- xwiki-users@xwiki.org - lists.xwiki.org

Re: [xwiki-users] Futex errors
by vincent＠massol.net 22 Feb '15

22 Feb '15

On 22 Feb 2015 at 19:43:08, Aaron Hardy at AC (ashtarcommunications@gmail.com(mailto:ashtarcommunications@gmail.com)) wrote: > Hi Vincent, > > Thanks for the follow-up. > > I never managed to track down the exact cause of the futex lock or gettimeofday calls. My best guess is that it has something to do with XWiki running on an Amazon EC2 instance. I didn't see the same kind of issues on a local machine. I had another thread a few months ago where I asked if anyone had successfully run XWiki on AWS, and it didn't seem like there was much experience with that setup. > > My short term solution was just to double the RAM and throw it all at XWiki. That seems to have mostly dealt with the stability issues (at least, the instance rarely crashes under load), but under the hood I think it's still performing much worse than it should be. > > Any ideas you have about what might be causing the issue, or any tips for running XWiki on Amazon under reasonably high loads would be much appreciated. Thanks for the information and indeed you could be right about the Amazon EC2 context for the futex problem. I don’t have any experience with running XWiki on Amazon EC2 so I cannot help much, sorry. Thanks -Vincent > Thanks, > > aaron > > > > On Fri, Feb 20, 2015 at 10:05 AM, vincent@massol.net(mailto:vincent@massol.net) wrote: > > Hi Aaron, > > > > Sorry you didn’t get any answer… > > > > Were you able to find out the problem and improve XWiki under load? > > > > Thanks > > -Vincent > > > > > > On 20 Sep 2014 at 06:52:10, Aaron Hardy at AC (ashtarcommunications@gmail.com(mailto:ashtarcommunications@gmail.com)(mailto:ashtarcommunications@gmail.com)) wrote: > > > > > Trying to track down the source of some persistent performance issues under > > > load with 6.2 RC 1 (haven't had time to upgrade to 6.2 final yet). I'm > > > maxing out at about 30 or so users before dying on a system with 4GB of RAM. > > > > > > The java interpreter is getting pegged to 100% of the CPU, and about 70% of > > > the calls in the stack trace are futex lock errors. A good chunk of the > > > remainder are gettimeofday calls. > > > > > > Potentially useful info (sorry for formatting): > > > > > > % time seconds usecs/call calls errors syscall > > > ------ ----------- ----------- --------- --------- ---------------- > > > 72.75 5361.592109 45075 118947 14045 futex > > > 12.28 905.064191 466 1943354 gettimeofday > > > 4.83 356.110745 3709487 96 45 restart_syscall > > > 2.88 212.173358 836 253729 clock_gettime > > > 2.71 199.867690 8802 22706 recvfrom > > > 2.10 154.843342 37841 4092 poll > > > 1.14 84.282371 580 145307 130153 stat > > > > > > Any ideas? > > > > > > thanks, > > > > > > aaron > > >

1 0

[xwiki-users] Stéphane LASSIRE est en congés.
by Stéphane LASSIRE 21 Feb '15

21 Feb '15

Je serai absent(e) à partir du 21/02/2015 de retour le 25/02/2015. je suis en congés. Je répondrai à vos messages dès mon retour. En cas de problème technique, veuillez contacter SYNOX au 05 67 34 66 56. Merci

1 0

[xwiki-users] Futex errors
by Aaron Hardy at AC 20 Feb '15

20 Feb '15

Trying to track down the source of some persistent performance issues under load with 6.2 RC 1 (haven't had time to upgrade to 6.2 final yet). I'm maxing out at about 30 or so users before dying on a system with 4GB of RAM. The java interpreter is getting pegged to 100% of the CPU, and about 70% of the calls in the stack trace are futex lock errors. A good chunk of the remainder are gettimeofday calls. Potentially useful info (sorry for formatting): % time seconds usecs/call calls errors syscall ------ ----------- ----------- --------- --------- ---------------- 72.75 5361.592109 45075 118947 14045 futex 12.28 905.064191 466 1943354 gettimeofday 4.83 356.110745 3709487 96 45 restart_syscall 2.88 212.173358 836 253729 clock_gettime 2.71 199.867690 8802 22706 recvfrom 2.10 154.843342 37841 4092 poll 1.14 84.282371 580 145307 130153 stat Any ideas? thanks, aaron

2 1

[xwiki-users] Fw: Re: Default Wiki Pages XML Files not Installed
by vincent＠massol.net 20 Feb '15

20 Feb '15

Oops, the users list was dropped! -Vincent On 20 Feb 2015 at 17:55:57, vincent(a)massol.net (vincent(a)massol.net) wrote: On 20 Feb 2015 at 17:42:47, Erin Kelley (erinmkelley7@gmail.com(mailto:erinmkelley7@gmail.com)) wrote: > Well the issue could be that the server is behind a firewall that does not get outside internet access. If the UI installer of the DW contacts xwiki.org(http://xwiki.org) like you are saying, then that explains why it will not find the extension. I have to import them manually then. XWiki works find behind proxies :) You just need to configure XWiki for that, see: http://platform.xwiki.org/xwiki/bin/view/AdminGuide/Installation#HRunningXW… > I'm gonna try a clean instance by following your directions. I'm using a tomcat on a windows machine so there isn't a /var/local/xwiki where my Xwiki permanent directory is located. I'm assuming that its /tomcat/temp/xwiki. There were only 2 files in here but i deleted the directory anyways. If you haven’t set any permanent dir then you have a WARNING in your logs saying it’s using the temporary directory and that you need to set it to a proper place that has not risk of being deleted! :) > If i run into more issues I'll shoot you another message with helpful screenshots. Thanks -Vincent > Thanks so much for taking the time to help me! > > On Fri, Feb 20, 2015 at 9:49 AM, vincent@massol.net(mailto:vincent@massol.net) wrote: > > Hi Erin, > > > > On 20 Feb 2015 at 15:09:27, Erin Kelley (erinmkelley7@gmail.com(mailto:erinmkelley7@gmail.com)(mailto:erinmkelley7@gmail.com)) wrote: > > > > > Hi Vincent, > > > > > > Thanks for the response! > > > > > > The import status showed that some pages were installed. I cannot remember what exactly these were because I'm not sure what all was contained in the default wiki pages .xar file. What I do know is that every file that the import status said was not installed was a .xml file. I do remember checking the files that the import status showed were properly installed and absolutely no .xml files were installed. > > > > All the pages located in the XAR file are XML files :) The import only import wiki pages (i.e. XML files). > > > > I have no clue why it fails. If you can reproduce with a clean install, I’ll suggest you create a jira issue at http://jira.xwiki.org so that it gets fixed. > > > > > As to why I didn't use the distribution wizard: The distribution wizard, when loaded the first time I went to the wiki, showed a message that said it could not find the default wiki pages version 6.4.1. I'm not sure why it said this because I just followed the administrator guide which included the unpacking of the xwiki-enterprise-web-6.4.1.war that I downloaded. So I googled this issue and saw that I could download the default pages and then login as a super admin and import them. > > > > You must have some bad luck and maybe you tried the DW at a time when xwiki.org(http://xwiki.org) was down and thus not answering from your XWiki instance. > > > > In any case since you have a non functional instance at the moment, I’d suggest you try again clean. You can do that simply by 1) stopping XWiki 2) deleting the full content of the XWiki permanent directory (see permanentDirectory in your xwiki.properties file) and 3) restarting XWiki. > > > > Let us know how it goes. > > > > Thanks > > -Vincent > > > > > Thanks again for the help! I really appreciate it! > > > > > > Erin > > > > > > On Fri, Feb 20, 2015 at 7:54 AM, vincent@massol.net(mailto:vincent@massol.net)(mailto:vincent@massol.net) wrote: > > > > Hi Erin, > > > > > > > > On 19 Feb 2015 at 17:55:52, Erin Kelley (erinmkelley7@gmail.com(mailto:erinmkelley7@gmail.com)(mailto:erinmkelley7@gmail.com)(mailto:erinmkelley7@gmail.com)) wrote: > > > > > > > > > Hello, > > > > > > > > > > I setup a Tomcat server with a MySQL database and am trying to setup Xwiki > > > > > on it. I followed the administrator installation guide and ran into a > > > > > problem that I can't seem to find the solution to. Everything seemed to > > > > > work properly until I tried to import the > > > > > xwiki-enterprise-ui-mainwiki-all-6.4.1.xar. After the import was done, I > > > > > was shown a list of files that were installed as well as the ones that were > > > > > not installed. It seemed that none of the xml files were installed. Has > > > > > anyone ran across this issue before? I can still navigate across the wiki, > > > > > but, for instance, when I click on the admin's profile or preferences, no > > > > > text boxes or buttons of any kind appear. It pretty much shows just a blank > > > > > page. > > > > > > > > So, some pages were installed but not all and the import status said that no page was installed? > > > > > > > > BTW why didn’t you use the Distribution Wizard which should have appeared when you started tomcat and entered an XWiki URL? > > > > > > > > See http://platform.xwiki.org/xwiki/bin/view/AdminGuide/InstallationWAR#HConclu… > > > > > > > > Thanks > > > > -Vincent > > > > > > > > > Any help would be appreciated. Thanks! > > > > > > > > > >

1 0

[xwiki-users] Failed to execute the [groovy] macro while creating an app within a minute
by Peter Duever 20 Feb '15

20 Feb '15

Hello XWiki Community, while creating an App within a Minute I get groovy executing failures for each element of the form. It is possible to save and finish the process but I cannot access the editor for the content field. That means I cannot enter default entries. You can see the full failure message at the end of the mail. I googled the problem and found entries for Confluence. Maybe they can guide a way: Now I added the "-XX:ReservedCodeCacheSize=64m" option into JAVA_OPTS. (https://bobswift.atlassian.net/browse/SCRP-129) and It worked for me, I just added XX:ReservedCodeCacheSize to my setenv.sh and until now everything is ok. (https://answers.atlassian.com/questions/13535/problem-with-the-script-runne…) I am running version 5.4.5 Thank you for your time! Best regards, Peter Here is the error which is displayed when I reenter the wizard page for step 2: Failed to execute the [groovy] macro: java.lang.VerifyError: (class: org/codehaus/groovy/runtime/ArrayUtil, method: createArray signature: ()[Ljava/lang/Object;) Illegal type in constant pool at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:190) at Script89.run(Script89.groovy:41) at org.codehaus.groovy.jsr223.GroovyScriptEngineImpl.eval(GroovyScriptEngineImpl.java:346) at org.codehaus.groovy.jsr223.GroovyScriptEngineImpl.eval(GroovyScriptEngineImpl.java:146) at org.xwiki.rendering.macro.script.AbstractJSR223ScriptMacro.eval(AbstractJSR223ScriptMacro.java:292) at org.xwiki.rendering.macro.script.AbstractJSR223ScriptMacro.evaluateBlock(AbstractJSR223ScriptMacro.java:226) at org.xwiki.rendering.macro.script.AbstractJSR223ScriptMacro.evaluateBlock(AbstractJSR223ScriptMacro.java:177) at org.xwiki.rendering.macro.script.AbstractJSR223ScriptMacro.evaluateBlock(AbstractJSR223ScriptMacro.java:57) at org.xwiki.rendering.macro.script.AbstractScriptMacro.execute(AbstractScriptMacro.java:198) at org.xwiki.rendering.macro.script.AbstractScriptMacro.execute(AbstractScriptMacro.java:59) at org.xwiki.rendering.internal.transformation.macro.MacroTransformation.transformOnce(MacroTransformation.java:191) at org.xwiki.rendering.internal.transformation.macro.MacroTransformation.transform(MacroTransformation.java:132) at org.xwiki.rendering.internal.transformation.DefaultTransformationManager.performTransformations(DefaultTransformationManager.java:87) at org.xwiki.display.internal.DocumentContentDisplayer.display(DocumentContentDisplayer.java:252) at org.xwiki.display.internal.DocumentContentDisplayer.display(DocumentContentDisplayer.java:125) at org.xwiki.display.internal.DocumentContentDisplayer.display(DocumentContentDisplayer.java:55) at org.xwiki.display.internal.DefaultDocumentDisplayer.display(DefaultDocumentDisplayer.java:80) at org.xwiki.display.internal.DefaultDocumentDisplayer.display(DefaultDocumentDisplayer.java:38) at org.xwiki.sheet.internal.SheetDocumentDisplayer.display(SheetDocumentDisplayer.java:253) at org.xwiki.sheet.internal.SheetDocumentDisplayer.applySheet(SheetDocumentDisplayer.java:212) at org.xwiki.sheet.internal.SheetDocumentDisplayer.maybeDisplayWithSheet(SheetDocumentDisplayer.java:164) at org.xwiki.sheet.internal.SheetDocumentDisplayer.display(SheetDocumentDisplayer.java:102) at org.xwiki.sheet.internal.SheetDocumentDisplayer.display(SheetDocumentDisplayer.java:50) at org.xwiki.display.internal.ConfiguredDocumentDisplayer.display(ConfiguredDocumentDisplayer.java:67) at org.xwiki.display.internal.ConfiguredDocumentDisplayer.display(ConfiguredDocumentDisplayer.java:41) at com.xpn.xwiki.doc.XWikiDocument.getRenderedContent(XWikiDocument.java:997) at com.xpn.xwiki.doc.XWikiDocument.getRenderedContent(XWikiDocument.java:976) at com.xpn.xwiki.doc.XWikiDocument.getRenderedContent(XWikiDocument.java:1007) at com.xpn.xwiki.api.Document.getRenderedContent(Document.java:619) at sun.reflect.GeneratedMethodAccessor343.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.doInvoke(UberspectImpl.java:395) at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:384) at org.apache.velocity.runtime.parser.node.ASTMethod.execute(ASTMethod.java:173) at org.apache.velocity.runtime.parser.node.ASTReference.execute(ASTReference.java:280) at org.apache.velocity.runtime.parser.node.ASTReference.value(ASTReference.java:567) at org.apache.velocity.runtime.parser.node.ASTExpression.value(ASTExpression.java:71) at org.apache.velocity.runtime.parser.node.ASTSetDirective.render(ASTSetDirective.java:142) at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:342) at org.xwiki.velocity.internal.DefaultVelocityEngine.evaluate(DefaultVelocityEngine.java:228) at org.xwiki.velocity.internal.DefaultVelocityEngine.evaluate(DefaultVelocityEngine.java:187) at com.xpn.xwiki.render.XWikiVelocityRenderer.evaluate(XWikiVelocityRenderer.java:105) at com.xpn.xwiki.internal.template.DefaultPrivilegedTemplateRenderer.evaluate(DefaultPrivilegedTemplateRenderer.java:125) at com.xpn.xwiki.internal.template.DefaultPrivilegedTemplateRenderer.evaluateTemplate(DefaultPrivilegedTemplateRenderer.java:75) at com.xpn.xwiki.XWiki.evaluateTemplate(XWiki.java:1687) at com.xpn.xwiki.XWiki.parseTemplate(XWiki.java:1627) at com.xpn.xwiki.api.XWiki.parseTemplate(XWiki.java:918) at sun.reflect.GeneratedMethodAccessor165.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.doInvoke(UberspectImpl.java:395) at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:384) at org.apache.velocity.runtime.parser.node.ASTMethod.execute(ASTMethod.java:173) at org.apache.velocity.runtime.parser.node.ASTReference.execute(ASTReference.java:280) at org.apache.velocity.runtime.parser.node.ASTReference.render(ASTReference.java:369) at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72) at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:216) at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:311) at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:230) at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:207) at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72) at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:87) at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:72) at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:342) at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:106) at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:342) at org.xwiki.velocity.internal.DefaultVelocityEngine.evaluate(DefaultVelocityEngine.java:228) at org.xwiki.velocity.internal.DefaultVelocityEngine.evaluate(DefaultVelocityEngine.java:187) at com.xpn.xwiki.render.XWikiVelocityRenderer.evaluate(XWikiVelocityRenderer.java:105) at com.xpn.xwiki.internal.template.DefaultPrivilegedTemplateRenderer.evaluate(DefaultPrivilegedTemplateRenderer.java:125) at com.xpn.xwiki.internal.template.DefaultPrivilegedTemplateRenderer.evaluateTemplate(DefaultPrivilegedTemplateRenderer.java:75) at com.xpn.xwiki.XWiki.evaluateTemplate(XWiki.java:1687) at com.xpn.xwiki.web.Utils.parseTemplate(Utils.java:167) at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:304) at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:129) at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:425) at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:228) at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1913) at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:449) at javax.servlet.http.HttpServlet.service(HttpServlet.java:621) at javax.servlet.http.HttpServlet.service(HttpServlet.java:722) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:304) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at com.xpn.xwiki.web.ActionFilter.doFilter(ActionFilter.java:121) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.xwiki.wysiwyg.server.filter.ConversionFilter.doFilter(ConversionFilter.java:126) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at com.xpn.xwiki.plugin.webdav.XWikiDavFilter.doFilter(XWikiDavFilter.java:66) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.xwiki.container.servlet.filters.internal.SavedRequestRestorerFilter.doFilter(SavedRequestRestorerFilter.java:208) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.xwiki.container.servlet.filters.internal.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:111) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:185) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:151) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:929) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:405) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:269) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:515) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:302) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662)

2 1

[xwiki-users] Default Wiki Pages XML Files not Installed
by Erin Kelley 20 Feb '15

20 Feb '15

Hello, I setup a Tomcat server with a MySQL database and am trying to setup Xwiki on it. I followed the administrator installation guide and ran into a problem that I can't seem to find the solution to. Everything seemed to work properly until I tried to import the xwiki-enterprise-ui-mainwiki-all-6.4.1.xar. After the import was done, I was shown a list of files that were installed as well as the ones that were not installed. It seemed that none of the xml files were installed. Has anyone ran across this issue before? I can still navigate across the wiki, but, for instance, when I click on the admin's profile or preferences, no text boxes or buttons of any kind appear. It pretty much shows just a blank page. Any help would be appreciated. Thanks!

2 3

[xwiki-users] Black gallery after PowerPoint import
by D R 20 Feb '15

20 Feb '15

Hi guys, we discovered an issue with XWiki 6.3. After importing a PowerPoint presentation from within the WYSIWYG editor and saving the page the presentation is added to the attachments but the document shows a black gallery with 0/0 slides. In the log files I don't see any errors concerning this. We're on Windows Server 2003 R2, Tomcat 7, JDK 7, Apache 2.4, Libre Office 4.3 Is this a bug I should report a Jira about or is there something you can suggest to me? BR, Dennis

2 2

[xwiki-users] Description and priority list for XWiki translations
by Valdis Vītoliņš 19 Feb '15

19 Feb '15

I'm updating XWiki translations in http://l10n.xwiki.org/ and after resource redesign I wonder where should I start. Can you provide some list of description/priorities for all XWiki platforms and files, which should be translated first to cover needs of the most usual XWiki users. Thanks! Valdis

1 0

[xwiki-users] Accidently deleted wiki
by Michael Kurbatov 19 Feb '15

19 Feb '15

We were creating a tutorial wiki for our company. During the making of it, we wanted to delete a space by clicking XWiki drop down menu on the home page and clicking delete. Instead of deleting the space the whole wiki got deleted... Is there a way to retrieve the lost content? Regards, Mikhail

4 7

Re: [xwiki-users] XWiki search/Solr support for additional filetypes
by Arnold, Garth 18 Feb '15

18 Feb '15

Hi Vincent - thanks for the reply. Are both the 7.x series and 6.4.x using Tika 1.7? Garth -----Original Message----- Message: 5 Date: Wed, 18 Feb 2015 15:32:17 +0100 From: "=?utf-8?Q?vincent=40massol.net?=" <vincent(a)massol.net> To: Marius Dumitru Florea <mariusdumitru.florea(a)xwiki.com>, XWiki Users <users(a)xwiki.org> Subject: Re: [xwiki-users] XWiki search/Solr support for additional filetypes Message-ID: <etPan.54e4a271.12200854.269a(a)vmassol.local> Content-Type: text/plain; charset="utf-8" On 16 Dec 2014 at 11:48:44, Marius Dumitru Florea (mariusdumitru.florea@xwiki.com(mailto:mariusdumitru.florea@xwiki.com)) wrote: > On Tue, Dec 16, 2014 at 2:11 AM, Arnold, Garth wrote: > > Hello Marius - thank you for the detailed reply. My goal is (2) - to find all documents with a .7z attachment, where those attachments include file(s) containing "foo". If I read your email correctly, Tika 1.6 (5) is root cause for my failure to search successfully for text within the files contained in a .7z attachment. I am successful with my search when using a .zip file as the attachment - so we will instruct wiki users to avoid .7z attachments. > > Yes, at least until we upgrade to Tika 1.7. FTR we?re now using Tika 1.7 in the latest versions of XWiki. Thanks -Vincent > Thanks, > Marius > > > > > Garth > > > >> -----Original Message----- > >> Message: 2 > >> Date: Thu, 11 Dec 2014 08:42:20 +0200 > >> From: Marius Dumitru Florea > >> To: XWiki Users > >> Subject: Re: [xwiki-users] XWiki search/Solr support for additional > >> filetypes > >> Message-ID: > >> > >> AkCcNA(a)mail.gmail.com> > >> Content-Type: text/plain; charset=UTF-8 > >> > >> It depends what you mean by "search attachments that are 7-Zip .7z > >> archives": > >> > >> (1) Give me all the documents that have an attachment of mime type > >> application/x-7z-compressed > >> (2) Give me all the documents that have a 7-Zip archive attached that > >> includes a file that contains the word "foo" > >> > >> If you use Solr, the default search engine for XWiki 6.2.4, then the > >> code that is responsible for indexing the attachments is > >> AttachmentSolrMetadataExtractor [1]. This is a component so it can be > >> overridden as per [2]. The current implementation uses Tika [3] to: > >> > >> (1) detect the mime type of the attachment > >> (2) extract indexable content from the attachment (whatever its mime > >> type may be) > >> > >> For (1) Tika supports detecting the 7-Zip mime type since version 1.2 > >> [4]. For (2) judging by [5] it seems Tika also supports reading 7-ZIP > >> archives but there were some issues in 1.6 that have been fixed in > >> 1.7. We are currently using Tika 1.6 in XWiki. We should probably > >> upgrade. > >> > >> Hope this helps, > >> Marius > >> > >> [1] https://github.com/xwiki/xwiki-platform/blob/master/xwiki-platform- > >> core/xwiki-platform-search/xwiki-platform-search-solr/xwiki-platform- > >> search-solr- > >> api/src/main/java/org/xwiki/search/solr/internal/metadata/AttachmentSolr > >> MetadataExtractor.java > >> [2] > >> http://extensions.xwiki.org/xwiki/bin/view/Extension/Component+Module > >> #HOverrides > >> [3] https://github.com/xwiki/xwiki-platform/blob/master/xwiki-platform- > >> core/xwiki-platform-search/xwiki-platform-search-solr/xwiki-platform- > >> search-solr- > >> api/src/main/java/org/xwiki/search/solr/internal/metadata/AbstractSolrMet > >> adataExtractor.java#L458 > >> [4] https://issues.apache.org/jira/browse/TIKA-940 > >> [5] https://issues.apache.org/jira/browse/TIKA-1411 > >> > >> On Wed, Dec 10, 2014 at 9:20 PM, Arnold, Garth wrote: > >> > Hello - is it possible to enable searching of additional filetypes within XWiki > >> 6.2.4? Specifically I would like to be able to search attachments that are 7-Zip > >> .7z archives. It looks to me as though the underlying library (Commons > >> Compress) supports this filetype, but I am a new XWiki user and non-java > >> programmer so I may be assuming too much. > >> > > >> > Thanks in advance for your thoughts on this - > >> > > >> > Garth Arnold ________________________________ GHC Confidentiality Statement This message and any attached files might contain confidential information protected by federal and state law. The information is intended only for the use of the individual(s) or entities originally named as addressees. The improper disclosure of such information may be subject to civil or criminal penalties. If this message reached you in error, please contact the sender and destroy this message. Disclosing, copying, forwarding, or distributing the information by unauthorized individuals or entities is strictly prohibited by law.

2 1