[opencms-dev] Error rebuilding "Solr Offline" index

[Rüdiger Kurz]

Hi Enric,

thanks for the info, this proves my suggested reason for the problem and 
helps to solve it.

Please perform the previously described steps:

Replace in the WEB-INF/config/opencms-search.xml:
   <indexer class="org.opencms.search.CmsDependencyIndexer" />
with
   <indexer class="org.opencms.search.CmsVfsIndexer" />

For the background:
The document dependency indexer tries to resolve document dependencies 
based on the file name of a resource e.g. it indexes:

document.pdf
document_de.pdf
document_de_0001.pdf
document_de_0002.pdf
document_en.pdf
document_en_01.pdf
document_en_02.pdf
document_fr.pdf

that are inside the same folder as a single document. If the number 
after the last underscore is bigger than Integer.MAX_VALUE a 
NumberFormatException is thrown currently, I will fix that ASAP. Thank 
you again posting your issue.

The CmsDependencyIndexer is not needed in general, so switching the 
indexer class to CmsVfsIndexer, as described above, should work fine and 
also more fast in your case.

regards
Rüdiger


Am 13.02.2013 18:36, schrieb Albiach, Enric (MAD-MRM):
> Hi Rüdiger,
>
> After a scan on a 6'5GB database dump, we found the filename that is causing the bug on your side: /sites/default/caprabo/pasion/contenidos/comentarios/receta/valentosta1331810434000/rushing_831333108216000
>
> We hope it helps you.
>
> Thank you.
>
> Kind regards,
> Enric
>
>
>
> Enric Albiach
> Software Engineer
>
> M > +34.690.823.283  E > enric.albiach at mrmww.es
> Paseo de la Castellana 165, 4ª planta 28046 Madrid
> W > www.mrmworldwide.com
>
> Creativity
> Technology
> Performance
>
>
> -----Mensaje original-----
> De: Albiach, Enric (MAD-MRM)
> Enviado el: miércoles, 13 de febrero de 2013 18:16
> Para: 'Rüdiger Kurz'
> Asunto: RV: [opencms-dev] Error rebuilding "Solr Offline" index
>
> Hi Rüdiger,
>
> Unfortunately, we can't see in the logs which file is failing. We only see in the progress rebuiling window the previous file that works fine and we assume that the file which fails is the next one in the VFS directory (see attached images).
>
> Will be waiting for your comments.
>
> Thank you very much for your help.
>
> Kind regards,
> Enric
>
>
> Enric Albiach
> Software Engineer
>
> M > +34.690.823.283  E > enric.albiach at mrmww.es Paseo de la Castellana 165, 4ª planta 28046 Madrid W > www.mrmworldwide.com
>
> Creativity
> Technology
> Performance
>
> -----Mensaje original-----
> De: Rüdiger Kurz [mailto:r.kurz at alkacon.com] Enviado el: miércoles, 13 de febrero de 2013 15:58
> Para: The OpenCms mailing list
> CC: Albiach, Enric (MAD-MRM)
> Asunto: Re: [opencms-dev] Error rebuilding "Solr Offline" index
>
> Hi,
>
> probably you have found an issue, could you please send the full file name of the resource that causes the stack you posted?
>
> Assuming that you have copied the Solr field configuration
> (opencms-search.xml) from a release < 8.5.1 after you updated your system, you might have configured the CmsDependencyIndexer for indexing documents.
>
> To solve the problem edit the opencms-search.xml and replace all nodes:
>     <indexer class="org.opencms.search.CmsDependencyIndexer"/>+
>
> with
>     <indexer class="org.opencms.search.CmsVfsIndexer" />
>
> HTH
> -Rüdiger
>
> Am 13.02.2013 15:44, schrieb Albiach, Enric (MAD-MRM):
>> Hi all,
>>
>> We are getting the following error rebuilding the index "Solr Offline"
>> (FYI, we've migrated our contents from OpenCms 7.5.2 to OpenCms 8.5.1):
>>
>> Exception java.lang.NumberFormatException: For input string:
>> "831333108216000"
>>
>> at
>> java.lang.NumberFormatException.forInputString(NumberFormatException.j
>> ava:65)
>>
>> at java.lang.Integer.parseInt(Integer.java:495)
>>
>> at java.lang.Integer.parseInt(Integer.java:527)
>>
>> at
>> org.opencms.search.documents.CmsDocumentDependency.<init>(CmsDocumentD
>> ependency.java:187)
>>
>> at
>> org.opencms.search.documents.CmsDocumentDependency.<init>(CmsDocumentD
>> ependency.java:166)
>>
>> at
>> org.opencms.search.documents.CmsDocumentDependency.readDependencies(Cm
>> sDocumentDependency.java:743)
>>
>> at
>> org.opencms.search.documents.CmsDocumentDependency.load(CmsDocumentDep
>> endency.java:352)
>>
>> at
>> org.opencms.search.CmsDependencyIndexer.rebuildIndex(CmsDependencyInde
>> xer.java:176)
>>
>> at
>> org.opencms.search.CmsSearchManager.updateIndex(CmsSearchManager.java:
>> 2523)
>>
>> at
>> org.opencms.search.CmsSearchManager.rebuildIndexes(CmsSearchManager.ja
>> va:1644)
>>
>> at
>> org.opencms.search.CmsSearchManager.cmsEvent(CmsSearchManager.java:986
>> )
>>
>> at
>> org.opencms.main.CmsEventManager.fireEventHandler(CmsEventManager.java
>> :194)
>>
>> at
>> org.opencms.main.CmsEventManager.fireEvent(CmsEventManager.java:117)
>>
>> at
>> org.opencms.main.CmsEventManager.fireEvent(CmsEventManager.java:139)
>>
>> at org.opencms.main.OpenCms.fireCmsEvent(OpenCms.java:167)
>>
>> at
>> org.opencms.workplace.tools.searchindex.CmsIndexingReportThread.run(Cm
>> sIndexingReportThread.java:123)
>>
>> Moreover, we couldn't find the string/number "831333108216000"
>> anywhere (xmlcontents, database, content properties, etc.), any clue?
>>
>> Thank you very much in advance.
>>
>> Kind regards,
>>
>> Enric
>>
>> Description: C:\Users\matos.admin\Desktop\MRM_LOGO_RGB_WT.jpg
>>
>> *Enric Albiach*
>>
>> Software Engineer
>>
>> M > +34.690.823.283  E > enric.albiach at mrmww.es
>>
>> Paseo de la Castellana 165, 4ª planta 28046 Madrid
>>
>> W > www.mrmworldwide.com
>>
>> Creativity
>>
>> Technology
>>
>> Performance