[opencms-dev] Development Workplace with OC11 - Solr error

Wed Feb 17 09:49:43 CET 2021

Hello Peter,

I have no solution for your Solr problem.
Instead I would like to let you know, that we developed a OpenCms Maven-Plugin more than 10 years ago and use this since then in a lot of projects for development.
If you are interested you can have a look at https://opencms-maven.comundus.com/index.html.
Best regards
Kai

Von: opencms-dev <opencms-dev-bounces at opencms.org> Im Auftrag von Hanspeter Klapf
Gesendet: Dienstag, 16. Februar 2021 10:09
An: opencms-dev at opencms.org
Betreff: Re: [opencms-dev] Development Workplace with OC11 - Solr error

Hi all,

I've tried now starting my tomcat in an own cmd, but after little time passes by, my search index doesn't work anymore. So this was obviously not the solution...

16 Feb. 2021 09:53:47,029 ERROR [ache.solr.common.SolrException: 148] org.apache.solr.common.SolrException: this IndexWriter is closed
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:219)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:2559)
        at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:191)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
        at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:504)
        at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:479)
        at org.opencms.search.solr.CmsSolrIndexWriter.commit(CmsSolrIndexWriter.java:122)
        at org.opencms.search.CmsSearchManager.updateIndexIncremental(CmsSearchManager.java:3105)
        at org.opencms.search.CmsSearchManager.updateIndex(CmsSearchManager.java:2861)
        at org.opencms.search.CmsSearchManager.updateAllIndexes(CmsSearchManager.java:2801)
        at org.opencms.search.CmsSearchManager.cmsEvent(CmsSearchManager.java:1005)
        at org.opencms.main.CmsEventManager.fireEventHandler(CmsEventManager.java:175)
        at org.opencms.main.CmsEventManager.fireEvent(CmsEventManager.java:117)
        at org.opencms.main.OpenCms.fireCmsEvent(OpenCms.java:159)
        at org.opencms.publish.CmsPublishEngine.publishJobFinished(CmsPublishEngine.java:657)
        at org.opencms.publish.CmsPublishThread.run(CmsPublishThread.java:180)
Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
        at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
        at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
        at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3406)
        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:677)
        at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:102)
        at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:68)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor.java:2034)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1981)
        at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:72)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
        ... 15 more
Caused by: java.nio.file.FileAlreadyExistsException: C:\DEV\apache-tomcat-9.0.39_oc11\webapps\opencms\WEB-INF\index\Solr Online\index\_p.fdx
        at java.base/sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:87)
        at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:103)
        at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:108)
        at java.base/sun.nio.fs.WindowsFileSystemProvider.newByteChannel(WindowsFileSystemProvider.java:231)
        at java.base/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:478)

Any ideas?

Thanks for your help!!

BR,
  Peter

Gesendet: Dienstag, 16. Februar 2021 um 06:35 Uhr
Von: "Hanspeter Klapf" <hanspeter.klapf at gmx.at<mailto:hanspeter.klapf at gmx.at>>
An: opencms-dev at opencms.org<mailto:opencms-dev at opencms.org>
Betreff: Re: [opencms-dev] Development Workplace with OC11 - Solr error

Hi Daniel,

thanks for your reply!

Yes, I'm using the default solrconfig.xml.

I start/stop my tomcat out of Eclipse (Servers-View), having "Use Tomcat installation" configured. I can try starting and stopping tomcat direct in cmd, maybe there is a difference. I would prefer not seeing console output in my development-environment anymore (but in seperate window) over rebuilding search-index hourly.

BR,
  Peter

Gesendet: Montag, 15. Februar 2021 um 16:49 Uhr
Von: "Daniel Seidel" <d.seidel at alkacon.com<mailto:d.seidel at alkacon.com>>
An: opencms-dev at opencms.org<mailto:opencms-dev at opencms.org>
Betreff: Re: [opencms-dev] Development Workplace with OC11 - Solr error

Hi Peter,

how do you start/stop tomcat? Do you use the default solrconfig.xml (WEB-INF/solr/configsets/default/conf/solrconfig.xml)?

Best, Daniel
Am 15.02.21 um 13:53 schrieb Hanspeter Klapf:
Hello,

using OpenCms since version 7.5, I've tried various approaches for the development of modules. In previous versions I used some Eclipse-Plugin for module-deployment, then the Eurelis Ant Task, later I combined this with WebDAV-Access.

Since version 9.5, I was quite happy with running OpenCms on a Tomcat locally, an Eclipse-Projekt with a dynamic folder pointing to a mounted WebDAV-Path on this instance and a few Ant-Tasks for synchronizing the Project-Files with SVN, building Java-Classes and publish/export my module via CmsShell.

Now I am trying this usage on version 11.0.2 and it basically works, but my Solr-Index is quite often damaged, I get the following stacktrace at startup:

INFO [pencms.search.CmsSearchManager:2677] . Search index         : Successfully configured search index "Solr Online" for project "Online"
INFO [pencms.search.CmsSearchManager:1807] . Search Solr          : Solr index directory created for index "Solr Offline" (C:\DEV\apache-tomcat-9.0.39_oc11\webapps\opencms\WEB-INF\index\Solr Offline).
ERROR [he.solr.update.SolrIndexWriter: 341] SolrIndexWriter was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!
ERROR [he.solr.update.SolrIndexWriter: 291] Error closing IndexWriter
java.lang.NullPointerException: null
    at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3603) ~[lucene-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 11:58:55]
    at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3563) ~[lucene-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 11:58:55]
    at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1044) ~[lucene-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 11:58:55]
    at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1087) ~[lucene-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 11:58:55]
    at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:286) [solr-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 12:06:06]
    at org.apache.solr.update.SolrIndexWriter.finalize(SolrIndexWriter.java:342) [solr-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 12:06:06]
    at java.lang.System$2.invokeFinalize(System.java:2117) [?:?]
    at java.lang.ref.Finalizer.runFinalizer(Finalizer.java:87) [?:?]
    at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:171) [?:?]
    Suppressed: java.lang.NullPointerException
        at org.apache.lucene.index.IndexWriter.rollbackInternalNoCommit(IndexWriter.java:2288) ~[lucene-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 11:58:55]
        at org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2266) ~[lucene-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 11:58:55]
        at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1051) ~[lucene-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 11:58:55]
        at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1087) ~[lucene-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 11:58:55]
        at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:286) [solr-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 12:06:06]
        at org.apache.solr.update.SolrIndexWriter.finalize(SolrIndexWriter.java:342) [solr-core-8.0.0.jar:8.0.0 2ae4746365c1ee72a0047ced7610b2096e438979 - jimczi - 2019-03-08 12:06:06]
        at java.lang.System$2.invokeFinalize(System.java:2117) [?:?]
        at java.lang.ref.Finalizer.runFinalizer(Finalizer.java:87) [?:?]
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:171) [?:?]

If that's the case, I have to delete the indexes and rebuild them (CmsShell-Task rebuildAllIndexes). Allthough this is working, it is quite anoying and takes quite long.

At Tomcat-shutdown I get the following message, don't know if this is related...
WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [opencms] appears to have started a thread named [Notify_null] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
 java.base at 11/java.lang.Object.wait<mailto:java.base at 11/java.lang.Object.wait>(Native Method)
 java.base at 11/java.lang.Object.wait<mailto:java.base at 11/java.lang.Object.wait>(Object.java:328)
 org.alfresco.jlan.smb.server.notify.NotifyChangeHandler.run(NotifyChangeHandler.java:1008)
 java.base at 11/java.lang.Thread.run<mailto:java.base at 11/java.lang.Thread.run>(Thread.java:834)

I'm grateful for suggestions as to how I could set up my environment better or what the cause of this behaviour may be.

BR,
  Peter

_______________________________________________

This mail is sent to you from the opencms-dev mailing list

To change your list options, or to unsubscribe from the list, please visit

https://lists.opencms.org/mailman/listinfo/opencms-dev

--

Kind Regards,

Daniel.

-------------------

Daniel Seidel

Alkacon Software GmbH & Co. KG - The OpenCms Experts

http://www.alkacon.com - http://www.opencms.org
_______________________________________________ This mail is sent to you from the opencms-dev mailing list To change your list options, or to unsubscribe from the list, please visit https://lists.opencms.org/mailman/listinfo/opencms-dev
_______________________________________________ This mail is sent to you from the opencms-dev mailing list To change your list options, or to unsubscribe from the list, please visit https://lists.opencms.org/mailman/listinfo/opencms-dev
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.opencms.org/pipermail/opencms-dev/attachments/20210217/46410482/attachment.htm>