[opencms-dev] random error during static export of about 3000 files

[Christian Schmidt]

Hi,

 > You could use wget to write the files to disk.
 > AFAIK the static export of OpenCms work similar.
 > That's why I asked if the online view works.
 > And that's why I suggested a "linkfile" to
 > e. g. Flash movies which wget can't find
 > when mirroring a website.

now I see what you mean, yes it would be a good idea but we can't do 
that because all of our pages are jsps and contain jsp-code. The jsps 
get interpreted while fetching them with wget :( (we have .txt files 
with the jsp code within opencms and include them in the pages as needed...)

 >>> What I did last night to temporarily solve the problem was to remove
 >>> pages so that we reached a number of files of about 2750 (2950 also
 >>> didn't work) - and it works again. It looks like some constraint has
 >>> been reached or some overflow or something, dont know.
 >
 > Backup your DB and clear the history completely,
 > so no older version will exist.

I will try to do that, thankyou!

I just set the log level to INFO and got the following Exception for the 
pages that produce the 404:




07 Apr 2005 12:15:01,527  WARN [rg.opencms.main.OpenCmsServlet: 158] 
Error exporting
org.opencms.staticexport.CmsStaticExportData[vfsName=/sites/default/oursite/some/path/somepage.jsp,
rfsName=/oursite/some/path/somepage.jsp, 
structureId=a37ce605-1cff-11d9-96ef-8df6bc3a05d3]
javax.servlet.ServletException: javax.servlet.jsp.JspException: null
         at 
org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:821)
         at 
org.apache.jasper.runtime.PageContextImpl.handlePageException(PageContextImpl.java:758)
         at 
org.apache.jsp.WEB_002dINF.jsp.online.system.modules.our.module.templates.our_005fstandard_jsp._jspService(our_005fstandard_jsp.j
ava:242)
         at 
org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
         at 
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:298)
         at 
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:292)
         at 
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:236)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
         at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:237)
         at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
         at 
org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:703)
         at 
org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:589)
         at 
org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:499)
         at 
org.opencms.flex.CmsFlexRequestDispatcher.includeExternal(CmsFlexRequestDispatcher.java:358)
         at 
org.opencms.flex.CmsFlexRequestDispatcher.include(CmsFlexRequestDispatcher.java:163)
         at org.opencms.loader.CmsJspLoader.service(CmsJspLoader.java:406)
         at 
org.opencms.flex.CmsFlexRequestDispatcher.include(CmsFlexRequestDispatcher.java:294)
         at 
org.opencms.loader.CmsJspLoader.dispatchJsp(CmsJspLoader.java:426)
         at org.opencms.loader.CmsJspLoader.export(CmsJspLoader.java:232)
         at 
org.opencms.loader.CmsXmlPageLoader.export(CmsXmlPageLoader.java:112)
         at 
org.opencms.staticexport.CmsStaticExportManager.export(CmsStaticExportManager.java:419)
         at org.opencms.main.OpenCmsServlet.handle(OpenCmsServlet.java:155)
         at 
org.opencms.main.OpenCmsServlet.invokeHandler(OpenCmsServlet.java:238)
         at org.opencms.main.OpenCmsServlet.doGet(OpenCmsServlet.java:101)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:697)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:810)
         at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:237)
         at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
         at 
org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:703)
         at 
org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:465)
         at 
org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:398)
         at 
org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:312)
         at 
org.apache.catalina.core.StandardHostValve.custom(StandardHostValve.java:396)
         at 
org.apache.catalina.core.StandardHostValve.status(StandardHostValve.java:301)
         at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:147)
         at 
org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
         at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
         at 
org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
         at 
org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
         at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
         at 
org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
         at 
org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
         at 
org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:929)
         at 
org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:160)
         at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:793)
         at 
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:702)
         at 
org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:571)
         at 
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:644)
         at java.lang.Thread.run(Thread.java:534)
07 Apr 2005 12:15:01,533  INFO [cexport.CmsStaticExportManager:1527] 
Request result
for RFS file /oursite/some/path/somepage.jsp with url
(http://our.ip.addr:8081/handle404/site/oursite/some/path/somepage.jsp) 
was STATUS=404


It more and more looks like some memory-or-something-problem, what do 
you think? (we give tomcat 768M)

Gonna try the history now...

Thanx for your help!

Regards,
Christian