[opencms-dev] Queue time is getting longer

Lorenzo Sala troubador at gmail.com
Fri Dec 4 12:11:58 CET 2009


Sorry about the tons of posts, 
                                        rebootng the CMS once more made
finally appear all the publishing that were now showing in the queue. Now
the only thing that we have to descover is why some projects publish the
"Non-Template Resources" and the "Template resources", even if unmodified,
this makes the wait queue long. We still have one project that works
smoothly and here is a result of it's publishing:

Publishing resources ...
Publishing files ...
( 1 / 1 ) Publishing file
/clienti_trading/bo/estero/europa/bonus_hsbc_ln.html ... o.k.
... finished publishing files
Statistics: published files: 1, published folders: 0, deleted folders: 0,
duration: 00:00:00
... the resources have been published
Exporting Non-Template Resources ...
... exporting Non-Template Resources is finished.
Exporting Template Resources ...
( 1 / 1 ) Exporting /clienti_trading/bo/estero/europa/bonus_hsbc_ln.html ...
o.k.
... exporting Template Resources is finished.
Updating search index "Online project EN (VFS)"
( 1 ) Indexing file
/sites/default/clienti_trading/bo/estero/europa/bonus_hsbc_ln.html ... o.k.
... finished updating search index "Online project EN (VFS)"
Updating search index "Online project DE (VFS)"
( 1 ) Indexing file
/sites/default/clienti_trading/bo/estero/europa/bonus_hsbc_ln.html ... o.k.
... finished updating search index "Online project DE (VFS)"

Just perfect and this is it's export-rule

          <export-rule>
          <name>Operazioni Societarie</name>
          <description>File delle operazioni societarie</description>
          <modified-resources>
          <regex>/sites/default/clienti_trading/.*</regex>
         
<regex>/system/default/modules/it.oursite.operazionisocietarie/.*</regex>
          </modified-resources>
          <export-resources>
          <uri>/sites/clienti_trading/</uri>
          </export-resources>
          </export-rule>


... when I created the export rule for the second project I started from
this one above and simply changed the paths :

          <export-rule>
          <name>Extranet Promotori</name>
          <description>File della Extranet Promotori</description>
          <modified-resources>
          <regex>/sites/extranet/.*</regex>
         
<regex>/system/default/modules/it.oursite.extranetpromotori/.*</regex>
          </modified-resources>
          <export-resources>
          <uri>/sites/extranet/</uri>
          </export-resources>
          </export-rule>

But somehow the publishing of this project exports ALL the site, and not
only the modified files. Any idea of where else I should see?

Lo'



Lorenzo Sala wrote:
> 
> Good Morning Ahchim.. the new day brought new symptoms.. we used the
> config with the new    <export-rule> but it seems that the export still
> exports something that we haven't asked to. 
> 
> Here is a brief of the last export:
> 
> Publishing resources ...
> Publishing files ...
> ( 1 / 1 ) Publishing file /sites/extranet/css/test/index.html ... o.k.
> ... finished publishing files
> Statistics: published files: 1, published folders: 0, deleted folders: 0,
> duration: 00:00:00
> ... the resources have been published
> Exporting Non-Template Resources ...
> ( 1 / 3,064 ) Exporting /sites/aaaa.html
> ( 2 / 3,064 ) Exporting .....
> (here are 3,064 files of that project, but we asked to export only this "
> /sites/extranet/css/test/index.html "
> 
> Here are the rules I created:
> 
>           <export-rule>
>           <name>Extranet</name>
>           <description>File della Extranet Promotori</description>
>           <modified-resources>
>           <regex>/sites/extranet/.*</regex>
>           <regex>/system/default/modules/it.oursite.extraneti/.*</regex>
>           </modified-resources>
>           <export-resources>
>           <uri>/sites/extranet/</uri>
>           </export-resources>
>           </export-rule>
> 
> So.. now not only it takes a lot of time to publish all, but the "User's
> last published" list doesn't show all the request in the queue. 
> 
> Does it makes any sense to you?
> 
> Lo'
> 
> 
> 
> 
> 
> 
> 
> Christian Steinert wrote:
>> 
>> Lorenzo Sala wrote:
>>> Ciao Achim,
>>>                may be I found the real problem that will solve most of
>>> our
>>> long waits. There is only 1 project that is exporting only the modified
>>> files and it takes about 1 second to export them. This project is the
>>> only
>>> one that has a <export-rule> configuration in the
>>> opencms-importexport.xml.
>>> All the other projects doesn't appear in this file at all. Could this be
>>> what causes CMS to republish ALL the files of all the projects when we
>>> do an
>>> export?
>>>   
>> Yes - exactly. If there is a fitting export-rule for your published 
>> file, then opencms will only export those files that are covered by this 
>> rule. If there is no such rule, then /all/ exportable resources will be 
>> re-exported.
>> 
>> So if you define separate export rules for each of your projects, then 
>> publishing will only cause the project-specific resources to be exported.
>> 
>>> I'm setting up some <export-rule> for the rest of the projects and
>>> tomorrow
>>> we'll see if that worked.
>>>   
>> This will definitely work.
>> 
>> 
>> Kind regards
>> Christian
>> 
>> 
>> _______________________________________________
>> This mail is sent to you from the opencms-dev mailing list
>> To change your list options, or to unsubscribe from the list, please
>> visit
>> http://lists.opencms.org/mailman/listinfo/opencms-dev
>> 
> 
> 

-- 
View this message in context: http://old.nabble.com/Queue-time-is-getting-longer-tp26625696p26635854.html
Sent from the OpenCMS - Dev mailing list archive at Nabble.com.




More information about the opencms-dev mailing list