[opencms-dev] Indexing the dynamic part of OpenCMS with htDig

[Olli Aro]

Hi all,

I got help for this from the htdig forum. Below are the cause and resolution
is case someone will need it in future.

Cause:

"OpenCMS handles a "directory URL" with a trailing slash by providing a
redirect to the same URL with index.html appended. But, htdig treats these
two URLs as the same, because with your average
HTTP server they are. Apache and most other HTTP servers, when handling a
request for a directory URL on their own, would return the contents of
index.html or some other default document without doing a redirect. To
prevent indexing the same document twice, htdig strips off the usually
redundant default document name for the directory.  This is handled by
http://www.htdig.org/attrs.html#remove_default_doc"

Resolution:

Add the following line in your htdig.conf;

remove_default_doc:

Regards,

Olli