User Guide

182 Chapter 8 Verity Spider
When you encounter MIME Types being dropped, make sure the Web server you are
indexing has the necessary MIME Type information. See the documentation for your
Web server for information about specifying MIME Types.
You can examine the indexing job’s log files for indications that files are being
skipped due to MIME Types. For example, a typical ASCII file you might want
indexed is a log file (filename.log). Unless the Web server understands that files with
.LOG extensions are ASCII text, of MIME Type text/plain, you will see in the indexing
job log file that .LOG files are skipped because of MIME Type even if you use:
-mimeinclude ’text/*’
MIME types and file system indexing
When you index a file system, the Verity Spider reads filenames and evaluates your
MIME Type criteria against an internal, compiled list of known MIME Types and
associated file extensions. You cannot edit this list. However, you can use the
-mimemap option to create a custom MIME Type mapping.
When you encounter MIME Types being dropped, check if the Verity Spider
recognizes that particular MIME Type. See the table, “Known MIME types for file
system indexing” on page 183 for more details.
You can examine the indexing job’s log files for indications that files are being
skipped due to MIME types. For example, a typical ASCII file you might want indexed
is a log file (filename.log). Since the Verity Spider does not understand that files
with .LOG extensions are ASCII text, of MIME Type text/plain, you will see in the
indexing job log file that .LOG files are skipped because of MIME Type even if you
use:
-mimeinclude ’text/*’.Setting MIME Types
Indexing unknown MIME types
Whenever you find MIME Types being dropped, or you know you will be indexing
files whose extensions are not known to the Verity Spider by default, use the
-mimemap option to point to a file which contains your own custom mappings for file
extensions and MIME Types.
You can also use the regular expression ’*/*’ for your MIME Type criteria.
For example:
-mimeinclude ’*/*’
Remember, on either platform you need to include single quotes for values which
include wildcard characters.