User Guide

Paths and URLs Options 163
Paths and URLs Options
-auth
Syntax: -auth path_and_filename
Specifies an authorization file to support authentication for secure paths.
Note
There must be a corresponding "
Authfile=" entry in the Information Server
configuration file,
inetsrch.ini, so that documents can be accessed for viewing.
Both -auth and Authfile= must point to the same file.
-cgiok
Typ e: Web crawling only.
Allows indexing of URLs containing the ? symbol. This typically means the URL leads
to a CGI or other such processing program.
The return document produced by the Web server is indexed and parsed for
document links which are followed and in turn indexed and parsed. However, if the
Web server does not return a page, perhaps because the URL is missing parameters
which are required for processing in order to produce a page, then nothing happens.
There is no page to index and parse.
Example
A URL without parameters is:
http://server.com/cgi-bin/program?
If you include parameters in the URL to be indexed, as specified with the -start
option, then those parameters are processed and any resulting pages are indexed
and parsed.
By default, URLs with ? symbols are skipped.
-domain
Syntax: -domain name_1 [name_n] ...
Type: Web crawling only.
Limits indexing to the specified domain(s). You must use only complete text strings
for domains. You may not use wildcard expressions. URLs not in the specified
domain(s) will not be downloaded or parsed.
You may list multiple domains by separating each one with a single space.
Note
You must have the appropriate Verity Spider licensing capability to use this option.