Specifications

5-14
Cisco Internet Streamer CDS 2.0-2.3 Software Configuration Guide
OL-13493-04
Chapter 5 Configuring Services
Configuring Delivery Services
The crawler feature starts with the Source URL, identifies every web link in the page, and adds every
link to the list of URLs to search, until the links have been followed to the specified depth.
The Link Depth field specifies how many levels of a website to crawl or how many directory levels of
an FTP server to search. This is optional. The range is –1 to 2147483636.
If the depth is –1, there is no depth constraint.
If the depth is 0, content is acquired only at the starting URL.
If the depth is 1, content is acquired starting at the URL and includes content the URL references.
Defining a Crawl Task
To define a crawl task, do the following:
Step 1 Click the Define a Crawl Task radio button.
Step 2 Do one of the following:
a. Click Submit (or Update if you are editing an existing content) to add a crawl task to the delivery
service. The local Manifest file is automatically reparsed, changes are detected, and the
corresponding content items are acquired or removed.
b. Go to the “Configuring Advanced Settings” section on page 5-17, if applicable.
c. Continue to the next step and create acquisition rules.
Step 3 Click the Show Optional Content Acquisition Rules arrow to further refine the crawl task. The fields
in the acquisition rules are displayed (Figure 5-9), and the arrow becomes the Hide Optional Content
Acquisition Rules arrow.