MACROMEDIA COLDFUSION 4.5-ADMINISTRING COLDFUSION SERVER Technical Information Page 135

  • Download
  • Add to my manuals
  • Print
  • Page
    / 174
  • Table of contents
  • TROUBLESHOOTING
  • BOOKMARKS
  • Rated. / 5. Based on customer reviews
Page view 134
130
CONFIGURING AND ADMINISTERING COLDFUSION 9
Indexing Collections with Verity Spider
Last updated 2/21/2012
Specifies the maximum number of simultaneous socket connections to make to websites for indexing. Each
connection implies a separate thread.
The default value is 6.
Note: The Verity Spider dynamic flow control makes the most use of all available connections when indexing websites. If
you are indexing multiple sites, you might want to increase this number. Increasing the number of connections does not
always help, because of such dependencies as your network connection and the capabilities of the remote hosts.
-delay
Type
Web crawling only
Syntax
-delay num_milliseconds
Specifies the minimum time between HTTP requests, in milliseconds. The default value is 0 milliseconds for no delay.
-header
Type
Web crawling only
Syntax
-header string
Specifies an HTTP header to add to the request; for example:
-header "Referer: http://www.verity.com/"
Verity Spider sends some predefined headers, such as Accept and User-Agent, by default. Special headers are
sometimes necessary to correctly index a site.
For example, earlier versions of Verity Spider did not support the Host header, which was needed for Virtual Host
indexing. Also, a Proxy-authentication header was required to pass a user name and password to a proxy server. In the
current version of Verity Spider, the Host header is supported by default, and the
-proxyauth option is available for
proxy server authentication. Therefore, the
-header option is maintained only for backwards compatibility and
possible future enhancements.
Note: Misuse of this option causes spider failure. If this happens, rerun the indexing task with modified -header values.
-hostcache
Syntax
-hostcache num_hostnames
Specifies the number of host names to cache to avoid DNS lookups. Without this option, the host cache continues to grow.
The default value is 256.
Page view 134
1 2 ... 130 131 132 133 134 135 136 137 138 139 140 ... 173 174

Comments to this Manuals

No comments