public Manage the general and default setting of the search appliance

Search appliance general settings

Using the General settings screen, you can manage the key settings of the search appliance. If you don’t provide any values, the default ones will be applied by the system. Please note that some of the settings could be overridden by the crawler or index settings To review the general setting, you need to follow the steps below:

To alter the general settings of the search appliance, you need to:

  1. Log in to the WordFrame Integra Core Administration
  2. Click on the "Builder" tab in the upper left corner
  3. Click on the "Content components" menu in the main navigation bar
  4. Click on the “General settings” link in “Search appliance” section on the left of the screen
  5. Click on the “manage settings” link located on the upper right corner of the grid.
  6. Change the general settings
  7. Click on the “Save” button

The form manages the following:

user-agent name
Description: This value defines how the search appliance crawler should present itself, when requesting web pages..
recrawl period
Description: The default start period for recrawling a single webpage.
minimum recrwal period
Description: The minimal period for revisiting and recrawling one unique URL.
crawler connection timeout
Description: When this period exceeds, the crawoler will terminate the HTTP request, of it is still not processed.
maximum size of the crawled file
Description: Limits the crawler to request and index only files up to this size.
default wait between requests
Description: Depends on the web server load that you want o inflict during the crawling and indexing processes.
indexing batch size
Description: Number of items indexed at a single pass.
apply robots.txt rules
Description: Robots.txt is a file that should be in the main folder of the domain. It can be reviewed by typing in your browser This file purpose is to set rules for the search crawlers/bots, how to crawl the pages and documents under the corresponding domain.
apply robots metatags rules
Description: Robots behavior can be managed on page basis with a html metatag included in the page’s HEAD.
apply “no-index” html comments rule
Description: If it is checked, the page content between <!—BEGIN NO INDEX --> and <! – END NO INDEX --> html comment lines will not be indexede.
”recrawl on error” period
Description: The period (in hours) to recrawl a URL if encountered an error.
document index parse timeout
Description: The period to wait for an indexing iFilter to extract plain text from a document.
Last edited by Boz Zashev on 26 Oct 2010 | Rev. 2 | This page is public | Views: 1
Comments: 0 | Filed under: Content components | Tags: