A collection in a search engine stores the data ready for crawling. In other words, it holds the database of any source of data that needs to be picked for indexing. It also has all the functionalities that allow you to configure the collection to crawl or index the data source based on your preference. 

Collection Sub Menus

The Keyspider Collection menu includes the following sub menus:

Collection Sub Menus

• Data source

All Collections

In this panel, you get a consolidated view of all your collections and their details. You can also add/delete a collection from this panel after making an informed decision from the overview. You can also create multiple collections in different data source types within the same engine.

All Collections Window

The Keyspider All Collections Window includes the following options:

All Collections Window

The following table describes the Recrawl parameters.

Note: The option is available only for the existing pages.

Adding New Collection

Following are the steps:

1. In the Keyspider UI, navigate to Collections > All Collections. The Data Source window is displayed.
2. Click New Collection to add the collection. The Create new collection window is displayed. Enter the parameter values from the drop down. Refer to the table All Collection Parameters for parameter description.
3. Check the box next to Start Indexing to initiate the indexing process. 
4. Click Save. 

Note: You can add multiple collections of different data source types within the same engine.