The Data Source is the hub of all sources added for crawling. You can also opt to index subdomains. A simple way for you to index various disparate data sources and have a centralized outlook on the metrics involved to ensure proper scaling of the business. You can edit, delete, and enter comments for the selected parameters. You can search for a specific data source through the provided search bar.

Data Source Window
The following table describes the Data Source parameters.
| Field | Default | Description |
|---|---|---|
| Datasource URL | None | Enter the URL of the Data Source that should be crawled or indexed. |
| Schedule | Default | Enter the Schedule from the drop down list. The options are as follows: * Monthly * Weekly * Daily * Default |
| Include sitemap | Unchecked | Check the Include Sitemap to include the sitemap. Once you include the sitemap, you can select to add the sitemap preference as follows: * Sitemap only * Sitemap & Link follow |
Data Source Parameters
Adding Data Source
Following are the steps:
- In the Keyspider UI, navigate to Collections > Data Source. The Data Source window is displayed.
- Click New Data Source to add the data source. The Create new Data Source window is displayed.
- Enter or select the parameter values from the drop down. Refer to the table Data Source Parameters for parameter description.
- Click Save to add the data source.

Create New Data Source
Editing Data Source
Following are the steps:
- In the Keyspider UI, navigate to Collections > Data Source. The Data Source window is displayed.
- Click on the edit icon to edit the data source. The Edit Data Source window is displayed.
- Make the updates and click on Save to update the configuration.
Deleting Data Source
Following are the steps:
- In the Keyspider UI, navigate to Collections > > Data Source. The Data Source window is displayed.
- Click on the Delete icon to delete the data data. The Delete Data Source window is displayed.
- Click OK to delete the data source or Cancel to retain the data source.
