You caught us before we are ready writing this documentation. Please contact us if you need more info.

Searchine first figures out the type of content. Based on the content there will be one or more analysers to retrieve important content to index.

 

 

Crawler setup
Exclude specific URLs