Our “Data as a Service” solution delivers data
exactly from where you need it, the way you need it, where you need it and when you need it.

We take care of everything from IP rotation, running the infrastructure as well as monitoring any changes in the website structure.

Setup fees include customization of our application to suit your business needs. It varies based on specific needs and hence setup fee is quoted after thorough review.

The pricing depends on several factors including the complexity of the website, frequency of scraping, the type, and volume of data being scraped and how the data is being shared with you.

The data can be delivered in XML, JSON, or CSV format. The default mechanism for delivering data is that we push the data to one of your file-sharing servers (FTP, SFTP, Amazon S3, Dropbox, Gdrive, Box, or MS Azure). Custom database integrations can also be done based on your needs.

We respect robots.txt and scrape a site only if bots are allowed in robots.txt file. If crawling is disallowed in robots.txt, even though crawling might be feasible technically, it involves legal issues for us as well as our clients. Also in cases where bots are allowed and we give data to clients, it is up to clients to conform to the Terms of Service for the usage of that data.

Yes, but it may involve additional one-time setup fees.

In order to provide a proof of concept, we’ll have to set up the crawlers in its entirety, which is a key step in the whole process. Hence, this will be a paid engagement. We provide 30-days paid PoC for a maximum of up to 2 sites