What We Do
Distributed web scraping/crawling of any website with hundreds of automated browsers from multiple geographical regions.
Scraping search engines such as Google, Bing, Duckduckgo and others in large quantities.
Whether you need to analyze your competitor's market share with a keyword research, obtain search engine results for your scientific research, or compare product prices from retailers, Scrapeulous.com enables you to scrape an ever increasing list of websites completely automatically.
Scrapeulous automates every thinkable workflow that is possible with browsers. You can crawl every website, make screenshots, convert websites to PDF, handle complex user interaction scenarios. We provide the infrastructure and error handling in case a server blocks a certain worker process.
We offer convenient API access to our all our services as well as the creation of individual scrape jobs in the backend.
Company
Scrapeulous.comSole Proprietorship with freelancing partners
Based in Berlin (Germany) and Bern (Switzerland)
Email: contact@scrapeulous.com
Website: incolumitas.com
Search Engine Scraping
There are many good reasons why you should scrape search engines with Scrapeulous.
Multiple Geographical Locations
We offer scraping from several different geographical regions. We support multiple locations from the United States, United Kingdom, Germany and France.
Scraping with Real Browsers
Scraping results are obtained using real browsers This means that results are exactly the same as if a human would have launched the search. Results also include advertisement links and location results.
Results in Minutes
The whole scraping process is finished within minutes. It takes us not longer than 3 minutes to scrape up to 10.000 keywords!
Many Search Engines
You can use many different search engines such as Google , Google Image , Google News , Google News Serp , Duckduckgo , Bing , Yandex , Infospace , Webcrawler .
Advanced Configuration
You can customize configuration parameters for search engines. For example, it's possible to set Google's search parameters such as num, gl, hl and google_domain
Pay for Valid Results only
You pay only for results that were successfully obtained. Due to the error prone nature of search engine scraping, we cannot always guarantee that we obtain all results, therefore our pricing strategy reflects this fact.
Search Engine API
Using our API allows you to integrate live and organic search engine results in your product. You can scrape up to 2000 keywords per single api call! Scrapeulous scales horizontally, this means that searching 500 keywords in one API call does not take significantly longer than searching 1 keyword.
API Request Example
{
"search_engine": "google",
"num_pages": 1,
"keywords": ["buy car boston"],
"region": "us",
"google_settings": {
"gl": "us",
"hl": "en",
"start": 0,
"num": 100
}
}
API Response
API Request Example
{
"search_engine": "bing",
"num_pages": 2,
"keywords": ["boat prices",
"I should buy a boat"],
"region": "uk"
}
API Response
Subscription Plans
One normal search equals one credit. We have several different subscription plans, including one free plan and arbitrary custom plans. The subscription plans listed below are the most common chosen ones. We additionally support the plans 5$/mo for 1000 credits and 10$/mo for 2250 credits.