Last update: 6th March 2019

Accordign to the federal court D.C. of the United States, web scraping is completely legal. After all, Google itself is the biggest web scraper known in history.

The minimal rate for creating custom scrapers is set to 30$ per hour.

Scraping up to 45 keywords is free (with 10 results per page).

The price for a Scrape Job is calculated based on the total number of searches made.

When you launch a scrape job with 100 keywords and 100 results for each keyword, there are in total 100 * 10 searches made on the search engine (because each SERP page has usually 10 results per page).

Unfortunately, scraping more results for each keyword also costs linearly more. The reason is that scraping can be detected at any time and then we need to restart the complete search for this specific keyword.

It is crucial to understand that we cannot give you a discount when you set the number of results per keyword to a certain number but the search engine doesn't provide this many results.

Example: Let's say you create a Scrape Job of 100 keywords and you want 100 results per keyword. When specific keywords do not have 100 results, you will be charged for the full 100 results. Therefore, you need to make sure that your keywords are common enough to yield the full number of results you chose.

For example, when you search for 100 results per keyword, but the search engine yields only 50 results, you will be charged for the full 100 results per keyword. The reason is that you scrape job is only started after you have paid the full amount.

This disadvantage will be resolved when a subscription model is introduced in Scrapeulous.com. To avoid this, you can order a custom scrape job.

We do not guarantee that scraping with keywords that excessively use those search parameteres will provide best results.

If you want to make sure that you will get proper results, please submit a manual scrape job to our contact page

Depends on the search engine. Usually you will get the link, title and snippet and date of the results from the SERP page. The general format is usually as follows:

{ 'KEYWORD':
   { '1': // the page number
      { time: '', // the timestamp of scraping
        num_results: '',
        no_results: ,
        effective_query: '',
        results:
         [ { link: '',
             title: '',
             snippet: '',
             date: '',
             rank: 1 },
             ...
      ...
                                                

For example, below are the results for the keyword marketing strategies with the search engine Google scraped from Germany:

{ 'marketing strategies':
   { '1':
      { time: 'Sat, 02 Feb 2019 18:12:43 GMT',
        num_results: 'Ungefähr 567.000.000 Ergebnisse (0,47 Sekunden) ',
        no_results: false,
        effective_query: '',
        results:
         [ { link: 'https://en.wikipedia.org/wiki/Marketing_strategy',
             title:
              'Marketing strategy - Wikipediahttps://en.wikipedia.org/wiki/Marketing_strategyIm CacheÄhnliche SeitenDiese Seite übersetzen',
             snippet:
              'Weiter zu Growth strategies - The Ansoff matrix identifies four specific growth strategies: market penetration, product development, market development ...',
             visible_link: 'https://en.wikipedia.org/wiki/Marketing_strategy',
             date: 'Weiter zu Growth strategies - ',
             rank: 1 },
           { link:
              'https://www.weidert.com/whole_brain_marketing_blog/bid/108524/top-10-most-effective-marketing-strategies',
             title:
              'Top 10 Most Effective Marketing Strategies - Weidert Grouphttps://www.weidert.com/...marketing.../top-10-most-effective-m...Im CacheÄhnliche SeitenDiese Seite übersetzen',
             snippet:
              '07.02.2018 - A look at the top 10 marketing strategies for B2B and B2C companies, which points to the effectiveness of inbound marketing across industries.',
             visible_link:
              'https://www.weidert.com/...marketing.../top-10-most-effective-m...',
             date: '07.02.2018 - ',
             rank: 2 },
           { link:
              'https://www.thebalancesmb.com/marketing-strategy-for-home-business-success-1794314',
             title:
              'How to Develop the Marketing Strategy in Your Home Business Planhttps://www.thebalancesmb.com › ... › Marketing & SalesIm CacheDiese Seite übersetzen',
             snippet:
              '06.11.2018 - Definition of marketing strategy and tips to creating a marketing strategy in your home business plan.',
             visible_link: 'https://www.thebalancesmb.com › ... › Marketing & Sales',
             date: '06.11.2018 - ',
             rank: 3 },
           { link:
              'https://www.inc.com/murray-newlands/15-marketing-strategies-that-inspire-strategic-thinkers.html',
             title:
              '15 Marketing Strategies That Inspire Strategic Thinkers | Inc.comhttps://www.inc.com/.../15-marketing-strategies-that-inspire-strate...Ähnliche SeitenDiese Seite übersetzen',
             snippet:
              '24.03.2015 - If you find yourself in that situation, then you may want to check out these fifteen marketing strategies that will definitely spark your creative ...',
             visible_link:
              'https://www.inc.com/.../15-marketing-strategies-that-inspire-strate...',
             date: '24.03.2015 - ',
             rank: 4 },
           { link: 'https://www.entrepreneur.com/article/299335',
             title:
              '10 Marketing Strategies to Fuel Your Business Growth - Entrepreneurhttps://www.entrepreneur.com/article/299335Im CacheDiese Seite übersetzen',
             snippet:
              '12.09.2017 - And without the right marketing strategies to fuel your growth, churning a profit and staying afloat is virtually impossible. However, identifying ...',
             visible_link: 'https://www.entrepreneur.com/article/299335',
             date: '12.09.2017 - ',
             rank: 5 },
           { link: 'https://www.businessknowhow.com/marketing/strategies.htm',
             title:
              '28 Marketing Strategies That Work - Business Know-Howhttps://www.businessknowhow.com/marketing/strategies.htmIm CacheDiese Seite übersetzen',
             snippet:
              '18.12.2018 - What are the best marketing strategies for small business? How can you get customers to know about your business and make a purchase?',
             visible_link: 'https://www.businessknowhow.com/marketing/strategies.htm',
             date: '18.12.2018 - ',
             rank: 6 },
           { link:
              'https://buildfire.com/marketing-strategies-for-small-businesses/',
             title:
              '16 Awesome Marketing Strategies For Small Businesses - BuildFirehttps://buildfire.com/marketing-strategies-for-small-businesses/Im CacheÄhnliche SeitenDiese Seite übersetzen',
             snippet:
              'Today, I\'m going to show you 16 different marketing strategies that have a proven history of success for small businesses. Half of these options will probably be ...',
             visible_link:
              'https://buildfire.com/marketing-strategies-for-small-businesses/',
             date: '',
             rank: 7 },
           { link: 'http://www.marketingstrategiesinc.com/',
             title:
              'Marketing Strategies Inc.www.marketingstrategiesinc.com/Im CacheÄhnliche SeitenDiese Seite übersetzen',
             snippet:
              'Marketing Strategies, Inc. is a full-service Public Relations and Marketing firm. We\'ve been around for over 20 years helping clients create memorable brands, ...',
             visible_link: 'www.marketingstrategiesinc.com/',
             date: '',
             rank: 8 },
           { link: 'https://neilpatel.com/blog/startup-marketing-strategies/',
             title:
              '20 Uncommon Marketing Strategies That\'ll Kickstart Your Startuphttps://neilpatel.com › Blog › MarketingIm CacheDiese Seite übersetzen',
             snippet:
              'This kind of creative, unexpected growth is often termed growth hacking. It\'s a way to promote your business not just through marketing, but through all channels ...',
             visible_link: 'https://neilpatel.com › Blog › Marketing',
             date: '',
             rank: 9 } ] },
     '2':
      { time: 'Sat, 02 Feb 2019 18:12:45 GMT',
        num_results:
         'Seite 2 von ungefähr 567.000.000 Ergebnissen (0,27 Sekunden) ',
        no_results: false,
        effective_query: '',
        results:
         [ { link:
              'http://www.infoentrepreneurs.org/en/guides/create-your-marketing-strategy/',
             title:
              'Create your marketing strategy - Info entrepreneurswww.infoentrepreneurs.org › Home › SearchIm CacheÄhnliche SeitenDiese Seite übersetzen',
             snippet:
              'Developing a marketing strategy is vital for any business. ... It explains what to include in your marketing strategy and how it can be used as the basis for effective ...',
             visible_link: 'www.infoentrepreneurs.org › Home › Search',
             date: '',
             rank: 10 },
           { link: 'https://www.marketingdonut.co.uk/marketing-strategy',
             title:
              'Marketing strategy | Marketing Donuthttps://www.marketingdonut.co.uk/marketing-strategyIm CacheÄhnliche SeitenDiese Seite übersetzen',
             snippet:
              'Content is at the heart of today\'s marketing strategies as websites and blogs demonstrate expertise, sell services and grow professional businesses.',
             visible_link: 'https://www.marketingdonut.co.uk/marketing-strategy',
             date: '',
             rank: 11 },
           { link:
              'https://www.wordstream.com/blog/ws/2018/12/31/top-marketing-strategies-2018',
             title:
              'The 11 Best Marketing Strategies We Tried This Year | WordStreamhttps://www.wordstream.com/.../top-marketing-strategies-2018Im CacheDiese Seite übersetzen',
             snippet:
              '31.12.2018 - We talked to expert marketers to find out the best marketing strategies that everyone is planning to try in 2019, from chatbots to nontraditional ...',
             visible_link:
              'https://www.wordstream.com/.../top-marketing-strategies-2018',
             date: '31.12.2018 - ',
             rank: 12 },
           { link:
              'https://blogs.constantcontact.com/best-marketing-strategies/',
             title:
              '5 of the Best Marketing Strategies You Haven\'t Tried | Constant Contacthttps://blogs.constantcontact.com/best-marketing-strategies/Im CacheDiese Seite übersetzen',
             snippet:
              'The old tactics to market your business are not working. Here are five of the best marketing strategies you have not tried.',
             visible_link:
              'https://blogs.constantcontact.com/best-marketing-strategies/',
             date: '',
             rank: 13 },
           { link:
              'http://www.smarta.com/advice/sales-and-marketing/advertising-and-marketing/how-to-develop-a-marketing-strategy/',
             title:
              'Smarta | How to develop a marketing strategywww.smarta.com/...marketing/...marketing/how-to-develop-a-ma...Im CacheÄhnliche SeitenDiese Seite übersetzen',
             snippet:
              'A free business step-by-step guide on developing your marketing strategy and plan from Smarta, the small business support and advice network.',
             visible_link:
              'www.smarta.com/...marketing/...marketing/how-to-develop-a-ma...',
             date: '',
             rank: 14 },
           { link: 'https://blog.hubspot.com/marketing/digital-strategy-guide',
             title:
              '7 Digital Marketing Strategies and How to Plan Your Own Campaign ...https://blog.hubspot.com/marketing/digital-strategy-guideIm CacheÄhnliche SeitenDiese Seite übersetzen',
             snippet:
              '31.10.2018 - Discover seven simple digital marketing strategies that will help you seize online growth opportunities for your business.',
             visible_link: 'https://blog.hubspot.com/marketing/digital-strategy-guide',
             date: '31.10.2018 - ',
             rank: 15 },
           { link:
              'https://blog.hubspot.com/marketing/global-marketing-and-international-business',
             title:
              '13 Businesses With Brilliant Global Marketing Strategies - HubSpot Bloghttps://blog.hubspot.com/marketing/global-marketing-and-intern...Im CacheDiese Seite übersetzen',
             snippet:
              '22.01.2019 - So, if you\'re looking for inspiration on how to craft a successful international marketing strategy and expand your business\' reach, check out ...',
             visible_link:
              'https://blog.hubspot.com/marketing/global-marketing-and-intern...',
             date: '22.01.2019 - ',
             rank: 16 },
           { link:
              'https://www.yodiz.com/blog/8-types-of-marketing-strategies-and-definition/',
             title:
              '8 Types of Marketing Strategies and Definition – Yodiz Project ...https://www.yodiz.com/.../8-types-of-marketing-strategies-and-de...Im CacheDiese Seite übersetzen',
             snippet:
              '24.06.2016 - There are different types of marketing strategies available. You have to pick one as per your business requirement. Before choosing the right ...',
             visible_link:
              'https://www.yodiz.com/.../8-types-of-marketing-strategies-and-de...',
             date: '24.06.2016 - ',
             rank: 17 },
           { link:
              'https://www.cyberclick.es/numericalblogen/10-marketing-strategies-for-your-product-launch',
             title:
              '10 marketing strategies for your product launch - Cyberclickhttps://www.cyberclick.es/.../10-marketing-strategies-for-your-pr...Im CacheDiese Seite übersetzen',
             snippet:
              'The term “growth hacking” has become quite a buzzword over the past few years, referring to non-traditional digital marketing strategies to ensure rapid growth.',
             visible_link:
              'https://www.cyberclick.es/.../10-marketing-strategies-for-your-pr...',
             date: '',
             rank: 18 },
           { link:
              'http://www.business.vic.gov.au/marketing-and-sales/increasing-sales-through-marketing/marketing-mix-strategies-and-tactics',
             title:
              'Marketing strategies and tactics | Business Victoriawww.business.vic.gov.au › ... › Increasing sales through marketingIm CacheDiese Seite übersetzen',
             snippet:
              'Set the direction for your marketing strategy so you\'re satisfying your customers.',
             visible_link:
              'www.business.vic.gov.au › ... › Increasing sales through marketing',
             date: '',
             rank: 19 } ] } } }
            

There is a boolean flag in the results: no_results is set to true when the search keyword either has legitimately no results or if the search engine used a different search term instead and is displaying results for the corrected search term.

When the search term was automatically corrected, the results have a additional variable: effective_query. This variable is the search keyword, that was effectively used in the search. When effective_query is set, no_results is also set to true.

You can specify the number of results for each keyword on the Start Scraping form.

Currently, scrapeulous.com supports the following options:

  • Google: Up to 100 results per keyword (10 pages)
  • Bing: Up to 100 results per keyword (10 pages)
  • Duckduckgo: Up to 100 results per keyword (10 pages)
Scrapeulous.com
Berlin, Germany
Email: contact@scrapeulous.com
Website: incolumitas.com