Scrape Google Product Local Sellers Results using SerpApi

What will be scraped

Why use an API?

• No need to create a parser from scratch and maintain it.
• Bypass blocks from Google: solve CAPTCHA or solve IP blocks.
• Pay for proxies, and CAPTCHA solvers.
• Don't need to use browser automation.

SerpApi handles everything on the backend with fast response times under ~2.5 seconds (~1.2 seconds with Ludicrous speed) per request and without browser automation, which becomes much faster. Response times and status rates are shown under SerpApi Status page.

Full Code

If you don't need an explanation, have a look at full code example in the online IDE.

from serpapi import GoogleSearch
import json

params = {
    'api_key': '...',                           # https://serpapi.com/manage-api-key
    'engine': 'google_product',                 # SerpApi search engine	
    'product_id': '14019378181107046593',       # product id
    'offers': True,                             # more offers, could be also set as '1` which is the same as True
    'location': 'Dallas, Texas, United States', # location
    'filter': 'flocal:1',                       # local sellers
    'hl': 'en',                                 # language
    'gl': 'us'                                  # country of the search, US -> USA
}

search = GoogleSearch(params)                   # where data extraction happens on the backend
results = search.get_dict()                     # JSON -> Python dict

data = {}

data['product_results'] = results['product_results']
data['local_sellers'] = results['sellers_results']['online_sellers']
data['related_items'] = results['related_products']['different_brand']

print(json.dumps(data, indent=2, ensure_ascii=False))

Preparation

Install library:

pip install google-search-results

google-search-results is a SerpApi API package.

Code Explanation

Import libraries:

from serpapi import GoogleSearch
import json

At the beginning of the code, parameters are defined for generating the URL. If you want to pass other parameters to the URL, you can do so using the params dictionary:

params = {
    'api_key': '...',                           # https://serpapi.com/manage-api-key
    'engine': 'google_product',                 # SerpApi search engine	
    'product_id': '14019378181107046593',       # product id
    'offers': True,                             # more offers
    'location': 'Dallas, Texas, United States', # location
    'filter': 'flocal:1',                       # local sellers
    'hl': 'en',                                 # language
    'gl': 'us'                                  # country of the search, US -> USA
}

📌Note: After recent changes Google does not provide local results and sellers parameter was deprecated. Alternatively filter=flocal:1 could be used switching Nearby filter.

Then, we create a search object where the data is retrieved from the SerpApi backend. In the results dictionary we get data from JSON:

search = GoogleSearch(params)   # where data extraction happens on the SerpApi backend
results = search.get_dict()     # JSON -> Python dict

Declaring the data dictionary where the extracted data will be added:

data = {}

Retrieving the data is quite simple, you just need to access the corresponding key:

data['product_results'] = results['product_results']
data['local_sellers'] = results['sellers_results']['online_sellers']
data['related_items'] = results['related_products']['different_brand']

After the data is retrieved, it is output in JSON format:

print(json.dumps(data, indent=2, ensure_ascii=False))

You can view playground or check the output. This way you will be able to understand what keys you can use in this JSON structure to get the data you need.

Output

{
  "product_results": {
    "product_id": 14019378181107046593,
    "title": "SteelSeries Aerox 3 2022 Edition Wired Gaming Mouse, Onyx",
    "reviews": 68,
    "rating": 4.5
  },
  "local_sellers": [
    {
      "position": 1,
      "name": "Best Buy",
      "link": "https://www.google.com/url?q=https://www.bestbuy.com/site/steelseries-aerox-3-2022-edition-lightweight-wired-optical-gaming-mouse-onyx/6485231.p%3FskuId%3D6485231%26ref%3D212%26loc%3D1%26extStoreId%3D1412&sa=U&ved=0ahUKEwjJ__yp3MD7AhWWhIkEHdp8D6IQ2ykIJA&usg=AOvVaw0iSz1DvCsnPaEyJ8Llivf7",
      "base_price": "$34.99",
      "additional_price": {
        "shipping": "See website"
      },
      "total_price": "$34.99"
    },
    ... other sellers
  ],
  "related_items": [
    {
      "title": "SteelSeries Aerox 5 Wired ...",
      "link": "https://www.bestbuy.com/site/steelseries-aerox-5-lightweight-wired-optical-gaming-mouse-with-9-programmble-buttons-black/6501454.p?skuId=6501454&ref=212&loc=1&extStoreId=1027&sa=X&ved=0ahUKEwjJ__yp3MD7AhWWhIkEHdp8D6IQrhIIfA",
      "price": "$47.99"
    },
    ... other items
  ]
}

Links

• Code in the online IDE
• Google Local Sellers API
• Google Product API

Join us on Twitter | YouTube

Add a Feature Request💫 or a Bug🐞