Scrape Google aggregated product results in mobile
When you do a Google search in mobile, for instance about clothing, Google will neatly return grid of product from difference e-commerce stores.
A search on "men's sweater" will show below results. Google aggregate the same product from different e-commerce stores.
Click on any of the item will bring you to more detail view on the product like below.
In SerpAPI, we've created new Google Immersive Product API to be able to scrape the above data.
- Use SerpApi's Google Search API to search for something, we use same query as above example 😊. Try it yourself - Playground
- You should be able to find
immersive_products
.immersive_products
consist of important product infos, but we are able to get more infos from it.
{
...
"immersive_products":[
{
"thumbnail":"https://serpapi.com/searches/62e364798b7ed27bc10236ef/images/319f326bfebd487321f51d99a03b959b0fcb79b13373940a2948259912f02b97.jpeg",
"source_logo":"https://serpapi.com/searches/62e364798b7ed27bc10236ef/images/319f326bfebd487321f51d99a03b959b9d74edb7b38f0363288fcdd2f3f379c10a12d00e91eb7482.png",
"source":"Amazon.com, 1+ stores",
"title":"Amazon Essentials Men's Crewneck Sweater",
"price":"$22.90",
"extracted_price":22.9,
"immersive_product_page_token":"eyJlaSI6ImVtVGpZcFVuMEtHUzlBX1FuTEtBQnciLCJjYXRhbG9naWQiOiIxNjY0NDk5MDE3NTI4NTE5MDk3OCIsInZjIjoiNzUwMDUxODQyODExNjc3MTE3OCIsInZzYyI6IjEwMzYzMDgzODI5NTAyODUxMiIsImhlYWRsaW5lT2ZmZXJEb2NpZCI6IjEzNDI5MDcxNjM0Mjc5NDEzMjM1IiwiaW1hZ2VEb2NpZCI6IjcyNTYzNzQxOTY5NTMzNDQwNTUiLCJyZHMiOiIiLCJxdWVyeSI6Im1lbnMrc3dlYXRlciJ9",
"serpapi_link":"https://serpapi.com/search.json?engine=google_immersive_product&page_token=eyJlaSI6ImVtVGpZcFVuMEtHUzlBX1FuTEtBQnciLCJjYXRhbG9naWQiOiIxNjY0NDk5MDE3NTI4NTE5MDk3OCIsInZjIjoiNzUwMDUxODQyODExNjc3MTE3OCIsInZzYyI6IjEwMzYzMDgzODI5NTAyODUxMiIsImhlYWRsaW5lT2ZmZXJEb2NpZCI6IjEzNDI5MDcxNjM0Mjc5NDEzMjM1IiwiaW1hZ2VEb2NpZCI6IjcyNTYzNzQxOTY5NTMzNDQwNTUiLCJyZHMiOiIiLCJxdWVyeSI6Im1lbnMrc3dlYXRlciJ9"
},
{
"thumbnail":"https://serpapi.com/searches/62e364798b7ed27bc10236ef/images/319f326bfebd487321f51d99a03b959b54d33dcde99dd679e52e8443e95731b4.jpeg",
"source_logo":"https://serpapi.com/searches/62e364798b7ed27bc10236ef/images/319f326bfebd487321f51d99a03b959b50c2a75ddcdbb23ce577cd7305178c4ad6ebf3cb0b060943.png",
"source":"Geiger's, 3+ stores",
"title":"Patagonia Men's Recycled Wool Sweater",
"rating":4.4,
"reviews":89,
"price":"$69.99",
"extracted_price":69.99,
"original_price":"$139",
"extracted_original_price":139,
"sale":true,
"immersive_product_page_token":"eyJlaSI6ImVtVGpZcFVuMEtHUzlBX1FuTEtBQnciLCJjYXRhbG9naWQiOiIxNTk1NTkzOTE4NTQ1MDAwNTcyNSIsInZjIjoiMjU5NDQ3MDAxNDE4MTk0MTQ4OCIsInZzYyI6IjY2NjIzMTY5MzMyNTAyOTYwNzAiLCJoZWFkbGluZU9mZmVyRG9jaWQiOiI2NDk2MjAzMzY0NTQ0MTg2ODQwIiwiaW1hZ2VEb2NpZCI6IjE3NzEwNzQ4Mzk1MjM4NzM4MDYiLCJyZHMiOiJQQ182MDUyMTgzNjI1MTU3Mzc5NjAxfFBST0RfUENfNjA1MjE4MzYyNTE1NzM3OTYwMSIsInF1ZXJ5IjoibWVucytzd2VhdGVyIn0=",
"serpapi_link":"https://serpapi.com/search.json?engine=google_immersive_product&page_token=eyJlaSI6ImVtVGpZcFVuMEtHUzlBX1FuTEtBQnciLCJjYXRhbG9naWQiOiIxNTk1NTkzOTE4NTQ1MDAwNTcyNSIsInZjIjoiMjU5NDQ3MDAxNDE4MTk0MTQ4OCIsInZzYyI6IjY2NjIzMTY5MzMyNTAyOTYwNzAiLCJoZWFkbGluZU9mZmVyRG9jaWQiOiI2NDk2MjAzMzY0NTQ0MTg2ODQwIiwiaW1hZ2VEb2NpZCI6IjE3NzEwNzQ4Mzk1MjM4NzM4MDYiLCJyZHMiOiJQQ182MDUyMTgzNjI1MTU3Mzc5NjAxfFBST0RfUENfNjA1MjE4MzYyNTE1NzM3OTYwMSIsInF1ZXJ5IjoibWVucytzd2VhdGVyIn0%3D"
}
...
]
...
}
3. To get more info, we provided serpapi_link
which easier to retrieve more infos of the product. Visit our documentation on Google Immersive Product engine for more detail on the response.
{
...
"similar_products":[
{
"name":"Carhartt WIP Sweater Men",
"thumbnail":"https://encrypted-tbn0.gstatic.com/shopping?q=tbn:ANd9GcSTnr4JpCVMHIyFvYWCSSahCOuyOHmrm28yMXtzL9hfqFpUcIbaQ_m2XhQpv64MSzEA5Vg3XShKStYTjnEkJdLSz2J3QM48OW6ZNiCLswlzJVPeF0yAG3ic",
"brand":"HHV",
"price":"$73.36",
"extracted_price":73.36,
"serpapi_link":"https://serpapi.com/search.json?engine=google_immersive_product&page_token=eyJlaSI6ImVtVGpZcFVuMEtHUzlBX1FuTEtBQnciLCJjYXRhbG9naWQiOiIxNTI3MDQ0MjYxODkyNjgwODAwMiIsInZjIjoiNTkzMTk2MTA4NjYyMzg5MzgxNyIsInZzYyI6Ijk4NDUxMjYxMjE5NTY1NjU1NTkiLCJoZWFkbGluZU9mZmVyRG9jaWQiOiIxMjY5Mjc4OTQ0OTgwMzE3ODE4NSIsImltYWdlRG9jaWQiOiIxNjgzMzc4NjA5ODcyMDk3NzEyOCIsInJkcyI6IlBDXzE1NzcyNzc1Nzg1ODU0NDY0NzA4fFBST0RfUENfMTU3NzI3NzU3ODU4NTQ0NjQ3MDgiLCJxdWVyeSI6Im1lbnMrc3dlYXRlciJ9"
},
...
],
"style_ideas_serpapi_link":"https://serpapi.com/search.json?engine=google_immersive_product&page_token=eyJyZXFwbGQiOlsiMTc3MTA3NDgzOTUyMzg3MzgwNiIsMTAsMSwiL20vMDE5YjgwIiwxXX0%3D"
}
4. For clothing, Google provide Style Ideas info.
A request to style_ideas_serpapi_link
returns data on style ideas.
{
...
"style_ideas": [
{
"thumbnail": "https://t1.gstatic.com/images?q=tbn:ANd9GcQce98Q7A5OrRASpTK3MXbLip_cl59K63Vpku-x60Nd2ZvtRnoN",
"image": "https://cdn.monsterchildren.com/wp-content/uploads/2019/09/04184449/monster-children-brixton-1-of-7.jpg",
"website": "https://www.monsterchildren.com/kenny-anderson-talks-style-with-brixton-in-new-series-threads/"
},
{
"thumbnail": "https://t0.gstatic.com/images?q=tbn:ANd9GcQGRXi2hW4Gn9THR27SrOYgHHi_A4fMB57arkCksPpfLGTf13B1",
"image": "https://i.pinimg.com/originals/a4/f6/23/a4f62304f747dcfc98a98e91042221da.jpg",
"website": "https://www.pinterest.com/rdeho/matt-style/"
},
{
"thumbnail": "https://t1.gstatic.com/images?q=tbn:ANd9GcRXI5epFqlce4DdDAHGZdT5O-TysHmKzwGaEkH4VFvmNEnGgF_a",
"image": "https://arancrafts.com/wp-content/uploads/2021/12/C4015-Navy-scaled.jpg",
"website": "https://arancrafts.com/product/norwegian-style-sweater-c4015/"
},
...
]
}
That's it. Very simple workflow and you are able to retrieve more infos on the product results from Google. Hope you find this useful 🙂.
If you haven't created an account with SerpApi, you can get 100 credits for free when you Sign Up!