Illia Zub

Scraping search engines and improving performance at https://serpapi.com

📍 Ukraine 🇺🇦

Scrape Walmart Search for a specific store

Update location cookies to specify the location for plain HTTP requests to Walmart.

Parse the number of Google search results as JSON using beta OpenAI

OpenAI data extraction: 'About 1,950,000,000 results (0.76 seconds)' to '{ "total_results": 1950000000, "time_taken_displayed": 0.76 }'.

AI ML

Extract the number of Google search results using beta GPT-3

Using OpenAI to extract numbers from HTML of Google SERP. The next step is to use Codex to generate parser code.

Web Scraping

How we reverse-engineered Google Maps pagination

In this story, you'll see the process of decoding URL parameters for pagination on Google Maps. It involved deobfuscation of Closure-compiled JavaScript, reverse-engineering of Protobuf data structures, and a bit of math. We tried to decode URL parameters by ourselves, by using pbtk, and attempted to outsource this

Support

How to report a bug on the SerpApi Public Roadmap to ensure it gets fixed quickly

Include screenshots, several Search IDs, and a descriptive title to ensure the bug report in SerpApi gets fixed quickly.

Business

How SerpApi sped up data extraction from HTML from 3s to 800ms (or How to profile and optimize Ruby code and C extension)

Optimization of Ruby C extension with help of Linux perf, gdb, pprof, rbspy, and kind people.

APIs

Easy Integrations

Features

Use Cases