Google is the most popular search engine and is the owner of YouTube. But YouTube is not the only video source for your search. Google Videos even has more videos from the internet.
Scraping Google Video Results helps content creators and digital marketers use video to curate content for their websites, YouTube channels...
Also you can do trend analysis on popular topics, build a content recommendations system for videos.
With the trend of AI for everything, Google Videos is the most valuable source to train AI and produce awesome videos.
Setting up a SerpApi account
SerpApi offers a free plan for newly created accounts. Head to the sign-up page to register an account and complete your first search with our interactive playground. When you want to do more searches with us, please visit the pricing page.
Once you are familiar with all results, you can utilize SERP APIs using your API Key.
Scrape your first Google Videos results with SerpApi
Head to the Google Videos Results from the documentation on SerpApi for details.
In this tutorial, we will scrape videos results when searching with the "football" keyword. The data contains: "position", "title", "link", "thumbnail", "description", "date", "duration" and more. You can also scrape more information with SerpApi.
First, you need to install the SerpApi client library.
pip install google-search-results
Set up the SerpApi credentials and search.
from serpapi import GoogleSearch
import os, json
params = {
'api_key': 'YOUR_API_KEY', # your serpapi api
'engine': 'google_videos', # SerpApi search engine
'q': 'football'
}
To retrieve Google Videos Results for a given search term, you can use the following code:
results = GoogleSearch(params).get_dict()['video_results']
You can store Videos Results JSON data in databases or export them to a CSV file.
import csv
header = ['position', 'title', 'link', 'thumbnail', 'description', 'date', 'duration']
with open('google_videos.csv', 'w', encoding='UTF8', newline='') as f:
writer = csv.writer(f)
writer.writerow(header)
for item in results:
print(item)
writer.writerow([item.get('position'), item.get('title'), item.get('link'), item.get('thumbnail'), item.get('snippet'), item.get('date'), item.get('duration')])
This example is using Python, but you can also use your all your favorite programming languages likes Ruby, NodeJS, Java, PHP....
If you have any questions, please feel free to contact me.