Wednesday, 4 September 2019

How to search a keyword in google present in list one by one and extract data

Lets say I have a list consisting of cities. For example,

zip = ['newyork','delhi']

how to search new york pincode and delhi pincode on google and extract the data.

This search gives the result and there are multiple pincodes present. I only need to capute the first one.

The output I need :

{Newyork: 10001, Delhi: 110001}

I tried this

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from bs4 import BeautifulSoup
import re
import pandas as pd
import os
import html5lib
import json
import time
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.keys import Keys
url = "https://www.google.com/"
chromedriver = r"C:\Users\me\chromedriver"
driver = webdriver.Chrome(chromedriver)
driver.implicitly_wait(30)
driver.get(url)
search = driver.find_element_by_name('q')
pincodencodee=['newyork','delhi']
for i in pincodencodee:    
    search.send_keys(i)
search.send_keys(Keys.RETURN) 
time.sleep(5) 
driver.quit()



from How to search a keyword in google present in list one by one and extract data

No comments:

Post a Comment