This repository contains Python scripts for web scraping real estate agent information from Zillow's website.
zillow_scraper.py: This script includes classes and methods for scraping realtor profile links, retrieving agent information, and extracting professional details.profiles.txt: This text file contains partial URLs of realtor profiles on Zillow. The script reads these URLs and scrapes the corresponding information.
- Ensure that Python 3.x is installed on your system.
- Install the required dependencies by running the command:
pip install requests beautifulsoup4. - Modify the
profiles.txtfile by adding the desired partial URLs of realtor profiles from Zillow. - Run the
zillow_scraper.pyscript to scrape agent information, retrieve professional details, and display the results in the console.
Please note that web scraping should be conducted responsibly and in accordance with the terms of service of the website you are scraping. Make sure to respect Zillow's terms of use and be mindful of any rate limits or restrictions they may have in place.