Data Entry Automation Bot
Real Estate Listing Scraper & Automated Google Forms/Sheets Pipeline
Combines BeautifulSoup HTML extraction, regex price normalization, and Selenium WebDriver form submission into Google Sheets.
An end-to-end web scraping and automated data entry pipeline built with Python, Requests, BeautifulSoup4, and Selenium WebDriver. Scrapes rental listings, sanitizes messy currency/bedroom strings with regular expressions, and populates Google Forms sequentially into a live Google Sheet.
Real estate portals mix pricing formatting, frequency suffixes (/mo), and unit metadata inside raw text blocks unsuitable for spreadsheet sorting.
Combining lightweight HTTP HTML parsing for extraction with Selenium solely for interactive Google Form submission optimizes speed and reliability.
Engineering Objectives
System Architecture
Two-stage ETL pipeline: fast Requests + BeautifulSoup extraction & regex cleaning followed by Selenium formsolving class submission.
Hybrid HTTP + Selenium ETL
Uses fast static Requests/BS4 for bulk card extraction before opening Chrome WebDriver only for Google Forms submission.
Core & Backend Implementation
- BeautifulSoup4 card parser targeting structured Zillow-clone attributes.
- Regex normalizer stripping currency symbols, '+ 1 bd', and '/mo' suffixes.
- Selenium formsolving class filling text inputs and advancing 'Submit another response' loops.
Client & Interface Layer
- Automated Google Forms submission feeding a live Google Sheets ledger.
Data & Schema Design
Rows structured by Address, Normalized Monthly Rent, and Listing URL.
Authentication & Security Controls
- Keeps form submission endpoints isolated outside version control.
Engineering Challenges & Technical Decisions
Key Challenges Solved
Trade-Off Decisions
Testing & Verification Methodology
- Verified 1:1 count alignment across scraped addresses, prices, and URLs before form submission.