SerpApi Production Pipeline — Independent Contractor (Full-Stack Engineer & Technical Lead)
Built and deployed a large-scale search data pipeline using SerpApi to extract structured T&D infrastructure project data across 27 countries. Processed thousands of queries with automated CAPTCHA handling, parsed structured results, and fed outputs into a queryable SQLite database. This work involved programmatic collection/structuring of AI-ready training/query data rather than manual annotation. • Data collection and structuring for downstream AI/RAG-style usage • Automated CAPTCHA handling and structured result parsing • Batched OpenAI processing to transform query results into stored records • Queryable persistence of extracted datasets in SQLite