Data Engineer Intern — Noble Ventures Data Inc (Remote)
Built and engineered ELT data pipelines and query-ready warehouse assets using Python and SQL to enable downstream analytics and ML workflows. Implemented data ingestion, cleansing, and deduplication logic via multi-phase SQL matching (exact, fuzzy, and geographic) across large firmographic datasets. Developed and deployed a FastAPI microservice over BigQuery with validation and audit logging to support automated data serving for applications. • Developed fault-tolerant ELT pipelines using Cloud Storage and BigQuery APIs. • Built SQL matching engines bridging millions of records with window functions and regex cleansing. • Created a FastAPI service with API-key authentication, request validation, and audit logging. • Consolidated and enriched 500M+ raw records into a 60M+ record BigQuery warehouse.