You will improve the reliability, privacy, and compliance of enterprise data pipelines used in AI systems. The work covers sanitized datasets, multilingual entities, OCR-affected content, unusual document formats, and checks that sensitive information has been removed accurately.
You will combine data engineering, machine learning evaluation, automated testing, and compliance-focused quality assurance.
- Design automated checks for schemas, completeness, data drift, and reconciliation across pipeline stages.
- Analyze data quality across enterprise sources and connectors, including coherence, domain coverage, consistency, and depth.
- Build adversarial test datasets with edge cases and obfuscated identifiers for PII and PHI de-identification systems.
- Evaluate named entity recognition and other ML systems using precision, recall, F1 score, leak rates, and false-negative analysis.
- Investigate privacy leakage across raw, processed, and sanitized data.
- Create CI/CD regression gates for data quality and privacy checks.
- Conduct sampling-based human audits and maintain compliance audit trails.
- Build monitoring and reporting for pipeline quality, de-identification performance, and compliance risk.
What it pays and takes
The listing does not provide a payment rate. The role is structured as part-time contract work with a 20-plus-hour weekly commitment.
- Work arrangement: Contractor and part time.
- Time requirement: 20 or more hours per week.
- Location: Worldwide.
- Language: English.
- Experience: 5 or more years in data engineering, ML engineering, data quality, or a related field.
- Technical skills: Strong Python and SQL, plus experience with pytest, Great Expectations, Pandera, or similar tools.
- Privacy knowledge: Understanding of PII, PHI, and de-identification, with familiarity with HIPAA Safe Harbor, GDPR, or LGPD.
- ML evaluation: Experience using labeled datasets and precision and recall metrics to assess NER or other ML systems.
- Cloud and delivery: Familiarity with CI/CD quality checks and GCP services such as BigQuery, Google Cloud Storage, or Cloud Run Jobs.
- Other strengths: Strong analytical, debugging, and communication skills.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
OpenTrain is the hiring and contracting organization for this role. AI training work is the human work behind AI systems, including preparing data, testing model behavior, and checking whether systems handle sensitive information correctly.
