ChromaDB Developer, Code Review & Evaluation

About OpenTrain AI

OpenTrain AI is the #1 platform for finding and building careers in AI training and data labeling. We help people start and grow careers teaching AI by connecting contributors with projects that improve how modern models behave.

This role is contracted through OpenTrain AI and contributes directly to training and evaluating systems that rely on human expertise for correctness and best practices.

About AI Training Work

AI training (data labeling/annotation) is the human work behind modern models: people create, review, and rate examples so models learn useful, safe, and efficient behaviors. These projects are often remote, flexible, and open to people with practical domain skills rather than formal credentials.

As an evaluator you will work at the intersection of software engineering and model evaluation, shaping how AI recommends and uses vector search and embedding-based retrieval.

The Role

You will review AI-generated prompts and code related to ChromaDB, judge correctness and relevance, label and categorize outputs, and provide structured, detailed feedback that helps improve AI answers about vector search and retrieval.

This is a part-time, contractor role. Compensation: $25 USD per hour. Time commitment: less than 20 hours per week. Work is fully remote and worldwide.

• Role type: Contractor, Part-time
• Pay: $25 USD per hour (PAY_PER_HOUR)
• Time: < 20 hours/week, remote (worldwide)

What You'll Do

Your day-to-day work focuses on technical code and design evaluation for ChromaDB-related answers produced by AI systems. You will both label outputs and act as a technical gatekeeper in candidate interviews.

• Review AI-generated ChromaDB prompts, code snippets, and responses for correctness and best practices.
• Label and categorize outputs according to accuracy, relevance, and implementation quality.
• Identify errors, inefficiencies, and missing best practices in vector storage, indexing, and retrieval logic.
• Provide structured, actionable feedback in clear English to help improve AI responses.
• Conduct AI-driven technical interviews to assess candidate competency with ChromaDB and vector databases.

Interview & Evaluation Guidelines

You will perform structured assessments when interviewing candidates for ChromaDB roles. Follow the guidelines below to verify hands-on expertise, practical problem-solving, and communication clarity.

• Experience Assessment: Confirm at least 5+ years of hands-on experience with ChromaDB and vector databases; ask about real-world projects involving similarity search, embeddings, and large-scale indexing.
• Technical Knowledge Check: Present a short ChromaDB code snippet with a deliberate issue for the candidate to identify and fix; probe optimization strategies for millions of records and indexing choices, metadata filtering, and hybrid search.
• Task Understanding & AI Evaluation Skills: Explain the project's goal (reviewing AI-generated ChromaDB answers) and ask how the candidate would analyze, correct, and enhance AI responses.
• Communication & Clarity: Evaluate the candidate's ability to explain complex ChromaDB features (e.g., hierarchical indexing or hybrid search) in clear, plain English.
• Final Confirmation: Ask about prior experience reviewing AI-generated code or performing code quality evaluations and confirm willingness to complete structured labeling tasks.

Requirements

Do not apply unless you meet the core technical requirements below. This role demands practical, hands-on experience and strong written English.

• Minimum 5+ years hands-on experience working with ChromaDB and vector databases (explicit requirement).
• Deep expertise with embedding models, similarity search, and indexing large-scale datasets.
• Practical experience integrating ChromaDB with LLMs and optimizing retrieval performance.
• Strong English writing skills for clear, structured feedback and interview assessment.
• Experience reviewing or evaluating AI-generated code and providing actionable corrections.
• Availability for part-time contractor work (<20 hours/week) at $25/hr, worldwide remote.

Who Should Apply & How It Works

This role is ideal for senior ChromaDB or vector-database engineers who enjoy code review, mentoring, and improving AI outputs. You will help filter candidates and produce labeled evaluations that directly refine model behavior.

Apply through your OpenTrain AI account. If selected, you'll complete structured evaluation tasks and technical interviews as described; your labels and feedback will be used to improve AI performance and search/retrieval guidance.

• Employment types: Contractor, Part-time
• Data type: Computer code/programming; label type: COMPUTER_PROGRAMMING_CODING
• World-wide applicants welcome; no specific country or language restrictions listed