Civil Engineering AI Evaluation Expert

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help experienced practitioners consolidate work, build a unified AI-training portfolio, and grow a durable freelance career by contracting directly with OpenTrain AI to develop high-quality evaluation content for models.

About AI training and why it matters

AI training (also called data labeling, annotation, or human feedback work) is the human side of building modern AI systems. Experienced engineers shape how models behave by creating realistic scenarios, drafting reference outputs, and writing rubrics that capture expert judgment. This work is remote, flexible, and a direct way to influence the performance of AI used in engineers’ everyday tools.

The role

OpenTrain AI is recruiting civil engineering specialists to design evaluation tasks for AI systems applied to large-scale infrastructure and construction programs. You will build scenario-based tasks, draft authoritative reference outputs, and write rubrics that separate senior engineering judgment from generic answers.

• Work type: Contractor, part-time (20+ hours/week)
• Data type: Document-based tasks (technical narratives, design summaries, review comments)
• Labeling focus: text generation evaluation, RLHF guidance, and evaluation/rating of model outputs

What you'll do

You will translate real civil engineering practice into evaluation assets that teach and test model behavior. Tasks are practical, appraisal-focused, and anchored to standards and regulatory processes.

• Design scenario-based evaluation tasks for infrastructure design, permitting reviews, and construction management
• Draft clear reference outputs (design decisions, calculations, review comments, technical narratives) that reflect senior-level judgment
• Write rubrics that isolate expert criteria and scoring guidance — distinguishing acceptable from unacceptable engineering responses
• Incorporate regulatory, environmental review, and public-agency oversight considerations (e.g., NEPA processes)
• Use and reference civil engineering tools and methods such as AutoCAD Civil 3D, Revit, STAAD.Pro, ETABS, HEC-RAS, structural load analysis, and hydrology/hydraulic modeling

Requirements

You must bring proven civil engineering experience and the ability to convert technical practice into teachable evaluation artifacts. OpenTrain will require you to demonstrate relevant background during onboarding.

• 5+ years of experience as a civil engineer or engineering lead on large infrastructure design, permitting, or construction delivery
• Fluency with civil engineering tooling, methods, and standards (AASHTO, ASCE) and experience applying them to real projects
• Understanding of NEPA, regulatory review, environmental review, and public-sector oversight
• Proven ability to write clear technical narratives, design documentation, or rubrics that reflect expert judgment
• Professional Engineer (PE) license strongly preferred; equivalent professional qualification accepted

Who should apply

This role is for senior civil engineers, engineering leads, or technical authors who want to shape how AI understands professional engineering reasoning. Prior experience authoring design guidance, QA rubrics, training materials, or technical review reports is highly relevant.

• Senior practitioners in structural, transportation, water resources, geotechnical engineering, or construction management
• Engineers comfortable translating technical decisions into concise reference answers and scoring criteria
• Professionals seeking flexible, remote contract work that leverages domain expertise to improve AI systems

Compensation, schedule, and logistics

This is a remote contract position with OpenTrain AI, open worldwide for English-language contributors. Pay is hourly at $70–$80 USD per hour. Expected minimum commitment is 20+ hours per week, with flexible scheduling. Work will be performed on document-based tasks and model-evaluation exercises.

• Hourly rate: $70–$80 USD per hour
• Time commitment: 20+ hours/week (part-time contractor)
• Language: English required; worldwide applicants accepted

How it works

Apply through your OpenTrain profile and complete the short onboarding and qualification checks. You'll receive task briefs, evaluation templates, and examples — then create scenarios, reference outputs, and rubrics according to the project's guidelines. Feedback cycles and calibration tasks ensure consistency across evaluators.

• Create or update your OpenTrain profile to showcase civil engineering experience
• Complete onboarding qualifications and sample tasks to demonstrate domain and rubric-writing ability
• Collaborate with OpenTrain AI on iterative reviews and calibration exercises