Brokerage Assistant AI Evaluator

You will help improve AI systems by creating questions based on brokerage assistant work and reviewing the answers they produce. Your feedback will show whether responses are accurate, relevant, and consistent with real brokerage practices.

The work covers broker and advisor support, including client workflows, documentation, transaction coordination, deal support, and operational processes.

• Create questions grounded in brokerage assistant and operations work.
• Review AI-generated responses for accuracy and relevance.
• Find errors or missing details in explanations of client, deal, documentation, and operational workflows.
• Use written guidelines and professional judgment to rate responses.
• Write clear feedback using accurate brokerage terminology.

This is independent, project-based contract work for candidates in the United States. Assignments are remote and asynchronous, so they can fit alongside primary employment.

• Hours: About 5 to 20 hours per week when assignments are available; projects open periodically throughout the year.
• Language: Professional fluency in English.
• Experience: At least four years of professional experience as a Brokerage Assistant or in closely related brokerage support or operations work.
• Background: Hands-on experience with broker or advisor support, client workflows, documentation, transactions, or operational processes.
• Skills: Strong written communication, careful attention to detail, independent work, and the ability to follow written guidelines.
• Professional discretion when handling sensitive or proprietary information.
• Relevant backgrounds may include Brokerage Coordinator, Sales Assistant, Client Service Associate, Administrative or Operations Assistant, Transaction Coordinator, or Deal Support Specialist.