Mercor

AI Scenario Auditor - Fully Remote 50

Mercor·West Virginia, US

Projected AI Stack

Based on our analysis of Accountants and Auditors positions

7.5Very High AI Upgrade Potential
MCMicrosoft 365 CopilotSOC audit workpaper documentation and evidence tracking spreadsheetsdaily
CLClaudeDraft audit findings summaries and compliance gap analysis memosweekly
PXPerplexityResearch FedRAMP, FISMA, and DoD policy updates for examination scopeweekly

Projected Workflow

How AI is expected to reshape this role

AI-assisted

Audit evidence collection and documentationMicrosoft 365 Copilot
Compliance findings summarization and reportingClaude
Regulatory framework research and benchmarkingPerplexity

Human-led

External auditor liaison and SOC1 coordination
Internal control evaluation and walkthroughs
Risk assessment and audit scoping
Audit opinion review and final sign-off

This AI stack and workflow map are projected by UpgradedJobs based on occupational analysis, not stated by the employer. They reflect how AI tools are transforming Accountants and Auditors roles today.

About the role


About the jobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .Position: Quality Control LeadType: W2 EmploymentCompensation: $80$105/hourLocation: RemoteCommitment: 40 hours/weekRole ResponsibilitiesAudit and evaluate detailed personas, digital environments, and tasks created by AI Training Scenario Designers. Ensure they are logically sound and properly structured.Apply strict rubrics to score scenarios objectively. Ensure tasks challenge an AI agent's ability to reason, filter, and prioritize.Identify logical inconsistencies, factual errors, missing context, and technical flaws, such as invalid JSON structures.Provide clear, constructive, and actionable feedback to scenario designers to refine their worlds and improve output.Document outcomes by logging review results, scores, and feedback in Airtable and Crucible .QualificationsMust-HaveUndergrad degree2+ years professional experiencePreferredEditing / QA background Senior editor, QA tester, technical reviewer, compliance auditor, or peer-reviewer.Technical / data comfort JSON familiarity, Jira/Asana power user, data analyst, SQL/Python exposure.Process & Systems thinking Operations managers, technical PMs, or systems designers.Application Process (Takes 2030 mins to complete)Upload resumeAI interview based on your resumeSubmit formResources & SupportFor details about the interview process and platform information, please check: any help or support, reach out to:

  • **PS:
  • Our team reviews applications daily.
  • Please complete your AI interview and application steps to be considered for this opportunity.#

Interested in this role?

Apply on Mercor website →

Listed on UpgradedJobs · Originally posted on Jobilize

Similar roles

Hiring someone who uses AI daily?

Post your role and reach candidates with real AI skills.

Post a job →
Apply now →