STEM & Technical Specialist (Remote) Contract
Listing checked September 29, 2026 · pay as published by SME Careers
Overview
Remote, hourly contract for a STEM & Technical Specialist focused on rubric design. You will craft expert-level questions that probe deep technical reasoning and reveal weaknesses in frontier AI models. You will write evaluation rubrics that specify required reasoning, acceptable alternatives, partial-credit criteria, and critical errors. You will develop reference content and problem sets to support RLHF and SFT workflows, helping AI systems improve reasoning and reliability.
What You'll Do9
- 1Create expert-level technical questions that test deep reasoning and expose weaknesses in frontier AI models.
- 2Design detailed evaluation rubrics that define what a correct, rigorous answer must include, including reasoning steps and partial-credit criteria.
- 3Define partial-credit standards with clear criteria for essential steps, acceptable alternatives, edge cases, and critical errors.
- 4Evaluate AI-generated solutions for accuracy, reasoning quality, and technical precision while documenting scoring rationales.
- 5Identify hidden reasoning errors where correct conclusions rely on flawed logic.
- 6Review peer rubrics for clarity, completeness, and scoring consistency to improve overall reliability.
- 7Develop reference content, including expert answers, explanations, and critique materials for learning and benchmarking.
- 8Support AI training pipelines by producing questions, rubrics, evaluations, and reference-answer pairs for RLHF and SFT workflows.
- 9Maintain technical rigor by aligning all outputs with standard disciplinary practices and model evaluation guidelines.
Requirements12
- 1bachelor’s degree or higher in mathematics, physics, chemistry, engineering, computer science, statistics, applied science, or another technical field
- 2strong professional English proficiency (minimum c1) with the ability to articulate precise technical criteria
- 33+ years of experience in a relevant technical domain (academic, research, or industry)
- 4demonstrated advanced expertise in a clearly defined technical specialty
- 5ability to craft challenging questions that require multi-step reasoning and professional judgment
- 6strong skill in designing detailed rubrics with explicit reasoning, methodology, alternatives, partial-credit, and errors
- 7ability to distinguish correct final answers from solutions supported by valid but flawed reasoning
- 8comfort in critiquing peers’ rubrics for ambiguity, missing criteria, redundancy, or scoring issues
- 9high attention to detail when evaluating formulas, assumptions, units, edge cases, and terminology
- 10experience with exam writing, academic grading, peer review, or standards development is highly preferred
- 11prior exposure to AI evaluation, RLHF, SFT, benchmarking, data annotation, prompt design, or LLM evaluation is preferred
- 12reliable, self-directed, and able to deliver consistent quality in hourly remote contractor work
Who Should Apply
Applicants with a strong technical background and hands-on rubric design experience are ideal. Look for candidates who have 3+ years in math, physics, chemistry, engineering, or computer science and a track record of creating multi-step questions and clear evaluation criteria. The role fits those who can separate correct results from flawed reasoning and who can critique rubrics with precise feedback. Strong English writing and comfort with remote, hourly contractor work are essential. This position may not be a fit for applicants lacking specialized technical expertise or experience in exam design or AI evaluation, and those who cannot commit to a remote, hourly schedule may score lower.
Salary Insight
Pay is $100/hr. This hourly remote contractor role aligns with specialized AI evaluation work and offers flexible scheduling typical of expert rubric design projects.
Location
Compensation
Up to $100/hr
Required Skills
Application Tip
Attach a portfolio featuring a rubric design sample and a multi-step question with evaluation criteria, plus a brief note on RLHF or SFT experience.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
SME Careers
VerifiedHealthcare Specialist Remote Contract Rubric Design
This hourly remote contractor role leverages your healthcare expertise to craft expert-level questions that reveal ai evaluation limits across medical domains. You will evaluate AI-generated clinical content and outline rubrics that specify required facts, reasoning steps, caveats, and acceptable alternatives. Your work helps ensure outputs meet clinical safety and professional standards. The role centers on rubric design and expert evaluation within SME Careers' AI data services program.
SME Careers
VerifiedFinance & Accounting Specialist (Remote) Rubric Design
Remote, hourly contractor role for a Finance & Accounting SME focused on rubric design, with hands-on work in excel and sql. You will craft realistic finance tasks and evaluate AI-driven outputs using precise criteria and professional judgment, shaping how complex financial work is assessed. Rubric design sits at the core as you specify calculations, assumptions, materiality, and reasoning across domains like accounting, corporate finance, and valuation. You will build reference content and assessment materials to support RLHF and SFT training for leading AI models.
Micro1
VerifiedStem Expert for AI Training Python Pro in Remote Contract
micro1 seeks STEM specialists to join an AI training project that blends technical problem-solving with scientific reasoning. You will work as an independent contractor, roughly 15 hours per week, on a schedule you control, including weekends if you prefer. The core of the job is coding-heavy: you will use Python to compute, simulate, and validate solutions, then judge whether AI-generated answers hold up. Deep expertise in one area such as Biology, Chemistry, Mathematics, Physics, Earth Science, or Robotics is what matters most. Pay ranges from $80 to $150 per hour, and the role is fully remote worldwide.
Micro1
VerifiedEducator Assessor Writer – Remote Contract
micro1 seeks Educator/Assessor Writers to support a customer project building advanced AI systems. You will evaluate AI-generated written responses, assign scores using rubrics, and write detailed rationales. This fully remote contract lets you work alongside other commitments. No AI background is needed; your expertise in grading or assessment design is what counts.
SME Careers
VerifiedMaterials Scientist (Remote) Contract
Remote contract role focusing on evaluating and creating high-quality materials science content. Work as a SME to review AI-generated materials science outputs, assess accuracy of crystal structures, phase diagrams, and structure-property relationships, and provide precise written feedback. Collaborate with an AI data services team to improve model explanations, calculations, and terminology in materials science contexts.
SME Careers
VerifiedComputer Science Team Lead for QA in Remote Contract
This hourly, remote contractor role leads quality assurance across computer science and IT training programs, software content, and system workflows. You will review AI training content and LLM evaluation outputs, assessing explanations, code snippets, and troubleshooting guidance for accuracy against rubrics. Provide precise written feedback and keep trainers and QAs aligned through updates on Discord about guidelines and quality standards. A strong foundation in CS/IT, excellent written English, and meticulous attention to detail ensure effective coordination of remote contributors.