Philosophy Expert - AI Evaluation Fellowship
Listing checked September 18, 2026 · pay as published by Handshake AI
Overview
Handshake AI hires philosophy PhDs for project-based contract work that improves how AI systems handle reasoning and theory. You will review model outputs in areas such as moral philosophy, theoretical analysis, and technical problem solving, then write feedback that flags weak arguments and missing nuance. The schedule is remote and asynchronous, with no minimum hours; most people contribute around 5 to 20 hours each week during an active project. Project leads place contributors based on current needs and may invite them to later projects. This fellowship suits doctoral students, postdocs, and graduates who want to keep their academic or industry commitments while earning up to $120 per hour.
What You'll Do8
- 1Review AI-generated responses for errors in philosophical reasoning, moral theory, and technical problem solving.
- 2Write detailed critiques that explain where an argument breaks down and how the model could improve.
- 3Flag unsupported claims, misread philosophical positions, and shallow theoretical analysis.
- 4Compare model outputs against standards found in leading generalist and ethics journals.
- 5Assess how well responses apply normative concepts, ethical frameworks, and logical structure.
- 6Document recurring weaknesses in model philosophy reasoning for project leads.
- 7Complete assigned evaluations during active project cycles on an asynchronous schedule.
- 8Maintain your own quality bar across content batches and return feedback within project timelines.
Requirements8
- 1Doctoral student or graduate in philosophy or a related field. Postdoctoral appointments qualify.
- 2At least one peer-reviewed article on moral philosophy in a top generalist or ethics journal.
- 3Publication in venues such as Philosophical Review, The Journal of Philosophy, Noûs, Philosophy and Phenomenological Research, Mind, Ethics, Philosophy & Public Affairs, Utilitas, Journal of Moral Philosophy, or Oxford Studies in Normative Ethics.
- 4Ability to evaluate arguments in moral philosophy and related areas with precision.
- 5Comfort with remote, project-based contract work and asynchronous communication.
- 6Strong written English for clear, detailed critique.
- 7Availability of about 5 to 20 hours per week during active projects.
- 8No minimum hour requirement, but active project participation depends on placement.
Who Should Apply
The ideal candidate holds or pursues a philosophy PhD and has placed at least one moral philosophy article in a journal such as Ethics, Mind, or Philosophy & Public Affairs. Doctoral students, postdocs, and graduates who can set aside 5 to 20 hours each week during project cycles fit the workflow. This role is less suitable for people without a philosophy doctorate or for those who have not published in the listed venues, because the project screens on that record. Applicants also get rejected when their feedback stays vague or when they cannot show close engagement with normative ethics. If your publication is in a different subfield or a lower-tier journal, your fit score will fall short.
Salary Insight
Pay reaches up to $120 per hour for this fellowship. That rate sits at the high end for part-time AI evaluation work, which matches the advanced philosophy credential and journal publication bar. Exact pay depends on the project and placement, so confirm details during onboarding.
Location
Compensation
Up to $120/hr
Required Skills
Application Tip
Lead your application with the exact journal and article title for your moral philosophy publication, then add one line on how that work trained you to spot weak normative arguments in AI outputs. Name the journal early because the screen looks for venues such as Ethics, Mind, Noûs, or Philosophy & Public Affairs.
See NearSkill jobs more often in your search
Application & verification flow
1Instant rubric match
Your resume is scanned against this role’s requirements to check qualification fit.
2Screened before the employer sees it
Only profiles that clear screening are passed on.
3Outcome by email
We notify you at the address on your resume once the screening is reviewed.
Similar open positions
Explore active roles that match your skills and interests.
AfterQuery
VerifiedPhilosophy Expert - Remote Contract Role
AfterQuery seeks philosophers to create the argument analysis and ethical reasoning tasks that frontier AI labs use to assess model judgment. You will design scenarios, write reference answers, and critique model responses for logical quality. The contract runs remote and async, with a commitment of at least 10 hours each week. Pay ranges from $50 to $100 per hour, and Stripe handles payment each week. Work stays inside your specialty, where rigor matters more than how many items you complete.
Handshake AI
VerifiedMath Expert AI Evaluation Fellowship Remote
Handshake AI recruits Math PhDs to sharpen how AI systems handle mathematical reasoning, proof construction, and technical problem-solving. The work centers on crafting difficult domain questions and checking AI-generated answers for accuracy, logical consistency, and mathematical rigor. Contributors join a remote, project-based fellowship with a schedule they set themselves. Most participants log 5 to 20 hours per week while a project is active, and no prior AI or technical experience is needed. Placement follows current project needs, with chances to join later projects as they open.
SME Careers
VerifiedPhilosophy QA Lead for Remote AI Training Projects
As a philosophy QA Lead, you will oversee quality and consistency across philosophy-focused AI training projects, coordinating with remote trainers and QAs. Review AI-generated philosophy explanations, argument analyses, and ethical reasoning for accuracy against project rubrics. Provide precise written feedback and maintain quality standards via style guides and onboarding materials. Strong experience in remote collaboration with expert teams helps ensure you guide calibrated quality workflows.
Handshake AI
VerifiedAI Evaluation Specialist - Remote Fellowship
Handshake AI hires students and graduates to support AI research with leading labs. You will use your academic background to help Large Language Models (LLMs) perform better in specific subjects. Projects run in a remote, async format, and the work includes writing domain-specific prompts and judging LLM responses. No minimum hour commitment applies, and placement depends on project availability. The fellowship is part-time and pays $17 to $30 per hour.
Handshake AI
VerifiedSTEM PhD AI Fellowship (Remote, Europe, UK)
Handshake AI runs a year-round fellowship that pulls STEM doctoral researchers into its AI research community, where experts shape how large language models handle scientific subjects. Fellows work remotely and set their own schedule, logging roughly 10 to 20 hours each week on project work. Typical tasks center on building domain-specific prompts and judging model responses for accuracy in mathematics, chemistry, physics, biology, and engineering. Project slots open and close with demand in each discipline, so placement depends on what is available when you apply.
AfterQuery
VerifiedGraduate Student AI Evaluator - Remote Contract
AfterQuery seeks current master's, PhD, MD, and MD/PhD students to join a remote AI evaluation research project across academic disciplines. You will use the vocabulary and visual conventions of your field, such as spectra, schematics, maps, or clinical images, to judge written and multimodal material. Projects run on a remote, asynchronous schedule, and you decide which windows to accept, with each window asking for about 10 to 20 hours per week. Pay ranges from $50 to $150 per hour, and a project week can bring in $800 to $1,500 based on discipline and seniority.