Model Evaluator Job at YPAI, Remote

S2N4RzZTa2puNm1LOTJ6b2VnTFVsdU9wWWc9PQ==
  • YPAI
  • Remote

Job Description

Rate and compare AI answers and explain why, as paid work from home. It suits careful readers who can say why an answer is wrong, not only that it is.

What the work is for

Your ratings and written reasons help train AI models and test their answers.

The work

  • Rate and compare AI answers against the project's criteria.
  • Write a short, concrete reason for each rating. It matters as much as the rating itself.
  • Check the facts in an answer. Rewrite weak answers where the task asks for it.
  • Flag unsafe, false or policy-breaking output explicitly.

What to expect

  • Each project has its own rating criteria and instructions for judging answers.
  • You work in YPAI's own review console, where each project's rating criteria are set up.

You need

  • Strong reading comprehension in the language you evaluate.
  • The ability to explain why, not only what.
  • 18 years or older.

Good to know

  • You will read unsafe or offensive output at times. Judging it is part of the work.
  • Work depends on the projects running in the language you evaluate. There can be gaps between projects.

Pay

$20–$28/hr. Rate shown is for the United States. This role is open in 12 countries, with local rates; pick your country on YPAI.

YPAI pays every two weeks for approved work via PayPal, Wise or bank transfer. Work is by invitation after your profile is reviewed.

Job Tags

Contract work, Local area, Work from home

Similar Jobs

UF Health

Respiratory Therapist Job at UF Health

Overview: Position Summary: Under the supervision of the Cardiopulmonary Services Medical Director and Department Director, the Respiratory Therapist performs direct patient care to patients in all aspects of respiratory care according to the physicians orders/approved... 

Mondo

Web Developer Job at Mondo

 ...Title: Web Developer Location: Hybrid NYC or VA - 3 days/ week onsite Duration...  ...Lead the entire lifecycle (design, development, testing, and deployment) of complex Tableau...  .... Collaborate extensively with Data Engineers and Scientists to define and refine data... 

Talnt

Tool Maker Job at Talnt

 ...Tool Maker Worcester, MA | Full-Time | On-Site Compensation: Up to $40.00 per hour About the Role: We are seeking...  ...tooling used in the manufacturing of bearings, metal stampings, machined components, and assemblies. This hands-on role is responsible for... 

Flytrex

Real Estate & Development Manager - Houston Job at Flytrex

 ...who want to join our Operations Team in Houston. As a Real Estate and Development Manager, youll work directly with our leadership teams identifying...  ...of land use planning, zoning, permitting, and commercial and mixed-use development. Key Responsibilities:... 

Sivana

Warehouse Associate - Starting at $18/hr Job at Sivana

**Now Hiring: Warehouse Associate** Join our fun, supportive team at Boxfort, a 3PL fulfillment center!**About Us:** We're more than a warehouse; we're a team that values: - **Rock Solid:** Honest and dependable. - **Down to Earth:** Collaborative and approachable...