STEM Master’s/Ph.D. Research Report Evaluator
Company Description
MillionLogics, a trusted Oracle Partner, is a global IT solutions provider combining innovation and expertise to enable digital transformation. With headquarters in London, UK, and a dynamic development centre in Hyderabad, India, MillionLogics bridges strategic business insight with exceptional technical talent. Through services such as Data & AI, Cloud Solutions, IT Consulting, and Database Services, we empower organisations with scalable and future-ready solutions tailored to their needs. Led by seasoned professionals, MillionLogics is dedicated to delivering cutting-edge technology and driving measurable outcomes for clients worldwide. Role Overview:
- We are conducting an initiative that involves evaluating deep research reports generated by AI systems. Evaluators will read and assess reports across multiple quality dimensions using a structured rubric, providing both numerical ratings and written justifications.
- This is a one-pass evaluation: each report is reviewed by a single general evaluator. The project covers hundreds of reports spanning diverse domains, including technology, healthcare, education, science, economics, social sciences, arts, and more.
Offer Details: Contract Duration: 6 months initially Compensation: USD 20-25 per hour (net/take-home) Working hours: Preferably full-time (40 hours/week) for U.S.-based candidates, but part-time is also acceptable with a 4-hour overlap with PST What does day-to-day look like?
- Read the research query to understand the intent and scope of the assigned report.
- Read and annotate the report using a PDF reader (Adobe Acrobat), highlighting key evidence and flagging issues such as broken links, weak sources, and claim-source mismatches.
- Score the report across 10 dimensions on a 1–5 scale using the provided rubric.
- Write justifications for each rating, referencing specific evidence from the report.
- Submit results via a survey and return the annotated PDF.
Requirements:
- Graduate student (Master’s or PhD candidate).
- Professionals with 1–3 years of experience in a relevant or adjacent domain.
- Regularly reads and consumes research reports, white papers, or analytical documents.
- Strong English reading comprehension and written communication skills.
- Based in the USA or Canada.
- Comfortable working with PDF annotation tools (Adobe Acrobat) and online surveys.
- Familiarity with one or more of the report domains: technology, healthcare, education, science, economics, social sciences, or related fields.
- Experience with quality evaluation, annotation, or data labelling tasks.
- Attention to detail and ability to provide clear, evidence-based written feedback
What MillionLogics is NOT seeking from your expertise:
- Confidential or proprietary information from any employer or university.
- Trade secrets or internal company or university data.
- Specific client information or case details.
- Any information that would violate NDAs, employment agreements or other confidentiality obligations.
How to Apply? Please send your updated CV to [email protected] with job ID: 72795 as your email subject. Apply To this Job