AI Evaluator - Library and Information Science
Straive is a global leader in enterprise-grade data analytics and AI solutions, committed to empowering businesses across various industries with cutting-edge technology and expert insights. Backed by EQT, a top private equity firm, we are uniquely positioned to drive innovation through significant investments and an entrepreneurial spirit. Our core focus is on delivering advanced Data Analytics & AI Solutions. By combining sophisticated technology with subject matter expertise, we deliver material impact on our clients' topline and streamline their operations. We specialize in providing tailored solutions across financial services, CPG, legal, pharma, life sciences, retail and logistics, helping them build robust data analytics and AI capabilities. With a client base spanning 30 countries, Straive's strategically located teams operate from eight countries and is headquartered in Singapore. This global presence enables us to offer localized expertise with a worldwide perspective. Join Straive to be part of a dynamic team at the forefront of data analytics and AI innovation. Here, you'll have the opportunity to contribute to transformative projects, supported by significant investments and an entrepreneurial drive fueled by our partnership with EQT. Website: https://www.straive.com/ Job Title: AI Evaluator - Library and Information Science Type: FTE Location: Remote Roles and responsibilities (I) Key Responsibilities: Review and Validate AI Responses: a) Evaluators will work via Straive, or client-provided online platform. b) All decisions of the Evaluators must be applied in line with the project-specific criteria and guidelines. c) The goal is to assess the quality, safety, and utility of AI-generated content for different use cases like assessing literature summarization done by AI, AI responses to queries raised by users of various databases in subjects like Biological sciences, Social sciences, Chemistry, Engineering or Clinical medicine. d) Each AI generated response should be rated across specific criteria that will be provided (Eg. Accuracy, Factuality, Comprehensiveness etc) e) Wherever applicable a justification or commentary must be written on the rationale behind a particular rating. f) Justification/commentaries must be error-free, concise and consistent with the established knowledge in the corresponding subject area. g) Rewriting the commentary and revisiting the evaluation based on quality checks or client feedback is also within scope (II) SMEs must stay well versed in their area of expertise; ensure that their validation and feedback are informed by the most current and accurate information in their domain. (III) Maintain Confidentiality: Adhere to strict confidentiality of the data received for processing and comply with data protection protocols and other relevant contract commitments and laws This job description is not intended to cover or contain a comprehensive listing of all responsibilities, duties, or activities that are required. Responsibilities, duties, and/or activities may change, or new ones may be added at any time with or without notice. If you are a motivated professional with a passion for delivering impactful solutions, we’d love to hear from you. Apply today to be part of a dynamic and forward-thinking team at Straive. “Straive is an Equal Opportunity Employer. Our policy is clear: there shall be no discrimination based on age, disability, sex, race, religion or belief, gender reassignment, marriage/civil partnership, pregnancy/maternity, or sexual orientation. We are an inclusive organization and actively promote equality of opportunity for all with the right mix of talent, skills and potential. We welcome all applications from a wide range of candidates. Selection for roles will be based on individual merit alone.”