Job Description

$22.00-$33.00/hour (depending on year in school)

Hybrid or Full Remote 
Preferred Locations - Milford OH, Costa Mesa CA - Maryland Heights, Ann Arbor MI
40 hours a week

Degree Program - Computer Science, Data Science or Data Analytics could provide a good background, but we want to place an emphasis on the actual aptitude towards working with GenAI.

The ideal applicant will possess demonstrated knowledge of custom data sources, data models, custom data structures and data annotation methods when used in combination with Generative AI (GenAI) Large Language Models (LLMs).

Objectives of this role

• Identify, annotate, benchmark and evaluate custom data to be used with GenAI Large LLMs
• Identify opportunities for improvement using complex datasets
• Identify and mitigate regression risks for different custom data types
• Develop and maintain Best-Practices to optimize custom data use for GenAI
• Develop and maintain protocols for identifying, annotating, benchmarking and evaluating data
• Work directly with other team members and project stakeholders to gather requirements, provide status updates, and build relationships

Responsibilities

• Work closely with project stakeholders to understand and maintain focus on their analytics needs, including critical metrics and KPIs, and deliver actionable insights to relevant decision-makers
• Analyze data to answer key questions for stakeholders or yourself, with an eye on what drives overall results, and investigate and communicate which areas need improvement in data efficiency
• Define and implement data acquisition and integration logic, selecting an appropriate combination of methods and tools within the defined technology stack to ensure optimal scalability and performance of the solution
• Develop and maintain databases by acquiring data from primary and secondary sources, and build scripts that will make our data evaluation process more flexible or scalable across datasets

Required skills and qualifications

• Data analytics skills, including annotation, benchmarking and evaluation
• Experience working with GenAI and LLMs
• Strong analytics skills with aptitude for learning other tools

Job Tags

Contract work, Internship, Remote job, Flexible hours,

Similar Jobs