Software Engineer for Code Evaluation for AI Training (Python)
Role Overview
This role involves evaluating AI-generated code responses for technical accuracy and best practices, providing expert feedback to train AI systems in writing better code. As a senior-level position requiring a BS, MS, or PhD in Computer Science, you'll work independently or in a remote team, ensuring AI outputs are functional, efficient, and adhere to industry standards. Your impact will directly improve AI coding capabilities through detailed review and structured feedback.
Perks & Benefits
This is a fully remote position with flexible hours, likely accommodating various time zones, and offers weekly paid compensation upon approval for reliable income. Career growth is supported through performance-based rate re-evaluation for different projects, and the role provides exposure to cutting-edge AI training with leading AI teams, fostering a collaborative and expert-driven culture.
Full Job Description
About the Company
G2i connects subject-matter experts, students, and professionals with flexible, remote AI training work such as annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, and all contributions are paid weekly upon approval, ensuring consistent, reliable compensation.
Project info
This project involves reviewing AI-generated responses, evaluating technical accuracy and best practices, and providing expert feedback that trains AI systems to write better code. You'll work with various programming languages and coding challenges, ensuring AI outputs are functional, efficient, and follow industry standards.
Compensation
Compensation is competitive and varies based on education level, institution, and prior experience.
Hiring Profile
BS, MS, or PhD with a significant focus on Computer Science (Required).
Expert in Python, with a firm grasp of algorithms, data structures, and debugging practices.
Expert-level English proficiency with excellent writing skills.
Expert at fact-checking information using public sources across multiple domains.
Significant experience using large language models (LLMs).
Strong analytical and structured thinking skills.
Ability to explain complex programming concepts clearly and accurately.
Prior experience with RLHF annotation (preferred).
Prior Software Engineering work experience (strongly preferred).
Expertise in additional programming languages (nice to have): C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R.
Compensation
Hourly rates are personalized based on your experience level, educational background, location, and industry expertise. You’ll see your specific rate in your contract offer before signing. Rates for technical roles can vary significantly based on these factors and can be re-evaluated for different projects based on your performance and experience.
Similar jobs
Found 6 similar jobs