Software Engineer, AI (Ruby)
Role Overview
This mid-level role involves training AI models to write production-grade code by comparing and ranking code snippets, repairing AI-generated code for correctness and style, and providing feedback to improve the RLHF pipeline. As a Software Engineer, you'll work in an asynchronous, low-oversight environment, focusing on code evaluation and training to help models learn to propose and critique code effectively. The impact includes directly enhancing AI capabilities for code generation, ensuring high-quality outputs across various programming languages.
Perks & Benefits
The job offers fully remote work from anywhere, with flexible hours ranging from 15 to 40 per week, ideal for balancing other commitments. Compensation varies from $30 to $70 per hour based on location and seniority, and the role is a 1099 contract, providing straightforward impact without corporate fluff. It supports an asynchronous culture with minimal oversight, allowing for autonomy and focus on detailed, written communication tasks.
Full Job Description
Software Engineer, AI — Code Evaluation & Training (Remote)
List of accepted countries and locations
Help train large-language models (LLMs) to write production-grade code across a wide range of programming languages:
Compare & rank multiple code snippets, explaining which is best and why.
Repair & refactor AI-generated code for correctness, efficiency, and style.
Inject feedback (ratings, edits, test results) into the RLHF pipeline and keep it running smoothly.
End result: the model learns to propose, critique, and improve code the way you do.
RLHF in one line
Generate code ➜ expert engineers rank, edit, and justify ➜ convert that feedback into reward signals ➜ reinforcement learning tunes the model toward code you’d actually ship.
What You’ll Need
3+ years of professional software engineering experience in Ruby
(Constraint programming experience is a bonus, but not required)Strong code-review instincts—you can spot logic errors, performance traps, and security issues quickly.
Extreme attention to detail and excellent written communication skills.
Much of this role involves explaining why one approach is better than another. This cannot be overstated.You enjoy reading documentation and language specs and thrive in an asynchronous, low-oversight environment.
What You Don’t Need
No prior RLHF (Reinforcement Learning with Human Feedback) or AI training experience.
No deep machine learning knowledge. If you can review and critique code clearly, we’ll teach you the rest.
Tech Stack
We are looking for engineers with a strong command of Ruby.
Logistics
Location: Fully remote — work from anywhere
Compensation: From $30/hr to $70/hr, depending on location and seniority
Hours: Minimum 15 hrs/week, up to 40 hrs/week available
Engagement: 1099 contract
Straightforward impact, zero fluff. If this sounds like a fit, apply here!
Similar jobs
Found 6 similar jobs