Freelance Senior Python Developer - Functional Test Frameworks
Role Overview
This is a freelance senior Python developer role focused on designing and implementing functional test frameworks for AI systems, using tools like pytest and Docker. As an independent contributor, you will work on project-based tasks such as analyzing codebases in C, Rust, or Go to create tests and migration stubs, and building CI pipelines for evaluation. The role involves applying professional judgment to assess AI responses, with an estimated 10-20 hours per week during active phases, requiring senior-level expertise in software development.
Perks & Benefits
This role offers full remote work with worldwide location flexibility, allowing you to choose projects and organize your own schedule as long as deadlines are met. It provides freelance payment rates that can be up to $80/hour, with potential for incentive payments and rates varying based on expertise and project needs. The setup is ideal for those seeking part-time, non-permanent opportunities with no time zone restrictions, focusing on project-based contributions without employment ties.
Full Job Description
Headquarters: Spain URL: https://mindrift.ai/
Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project based as an independent freelance contributor and does not create an employment relationship with Toloka or our clients. What this opportunity involves As an independent freelance contributor, you choose which projects to join and how you organize your work, as long as deliverables meet the project requirements and deadlines. While each project involves unique tasks, contributors may:
Coordinate cross-language migration workflows by analyzing C/Rust/Go codebases to create behavioral tests and migration stubs for Rust targets. Design and implement black-box functional test frameworks (pytest + uv, Python 3.10) for native CLI projects. Built reproducible Docker evaluation images and CI pipelines for agent evaluation (Dagger/Codespaces), handling secure workspace setup and git submodule integration. Apply professional judgment to assess AI responses.
What we look for This opportunity is a good fit for senior software developers open to part-time, non-permanent projects. Ideally, contributors will have:
Degree in Computer Science, Software Engineering or related fields 5+ years in software development with at least 5 years in Python Familiarity with C, Rust, Go / confidence to read this code with LLM English proficiency - B2 Stable internet connection
How it works Apply Pass qualification(s) Select a project Complete tasks on your own schedule within project timelines Get paid Project time expectations For this project, tasks are estimated to require around 10-20 hours of work per week during active phases, depending on the tasks you choose to complete. This is an estimate only and does not create any minimum or guaranteed hours. Payment
Paid freelance contributions, with rates that may be equivalent to up to $80/hour* (project and task based) Fixed project rate or individual rates, depending on the project Some projects include incentive payments
*Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.
To apply: https://weworkremotely.com/remote-jobs/mindrift-freelance-senior-python-developer-functional-test-frameworks
Similar jobs
Found 6 similar jobs
