Software Engineer
Role Overview
This mid-level Software Engineer role involves designing and building scalable backend infrastructure and API endpoints for real-time AI agents, focusing on performance and reliability. You'll work across the stack in a fast-paced startup environment, taking ownership of critical systems and contributing to architectural decisions. The role requires expertise in distributed systems and cloud services to support high-throughput, low-latency workflows.
Perks & Benefits
This is a fully remote position, likely with flexible hours, though time zone expectations may align with team collaboration. The role offers significant ownership and career growth in a low-process, technically ambitious startup culture focused on velocity and quality. You'll work with innovative AI teams, contributing to cutting-edge technology in a fast-paced environment that values hands-on expertise and continuous improvement.
Full Job Description
About Tavily
We're building the infrastructure layer for agentic web interaction at scale. Our API is designed from the ground up to power Retrieval-Augmented Generation (RAG) and real-time reasoning in AI systems. By connecting LLMs to high-quality, trustworthy web content, we help developers build agents that are not only intelligent - but also informed.
We work with some of the most innovative teams in AI - from small startups shaping the ecosystem to the largest enterprises deploying AI at scale. Whether it’s powering sales assistants, research copilots, or internal knowledge tools, we’re the missing link between LLMs and the real world.
The Role: Software Engineer
We’re looking for a Software Engineer to join our core engineering team and help build the infrastructure that powers real-time AI agents. You’ll work across the stack, ship fast, and take ownership of critical systems as we scale.
This is a great role for a generalist who loves building from scratch, thrives in low-process environments, and wants to work on technically ambitious problems.
What You'll Do
Be the expert in building fast, reliable, and scalable systems for real-time LLM workflows
Design and implement backend infrastructure and API endpoints
Collaborate closely with product to iterate on features quickly and thoughtfully
Improve performance, monitoring, and reliability across the stack
Own core systems and contribute to key architectural decisions
Help shape a strong engineering culture focused on velocity and quality
What You Bring
2+ years of professional software engineering experience
Strong backend development skills (Python, Go , C++)
Proven experience designing and operating large-scale, distributed systems, with a solid understanding of API design, reliability, and performance at scale
Hands-on expertise with AWS infrastructure and cloud-native services, bringing practical knowledge of deploying and managing services in real-world environments
Comfortable in a fast-paced startup environment with lots of ownership
You have hands-on experience designing and operating high-throughput, low-latency infrastructure, including systems that handle massive concurrency, heavy query loads.
Curiosity about LLMs, retrieval and the future of AI systems, with a drive to stay at the forefront of new technology
Nice To Have
Experience with performance optimization, load testing, and debugging production issues in large-scale systems.
Strong attention to system correctness, performance, and reliability, and a drive to continuously refine and improve production systems to perfection.
Familiarity with DevOps practices, including CI/CD pipelines, infrastructure as code, Kubernetes orchestration, and modern monitoring tools.
Similar jobs
Found 6 similar jobs