AI/ML Engineer

About Us:
We’re a boutique engineering consultancy and AI data lab working with leading AI model providers to improve the capabilities and reliability of their models.

Our work brings together software engineering, data, and experimentation. We build systems that test what AI can do, uncover where it struggles, and produce the data needed to help it improve.

We’re looking for an AI/ML Engineer focused on evaluation systems, synthetic data pipelines, and tooling for AI agents. You’ll tackle unfamiliar problems, turn ideas into working software, and build infrastructure that supports practical AI development.

What You’ll Work On:
You might create an environment where an agent navigates a codebase, build a pipeline that generates challenging tasks, or develop checks that distinguish a correct result from a convincing-looking answer.

Your work will include:

• Creating isolated execution environments and automated tests that measure how AI agents perform on realistic tasks.
• Building workflows for generating, processing, and validating data used to improve model capabilities.
• Developing interfaces and automation that help domain experts review complex outputs and provide consistent feedback.
• Turning open-ended technical problems into reliable software, defining validation checks, and improving systems based on observed failures.

What Makes You a Great Fit:
You’re comfortable getting into the details: reading unfamiliar code, tracing unexpected behavior, and figuring out how to make a system more dependable.

We’re looking for:

• Experience developing maintainable software, with a thoughtful approach to testing, debugging, and correctness.
• Strong programming skills, ideally in Python, with experience building backend systems, automation, or data pipelines.
• Practical knowledge of Linux, Docker, APIs, and asynchronous or concurrent workloads.
• Ability to navigate unfamiliar codebases, identify root causes, and learn new tools independently.
• Ability to make progress with incomplete requirements, communicate tradeoffs, and carry work through to delivery.

Bonus Points:

• Experience integrating LLM APIs into applications or automated workflows.
• Familiarity with agent tooling, orchestration frameworks, or automated task execution.
• Exposure to synthetic data generation or post-training methods such as SFT, RLHF, and DPO.
• Experience measuring model performance or working with benchmarks such as SWE-bench or OSWorld.
• Personal projects or open-source contributions that demonstrate initiative and strong problem-solving skills.

What You’ll Get:

• Work at the Frontier: Contribute to engineering projects that support the development of more capable AI models.
• Grow Fast, Build More: Take responsibility for meaningful systems and expand your skills across software, data, and AI.
• Relocation & Hacker House: Visa and legal relocation sponsorship to Yerevan, Armenia, with accommodation and utilities covered.
• Compensation & Equity: A base salary plus early-stage equity and the opportunity to participate in our growth.

Built for Builders:
We value technical curiosity, sound engineering judgment, and ownership. If you enjoy understanding complex systems and building tools that make AI more capable and reliable, we’d like to meet you.