Staff Software Engineer, Applied AI & Data Systems

Conductor LLCBerlin, State of BerlinOn-siteFull-timeSenior, 5–8 yearsListed 5 hours ago

Apply now

About this role

company

About Conductor:

Conductor is the leading enterprise AEO platform. Today’s top enterprise brands use Conductor to grow authority and visibility in both AI and traditional search engines. From tracking visibility in LLMs to real-time monitoring of technical site health and scaled AI content creation, Conductor provides a single source of truth that fuels digital growth—all from one platform.

Conductor is a mission-driven company with a commitment to innovation, customer success, and culture. For Conductor, success is improving the lives of everyone in our orbit—our customers, our customers' customers, our employee-owners, and our communities.

role

We’re looking for a Staff-level engineer who can take ambiguous problems from exploration to production. The work spans applied research, backend and data engineering, ML/LLM infrastructure, and cloud systems. You’ll work as a peer alongside other Staff-level engineers, product partners, and senior leadership.

We want someone who treats research and production as one world. In a single week you might test whether a new ML approach improves a core algorithm, design the pipeline around it, dig into surprising behavior in a dataset, or trace a production failure through the infrastructure beneath it. You take full ownership, work with little direction, hold a high bar, and move quickly. We’re a small company, so you’ll need to be comfortable with ambiguity and shifting priorities.

What you’ll do

Build production AI and data systems

- Design and ship backend services, APIs, and data pipelines that power AI products, integrating ML models, LLMs, and internal and external systems.
- Make pragmatic architectural decisions across application, data, model, and infrastructure boundaries, with reliability, observability, performance, cost, and simplicity in mind.
- Own substantial workstreams end to end: exploration, architecture, implementation, deployment, and operation.

Turn applied research into product

- Develop and evaluate ML algorithms, statistical methods, ranking and clustering systems, and retrieval pipelines for problems where the solution isn’t known in advance.
- Analyze noisy internal datasets to diagnose product behavior and find opportunities.
- Design experiments and metrics that compare approaches rigorously, prototype quickly, and carry what works into maintainable production systems.
- Read research critically and adapt it to real product constraints.

Build ML and LLM evaluation infrastructure

- Create reusable, reproducible evaluation pipelines for models, prompts, retrieval, and agents, rather than relying on manual inspection.
- Set up experiment tracking, dataset and artifact versioning, and monitoring, so engineers can compare approaches and investigate failures.
- Help decide when conventional software, statistics, classical ML, or LLMs is the right tool.

Own the path to production

- Containerize, deploy, and operate your services, and build the CI/CD and operational tooling around them.
- Diagnose failures across application, data, model, and infrastructure layers.
- Reason about latency, throughput, storage, reliability, and cost.

This isn’t primarily an infrastructure role, but you should be able to own the full path from code to production when needed.

What we’re looking for

Experience and judgment

- Staff-level experience, or an exceptionally strong Senior engineer approaching it.
- A track record of shipping non-trivial, high-impact projects more than once, ideally including at smaller companies.
- The ability to structure ambiguous problems, separate essential from accidental complexity, and work effectively with little supervision, coaching, or task breakdown.

Python and data

- Deep production Python experience, not only notebooks or prototypes.
- Strong command of tools such as NumPy, pandas, SciPy, scikit-learn, PyTorch, Pydantic, and FastAPI, and comfort profiling, testing, and optimizing Python systems.

Machine learning and quantitative reasoning

- Hands-on experience building, evaluating, or operating real ML or statistical systems, beyond calling pretrained model APIs.
- Solid grounding in probability, statistics, optimization, and experimental design, plus the ability to judge whether an unfamiliar algorithm or paper fits a problem.
- Experience separating real signal from confounders, measurement artifacts, and evaluation failure modes.
- A research degree is welcome but not required. Demonstrated, serious work in ML and experimentation matters more.

Production systems

- Experience designing backend or distributed systems and data pipelines at meaningful scale.
- Strong grounding in APIs, async processing, queues, databases, failure handling, and observability.
- Practical experience with Docker, Kubernetes, AWS (e.g., S3, SQS, Lambda, ECS/EKS, DynamoDB, CloudWatch), CI/CD, and a workflow orchestrator such as Airflow, Dagster, or Prefect.

Nice to have

- Experience in a research-intensive or deep-tech setting, such as robotics, computer vision, search and ranking, recommenders, scientific computing, optimization, autonomous systems, or computational biology.
- Building or materially modifying ML algorithms, or designing evaluations where no off-the-shelf benchmark exists.
- Semantic search, embeddings, or vector databases, and LLM applications such as agents, RAG, or structured generation.
- Experiment-tracking and evaluation tools such as Weights & Biases or MLflow, or custom internal tooling.
- Event-driven architectures and Kubernetes-based ML workloads.
- Moving experimental ML systems into reliable production services.

How you work

You measure rather than argue from intuition, and you challenge assumptions, including your own, when the evidence says otherwise. You can go deep without turning every problem into a research project, and you know when to prototype and when to engineer properly. You treat observability, testing, and evaluation as part of the system. You document your reasoning so others can understand it later, and you communicate clearly with both specialists and non-specialists.

What success looks like

After ramping up, you own major technical workstreams with minimal supervision. You work with other senior engineers as a high-bandwidth peer: splitting hard problems, pursuing separate lines of investigation, challenging each other’s designs, and combining the results into systems that work.

------------------------------------------------------------------------------------------------------------------

Compensation:  Conductor maintains competitive, performance-based compensation programs.  The Berlin base salary range  for this role is currently  120,000 - 130,000 euro .

------------------------------------------------------------------------------------------------------------------

Conductor LLC is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Bringing in diverse perspectives and challenging our assumptions is the clear key to growth; it drives innovation, creativity, faster problem-solving, and stronger decision making. All aspects of employment including the decision to hire, promote, train, discipline, or discharge, will be based on merit, competence, performance, and business needs .

Conductor does not discriminate against any employee or applicant on the basis of race, color, ancestry, national origin, religion or religious creed, mental or physical disability, medical condition, genetic information, sex (including pregnancy, childbirth, and related medical conditions), sexual orientation, gender identity, gender expression, age, marital status, military or veteran status, or other characteristics protected by state or federal law or local ordinance.  In addition, it is the policy of Conductor to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations and ordinances where a particular employee works.