Manager I, Applied AI - Distilled Models

Applied AI is where Datadog's ambitious AI bets get built and shipped (Bits Chat, updog). We sit at the intersection of research and product: turning promising capabilities from Datadog AI Research lab and the research community into production systems that reach real customers. The team builds specialized models that replace frontier models where they are not necessary, making AI capabilities faster, cheaper, and more secure. The mandate is to move fast from idea to customer impact, and when a product finds its footing, to set it up for growth.

 

As a Manager I in Applied AI, you will lead a team of engineers and applied scientists working on one of these challenges. You will define technical direction, run short feedback loops, make deliberate decisions about what to pursue or stop, and work closely with product managers, research teams, and cross-functional partners to ship AI capabilities that matter.

 

At Datadog, we place value in our office culture, the relationships and collaboration it builds and the creativity it brings. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

 

What You'll Do 

• Lead and develop a team of engineers and applied scientists focused on cost-efficient specialized models and AI security capabilities
• Work closely with product managers, research teams, and cross-functional partners to shape the team's bets from initial framing through to broader adoption, with a clear definition of success criteria at each stage
• Own end-to-end delivery of high-quality AI systems, from early research exploration to production-grade reliability, with high standards for operational excellence, system reliability, and technical quality
• Navigate the unique challenges of shipping AI-powered products: balancing quality, latency, cost, and safety considerations. Drive evaluation and iteration practices for AI systems: define the quality bar and guide the team in building the offline and online evaluation pipelines needed to measure quality and detect drift
• Contribute to cross-team collaboration and knowledge sharing across the broader AI organization
• Support career growth for engineers through coaching, feedback, and fostering a culture of experimentation, innovation, and learning. Participate in hiring and help shape the future team as the organization grows

Who You Are

• A people-focused manager with experience leading and mentoring engineers, able to develop strong engineering talent in a fast-moving domain
• A technical leader with deep expertise in one or more areas of AI or machine learning: large language models, retrieval-augmented generation (RAG), semantic search, agentic systems, deep learning, or NLP
• Well-versed in evaluation methodologies for AI systems, both offline benchmarks and online metrics
• A strong product instinct: able to anchor early-stage work in concrete customer problems, define success criteria before writing code, and actively contribute to shaping product direction alongside product and research partners
• Experience taking AI products from 0 to 1 is strongly valued: able to bring structure to early-stage work by scoping clear hypotheses, moving quickly toward signal, and making deliberate decisions about what to pursue, pivot, or stop
• BS/MS/PhD in Machine Learning, Computer Science, Engineering, or related field, or equivalent professional experience

#LI-Hybrid