Descripción de la oferta
Overview
As a Principal AI Engineer, you own the end-to-end improvement loop for the Context Engine, shaping how agents, automations and skills behave in production. You define evaluation, telemetry, and safe deployment practices, ensuring customer impact and reliability. You collaborate with data scientists, engineers, product and UX to translate measurements into shipping decisions. Your work directly influences how customers build on Elastic’s AI-enabled platform, in an open-code environment.
Compensaciones / Beneficioshealth coverage for you and familyflexible locations and schedulesgenerous vacation daysdonation matching up to $2000volunteering time (up to 40 hours/year)parental leave (16 weeks)
ResponsabilidadesOwn the production improvement loop for Context Engine, diagnosing failures from telemetry and user feedback and delivering fixesDefine safe iteration processes for agents, prompts, skills, and automations, including versioning, rollout, regression coverage, and guardrailsDesign telemetry for data-informed engineering decisions, capturing agent traces, tool calls and retrieval data and integrating with Elasticsearch for dashboards and feedbackCollaborate with data science on evaluation strategy (golden datasets, evaluators) to gate quality, latency and costMentor engineers, review designs and PRs, and draft technical proposals to shape the roadmap
Requisitos principales10+ years of software engineering experience with AI-driven production productsExperience diagnosing agent/LLM behavior from traces and user feedback; designing evaluations and shipping fixesHands-on experience building agents with state and memory; iterating prompts, skills, and tool behavior in productionFamiliarity with MCP, including exposing public MCP servers and toolsExperience designing telemetry for AI systems and using it to influence engineering/product decisionsExperience running product experiments end-to-end (instrumentation, unattended execution, interpreting results)Experience building products with public APIs and evolving data models while maintaining external contractsStrong backend skills in Python or TypeScript (APIs, stateful workflows, data pipelines)Ability to communicate trade-offs clearly with data scientists, engineers, and product managersPragmatic, low-ego, distributed, async-first work stylecollaboration with cross-functional peersanalytical thinking and problem solvingclear communication of trade-offsPython or TypeScript backend engineeringAPIs and data pipelinesproduction services and stateful workflows
