Lead Observability Engineer (New Relic)

We are looking for a Lead Observability Engineer to build an Enterprise Agent Development Platform — a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The platform standardizes agent development across the organization using LangGraph and Strands Agents on AWS AgentCore Runtime. The initiative spans agent framework design, runtime architecture, marketplace integration, CI/CD automation, and enterprise-grade observability — reducing agent development from months to days while enforcing consistent security, quality, and governance standards. Responsibilities Own the multi-tenant New Relic consolidation layer aggregating telemetry across the agent estateAdminister New Relic at scale, including management account setup and cross-account configurationBuild and maintain cross-account NRQL queries that aggregate telemetry from multiple project tenantsDevelop dashboards-as-code and alert-policy-as-code using the Terraform New Relic provider and CrossplaneConfigure New Relic alert policies routed to Opsgenie, with future migration to ServiceNowConsume OpenTelemetry / ADOT data through OTLP and Firehose ingestion into New RelicDesign metric dimensions for large agent estates, ensuring stable, low-cardinality facetsMaintain segregation across Technical, Business, and Audit observability models Requirements 6+ years of experience in observability or SRE engineeringHands-on experience consolidating observability/telemetry for AI agent estates in a production agentic AI project, such as multi-tenant New Relic (or equivalent) aggregation of agent telemetry, cost/token attribution for GenAI workloads, or AgentCore GenAI Observability integrationExpertise in New Relic (or equivalent SaaS observability platforms) operated as a multi-tenant consolidation layerSkills in cross-account / cross-tenant telemetry aggregation and reportingFamiliarity with working within a Technical / Business / Audit observability segregation modelProficiency in NRQL, dashboards-as-code, and alert-policy-as-code practicesKnowledge of OpenTelemetry / ADOT consumption fundamentals Nice to have Familiarity with AWS Bedrock AgentCore observability (Transaction Search, GenAI Observability)Background in Kinesis Firehose metric / log forwarding pipelines (CloudWatch → New Relic)Knowledge of cost / token attribution modeling for GenAI workloadsSkills in Crossplane-based provisioning of observability resources We offer We gather like-minded people:Top tech minds driving innovation in AI, cloud and digital platform modernizationSupportive team and agile, startup-like cultureHybrid by design mode and opportunity to work remotely within PolandChance to work abroad for up to 60 days annuallyBusiness-driven relocation opportunitiesWe provide growth opportunities:Career development programsThought leadership, mentoring, soft skills and well-being programsCertification (Anthropic, Gemini, GCP, Azure, AWS)English classesWe cover it all:Stable payParticipation in the Employee Stock Purchase Plan with a 15% discountBenefits package (health insurance, multisport, shopping vouchers)Referral bonuses up to $2,000Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and moreCorporate, social and well-being eventsPlease, note:Benefits listed above are available to employees onlyWe are open for working with Contractors. Terms of B2B cooperation agreements are agreed individuallyWe will reach out to selected candidates exclusively EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.