GenAI Platform Engineer – LLM Gateway
- India - Remote
Our Purpose
Pfizer Digital
Benefits
ROLE SUMMARY
The GenAI Platform Engineering team builds and runs the shared platform that lets Pfizer colleagues and applications use generative AI safely and at scale. At its core is the enterprise GenAI Gateway: a single, governed entry point to large language models from multiple providers, with self-service access, routing, usage and cost transparency, and observability built in. Around it, we deliver evaluation, observability and agentic tooling — MCP integrations, agent registries and reusable agent skills — for teams across the company.
We run the platform as a product: self-service over tickets, automation over manual approvals, small and frequent releases, and reliability we can measure. We are looking for a hands-on engineer to help evolve the Gateway and its ecosystem. You will keep it secure, fast and current in a fast-moving open-source landscape. You will work closely with a globally distributed team and with the teams that build on the platform.
This is an individual contributor role.
ROLE RESPONSIBILITIES
Platform engineering
- Design, build and operate features of the enterprise LLM gateway, mainly in Python:
- multi-provider model access
- routing and failover
- API key and access management
- budgets, usage metering and chargeback
- Integrate agentic capabilities into the platform with the right security controls. Examples include Model Context Protocol (MCP) servers, tool calling across providers, and agent-to-agent connectivity.
- Keep the platform’s open-source foundations current. Assess upstream releases, maintain and retire Pfizer-specific extensions, and deliver upgrades without regressions.
- Contribute to the platform’s admin and self-service experiences, including web UI, portals and developer documentation.
Quality, reliability and security
- Build and maintain automated quality gates in CI/CD. These include unit, integration, contract and performance/load tests that protect every release.
- Instrument services with metrics, traces and logs (e.g., OpenTelemetry, Langfuse). Use them to find and fix latency, error and cost issues.
- Take part in the support/on-call rotation. Lead root-cause analysis of production incidents, and turn the findings into lasting fixes and blameless postmortems.
- Apply secure-by-default engineering:
- identity and access controls (SSO, OAuth 2.0/OIDC, RBAC)
- secret handling
- dependency pinning and supply-chain hygiene
Enablement and collaboration
- Evaluate emerging GenAI capabilities hands-on, such as model routing, guardrails and agent registries. Turn the results into clear recommendations on whether to adopt them.
- Help consuming teams onboard and succeed. Write guides and runbooks, and create reusable assets such as code samples and AI agent skills.
- Work in the open. Make InnerSource contributions, review code, and engage with open-source communities and vendors by reporting issues and proposing fixes upstream.
BASIC QUALIFICATIONS
- Bachelor’s or Master’s degree in Computer Science, Computer Applications, Engineering or a related field, or equivalent practical experience.
- 9+ years of professional software engineering experience, including 3+ years building GenAI/LLM-based applications or platforms used in production.
- Strong Python skills for backend services: async programming, FastAPI or similar, REST APIs and streaming responses.
- Hands-on experience with LLM provider APIs (e.g., OpenAI, Azure OpenAI, AWS Bedrock), including tool/function calling and integrating multiple providers.
- Experience delivering and running services on AWS with containers and CI/CD pipelines (e.g., Docker, GitHub Actions), with automated testing built into the workflow.
- Proven ability to troubleshoot complex production issues and perform root-cause analysis.
- Clear written and verbal communication in English, and comfort working with distributed, cross-functional teams.
PREFERRED QUALIFICATIONS
- Experience with an AI/LLM gateway or API gateway, including routing, key management and cost tracking.
- Experience running and extending open-source software in production, including patches, upgrades, regression testing and upstream contributions.
- Knowledge of agentic AI patterns and tooling:
- MCP
- LangGraph/LangChain or similar frameworks
- multi-agent orchestration
- RAG and vector search
- Experience with performance/load testing and observability tooling (e.g., OpenTelemetry, Langfuse, Prometheus/Grafana).
- Experience with Kubernetes and Infrastructure as Code (Terraform).
- Frontend skills (React, TypeScript) for internal tools and portals.
- Daily use of AI-assisted development tools (e.g., GitHub Copilot, Claude Code) and interest in building reusable agent skills.
- Experience in pharmaceutical, healthcare or other regulated environments.
- Experience mentoring engineers or delivering technical enablement, such as workshops, documentation and onboarding.
- AWS certification.
WORK SCHEDULE
- Regular collaboration with colleagues in European time zones.
- Participation in the team’s support rotation.
Pfizer is an equal opportunity employer and complies with all applicable equal employment opportunity legislation in each jurisdiction in which it operates.
To learn more about acceptable and prohibited uses of AI during the recruitment process, please review our candidate AI-use guidelines available on Pfizer Careers.
Information & Business Tech
Breakthroughs that change patients’ lives
Research confirms what intuition tells us: that purpose-driven companies perform better, are more innovative, attract and retain the best people, and know how to unleash the power of those people. Pfizer’s purpose—Breakthroughs that change patients' lives—fuels everything we do and reflects our passion for building on our legacy as one of the greatest contributors of good to the world.
Each word in our purpose has meaning and reflects the value we strive to bring to patients and society:
“Breakthroughs” - These are the innovations, scientific and commercial, that we seek to deliver every day. All colleagues, regardless of role, level or location, strive for breakthroughs every day.
“Change” - We want to do more than simply improve patients’ medical conditions; we want to dramatically change their lives for the better.
“Patients’ lives” - We consider not only patients, but everyone they touch—including their families, caregivers, and friends—and everything they love to do. It’s an intentionally holistic view.
Our purpose ensures that patients remain at the center of all we do. We live our purpose by sourcing the best science in the world; partnering with others in the healthcare system to improve access to our medicines; using digital technologies to enhance our drug discovery and development, as well as patient outcomes; and leading the conversation to advocate for pro-innovation/pro-patient policies.
Every decision we make and every action we take is done with the patient in mind—and to nurture an environment where breakthroughs can thrive.
Pfizer Digital
Pfizer Digital takes immense pride in being at the forefront of innovation, harnessing cutting-edge smart technology that profoundly impacts the lives of our patients.
With the transformative potential of digital solutions, we revolutionize how we discover, develop, and deliver medicines, enabling us to achieve breakthroughs faster and more efficiently.
By streamlining and automating transactional processes, we create valuable time and resources, empowering our talented team to focus on meaningful work that truly makes a difference in healthcare and beyond.
Benefits at Pfizer
Pfizer offers competitive compensation and benefits programs designed to meet the diverse needs of our colleagues. Our Pay for Performance Philosophy and Practices reward colleagues based on the contributions they make to our business.
Our Competitive Benefits Programs help our colleagues by:
- Promoting Health and Wellness to help colleagues maintain and improve their physical and mental wellbeing. Pfizer offerings include health and disability insurance, preventative health programs, medical screenings, free or reduced-cost vaccinations, discounts on Pfizer products, mental health support, nutrition and fitness counseling and more.
- Strengthening Colleagues’ Financial Security by providing company contributions to retirement plans, life insurance and financial planning education to help colleagues achieve their financial goals.
- Providing Benefits and Time off for the Moments that Matter to ensure Pfizer colleagues have the time away from the office to recharge, recover and return to work as the best version of themselves. Vacation, Holiday time and Sick time are just the beginning, with a 12 week parental leave policy for both parents of a new born, 10 day of caregiver leave for those times when your family needs you whether it’s a child, spouse or parent, bereavement leave, and additional country-specific programs.
- And so much more, depending on your country and site, Pfizer offers childcare facilities or discount programs, on-site health and/or fitness centers, movement and mindfulness solutions, “Log in for your Day” work flexibility and so much more.
For U.S. based jobs, view an overview of Pfizer’s U.S. benefits program (opens in a new window)