Director, AI Experimentation & Measurement
- United States - Illinois - Lake Forest
- United States - Washington – Bothell
- United States - Pennsylvania - Collegeville
- United States - New York - New York City
- United States - California - San Francisco
- India - Bangalore
- United States - Connecticut - Groton
Director, AI Experimentation & Measurement
Pfizer US Commercial is scaling a portfolio of AI initiatives, each launched as an experiment measured against a real-world baseline. The value of that portfolio depends on one thing: a shared, credible definition of what good looks like plus the evidence to prove we are reaching it.
We are hiring a Director of Experimentation & Measurement to own that definition end to end. This is not a scorekeeping role. You will decide what is worth proving next, design the experiment that proves it, set the bar for success before the work begins, and tell the story of what the evidence means to the people making the biggest decisions. You are equal parts systems thinker, experiment designer, and storyteller, with the rigor to make sure the story is true.
This is a build-from-scratch role for someone who can see across a whole portfolio, frame the questions that matter most, and hold the independence to say when a result does not clear the bar.
What you will own
1. Success criteria & proof standards. Own the portfolio-wide standard for what counts as proof—defined before work begins, not after results land. Draft and socialize pre-registered success criteria for each initiative (primary KPIs, guardrails, minimum detectable effect, read windows). Maintain a shared measurement playbook (matched controls, power calculations, blinded review, backtesting where appropriate).
2. Portfolio learning agenda. Prioritize what the portfolio must prove next—and in what sequence evidence compounds. Maintain a ranked learning agenda across initiatives and recommend the next proof point per initiative.
3. Experiment design & statistical rigor. Review experiment designs: control arms, audience matching, read windows, confounders, data leakage risks. Run power analysis and flag underpowered or ungradeable designs before launch.
4. Evidence narrative for senior leaders. Produce evidence read memos on a fixed cadence: what was tested, what was observed, what it means, what is recommended. Synthesize across initiatives into one portfolio story—not a patchwork of disconnected scorecards.
5. Measurement integrity & bias controls. Guard against failure modes that quietly invalidate results: moving goalposts; letting the people a system is meant to outperform grade it; acting before pre-registered proof exists. Escalate when a read is not gradeable.
6. Evidence governance & readout cadence. Run evidence read sessions at pre-registered dates; own continue / adjust / stop recommendations with rationale; track whether recommendations are acted on.
Key stakeholders & accountability
Partners with initiative facilitators on criteria, design, and readouts. Influences BU Presidents and proxies by helping define their success criteria and reporting back whether evidence meets the bar. Reports results and implications to USLT and Chief Commercial Office as portfolio executive sponsors.
What we require
Experience: 8+ yrs (Bachelor's) · 7+ yrs (Master's) · 5+ yrs (PhD), spanning experimentation, measurement science, causal inference, or a quantitatively rigorous discipline — paired with strategy or product-facing work.
Required Qualifications:
-Bachelor's degree required with 8+ years of relevant experience spanning experimentation, measurement science, causal inference, or a quantitatively rigorous discipline — paired with strategy or product-facing work.
- Systems thinking: sees across an entire portfolio, frames the questions that matter most, and designs how proof compounds over time rather than optimizing one test at a time.
- Storytelling and executive presence: turns a rigorous, technical result into a clear, persuasive narrative that shapes senior decisions.
- Experiment design and causal credibility: has designed and defended controlled experiments at enterprise scale: power analysis, matched controls, quasi-experimental methods, pre-registration.
- Independence and spine: able to tell a senior stakeholder that a result does not clear the bar, and make it stick.
- AI fluency: evaluates AI/ML and generative systems credibly: what a real performance signal looks like versus a plausible artifact.
Preferred Qualifications:
- Regulated-industry measurement experience.
- Provenance, auditability, and responsible-AI evaluation frameworks.
- Experience standing up an experimentation or evidence function from scratch.
Candidate demonstrates a breadth of diverse leadership experiences and capabilities including: the ability to influence and collaborate with peers, develop and coach others, oversee and guide the work of other colleagues to achieve meaningful outcomes and create business impact.
Other Job Details:
Last Date to Apply for Job: July 26, 2026.
Ability to travel based on business needs
This position is hybrid and requires working onsite 2 to 3 days per week
Relocation assistance may be available based on business needs and/or eligibility.

Candidates must be authorized to be employed in the U.S. by any employer.
U.S. work visa sponsorship (such as TN, O-1, H-1B, etc.) is not available for this role now or in the future.

Sunshine Act
Pfizer reports payments and other transfers of value to health care providers as required by federal and state transparency laws and implementing regulations. These laws and regulations require Pfizer to provide government agencies with information such as a health care provider’s name, address and the type of payments or other value received, generally for public disclosure. Subject to further legal review and statutory or regulatory clarification, which Pfizer intends to pursue, reimbursement of recruiting expenses for licensed physicians may constitute a reportable transfer of value under the federal transparency law commonly known as the Sunshine Act. Therefore, if you are a licensed physician who incurs recruiting expenses as a result of interviewing with Pfizer that we pay or reimburse, your name, address and the amount of payments made currently will be reported to the government. If you have questions regarding this matter, please do not hesitate to contact your Talent Acquisition representative.
EEO & Employment Eligibility
Pfizer is committed to equal opportunity in the terms and conditions of employment for all employees and job applicants without regard to race, color, religion, sex, sexual orientation, age, gender identity or gender expression, national origin, disability or veteran status. Pfizer also complies with all applicable national, state and local laws governing nondiscrimination in employment as well as work authorization and employment eligibility verification requirements of the Immigration and Nationality Act and IRCA. Pfizer is an E-Verify employer. This position requires permanent work authorization in the United States.
Pfizer endeavors to make www.pfizer.com/careers accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process and/or interviewing, please email disabilityrecruitment@pfizer.com. This is to be used solely for accommodation requests with respect to the accessibility of our website, online application process and/or interviewing. Requests for any other reason will not be returned.
To learn more about acceptable and prohibited uses of AI during the recruitment process, please review our candidate AI-use guidelines available on Pfizer Careers.

Information & Business Tech
Breakthroughs that change patients’ lives
Research confirms what intuition tells us: that purpose-driven companies perform better, are more innovative, attract and retain the best people, and know how to unleash the power of those people. Pfizer’s purpose—Breakthroughs that change patients' lives—fuels everything we do and reflects our passion for building on our legacy as one of the greatest contributors of good to the world.
Each word in our purpose has meaning and reflects the value we strive to bring to patients and society:
“Breakthroughs” - These are the innovations, scientific and commercial, that we seek to deliver every day. All colleagues, regardless of role, level or location, strive for breakthroughs every day.
“Change” - We want to do more than simply improve patients’ medical conditions; we want to dramatically change their lives for the better.
“Patients’ lives” - We consider not only patients, but everyone they touch—including their families, caregivers, and friends—and everything they love to do. It’s an intentionally holistic view.
Our purpose ensures that patients remain at the center of all we do. We live our purpose by sourcing the best science in the world; partnering with others in the healthcare system to improve access to our medicines; using digital technologies to enhance our drug discovery and development, as well as patient outcomes; and leading the conversation to advocate for pro-innovation/pro-patient policies.
Every decision we make and every action we take is done with the patient in mind—and to nurture an environment where breakthroughs can thrive.
Our Values
To fully realize Pfizer’s purpose, we have established a clear set of expectations regarding “what” we need to achieve for patients and “how” we will go about achieving those goals.
The “how” is represented by four simple, powerful values—courage, excellence, equity, and joy—that define our company and our culture.
Courage: Breakthroughs start by challenging convention, especially in the face of uncertainty or adversity. This happens when we think big, speak up, and are decisive.
Excellence: We can only change patients’ lives when we perform at our best together. This happens when we focus on what matters, agree who does what, and measure our outcomes.
Equity: We believe that every person deserves to be seen, heard, and cared for. This happens when we are inclusive, act with integrity, and reduce healthcare disparities.
Joy: We give ourselves to our work, but it also gives to us. We find joy when we take pride, recognize one another, and have fun.
Benefits at Pfizer
Pfizer offers competitive compensation and benefits programs designed to meet the diverse needs of our colleagues. Our Pay for Performance Philosophy and Practices reward colleagues based on the contributions they make to our business.
Our Competitive Benefits Programs help our colleagues by:
- Promoting Health and Wellness to help colleagues maintain and improve their physical and mental wellbeing. Pfizer offerings include health and disability insurance, preventative health programs, medical screenings, free or reduced-cost vaccinations, discounts on Pfizer products, mental health support, nutrition and fitness counseling and more.
- Strengthening Colleagues’ Financial Security by providing company contributions to retirement plans, life insurance and financial planning education to help colleagues achieve their financial goals.
- Providing Benefits and Time off for the Moments that Matter to ensure Pfizer colleagues have the time away from the office to recharge, recover and return to work as the best version of themselves. Vacation, Holiday time and Sick time are just the beginning, with a 12 week parental leave policy for both parents of a new born, 10 day of caregiver leave for those times when your family needs you whether it’s a child, spouse or parent, bereavement leave, and additional country-specific programs.
- And so much more, depending on your country and site, Pfizer offers childcare facilities or discount programs, on-site health and/or fitness centers, movement and mindfulness solutions, “Log in for your Day” work flexibility and so much more.
For U.S. based jobs, view an overview of Pfizer’s U.S. benefits program (opens in a new window)