Summary
Johnson & Johnson is seeking a Post Doctoral Researcher to join the Data Analytics & Computational Sciences team. This role focused on developing evaluation frameworks, rubrics, and quality systems to rigorously assess generative AI agents deployed across clinical operations and global development workflows. The researcher will ensure these AI systems are safe, reliable, and effective for scientists, clinical operations specialists, and site teams.
Post Doctoral Researcher, Evaluation & Standards in Clinical Operations, Johnson & Johnson, USA
Key Job Details
| Job Attribute | Details |
| Designation | Post Doctoral Researcher (ST5) |
| Department / Sub Function | Post Doc – Data Analytics & Computational Sciences |
| Job Category | Career Program (2-Year Postdoctoral Appointment) |
| Work Pattern | Hybrid |
| Requisition Number | R-077718 |
Research Area & Focus
- Generative AI Evaluation: Developing structured assessment protocols and multidimensional quality rubrics for LLMs and agentic systems.
- Clinical Operations Systems: Designing evaluation pipelines for specialized AI outputs, including clinical data queries, trial anomaly detection, protocol Q&A responses, Informed Consent Form (ICF) generation, and regulatory document assembly.
- Human-in-the-Loop Frameworks: Running human evaluation protocols alongside clinical, regulatory, and site-facing subject matter experts.
Locations & Anticipated Pay Ranges
| Location | Anticipated Base Pay Range |
| United States (Raritan, NJ / Titusville, NJ) | USD 79,000 – USD 127,650 |
| Switzerland (Zug) | CHF 93,500 – CHF 149,615 |
| United Kingdom (High Wycombe) | GBP 40,100 – GBP 63,595 |
| Spain (Barcelona / Madrid / Toledo) | EUR 43,600 – EUR 70,150 |
| Belgium (Beerse) | €60.000,00 – €96.255,00 (Primary Posting Location Range) |
Eligibility & Qualifications
- Education: PhD or equivalent research experience in a clinical, biomedical, regulatory, biostatistics, or a closely related field.
- Domain Expertise: Strong understanding of clinical operations, clinical data management, monitoring, regulatory documentation, or site operations.
- AI & Prototyping Skills: Genuine interest in generative AI/agentic systems, curiosity about LLM failure modes in specialized domains, and comfort prototyping with modern AI tooling (LLM APIs, vector databases, evaluation frameworks).
- Technical & Analytical Skills: Proficiency with Python and the modern ML/data stack. Strong experience designing structured assessments involving multiple quality dimensions or inter-rater reliability considerations.
- Collaboration: Ability to work cross-functionally across AI engineering, data science, regulatory affairs, and clinical operations.
Job Description
What You’ll Do:
- Develop comprehensive evaluation frameworks and rubrics tailored to AI agents in clinical operations and global development contexts.
- Define quality dimensions for specialized outputs to accurately reflect how clinical-ops users judge quality.
- Design and run human evaluation protocols with clinical, regulatory, and site-facing subject matter experts.
- Build benchmark datasets and evaluation pipelines to be utilized by the broader GenAI organization across various applications.
- Partner directly with AI engineering teams to translate your evaluation findings into measurable model and agent improvements.
- Contribute directly to the overarching methodology of how a heavily regulated pharma organization safely evaluates AI in clinical workflows.
How to Apply
Interested and qualified candidates can apply directly through the official Johnson & Johnson job portal by visiting the Johnson & Johnson Careers Page.
Note: The official closing date for applications is not explicitly specified on the posting. Candidates are highly encouraged to apply as early as possible while the requisition (R-077718) remains open on the portal.
Last Date to Apply
Open now
