Associate Director, Evaluation and Quality Standards

En Johnson & Johnson creemos que la salud lo es todo. Nuestra fuerza en la innovación en la atención médica nos permite construir un mundo en el que se eviten, traten y curen enfermedades complejas, en el que los tratamientos sean más inteligentes y menos invasivos, y las soluciones sean personales. A través de nuestra experiencia en Medicina Innovadora y MedTech, estamos en una posición única para innovar en todo el espectro de soluciones de atención médica de hoy para ofrecer los avances del futuro y afectar profundamente a la salud para la humanidad. Obtenga más información en jnj.com Guiados por nuestro Credo, en Johnson & Johnson somos responsables de nuestros empleados que trabajan con nosotros en todo el mundo. Proporcionamos un entorno laboral inclusivo donde cada persona es tratada como individuo. En Johnson & Johnson, respetamos la diversidad y la dignidad de nuestros empleados y reconocemos sus méritos. Función de trabajo: Data Analytics & Computational Sciences Subfunción de trabajo: Data Science Categoría de trabajo: People Leader Todas las ubicaciones de colocación de trabajo: Cornellà de Llobregat, Barcelona, Spain, Madrid, Spain Descripción del trabajo: Evaluation & Quality Standards to join our Data Science and Digital Health team (DSDH). This is a newly created leadership role within the Generative AI organization, reporting directly to the Head of Generative AI. The GenAI team is deploying AI across discovery, development, regulatory, and operations to create AI assistants and agentic systems across the therapeutic areas and functions. As we scale from proof-of-concept to enterprise deployment, we need a dedicated evaluation function that defines what quality means for generative AI in a regulated pharmaceutical R&D environment, communicates the metrics effectively, and enforces that standard across every platform, vendor, and capability we build or adopt. This role owns evaluation and governance for all generative AI work across R&D. Key Responsibilities Evaluation Framework Design • Design and maintain evaluation frameworks for GenAI solutions spanning LLM quality, RAG performance, agent reliability, safety, and scientific accuracy. • Develop therapeutic-area-specific evaluation criteria with business teams, reflecting domain-specific quality requirements per therapeutic area and application type. • Define benchmarks for scientific validity, regulatory compliance, data quality, and operational reliability. • Establish gold-standard validation datasets and automated evaluation pipelines. Vendor and Solution Assessment • Lead structured vendor assessments producing written Evaluation Reports • Challenge vendor claims with independent benchmarking; distinguish genuine capability from demonstration performance. • Assess integration complexity, total cost of ownership, regulatory posture, and vendor lock-in risk. Governance and Standards • Serve as technical lead for the Evaluation & Standards Board, a cross-functional governance body for GenAI quality. • Present evaluation findings and recommendations to the GenAI Portfolio Steering Committee. • Define what “production-ready” means for GenAI in a regulated R&D environment and enforce that standard. • Set evaluation gates for product development stages: PoC, Limited Release, Scaled Product, and Product Ops. Cross-Functional Collaboration • Partner with QMS/MLOps on the handoff from pre-adoption evaluation to production quality monitoring. • Work with therapeutic area teams on domain-specific evaluation standards. • Collaborate with Data Strategy & Products on data quality as an input to the evaluation rubric. • Engage JJIT architecture teams on platform-layer evaluation and security assessments. Opinion Leadership and Capability Building • Contribute to the weekly GenAI Outlook newsletter, specifically the evaluation implications of frontier AI developments. • Build internal evaluation capability through training, documentation, and tooling for teams conducting assessments. • Publish evaluation standards and rubrics as reference material for the broader organization. Team Leadership • Build and lead the GenAI Evaluation & Standards team • Attract, develop, and retain top talent in AI evaluation, quality science, and governance. • Establish a culture of scientific rigor and independent judgment within the team. What This Role Is Not • Not MLOps or production monitoring: the QMS function handles post-deployment operations. • Not platform engineering. • Not regulatory affairs or medical writing. • Not vendor management or procurement: evaluation is independent of purchasing. Key Qualifications • Advanced degree (PhD strongly preferred) in computational biology, bioinformatics, data science, computer science, AI/ML, biomedical engineering, applied mathematics, or related discipline. • Minimum 8 years of post-academic industry experience, with significant time in pharmaceutical or biotechnology R&D. • Hands-on expertise with generative AI systems: large language models, retrieval-augmented generation, agentic frameworks, and prompt engineering. • Demonstrated track record designing evaluation frameworks, scientific benchmarks, or quality standards for AI/ML systems. • Strong people leadership experience, including building and managing technical teams in a matrixed organization. • Excellent communication skills: ability to present complex technical findings clearly to non-technical senior stakeholders and defend unpopular conclusions. • Strategic thinking capability: ability to connect technical evaluation to business impact and organizational decision-making. Habilidades requeridas: Habilidades deseables: Análisis avanzado, Análisis de datos, Calidad de los datos, Ciencia de datos, Desarrollo de otros, Estándares de privacidad de datos, Experto en datos, Fluidez digital, Gestión de cumplimiento, Gestión de programas, Gestión presupuestaria, Liderazgo, Liderazgo inclusivo, Pensamiento crítico, Pensamiento estratégico, Planificación de sucesión, Presentación de informes de datos, Visualización de datos El intervalo de salario base anual previsto para esta posición es: €75,000.00 - €129,260.00 Beneficios: Además del salario base, ofrecemos los siguientes beneficios*: Una bonus variable anual con un objetivo o target preestablecido (% del salario fijo) en función del pay grade/ubicación, donde el importe a percibir se basa en el desempeño que hayan tenido durante el año natural anterior tanto los empleados como las empresas, o comisiones de ventas. Además, ofrecemos días de vacaciones, permiso parental por un mínimo de 12 semanas, permiso por duelo, permiso para cuidadores, permiso de voluntariado, reembolso de bienestar, programas de salud financiera, física y mental. Además, ofrecemos premios por aniversario de servicio y reconocimiento, y con sujeción a los términos de sus respectivos planes, los empleados, y los dependientes elegibles de algunas ubicaciones, pueden participar en varios planes de seguro. Para obtener más información, visite Employee benefits | Supporting well-being & career growth | Johnson & Johnson Careers. *Lo anterior se facilita con fines exclusivamente informativos. Los importes y los beneficios reales pueden variar según la ubicación y están sujetos a cambios.