Descripción de la vacante
Fully remote
Spain
Senior Deep Learning Engineer, Accuracy Evaluation en España is listed on Jobeax. Browse 80,000+ vacancies available.
We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance and capabilities of ground-breaking deep learning models, including LLMs, RAG, agents, and vision models. You will collaborate across the organization to bring the latest flagship models from our community and partners to life. This role offers an outstanding opportunity to craft the future of AI at a fast-growing company at the forefront of the AI revolution. Join our team of world-class software engineers and partners to deliver the most advanced models with lightning-fast inference. You'll work on the most powerful, enterprise-grade GPU clusters capable of hundreds of PetaFLOPS and gain early access to unreleased hardware, making a direct impact on NVIDIA's roadmap and the broader AI landscape!
Design and build decision-grade evaluation environments for NVIDIA's frontier models spanning reasoning, multimodal, long-context, and agentic systems, producing auditable accuracy signals that gate every major model release.
Research and develop novel evaluation methodologies for emerging model families and capability domains (low-precision numerics, multi-turn agentic tasks, code generation) where established benchmarks don't yet exist or don't generalize.
Build and operate the evaluation infrastructure and pipelines including benchmark environments, regression CI systems, and statistical analysis tooling, used by model, product, and applied research teams across NVIDIA.
Partner with model research, training, and customer teams to translate evaluation signals into concrete decisions: release go/no-go, training iteration direction, and competitive positioning against external frontier models.
BS, MS, or PhD in Computer Science, Machine Learning, Statistics, or a related field
6+ years of hands-on experience with LLMs, designing and running evaluations for large language models or multimodal AI systems, including experience with agentic, multi-turn, or reasoning-heavy settings.
Strong statistical foundations: experimental design, significance testing, regression analysis, and the ability to distinguish signal from noise in benchmark results at scale.
Proven experience building evaluation infrastructure (pipelines, benchmark harnesses, reproducible CI systems) not just consuming existing benchmarks.
Clear, precise communicator who can translate quantitative evaluation results into decisions for researchers, product teams, and senior leadership.
Deep familiarity with open-source evaluation frameworks
Experience designing evaluations for agentic systems: tool use, multi-turn reasoning, environment-based benchmarks (SWE-bench, GAIA, WebArena-style), or interactive evaluation settings.
Track record of publishing or contributing to evaluation research, new benchmark design, methodology papers, or reproducibility analyses that shaped how the field measures model capability.
Experience measuring model accuracy under low-precision inference (FP8, INT4, quantization-aware settings) and understanding how calibration and sparsity interact with benchmark results.
Comfort running large-scale workloads on HPC/Slurm clusters, including reproducible experiment management (MLflow, W&B) and compute cost optimization across hundreds of benchmark runs.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. For Poland: The base salary range is 375,000 PLN - 650,000 PLN.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Vacantes similares
Grid Dynamics
Grid Dynamics busca un Senior Machine Learning Engineer enfocado en sistemas LLM y evaluación para liderar proyectos de IA de última generación, incluidas técnicas de RAG, agentes y evaluación de seguridad AI. El candidato ideal tiene 5+ años en ML engineering, fuerte Python y experiencia con PyTorch, TensorFlow o JAX, ...
Spain, Castro-Urdiales
Up to US$40 an hour
... ones, neither too strict nor too lenient - Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust - Not data labeling - Not prompt engineering - Not writing code from scratch - the agent writes most of the code; you guide and evaluate ...
Spain
€60,000 - €85,000 a year
About the role We are seeking an experienced Senior Machine Learning Engineer to join our innovative AI team in Barcelona. You will be responsible for designing, developing, and deploying cutting-edge machine learning solutions for our leading automotive and manufacturing clients. This is a Full-time, on-site position where ...
Spain, Barcelona
Dow Jones
€55,000 - €70,000 a year
About the role We are seeking a highly experienced and technically adept Senior Machine Learning Engineer to join our team. In this pivotal role, you will own the entire lifecycle of MLOps from optimization to deployment, with a strong focus on LLMOps. This position demands a strong blend of hands-on technical expertise, ...
Spain, Barcelona
Up to US$70,000 a year
... the role We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks. You'll create challenging tasks and evaluation criteria within realistic simulated environments: What this is NOT - Not data labeling - Not prompt engineering - Not writing code from scratch - the agent ...
Spain
Up to US$70,000 a year
... specifically for QA-automation/testing or cybersecurity roles Education & certifications Educational qualifications - A Master's Degree in Computer Science, Software Engineering, Data Science / Data Analytics, Artificial Intelligence / Machine Learning, Computational Linguistics / Natural Language Processing (NLP), Information Systems ...
Spain
Up to US$70,000 a year
... specifically for QA-automation/testing or cybersecurity roles Education & certifications Educational qualifications - A Master's Degree in Computer Science, Software Engineering, Data Science / Data Analytics, Artificial Intelligence / Machine Learning, Computational Linguistics / Natural Language Processing (NLP), Information Systems ...
Spain
€55,000 - €70,000 a year
About the role We are looking for a Senior Machine Learning Engineer to join our Search team in Barcelona. You will design and build systems that deliver highly relevant, personalized experiences across our digital products. This role sits at the intersection of backend engineering, data, and applied AI-leveraging modern ...
Spain, Barcelona
Up to US$262,500 a year
... involves: We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks. You'll create challenging tasks and evaluation criteria within realistic simulated environments: What you'll do - Build realistic developer environments - a virtual company with codebase, infrastructure, ...
Spain
... Transition models from research/evaluation into full production, optimizing complex models for strict low-latency inference and high reliability. - Quality & Evaluation Frameworks: Establish rigorous evaluation benchmarks, automated testing harnesses, and monitoring dashboards to guarantee the accuracy and stability of ML ...
Spain
All European Careers
... Castro e Marzán, Galicia, Spain Descripción del trabajo Join our dynamic international team and embrace the adventure of working abroad! We are looking for a Senior AI & NLP Engineer for the development and maintenance of software applications in the field of Natural Language Processing (NLP), Machine Learning (ML) and/or ...
Spain, Mos
de 80000 a 120000 $/año
... environment is highly technical and innovation-driven, with a strong emphasis on production-grade ML systems and measurable impact. You will collaborate with engineers across distributed teams to push the boundaries of LLMs, deep learning, and large-scale data systems. This is an opportunity to work on one of the most advanced ...
Spain, Madrid
€65,000 - €95,000 a year
... analysis, while mentoring junior engineers and contributing to our technical strategy. Who are we looking for We're looking for a highly experienced machine learning professional with a strong background in computer vision and deep learning frameworks. You should have at least 6+ years of experience in ML engineering, with ...
Spain, Barcelona
What you'll do As a Senior Machine Learning Engineer, these will be some of the key activities in your day-to-day role: Design, train and deploy scalable machine learning models using Getnet data to solve high-impact payment and business challenges across geographies. Build and maintain end-to-end machine learning pipelines, ...
Spain, Boadilla del Monte
€65,000 - €95,000 a year
Sobre el rol Buscamos un ingeniero de Machine Learning senior altamente cualificado para unirse a nuestro equipo de transformación digital en Banco Santander. En esta posición, serás responsable de diseñar, desarrollar e implementar soluciones avanzadas de machine learning que impulsen la innovación en el sector financiero. ...
Spain, Madrid
Capitole
Buscamos un/a Data Scientist / ML Engineer con sólida experiencia en IA tradicional para incorporarse a un equipo de datos en expansión. La persona seleccionada será responsable de diseñar, entrenar y poner en producción modelos predictivos orientados a pricing dinámico, personalización de oferta y forecast de demanda en ...
Spain
Michael Page España
€50,000 - €65,000 a year
About the role We are looking for a Senior Machine Learning Engineer to design, develop, and deploy deep learning models for complex pattern recognition problems in industrial inspection data. You will take ownership of projects end-to-end, from data preparation and model development to production deployment, working closely ...
Spain, Barcelona
Full-time hours
... pipelines, distributed execution, optimisation, and training stability. Skills - Advanced programming ability in Python and strong software engineering practices. - Deep understanding of modern machine learning and deep learning techniques. - Strong practical experience with PyTorch or an equivalent deep learning framework. - ...
Spain
Up to US$70,000 a year
... ones, neither too strict nor too lenient - Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust What this is NOT - Not data labeling - Not prompt engineering - Not writing code from scratch - the agent writes most of the code; you guide ...
Spain