Descripción de la vacante
Fully remote
Spain
Senior Deep Learning Engineer, Accuracy Evaluation en España is listed on Jobeax. Browse 80,000+ vacancies available.
We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance and capabilities of ground-breaking deep learning models, including LLMs, RAG, agents, and vision models. You will collaborate across the organization to bring the latest flagship models from our community and partners to life. This role offers an outstanding opportunity to craft the future of AI at a fast-growing company at the forefront of the AI revolution. Join our team of world-class software engineers and partners to deliver the most advanced models with lightning-fast inference. You'll work on the most powerful, enterprise-grade GPU clusters capable of hundreds of PetaFLOPS and gain early access to unreleased hardware, making a direct impact on NVIDIA's roadmap and the broader AI landscape!
Design and build decision-grade evaluation environments for NVIDIA's frontier models spanning reasoning, multimodal, long-context, and agentic systems, producing auditable accuracy signals that gate every major model release.
Research and develop novel evaluation methodologies for emerging model families and capability domains (low-precision numerics, multi-turn agentic tasks, code generation) where established benchmarks don't yet exist or don't generalize.
Build and operate the evaluation infrastructure and pipelines including benchmark environments, regression CI systems, and statistical analysis tooling, used by model, product, and applied research teams across NVIDIA.
Partner with model research, training, and customer teams to translate evaluation signals into concrete decisions: release go/no-go, training iteration direction, and competitive positioning against external frontier models.
BS, MS, or PhD in Computer Science, Machine Learning, Statistics, or a related field
6+ years of hands-on experience with LLMs, designing and running evaluations for large language models or multimodal AI systems, including experience with agentic, multi-turn, or reasoning-heavy settings.
Strong statistical foundations: experimental design, significance testing, regression analysis, and the ability to distinguish signal from noise in benchmark results at scale.
Proven experience building evaluation infrastructure (pipelines, benchmark harnesses, reproducible CI systems) not just consuming existing benchmarks.
Clear, precise communicator who can translate quantitative evaluation results into decisions for researchers, product teams, and senior leadership.
Deep familiarity with open-source evaluation frameworks
Experience designing evaluations for agentic systems: tool use, multi-turn reasoning, environment-based benchmarks (SWE-bench, GAIA, WebArena-style), or interactive evaluation settings.
Track record of publishing or contributing to evaluation research, new benchmark design, methodology papers, or reproducibility analyses that shaped how the field measures model capability.
Experience measuring model accuracy under low-precision inference (FP8, INT4, quantization-aware settings) and understanding how calibration and sparsity interact with benchmark results.
Comfort running large-scale workloads on HPC/Slurm clusters, including reproducible experiment management (MLflow, W&B) and compute cost optimization across hundreds of benchmark runs.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. For Poland: The base salary range is 375,000 PLN - 650,000 PLN.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Vacantes similares
Grid Dynamics
Grid Dynamics busca un Senior Machine Learning Engineer enfocado en sistemas LLM y evaluación para liderar proyectos de IA de última generación, incluidas técnicas de RAG, agentes y evaluación de seguridad AI. El candidato ideal tiene 5+ años en ML engineering, fuerte Python y experiencia con PyTorch, TensorFlow o JAX, ...
Spain, Castro-Urdiales
Up to US$40 an hour
... ones, neither too strict nor too lenient - Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust - Not data labeling - Not prompt engineering - Not writing code from scratch - the agent writes most of the code; you guide and evaluate ...
Spain
€60,000 - €85,000 a year
About the role We are seeking an experienced Senior Machine Learning Engineer to join our innovative AI team in Barcelona. You will be responsible for designing, developing, and deploying cutting-edge machine learning solutions for our leading automotive and manufacturing clients. This is a Full-time, on-site position where ...
Spain, Barcelona
All European Careers
... Castro e Marzán, Galicia, Spain Descripción del trabajo Join our dynamic international team and embrace the adventure of working abroad! We are looking for a Senior AI & NLP Engineer for the development and maintenance of software applications in the field of Natural Language Processing (NLP), Machine Learning (ML) and/or ...
Spain, Mos
de 80000 a 120000 $/año
... environment is highly technical and innovation-driven, with a strong emphasis on production-grade ML systems and measurable impact. You will collaborate with engineers across distributed teams to push the boundaries of LLMs, deep learning, and large-scale data systems. This is an opportunity to work on one of the most advanced ...
Spain, Madrid
€65,000 - €95,000 a year
... analysis, while mentoring junior engineers and contributing to our technical strategy. Who are we looking for We're looking for a highly experienced machine learning professional with a strong background in computer vision and deep learning frameworks. You should have at least 6+ years of experience in ML engineering, with ...
Spain, Barcelona
€65,000 - €95,000 a year
Sobre el rol Buscamos un ingeniero de Machine Learning senior altamente cualificado para unirse a nuestro equipo de transformación digital en Banco Santander. En esta posición, serás responsable de diseñar, desarrollar e implementar soluciones avanzadas de machine learning que impulsen la innovación en el sector financiero. ...
Spain, Madrid
Capitole
Buscamos un/a Data Scientist / ML Engineer con sólida experiencia en IA tradicional para incorporarse a un equipo de datos en expansión. La persona seleccionada será responsable de diseñar, entrenar y poner en producción modelos predictivos orientados a pricing dinámico, personalización de oferta y forecast de demanda en ...
Spain
Full-time hours
... pipelines, distributed execution, optimisation, and training stability. Skills - Advanced programming ability in Python and strong software engineering practices. - Deep understanding of modern machine learning and deep learning techniques. - Strong practical experience with PyTorch or an equivalent deep learning framework. - ...
Spain
TELUS Digital AI Data Solutions
TELUS Digital invites qualified professionals to join as a Financial Accuracy Specialist operating as an independent contractor. You will review AI-generated financial statements and expense reports, ensuring compliance with local accounting laws and accuracy to the penny. You’ll verify tax logic, categorize expenses, and ...
Spain, Zaragosa
Full-time hours
... Design and implement automated and manual QA strategies for GenAI systems - Build regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracy, grounding, robustness, safety - Validate prompt logic, model behavior and evaluation metrics - Execute tests and debug pipelines - ...
Spain
Have the right to work in Spain
... processes. - You will prepare system review reports based on the collected and analyzed data. - You will coordinate follow-up groups to communicate process evaluations and trends. - You will review documentation that describes production operations and the functioning of equipment and facilities. - You will review qualification ...
Spain
The BIG Jobsite
€270 EUR - €300 EUR
SEEKING : Senior AI/Platform Engineer We are looking for a Senior AI/Platform Engineer GOAL : - Engage with project delivery teams during planning and execution to build architecture recommendations Productize Mosaic AI into a governed, multi-tenant, self-service platform - Shipping golden paths, SDK/CLI/templates, and ...
Spain, Vitoria
€270 EUR - €300 EUR
SEEKING : Senior AI/Platform Engineer We are looking for a Senior AI/Platform Engineer GOAL : ► Engage with project delivery teams during planning and execution to build architecture recommendations Productize Mosaic AI into a governed, multi-tenant, self-service platform ► Shipping golden paths, SDK/CLI/templates, and ...
Spain, Cequelinos
€270 EUR - €300 EUR
SEEKING : Senior AI/Platform Engineer We are looking for a Senior AI/Platform Engineer GOAL : ► Engage with project delivery teams during planning and execution to build architecture recommendations Productize Mosaic AI into a governed, multi-tenant, self-service platform ► Shipping golden paths, SDK/CLI/templates, and ...
Spain
€270 EUR - €300 EUR
SEEKING : Senior AI/Platform Engineer We are looking for a Senior AI/Platform Engineer GOAL : ► Engage with project delivery teams during planning and execution to build architecture recommendations Productize Mosaic AI into a governed, multi-tenant, self-service platform ► Shipping golden paths, SDK/CLI/templates, and ...
Spain, Castro
Full-time hours
... Optimization - Model Development & Experimentation: Lead exploratory data analysis, feature engineering, model selection, training, validation, and performance evaluation for machine learning and AI-enabled solutions. Design and evaluate multiple modeling approaches, establish appropriate evaluation metrics, and optimize models ...
Spain
€55,000 - €80,000 a year
About the role Buscamos un Senior Full-Stack Engineer experimentado para unirse a nuestro equipo de desarrollo de software de clase mundial. En esta posición, serás responsable del diseño, desarrollo y mantenimiento de aplicaciones web complejas y escalables utilizando tecnologías modernas. Trabajarás en proyectos innovadores ...
Spain, España
€60,000 - €85,000 a year
Acerca del rol Buscamos un Senior Machine Learning Engineer experimentado para unirse a nuestro equipo de innovación en Barcelona. En esta posición híbrida, serás responsable de diseñar, desarrollar e implementar soluciones de machine learning de alto impacto que transformen nuestros productos y servicios. Trabajarás en ...
Spain, Barcelona