Descripción de la vacante
Fully remote
Spain
Senior Deep Learning Engineer, Accuracy Evaluation en España is listed on Jobeax. Browse 80,000+ vacancies available.
We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance and capabilities of ground-breaking deep learning models, including LLMs, RAG, agents, and vision models. You will collaborate across the organization to bring the latest flagship models from our community and partners to life. This role offers an outstanding opportunity to craft the future of AI at a fast-growing company at the forefront of the AI revolution. Join our team of world-class software engineers and partners to deliver the most advanced models with lightning-fast inference. You'll work on the most powerful, enterprise-grade GPU clusters capable of hundreds of PetaFLOPS and gain early access to unreleased hardware, making a direct impact on NVIDIA's roadmap and the broader AI landscape!
Design and build decision-grade evaluation environments for NVIDIA's frontier models spanning reasoning, multimodal, long-context, and agentic systems, producing auditable accuracy signals that gate every major model release.
Research and develop novel evaluation methodologies for emerging model families and capability domains (low-precision numerics, multi-turn agentic tasks, code generation) where established benchmarks don't yet exist or don't generalize.
Build and operate the evaluation infrastructure and pipelines including benchmark environments, regression CI systems, and statistical analysis tooling, used by model, product, and applied research teams across NVIDIA.
Partner with model research, training, and customer teams to translate evaluation signals into concrete decisions: release go/no-go, training iteration direction, and competitive positioning against external frontier models.
BS, MS, or PhD in Computer Science, Machine Learning, Statistics, or a related field
6+ years of hands-on experience with LLMs, designing and running evaluations for large language models or multimodal AI systems, including experience with agentic, multi-turn, or reasoning-heavy settings.
Strong statistical foundations: experimental design, significance testing, regression analysis, and the ability to distinguish signal from noise in benchmark results at scale.
Proven experience building evaluation infrastructure (pipelines, benchmark harnesses, reproducible CI systems) not just consuming existing benchmarks.
Clear, precise communicator who can translate quantitative evaluation results into decisions for researchers, product teams, and senior leadership.
Deep familiarity with open-source evaluation frameworks
Experience designing evaluations for agentic systems: tool use, multi-turn reasoning, environment-based benchmarks (SWE-bench, GAIA, WebArena-style), or interactive evaluation settings.
Track record of publishing or contributing to evaluation research, new benchmark design, methodology papers, or reproducibility analyses that shaped how the field measures model capability.
Experience measuring model accuracy under low-precision inference (FP8, INT4, quantization-aware settings) and understanding how calibration and sparsity interact with benchmark results.
Comfort running large-scale workloads on HPC/Slurm clusters, including reproducible experiment management (MLflow, W&B) and compute cost optimization across hundreds of benchmark runs.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. For Poland: The base salary range is 375,000 PLN - 650,000 PLN.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Vacantes similares
Fully remote
... latency/cost optimization, and monitoring. - Research state-of-the-art approaches in the industry, publish your own work, and speak at leading conferences. - Mentor senior engineers and scientists; own technical standards for model development across the team (design reviews, evaluation methodology, deployment practices). - Communicate ...
Spain
€95,000 - €115,000 a year
... exploitation, accuracy and latency, and autonomy and control. - Define evaluation frameworks and metrics for retrieval quality, agent performance, factual accuracy, and business relevance. - Partner closely with Research, Product, and Engineering to rapidly prototype, test, and refine new capabilities through short feedback ...
Spain
Sardine
€85,000 - €160,000 a year
... - We are a remote-first company with a globally distributed team. You can find your productive zone and work from there. What you'll be doing As a Machine Learning Engineer at Sardine, you'll own the systems that make real-time fraud detection possible. Our data science team builds custom models for our clients, you build ...
Spain
de 40000 a 43000 €/año
¿Te gustaría participar en proyectos de innovación tecnológica , trabajando con ingeniería de datos, Cloud, Inteligencia Artificial y Machine Learning aplicados a entornos industriales? En Keapps buscamos un/a Ingeniero/a de Datos y Machine Learning para incorporarse a un proyecto estable dentro de un Departamento de Innovación ...
Spain, Castro
Ayesa Digital
11k
EData Scientist / Machine Learning Engineer Ayesa Digital Cequelinos, galicia, Spain Descripción del trabajo ¡En Ayesa Digital crecemos Contigo! Desplácese hacia abajo para encontrar una descripción detallada de este trabajo y lo que se espera de los candidatos. Cada profesional de nuestra empresa es importante para nosotros, ...
Spain, Arbo
US$12 an hour
... text captions and task requirements. - Voice Quality: Evaluate whether generated voices sound natural and, where applicable, match the reference audio. - Evaluation & Feedback: Assign accurate scores and identify issues according to the provided evaluation guidelines. What we're looking for - Native-level fluency in Spanish ...
Spain
€65,000 - €95,000 a año
... con metodologías DevOps. Habilidades y competencias - Experiencia avanzada en Python, SQL y manipulación de datos con pandas y NumPy - Dominio de frameworks de deep learning como TensorFlow, PyTorch o Keras - Conocimiento sólido en algoritmos de machine learning, estadística y análisis de datos - Experiencia con herramientas ...
Spain, Barcelona
FirstIgnite
... • You're based somewhere between New York time (ET) and Western European time. Italy is the furthest east we can go. You might currently be titled AI Agent Engineer · Agentic AI Engineer · Senior AI Engineer · AI Systems Engineer · Lead AI Developer · AI Solutions Architect · AI Integration Specialist · Senior Data Scientist, ...
Spain, Castro
jobtraffic
... scalability, latency and cost. - Document technical decisions, limitations and evaluation results. What we are looking for - 3+ years of relevant experience in AI Engineering, Machine Learning Engineering or Data Science. - Hands-on experience with LLMs, Generative AI, prompt engineering and model evaluation. - Experience with ...
Spain
... https://jobeax.com/link/8om4ubga9gvjbUNE a mejorar su posición competitiva mediante la gestión avanzada de la información. ¡Únete a nuestro equipo! Actualmente buscamos Machine Learning Operations Engineer con experiencia comprobable en Vertex AI (GCP) y liderazgo para trabajar en un proyecto líder del sector retail. Requisitos obligatorios: ...
Spain, Madrid
Visa sponsorship mentioned
... Production AI Lifecycle: Lead end to end delivery for complex Machine Learning and GenAI initiatives-moving from initial hypothesis, data scoping, and model evaluation harnesses to production deployment and post-launch monitoring. - Bridge Engineering and Business Strategy: Act as the technical sparring partner for Data Scientists ...
Spain
Fully remote
... design, build, and operate the systems behind our AI products. Your work will span generative AI applications, enterprise RAG systems, agentic workflows, model evaluation, machine learning pipelines, and the infrastructure required to run them reliably at scale. This is a hands on engineering role with strong ownership. You ...
Spain
€65,000 - €95,000 a year
... Barcelona, Madrid y centros remotos en toda Europa. Proceso de selección Nuestro proceso incluye: entrevista inicial con RRHH (30 min), prueba técnica de machine learning (2-3 horas), entrevista técnica con senior engineers (45 min), y entrevista final con responsable de equipo (30 min). Total: 1-2 semanas aproximadamente.
Spain, Barcelona
Full-time hours
About the role At Preply, we’re all about creating life-changing learning experiences. We help people discover the magic of the perfect tutor, craft a personalised learning journey, and stay motivated to keep growing. Our approach is human-led, tech-enabled - and it’s creating real impact. We’ve just reached unicorn status ...
Spain
€55,000 - €80,000 a year
Acerca del rol Buscamos un Senior Backend Developer apasionado por la tecnología y la innovación para unirse a nuestro equipo en Vitoria. En esta posición Full-time, serás responsable del desarrollo y mantenimiento de arquitecturas backend escalables utilizando Python y tecnologías de Machine Learning. Trabajarás en proyectos ...
Spain, Vitoria
Hire Feed
... Data Manager, New Grad to work on a full-time basis. The role involves maintaining high-quality datasets used in AI model training and evaluation, ensuring accuracy and relevance of labeled information. Candidates will assist in refining data pipelines and improving annotation processes for machine learning applications. ...
Spain, Vitoria
65000 €/año
... e-commerce technology company that is investing heavily in AI to transform the way software is designed, developed, tested, and delivered. We are looking for a Senior AI Engineer to join an international engineering team and help bring AI capabilities directly into the software development lifecycle. You’ll work on practical, ...
Spain
Agilent Technologies
... scientific discovery, diagnostics, and applied market solutions through instruments, software, consumables, services, and deep domain expertise. About the role As a Senior Applied AI Engineer, Agentic Systems, you will be an AI engineering SME within a cross-functional AI pod, working alongside data engineers, domain experts, business ...
Spain, Barcelona
€95,000 - €115,000 a year
... exploitation, accuracy and latency, and autonomy and control. - Define evaluation frameworks and metrics for retrieval quality, agent performance, factual accuracy, and business relevance. - Partner closely with Research, Product, and Engineering to rapidly prototype, test, and refine new capabilities through short feedback ...
Spain
Full relocation support
... machine learning concepts, including classification, regression, decision trees, and the standard model lifecycle from data collection to deployment. - Model Evaluation Understanding: Ability to translate technical model evaluation metrics such as precision, recall, and F1 score into practical operational outcomes like saved ...
Spain