Senior Deep Learning Engineer, Accuracy Evaluation en… - Jobeax
Descripción de la vacante
Senior Deep Learning Engineer, Accuracy Evaluation en España
RemotoTrabaja desde cualquier lugar
Fully remote
Spain
Senior Deep Learning Engineer, Accuracy Evaluation en España is listed on Jobeax. Browse 80,000+ vacancies available.
About the role
We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance and capabilities of ground-breaking deep learning models, including LLMs, RAG, agents, and vision models. You will collaborate across the organization to bring the latest flagship models from our community and partners to life. This role offers an outstanding opportunity to craft the future of AI at a fast-growing company at the forefront of the AI revolution. Join our team of world-class software engineers and partners to deliver the most advanced models with lightning-fast inference. You'll work on the most powerful, enterprise-grade GPU clusters capable of hundreds of PetaFLOPS and gain early access to unreleased hardware, making a direct impact on NVIDIA's roadmap and the broader AI landscape!
What you'll do
Design and build decision-grade evaluation environments for NVIDIA's frontier models spanning reasoning, multimodal, long-context, and agentic systems, producing auditable accuracy signals that gate every major model release.
Research and develop novel evaluation methodologies for emerging model families and capability domains (low-precision numerics, multi-turn agentic tasks, code generation) where established benchmarks don't yet exist or don't generalize.
Build and operate the evaluation infrastructure and pipelines including benchmark environments, regression CI systems, and statistical analysis tooling, used by model, product, and applied research teams across NVIDIA.
Partner with model research, training, and customer teams to translate evaluation signals into concrete decisions: release go/no-go, training iteration direction, and competitive positioning against external frontier models.
What we're looking for
BS, MS, or PhD in Computer Science, Machine Learning, Statistics, or a related field
6+ years of hands-on experience with LLMs, designing and running evaluations for large language models or multimodal AI systems, including experience with agentic, multi-turn, or reasoning-heavy settings.
Strong statistical foundations: experimental design, significance testing, regression analysis, and the ability to distinguish signal from noise in benchmark results at scale.
Proven experience building evaluation infrastructure (pipelines, benchmark harnesses, reproducible CI systems) not just consuming existing benchmarks.
Clear, precise communicator who can translate quantitative evaluation results into decisions for researchers, product teams, and senior leadership.
Nice to have
Deep familiarity with open-source evaluation frameworks
Experience designing evaluations for agentic systems: tool use, multi-turn reasoning, environment-based benchmarks (SWE-bench, GAIA, WebArena-style), or interactive evaluation settings.
Track record of publishing or contributing to evaluation research, new benchmark design, methodology papers, or reproducibility analyses that shaped how the field measures model capability.
Experience measuring model accuracy under low-precision inference (FP8, INT4, quantization-aware settings) and understanding how calibration and sparsity interact with benchmark results.
Comfort running large-scale workloads on HPC/Slurm clusters, including reproducible experiment management (MLflow, W&B) and compute cost optimization across hundreds of benchmark runs.
What you'll get
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. For Poland: The base salary range is 375,000 PLN - 650,000 PLN.
Additional information
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
... deliver high-quality Polish language-engineering work as part of a larger, fast-moving program - writing code and prompts, generating and auditing data, running evaluations, analyzing the assistant's behavior, and reviewing peers' contributions. What This Role Is Like: This is a hands-on, execution-focused engineering role inside ...
... Instructional Designer, Learning Experience Designer, Learning Content Developer, Program Designer, or in a comparable role. - Proven experience applying modern learning experience design models, methodologies, and frameworks to the development of complex skills. - Experience structuring end-to-end learning experiences, including ...
... Instructional Designer, Learning Experience Designer, Learning Content Developer, Program Designer, or in a comparable role. - Proven experience applying modern learning experience design models, methodologies, and frameworks to the development of complex skills. - Experience structuring end-to-end learning experiences, including ...
This job was automatically translated to English, see original posting . About the role Are you passionate about learning experience design and creating innovative educational content? We are looking for a creative, organized, and quality-oriented person to join a stable project in the e-learning sector, with a 100% remote ...
... health in production, using observability tools to proactively identify and resolve bottlenecks or anomalies. - Technical Leadership: Share your expertise through deep code reviews, mentoring junior engineers, and documenting engineering standards that elevate the entire squad. - AI-Driven Execution: Actively leverage AI tools ...
... from tasks that are simply challenging. Required Qualifications - 3–8 years of professional web development experience , primarily in frontend or full-stack engineering. - Strong hands-on experience with HTML, CSS, JavaScript, responsive web development, and modern frontend engineering practices . - Deep understanding of ...
Sobre el rol Buscamos un Ingeniero de Machine Learning Senior para unirse a nuestro equipo innovador en Madrid. En esta posición Full-time, serás responsable del diseño, desarrollo e implementación de algoritmos avanzados de aprendizaje automático que potencien nuestras plataformas de inteligencia artificial de última generación. ...
Sobre el rol Buscamos un Ingeniero de Machine Learning Senior apasionado por construir sistemas de recomendación de última generación. En esta posición, serás responsable de diseñar, desarrollar y optimizar algoritmos de ML que impulsen la experiencia del usuario en nuestra plataforma. Trabajarás en un entorno Full-time, ...
... Habilidades y competencias requeridas - Experiencia sólida con Python, TensorFlow, PyTorch o frameworks similares - Conocimiento profundo de algoritmos de Machine Learning, Deep Learning y estadística - Experiencia en procesamiento y visualización de grandes volúmenes de datos - Dominio de herramientas de versionado (Git) y metodologías ...
... is seeking a Sr Applied Researcher to join our team building greenfield next-generation AI that stops breaches and is powered by large language models (LLMs), deep learning, and other modern AI techniques.. You will work closely with other scientists and software engineers to provide technical leadership and strategic direction, ...
... increasingly digital world. Our teams combine deep technical expertise, collaboration, and a strong customer focus to deliver impactful results. We value continuous learning, knowledge sharing, and an inclusive culture where people can thrive and grow. As a Senior Data Scientist , you will focus on traditional Machine Learning and ...
... multimodal integration; model calibration and domain adaptation; data-centric AI; model interpretability; model post-training and alignment. - Exceptional software engineering skills: Python, deep learning frameworks (https://jobeax.com/link/qhTDnaKbrA46k5AN), frontier coding agent frameworks, modern LLM tooling, and cloud platforms ...
... on the AI agents, prompts, specs, tools, and guardrails, using evaluation sets, quality metrics, and feedback from real delivery, so every cycle raises the accuracy, reliability, and impact of what the agents collaboratively create. - Write high-quality, well-documented, testable specifications and code, the senior engineer's ...
Newton Colmore Consulting is partnering with a venture-backed deep tech company to develop novel intelligent systems. The Machine Learning Engineer will own advanced modelling, ML and predictive analytics across product platforms, tackling challenging problems with autonomy and leadership exposure. You will join a talented ...
Acerca del rol Buscamos un Ingeniero/a Senior de Machine Learning apasionado/a por desarrollar sistemas inteligentes de recomendación y procesamiento de datos a escala. En esta posición, serás responsable de diseñar, implementar y optimizar algoritmos avanzados de machine learning que potencien nuestras plataformas de análisis ...
... training sessions, that help our hotel customers and internal teams master D-EDGE products. If you enjoy turning complex product information into clear, useful learning experiences, and want to build deeper expertise in hospitality technology, this role is for you. WHAT YOU'LL DO - Design & Innovate: Create clear, outcome-focused ...
... channel events, shaping the learning arc, scripting facilitated moments, and ensuring behaviour change outcomes are embedded throughout the experience - Apply learning methodologies with intention: experiential learning, coaching integration, gamification, peer engagement, selecting what fits each moment and format - Collaborate ...
... and borders open. Our tech and communication innovations are the secret behind the success of the world's air travel industry. About The Role And The Team The Senior Business Consultant works closely with account teams and clients and plays a key project/program role in any consulting engagement in area/s of expertise to ...
... workflows. - Build trust and alignment across the C++ Ecosystem, AI, Product, QA, and ML organizations We'd love to talk if you have: - Significant software engineering experience as a Staff Engineer, Principal Engineer, Technical Lead, or similar senior technical role. - Strong experience with Kotlin, Java, or other JVM ...
... workflows. - Build trust and alignment across the C++ Ecosystem, AI, Product, QA, and ML organizations We'd love to talk if you have: - Significant software engineering experience as a Staff Engineer, Principal Engineer, Technical Lead, or similar senior technical role. - Strong experience with Kotlin, Java, or other JVM ...