Senior Data Engineer(Databricks) en Castro, España - Jobeax
Descripción de la vacante
Senior Data Engineer(Databricks) en Castro, España
Intellias
RemotoTrabaja desde cualquier lugar
ContratoTemporal o freelance
Spain, Castro
Senior Data Engineer(Databricks) en Castro, España is listed on Jobeax. Browse 80,000+ vacancies available.
Senior Data Engineer(Databricks)
Location: Remote from Spain (an indefinite Spanish employment contract)
We are hiring a Senior Data Engineer to join an Intellias delivery team on a large-scale enterprise data platform migration programme for a financial services client. This is a hands-on senior role. You will write production code every week, own architectural decisions on your workstream, and mentor a paired mid-level engineer.
Our client is an independent, active global asset manager with over R3 trillion in assets under management. They are executing a firm-wide data strategy to govern, manage and engineer data as a product across more than 70 business-owned sub-domains.
As part of this, they are migrating to Databricks as the foundational layer of their Enterprise Data Platform, adopting a lakehouse architecture built on open formats, declarative pipelines and Unity Catalog.
Requirements:
6+ years of data engineering experience, with at least the last three years on Databricks in production.
Deep hands-on experience with medallion / Lakehouse architecture, Delta Lake, Unity Catalog, Lakeflow Declarative Pipelines and Databricks Asset Bundles.
Strong python, PySpark and SQL, comfortable diagnosing performance issues on large workloads through Spark UI and Photon.
Real production experience with streaming ingestion (Kafka Structured Streaming, Auto Loader) and CDC patterns.
Experience implementing data quality at scale (Great Expectations or equivalent), plus lineage, cataloguing and access control.
CI/CD on data platforms through Azure DevOps or GitHub Actions, with infrastructure as code (Terraform or equivalent).
Fluent working English.
Nice to have
Active Databricks certifications
Prior exposure to investment management platforms, asset management operations data, market data feeds from major providers
CDMP DAMA certification or equivalent data governance credential.
Experience applying agentic engineering tooling to production data engineering (not just personal productivity), including MCP-connected Databricks or cloud servers.
Responsibilities:
Perform the end-to-end delivery of one or more priority data domains on Azure Databricks.
Design and build medallion (Bronze / Silver / Gold) pipelines using Lakeflow Declarative Pipelines, Auto Loader, Structured Streaming and Delta Lake with Liquid Clustering.
Register curated data products in Unity Catalog with the correct tags, masks, row filters, lineage and access policies.
Implement data quality gates at the Silver-to-Gold boundary, and refine rules with domain stewards.
Package and deploy work using Databricks Asset Bundles through Azure DevOps CI/CD
Write automated tests and documentation
Work at AI-as-Collaborator level today with a path to AI-as-Orchestrator, using Claude Code, Databricks Assistant, GitHub Copilot and MCP-connected agent tooling to accelerate the recurring parts of pipeline build, test and deploy.
Why this position:
Build within a large-scale enterprise data platform migration from day one, designing and delivering the pipelines, ingestion patterns and domain migrations that bring a 70+ sub-domain data strategy to life. You'll work hands-on with the leading edge of the Databricks ecosystem on a high-stakes lakehouse build, applying agentic engineering tooling to accelerate delivery, and working closely with the architecture team to turn platform standards into working, production-grade data.
... equally comfortable running a 1:1, unblocking the mapping of a stubborn dataset into the common data model, defending a roadmap to leadership, and coaching an engineer on how (and when not) to trust a coding agent. Lead, coach, and grow the Barcelona data engineering team including senior ICs and the Data Architect, through ...
... self‑service para equipos de Inteligencia Artificial, basada en Databricks Mosaic AI , MLflow y Azure . Requisitos: - +5 años de experiencia en MLOps , Platform Engineering o SRE aplicado a ML/IA . - Experiencia sólida con Databricks y MLflow en entornos productivos. - Conocimientos avanzados de CI/CD , automatización y promoción ...
... Experience with Hibernate/JPA. - Experience with DynamoDB. - Experience with CloudFormation. - Experience with Flyway. - Experience with Snowflake, BigQuery, or Databricks. - Experience processing telemetry or event data at scale. - Fully remote 6 hours overlap with US Central Time (CT) on business days (till 2 pm CT latest)
... del negocio, trabajando sobre ecosistemas Microsoft para garantizar fiabilidad, integración y capacidad de evolución. En Airplane Solutions buscamos un perfil Senior Azure Data Engineer que se una a nuestro equipo para diseñar, implementar y optimizar soluciones de datos escalables en Microsoft Azure y Microsoft Fabric, liderando ...
... self‑service para equipos de Inteligencia Artificial, basada en Databricks Mosaic AI , MLflow y Azure . Requisitos: - +5 años de experiencia en MLOps , Platform Engineering o SRE aplicado a ML/IA . - Experiencia sólida con Databricks y MLflow en entornos productivos. - Conocimientos avanzados de CI/CD , automatización y promoción ...
... this?As the Senior AI & ML Engineer, you are the technical backbone of the end-to-end machine learning lifecycle. You’ll sit right at the core of the digital and data team, applying deep engineering rigor to build and scale reliable systems that solve real-world R&D challenges. Your main mission is to make sure complex AI concepts ...
... years of experience in developing data processing and analytics https://jobeax.com/link/5WM6jVJPxXxkaX5M ideal candidate will have strong expertise in Python and Databricks, as well as experience working with large-scale data environments, database management, and data transformation https://jobeax.com/link/2rayNmuFHnqVcmrD ...
About the profile We’re looking for a Data Engineering Team Lead to join our growing Data and AI Engineering practice - a role designed for someone who thrives at the intersection of technical excellence and people leadership. This is not about being the most senior engineer in the room; it’s about being the person who ...
About the role Trinetix is looking for a skilled Databricks Developer with strong expertise in Apache Spark, Python, and modern data engineering practices. This role involves designing, developing, and maintaining scalable data ingestion, transformation, and analytics pipelines using Databricks and related technologies. ...
Buscamos un/a Technical Manager – Data Architecture & AI (Databricks) Gestionamos una interesante oportunidad para incorporar un perfil senior con experiencia en liderazgo técnico, arquitectura de datos e Inteligencia Artificial sobre entornos Databricks. Buscamos una persona capaz de combinar la gestión de equipos multidisciplinares ...
... datos. ¿Qué buscamos? - Mínimo 3 años de experiencia desarrollando con Python y Databricks . - Sólidos conocimientos de Python . - Experiencia demostrable con Databricks . - Conocimientos de Inteligencia Artificial aplicada a datos . - Experiencia con Oracle Exadata, S3 y PL/SQL . - Experiencia imprescindible con Control-M ...
... this role, you will design and implement data models, reporting solutions and integrations leveraging SAP Datasphere and SAP Analytics Cloud (SAC) to enable data-driven decision-making across the enterprise. You will also work with modern data platforms such as Databricks for advanced analytics and engineering while ensuring ...
... data and digital solutions in support of Roche's vision. As a Senior Data Engineer at Roche PT, you will play a pivotal role in developing and optimizing the data infrastructure that powers our pharmaceutical operations and data products. Working in multidisciplinary teams-alongside data scientists, subject matter experts, ...
About the role The Knot Worldwide's Data team is looking for a highly motivated, highly energetic team-player with a strong analytical mindset to join as a Senior Data Engineer supporting end-to-end data pipelines for our business. A top priority for the company this year is to establish a robust data foundation to power ...
MindMatch is seeking a Senior Data Engineer (Metadata & Lineage Integration) to architect and implement data foundations enabling AI adoption. You will design catalogues, semantic and analytical layers to convert large on‑premise estates into agent‑usable data, with a focus on security, governance and scalable pipelines. ...
En Qaracter buscamos un/a Fullstack Developer - Databricks para incorporarse a un proyecto estratégico dentro del sector financiero, participando en el diseño, desarrollo y optimización de soluciones avanzadas de tratamiento, explotación y análisis de grandes volúmenes de datos. Formarás parte de un entorno tecnológico ...
... performance across all their IT functions. To continue growing, we are looking for Data Engineering and Analytics profiles who want to participate in strategic data projects in cutting-edge cloud environments. What you'll do - Design and evolve data architectures in Microsoft Fabric / Azure (Data Lake, pipelines, notebooks, ...
... understanding of the Modern Data Stack and experience with cloud environments such as AWS, Azure or GCP . - Experience with technologies such as dbt, Snowflake, Databricks, BigQuery and/or Microsoft Fabric . - A strong DataOps mindset , applying software engineering best practices to data environments. - Ability to combine ...
... understanding of the Modern Data Stack and experience with cloud environments such as AWS, Azure or GCP . - Experience with technologies such as dbt, Snowflake, Databricks, BigQuery and/or Microsoft Fabric . - A strong DataOps mindset , applying software engineering best practices to data environments. - Ability to combine ...
... possible without our Data team and we are seeking a Senior Data Engineer to join our Data Platform team! Our mission is to develop maintain and improve Ebury's Data Platform with a focus on building scalable, robust, and innovative frameworks. As a Senior Data Platform Engineer, you will work closely with the rest of the ...