Cargando descripción…

Senior Data Engineer (Metadata & Lineage Integration) en… - Jobeax

Senior Data Engineer (Metadata & Lineage Integration) en Castro, España is listed on Jobeax. Browse 80,000+ vacancies available.

Senior Data Engineer (Metadata & Lineage Integration)

Location: Remote from Spain (an indefinite Spanish employment contract)

Our client is a leading global investment management company headquartered in London. It manages over $228 billion in assets and serves institutional investors, pension funds, wealth managers, and other sophisticated clients worldwide. The firm specializes in quantitative investing, alternative investments, systematic trading strategies, and technology-driven asset management. Data science, machine learning, and AI are core components of its investment and research processes.

As part of our collaboration we will focus on two foundational capabilities required to enable safe and scalable AI adoption across the enterprise: Agentic Security and AI-Ready Data Foundations.

We build the data foundations that make AI useful and safe inside regulated financial firms. The value of AI is capped by the data its agents can reach: if an agent cannot find, interpret, trace or be correctly permissioned against data, the capability is useless, or worse, unsafe. Your job is to close that gap.

This is a hands-on senior role for an excellent Python engineer with strong data-engineering skills who is genuinely comfortable building with AI agents. You will design and build the catalogue, semantic, entitlement and analytical layers that turn large on-premise data estates into something agents can use.

Requirements:

5+ years building production data systems in Python, with strong engineering fundamentals (testing, code review, performance) and solid SQL.
Experience building crawlers, harvesters or connector frameworks that extract inventories, schemas, field dictionaries and lineage from databases, filesystems, message platforms and API surfaces, in addition to conventional data pipelines.
Event-driven integration with Kafka or similar, including secure producer patterns (mTLS or equivalent) and schema-managed topics.
Experience with search and document stores that back catalogue platforms (e.g. Elasticsearch, OpenSearch, MongoDB or similar).
Working knowledge of lineage capture and modelling, with OpenLineage or similar as a reference, and readiness to work with proprietary in-house event models.
Experience applying LLMs to metadata work, such as drafting descriptions and classifications for human review, including quality evaluation of the generated output.
Readiness to work inside another team's codebase, complete components that the team has designed, and contribute through its review process.
Fluent English for written and spoken communication with client teams.

Will be a plus

Time-series and tick stores (e.g. kdb+ or similar columnar time-series databases), market-data vendor schema APIs, symbology and asset-class concepts (market-data opening).
MS SQL Server estates, reporting and BI systems, inventory extraction from application metadata tables (reporting opening).
Columnar and lake formats (Parquet or similar), large object stores, orchestration platforms (Airflow or similar).
Working-level knowledge of graph databases; data contracts and data quality frameworks; catalogue platforms (DataHub or similar) on the ingestion side.
Day-to-day use of AI coding agents; building data services consumed by AI agents.
Experience in financial services or other regulated on-premise environments.

Responsibilities:

Build extraction, enrichment and registration paths that populate domain catalogues from live estates (databases, time-series stores, streaming platforms, filesystems, internal and vendor APIs) and connect them to the client's central catalogue through its existing mechanisms.
Extend an existing scraping capability from bare dataset and symbol inventories to full metadata: descriptions, field-level dictionaries, date ranges, asset-class and cadence tags, vendor provenance.
Load vendor schema metadata at scale, through vendor APIs, into a persistent internal knowledge base designed for step-by-step disclosure to humans and LLMs.
Seed report and dataset inventories from existing application metadata tables and ETL sources; combine them with LLM-drafted descriptions approved by stewards.
Integrate lineage into the client's lineage backend across batch, streaming and cross-system report chains, completing the client's existing registration designs.
Implement the federation contract defined by the architect: stable identities, ownership, hierarchy, links and availability state exposed by each local catalogue to the central layer.
Keep metadata current through scheduled and event-driven refresh, with explicit staleness detection and quality signals.

Why this position:

This role sits at the intersection of data engineering, AI, and financial services, solving one of the most important challenges in enterprise AI: enabling agents to securely access and reason over trusted data. You'll have the opportunity to design and build foundational platforms that combine large-scale data systems, governance, and AI technologies in highly regulated environments. It offers significant technical ownership, exposure to cutting-edge AI agent architectures, and the chance to shape how organisations safely unlock value from their data.

Postularse a la vacante

Vacantes similares

Más como este puesto

Senior Data Integration Engineer

Hace 7 días

Híbrido
Presencial
Tiempo completo

Full-time hours

... has just arised within Airbus Defence & Space in Data Integration transversal department. As a Data Integration specialist you will take responsibility for the data integration pipelines design, implementation and deployment, between multiple data sources including Business Systems, Engineering Systems, Machines, Drones, ...

Spain

Adikteev

Senior Data Engineer

Hace 13 días

Remoto
Tiempo completo
Contrato

€80,000 - €90,000 a year

... HR Call with Claire - Senior Talent Acquisition Partner, - Technical interview with two members of our tech team, - Team fit Interview with Aldenis, VP of Engineering and Lamyaa, Engineering Team lead, - Final interview with Cédric, CTO, and Loïc, CPO. If you require accommodations at any stage of the application process, ...

Spain, Barcelona

Deloitte

Senior Data Engineer Madrid

Hace 13 días

Remoto
Híbrido
Presencial
Tiempo completo

... Engineering , Telecommunications Engineering , or related fields. Languages - Advanced (B2 or higher). Tech Stack - Data platforms and services : Snowflake, Databricks, Cloudera Data Services. - Cloud services : Azure, AWS, GCP (including Fabric, Glue, Redshift, Dataproc, BigQuery). - Integration and deployment tools : ...

Spain, Madrid

MAPFRE

Data Engineer Senior

Hace 13 días

Híbrido
Presencial

About the role At Verti Seguros, we continue to bet strongly on data, advanced analytics, and artificial intelligence as key business drivers. We are looking to bring on a Senior Data Engineer to join our Data & AI team within the Digital area, working in a multidisciplinary environment that directly supports Channels and ...

Spain, Madrid

ge vernova

Lead Fleet Reliability Data Engineer

Hace 13 días

Remoto
Tiempo completo

... historians, SCADA systems, remote-monitoring platforms, service-management systems, engineering databases, and other relevant sources. - Create reliable APIs, data services, semantic layers, and governed access patterns that enable engineering teams to use fleet data efficiently and consistently. - Maintain data lineage, ...

Spain, Barcelona

Data Engineering Lead

Hace 7 días

Híbrido
Tiempo completo

Full-time hours

... optimisation. - Data product engineering: Data contracts, semantic layers, metadata, lineage, catalogues, discoverability, interoperability and self-service. - AI engineering: LLM APIs, vector or hybrid search, RAG, prompt and model management, tool integration, evaluation and monitoring. - Analytics and visualisation: Power BI ...

Spain

European Dynamics

Senior Databricks Administrator/Architect

Hace 13 días

Remoto
Contrato

... ID (Azure AD), Role-Based Access Control (RBAC), Privileged Identity Management (PIM), data encryption, private networking, managed identities, Key Vault integration, and secure access patterns; - Establish enterprise data governance standards utilizing Unity Catalog including data lineage, data quality, metadata management, ...

Spain, Valencia

Gaming Innovation Group

Data Architect

Hace 13 días

Híbrido
Tiempo completo
Contrato

... frameworks. Databases & Data Management - Proficiency in relational and non-relational databases (SQL, NoSQL). - Strong hands-on knowledge of ETL/ELT tools, data integration, and data pipelines. - Familiarity with data governance, lineage, and metadata management. Cloud & Big Data Technologies - Experience with cloud data platforms ...

Spain, Madrid

Gaming Innovation Group

Data Architect

Hace 13 días

Híbrido
Tiempo completo
Contrato

Spain, Barcelona

Gaming Innovation Group

Data Architect

Hace 13 días

Híbrido
Tiempo completo
Contrato

Spain, Marbella

Grifols

IT Master Data Governance Manager

Hace 13 días

Híbrido
Contrato

... and data catalog tools. - Knowledge of data governance frameworks, data ownership, stewardship, data quality management, metadata management, cataloging and lineage. Experience with Microsoft Purview. - Understanding of data integration patterns, APIs, ETL/ELT, data pipelines, ERP integration and analytical data platforms. ...

Spain, Parets del Vallès

KPMG

Senior Azure Data Engineer - Data Fabric

Hace 13 días

Presencial

... performance across all their IT functions. To continue growing, we are looking for Data Engineering and Analytics profiles who want to participate in strategic data projects in cutting-edge cloud environments. What you'll do - Design and evolve data architectures in Microsoft Fabric / Azure (Data Lake, pipelines, notebooks, ...

Spain, Madrid

Intellias

Senior Azure Data Architect - Remote Work

Hace 13 días

Remoto
Contrato

Senior Data Engineer(Databricks) La descripción completa del puesto cubre todas las habilidades asociadas, la experiencia previa y cualquier cualificación que se espera que tengan los solicitantes. Location: Remote from Spain (an indefinite Spanish employment contract) We are hiring a Senior Data Engineer to join an Intellias ...

Spain, Santa Cruz de Tenerife

Johnson & Johnson

Senior Agentic Workflow Engineer, Biologics Discovery - Madrid, ES

Hace 13 días

Remoto
Híbrido
Tiempo completo

€55,400 - €87,860 a year

... with discovery scientists, AI/ML scientists, and data engineers so experimental outputs improve downstream property models and decision-making. - Help ensure data generated through agentic workflows is high-quality, traceable, interoperable, and AI-ready, with strong metadata, provenance, and lineage. - Identify and propose ...

Spain, Madrid

Michael Page España

Data Modeler

Hoy

Híbrido
Contrato

€60,000 - €70,000 a year

... architecture and end-to-end data flow analysis . - Knowledge of databases, data warehouses, data lakes, APIs and distributed architectures. - Familiarity with data modelling and governance databases, data warehouses, data lakes, APIs and distributed architectures. - Experience with SQL, metadata management, data lineage, ...

Spain, Madrid

Senior Software Engineer - Market Data

Hoy

Remoto

Fully remote

About the role As a senior software engineer, you will help build and scale the systems and services that form the foundation of Alpaca and empower millions of users who are trading billions of dollars worth of assets. The market data team is responsible for improving the overall architecture of Alpaca connected to data ...

Spain

Keepler Data Tech

Senior Data Engineer (AWS)

Hace 5 días

Remoto

39k - 46k

... proactivo/a y tirar del carro cuando te toque, es posible que Keepler sea el sitio donde deberías trabajar. ¿Te interesa? Echa un vistazo a nuestra vacante de Senior Data Engineer AWS. ¿En qué trabajarás? En la construcción de diferentes plataformas de datos dentro de la compañía, todas ellas en entornos cloud con AWS. Requisitos: ...

Spain, Zaragosa

Mimacom

Senior Data Engineer - RD1

Hace 5 días

Are you passionate about building scalable data platforms that power advanced analytics and AI solutions? We are looking for a Mid-Senior Data Engineer who thrives in modern cloud environments and enjoys designing, building, and optimizing high-performance data solutions. Mimacom is a technology company that helps organizations ...

Spain, Valencia

Senior Python Data Scraping Engineer

Hace 5 días

Remoto
Tiempo parcial
Contrato

Up to US$40 an hour

... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...

Spain

Jakala

Data Engineer Senior Consultant

Hace 7 días

Remoto
Híbrido
Presencial

3400 / year

... 3.400 profesionales en 21 países que trabajan cada día para transformar la información en decisiones y las decisiones en resultados. Actualmente buscamos un/a Data Engineer Senior Consultant. Para este rol necesitamos un/a profesional con capacidad para gestionar retos complejos, aportar criterio y actuar como referente ...

Spain, Vitoria