Cargando descripción…

Senior Data Engineer (Metadata & Lineage Integration) en… - Jobeax

Senior Data Engineer (Metadata & Lineage Integration) en Cequelinos, España is listed on Jobeax. Browse 80,000+ vacancies available.

Senior Data Engineer (Metadata & Lineage Integration)

Location: Remote from Spain (an indefinite Spanish employment contract)

Our client is a leading global investment management company headquartered in London. It manages over $228 billion in assets and serves institutional investors, pension funds, wealth managers, and other sophisticated clients worldwide. The firm specializes in quantitative investing, alternative investments, systematic trading strategies, and technology-driven asset management. Data science, machine learning, and AI are core components of its investment and research processes.

As part of our collaboration we will focus on two foundational capabilities required to enable safe and scalable AI adoption across the enterprise: Agentic Security and AI-Ready Data Foundations.

We build the data foundations that make AI useful and safe inside regulated financial firms. The value of AI is capped by the data its agents can reach: if an agent cannot find, interpret, trace or be correctly permissioned against data, the capability is useless, or worse, unsafe. Your job is to close that gap.

This is a hands-on senior role for an excellent Python engineer with strong data-engineering skills who is genuinely comfortable building with AI agents. You will design and build the catalogue, semantic, entitlement and analytical layers that turn large on-premise data estates into something agents can use.

Requirements:

5+ years building production data systems in Python, with strong engineering fundamentals (testing, code review, performance) and solid SQL.
Experience building crawlers, harvesters or connector frameworks that extract inventories, schemas, field dictionaries and lineage from databases, filesystems, message platforms and API surfaces, in addition to conventional data pipelines.
Event-driven integration with Kafka or similar, including secure producer patterns (mTLS or equivalent) and schema-managed topics.
Experience with search and document stores that back catalogue platforms (e.g. Elasticsearch, OpenSearch, MongoDB or similar).
Working knowledge of lineage capture and modelling, with OpenLineage or similar as a reference, and readiness to work with proprietary in-house event models.
Experience applying LLMs to metadata work, such as drafting descriptions and classifications for human review, including quality evaluation of the generated output.
Readiness to work inside another team's codebase, complete components that the team has designed, and contribute through its review process.
Fluent English for written and spoken communication with client teams.

Will be a plus

Time-series and tick stores (e.g. kdb+ or similar columnar time-series databases), market-data vendor schema APIs, symbology and asset-class concepts (market-data opening).
MS SQL Server estates, reporting and BI systems, inventory extraction from application metadata tables (reporting opening).
Columnar and lake formats (Parquet or similar), large object stores, orchestration platforms (Airflow or similar).
Working-level knowledge of graph databases; data contracts and data quality frameworks; catalogue platforms (DataHub or similar) on the ingestion side.
Day-to-day use of AI coding agents; building data services consumed by AI agents.
Experience in financial services or other regulated on-premise environments.

Responsibilities:

Build extraction, enrichment and registration paths that populate domain catalogues from live estates (databases, time-series stores, streaming platforms, filesystems, internal and vendor APIs) and connect them to the client's central catalogue through its existing mechanisms.
Extend an existing scraping capability from bare dataset and symbol inventories to full metadata: descriptions, field-level dictionaries, date ranges, asset-class and cadence tags, vendor provenance.
Load vendor schema metadata at scale, through vendor APIs, into a persistent internal knowledge base designed for step-by-step disclosure to humans and LLMs.
Seed report and dataset inventories from existing application metadata tables and ETL sources; combine them with LLM-drafted descriptions approved by stewards.
Integrate lineage into the client's lineage backend across batch, streaming and cross-system report chains, completing the client's existing registration designs.
Implement the federation contract defined by the architect: stable identities, ownership, hierarchy, links and availability state exposed by each local catalogue to the central layer.
Keep metadata current through scheduled and event-driven refresh, with explicit staleness detection and quality signals.

Why this position:

This role sits at the intersection of data engineering, AI, and financial services, solving one of the most important challenges in enterprise AI: enabling agents to securely access and reason over trusted data. You'll have the opportunity to design and build foundational platforms that combine large-scale data systems, governance, and AI technologies in highly regulated environments. It offers significant technical ownership, exposure to cutting-edge AI agent architectures, and the chance to shape how organisations safely unlock value from their data.

Postularse a la vacante

Vacantes similares

Más como este puesto

MindMatch

Senior Data Engineer (Data Governance)

Hace 8 días

MindMatch is seeking a Senior Data Engineer (Metadata & Lineage Integration) to architect and implement data foundations enabling AI adoption. You will design catalogues, semantic and analytical layers to convert large on‑premise estates into agent‑usable data, with a focus on security, governance and scalable pipelines. ...

Spain, León

Hays

Functional Collibra Software Engineer_ ENGLISH- REMOTE

Hace 8 días

Remoto
Híbrido
Presencial
Contrato

... and development teams to gather requirements and translate them into scalable platform configurations. - Configure and manage Collibra capabilities including Data Catalog, Data Lineage, Data Notebook, Data Products, metadata management, and governance workflows. - Support metadata governance initiatives, ensuring data assets ...

Spain

Hays

Functional Collibra Software Engineer_ ENGLISH- REMOTE

Hace 8 días

Remoto
Híbrido
Presencial
Contrato

Spain

Hays

Functional Collibra Software Engineer_ ENGLISH- REMOTE

Hace 8 días

Remoto
Híbrido
Presencial
Contrato

Spain

Hays

Functional Collibra Software Engineer_ ENGLISH- REMOTE

Hace 9 días

Remoto
Híbrido
Presencial
Contrato

Spain, Cequelinos

Hays

Functional Collibra Software Engineer_ ENGLISH- REMOTE

Hace 9 días

Remoto
Híbrido
Presencial
Contrato

... architects, and development teams to gather requirements and translate them into scalable platform configurations. Configure and manage Collibra capabilities including Data Catalog, Data Lineage, Data Notebook, Data Products, metadata management, and governance workflows. Support metadata governance initiatives, ensuring data assets ...

Spain, Esteiro

Senior AI Data Engineer, Data Products & RAG Foundations

Hace 8 días

Híbrido
Tiempo completo

Full-time hours

... andmaintainAI-readydata products and pipelinesforthe pod's use case,ensuringappropriate governance,lineage, metadata, access controls, and documentation from the start. - Designdata products for reuse, treating every asset as a potential enterprise capability rather thanapointintegration. - Establishdata qualitystandards,quality scoring, ...

Spain

Johnson & Johnson

Sr Manager, IMSC Information Architecture Make/Quality

Hace 14 días

Remoto
Tiempo completo

... master data, transactional data, operational data, and analytics consumption layers. - Strong understanding of how information architecture enables AI-ready data, including semantic consistency, contextual connectivity, metadata completeness, lineage, data ownership, and governed reuse. - Experience working with data catalogues, ...

Spain, Madrid

Johnson & Johnson

Sr Manager, Information Architecture Plan & Source

Hace 1 día

Híbrido
Tiempo completo

Spain, Madrid

Johnson & Johnson

Sr Manager Information Architecture IMSC, Deliver

Hace 1 día

Remoto
Tiempo completo

Spain, Madrid

SQL Senior Data Engineer (Hybrid - Madrid)

Hace 8 días

Remoto
Híbrido
Presencial

Have the right to work in Spain

... enhance enterprise data models, including Data Vault, dimensional models, SCD, and 3NF structures. - Ensure SQL code is performant, maintainable, and aligned with data architecture standards. - Implement data quality controls, testing frameworks, and validation rules. - Maintain documentation, data lineage, and metadata management ...

Spain

Senior Data Engineer

Hace 6 días

Tiempo completo

Full-time hours

... data and digital solutions in support of Roche's vision. As a Senior Data Engineer at Roche PT, you will play a pivotal role in developing and optimizing the data infrastructure that powers our pharmaceutical operations and data products. Working in multidisciplinary teams-alongside data scientists, subject matter experts, ...

Spain

Senior Data Engineer

Hace 6 días

Tiempo completo

Full-time hours

... Proactively identify data quality, performance, and modelling issues and drive improvements before they become business problems - Contribute to architecture and engineering decisions within your domain, balancing speed, quality, and long-term maintainability - Mentor less senior data engineers through code reviews, design discussions, ...

Spain

Senior Data Engineer

Hace 8 días

Remoto
Tiempo completo

Full-time hours

... with BI & Data Teams: Work closely with BI and data teams to support efficient data models and reporting solutions. • Data Governance & Security Basics: Support data governance requirements such as access control, secure data handling, and basic metadata management. What You Bring • Azure Data Platform Experience: Several ...

Spain

Senior Data Engineer

Hace 8 días

Híbrido
Presencial
Contrato

Hybrid

... orchestration (Airbyte & Airflow) is a plus - Solid understanding of modern data engineering and architecture concepts and practices . This includes knowledge of data warehousing, data pipelines, data marts, semantic layers like Cube, and data integration techniques and tools mostly in cloud infrastructure. - Marketing Domain ...

Spain

Senior Data Engineer

Hace 8 días

Remoto
Híbrido
Presencial
Tiempo completo

Full-time hours

... you better Start the process! We will guide you through the different phases until your incorporation. Tech Stack - Data platforms and services : Snowflake, Databricks, Cloudera Data Services. - Cloud services : Azure, AWS, GCP (including Fabric, Glue, Redshift, Dataproc, BigQuery). - Integration and deployment tools : ...

Spain

Intellias

Senior AI/RAG Engineer (Document Intelligence)

Hace 14 días

Remoto
Híbrido
Presencial
Contrato

... a plus - Integration with SharePoint and Microsoft Graph APIs or an equivalent enterprise content platform: change notifications, delta polling, permission metadata. - Bitemporal modelling (execution versus effective dates, as-of queries) and document lineage or supersession modelling. - Graph engines (e.g. Apache AGE, ...

Spain

Michael Page España

Data Engineer (GCP & BigQuery)

Hace 14 días

Remoto
Híbrido
Contrato

... practices in security, traceability, metadata, and data governance. - Documenting pipelines, models, dependencies, and operational procedures. - Collaborating with Data Factory, Consumer Data, Digital Analytics, AI Engineering, and Integration Engineering teams. - Participating in code reviews, technical design, and definition ...

Spain, Barcelona

Capitole

Senior Data Engineer

Hace 2 días

€1200 EUR / year

En CAPITOLE, ¡seguimos creciendo y queremos hacerlo contigo! Descripción del puesto Estamos buscando un/a Senior Data Engineer para unirse a un proyecto donde diseñarás y evolucionarás una plataforma de datos moderna que soporta analítica avanzada, modelos de Machine Learning y sistemas de decisión en tiempo casi real. ...

Spain

Senior Data Engineer - Platform

Hace 6 días

Híbrido
Presencial

Have the right to work in Spain

... possible without our Data team and we are seeking a Senior Data Engineer to join our Data Platform team! Our mission is to develop maintain and improve Ebury's Data Platform with a focus on building scalable, robust, and innovative frameworks. As a Senior Data Platform Engineer, you will work closely with the rest of the ...

Spain