Contract Length – 2 months (with possible extension)
Contract type – Freelance
Project focus
Our FinTech client is moving its existing on-premise ETL workloads to the cloud. You will rebuild and migrate these jobs into a secure, well-documented cloud solution, with proper orchestration, scheduling and logging in place, in a regulated environment where documentation may be used as audit evidence.
Key skills and Experience required
Proven experience migrating on-premise ETL jobs to a cloud platform
Workflow orchestration and scheduling with Airflow (dbt also beneficial)
Strong SQL skills
Security-conscious approach, including solid logging and monitoring practices
Fluent Italian
Nice to have: background in compliance-driven or regulated environments, and experience producing documentation used as audit evidence
Data Engineer - Málaga | KRELL Consulting Buscamos incorporar un/a Data Engineer para participar en un proyecto de integración de plataformas, trabajando en el desarrollo y mantenimiento de soluciones de datos escalables y eficientes. Buscamos un perfil con experiencia en Python, Spark y Apache Airflow, valorándose especialmente ...
What you’ll do - Build the data-serving layer: curated datasets, marts, and product-ready tables - Develop incremental / micro-batch pipelines and support CDC near-real-time ingestion (AWS DMS) - Design BI-friendly data models (star schema) and manage schemas - Build ETL/ELT in Python (Polars) and serve/query via Athena ...
... are: - Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service. - Implement data transformation and quality to ensure data consistency and accuracy. Utilize programming languages such as Scala and SQL and tools like Spark for data transformation ...
Overview Importante consultora en tecnología busca un Data Engineer con mínimo 3 años de experiencia como desarrollador y mínimo 1 año de experiencia trabajando en proyectos de Big Data. Requisitos técnicos - Experiencia con las tecnologías Spark, YARN, Hadoop, Hive. - Experiencia con bases de datos relacionales (MySQL). ...
... the team alongside you, and grow into more of the platform as you go. You'll also ship with agentic AI tools as a real part of how we work — this is AI-native data engineering. If you like owning data end to end, from a Pub/Sub event to a Looker explore, and want scale you can't get just anywhere (hundreds of millions of ...
We are looking for an experienced Data Engineer with a strong technical background in data engineering, data architecture, and data pipeline development. The successful candidate will work within an Agile team to design, develop, test, and deploy data solutions that meet business requirements while adhering to the client's ...
... capacidades: - Experiencia mínima de 3 años como Data Engineer o en roles similares. - Conocimiento sólido del ecosistema de datos Microsoft Azure y Microsoft Fabric: Data Factory, Synapse, Databricks, Fabric (Lakehouse/Warehouse), Power BI y Purview. - Experiencia con servicios de almacenamiento en Azure: Data Lake Storage Gen2, ...
... cloud-based data services (AWS, Azure, or GCP). - Solid understanding of Data Lakes, Data Warehouses, and modern data architectures. - Experience with Python data engineering and analytics libraries, such as Pandas, NumPy, and PySpark and Spark. - Hands-on experience with Databricks, including data engineering, analytics, ...
... importance of our data is growing fast, and we're looking for a Data Engineer to build the infrastructure that keeps up. Your profile You'll design and build the data infrastructure that carries Bookboost from hundreds of gigabytes to terabytes of guest data, moving, transforming and making it available to our frontend application ...