Databricks Data Engineer — Spark, Python & AWS ETL Pro en Madrid, España
Ad4 Octogono
Madrid, España
AD4 Octógono está buscando un/a Databricks Data Engineer para unirse a un equipo internacional y contribuir en la ingesta, transformación y explotación de datos en soluciones basadas en Databricks. El perfil debe ser autónomo, analítico y capaz de gestionar prioridades en entornos distribuidos.
Se valorará experiencia en Spark, Python, SQL, AWS, PostgreSQL, Power BI y herramientas como GitHub, Jira/Confluence y Visual Studio; además de conocimientos en Agile/Scrum y un inglés B2/C1
... and Administration department within Investment Management for an experienced Data Engineer in cloud based database design and architecture, data pipelines, Python, Spark using Databricks technology. Individuals in this role will assist in the design, development, enhancement, and maintenance of a complex data hub that ...
Ookla is seeking a Senior Data Engineer to join the Data Engineering team and help process the world's best data on internet performance. You will develop tools and pipelines to support data scientists and analysts, using Spark, Redshift, Athena, Iceberg and Airflow in a fast-paced environment. You will collaborate across ...
Métrica España busca un Data Engineer con experiencia en entornos Big Data para diseñar y optimizar pipelines con Spark, PySpark y Azure Databricks. Trabajo 100% remoto desde España, enfocado en soluciones escalables y eficientes. Se valorará la capacidad de colaborar directamente con clientes, aplicar IA para acelerar ...
... Large‑scale/distributed data processing Data transformation and aggregation Databricks/Spark performance tuning and optimization Data quality and pipeline monitoring Cloud‑based data engineering environments Highly Desirable Experience with some of the following would be advantageous: AWS: S3, Glue ETL, Lambda, Step Functions, ECS, CloudWatch ...
... resolución de problemas, con capacidad para gestionar prioridades y colaborar con equipos distribuidos. Requisitos imprescindibles - Más de 2 años de experiencia en Data Engineering . - Experiencia con Databricks / Data Lake . - Apache Spark y Python . - SQL . - Diseño y desarrollo de procesos ETL/ELT . - Experiencia con AWS y ...
... experience in data platform engineering or data engineering in large-scale enterprise https://jobeax.com/link/hj0fhRLVXiKXhfVY have hands-on experience with Databricks (data engineering, analytics, or platform administration).You are proficient in Python and SQL, and familiar with CI/CD https://jobeax.com/link/kNnJqrMah0quujOD ...
... in data engineering, data architecture, or big data platform development. - Proficient in Python and SQL; strong expertise in distributed computing and Apache Spark (Scala experience preferred). - Proven track record building and deploying modern data platforms using Databricks (or comparable technologies) alongside at least ...
... designing Databricks-based solutions . Deep knowledge of Apache Spark, Delta Lake, Unity Catalog, and Photon . Experience with cloud platforms such as Azure, AWS, or GCP . Knowledge of cloud infrastructure, networking, storage, and IAM security. Experience designing ETL/ELT pipelines and data processing solutions. Knowledge ...
... medallion architecture, dimensional modelling and Data Vault. - Hands-on experience designing Databricks lakehouses (Unity Catalog, Delta Lake) and running them in production. Azure strongly preferred, AWS /GCP exposure is an advantage. - Experience leading data engineers and/or data modellers and setting standards others adopt. ...
... consultancy specialising in IT, Finance, HR, and Digital Technology. We are currently looking for a Databricks Data Architect to join a remote project with an approximate duration of 9 months. RESPONSIBILITIES The successful candidate will be responsible for designing and developing data products in Databricks and DBT , delivering ...