Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://jobeax.com/link/8XcmRrwPXUDcd45b) and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.
What We Do
The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.
About the Role
This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing tools such as Apify, OpenRouter, and other technologies, alongside your own technical expertise and approaches.
Key Responsibilities
Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
Leverage available tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirement.
Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior.
Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Educational qualifications
At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required).
Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
Academic and/or Professional Experience
Candidates should have a strong technical foundation and practical experience with scripting, automation, and data extraction workflows. We are looking for specialists who can solve non-trivial problems, work confidently with modern development tools and technologies, and systematically collect, structure, and validate data from diverse sources. A methodical, detail-oriented approach and the ability to work independently are essential.
Technical Skills (Essential)
Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
Additional requirements
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
Strong attention to detail and commitment to data accuracy
Self-directed work ethic with ability to troubleshoot independently
A link to GitHub is a plus
English proficiency: Upper-intermediate (B2) or above (required)
Project time expectations
For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
Compensation
On this project, contributors can earn up to $40 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
... closely together at the company, and engineers benefit from understanding both worlds. Someone who comes in strong on backend will be supported in growing into data engineering over time. Backend Engineering Design, build and maintain scalable backend services using Python. Develop new product features and reusable backend ...
Ayesa Digital busca un Data Scientist / Machine Learning Engineer para unirse a su equipo y participar en el ciclo completo del dato, desde la extracción hasta la explotación analítica en entornos productivos. El rol requiere experiencia en ML, MLflow, Python y SQL avanzados, además de experiencia con herramientas de procesamiento ...
ZRG Careers is seeking a hands-on Solution Engineer to drive revenue with customers across cloud, data, AI, geospatial, APIs, and integrations. You will tailor reference solutions, run PoCs, and lead the technical sales path with executives and engineers. The role requires 7+ years in enterprise tech, deep Python/SQL skills, ...
Jobtailor in Madrid, Spain, seeks a senior Data Scientist specializing in LLMs to lead analytical projects and build AI-driven banking solutions. You will guide teams, collaborate with product, engineers, and designers, and translate complex data into strategic recommendations. Ideal candidates have 5+ years in data science, ...
... turn Sateliot’s network data into tools our internal teams rely on every day, from device status and tracking to session and satellite pass management. As a Senior Full Stack Engineer, you’ll own features from design to production across a Laravel (PHP) and Python codebase, set the bar for quality in a small team, and partner ...
Una AI startup dentro de una scale-up global (automatización de ventas con IA, 22.000+ empresas cliente en la plataforma matriz) busca un/a Senior Backend Engineer en Python para incorporarse a su unidad de producto como un miembro más del equipo. Startup mentality + scale-up safety. ⚡ Sobre el rol Un/a senior Python que ...
Ayesa Digital busca un Data Scientist / Machine Learning Engineer para unirse a un proyecto tecnológico donde participarás en todo el ciclo de vida del dato y en el diseño, entrenamiento e implementación de ML en entornos productivos. Se valorarán 3–5 años de experiencia, dominio de Python y SQL, y experiencia con PySpark ...
Dow Jones is seeking an AI Engineer/Solutions Specialist to design, implement, and maintain AI solutions that automate workflows and enhance reporting. You will build ML models, leverage NLP techniques, and create robust data pipelines in Python, SQL, and cloud services. You will collaborate with product and engineering ...
Wipro Limited in Madrid is seeking a seasoned Test Automation Engineer to develop multi-module test cases and set up robust test environments, ensuring tested functionality across complex systems. You will analyze requirements, create test data, execute functional and regression tests, document results, and maintain test ...
... closely together at the company, and engineers benefit from understanding both worlds. Someone who comes in strong on backend will be supported in growing into data engineering over time. Backend Engineering Design, build and maintain scalable backend services using Python. Develop new product features and reusable backend ...
Traveltechessentialist in Barcelona is seeking a Machine Learning Software Engineer to connect complex data pipelines with user-facing software. The ideal candidate will have a robust background in software development, particularly in Python, PostgreSQL, FastAPI, and AWS services. This role offers full-time hours in a ...
DTN Spain seeks a Software Engineer to design, develop, and maintain enterprise software with RESTful APIs and web interfaces. You will work in a cross-functional team, building scalable systems in Dockerized environments and contributing to GIS-enabled data pipelines. Requirements include a CS/IT degree or equivalent, ...
eDreams ODIGEO in Barcelona seeks a Senior Data Scientist to advance AI-powered solutions across fraud detection, recommendation engines, and personalized experiences. You will work with massive datasets, explore cutting-edge ML models, and mentor junior data scientists in a hybrid work setup. We value strong Python and ...
https://jobeax.com/link/CceYJvH61YMJlyJs is seeking a Frontend Engineer to join our fast-moving product teams in Barcelona. You will build and improve applications that transform the vehicle buying and selling experience, working closely with multidisciplinary teams across Product, UX, Data, and Backend. This role emphasizes ...
... cambios, despliegues y mantenimiento preventivo • Gestionar activos físicos del CPD (inventario, hardware, lifecycle) • Participar y coordinar proyectos dentro del Data Center • Colaborar con equipos técnicos y proveedores • Asegurar la continuidad y seguridad de los sistemas Conocimientos específicos necesarios: • Grado en Ingeniería ...
Ookla, an Accenture company, seeks a Software Engineer to join a squad-focused team building next-generation data visualization platforms. You’ll develop scalable web applications with React, Redux Toolkit, and Vite, collaborating with cross-functional teams to deliver features for enterprise products that visualize data ...
Descripción del puesto / Funciones Buscamos un/a Data Integration Platform Engineer Expert para incorporarse a un entorno internacional, participando en iniciativas de automatización, mejora continua, capacidad y estabilidad de plataformas de integración. Funciones: - Diseñar y desarrollar soluciones de automatización para ...
DigiHunting busca un/a APPS Developer para unirse a una empresa tecnológica especializada en Data Intelligence, con cliente final en gran consumo. La posición es en Sant Cugat del Vallès o Manresa, con modalidad híbrida: 3-4 días presenciales. El contrato es indefinido directamente con la compañía. Participarás en el diseño ...
Astrafy is seeking a data-focused engineer to design and maintain scalable data pipelines in Google Cloud, using Airflow, dbt, BigQuery, Pub/Sub, and Snowflake. You will contribute across business and technical use cases, delivering reliable ingestion, transformation, and analytics. You will collaborate with cross-functional ...
Fujitsu busca un Data - Presales Engineer para liderar proyectos de datos y ML, con experiencia en consultoría y diseño de soluciones en entornos de nube. Se valoran capacidades analíticas, gestión de proyectos y trabajo en equipo en un marco operacional orientado a resultados. La persona formada en ingeniería con experiencia ...