Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://jobeax.com/link/8XcmRrwPXUDcd45b) and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.
What We Do
The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.
About the Role
This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing tools such as Apify, OpenRouter, and other technologies, alongside your own technical expertise and approaches.
Key Responsibilities
Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
Leverage available tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirement.
Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior.
Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Educational qualifications
At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required).
Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
Academic and/or Professional Experience
Candidates should have a strong technical foundation and practical experience with scripting, automation, and data extraction workflows. We are looking for specialists who can solve non-trivial problems, work confidently with modern development tools and technologies, and systematically collect, structure, and validate data from diverse sources. A methodical, detail-oriented approach and the ability to work independently are essential.
Technical Skills (Essential)
Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
Additional requirements
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
Strong attention to detail and commitment to data accuracy
Self-directed work ethic with ability to troubleshoot independently
A link to GitHub is a plus
English proficiency: Upper-intermediate (B2) or above (required)
Project time expectations
For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
Compensation
On this project, contributors can earn up to $40 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
... estrecha colaboración con nuestros clientes, desafiamos los límites para ayudarles a alcanzar todo su potencial. Actualmente tenemos un puesto vacante para Senior Python Developer que quiera unirse a GFT. Buscamos una persona entusiasta y dinámica con interés en seguir desarrollándose profesionalmente en un entorno multicultural, ...
Actualmente tenemos un puesto vacante para Senior Python Developer que quiera unirse a GFT. Buscamos una persona entusiasta y dinámica con interés en seguir desarrollándose profesionalmente en un entorno multicultural, motivador y desafiante. Tus principales responsabilidades serán: - Diseñar y desarrollar aplicaciones ...
... promociones exclusivas para nuestros empleados (másteres y posgrados, sellos editoriales, coleccionables, Casa del Libro…). - Experiencia mínima de 3 años como Data Scientist en proyectos reales. - Nivel avanzado en Python, incluyendo el uso de bibliotecas como Pandas, NumPy, Scikit-learn, Matplotlib y Seaborn. - Nivel intermedio ...
Capgemini Engineering busca un Data Scientist para trabajar en un proyecto del sector aeronáutico. Se enfocará en el análisis de datos de sensores de aeronaves y en el desarrollo de modelos predictivos para optimizar el mantenimiento. Se valorará experiencia en sistemas industriales y/o proyectos aeronáuticos. Formación ...
... for data minimization, secure handling, encryption, and least privilege access. Requirements What we're looking for - Bachelor's degree in Computer Science, Data Science, Engineering, Information Security, or related field (or equivalent experience). - Proven experience in leading data analytics teams and projects, with ...
The Bayer CropScience Limited Senior Data Scientist/Engineer will lead end-to-end data science initiatives across Veg PS digital landscape. You will partner with crop and digital enablement teams to build ML solutions, cloud pipelines, and APIs that deliver enterprise dashboards and data products. You will mentor team members ...
... software developer to join our Madrid team. You will develop and operate production suites supporting ocean monitoring and forecasting, with a primary focus on data stewardship for in-situ observations using EMODNET and Copernicus Marine data sources. You will also assist with the integration of regional forecast products ...
¡Forma parte del futuro de Paradigma! Buscamos un Senior Data Engineer para participar en un proyecto de nuestro área de Data con experiencia en mantenimiento, optimización, integración , gestión del ciclo de vida y calidad del dato basado en cloud. ¿Que buscamos? Buscamos un Data Engineer Senior con experiencia en construcción ...
... Iberia busca un/a Senior Data Engineer Databricks para unirse al equipo, con experiencia en ETL/ELT y arquitecturas modernas de datos. Trabajarás en entornos Data Lake, Lakehouse y Data Warehouse, asegurando calidad y trazabilidad en colaboración con BI y ciencia de datos. Se valorará dominio de Databricks, Python, SQL ...
... Apostamos por el talento, la excelencia técnica y la colaboración, ofreciendo un entorno profesional, flexible y con proyección de futuro. Buscamos incorporar un/a Senior Data Engineer con experiencia de al menos 3 años en el desarrollo de soluciones de datos sobre Google Cloud Platform, capaz de diseñar e implementar pipelines ...
... Minería de Datos y Aprendizaje Automático con conocimiento de herramientas como Pandas, Statsmodels, Scikit-learn, Tensorflow o bibliotecas de visualización en Python; - Conocimiento de tecnologías Big Data como Hadoop, MapReduce, Spark; - Conocimiento de scripts de Web Scraping utilizando Python; - Conocimiento de tecnologías ...
Capgemini Engineering busca un Data Scientist Junior para un proyecto aeronáutico con Boeing en Madrid, en modalidad híbrida. Se valoran sólidos fundamentos en matemáticas/estadística e informática, y experiencia con Python, Spark/PySpark y SQL. El rol implica análisis de datos, desarrollo de modelos y visualización para ...
... for you to learn, experiment, and evolve within an environment where teamwork and support from more senior colleagues are key. What You Will Bring - Software Engineering background with an interest in SaaS platforms and enterprise applications. - Experience with Collibra is highly desirable. Similar Data Catalog or Data Governance ...
... soluciones de IA Generativa y RAG , conectando la API de OpenAI con bases de datos vectoriales. - Automatizar procesos de extracción de datos mediante web scraping masivo y concurrente. - Gestionar la infraestructura en entornos Linux, Windows Server y Docker . - Modelar y visualizar datos clave del negocio en Power BI ...
The role Job Title: Senior Clinical Programmer I Location: Barcelona Introduction to Role The Senior Clinical Programmer I is primarily responsible for activities related to programming, dashboard development and validation of data cleaning and review listings and sophisticated programs for ongoing clinical studies. This ...
Responsibilities - Desarrollar aplicaciones utilizando Django o Falcon. - Diseñar y mantener API REST y microservicios. - Trabajar en colaboración con equipos para implementar soluciones innovadoras. - Asegurar la calidad del código a través de pruebas unitarias e integración.
About the role We are seeking a Senior Backend Python Developer to join our innovative technology team in Madrid. This is a Full-time, on-site position where you will lead the design and implementation of scalable backend systems using Python and modern frameworks. You'll work on mission-critical applications serving millions ...
GFT Technologies España busca un/a AI Engineer (Generative AI & Data Science Solutions) para unirse a su Center of Excellence https://jobeax.com/link/fIR5PvdGEztzLm9S en Madrid. Se espera liderar equipos, diseñar estrategias analíticas y guiar implementaciones de soluciones avanzadas en IA y Data Science. Requisitos: más ...
Capgemini busca un Data Engineer o Data Platform Engineer para evolucionar nuestra plataforma de datos, evaluando y optimizando Snowflake, Collibra y otras soluciones del ecosistema Data. Trabajarás junto a Arquitectura, Gobierno del Dato y Analytics para proponer soluciones innovadoras, impulsar buenas prácticas y contribuir ...
Una empresa innovadora está buscando un Ingeniero de Datos Senior para unirse a su equipo en España. El candidato ideal debe tener experiencia sólida en Python, desarrollo de APIs REST y habilidades avanzadas en SQL y modelado de datos. En este rol, participarás en el desarrollo de aplicaciones analíticas, optimizando sistemas ...