Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://jobeax.com/link/8XcmRrwPXUDcd45b) and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.
What We Do
The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.
About the Role
This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing tools such as Apify, OpenRouter, and other technologies, alongside your own technical expertise and approaches.
Key Responsibilities
Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
Leverage available tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirement.
Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior.
Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Educational qualifications
At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required).
Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
Academic and/or Professional Experience
Candidates should have a strong technical foundation and practical experience with scripting, automation, and data extraction workflows. We are looking for specialists who can solve non-trivial problems, work confidently with modern development tools and technologies, and systematically collect, structure, and validate data from diverse sources. A methodical, detail-oriented approach and the ability to work independently are essential.
Technical Skills (Essential)
Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
Additional requirements
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
Strong attention to detail and commitment to data accuracy
Self-directed work ethic with ability to troubleshoot independently
A link to GitHub is a plus
English proficiency: Upper-intermediate (B2) or above (required)
Project time expectations
For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
Compensation
On this project, contributors can earn up to $40 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
Aktios Spain is looking for a Senior Data Scientist to enhance predictive maintenance in aviation through machine learning solutions. The ideal candidate will develop ML solutions, mentor junior scientists, and collaborate with stakeholders. Candidates should possess strong skills in Python, XGBoost, and machine learning ...
... product, business, and platform teams, leveraging analysis, experimentation, causal inference, and machine learning for decision-making. What Will You Do? As a Senior Data Scientist at Preply, you will collaborate with performance marketing teams on data solutions for optimizing campaigns and budgets. You will roll out Marketing ...
Johnson & Johnson Innovative Medicine is seeking a Senior Data Scientist to advance the Biologics Discovery program. You will design featurization, build model-ready datasets, and develop ML solutions that guide molecule design and evaluation. This role collaborates across ISD and in silico discovery, ensuring reproducible ...
Recodme busca un Data Scientist / Machine Learning Senior para el Squad de Producto dentro del área de Advanced Analytics en Barcelona. Se valorará experiencia en forecasting de demanda, series temporales y visión por ordenador, con capacidad de trabajar en proyectos transversales para negocio. Se requieren 5–7 años en ...
AgileEngine is seeking a Senior Data Scientist to develop predictive models and analytics powering risk-based vulnerability prioritization within a large-scale enterprise security program. You will structure and analyze massive security telemetry datasets, build ML algorithms to reduce false positives, and establish unified ...
... remains aligned with client and program needs Who You Are: - Senior and hands-on, with strong ownership of both execution and quality - Deeply comfortable with data engineering and pipelines, analytical logic, and metric design - Strong SQL, Python, spark and strong coding skills for data processing and workflowdevelopment ...
Garaje de ideas busca un Senior Data Scientist / ML & GenAI Specialist con al menos 5 años de experiencia para transformar datos en soluciones de negocio. Trabajarás en ML avanzado, GenAI, NLP/NLU y desplegarás modelos en entornos cloud. Se requiere dominio de Python/SQL, frameworks como TensorFlow o PyTorch y experiencia ...
ALBA, located in Cerdanyola del Vallès near Barcelona, invites applications for a data analysis pipelines engineer in the Methodology Group. You will design end-to-end pipelines for multimodal experimental data, automate workflows, and deploy solutions across local servers, clusters and cloud computing resources. The role ...
Dow Jones is seeking a Principal Product Designer for Market Data to own the design strategy across The Wall Street Journal, Barron's, MarketWatch, and Investor's Business Daily. You will shape patterns for quotes, charts, tables, portfolios, and alerts, ensuring clarity and a seamless user experience across all brands. ...
... digital transformation with the ambition to become the most digitally empowered company on the planet. Within our Data, Analytics & AI organization, we turn data into decisions and ideas into impact through modern technologies, trusted insights, and responsible AI solutions. As Senior Manager - Data & AI Stewards Community, ...
Description Amazon Web Services (AWS) is seeking a Senior Architect to join its Data Centre Design Team in Dublin, Ireland. Description Amazon Web Services (AWS) is seeking a Senior Architect to join its Data Centre Design Team in Dublin, Ireland. As a Senior Architect at AWS, you will lead designs for AWS Data Centres ...
... changes/new initiatives to management using insights derived from data. - Use your technical skills such as actively engaging in configuration and programming in the data environment, querying data via SQL from the data lake, automating data processes, deep dive analysis in Python and adjusting ETL tasks. - Bringing new insights ...
... an experienced backend/infra engineer to own the automated pipelines from threat intelligence to deployed protections. You will design scalable, multi-stage data pipelines with strong observability, reliability, and guardrails across a large fleet of systems. The role emphasizes deep expertise in Python/Go/Rust, CI/CD, ...
... closely together at the company, and engineers benefit from understanding both worlds. Someone who comes in strong on backend will be supported in growing into data engineering over time. Backend Engineering Design, build and maintain scalable backend services using Python. Develop new product features and reusable backend ...
Ayesa Digital busca un Data Scientist / Machine Learning Engineer para unirse a su equipo y participar en el ciclo completo del dato, desde la extracción hasta la explotación analítica en entornos productivos. El rol requiere experiencia en ML, MLflow, Python y SQL avanzados, además de experiencia con herramientas de procesamiento ...
ZRG Careers is seeking a hands-on Solution Engineer to drive revenue with customers across cloud, data, AI, geospatial, APIs, and integrations. You will tailor reference solutions, run PoCs, and lead the technical sales path with executives and engineers. The role requires 7+ years in enterprise tech, deep Python/SQL skills, ...
Jobtailor in Madrid, Spain, seeks a senior Data Scientist specializing in LLMs to lead analytical projects and build AI-driven banking solutions. You will guide teams, collaborate with product, engineers, and designers, and translate complex data into strategic recommendations. Ideal candidates have 5+ years in data science, ...
... turn Sateliot’s network data into tools our internal teams rely on every day, from device status and tracking to session and satellite pass management. As a Senior Full Stack Engineer, you’ll own features from design to production across a Laravel (PHP) and Python codebase, set the bar for quality in a small team, and partner ...
Una AI startup dentro de una scale-up global (automatización de ventas con IA, 22.000+ empresas cliente en la plataforma matriz) busca un/a Senior Backend Engineer en Python para incorporarse a su unidad de producto como un miembro más del equipo. Startup mentality + scale-up safety. ⚡ Sobre el rol Un/a senior Python que ...
Ayesa Digital busca un Data Scientist / Machine Learning Engineer para unirse a un proyecto tecnológico donde participarás en todo el ciclo de vida del dato y en el diseño, entrenamiento e implementación de ML en entornos productivos. Se valorarán 3–5 años de experiencia, dominio de Python y SQL, y experiencia con PySpark ...