Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://jobeax.com/link/8XcmRrwPXUDcd45b) and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.
What We Do
The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.
About the Role
This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing tools such as Apify, OpenRouter, and other technologies, alongside your own technical expertise and approaches.
Key Responsibilities
Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
Leverage available tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirement.
Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior.
Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Educational qualifications
At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required).
Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
Academic and/or Professional Experience
Candidates should have a strong technical foundation and practical experience with scripting, automation, and data extraction workflows. We are looking for specialists who can solve non-trivial problems, work confidently with modern development tools and technologies, and systematically collect, structure, and validate data from diverse sources. A methodical, detail-oriented approach and the ability to work independently are essential.
Technical Skills (Essential)
Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
Additional requirements
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
Strong attention to detail and commitment to data accuracy
Self-directed work ethic with ability to troubleshoot independently
A link to GitHub is a plus
English proficiency: Upper-intermediate (B2) or above (required)
Project time expectations
For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
Compensation
On this project, contributors can earn up to $40 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
... allows us to achieve higher performance and drive innovation. Your tasks and responsibilities - You will collaborate with a multidisciplinary team of aerospace engineers, data scientists, and software developers to integrate and optimize third-party sensor data sources within our SSA platform . Your contributions will directly ...
JLL is seeking a skilled FIDIC Engineer to act as contract administrator and technical authority for projects governed by FIDIC forms. The role focuses on fair, impartial enforcement of contract provisions while safeguarding schedule, quality, and budget. Responsibilities include administering Red/Yellow/Silver books, assessing ...
Kollmorgen Automation AB seeks an experienced data center/network engineer to actively manage our data centers in Barcelona, Spain or Athens, Greece. A Master’s degree is required, and compensation is to be determined. Responsibilities include maintaining secure data communications, troubleshooting LAN/WAN/firewalls, and ...
Amazon Web Services is seeking an exceptional Controls Design Engineer to join the Data Center Global Services team. The role focuses on BMS and EPMS design standards across AWS data centers, driving standardization, documentation, and cost-efficient control solutions. You will serve as a single point of contact for internal ...
... opportunities as they open within our Platform Engineering team. Here you have some details on what we look for: Core requirements - Strong experience in data engineering, cloud engineering, or software development - Experience with cloud platforms (Azure preferred) and modern data infrastructure - Familiarity with data modeling, ...
... Experience building and maintaining MLOps pipelines using tools like MLflow, or Airflow. - Experience with cloud platforms (AWS, GCP, or Azure) and large-scale data processing frameworks like Spark or Dask is preferred. The role We are seeking a highly experienced and technically adept Senior Machine Learning Engineer to ...
... production readiness, runbooks, incident response, on-call practices, coding conventions, and infrastructure as code. - Create robust observability systems and data-backed insights. - Provide peer feedback, share knowledge and help others grow. - Build and improve the systems that enable Add-ons engineering to safely develop, ...
Contractor Company is looking for candidates for the position of Rotating Equipment Senior Engineer, with at least 15 years of demonstrable experience in this type of equipment in Oil & Gas, Petrochemical Projects or Power Plants. The Rotating Equipment Senior Engineer will develop activities for specify, select and follow ...
The role R&D Product Development R&D Machine Learning Scientific/Technology Johnson & Johnson Innovative Medicine is seeking a Senior ML Engineer for our Biologics Discovery Data Science team. This role builds and operates the integration, deployment, lifecycle management, and governance capabilities that enable machine ...
About the role We are seeking an experienced Senior DevOps Engineer to join our dynamic infrastructure team in Madrid. This is a hybrid position that offers flexibility and the opportunity to work with cutting-edge cloud technologies. You will be responsible for designing, implementing, and maintaining our cloud infrastructure, ...
About the role We are seeking a Senior DevOps Infrastructure Engineer to join our growing technology team in Madrid. This is a Full-time, on-site position where you will design, implement, and maintain robust cloud infrastructure solutions for our enterprise clients. You will work with cutting-edge technologies including ...
Senior DevOps Engineer Build a company's entire delivery platform from the first commit, own it outright, and never carry a pager. Both halves of that sentence are deliberate. This is a senior role and it is not a role we can hire junior into — you are the first, for a while the only, and the platform everyone else builds ...
... internacional, con nuevas líneas estratégicas vinculadas a banca embebida e inteligencia artificial aplicada a finanzas. Misión y ubicación del puesto: Buscamos un/a Senior / Staff Backend Engineer para participar en el diseño y evolución de una plataforma financiera compleja, escalable y segura. La posición puede ser híbrida en ...
About the role An opportunity for an Electrical Installation Senior Design Engineer has arisen within Airbus Defence and Space. The selected candidate will join the Electrical System Installation Design Department (Spanish perimeter) to support the development of Eurofighter future capabilities, such as P4E and LTE. The ...
... equal employment opportunity regardless of race, religion, sexual orientation, age, marital status, disability or gender identity. Please do not submit personal data revealing racial or ethnic origin, political opinions, religious or philosophical beliefs, trade union membership, data concerning your health, or data concerning ...
... Requirements - Bachelor's or Master's degree in Data Science, Computer Science, Mathematics, Statistics, or related field - Proven experience as a Machine Learning Engineer or similar role in AI solution development - Strong programming skills in Python, experience with ML libraries and deep learning frameworks (TensorFlow or PyTorch) ...
... quality - Solving complex technical issues and turning operational learnings into better systems - Using AI-assisted development tools as part of a modern engineering workflow - Collaborating with product, engineering, and customer-facing teams to deliver high-impact solutions What we are looking for - 5+ years of software ...
Spain - Barcelona Full time Job_Req_54759 Job Description Senior Machine Learning Engineer Dow Jones Barcelona-Spain About the Team Our Technology team drives the evolution of our Technology, Engineering, Data, Product and User Experience functions. With a keen focus on delivering cutting-edge solutions, we shape the digital ...
Sobre el puesto Nos complace presentar una oportunidad única para un Senior Software Engineer - Backend en nuestro equipo de desarrollo. Somos una empresa tecnológica líder en España que construye productos innovadores utilizados por cientos de miles de usuarios en toda Europa. Buscamos un ingeniero experimentado que pueda ...