Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://jobeax.com/link/8XcmRrwPXUDcd45b) and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.
What We Do
The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.
About the Role
This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing tools such as Apify, OpenRouter, and other technologies, alongside your own technical expertise and approaches.
Key Responsibilities
Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
Leverage available tools and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirement.
Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior.
Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.
Educational qualifications
At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development (required).
Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
Academic and/or Professional Experience
Candidates should have a strong technical foundation and practical experience with scripting, automation, and data extraction workflows. We are looking for specialists who can solve non-trivial problems, work confidently with modern development tools and technologies, and systematically collect, structure, and validate data from diverse sources. A methodical, detail-oriented approach and the ability to work independently are essential.
Technical Skills (Essential)
Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
Additional requirements
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale
Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker) as part of real workflows
Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar) applied to automation tasks
Strong attention to detail and commitment to data accuracy
Self-directed work ethic with ability to troubleshoot independently
A link to GitHub is a plus
English proficiency: Upper-intermediate (B2) or above (required)
Project time expectations
For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
Compensation
On this project, contributors can earn up to $40 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
The role R&D Product Development R&D Machine Learning Scientific/Technology Johnson & Johnson Innovative Medicine is seeking a Senior ML Engineer for our Biologics Discovery Data Science team. This role builds and operates the integration, deployment, lifecycle management, and governance capabilities that enable machine ...
About the role We are seeking an experienced Senior DevOps Engineer to join our dynamic infrastructure team in Madrid. This is a hybrid position that offers flexibility and the opportunity to work with cutting-edge cloud technologies. You will be responsible for designing, implementing, and maintaining our cloud infrastructure, ...
About the role We are seeking a Senior DevOps Infrastructure Engineer to join our growing technology team in Madrid. This is a Full-time, on-site position where you will design, implement, and maintain robust cloud infrastructure solutions for our enterprise clients. You will work with cutting-edge technologies including ...
Senior DevOps Engineer Build a company's entire delivery platform from the first commit, own it outright, and never carry a pager. Both halves of that sentence are deliberate. This is a senior role and it is not a role we can hire junior into — you are the first, for a while the only, and the platform everyone else builds ...
... internacional, con nuevas líneas estratégicas vinculadas a banca embebida e inteligencia artificial aplicada a finanzas. Misión y ubicación del puesto: Buscamos un/a Senior / Staff Backend Engineer para participar en el diseño y evolución de una plataforma financiera compleja, escalable y segura. La posición puede ser híbrida en ...
About the role An opportunity for an Electrical Installation Senior Design Engineer has arisen within Airbus Defence and Space. The selected candidate will join the Electrical System Installation Design Department (Spanish perimeter) to support the development of Eurofighter future capabilities, such as P4E and LTE. The ...
... equal employment opportunity regardless of race, religion, sexual orientation, age, marital status, disability or gender identity. Please do not submit personal data revealing racial or ethnic origin, political opinions, religious or philosophical beliefs, trade union membership, data concerning your health, or data concerning ...
... Requirements - Bachelor's or Master's degree in Data Science, Computer Science, Mathematics, Statistics, or related field - Proven experience as a Machine Learning Engineer or similar role in AI solution development - Strong programming skills in Python, experience with ML libraries and deep learning frameworks (TensorFlow or PyTorch) ...
... quality - Solving complex technical issues and turning operational learnings into better systems - Using AI-assisted development tools as part of a modern engineering workflow - Collaborating with product, engineering, and customer-facing teams to deliver high-impact solutions What we are looking for - 5+ years of software ...
Spain - Barcelona Full time Job_Req_54759 Job Description Senior Machine Learning Engineer Dow Jones Barcelona-Spain About the Team Our Technology team drives the evolution of our Technology, Engineering, Data, Product and User Experience functions. With a keen focus on delivering cutting-edge solutions, we shape the digital ...
Sobre el puesto Nos complace presentar una oportunidad única para un Senior Software Engineer - Backend en nuestro equipo de desarrollo. Somos una empresa tecnológica líder en España que construye productos innovadores utilizados por cientos de miles de usuarios en toda Europa. Buscamos un ingeniero experimentado que pueda ...
... inmersa en un proceso de transformación digital, busca incorporar talento técnico para impulsar su estrategia de inteligencia artificial. El rol Incorporamos un/a Senior Backend AI Engineer para construir e integrar funcionalidades de IA en productos que ya están en producción y, cuando sea necesario, desarrollar nuevos productos ...
... personal responsibility and always do what's right for our clients, people and communities. Job Description Reporting into Director of Software Engineering, the Senior Backend Engineer will work within the Global Technology Hub from our Madrid office. We are seeking an experienced and passionate Senior Backend Engineer for ...
... inmersa en un proceso de transformación digital, busca incorporar talento técnico para impulsar su estrategia de inteligencia artificial. El rol Incorporamos un/a Senior Backend AI Engineer para construir e integrar funcionalidades de IA en productos que ya están en producción y, cuando sea necesario, desarrollar nuevos productos ...
... truly be proud of. Check our open-source projects here! What you'll do - Build features in all of Proton's products. - Close interactions with products and engineers across the company. - Build scalable software architecture through software engineering best practices. - Optimise user experience and design. Nice to have ...
... Diseño, Project Management y muchas más. Además, desarrollamos soluciones tecnológicas a medida desde nuestros BETWEEN Labs. Estamos buscando un WCS Software Engineer (WMS, WCS..) para ampliar uno de nuestros equipos en Barcelona. Funciones Como WCS Software Engineer , serás responsable de diseñar, desarrollar e implementar ...
Job description_About the Role_We are seeking a talented Senior Software Engineer to join our team and contribute to the development of a modern, cloud-native data processing platform. In this role, you will design, build, and maintain scalable, resilient services that process and manage large volumes of data across AWS ...
... all code written in TypeScript . For high-throughput messaging and background processing, we use Kafka (for millions of events) and Bull (Redis) . Analytics data is stored in ClickHouse , and we use Elasticsearch for search. We are a distributed team of 160+ product professionals, including 80+ engineers. Our team members ...
... features that directly contribute to user success and business impact. Tech stack The company’s core technologies include React and React Native for the frontend, Python with Django on the backend, and relational databases for data management. The team works in an agile environment with continuous integration and deployment practices. ...