Freelance Web Scraping Engineer (Remote)

Job summary

This is a part-time freelance position focused on web scraping and data extraction within a hybrid AI and human system. The role involves collaborating with agents to ensure accurate and actionable data delivery while utilizing various tools for efficient data processing.

Qualifications

• Minimum of 1 year of experience in data analysis, AI automation, data engineering, or software development.
• Bachelor's or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related fields is preferred.
• Proficiency in English at an upper-intermediate level (B2 or above) is required.

Responsibilities

• Manage end-to-end data extraction workflows across complex websites, ensuring accuracy and reliability of structured datasets.
• Utilize internal tools (Apify, OpenRouter) and custom workflows to enhance data collection and validation processes.
• Adapt scraping techniques for dynamic web sources, including JavaScript-rendered content.
• Implement data quality standards through validation checks and consistency controls before delivery.
• Scale scraping operations for large datasets, monitor for failures, and maintain stability against minor changes in site structure.

Skills

• Proficient in Python web scraping, including tools like BeautifulSoup and Selenium for handling complex sites and dynamic content.
• Expertise in data extraction from hierarchical structures and varied HTML formats.
• Strong data processing skills, including cleaning, normalizing, and validating scraped data.
• Familiarity with LLMs and AI frameworks to enhance automation.
• Excellent attention to detail and commitment to data accuracy.

Tools

Compensation

Earn up to $32 per hour based on experience and contribution pace, with potential for performance-based bonuses.

• Apify, OpenRouter, BeautifulSoup, Selenium, and other web scraping tools.