Data Engineer (Remote, AI Industry)

Job summary

The role involves building reliable data pipelines to support operations and site reliability engineering for a SaaS offering. The position requires collaboration with various teams to enhance data management and streamline processes.

Qualifications

• Bachelor's degree in Computer Science or a related field.
• Over 3 years of experience in a similar role.
• Basic scripting or development skills in Python and SQL.
• Familiarity with data platforms such as Snowflake, Databricks, or BigQuery.
• Knowledge of public cloud ecosystems including AWS, Azure, or GCP.
• Experience in orchestrating data pipelines and implementing governance practices.
• Proficiency in leveraging APIs.
• Strong problem-solving abilities and creativity in solution design.
• Effective communication skills for collaboration with diverse teams.

Responsibilities

• Develop data pipelines to load information from various systems into the platform using S3 or Snowflake.
• Enhance the robustness of existing production pipelines and establish monitoring and testing processes.
• Collaborate with data and analytics teams to improve the reliability and scalability of product usage data.
• Create custom applications and integrations to automate tasks for operational teams.
• Contribute to the maintenance of data systems by documenting best practices.

Skills

• Proficiency in Python and SQL.
• Experience with data platforms and cloud services.
• Strong analytical and problem-solving skills.

Education

• Bachelor's degree in Computer Science or a related field.

Tools

• Familiarity with AWS, Snowflake, Databricks, BigQuery, and API integration.