Summary: The Senior Data Engineer role is a remote contract position requiring occasional travel to London or Birmingham, focused on big data technologies and ETL pipeline development. The contract duration is between 6 to 9 months, and candidates must have BPSS clearance. As this job is outside of the UK, if the end hirer has no UK presence, the responsibility for performing the IR35 assessment sits with the contractor.

Key Responsibilities:

• Hands-on experience in big data technologies.
• Designing, implementing, and debugging ETL pipelines.
• Collaborating with stakeholders, data architects, and data scientists to ensure data quality.
• Expertise in ETL tools such as Apache Kafka, Spark, and Airflow.
• Excellent programming skills in Python, Scala, and SQL.
• Implementing data pipelines using cloud-native services on AWS.
• Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, and CloudWatch.

Key Skills:

• Experience with big data technologies.
• ETL pipeline design and implementation.
• Collaboration skills with various stakeholders.
• Proficiency in Apache Kafka, Spark, and Airflow.
• Programming skills in Python, Scala, and SQL.
• Cloud-native services expertise on AWS.
• Knowledge of AWS services including API Gateway, Lambda, Redshift, Glue, and CloudWatch.

Salary (Rate): 450

City: Halton Hills

Country: Canada

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT