Data Engineer

Data Engineer

Posted 2 weeks ago by Harvey Nash

Negotiable
Outside
Onsite
Edinburgh
p>Data Engineer 6 Months Outside IR35 Edinburgh

Day Rate Circa 475

Harvey Nash s public sector client are currently looking to recruit a Data Engineer to join their team based in Edinburgh for an initial 6 month period.

Assignment Description

An experienced data engineer is required to accelerate the development of the organisations Data Warehouse and associated products and services. The focus of the work will be the collaborative development of internal casework[1]profiling solutions using data extraction & processing techniques applied to semi[1]structured and unstructured documents and forms. The candidate will also be expected to deliver robust and resilient data integration solutions and automation of data products and services to ensure that the Data Warehouse is fit-for-purpose.

Essential Skills:

Significant commercial experience with the following technology:

  • Python
  • PostgreSQL
  • REST APIs
  • Modern DevOps and CI/CD practices and tooling including Docker, GitLab CI, AWS CodePipeline, AWS CDK and AWS CloudFormation

Significant and demonstrable commercial experience in the following areas:

  • Expertise in SQL, data transformation and analysis
  • Delivering high quality software collaboratively in high-performing, cross-functional development teams.
  • Experience implementing data ETLs, data streaming systems and data integration solutions
  • Experience working in the Agile delivery models - such as Scrum and/or Kanban frameworks.

Desirable Skills:

  • Data warehousing
  • Hybrid on-premises/cloud solutions
  • AWS Glue, Lambda functions, S3, RDS, Comprehend, SageMaker, Data Migration Service
  • Experience implementing ML/AI-based solutions, especially in the NLP domain
  • Spark
  • Using testing tools for unit testing, including system test automation frameworks
  • Openshift
  • PostGIS for PostgreSQL
  • Designing and implementing solutions using service and event-based architectures
  • Monitoring, alerting, intelligence tools and processes, including Grafana
  • Human-centred, research-driven, inclusive design practices
  • Developing within Digital First or GDS quality standards

This role has been deemed Outside IR35 by the client. Applicants must hold, or be happy to apply for, a valid Basic Disclosure Scotland. Please click the link to apply.