Negotiable
Outside
Onsite
Edinburgh
Day Rate Circa 475
Harvey Nash s public sector client are currently looking to recruit a Data Engineer to join their team based in Edinburgh for an initial 6 month period.
Assignment Description
An experienced data engineer is required to accelerate the development of the organisations Data Warehouse and associated products and services. The focus of the work will be the collaborative development of internal casework[1]profiling solutions using data extraction & processing techniques applied to semi[1]structured and unstructured documents and forms. The candidate will also be expected to deliver robust and resilient data integration solutions and automation of data products and services to ensure that the Data Warehouse is fit-for-purpose.
Essential Skills:
Significant commercial experience with the following technology:
- Python
- PostgreSQL
- REST APIs
- Modern DevOps and CI/CD practices and tooling including Docker, GitLab CI, AWS CodePipeline, AWS CDK and AWS CloudFormation
Significant and demonstrable commercial experience in the following areas:
- Expertise in SQL, data transformation and analysis
- Delivering high quality software collaboratively in high-performing, cross-functional development teams.
- Experience implementing data ETLs, data streaming systems and data integration solutions
- Experience working in the Agile delivery models - such as Scrum and/or Kanban frameworks.
Desirable Skills:
- Data warehousing
- Hybrid on-premises/cloud solutions
- AWS Glue, Lambda functions, S3, RDS, Comprehend, SageMaker, Data Migration Service
- Experience implementing ML/AI-based solutions, especially in the NLP domain
- Spark
- Using testing tools for unit testing, including system test automation frameworks
- Openshift
- PostGIS for PostgreSQL
- Designing and implementing solutions using service and event-based architectures
- Monitoring, alerting, intelligence tools and processes, including Grafana
- Human-centred, research-driven, inclusive design practices
- Developing within Digital First or GDS quality standards
This role has been deemed Outside IR35 by the client. Applicants must hold, or be happy to apply for, a valid Basic Disclosure Scotland. Please click the link to apply.