Senior Data Engineers
Breakthrough Talent is currently supporting a leading data business build a brand new data platform to support a modern data mesh organisation. They work with national and global clients across data, software and digital consulting, and they are now looking for a Data Infrastructure Engineer to help build and scale their next generation platform.
This role suits someone who enjoys owning infrastructure, building reusable solutions, and supporting data teams with analytics and AI ready environments.
The Role
As a Data Engineer you will design, build and maintain the core infrastructure that enables data processing, analytics, data science and data management across the business.
You will work in a multi account and multi region AWS environment that follows zero trust and least privilege principles. Infrastructure as Code and CI CD will be central to how you operate, alongside continuous improvement and strong governance.
What You Will Do
Build and maintain cloud based infrastructure using Cloud Formation and SAM
Design and implement data processing environments using AWS services such as Glue, EMR, Sagemaker, Redshift, Aurora and Snowflake
Build data processing pipelines using Python, SQL, PySpark, Spark, Lambda, Step Functions and Apache Airflow
Monitor performance, cost and security of the data platform
Apply strong data governance and access control for sensitive data
Collaborate with multiple teams to support the wider data platform strategy
What You Need
Six years or more experience in a Data Engineering or Data Infrastructure role
Strong experience building data architectures in AWS
Solid coding skills in Python and SQL, Golang
Strong Cloud Formation knowledge
Experience working with relational databases such as Postgres or Redshift
Good coding discipline including documentation, unit testing and version control
Experience with Git and CI CD tools such as GitLab
Worked in Agile teams and ceremonies
Strong problem solving skills and excellent communication
Nice to Have
Experience with Jira or similar project management tools
Experience with Snowflake
Spatial data processing experience
If you would like to learn more about the role, please reach out to Jake Denman at Breakthrough Talent.