Cloud Data Engineer Role
We seek a skilled Cloud Data Engineer to design and implement large-scale data processing systems.
As a Cloud Data Engineer, you will be responsible for designing and implementing cloud-based architectures using AWS technologies to efficiently handle large volumes of data.
* Design and implement cloud-based data ingestion pipelines and integration processes using AWS services such as S3 and Lambda to ensure the smooth transfer of data into the DataLake;
* Implement data transformation and data enrichment processes using serverless technologies like Glue and Lambda to ensure data quality and consistency;
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake;
* Optimize data storage and retrieval mechanisms, leveraging AWS services such as Athena, Redshift, and DynamoDB, to provide high-performance access to the data;
* Maintain and improve existing data processing systems to meet evolving business needs.
Requirements
* Extensive experience (5+ years) working as a Cloud Data Engineer, with a strong focus on AWS technologies and serverless architectures;
* Experience working with AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB, and their capabilities for building scalable data processing systems;
* Proven expertise in designing and implementing cloud-based architectures for large-scale data processing and storage;
* Strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying;
* Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas;
* Solid understanding of data security, access control, and compliance requirements in a data-driven environment.