Data Engineering Role
This role involves designing and implementing serverless data architectures to efficiently handle large volumes of data and support various data processing workflows.
* Design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows.
* Develop data ingestion pipelines and integration processes using AWS services.
* Implement data transformation and enrichment processes using AWS Lambda, Glue, or similar technologies.
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake.
The ideal candidate will have:
* 5+ years of experience working as a Data Engineer with strong knowledge of AWS technologies and serverless architectures.
* In-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB.
* Strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying.
* Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
Key Responsibilities
* AWS Serverless DataLake Architecture Design
* Data Ingestion Pipelines Development
* Data Transformation and Enrichment Processes
* Cross-Functional Team Collaboration