Job Title: Data Engineer
-----------------------------------
Description:
* We are seeking a skilled Data Engineer to design and implement an AWS Serverless DataLake architecture that efficiently handles large volumes of data and supports various data processing workflows.
* The ideal candidate will develop data ingestion pipelines and integration processes, ensuring the smooth and reliable transfer of data from various sources into the DataLake.
* Key responsibilities include implementing data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency.
* This role requires collaboration with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake.
* The Data Engineer will optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data.
-----------------------------------
Requirements:
* A minimum of 5 years of experience working as a Data Engineer, with a strong focus on AWS technologies and serverless architectures.
* In-depth knowledge of AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB, and their capabilities for building scalable data processing systems.
* Strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying.
* Hands-on experience with data integration and ETL tools, such as AWS Glue or Apache Spark, for transforming and processing data.
* English proficiency is required.
* Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas.
* Solid understanding of data security, access control, and compliance requirements in a data-driven environment.
* Experience with data visualization tools (e.g., Tableau, Power BI) and the ability to collaborate with analysts and data scientists to deliver actionable insights.
* Strong problem-solving and analytical skills, with a detail-oriented approach to ensure data accuracy and integrity.
* Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.