Job Opportunity:
As a Data Engineer, you will be responsible for designing and implementing scalable data processing systems using AWS services. You will work closely with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake.
Key Responsibilities:
* Design and implement an AWS Serverless DataLake architecture
* Develop data ingestion pipelines and data integration processes
* Implement data transformation and data enrichment processes
* Collaborate with data scientists and analysts to understand their data requirements
* Optimize data storage and retrieval mechanisms
* Monitor and troubleshoot the DataLake infrastructure
Essential Skills:
* 5+ years of experience in AWS technologies and serverless architectures
* Strong programming skills in languages like Python, Java, or Scala
* Experience with data integration and ETL tools, such as AWS Glue or Apache Spark
* In-depth knowledge of AWS services and their capabilities for building scalable data processing systems
* Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas