Design and Implement Data Solutions
We are seeking an experienced Data Engineer to spearhead the development of a robust data architecture. This role involves designing and implementing an AWS Serverless DataLake infrastructure to efficiently process large volumes of data and support various data processing workflows.
The ideal candidate will have extensive experience working as a Data Engineer, with a strong focus on AWS technologies and serverless architectures, as well as hands-on experience with data integration and ETL tools, such as AWS Glue or Apache Spark.
Key responsibilities include developing data ingestion pipelines, implementing data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies, and collaborating with data scientists and analysts to understand their data requirements.
* Develop scalable data ingestion pipelines
* Implement data transformation and enrichment processes
* Collaborate with cross-functional teams