Anunciada dia 17 novembro
Descrição
Cloud Data Architect
We are seeking a highly skilled Cloud Data Architect to design and implement an efficient AWS Serverless DataLake architecture. As a key member of our team, you will be responsible for developing data ingestion pipelines, data integration processes, and data transformation processes.
* Design and implement an AWS Serverless DataLake architecture that can handle large volumes of data and support various data processing workflows;
* Develop data ingestion pipelines and data integration processes to ensure the smooth transfer of data from various sources into the DataLake;
* Implement data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency;
* Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake;
* Optimize data storage and retrieval mechanisms leveraging AWS services such as S3, Athena, Redshift, or DynamoDB to provide high-performance access to the data;
* Monitor and troubleshoot the DataLake infrastructure identifying and resolving performance bottlenecks, data processing errors, and other issues;
* Continuously evaluate new AWS services and technologies to enhance the DataLake architecture improve data processing efficiency and drive innovation;
* Mentor and provide technical guidance to junior data engineers fostering their growth and ensuring adherence to best practices;
* Collaborate with cross-functional teams to understand business requirements prioritize tasks and deliver high-quality solutions within defined timelines.
Required Skills and Qualifications:
* Proven experience designing and implementing cloud-based data architectures;
* Strong understanding of AWS services including S3, Lambda, Glue, and DynamoDB;
* Experience with data ingestion pipelines and data integration processes;
* Knowledge of data transformation and enrichment processes using AWS Lambda, Glue, or similar serverless technologies;
* Ability to collaborate with data scientists and analysts to understand their data requirements;
* Strong problem-solving skills and attention to detail;
* Excellent communication and interpersonal skills.
Benefits:
* Competitive salary and benefits package;
* Opportunities for professional growth and development;
* Collaborative and dynamic work environment;
* Recognition and rewards for outstanding performance.
