Big Data Architect Role
We are seeking an experienced Big Data Architect who can design, implement and maintain large-scale data architectures to support our business growth.
* Design and develop a scalable serverless architecture using AWS services such as Lambda, Glue, S3, Athena, Redshift, and DynamoDB.
* Develop efficient data ingestion pipelines and integration processes to transfer data from various sources into the data lake.
* Implement data transformation and enrichment processes using AWS Lambda and Glue to ensure high-quality and consistent data.
* Collaborate with cross-functional teams including data scientists, analysts, and engineers to understand their data requirements and design appropriate data models and schemas.
* Optimize data storage and retrieval mechanisms to provide high-performance access to the data.
* Monitor and troubleshoot the data infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues.
* Stay up-to-date with new AWS services and technologies to enhance the data architecture, improve data processing efficiency, and drive innovation.
* Provide technical guidance and mentorship to junior team members to foster their growth and ensure adherence to best practices.