Data Architect - Data Lake Specialist
Job Description:
We are seeking a skilled Data Architect to design and implement an advanced data lake architecture. The successful candidate will have extensive experience with AWS technologies, serverless architectures, and big data processing systems.
The ideal candidate will be responsible for designing and implementing scalable data processing systems using AWS services such as S3, Lambda, Glue, Athena, Redshift, and DynamoDB. They will also work closely with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the data lake.
This role requires strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying. Additionally, the candidate should have hands-on experience with data integration and ETL tools, such as AWS Glue or Apache Spark, for transforming and processing data.
The successful candidate will be a key member of our team, working collaboratively with cross-functional teams to deliver high-quality solutions within defined timelines.
Key Responsibilities:
* Design and Implement Data Lake Architecture: Design and implement an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows.
* Develop Data Ingestion Pipelines: Develop data ingestion pipelines and data integration processes, ensuring the smooth and reliable transfer of data from various sources into the DataLake.
* Implement Data Transformation and Enrichment: Implement data transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency.
* Collaborate with Cross-Functional Teams: Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake.
Benefits:
We offer a range of benefits, including professional development opportunities, a collaborative and diverse environment, and competitive compensation packages. Our employees enjoy opportunities to work on challenging projects, develop new skills, and take ownership of their work.
Requirements:
To be successful in this role, you will need:
* 5+ years of experience working as a Data Engineer or Data Architect
* Strong knowledge of AWS technologies and serverless architectures
* Experience working with big data processing systems and data warehousing concepts
* Excellent communication and collaboration skills
* Strong problem-solving and analytical skills
Please note that we are looking for a motivated individual who is passionate about data engineering and architecture. If you are excited about working with big data and cloud-based technologies, please submit your application.