Big Data Expert
As a Big Data Expert, you will be responsible for designing and implementing a robust data architecture to handle large volumes of data. This role involves developing data ingestion pipelines, data integration processes, and data transformation processes using AWS Lambda, Glue, or similar serverless technologies.
You will collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the data lake.
Key Responsibilities:
* Mentor and provide technical guidance to junior data engineers.
* Continuously evaluate new AWS services and technologies to enhance the data lake architecture.
* Monitor and troubleshoot the data lake infrastructure.
This role requires strong programming skills in languages like Python, Java, or Scala, along with experience using SQL for data manipulation and querying. Familiarity with data modeling techniques and data warehousing concepts, including star and snowflake schemas, is also necessary.
The ideal candidate should have excellent problem-solving skills, a strong attention to detail, and the ability to work effectively in a team environment.