Job Title:
Data Systems Architect
About the Role:
We are seeking a skilled Data Systems Architect to design, build, and maintain large-scale data systems. The ideal candidate will have experience with data modeling, data architecture, and data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
Main Responsibilities:
1. Design and implement data warehouses using tools such as Amazon Redshift, Google BigQuery, and Snowflake.
2. Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
3. Work with data architects to design and implement data models and data architectures.
4. Collaborate with data scientists to develop and deploy machine learning models and data products.
5. Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
6. Stay up-to-date with new technologies and trends in data engineering and make recommendations for adoption.
Requirements:
* 5+ years of experience in data engineering or a related field
* 2-4 years of experience in Ruby programming
* 5+ years of experience with programming languages such as Python, Java, and Scala
* Strong experience with data warehousing and data lakes
* Strong collaboration and communication skills
* Bachelor's degree in Computer Science, Engineering, or a related field