Design Data Architect
Job Description
An exciting opportunity for a Data Engineer to join a collaborative environment and contribute to building and maintaining the data infrastructure.
This role involves designing, building, and maintaining large-scale data systems, including data pipelines, data warehouses, and data lakes. You will work closely with data architects, data scientists, and other stakeholders to ensure that the entire data system meets the needs of the business.
The successful candidate will be responsible for designing and implementing scalable automated testing solutions using Ruby/Selenium-based frameworks. Additionally, you will develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue. You will also work with data architects to design and implement data models and data architectures.
To succeed in this role, you should have strong experience with data modeling and data architecture, as well as experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake. Strong collaboration and communication skills are also essential.
Key Responsibilities:
* Design and build large-scale data systems.
* Implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Collaborate with data architects to design and implement data models and data architectures.
Qualifications:
* 5+ years of experience in data engineering or a related field.
* 2-4 years of experience in Ruby products, including Ruby on Rails framework.
* 5+ years of experience with programming languages such as Python, Java, and Scala.
* 3+ years of experience with data modeling and data architecture.
* Strong experience with data warehousing and data lakes.
Nice to Have:
* Experience with machine learning and data science.
* Experience with cloud-based data platforms such as AWS, GCP, or Azure.
We thank all candidates in advance. Only selected candidates for interviews will be contacted.