Job Description
We are seeking a skilled Data Engineer to join our team in designing, building, and maintaining large-scale data systems. As a Data Engineer, you will be responsible for creating efficient and scalable data pipelines, data warehouses, and data lakes using various tools and technologies.
Key Responsibilities:
* Design and develop data architectures that meet the needs of our business.
* Implement data warehouses using Amazon Redshift, Google BigQuery, and Snowflake.
* Create scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using Apache Beam, Apache Spark, and AWS Glue.
* Work with data architects to design and implement data models and data architectures.
* Collaborate with data scientists to develop and deploy machine learning models and data products.
Qualifications:
Required Skills and Qualifications:
* A minimum of 5 years of experience in data engineering or a related field.
* 2-4 years of experience in Ruby products, including Ruby on Rails framework.
* 5+ years of experience with programming languages such as Python, Java, and Scala.
* 3+ years of experience with data modeling and data architecture.
* 3+ years of experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
About This Role:
As a Data Engineer, you will work closely with cross-functional teams to ensure that our data systems meet the needs of our business. You will be responsible for designing, building, and maintaining large-scale data systems, including data pipelines, data warehouses, and data lakes. You will also collaborate with data architects, data scientists, and other stakeholders to ensure that our data systems are efficient, scalable, and reliable.
What We Offer:
* A competitive salary and benefits package.
* The opportunity to work with a collaborative and dynamic team.
* Professional development opportunities to help you grow your career.