Data Engineer Position
This is an exciting opportunity for a skilled Data Engineer to join our collaborative environment and contribute to the development of our data infrastructure. As a key member of our team, you will be responsible for designing, building, and maintaining large-scale data systems, including data pipelines, data warehouses, and data lakes.
**Key Responsibilities:**
* Design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Work with data architects to design and implement data models and data architectures.
* Collaborate with data scientists to develop and deploy machine learning models and data products.
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
**Required Skills and Qualifications:**
* 5+ years of experience in data engineering or a related field.
* 2-4 years of experience in Ruby products, including Ruby on Rails framework.
* 5+ years of experience with programming languages such as Python, Java, and Scala.
* 3+ years of experience with data modeling and data architecture.
* 3+ years of experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
**Nice to Have:**
* Experience with machine learning and data science.
* Experience with cloud-based data platforms such as AWS, GCP, or Azure.
* Experience with containerization using Docker and Kubernetes.
* Experience with agile development methodologies such as Scrum or Kanban.
About This Opportunity:
This is a fully remote position with the potential to become a permanent role. We are looking for a highly skilled and motivated individual who can work collaboratively with our team to drive business success.