Data Engineer - An Exciting Opportunity to Shape the Future of Data Infrastructure.
We are seeking a highly skilled Data Engineer to join our collaborative environment and help build and maintain large-scale data systems. As a key member of our team, you will be responsible for designing, building, and maintaining data pipelines, data warehouses, and data lakes. Your expertise in data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake will enable us to deliver innovative solutions that meet the needs of our business.
Key Responsibilities:
* Design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Work with data architects to design and implement data models and data architectures.
* Collaborate with data scientists to develop and deploy machine learning models and data products.
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
Qualifications:
* A minimum of 5+ years of experience in data engineering or a related field.
* 2-4 years of experience in Ruby products, including Ruby on Rails framework.
* 5+ years of experience with programming languages such as Python, Java, and Scala.
* 3+ years of experience with data modeling and data architecture.
* 3+ years of experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
Benefits:
This is a fully remote opportunity with the potential to become a permanent position. We offer a dynamic and supportive work environment, where you will have the opportunity to grow and develop your skills.
About the Role:
The successful candidate will be a highly motivated and detail-oriented individual with excellent communication and collaboration skills. If you are passionate about data engineering and are looking for a new challenge, we encourage you to apply.
],