**Job Description**
We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The successful candidate will be responsible for ensuring that our entire data infrastructure meets the needs of our business.
Key Responsibilities:
* Design, build, and maintain scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Collaborate with data architects to design and implement data models and data architectures.
* Work with data scientists to develop and deploy machine learning models and data products.
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
Qualifications:
* 5+ years of experience in data engineering or a related field.
* Experience with programming languages such as Python, Java, and Scala.
* Strong experience with data modeling and data architecture.
* Strong collaboration and communication skills.
Nice to Have:
* Experience with machine learning and data science.
* Experience with cloud-based data platforms such as AWS, GCP, or Azure.
This is a fully remote opportunity with the potential to become a permanent position. If you are passionate about data engineering and want to work in a collaborative environment, please apply today.