Data Engineer - Build and Maintain Large-Scale Data Systems
">
* Design, build, and maintain large-scale data systems to ensure the smooth operation of our business.
* Create data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue to process and analyze data efficiently.
* Develop and maintain scalable automated testing solutions using Ruby/Selenium-based frameworks to ensure high-quality data delivery.
* Collaborate with data architects to design and implement data models and architectures that meet the needs of our business.
* Work closely with data scientists to develop and deploy machine learning models and data products to drive business growth.
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes to maintain accurate and reliable data.
* Stay up-to-date with new technologies and trends in data engineering and make recommendations for adoption to continuously improve our data infrastructure.