A Data Engineer is needed to design, build, and maintain large-scale data systems. This role involves working closely with data architects, data scientists, and other stakeholders to ensure that the entire data system meets the business needs.
Key Responsibilities:
* Design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Collaborate with data scientists to develop and deploy machine learning models and data products.
* Evaluate and recommend new technologies and trends in data engineering.
The ideal candidate should have strong experience with data modeling and architecture, data validation and cleansing, and collaboration and communication skills. A Bachelor's degree in Computer Science or a related field is required.
Required Skills and Qualifications:
* Data Modeling and Architecture
* Scalable Automated Testing Solutions
* Data Pipelines
* Machine Learning Models
* Cloud-Based Data Platforms
* Containerization
Benefits:
* Fully Remote Opportunity
* Potential for Permanent Position
* Collaborative Work Environment