Data Engineer Position
We are seeking a highly skilled Data Engineer to join our team and help build and maintain our data infrastructure. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems, including data pipelines, data warehouses, and data lakes.
Key Responsibilities:
* Design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Work with data architects to design and implement data models and data architectures.
* Collaborate with data scientists to develop and deploy machine learning models and data products.
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
* Candidate should have 5+ years of experience in data engineering or a related field and strong experience with data warehousing and data lakes.
* The ideal candidate will also have experience with cloud-based data platforms such as AWS, GCP, or Azure and agile development methodologies such as Scrum or Kanban.
Required Qualifications:
* Bachelor's degree in Computer Science, Engineering, or a related field.
* Strong collaboration and communication skills.
* Experience with programming languages such as Python, Java, and Scala.
Nice to Have:
* Experience with containerization using Docker and Kubernetes.
* Experience with data governance and data security.
This is a fully remote opportunity with the potential to become a permanent position.