Key Responsibilities:
* Design, build and maintain large-scale data systems.
* Develop data warehouses using Amazon Redshift, Google BigQuery and Snowflake.
* Create scalable automated testing solutions with Ruby/Selenium-based frameworks.
* Build and maintain data pipelines with Apache Beam, Apache Spark and AWS Glue.
* Develop and maintain data lakes with Apache Hadoop, Apache Spark and Amazon S3.
* Work with data architects to design data models and architectures.
* Collaborate with data scientists to develop and deploy machine learning models and data products.
Become a crucial part of our team as a Data Engineer and help us build and maintain the data infrastructure. You will be responsible for designing, building and maintaining data systems, including data pipelines, data warehouses and data lakes.
This is a fully remote opportunity with the potential to become a permanent position. You will work closely with data architects, data scientists and other stakeholders to ensure that the entire data systems meet the needs of our business.
We are looking for someone with 5+ years of experience in data engineering or a related field. You should have experience with programming languages such as Python, Java and Scala, and data engineering tools like Apache Beam, Apache Spark and AWS Glue. Strong collaboration and communication skills are also required.
A Bachelor's degree in Computer Science, Engineering or a related field is necessary. Additionally, experience with machine learning and data science, cloud-based data platforms and containerization using Docker and Kubernetes would be beneficial. Agile development methodologies such as Scrum or Kanban are also a plus.