Job Description
We are seeking an experienced Data Engineer to design, build and maintain large-scale data systems. The successful candidate will work closely with data architects, data scientists and other stakeholders to ensure that the entire data systems meet the needs of our business.
Main Responsibilities:
* Data System Design and Development: Design, build and maintain large-scale data systems including data pipelines, data warehouses and data lakes.
* Data Warehousing: Design and implement data warehouses using tools such as Amazon Redshift, Google BigQuery and Snowflake.
* Automated Testing: Design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Data Pipelines: Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark and AWS Glue.
* Data Lakes: Develop and maintain data lakes using tools such as Apache Hadoop, Apache Spark and Amazon S3.
Requirements:
* Experience: 5+ years of experience in data engineering or a related field.
* Skills: Strong experience with programming languages such as Python, Java and Scala. Experience with data modeling and data architecture is also required.
* Tools and Technologies: Experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery and Snowflake.
Benefits:
* Remote Work Opportunity: This is a fully remote opportunity with the potential to become a permanent position.
* Collaborative Environment: You will work closely with data architects, data scientists and other stakeholders to ensure that the entire data systems meet the needs of our business.