Job Description
We are seeking a skilled Data Engineer to join our team in designing, building, and maintaining large-scale data systems.
The successful candidate will be responsible for developing and implementing data pipelines, data warehouses, and data lakes using various tools and technologies.
This is a fully remote opportunity with the potential to become a permanent position.
Key Responsibilities:
* Design, build, and maintain large-scale data systems.
* Develop and implement data pipelines using Apache Beam, Apache Spark, and AWS Glue.
* Design and implement data warehouses using Amazon Redshift, Google BigQuery, and Snowflake.
* Develop and maintain data lakes using Apache Hadoop, Apache Spark, and Amazon S3.
* Work with data architects to design and implement data models and data architectures.
* Collaborate with data scientists to develop and deploy machine learning models and data products.
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
Qualifications:
* 5+ years of experience in data engineering or a related field.
* 2-4 years of experience in Ruby products, including Ruby on Rails framework.
* 5+ years of experience with programming languages such as Python, Java, and Scala.
* 3+ years of experience with data modeling and data architecture.
* Strong experience with data warehousing and data lakes.
* Strong collaboration and communication skills.