Data Engineer Position
An exciting opportunity exists for a Data Engineer to join our collaborative environment and help build and maintain the data infrastructure. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems, including data pipelines, data warehouses, and data lakes.
This is a fully remote opportunity with the potential to become a permanent position. We are seeking a skilled professional with expertise in data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
Key Responsibilities:
* Design, build, and maintain data systems.
* Implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam and Apache Spark.
* Develop and maintain data lakes using tools such as Apache Hadoop and Amazon S3.
* Collaborate with data architects to design and implement data models and data architectures.
* Work with data scientists to develop and deploy machine learning models and data products.
Required Skills and Qualifications:
* 5+ years of experience in data engineering or a related field.
* 2-4 years of experience in Ruby products, including Ruby on Rails framework.
* 5+ years of experience with programming languages such as Python, Java, and Scala.
* Strong experience with data modeling and data architecture.
* Experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
Benefits:
* Fully remote work opportunity.
* Potential for permanent position.