Data Engineering Role
We are seeking a highly skilled Data Engineer to join our team and contribute to the design, development, and maintenance of large-scale data systems.
* The successful candidate will be responsible for designing, building, and maintaining data pipelines, data warehouses, and data lakes.
* Key responsibilities include designing and implementing data warehouses using tools such as Amazon Redshift, Google BigQuery, and Snowflake, as well as developing and maintaining data pipelines using tools like Apache Beam, Apache Spark, and AWS Glue.
* The ideal candidate will have strong experience with data modeling and data architecture, as well as expertise in programming languages such as Python, Java, and Scala.
* A collaborative environment is essential, and the successful candidate will work closely with data architects, data scientists, and other stakeholders to ensure that the entire data systems meet the needs of the business.
* This is a fully remote opportunity with the potential to become a permanent position.
Requirements
* 5+ years of experience in data engineering or a related field
* 2-4 years of experience in Ruby products, including Ruby on Rails framework
* 5+ years of experience with programming languages such as Python, Java, and Scala
* 3+ years of experience with data modeling and data architecture
* 3+ years of experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake
* Strong experience with data warehousing and data lakes
* Strong experience with data validation and data cleansing
* Strong collaboration and communication skills
* Bachelor's degree in Computer Science, Engineering, or a related field
Nice to Have
* Experience with machine learning and data science
* Experience with cloud-based data platforms such as AWS, GCP, or Azure
* Experience with containerization using Docker and Kubernetes
* Experience with agile development methodologies such as Scrum or Kanban
* Experience with data governance and data security