Data Engineer Position
We are seeking a highly skilled Data Engineer to join our collaborative environment and help build and maintain the data infrastructure.
* Design, build, and maintain large-scale data systems.
* Implement data warehouses using tools such as Amazon Redshift, Google BigQuery, and Snowflake.
* Develop scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Develop and maintain data lakes using tools such as Apache Hadoop, Apache Spark, and Amazon S3.
The successful candidate will work closely with data architects, data scientists, and other stakeholders to ensure that the entire data systems meet the needs of the business.
This is a fully remote opportunity with the potential to become a permanent position.
Key Responsibilities:
* Collaborate with data architects to design and implement data models and data architectures.
* Work with data scientists to develop and deploy machine learning models and data products.
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
* Collaborate with other teams to ensure that data systems meet the business's needs.
* Stay up-to-date with new technologies and trends in data engineering and make recommendations for adoption.
Qualifications:
* 5+ years of experience in data engineering or a related field.
* 2 - 4 years of experience in Ruby products, including Ruby on Rails framework.
* 5+ years of experience with programming languages such as Python, Java, and Scala.
* 3+ years of experience with data modeling and data architecture.
* 3+ years of experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
Nice to Have:
* Experience with machine learning and data science.
* Experience with cloud-based data platforms such as AWS, GCP, or Azure.
* Experience with containerization using Docker and Kubernetes.
* Experience with agile development methodologies such as Scrum or Kanban.
* Experience with data governance and data security.
About This Opportunity:
This role offers a unique chance to work on complex data engineering projects and contribute to the growth of the organization.
The ideal candidate will have a strong passion for data engineering and a desire to continuously learn and improve their skills.
This is a fantastic opportunity to work on a wide range of projects and collaborate with a talented team of professionals.