Job Title: Experienced Data Systems Engineer
Job Summary:
We are seeking a highly skilled Data Systems Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems, including data pipelines, data warehouses, and data lakes.
Key Responsibilities:
* Design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Design and implement data warehouses using tools such as Amazon Redshift, Google BigQuery, and Snowflake.
* Develop and maintain data lakes using tools such as Apache Hadoop, Apache Spark, and Amazon S3.
* Collaborate with data architects to design and implement data models and data architectures.
* Work closely with data scientists to develop and deploy machine learning models and data products.
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
* Stay up-to-date with new technologies and trends in data engineering and make recommendations for adoption.
Requirements:
* 5+ years of experience in data engineering or a related field.
* 2-4 years of experience in Ruby products, including Ruby on Rails framework.
* 5+ years of experience with programming languages such as Python, Java, and Scala.
* Strong experience with data modeling and data architecture.
* Strong experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
* Strong collaboration and communication skills.
* Bachelor's degree in Computer Science, Engineering, or a related field.
Nice to Have:
* Experience with machine learning and data science.
* Experience with cloud-based data platforms such as AWS, GCP, or Azure.
* Experience with containerization using Docker and Kubernetes.
* Experience with agile development methodologies such as Scrum or Kanban.
* Experience with data governance and data security.
About the Role:
This is a fully remote opportunity with the potential to become a permanent position. You will work closely with a collaborative team to ensure that the entire data systems meet the needs of our business.
What We Offer:
We offer a competitive salary, excellent benefits package, and opportunities for professional growth and development.
Contact Us:
Please visit us at [website URL] to learn more about this opportunity and how to apply.