Data Engineering Role
We are seeking a highly skilled Data Engineer to join our team and contribute to the design, development, and maintenance of large-scale data systems.
The ideal candidate will have 5+ years of experience in data engineering or a related field, with a strong background in programming languages such as Python, Java, and Scala.
Key Responsibilities:
* Data Systems Design: Design, build, and maintain large-scale data systems, including data pipelines, data warehouses, and data lakes.
* Data Warehousing: Design and implement data warehouses using tools such as Amazon Redshift, Google BigQuery, and Snowflake.
* Automated Testing: Design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Data Pipelines: Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Data Lakes: Develop and maintain data lakes using tools such as Apache Hadoop, Apache Spark, and Amazon S3.
* Data Architecture: Work with data architects to design and implement data models and data architectures.
* Collaboration: Collaborate with data scientists to develop and deploy machine learning models and data products.
* Quality Assurance: Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
Qualifications:
* 5+ years of experience in data engineering or a related field.
* 2 - 4 years of experience in Ruby products, including Ruby on Rails framework.
* Strong experience with data modeling and data architecture.
* Strong experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
* Strong collaboration and communication skills.
Requirements:
* Bachelor's degree in Computer Science, Engineering, or a related field.
* Strong knowledge of cloud-based data platforms such as AWS, GCP, or Azure.
* Experience with containerization using Docker and Kubernetes.
* Experience with agile development methodologies such as Scrum or Kanban.
About Us:
We are an equal-opportunity employer committed to diversity and inclusion. We thank all candidates in advance. Only selected candidates for interviews will be contacted.
],