Data Engineer Position
">
We are seeking a highly skilled Data Engineer to join our team and contribute to the design, building, and maintenance of large-scale data systems.
]
The ideal candidate will have 5+ years of experience in data engineering or a related field, with expertise in programming languages such as Python, Java, and Scala.
]
Additionally, they will have experience with data modeling and data architecture, as well as data engineering tools like Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
]
Responsibilities:
* Design and implement data warehouses using various tools
* Develop and maintain data pipelines using scalable automated testing solutions
* Work with data architects to design and implement data models and architectures
* Collaborate with data scientists to develop and deploy machine learning models and data products
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes
* Stay up-to-date with new technologies and trends in data engineering and make recommendations for adoption
Requirements:
* 5+ years of experience in data engineering or a related field
* 2-4 years of experience in Ruby products, including Ruby on Rails framework
* 5+ years of experience with programming languages such as Python, Java, and Scala
* 3+ years of experience with data modeling and data architecture
* 3+ years of experience with data engineering tools
* Strong collaboration and communication skills
* Bachelor's degree in Computer Science, Engineering, or a related field
Nice to Have:
* Experience with machine learning and data science
* Experience with cloud-based data platforms
* Experience with containerization using Docker and Kubernetes
* Experience with agile development methodologies
* Experience with data governance and data security
],