We are seeking a highly skilled Data Engineer to join our team. This is an exciting opportunity to build and maintain large-scale data systems, design data pipelines, and develop scalable automated testing solutions.
The ideal candidate will have experience with programming languages such as Python, Java, and Scala, as well as data engineering tools like Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
Responsibilities will include designing, building, and maintaining data warehouses, developing and maintaining data lakes, working with data architects to design and implement data models and data architectures, and collaborating with data scientists to develop and deploy machine learning models and data products.
In addition, the successful candidate will be responsible for ensuring data quality and integrity by developing and implementing data validation and data cleansing processes.
Requirements
* 5+ years of experience in data engineering or a related field
* Experience with Ruby on Rails framework
* Strong experience with data modeling and data architecture
* Strong experience with data engineering tools
* Bachelor's degree in Computer Science, Engineering, or a related field
Nice to Have
* Experience with machine learning and data science
* Experience with cloud-based data platforms
* Experience with containerization using Docker and Kubernetes
* Experience with agile development methodologies
* Experience with data governance and data security