A Data Engineer position has become available in a collaborative environment where you will be responsible for designing, building, and maintaining large-scale data systems.
About the Role
This is an exciting opportunity to work with data architects, data scientists, and other stakeholders to ensure that the entire data systems meet the needs of the business.
Key Responsibilities
* Design, build, and maintain large-scale data systems using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Develop and maintain data pipelines, data warehouses, and data lakes.
* Work closely with data architects to design and implement data models and data architectures.
* Collaborate with data scientists to develop and deploy machine learning models and data products.
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
Requirements
To be successful in this role, you will need:
* 5+ years of experience in data engineering or a related field.
* 2 - 4 years of experience in Ruby on Rails framework.
* Strong experience with programming languages such as Python, Java, and Scala.
* 3+ years of experience with data modeling and data architecture.
* Strong collaboration and communication skills.
Nice to Have
The following qualifications are desirable:
* Experience with machine learning and data science.
* Experience with cloud-based data platforms such as AWS, GCP, or Azure.
* Experience with containerization using Docker and Kubernetes.
* Experience with agile development methodologies such as Scrum or Kanban.
About You
We are looking for a highly skilled and experienced data engineer who can bring their expertise to our team. If you have a passion for working with data and are eager to take on new challenges, we would love to hear from you.