Cloud Data Engineer
">
We are seeking a highly skilled Cloud Data Engineer to design, build, and maintain large-scale data systems. As a key member of our team, you will work closely with data architects, data scientists, and other stakeholders to ensure that our entire data systems meet the needs of our business.
">
Main Responsibilities:
">
* Data System Design and Development: You will be responsible for designing, building, and maintaining large-scale data systems, including data pipelines, data warehouses, and data lakes.
">
* Cloud-Based Data Platforms: You will have experience with cloud-based data platforms such as AWS, GCP, or Azure, and be able to design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
">
* Big Data Technologies: You will have strong experience with big data technologies such as Apache Beam, Apache Spark, and Amazon S3, and be able to develop and maintain data pipelines using these tools.
">
* Data Governance and Security: You will be responsible for ensuring data quality and integrity by developing and implementing data validation and data cleansing processes, and collaborating with other teams to ensure that data systems meet the business's needs.
">
">
Qualifications:
">
* A Bachelor's degree in Computer Science, Engineering, or a related field.
">
* 5+ years of experience in data engineering or a related field.
">
* Strong collaboration and communication skills.
">
* Experience with programming languages such as Python, Java, and Scala.
">
* Experience with data modeling and data architecture.
">
* Experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and Snowflake.
">
">
Nice to Have:
">
* Experience with machine learning and data science.
">
* Experience with agile development methodologies such as Scrum or Kanban.
">
* Experience with containerization using Docker and Kubernetes.
">
* Experience with data governance and data security.
">