Data Engineer Opportunity
We are seeking a highly skilled Data Engineer to join our team and contribute to the design, development, and maintenance of large-scale data systems.
The successful candidate will be responsible for designing and implementing data pipelines, data warehouses, and data lakes using tools such as Apache Beam, Apache Spark, and AWS Glue. They will work closely with data architects, data scientists, and other stakeholders to ensure that the entire data system meets the needs of our business.
This is a fully remote opportunity with the potential to become a permanent position.
Key Responsibilities:
* Design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Work with data architects to design and implement data models and data architectures.
* Collaborate with data scientists to develop and deploy machine learning models and data products.
* Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.
Qualifications:
* 5+ years of experience in data engineering or a related field.
* 2-4 years of experience in Ruby products, including Ruby on Rails framework.
* 5+ years of experience with programming languages such as Python, Java, and Scala.
* 3+ years of experience with data modeling and data architecture.
* Strong experience with data warehousing and data lakes.
* Strong collaboration and communication skills.
* Bachelor's degree in Computer Science, Engineering, or a related field.
Nice to Have:
* Experience with machine learning and data science.
* Experience with cloud-based data platforms such as AWS, GCP, or Azure.
* Experience with containerization using Docker and Kubernetes.
* Experience with agile development methodologies such as Scrum or Kanban.
About the Role:
This is a fantastic opportunity for a Data Engineer to grow and develop their skills in a collaborative environment.
Frequently Asked Questions:
Q: What is the primary responsibility of this role?
A: The primary responsibility is to design, develop, and maintain large-scale data systems.
Q: What skills are required for this role?
A: Strong experience with data warehousing and data lakes, collaboration and communication skills, and a Bachelor's degree in Computer Science, Engineering, or a related field.
Q: Is this a permanent position?
A: This is a fully remote opportunity with the potential to become a permanent position.