Data Engineer Position
We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will design, build, and maintain large-scale data systems. This includes designing and implementing data warehouses using tools such as Amazon Redshift, Google BigQuery, and Snowflake.
Key Responsibilities:
* Design scalable automated testing solutions using Ruby/Selenium-based frameworks.
* Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.
* Develop and maintain data lakes using tools such as Apache Hadoop, Apache Spark, and Amazon S3.
* Work with data architects to design and implement data models and data architectures.
* Collaborate with data scientists to develop and deploy machine learning models and data products.
* Evaluate and recommend new technologies for data engineering.
Required Skills and Qualifications:
* A minimum of 5+ years of experience in data engineering or a related field.
* 2-4 years of experience in Ruby products, including the Ruby on Rails framework.
* Strong programming skills in languages such as Python, Java, and Scala.
* Experience with data modeling and data architecture.
* Familiarity with data warehousing and data lakes.
* Strong collaboration and communication skills.
Benefits:
* This is a fully remote opportunity with potential for a permanent position.
* The successful candidate will have opportunities for professional growth and development.