Role Overview
A key contributor in building, maintaining and modernizing large-scale data pipelines processing regulatory data worldwide.
* Work hands-on with Python, SQL and related tools to untangle legacy processes and migrate to maintainable platforms such as Airflow.
* Ensure accurate, reliable and client-ready data.
Required Skills and Qualifications
* 7+ years of experience using Python for analyzing, extracting, creating and transforming large datasets.
* Proficiency in Python 3+ and common libraries and tools for data engineering.
* Deep experience with SQL and relational data using Oracle, Postgres or MS SQL Server.
* Solid understanding of database design principles, data modeling and warehousing concepts.
* Excellent troubleshooting skills and instincts.
* College degree or equivalent experience in computer science, software development, engineering, information systems, math, food science or relevant field of study.
Preferred Qualifications
* NoSQL database design and development using MongoDB, AWS DynamoDB or Azure Cosmos DB.
* Familiarity with cloud platforms and services related to data storage/processing.
Key Responsibilities
The Data Engineer will contribute to our team by:
* Collaborating on the design, implementation, and maintenance of large-scale data pipelines.
* Ensuring data accuracy, reliability, and usability.