Data Engineering Position Overview
Our organization is seeking an experienced Data Engineer to design, build, and maintain high-performance data processing pipelines using Python libraries such as Pandas and Polars.
* Design, build, and maintain data processing pipelines utilizing Python for efficient data analysis.
* Develop RESTful APIs using frameworks like FastAPI or similar technologies to serve dynamic data.
* Process normalized Parquet files from multiple sources to create informative Excel reports.
* Collaborate on infrastructure automation projects using Bicep or comparable tools to streamline operations.
* Participate in discussions regarding future data migration to Snowflake or a data lake architecture.
Required Skills and Qualifications
* Strong proficiency in Python for data analysis, with expertise in Pandas and knowledge of Polars and openpyxl.
* Experience in building backend services or APIs using frameworks like FastAPI.
* Solid understanding of data modeling principles and handling of normalized datasets.
* Familiarity with enterprise messaging patterns and data integration from various sources.
* Proficiency in working with GitHub and CI/CD pipelines.
* Infrastructure-as-Code experience with Bicep or comparable tools.
We value your skills and experience in the field of data engineering. If you are interested in this position, please apply through our website.