Project Overview
As a senior data professional, you will be responsible for designing and implementing high-performance data processing pipelines using Python libraries.
* Design and implement scalable data pipelines that meet performance requirements
* Develop and expose APIs to facilitate data access
* Process and integrate normalized datasets from various sources
* Collaborate on infrastructure automation and configuration management
Required Skills and Qualifications
To succeed in this role, you should have:
* Strong proficiency in Python programming language, with expertise in Pandas and Polars libraries
* Experience building backend services or APIs using frameworks like FastAPI
* Solid understanding of data modeling principles and dataset handling
* Familiarity with enterprise architecture patterns and data integration from multiple sources
* Proficiency in version control systems and CI/CD pipeline management
* Infrastructure-as-Code experience with Bicep or comparable tools
Beyond the technical requirements, successful candidates will demonstrate excellent collaboration skills, a passion for innovative solutions, and a commitment to delivering high-quality results under tight deadlines.