Job Title: Data Warehouse Architect
A prominent player in the gaming industry is seeking an experienced Data Architect with DataWarehouse Engineer expertise to spearhead the design and implementation of a cutting-edge data warehouse instance for a key product line.
The ideal candidate should be passionate about data architecture, thrive in fast-paced environments, and have a proven track record of setting up high-performance lakehouse platforms on Databricks with a strong foundation in data warehousing principles.
Key Responsibilities:
* Design and deploy a bespoke Databricks Lakehouse instance tailored to meet the client's product-level data needs.
* Develop robust data ingestion pipelines using Spark (PySpark/Scala) and Delta Lake to ensure seamless data flow.
* Integrate AWS-native services (S3, Glue, Athena, Redshift, Lambda) with Databricks for optimal performance and scalability.
* Define data models, optimize query performance, and establish warehouse governance best practices.
* Collaborate cross-functionally with product teams, data scientists, and DevOps to streamline data workflows and achieve operational excellence.
* Maintain CI/CD, preferably DBX, for data pipelines using GitOps and Infrastructure-as-Code to ensure version control and reproducibility.
* Monitor data jobs and resolve performance bottlenecks or failures across environments to ensure uninterrupted service.