Design a Data Warehouse Instance
About the Role:
As a skilled professional with expertise in data architecture, you will spearhead the design and implementation of a new data warehouse instance. This role requires hands-on experience with Databricks (DBX) and AWS-native data services.
Key Responsibilities:
* Design and Deploy: Create a tailored Databricks Lakehouse instance that meets client-specific product-level data needs.
* Implement Robust Pipelines: Use Spark (PySpark/Scala) and Delta Lake to architect and implement efficient data ingestion pipelines.
* Integrate AWS Services: Integrate AWS-native services (S3, Glue, Athena, Redshift, Lambda) with Databricks for optimized performance and scalability.
* Define Data Models: Optimize query performance and establish warehouse governance best practices.
* Collaborate Cross-Functionally: Work with product teams, data scientists, and DevOps to streamline data workflows.
Requirements:
* Hands-on experience with Databricks (DBX) and AWS-native data services.
* Strong understanding of data architecture principles.
* Excellent problem-solving skills.
* Ability to work collaboratively in a team environment.
Benefits:
This role offers a competitive compensation package, comprehensive benefits, and opportunities for growth and development.