Job Opportunity: Technical Leader
We are seeking a skilled technical leader to oversee the design, integration, and evolution of large-scale distributed data platforms.
This individual will serve as the technical visionary for our data platform, defining architecture blueprints, designing scalable solutions, and leading cross-functional teams to drive innovation and growth.
Key Responsibilities:
* Technical Visionary: Define and evolve the end-to-end data platform architecture, aligning with business requirements and industry standards.
* Solution Design: Translate solution requests into scalable, compliant architecture blueprints, incorporating emerging technologies and best practices.
* Team Leadership: Lead and mentor cross-functional teams, ensuring seamless collaboration and knowledge sharing.
* Stakeholder Engagement: Engage with stakeholders to influence architecture decisions, driving alignment and consensus across engineering and client teams.
* Platform Enablement: Develop and maintain reference architectures, design patterns, and integration frameworks to enable platform engineers and developers.
* Tech Selection: Oversee the selection, integration, and tuning of open-source components, such as Spark, Trino, Airflow, NiFi, YuniKorn, Superset, Iceberg, Ranger, DataHub, and S3.
* Architecture Review: Participate in Architecture Review Boards (ARBs) to ensure deployments meet enterprise standards and security requirements.
Required Skills and Qualifications:
* Core Expertise: Proficiency in Spark, Trino, Airflow, NiFi, YuniKorn, Superset, Iceberg, Ranger, DataHub, and S3.
* Infrastructure & Automation: Experience with Terraform, Kubernetes (K8s), OpenShift (OCP), Docker, and Linux.
* Security & Governance: Knowledge of IAM, SSO, KMS, Kerberos, Encryption, and RBAC.
* Monitoring & Observability: Familiarity with Grafana, Datadog, and Prometheus.
* Programming: Proficiency in Java, Scala, and Python.
* Architecture Practices: Experience with solution design, reference architectures, system modeling, and scaling patterns.
Benefits:
* Flexible Work Schedule: Enjoy a flexible work schedule with PTO for any reason, including sick days.
* Personal Laptop: Receive a personal laptop to enhance productivity and work efficiency.
* Health/Sport Budget: Access to a health/sport budget to support your well-being.
* Fully Remote: Work from anywhere, fully remote.