Empowering Innovation through AI Gateway Expertise
A highly skilled AI Gateway Engineer is required to spearhead the deployment and optimization of cutting-edge AI/ML models in a production environment. This individual will be responsible for designing, managing, and maintaining AI/API gateways like Kong, Mosaic, or Portkey.
Key Responsibilities:
* Design and manage AI/API gateways with expertise in tools such as Kong, Mosaic, or Portkey.
* Develop and maintain backend services utilizing Go, with Python as a valuable secondary skill.
* Optimize and productize AI/ML models for seamless integration into production environments.
* Leverage AWS to design and manage scalable cloud infrastructure solutions.
* Implement and manage observability tools including OpenTelemetry (OTel), Grafana, and Prometheus for real-time system performance monitoring.
* Apply prompt engineering techniques to enhance AI model efficiency and effectiveness.
* Collaborate closely with cross-functional teams to ensure smooth integration and deployment of AI-driven solutions.
Required Skills & Qualifications:
* Proven experience with API or AI gateways.
* Strong backend development skills in Go, with proficiency in Python a plus.
* Expertise in AI/ML optimization and productization.
* Proficiency in AWS and its various services for building scalable applications.
* Familiarity with observability tools like OTel, Grafana, and Prometheus.
* Practical experience with prompt engineering.
* A strong track record of delivering results in enterprise-grade environments.