AI Gateway Specialist
We are seeking a skilled professional with hands-on experience in AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI/ML models in production environments.
* Design and manage AI/API gateways such as Kong, Mosaic, or Portkey.
* Develop and maintain backend services primarily using Go, with Python as a valuable secondary skill.
* Optimize and productize AI/ML models for production use ensuring performance, scalability, and reliability.
* Utilize AWS to build and manage our cloud infrastructure.
* Implement and manage observability tools including OpenTelemetry (OTel), Grafana, and Prometheus to monitor system health and performance.
* Apply prompt engineering techniques to improve the efficiency and effectiveness of AI models.
Essential Skills & Qualifications:
* Proven experience with API or AI gateways (e.g., Kong, Mosaic, Portkey).
* Strong backend development skills particularly in Go; proficiency in Python is a plus.
* Experience with AI/ML optimization and productization.
* Expertise in AWS including its various services for building scalable applications.
* Familiarity with observability tools like OTel, Grafana, and Prometheus.
* Practical experience with prompt engineering.
Preferred Qualifications:
* A history of working in enterprise-grade environments.