AI Gateway Engineer
We are seeking a skilled AI Gateway Engineer to join our team. The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI/ML models in a production environment. You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting.
Key Responsibilities:
* Design and manage AI/API gateways like Kong, Mosaic, or Portkey.
* Develop and maintain backend services, primarily using Go, with Python as a valuable secondary skill.
* Optimize and productize AI/ML models for production use, ensuring performance, scalability, and reliability.
* Leverage AWS to build and manage our cloud infrastructure.
* Implement and manage observability tools, including OpenTelemetry (OTel), Grafana, and Prometheus, to monitor system health and performance.
* Apply prompt engineering techniques to improve the efficiency and effectiveness of AI models.
* Collaborate with cross-functional teams to ensure seamless integration and deployment of AI solutions.
Required Skills & Qualifications:
* Proven experience with API or AI gateways (e.G., Kong, Mosaic, Portkey).
* Strong backend development skills, particularly in Go ;
proficiency in Python is a plus.
* Experience with AI/ML optimization and productization .
* Expertise in AWS, including its various services for building scalable applications.
* Familiarity with observability tools like OTel, Grafana, and Prometheus.
* Practical experience with prompt engineering .
* A history of working in enterprise-grade environments .
Other Details:
* Location: Remote (preferred in LATAM region)
* Length: 1+ Year
* Client: Gaming Giant
1.
The difference between something good and something great is attention to detail – AVM Consulting.