We are seeking an experienced Artificial Intelligence Engineer to join our team and contribute to the development of cutting-edge technologies. The ideal candidate will have a strong background in search technology, machine learning, and software development.
Key Responsibilities:
* Model Development: Design, build, and optimize Retrieval-Augmented Generation (RAG) models for large-scale medical and scientific documents.
* Pre-processing: Pre-process over half a billion documents to ensure they are searchable and contextually accurate.
* Semantic Chunking Strategies: Develop and implement semantic chunking strategies to improve the automated evaluation pipeline.
* LLM Fine-tuning: Fine-tune Large Language Models (LLMs) for textual RAG use cases.
Requirements:
* 1+ years of experience as a Search Engineer or AI Engineer.
* Strong search technology skills, including OpenSearch and scalable search systems.
* 2+ years of Python development experience, including API creation, model training, testing, and backend programming.
* Familiarity with LangChain for building LLM workflows using tools, memory, and retrieval.