Job Title:
About the Role:
Key Responsibilities:
1. Design and implement RAG models for search across vast databases of documents
2. Pre-process and embed over half a billion documents to ensure they are searchable and contextually accurate
3. Semantic chunking strategies for efficient information retrieval
4. Develop and refine automated evaluation pipelines for model performance
5. Fine-tune Large Language Models (LLMs) for various textual applications
Requirements:
* 1+ years of experience as a Software Engineer or Data Scientist with expertise in Search Technology
* Proficiency in Python development, including API creation, model training, testing, and backend programming
* Familiarity with LangChain for building LLM workflows using tools, memory, and retrieval
* Strong understanding of software design patterns and data structures
Nice to Have Skills:
* Experience with AWS infrastructure (IAM, VPC, S3)
* Knowledge of RAG architectures and textual RAG use cases