Job Overview
We are seeking a skilled Data Engineer to join our team and contribute to the development of cutting-edge data pipelines.
This role is focused on leveraging Python-based services, AWS data workflows, and AI/LLM frameworks to enable advanced media processing capabilities.
About the Role:
* Design and develop backend and data pipelines using Python.
* Develop solutions based on AWS services such as Glue, Step Functions, and SQS for data workflows and Serverless architecture.
* Integrate AI/LLM frameworks (Bedrock, RAG, Agents) into production systems.
* Ensure scalability and reliability of Kubernetes-hosted applications.
* Collaborate with Agile teams and maintain CI/CD pipelines.
Requirements:
* Strong Python development experience.
* Expertise in SQL and NoSQL databases (key-value datastores, and document storage).
* Expertise in AWS services (Glue, Step Functions, SQS, Lambda, S3).
* Knowledge of AI/LLM frameworks and integration patterns.
* Familiarity with MQTT/WebSockets for real-time communication.
* Proficiency in microservices and event-driven architecture.
* Kubernetes and CI/CD expertise.
* Strong system design skills for distributed environments.
* English language proficiency at B2 level.