Python Data Engineer Job Description
This role emphasizes Python-based services, AWS data workflows and integration with AI/LLM frameworks to enable advanced media processing capabilities.
* Main Responsibilities:
* - Design and develop backend and data pipelines using Python.
* - Development based on AWS services such as Glue, Step Functions and SQS for data workflows + Serverless.
* - Integrate AI/LLM frameworks into production systems.
* - Ensure scalability and reliability of Kubernetes-hosted applications.
* - Collaborate with Agile teams and maintain CI/CD pipelines.
* Mandatory Skills:
* - Strong Python development experience.
* - Expertise in SQL and NoSQL databases (key-value datastores and document storage).
* - Expertise in AWS services (Glue, Step Functions, SQS, Lambda, S3).
* - Knowledge of AI/LLM frameworks and integration patterns.
* - Familiarity with MQTT/WebSockets for real-time communication.
* - Proficiency in microservices and event-driven architecture.
* - Kubernetes and CI/CD expertise.
* - Strong system design skills for distributed environments.
* Nice-to-Have Skills:
* - Java/Golang experience.
This is an exciting opportunity to leverage your technical expertise and contribute to the development of innovative data solutions. If you have a passion for Python and cloud computing, we encourage you to apply for this position.