As a skilled Data Engineer, you will be responsible for designing and developing scalable backend and data pipelines using Python. These systems must ensure reliability and scalability of Kubernetes-hosted applications.
Key Responsibilities:
* Design and develop Python-based data workflows on AWS services such as Glue, Step Functions, and SQS.
* Develop AI/LLM frameworks integration into production systems using Bedrock, RAG, Agents.
* Collaborate with Agile teams to maintain CI/CD pipelines.
Required Skills and Qualifications:
* Strong Python development experience.
* Expertise in SQL and NoSQL databases (key-value datastores and document storage).
* Proficiency in microservices and event-driven architecture.
* Kubernetes and CI/CD expertise.
* Knowledge of MQTT/WebSockets for real-time communication.
Additional Requirements:
* Experience with Java/Golang is a plus.
Languages:
* English: C1 Advanced