Job Title: Software Engineer - Data Pipeline Specialist
We are seeking a skilled Software Engineer to join our team as a Data Pipeline Specialist. This role will be responsible for designing, developing, and maintaining large-scale data pipelines using Python.
About the Role
This is an excellent opportunity to work on complex data processing projects and contribute to the development of our data-driven applications. As a Data Pipeline Specialist, you will be working closely with our engineering team to design, build, and deploy scalable data pipelines that meet the needs of our business.
Your primary focus will be on developing and maintaining high-quality data pipelines using Python, AWS services such as Glue, Step Functions, and SQS, and integration with AI/LLM frameworks like Bedrock, RAG, and Agents.
Required Skills and Qualifications
To be successful in this role, you will need:
* Strong experience with Python programming language and its ecosystem.
* Expertise in SQL and NoSQL databases, including key-value datastores and document storage.
* Familiarity with AWS services, including Glue, Step Functions, SQS, Lambda, and S3.
* Knowledge of AI/LLM frameworks and integration patterns.
* Proficiency in microservices and event-driven architecture.
* Kubernetes and CI/CD expertise.
* Strong system design skills for distributed environments.
* Excellent communication and teamwork skills.
Benefits
We offer a competitive salary and benefits package, including:
* A generous bonus scheme.
* A comprehensive health insurance plan.
* A 401(k) retirement savings plan.
* Flexible working hours and remote work options.
Others
We are an equal opportunities employer and welcome applications from all qualified candidates. If you are passionate about data engineering and want to join a dynamic team, please submit your application today.