Career Transformation for Data Engineering Experts
We are seeking a seasoned Data Engineer to join our team and embark on an exciting career journey. This role offers the perfect blend of technical challenges, opportunities for growth, and collaborative environment.
About the Role
In this position, you will be responsible for designing, developing, and maintaining scalable data processing pipelines using AWS services such as API Gateway, Lambda/Fargate, S3, Glue, and CloudWatch. Your expertise in PySpark, particularly in areas like partitioning, joins, and optimization, will enable us to harness the power of big data and drive business insights.
Key Responsibilities
* Proven experience with AWS (API Gateway, Lambda/Fargate, S3, Glue, CloudWatch) and strong knowledge of PySpark
* Experience with integration and manipulation of data in REST APIs and good practices in version control (Git) and CI/CD
* Knowledge of infrastructure as code (Terraform or CloudFormation), columnar and table formats (Parquet, Delta, Hudi, Iceberg), and Data Quality tools (Great Expectations, Soda)
* Use of Step Functions, EventBridge, or Kinesis, best practices for API security (Cognito, WAF, IAM Policies), and soft skills like good communication and teamwork
What We Offer
We provide a comprehensive benefits package, including health insurance, dental plan, life insurance, transportation vouchers, meal/food voucher, childcare assistance, and more. Our commitment to employee well-being extends to a collaborative, diverse, and innovative work environment that encourages teamwork and professional development.
Become a Part of Our Team
At [Company], we foster an inclusive culture that values individuality and promotes social responsibility. Join us in building a workplace that respects differences and empowers employees to grow professionally and personally.