Senior Data Engineer
We are looking for a highly skilled and experienced Senior Data Engineer to join our team. The successful candidate will have a strong background in designing, building, and maintaining large-scale data pipelines and data processing systems.
Job Description:
* Design, build, and maintain large-scale data pipelines and data processing systems in AWS.
* Develop and optimize distributed data workflows using Hadoop, Spark, and related technologies.
* Collaborate with data scientists, analysts, and product teams to deliver reliable and efficient data solutions.
* Implement best practices for data governance, security, and compliance.
* Monitor, troubleshoot, and improve the performance of data systems and pipelines.
* Mentor junior engineers and contribute to building a culture of technical excellence.
* Evaluate and recommend new tools, frameworks, and approaches for data engineering.
Required Skills and Qualifications:
* Bachelor's or Master's degree in Computer Science, Engineering, or related field.
* 5+ years of experience in data engineering, software engineering, or related roles.
* Strong hands-on expertise with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.).
* Deep knowledge of big data ecosystems, including Hadoop (HDFS, Hive, MapReduce) and Apache Spark (PySpark, Spark SQL, streaming).
* Strong SQL skills and experience with relational and NoSQL databases.
* Proficiency in Python, Java, or Scala for data processing and automation.
* Experience with workflow orchestration tools (Airflow, Step Functions, etc.).
* Solid understanding of data modeling, ETL/ELT processes, and data warehousing concepts.
* Excellent problem-solving skills and ability to work in fast-paced environments.
* Ability to work in a collaborative team environment.
Benefits:
* Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
* Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation.
* Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.