Join to apply for the Data Engineer (Senior) ID40199 role at AgileEngine.
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and startups across 17+ industries, with a people-first culture and multiple Best Place to Work awards.
Overview
We are looking for a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You’ll work with AWS and big data frameworks like Hadoop and Spark to drive data initiatives across the company.
What you will do
* Design, build, and maintain large-scale data pipelines and data processing systems in AWS.
* Develop and optimize distributed data workflows using Hadoop, Spark, and related technologies.
* Collaborate with data scientists, analysts, and product teams to deliver reliable and efficient data solutions.
* Implement best practices for data governance, security, and compliance.
* Monitor, troubleshoot, and improve the performance of data systems and pipelines.
* Mentor junior engineers and contribute to building a culture of technical excellence.
* Evaluate and recommend new tools, frameworks, and approaches for data engineering.
Must haves
* Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
* 5+ years of experience in data engineering, software engineering, or related roles.
* Strong hands-on expertise with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.).
* Deep knowledge of big data ecosystems, including Hadoop (HDFS, Hive, MapReduce) and Apache Spark (PySpark, Spark SQL, streaming).
* Strong SQL skills and experience with relational and NoSQL databases.
* Proficiency in Python, Java, or Scala for data processing and automation.
* Experience with workflow orchestration tools (Airflow, Step Functions, etc.).
* Solid understanding of data modeling, ETL/ELT processes, and data warehousing concepts.
* Excellent problem-solving skills and ability to work in fast-paced environments.
* Ability to work in German Time Zone (6:00–7:00 am to 2:00–3:00 pm Brazil/ART time).
* Upper-Intermediate English level.
Nice to have
* Experience with real-time data streaming platforms (Kafka, Kinesis, Flink).
* Knowledge of containerization and orchestration (Docker, Kubernetes).
* Familiarity with data governance, lineage, and catalog tools.
* Previous leadership or mentoring experience.
Perks and benefits
* Professional growth: Mentorship, TechTalks, and personalized growth roadmaps.
* Competitive compensation: USD-based compensation with budgets for education, fitness, and team activities.
* A selection of exciting projects: Modern solutions development with Fortune 500 enterprises and leading brands.
* Flextime: Flexible schedule including options to work from home or in the office for work-life balance.
Job details
* Seniority level: Mid-Senior level
* Employment type: Full-time
* Job function: IT Services and IT Consulting
Referrals increase your chances of interviewing at AgileEngine.
#J-18808-Ljbffr