Cloud Data Engineer
Join our team of innovative cloud data engineers and help us design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Services (Azure Data Factory, Azure Databricks, Azure Synapse, etc.).
Job Responsibilities:
* Design and develop high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks.
* Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets.
* Optimize data workflows/pipelines for performance and cost efficiency in a cloud environment.
* Implement best practices around data security, governance, and compliance.
* Develop CI/CD pipelines for data engineering workflows.
* Monitor, troubleshoot, and enhance existing data solutions for reliability and performance.
Required Skills and Qualifications:
* Azure Data Bricks; Azure Data Factory; Azure Data Services
* Experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg)
* Use of Data Quality tools (Great Expectations, Soda)
* Knowledge of Step Functions, EventBridge, or Kinesis
* Best practices for API security (Cognito, WAF, IAM Policies)
Benefits:
* Professional development and constant evolution of your skills, always in line with your interests
* Opportunities to work outside Brazil
* A collaborative, diverse, and innovative environment that encourages teamwork
* Health insurance
* Dental Plan
* Life insurance
* Transportation vouchers
* Meal/Food Voucher
* Childcare assistance
* Gympass
Others:
We promote an inclusive culture and think of different actions of inclusion and social responsibility. Come to be part of our team!