Azure Data Engineer Role
Transforming Business with Data Insights
In this pivotal role, you will design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Services.
Main Responsibilities:
* Bulk Data Processing: Leverage Apache Spark (PySpark) on Azure Databricks to drive data-driven decision-making.
* Data Collaboration: Work closely with cross-functional teams – data scientists, analysts, and business stakeholders – to deliver high-quality, reliable datasets.
* Data Workflow Optimization: Enhance performance and cost efficiency in cloud environments through data workflow optimization.
Essential Skills:
* Columnar and Table Formats: Excel in experience with Parquet, Delta, Hudi, and Iceberg formats.
* Data Quality Tools: Utilize Great Expectations and Soda for robust data quality assurance.
* Cloud Functionality: Demonstrate knowledge of Step Functions, EventBridge, or Kinesis for seamless integration.
We Offer:
* Professional Growth: Opportunities for continuous learning and skill development.
* Cross-Cultural Experience: Chance to work outside Brazil.
* Innovative Environment: Collaborative, diverse, and dynamic work atmosphere that fosters teamwork and creativity.