Looking for an experienced Senior Data Engineer to join the Prosigliere team.
Description
We are seeking a highly skilled and motivated Data Engineer to join our growing team. The ideal candidate will be instrumental in designing, building, and maintaining robust and scalable data pipelines and infrastructure. This role requires a deep understanding of data warehousing principles, ETL processes, and database management, with a strong focus on ensuring data quality, accessibility, and performance to support our analytical and reporting needs. You will play a critical role in transforming raw data into actionable insights, empowering our data-driven decision-making across the organization.
Responsibilities
* Design, develop, and maintain scalable and efficient ETL/ELT pipelines using various data integration techniques to ingest, transform, and load data from diverse sources into our data warehouse.
* Manage and optimize data models and structures within Snowflake, ensuring strategic organization for performance, cost-efficiency, and ease of consumption by analytics and reporting tools.
* Administer and optimize PostgreSQL databases, including schema design, query optimization, and performance tuning.
* Develop, monitor, and troubleshoot data workflows and orchestrations using Apache Airflow to ensure timely and reliable data delivery.
* Collaborate closely with data analysts, data scientists, and business stakeholders to understand data requirements and translate them into technical solutions.
* Ensure data quality, accuracy, and consistency by implementing robust data validation, cleansing, and monitoring processes.
* Troubleshoot, debug, and optimize existing Tableau reports, and develop new, insightful dashboards and visualizations to meet business needs.
* Implement and maintain data governance best practices, including data security, privacy, and compliance.
* Participate in code reviews, contribute to architectural discussions, and promote best practices in data engineering.
* Continuously evaluate and recommend new technologies and methodologies to improve our data platform and processes.
Technology Requirements
* Databases: Strong expertise in PostgreSQL and extensive experience with Snowflake data warehousing.
* Orchestration: Proficient in using Apache Airflow for workflow management and scheduling.
* ETL/ELT: Proven experience in designing and implementing efficient ETL/ELT processes.
* Business Intelligence: Hands-on experience with Tableau for report troubleshooting and development.
* Programming Languages: Strong proficiency in Python for data manipulation, scripting, and automation.
* Cloud Platforms: Experience with at least one major cloud provider (e.g., AWS, Azure, GCP) and their data-related services (e.g., S3, EC2, Azure Data Lake Storage, Google Cloud Storage, BigQuery).
* Data Concepts: Solid understanding of data warehousing concepts, dimensional modeling, data lakes, and data marts.
* Version Control: Experience with Git and collaborative development workflows.
* SQL: Advanced SQL writing and optimization skills.
* Big Data Technologies (Plus): Familiarity with big data technologies like Spark, Kafka, or similar is a plus.
Profile Requirements
* Ability to learn quickly and work independently.
* Strong project management and interpersonal skills.
* A team player who enjoys collaborating with others.