We are seeking an experienced Data Engineer to join our team. The primary responsibility of this role is to design, develop, and maintain data pipelines for threat intelligence ingestion, validation, and export automation flows.
Responsibilities:
* Data Ingestion
* Data Validation
* Collaboration with Threat Analysts
* Automation Scripting
* Pipeline Optimization
* Troubleshooting
* Documentation
* Technology Updates
* Technical Guidance
Requirements:
* Proven experience as a Data Engineer or similar role, with a focus on data ingest, validation, and export automation.
* Python Proficiency
* Experience with data pipeline orchestration tools such as Apache Airflow, Apache NiFi, or similar.
* Familiarity with cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform.
* Data Validation Techniques
* Containerization Technologies
* Excellent problem-solving skills and attention to detail.
* Strong communication and collaboration skills, with the ability to work effectively in a team environment.