Design and develop efficient and scalable data pipelines in Palantir Foundry. Implement and manage ETL (Extract, Transform, Load) processes to integrate and transform data from various sources. Collaborate with cross-functional teams to define and enhance data architecture. Ensure data quality, integrity, and security through validation and monitoring processes. Develop and maintain relational (SQL) and non-relational (NoSQL) databases. Automate workflows and routine tasks using Python scripts. Document processes and technical solutions clearly and concisely.
Skills Required
1. Ability to solve problems efficiently and work in a dynamic, collaborative environment.
2. Excellent communication skills and ability to work in a team.
Skills Desirable
1. Teamwork.
2. Ability to work under pressure.
Technical Required
1. Proven experience as a Data Engineer or in a similar role.
2. Proficiency in Python and experience in developing scripts and automating tasks.
3. Solid knowledge of ETL processes and related tools.
4. Experience with relational (SQL) and non-relational (NoSQL) databases.
5. Advanced command of the English language.
Technical Desirable
1. Previous experience working with Palantir Foundry.
2. Knowledge of other Big Data tools and cloud technologies.
#J-18808-Ljbffr