We are looking for a Databricks Engineer with strong Python, SQL, and AI parsing/extraction skills to help migrate an underperforming customer solution to Databricks.
Key Responsibilities
- Migrate existing data pipelines and workflows to Databricks.
- Analyze the customer’s current solution and implement improvements.
- Build and optimize Python- and SQL-based pipelines.
- Develop and enhance AI-driven parsing and extraction components.
- Ensure performance, data quality, and reliability.
- Collaborate with technical and business teams to deliver a stable solution.
Required Skills
- Hands-on experience with Databricks (clusters, notebooks, Delta Lake).
- Strong Python (required) and SQL skills.
- Experience with AI parsing/extraction and text-processing workflows.
- Background in data migration and troubleshooting.
Preferred
- Experience with Azure Databricks, MLflow, or Lakehouse architecture.
- Knowledge of document intelligence tools and DevOps workflows.