Databricks Engineer

We are looking for a Databricks Engineer to support the migration of Snowflake workloads to Databricks. The role involves developing and validating data pipelines, executing migration activities, performing testing and reconciliation, resolving defects, and collaborating with architects and QA teams to ensure successful project delivery.

• Develop and implement assigned data pipelines, jobs, scripts, and workloads in Databricks.
• Migrate Snowflake workloads to Databricks following project standards.
• Perform data validation, reconciliation, and parity checks between Snowflake and Databricks.
• Execute unit testing and integration testing for migrated workloads.
• Investigate and resolve data mismatches, execution failures, and functional defects.
• Support deployments across SIT, QA, and Production environments.
• Collaborate with Senior Data Engineers, QA Analysts, and Solution Architects to resolve migration issues.
• Prepare technical documentation, validation reports, reconciliation notes, and deployment artifacts.
• Participate in defect triage and support release management activities.

• Strong experience with Databricks
• Proficiency in Python and SQL
• Experience with Snowflake
• Knowledge of Delta Lake
• Experience in data pipeline development and optimization
• Data validation and reconciliation experience
• Hands-on experience with Git version control
• Unit testing and defect analysis skills
• Experience with cloud-based data engineering platforms
• Good communication and collaboration skills

• Experience in Snowflake to Databricks migration projects
• Knowledge of CI/CD and release management processes
• Experience working with QA and architecture teams
• Exposure to enterprise-scale cloud data modernization projects