Azure Databricks

Job Details:

Employment Type: Permanent Payroll of the hiring organization

Client: A Leading IT Services Company

Experience Required: 5 to 16 Years

Location: PAN India (Hybrid)

Notice Period: 0-30 days

Key Responsibilities

• Design, develop and optimize ETL/ELT pipelines using Databricks PySpark to ingest, transform and serve data for digital customer experience use cases
• Build and maintain high-quality performant SQL transformations and dimensional curated data layers for analytics and downstream consumption
• Implement best practices for Databricks engineering notebooks vs repos, modular code, cluster/job configuration, performance tuning and cost awareness
• Use Python for data processing utilities, validations, orchestration helpers and reusable libraries
• Manage source control using Git with enterprise workflows across GitHub, Bitbucket; enforce PR reviews, branching strategies and coding standards
• Build and maintain CI/CD pipelines using Azure DevOps automating testing, packaging and deployment of data code/artifacts across environments
• Ensure data quality and reliability through validations, reconciliation checks, monitoring and operational runbooks
• Collaborate with product/app teams, analysts and platform teams to translate requirements into scalable data products aligned to customer experience journeys
• For Senior Developer: lead module-level design, mentor engineers, drive standards for CI/CD and code quality, and own delivery for critical pipelines

Primary Skills (Must-Have)

• Strong hands-on experience with:
• Python
• PySpark
• Databricks jobs, workflows, clusters, repos
• SQL advanced querying, optimization
• Strong experience with Git and repository platforms GitHub and/or Bitbucket
• Hands-on experience implementing CI/CD for data engineering workloads
• Strong working experience with Azure DevOps Boards, Repos, Pipelines, build/release workflows

Apply Now!

Share your updated resume with nilima@mississippiconsultants.net