Azure Databricks & Pyspark Professional

Diverse Lynx
Posted on
Diverse Lynx logo
Experience
5 - 9 yrs
Job Location
Gurugram, India
Vacancy
1
Designation
Pyspark Developer
Job Type
ONSITE

Job Description

Job Title: Azure Databricks + PySpark Developer
Location: Gurgaon
Interview Mode: InPerson
Job Summary
Cognizant is looking for experienced Azure Databricks + PySpark Developers to join its Data Engineering practice. The ideal candidate should have strong expertise in Azure cloud technologies, Databricks, PySpark, and SQL, with handson experience building scalable data pipelines and modern data lake solutions.
Key Responsibilities
  • Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and PySpark.
  • Build and optimize data processing solutions for largescale datasets.
  • Develop data pipelines using Azure Data Factory and Azure Data Lake Storage (ADLS).
  • Write optimized Spark SQL and SQL queries for highperformance data processing.
  • Implement Delta Lake architecture and optimize Databricks workloads.
  • Collaborate with business analysts, data scientists, and application teams to deliver data solutions.
  • Monitor, troubleshoot, and optimize production data pipelines.
  • Ensure data quality, security, goverce, and compliance.
  • Participate in code reviews and follow Agile development practices.
Required Skills
  • Strong handson experience with Microsoft Azure.
  • Expertise in Azure Databricks.
  • Strong experience with PySpark and Apache Spark.
  • Advanced SQL programming.
  • Experience with Azure Data Factory (ADF).
  • Experience with Azure Data Lake Storage (ADLS Gen2).
  • Knowledge of Delta Lake.
  • Strong Python programming skills.
  • Experience designing ETL/ELT pipelines.
  • Good understanding of data warehousing concepts.
Preferred Skills
  • Azure Synapse Analytics.
  • Azure Event Hubs or Azure Service Bus.
  • Azure DevOps and CI/CD.
  • Git version control.
  • Docker and Kubernetes.
  • Snowflake experience.
  • Terraform or Infrastructure as Code.
Qualifications
  • Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
  • 5.5 9 years of relevant experience in Data Engineering.
  • Strong communication and stakeholder management skills.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

No Referrers Available

There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.