Databricks Data Engineer

NOTE: Please carry a copy of your Aadhar or PAN Card Xerox

Relevant Experience Required

• Hands-on experience in developing, maintaining, and optimizing data pipelines using Databricks.
•   Knowledge of ETL/ELT pipelines, data ingestion, transformation, and orchestration.
•   Exposure to data lake, data warehouse, or lakehouse architectures.
•   Experience with data migration, integration, and automation.
•   Collaboration with senior engineers, architects, and analytics teams for solution delivery.
•   Familiarity with security, access control, and compliance best practices.
•   Working experience in Agile and DevOps environments

Must Have Skills

• Hands-on experience with Databricks platform, including:
• PySpark / Spark SQL for data processing and transformation
• Delta Lake for ACID-compliant data storage
• Notebooks for workflow orchestration and collaborative development
•   Strong programming skills in Python and SQL.
•   Experience in data ingestion from batch and streaming sources.
•   Knowledge of ETL/ELT design patterns and data pipeline optimization.
•   Familiarity with cloud data storage and compute environments (AWS, Azure, or GCP).
•   Basic understanding of workflow orchestration tools (Airflow, Databricks Jobs).
•   Exposure to DevOps concepts, CI/CD pipelines, and version control (Git).
•   Awareness of data security, access control, and compliance considerations.
•   Understanding of performance tuning, partitioning, and caching strategies in Spark.

Responsibilities

• Develop and maintain scalable data pipelines using Databricks (PySpark, Delta Lake).