Sr. Data Engineer (Databricks)

Work Location: Hyderabad (Hybrid Model)

Prestige Skytech, Financial District

Experience: 6 - 8 years

Mandatory Skills: Databricks, Python/Pyspark, SQL

Job Summary

We are seeking a highly skilled Senior Data Engineer with strong expertise in PySpark, Databricks, and SQL. The ideal candidate should have hands-on experience building enterprise-scale batch and real-time data pipelines, optimizing high-volume workloads, and designing modern data architectures.

Key Responsibilities

• Design and develop scalable batch and streaming data pipelines using PySpark and Databricks
• Build and optimize enterprise data models and transformation pipelines using Snowflake and DBT
• Develop advanced SQL scripts, stored procedures, and performance-optimized queries
• Design and implement real-time streaming architectures
• Build integrations using APIs, event-driven architectures, and cloud-native services
• Optimize workloads for performance, scalability, and cost efficiency
• Design enterprise data platforms using Lakehouse, Data Mesh, Data Vault, and Fabric principles
• Work with cross-functional teams to build scalable analytics and data engineering solutions
• Implement CI/CD and DevOps practices for data engineering pipelines
• Provide technical leadership and mentor engineering teams

Required Skills

• Strong hands-on experience with Python / PySpark
• Expertise in Databricks
• Advanced SQL expertise
• Strong experience with Stored Procedures and complex SQL optimization
• Hands-on experience with streaming frameworks and real-time processing
• Experience with REST APIs and enterprise integrations
• Strong understanding of distributed data processing
• Working knowledge of AWS and/or Azure
• Excellent analytical and debugging skills

Strong Knowledge Of

• Data Warehousing
• Data Vault Modeling
• Data Mesh
• Data Lake & Lakehouse Architecture
• Enterprise Data Architecture Patterns

Good to Have

• Kafka/Event Hub/Kinesis
• Airflow
• Terraform
• Unity Catalog
• Delta Live Tables
• CI/CD pipelines

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.