Experience
5 - 10 yrs
Job Location
Bengaluru, India
Vacancy
1
Designation
Data Engineer
Job Type
Not specified
Job Description
Skills
Exp Required
Databricks
5+ Yrs
Py spark
5+ Yrs
Spark
5+ Yrs
SQL
5+ Yrs
AWS
2+ Yrs
ECMS Req #
527070
Relevant and Total years of experience
Relevant 5+ years and Total 6 + years
Detailed job description - Skill Set:
- Strong Data Engineer with 5+ Years exp in Data Bricks , Pyspark , SQL
- Design and develop data processing pipelines and analytics solutions using Databricks.
- Architect scalable and efficient data models and storage solutions on the Databricks platform.
- Collaborate with architects and other teams to migrate current solution to use Databricks.
- Optimize performance and reliability of Databricks clusters and jobs to meet SLAs and business requirements.
- Use best practices for data governance, security, and compliance on the Databricks platform.
- Mentor junior engineers and provide technical guidance.
- Stay current with emerging technologies and trends in data engineering and analytics to drive continuous improvement.
- Strong understanding of distributed computing principles and experience with big data technologies such as Apache Spark.
- Experience with cloud platforms such as AWS, Azure, or GCP, and their associated data services.
- Proven track record of delivering scalable and reliable data solutions in a fast-paced environment.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills with the ability to work effectively in cross-functional teams.
- Good to have experience with containerization technologies such as Docker and Kubernetes.
- Knowledge of DevOps practices for automated deployment and monitoring of data pipelines.
Mandatory Skills
- Strong Data Engineer with 5+ Years exp in Data Bricks , Pyspark , SQL
- Design and develop data processing pipelines and analytics solutions using Databricks.
- Architect scalable and efficient data models and storage solutions on the Databricks platform.
- Collaborate with architects and other teams to migrate current solution to use Databricks.
- Optimize performance and reliability of Databricks clusters and jobs to meet SLAs and business requirements.
- Use best practices for data governance, security, and compliance on the Databricks platform.
- Mentor junior engineers and provide technical guidance.
- Stay current with emerging technologies and trends in data engineering and analytics to drive continuous improvement.
- Strong understanding of distributed computing principles and experience with big data technologies such as Apache Spark.
- Experience with cloud platforms such as AWS, Azure, or GCP, and their associated data services.
Vendor Billing range in local currency (per day)
INR 8000/Day
Work Location
Bangalore, Hyderabad (Preferred)
Notice period
15 days
WFO/WFH/Hybrid WFO
Hybrid
BGCHECK before or After onboarding
Post onboarding
Skill Matrix:
Skills
Exp Required
Databricks
5+ Yrs
Py spark
5+ Yrs
Spark
5+ Yrs
SQL
5+ Yrs
AWS
2+ Yrs