Pyspark Data Engineer

Virtusa Consulting Services
Posted on
Virtusa Consulting Services logo

Experience
6 - 9 yrs
Salary (CTC)
540,000 - 800,000
Job Location
Hyderabad, India
Vacancy
1
Designation
Pyspark Developer
Job Type
ONSITE

Job Description

Roles and Responsibilities :

  • Design, develop, test, deploy and maintain large-scale data pipelines using HL7 standards for healthcare industry clients.
  • Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions that meet business needs.
  • Develop complex SQL queries to extract insights from large datasets using PySpark on AWS Glue.
  • Troubleshoot issues related to data processing pipeline failures and implement fixes in a timely manner.

Job Requirements :

  • 6-9 years of experience in Data Engineering with expertise in HL7 ETL/ELT processes.
  • Strong understanding of Python programming language and its applications in big data processing (PySpark).
  • Experience working with cloud-based technologies such as AWS Glue for building scalable data pipelines.
  • Proficiency in designing efficient database schema's using relational databases like MySQL or PostgreSQL.

No Referrers Available

There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.