AWS Glue Pyspark Developer - 8th April - Virtual Interview - Hyderabad

Tata Consultancy Services
Posted on
Tata Consultancy Services logo
Experience
5 - 10 yrs
Salary (CTC)
₹480,000 - ₹620,000
Job Location
Hyderabad, India
Vacancy
6
Designation
Pyspark Developer
Job Type
ONSITE

Job Description

Location: PySpark & AWS Glue Developer

Experience Range: 5-10 Years

Location: Hyderabad


Virtual Interview : 8th April (Wednesday)

Timing : 10 am - 5pm


Job Description:

We are looking for a PySpark & AWS Glue Developer with 45 years of experience to design, develop, and maintain scalable data ingestion and transformation pipelines on AWS. The role focuses on building robust ETL solutions using PySpark and AWS Glue to support analytics and reporting use cases.

Key Responsibilities

  • Design, develop, and maintain ETL pipelines using PySpark and AWS Glue.
  • Build and optimize AWS Glue jobs (PySpark-based) for batch data processing.
  • Ingest and transform structured and semi-structured data into data lakes or data warehouses.
  • Implement data quality checks, validations, and reconciliation mechanisms.
  • Optimize performance through partitioning, caching, and efficient Spark transformations.
  • Write and optimize SQL for data validation and downstream analytical consumption.
  • Prepare and maintain technical documentation including ETL mappings and LLDs.
  • Support SIT/UAT activities and troubleshoot production issues as required.

Required Skills & Experience

  • 4–5 years of hands-on experience in ETL / Data Engineering roles.
  • Strong experience with PySpark for large-scale data processing.
  • Hands-on experience with AWS Glue (Glue Jobs, Crawlers, Data Catalog).
  • Strong SQL skills for querying, transformations, and validation.
  • Good understanding of data warehousing and data lake concepts.
  • Exposure to AWS services such as S3 and IAM.
  • Experience with UNIX/Linux and basic shell scripting.

Good-to-Have Skills

  • Exposure to AWS orchestration services such as Step Functions or Airflow.
  • Experience in performance tuning and cost optimization on AWS.
  • Exposure to CI/CD practices and version control tools like Git.
  • Exposure to DataStage or migration projects is a plus.



HR - Talent Acquisition Group

Let's connect on Linkedln: linkedin.com/in/mahalaxmi-g-46a391245

For Opportunities visit: https://ibegin.tcs.com/iBegin

Website: www.tcs.com


No Referrers Available

There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.