Pyspark Developer

Weekend Walk-in Drive(Face to Face ) for 18th July

Skill:Pyspark

Experience: 4+ years

Location:Chennai, Bengaluru, Hyderabad, Kolkata, Pune

Job Description:

We are looking for a skilled PySpark Developer with 4+ years of experience in designing, developing, and optimizing large-scale data processing applications. The ideal candidate should have strong hands-on expertise in PySpark, Python, SQL, and Data Engineering concepts, with experience building scalable ETL pipelines and processing large volumes of data. Relevant skills from enterprise JD templates include PySpark development, SQL, data warehousing, and cloud-based data engineering environments

Must-Have Skills:

• Strong hands-on experience in PySpark
• Proficiency in Python Programming
• Strong SQL skills
• Experience in ETL/ELT development
• Knowledge of Data Warehousing concepts
• Experience with data modeling and large-scale data processing
• Understanding of Spark architecture and performance tuning
• Git/GitHub version control
• Strong debugging and troubleshooting skills

Good-to-Have Skills:

• AWS (S3, EMR, Glue)
• Databricks
• Airflow
• Snowflake
• dbt
• Redshift
• CI/CD pipelines
• Agile/Scrum methodology

Roles & Responsibilities:

• Develop and maintain scalable data pipelines using PySpark and Python.
• Design and implement ETL/ELT workflows for enterprise data platforms.
• Process and analyze large structured and unstructured datasets.
• Optimize Spark jobs for performance, scalability, and efficiency.
• Develop reusable frameworks and components for data processing.
• Collaborate with data architects, business analysts, and application teams.
• Perform data validation, reconciliation, and quality checks.
• Troubleshoot production issues and provide timely resolutions.
• Participate in code reviews and follow coding best practices.