Job Description
Role: PySpark Developer
Experience: 6+ Years
Location: Chennai/Pune & Hybrid Mode
Notice: Immediate
JD:
We are looking for a highly skilled PySpark Developer with 5+ years of experience in designing, developing, and optimizing big data solutions. The ideal candidate will have expertise in Apache Spark, Python, and distributed computing to process large datasets efficiently.
Key Responsibilities:
Develop and maintain scalable data processing pipelines using PySpark.
Optimize and tune PySpark jobs for performance and efficiency.
Collaborate with data engineers and analysts to understand data requirements.
Ensure data quality and integrity throughout the data lifecycle.
Troubleshoot and resolve data processing issues.
Deploy and manage big data solutions in a distributed computing environment.
Participate in code reviews and provide constructive feedback.