python+pyspark(5-9yrs)ss

Roles and Responsibilities

• Design, develop, test, deploy, and maintain large-scale data processing pipelines using Python and PySpark.
  
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
  
• Develop complex ETL processes to extract, transform, and load data from various sources into a centralized repository.
  
• Ensure high-quality data processing by implementing robust testing frameworks and monitoring dashboards.
  

Desired Candidate Profile

• 5-8 years of experience in Big Data technologies such as Hadoop ecosystem (HDFS, MapReduce), Spark (PySpark), Kafka Streams).
  
• Strong proficiency in programming languages like Python with hands-on experience working on big data projects.
  
• Bachelor's degree in Any Specialization (B.C.A. or B.Sc.,B.Tech.,).