Python+pyspark(2-9yrs)s

Roles and Responsibilities

• Design, develop, test, deploy, and maintain scalable data pipelines using PySpark and Spark SQL.
  
• Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
  
• Develop ETL processes for large datasets using Pandas, NumPy, and other relevant libraries.
  
• Troubleshoot issues related to data processing, storage, and retrieval from various sources (structured/unstructured).
  

Desired Candidate Profile

• 2-9 years of experience in Data Engineering with expertise in PySpark/Spark SQL.
  
• Bachelor's degree in Any Specialization (B.C.A., B.Sc.,B.Tech.,).
  
• Strong understanding of big data technologies such as Hadoop ecosystem components (HDFS, MapReduce, YARN).