Python + Pyspark (5-9 yrs)sv

Roles and Responsibilities

• Design, develop, test, and deploy scalable data pipelines using AWS services such as S3, Lambda, Step Functions, etc.
  
• Develop high-quality code in Python frameworks like Django or Flask to build web applications.
  
• Collaborate with cross-functional teams to gather requirements and deliver solutions that meet business needs.
  
• Troubleshoot issues related to data processing using tools like Pandas and SQL.
  

Desired Candidate Profile

• 5-10 years of experience in Data Engineering with expertise in Python & PySpark.
  
• Strong understanding of AWS ecosystem including S3, Lambda, Step Functions, etc.
  
• Proficiency in writing efficient SQL queries for querying large datasets.
  
• Experience working on big data analytics projects involving Hadoop/Hive/Pig technologies.
  
• Bachelor's degree in B.C.A. or B.Sc., B.Tech., from a reputed institution.