Design, develop, and maintain highly scalable data processing applications
Write efficient, reusable and well documented code
Deliver big data projects using Spark, Scala, Python, SQL, HQL, Hive
Leverage data pipelining application to package work
Maintain and tune existing Hadoop applications
Work closely with QA, Operations and various teams to deliver error free software on time
Actively participate in daily agile / scrum meetings

Job skill

5 + years of software development experience with Hadoop framework components(HDFS, Spark, PySpark, Sqoop, Hive, HQL, Spark, Scala)
4+ years of experience using Python, SQL and shell scripting
Experience in developing and tuning spark applications
Excellent understanding of spark architecture, data frames and tuning spark
Strong knowledge of database concepts, systems architecture, and data structures is a must
Process oriented with strong analytical and problem-solving skills
Excellent written and verbal communication skills
Bachelors degree in Computer Science or related field

Python Developer

Job Description