Senior Big Data Engineer

• Senior Big Data Engineer is an integral part of the Data Science Innovation team that works closely with Internal/External customer in all phases of the development
• Work with key stakeholders and understand their needs to develop new or improve existing solutions around data and analytics
• Work in a cross-functional, matrix organization, at times under ambiguous circumstances
• Partner in development of scalable solutions using large datasets with other data scientists on the teamResearch innovative data solutions to solve real market problems
• Conceptualize, analyze and develop actionable recommendations for strategic challenges facing the organization
• Manage data analysis to develop fact-based recommendations for innovation projects
• Mine Big Data and other unstructured data to tap untouched data sources and deliver insight into new and emerging solutions
• Work with cross-functional teams to develop ideas and execute business plans
• Remain current on new developments in data analytics, Big Data, predictive analytics, and technology

.Education, Experience, Skills and Abilities Required for Consideration as a Candidate:

• BTech/MCA degree or higher.

• Minimum 5 year experience.
• Candidates must be proficient in -Java, Scala, Python
• Apache Spark, Hadoop, Hive, Spark SQL, Spark Streaming, Apache KafkaWell versed in various Predictive Algorithms, MllibCassandra, RDMS (MYSQL, MS SQL, etc.), NOSQL, Columnar Databases, Big table.
• Demonstrate a deep understanding of search engine technology. Ability to configure, index and maintain enterprise scale search applications. Proficient in writing custom handlers for Elasticsearch/Solr.
• Agile development including Scrum and other lean techniques.
• Excellent problem solving skills with the ability to design algorithms, which may include data cleaning, data mining, data clustering and pattern recognition methodologies
• Ability to work cross-functionally in a highly matrix driven organization, at times under ambiguous circumstances
• Personal qualities desired: creativity, tenacity, curiosity, and passion for deep technical excellence.