Sr. Big Data Engineer

Hi

I hope you are doing great.

Please share your updated resume if you want to apply for the position below.

Job Title Sr. Big Data Engineer

Location Chennai, Pune, Bangalore

Interview Mode- Video

Duration: Full Time

Job Summary:

Must provide employment proof at the time of submission.

Key Responsibilities-

Develop Big Data applications using Spark (Scala-Spark or PySpark), Hadoop, Hive and/or Kafka, HBase, MongoDB

Understanding of Machine Learning models

Working knowledge on Public Cloud / Private Cloud platforms

Must have-

Total IT / development experience of 7+ years
Experience in Spark (Scala-Spark or PySpark) developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB
Deep knowledge of Spark-Scala or PySpark libraries to develop and debug complex data engineering challenges
Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies
Exposure in deploying on Cloud platforms

At least 3 years of development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Scala-Spark
At least 3 years of development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS
At least 4 years of developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, TDD, CI/CD, Change Management to support DevOps
At least 6 years of development experience on Data technologies

Good to have-

Banking domain knowledge
Hands-on experience in SAS toolset / statistical modelling migrating to Machine Learning models
Banking Risk, Fraud or Digital Marketing Machine Learning models and use cases
ETL / Data Warehousing and Data Modelling experience prior to Big Data experience
Knowledge on AWS stack for big data and machine learning