Hadoop Administrator

Sightspectrum
Posted on
Sightspectrum logo

Experience
5 - 8 yrs
Salary (CTC)
₹11L - ₹20L
Job Location
India
Vacancy
1
Designation
Hadoop Administrator
Job Type
Not specified

Job Description

Experience : 5 to 8 Years

Location : NewDelhi


Job Summary

We are looking for an experienced Hadoop Administrator to manage, monitor, maintain, and optimize enterprise Hadoop clusters. The ideal candidate should have hands-on experience in Hadoop ecosystem administration, Linux, cluster performance tuning, security implementation, and troubleshooting in production environments.

Key Responsibilities

  • Install, configure, administer, and maintain Hadoop clusters.
  • Manage Hadoop ecosystem components including HDFS, YARN, MapReduce, Hive, HBase, Spark, Kafka, Sqoop, Oozie, and ZooKeeper.
  • Perform cluster monitoring, health checks, capacity planning, and performance tuning.
  • Configure High Availability (HA), disaster recovery, backup, and recovery processes.
  • Monitor storage utilization and optimize cluster resources.
  • Troubleshoot Hadoop services, node failures, and performance issues.
  • Install patches, upgrades, and version migrations with minimal downtime.
  • Implement security using Kerberos, Ranger, Knox, LDAP/Active Directory integration.
  • Manage user access, permissions, and authentication.
  • Automate administration tasks using Shell/Python scripting.
  • Work closely with Data Engineers, Developers, and Infrastructure teams.
  • Maintain operational documentation and standard operating procedures.
  • Support 24x7 production environments and participate in on-call rotations.

Required Skills

  • Strong experience in Hadoop Administration
  • Hadoop Distributed File System (HDFS)
  • YARN Resource Manager
  • MapReduce
  • Hive Administration
  • Apache Spark
  • Kafka Administration
  • HBase
  • Sqoop
  • Oozie
  • ZooKeeper
  • Linux Administration (RHEL/CentOS)
  • Shell Scripting
  • Python scripting (preferred)
  • Cluster Monitoring & Performance Tuning
  • Capacity Planning
  • High Availability (HA)
  • Disaster Recovery
  • Kerberos Authentication
  • Apache Ranger
  • Apache Knox
  • LDAP/Active Directory
  • SSL Certificates
  • Backup & Restore
  • Log Analysis
  • Incident Management
  • Change Management
  • Git (preferred)

Preferred Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or related field.
  • Hadoop certifications (Cloudera/Hortonworks) are preferred.
  • Experience with cloud platforms such as AWS EMR, Azure HDInsight, or Google Cloud Dataproc is an advantage.
  • Experience with DevOps tools like Jenkins, Ansible, Terraform, or Kubernetes is a plus.

No Referrers Available

There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.