EMR Platform Administrator/ Hadoop Admin

Job Description: Platform Administrator EMR (Hadoop) & Big Data (4–6 Years)
Experience
4–6 years of experience in platform administration, production support, and Big Data ecosystems
Location: Offshore
________________________________________
Role Overview
We are seeking a mid-level Hadoop / EMR Platform Administrator with strong hands-on experience in managing Big Data platforms. The candidate will focus on day-to-day operations, monitoring, troubleshooting, and performance tuning of Hadoop clusters while collaborating with senior engineers on improvements and automation.
________________________________________
Key Responsibilities
Big Data Platform Administration
• Support and administer AWS EMR (Hadoop ecosystem) clusters
• Manage Hadoop components: HDFS, YARN, Hive, Spark, MapReduce
• Perform routine tasks like cluster monitoring, health checks, and job tracking
• Assist in cluster setup, scaling, and performance tuning
• Ensure system availability and data reliability
• Hadoop admins typically handle cluster lifecycle, monitoring, and performance optimization tasks [torchora.com]
________________________________________
AWS & Linux Infrastructure
• Manage Linux systems (RHEL/CentOS/Ubuntu)
• Work with AWS services: EC2, S3, IAM, VPC, CloudWatch
• Perform OS patching, system upgrades, and basic hardening
• Monitor resource utilization and support cost optimization
• AWS admins are responsible for resource provisioning, security, monitoring, and troubleshooting in cloud environments
________________________________________
Distributed Systems & Middleware
• Assist in managing Zookeeper clusters
• Support Solr / search platforms (basic configuration & troubleshooting)
• Troubleshoot common distributed system issues (node failures, latency, data inconsistencies)
________________________________________
Application & Services Management
• Deploy and maintain Apache Tomcat servers
• Support Java application deployments
• Perform basic JVM monitoring and log analysis
________________________________________
Monitoring & Automation
• Use monitoring tools: CloudWatch, Grafana, ELK, Prometheus
• Monitor cluster health and job execution
• Automate repetitive tasks using Shell scripting / Python
• Automation and monitoring are key to maintaining stable and scalable Hadoop environments [torchora.com]
________________________________________
Production Support
• Provide L2 support with occasional L3 contributions
• Troubleshoot failures and perform Root Cause Analysis (RCA)
• Handle tickets, incidents, and service requests
• Work in on-call rotation
• Hadoop admins are responsible for troubleshooting, system reliability, and operational support [educba.com]
________________________________________
Required Skills & Expertise
Core Skills
• Strong experience in Linux administration
• Hands-on with AWS EMR and Hadoop ecosystem
• Knowledge of HDFS, YARN, Hive, Spark
• Basic understanding of distributed systems
• Scripting: Shell / Python
• Familiarity with monitoring tools
________________________________________
Big Data Skills
• Understanding of:
o Hadoop architecture
o Data ingestion (Sqoop / Flume – optional exposure)
o Job scheduling and execution
• Hadoop administrators often work with ingestion tools, scheduling, and ecosystem components [velvetjobs.com]
________________________________________
Good to Have
• Exposure to Docker / Kubernetes
• Basic knowledge of CI/CD pipelines
• Familiarity with Terraform / CloudFormation
• Understanding of ETL processes and data pipelines
________________________________________
Soft Skills
• Strong troubleshooting and analytical skills
• Ability to work in production environments under pressure
• Good communication and collaboration skills
• Willingness to learn and grow into senior roles
________________________________________
Preferred Qualifications
• Bachelor’s degree in Computer Science / IT
• AWS certification (preferred but not mandatory)
• Exposure to enterprise Big Data platforms