Experience
9 - 14 yrs
Salary (CTC)
₹6.7L - ₹7.8L
Job Location
Hyderabad, India
Vacancy
1
Designation
Big Data Engineer
Job Type
Not specified
Job Description
Educational Requirements
Bachelor of Engineering, BTech, BCA, BSc, MTech, MSc, MCA
Service Line Data Analytics Unit
Responsibilities - Production Support Incident Management
- Provide L2/L3 support for Big Data and ETL applications
- Monitor batch jobs, workflows, and data pipelines (24/7 support model if required)
- Troubleshoot Informatica workflows, Hadoop/Hive jobs, and UNIX scripts
- Perform root cause analysis (RCA) and ensure timely resolution of incidents
- Track and resolve SLA breaches, P1/P2 incidents
- ETL Data Pipeline Support
- Support and maintain Informatica PowerCenter / IICS workflows
- Debug ETL failures, data mismatches, and performance issues
- Perform data validation and reconciliation across systems
- Handle data ingestion and transformation pipelines
- Big Data / Hadoop Ecosystem
- Troubleshoot issues in:Hadoop (HDFS, YARN)
- Hive queries and performance tuning
- Spark jobs (basic to intermediate exposure preferred)
- Analyze logs, optimize queries, and ensure smooth data processing
- Unix Scripting
- Develop and support Shell scripts for automation
- Analyze logs, manage file movements, job scheduling, and cron jobs
- Automate repetitive support activities
- Monitoring Tools
- Work with scheduling tools: Autosys / Control-M / Airflow
- Use monitoring and ticketing tools: ServiceNow / Jira
- Proactively monitor systems and prevent failures
- Performance Optimization
- Identify bottlenecks in ETL and Big Data workloads
- Optimize Hive queries, partitioning, and indexing strategies
- Improve job execution time and system stability
- Stakeholder Coordination
- Collaborate with: Development teams
- Business stakeholders
- Infrastructure teams
- Communicate status updates and incident reports clearly
Core Technical Skills In Informatica PowerCenter / IICS (strong exposure) Hadoop ecosystem (HDFS, YARN, MapReduce basics) Hive (advanced querying tuning) UNIX/Linux + Shell scripting SQL (advanced) Production Support Skills Incident problem management RCA and debugging expertise Batch monitoring and job scheduling SLA-driven environment experience
Technical and Professional Requirements Primary skills:Process->Informatica, Bigdata, Production support,Unix,Hadoop,Hive
Preferred Skills - Technology->Big Data->Big Data - ALL
- Technology->Data Management - Data Integration->Informatica
- Foundational->Maintenance and Production Support process->Support Process - Transition
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.