Big Data Developer

Role & responsibilities

• Design, develop, and maintain scalable data pipelines using Hadoop ecosystem technologies.
• Build and optimize batch and real-time data processing solutions.
• Develop ETL/ELT workflows for ingesting, transforming, and processing large datasets.
• Work with distributed computing frameworks such as Spark, Hive, and MapReduce.
• Manage and optimize Hadoop clusters for performance, scalability, and reliability.
• Integrate data from multiple structured and unstructured data sources.
• Collaborate with data scientists, analysts, and application teams to deliver data solutions.
• Monitor data quality, troubleshoot production issues, and optimize system performance.
• Implement security, governance, and best practices for big data environments.
• Support CI/CD, automation, and deployment of big data application

Preferred candidate profile