Apache Spark Scala Engg_Chennai_6+ years - 10 years_Early joiners

HI,

Greetings for the day !!!

We at HCL are looking Data Engineers with exp Apache Spark Scala and Big Data

Location: Chennai

If interested reach us on srikanth.domala@hcltech.com

Provide us the details below:

Total years of exp:

Exp in Apache:

Exp in Spark:

Exp in Scala/Python:

Current CTC:

Expected CTC:

Notice Period:

Current location:

Preferred location:

Detailed Responsibilities:

• Lead technical teams in designing, developing, and implementing solutions using Apache Spark, Scala, and Python, ensuring robust, scalable, and optimized data pipelines.
• Provide technical expertise and guidance to resolve complex issues, optimize Spark applications, and enhance overall system performance.
• Collaborate with stakeholders to gather requirements, define project scope, and ensure alignment with business objectives, translating business needs into technical solutions.
• Oversee the adoption of best practices in coding, testing, and deployment for robust and maintainable solutions, including managing the full software development lifecycle in an Agile environment.
• Conduct code reviews, performance tuning, and optimization activities to maximize efficiency, reliability, and scalability of data processing jobs.
• Troubleshoot, debug, and resolve technical challenges related to Spark jobs, data pipelines, and big data infrastructure to ensure seamless operations and timely delivery.
• Stay abreast of industry trends, emerging technologies, and advancements in Apache Spark, Scala, Python, and big data ecosystems to continuously improve technical solutions.
• Mentor and facilitate knowledge sharing within the technical team, fostering growth, skill development, and best practices in big data engineering.
• Own end-to-end data pipeline development, including deep SQL, data modeling, and managing deployment in production environments, ensuring data quality and integrity.

Skill Requirements

• Strong proficiency and hands-on experience in developing, optimizing, and maintaining applications and data pipelines using Apache Spark.
• Deep understanding of Scala programming, with practical experience designing and implementing solutions in big data contexts.
• Expertise in building and deploying scalable data solutions using Python, including integration with Spark and other big data tools.
• Expertise in writing complex SQL queries, designing data models, and managing big data storage and retrieval efficiently.
• Proven track record of leading technical teams, managing projects, and providing guidance in a collaborative environment.
• Solid grasp of the software development lifecycle, Agile methodologies, and best practices in coding, testing, and deployment.
• Experience in performance tuning, optimization, and troubleshooting Spark jobs and data pipelines to resolve bottlenecks and improve efficiency.
• Excellent problem-solving, critical thinking, communication, and interpersonal skills.
• Bachelors or Master’s degree in Computer Science, Engineering, or related field.
• Relevant certifications in Apache Spark, Scala, or Python are preferred.