Sr Data Engineer

We are looking for a skilled Sr Data Engineer with 5 to 10 years of experience, located in Hyderabad/Secunderabad. The ideal candidate should have expertise in Pyspark, Data Bricks, ADF, Big Data, Hadoop, and Hive.

Roles and Responsibility

• Design and develop scalable data pipelines using Pyspark and Data Bricks.
• Collaborate with cross-functional teams to integrate data from various sources into a unified data warehouse.
• Develop and maintain large-scale data architectures using ADF and Hadoop.
• Optimize data processing workflows to improve performance and efficiency.
• Ensure data quality and integrity by implementing robust testing and validation procedures.
• Participate in code reviews to ensure adherence to coding standards and best practices.

Job Requirements

• Strong proficiency in Pyspark, Data Bricks, ADF, Big Data, Hadoop, and Hive.
• Experience working with large datasets and distributed computing environments.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a team environment.
• Strong understanding of data modeling and database design principles.
• Familiarity with agile development methodologies and version control systems.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.