Azure Databricks Professional

Software Engineering Professional ( Azure Data Lake, Azure Data Factory and Azure Databricks
This candidate will work on the cloud domain with focus on data architecture and data integration with business components. The candidate is expected to understand the technical stack of the end-to-end eco system and provide an integrated solution in cloud platform. The candidate will work on technical designs, and developing platform solutions, while working with other technology teams.

Experience : 3 to 5 years of experience.

Skill Set requirement:

The ideal candidate should have

• Design Consulting, Development, Unit Testing
• Deep hands-on development expertise in data architecture, batch, and real-time data integration.
• Must have hands-on experience on Spark ( Spark Data Frame and SQL etc )
• Must have hands-on and good understanding of Azure Databricks, Azure Data Lake and Azure Data factory platform and can build data analytics solutions to support the required performance scale
• Hands-on experience with event-based / streaming technologies to ingest and process data
• Good understanding of Azure Data Lake storage concepts
• Must have hands-on skill on Python Programming Language
• Basic Concepts on Cluster
• Good understanding of Training and Prediction with Machine Learning Models
• Good understanding of ETL and ELT
• Good knowledge on Azure DevOps