Azure Data Engineer

Job Category: Data Engineer

Job Type: Hybrid

Job Location: Bangalore

Job Experience: 5-8 years

Responsibilities for the job

Technical (Primary) -

Excellent in SQL, ADF. A must .
Strong experience in building data pipelines in Azure Data Factory. Experience calling rest APIs using ADF
ETL, API (Rest, OAuth, SOAP, etc) data integration into ADLS Gen2/ Azure Synapse Analytics and data migration.
Experience in Ingestion of batch and Streaming data with complex transformations.
Experience in handling Semi-structured data in various data formats (Parquet, JSON) and manipulating data in complex data types.
Azure Synapse/data warehouse experience using synapse/data warehouse to present data securely and to build & manage data models.
Azure Data Bricks experience writing in and using data bricks Using Python to transform, manipulate data.
Azure Data Lake/ Delta Lake, Blob Storage
Knowledge of data modeling, design, manipulation, optimization, and best practices.
Experience in working with very large volume of log data and building analytical insights based on user requirements

Technical (Secondary) Skills:

Knowledge of Dev-Ops tools and experience in building CI/CD pipelines on Azure.
Write programs to pull data from External Applications and Services using REST API with different authentication methods.
Knowledge on NoSQL Database types like Document and Graph DB is a plus.

Behavioral:

Eligibility Criteria for the Job

Education:

B.E/B.Tech in any specialization, BCA, M.Tech in any specialization, MCA.

Primary Skill:

1. SQL
2. Databricks
3. Cloud Azure

4. Azure Data Factory, Azure Synapse, Azure Data Lake/ Delta Lake, Blob Storage

5. Python, Pyspark

Management Skills:

1. Ability to handle given tasks and projects simultaneously in an organized and timely manner.

Soft Skills:

1. Good communication skills, verbal and written.
2. Attention to details.
3. Positive attitude and confidence.

Azure Data Engineer

Job Description