Lead Data Engineer - Spark / Scala

Notice Period : Immediate to 15 Days.

Job Description :

- 6+ years of overall Data Analytics and BI experience

- Experience in Spark, Hive, Scala.

- Build data pipelines for ETL that fetch data from variety of sources such as flat files relational databases and APIs

- Python scripting with focus on data transformation and manipulation libraries such as Pandas and numpy

- Strong knowledge and hands-on experience of SQL (should be able to write advance level SQL queries)

- Good hands-on experience on data visualization tools such as Power BI, Tableau, Looker

- Good understanding and hands-on experience of Data engineering pipeline management tools such as Airflow

- Good Communication skills.