Data Engineer

We have openings for one of our client(Data Science & AI Firm)- Fulltime oppurtunity

Role & responsibilities

Technical expertise with emerging Big Data technologies, such as: Python, Spark, Hadoop, Clojure, Git, SQL and Databricks; and visualization tools: Tableau and PowerBI

• Experience with cloud, container and micro service infrastructures
• Hands-on experience with data modelling, query techniques and complexity analysis

Your duties will include:

• Develop data solutions within a Big Data Azure and/or other cloud environments
• Working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams
• Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse
• Liaising with CTO, Product Owners and other Operations teams to deliver engineering roadmaps showing key items such as upgrades, technical refreshes and new versions
• Perform data mapping activities to describe source data, target data and the high-level or detailed transformations that need to occur;
• Assist Data Analyst team in developing KPIs and reporting in tools viz. Power BI, Tableau
• Data Integration, Transformation, Modelling