Data Architect

Job Summary

As a Data Architect, you will define the data requirements and structure for applications, modeling and designing data structure, storage, and integration. This role requires strong proficiency in Databricks Unified Data Analytics Platform and experience with Python (Programming Language). Candidates must have a minimum of 7.5 years of experience, specifically in Databricks or MS Fabric, and possess a 15-year full-time education.

Job Description

This Project Role involves defining the data requirements and structure for the application, as well as modeling and designing the application's data structure, storage, and integration.

As a Senior Data Engineer/Backend Developer with deep knowledge on Databricks or MS Fabric, you will design, develop, and maintain scalable data pipelines and systems using Databricks/Fabric. You will also be involved in defining the data requirements and structure for the applications. Your typical day will involve optimizing and tuning data processing workflows for better performance. You will also be responsible for ensuring data quality, integrity, and security across applications. You should possess very good communication skills to liaise with client stakeholders and other experts like Data Scientists, Architects, and Modelers to translate business requirements into effective data solutions, while also addressing any challenges that arise during the development process. Your role will be pivotal in establishing robust quality in data that matches the organization's data strategy and enhances data accessibility and usability across teams.

Key Responsibilities

• Expected to be an SME.
• Collaborate and manage the team to perform.
• Responsible for team decisions.
• Engage with multiple teams like data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions to contribute on key decisions.
• Provide solutions to problems for their immediate team and across multiple teams.
• Facilitate knowledge sharing sessions to enhance team capabilities and foster a culture of continuous improvement.
• Develop and maintain documentation related to data architecture, ensuring clarity and accessibility for all stakeholders.

Requirements

• Proficiency in Databricks or MS Fabric with strong troubleshooting skills.
• Strong understanding of data modeling techniques and best practices.
• Experience with data pipelines, ETL processes, and data integration tools.
• Proficiency in Apache Spark and in programming languages such as Python.
• Familiarity with cloud data platforms and services.
• Ability to design and implement data governance frameworks.
• Hands-on ability to handle large volumes of data in day-to-day tasks.
• Minimum 7.5 years of experience in Databricks or MS Fabric.
• A 15-year full-time education is required.