Data lead with AI

8+ Yrs

Pune, Mumbai, Kochi, Hyderabad, coimbatore, chennai

Job Overview:

We are looking for a senior technical lead to design, scale, and govern enterprise-grade data platforms across Microsoft Fabric, Databricks, and Snowflake. The role focuses on defining data architecture standards, enabling AI/GenAI-ready platforms, leading engineering teams, and delivering secure, high-performance cloud data solutions that support analytics and business outcomes.

Key Responsibilities

• Lead the design and implementation of scalable data platforms using Microsoft Fabric, Databricks and Snowflake including Pipelines, Notebooks, Lakehouse, Data Warehouse, and Semantic Models.
• Define end-to-end data architecture standards, patterns, and best practices across ingestion, storage, transformation, modeling, and consumption layers.
• Guide technical decisions on compute patterns, storage optimization, pipeline orchestration, and data modeling frameworks.
• Evaluate and integrate emerging technologies to modernize the platform and enable AI/GenAI workloads.
• Partner with AI/ML teams to productionize models and integrate them with enterprise data workflows.
• Ensure data governance, lineage tracking, and metadata standards to support trustworthy AI initiatives.
• Champion data governance, security, privacy, and compliance requirements within the platform.
• Implement observability frameworks for pipeline monitoring, performance tuning, and reliability engineering.
• Drive continuous improvement initiatives to enhance platform robustness and engineering productivity.
• Work closely with product owners, business stakeholders, architects, and analytics teams to translate requirements into scalable technical solutions.
• Serve as the primary technical point of contact for data platform projects and stakeholders.
• Communicate technical roadmaps, project risks, and delivery plans clearly and effectively.
• Develop and deliver dashboards and reports using Power BI and Tableau.

Key Skills:

• Bachelor s or Master s degree in Computer Science, Engineering, Data Science, or equivalent professional experience.
• 12+ years of experience in data engineering, data platform development, or cloud data architecture.
• 3+ years in a technical leadership or team management role.
• Mandatory deep hands-on expertise with Microsoft Fabric, Snowflake or Databricks:
  • Pipelines
  • Notebooks
  • Lakehouse
  • Data Warehouse
  • Semantic Models
• Strong proficiency in PySpark, distributed compute, and data transformation frameworks.
• Advanced SQL capabilities and experience building stored procedures for transactional and analytical workloads.
• Proven track record in designing and delivering large-scale data platforms in cloud environments (Azure preferred).
• Solid understanding of AI/ML data workflows, GenAI dataset preparation, and integration patterns.
• Demonstrated ability to lead engineering teams, drive architectural decisions, and oversee complex technology implementations.
• Strong communication, stakeholder management, and technical documentation skills.
• Proficiency in creating interactive dashboards and reports using Power BI and Tableau.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.