Azure Databricks Engineer

Azure Databricks Microsoft Fabric for the Chevron account is expected to design and implement scalable data platforms using Azure services with strong hands-on expertise in Azure Databricks PySparkSQL Microsoft Fabric Data Factory Lakehouse Pipelines OneLake and Azure Data Factory for building robust ETL/ELT pipelines. The role involves developing and optimizing data ingestion, transformation, and processing workflows, managing large-scale data in lakehouse architectures, and implementing CI/CD pipelines using Azure DevOps for deployment and release management of Databricks notebooks and data pipelines. The candidate should possess solid experience in data modeling, performance optimization, and data architecture design ensuring scalable and reliable solutions while also collaborating closely with cross-functional and business teams to translate requirements into technical solutions in a client-facing environment. Strong communication, problem-solving skills, and the ability to mentor junior engineers are essential along with exposure to tools like Power BI, Unity Catalog, and data platform modernization initiatives across Azure ecosystems. Key Skills

• Azure Databricks PySpark SQL
• Microsoft Fabric Data Factory Lakehouse Pipelines OneLake
• Azure Data Factory ADF
• ETL ELT Pipeline Development
• Python and Advanced SQL
• Azure Data Lake ADLS Lakehouse Architecture
• CI/CD using Azure DevOps
• Data Modeling Optimization Techniques
• Spark Performance Tuning
• Databricks Workflows Notebooks
• Power BI Preferred
• Unity Catalog Data Governance Preferred
• Strong Communication Stakeholder Management