Experience
10 - 11 yrs
Job Location
Hyderabad, India
Vacancy
1
Designation
Senior Machine Learning Engineer
Job Type
ONSITE
Job Description
Sr Machine Learning Engineer Role Overview
Let's do this. Let's change the world. We are looking for a highly motivated expert Data Engineer to design and develop scalable, secure, and reliable data pipelines and ingestion solutions that power knowledge layer and assistant experiences via generative AI solutions for our Manufacturing Applications Product Team. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics for Manufacturing and Operations use cases. This role requires deep expertise in big data processing, distributed computing, data modeling, LLMs, vector stores, productized assistant workflows, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management.
Responsibilities - Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets.
- Champion ML/LLM feature engineering including data ingestion, embeddings/vector DBs, RAG/LLM serving, latency optimization, and knowledge graph/metadata.
- Build highly efficient data pipelines to migrate and deploy complex data across systems, with an understanding of biotech/pharma/manufacturing or related domains.
- Design and implement solutions to enable secure access, logging, privacy controls, unified data access, governance, and interoperability across hybrid cloud environments.
- Ingest and transform structured and unstructured data from databases (PostgreSQL, MySQL, SQL Server, MongoDB, etc.), APIs, logs, event streams, images, PDFs, and third-party platforms.
- Ensure data integrity, accuracy, and consistency through rigorous quality checks and monitoring.
- Innovate, explore, and implement new tools and technologies to enhance efficient data processing.
- Proactively identify and implement opportunities to automate tasks and develop reusable frameworks.
- Work in an Agile and Scaled Agile (SAFe) environment, collaborating with cross-functional teams, product owners, and Scrum Masters to deliver incremental value.
- Use JIRA, Confluence, and Agile DevOps tools to manage sprints, backlogs, and user stories.
- Support continuous improvement, test automation, and DevOps practices in the data engineering lifecycle.
- Collaborate and communicate effectively with product teams and cross-functional teams to understand business requirements and translate them into technical solutions.
- Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies.
- Proficiency in workflow orchestration and performance tuning on big data processing.
- Strong understanding of AWS services.
- Ability to quickly learn, adapt, and apply new technologies.
- Strong problem-solving and analytical skills.
- Excellent communication and teamwork skills.
- Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices.
- Experience with streaming technologies such as Apache Kafka, Debezium, or similar platforms for real-time data processing and integration.
- Experience with AI assisted code development using tools like GitHub Copilot, Cursor, Claude Code.
- Collaboration with ML engineers, prompt engineers, Product Managers and Owners.
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.