Experience
6 - 10 yrs
Job Location
Hyderabad, India
Vacancy
1
Designation
Senior QA Engineer
Job Type
ONSITE
Job Description
Designation: Senior QA Data Engineer
Location: Bangalore/Hyderabad /Mumbai
Experience: 6 to 10 years
Qualification: BE/ B.Tech /M.E/ M.Tech /MS/MCA in Computer Science or related field
Job Description:
We are looking for a highly skilled Senior Data QA Engineer with experience in validating and ensuring the quality of scalable data pipelines and integration solutions. The QA Engineer will analyse user requirements and business objectives, define test strategies, and recommend improvements to existing custom data connectors and ETL processes. This role involves designing and executing test plans, performing data validation using SQL and scripting, and collaborating closely with data engineering teams to ensure data accuracy, integrity, and compliance across the platform. Design and develop comprehensive test plans and scripts for data lake projects, focusing on data ingestion, transformation, and storage.
Key Responsibilities:
- Create and execute manual and automated test cases to validate ETL/ELT pipelines built on Microsoft Fabric s medallion architecture.
- Write and run complex SQL queries , NoSQL queries and PySpark/Python scripts to perform data validation, reconciliation, and integrity checks.
- Collaborate with data engineers and architects to understand data mappings, technical specifications, and business rules.
- Implement and maintain automated testing frameworks to streamline and scale data quality assurance processes.
- Ensure adherence to data governance, security, and compliance standards across all QA activities.
- Participate in Agile ceremonies, contribute to sprint planning, and support continuous integration and delivery (CI/CD) of data solutions.
- Stay updated with Microsoft Fabric features and modern data QA tools to drive innovation and efficiency.
Mandatory Skills:
- Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
- 6+ years of hands-on experience in data quality assurance, testing, and validation of large-scale data solutions.
- Proficiency in ETL/ELT Testing, SQL, NoSQL, PySpark, and Python for data validation, reconciliation, and integrity checks.
- Experience testing Data Lakehouse architectures, Delta tables, and modern data warehousing solutions using Microsoft Fabric .
- Experience in data migration platforms such as Fivetran.
- Knowledge or basic experience in data visualization testing using Power BI
- Experience testing multiple databases preferably Oracle, PostgreSQL, MongoDB and Cosmo s.
- Experience working with diverse data sources such as APIs, flat files, databases, and streaming data.
- Familiarity with automated testing frameworks, CI/CD pipelines, and Agile methodologies.
- Strong analytical and debugging skills with a keen eye for data inconsistencies and anomalies.
- Excellent communication and collaboration skills for working with cross-functional teams.
Optional Skills:
- API testing using Postman.
- Knowledge of test automation frameworks like Great Expectations, PyTest , or Selenium for data validation
- Familiarity with DevOps practices and tools like Azure DevOps, GitHub Actions, or Jenkins.
Key Words:
- Primary Skills : SQL, Microsoft Fabric, ETL / ELT Testing, NoSQL, Oracle Database , Python, Power BI
- Secondary Skills : Fivetran , PostgreSQL, MongoDB , Azure Cosmos DB
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.