Experience
3 - 5 yrs
Job Location
India
Vacancy
1
Designation
Data Engineer
Job Type
Not specified
Job Description
Roles and Responsibilities
- Design, develop, and maintain large-scale data pipelines using BigQuery, Dataproc, and Airflow.
- Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
- Develop complex SQL queries to optimize database performance and troubleshoot issues.
- Implement data warehousing concepts using Python scripts and PySpark.
- Ensure seamless integration of Kafka messaging systems with other technologies.
Desired Candidate Profile
- 3-5 years of experience in GCP Data Engineering or related field (B.Tech / B.E. degree).
- Strong proficiency in BigQuery, Dataproc, Airflow, SQL, Python, Pyspark, and Kafka.
- Experience working on end-to-end big data processing projects from ingestion to visualization.