GCP Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using GCP services such as BigQuery, Data Flow, PubSub.
• Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs.
• Develop scalable and efficient SQL queries on BigQuery to extract insights from massive datasets.
• Troubleshoot issues related to data ingestion, transformation, and loading into Dataproc clusters.

Job Requirements :

• 7-13 years of experience in a similar role working with big data technologies like PySpark, SQL, Python.
• Strong understanding of GCP cloud platform including Cloud Storage, Dataproc, PubSub.
• Experience with building end-to-end data pipelines using tools like Airflow or equivalent.