Experience
2 - 7 yrs
Job Location
Bengaluru, India
Vacancy
1
Designation
Gcp Data Engineer
Job Type
ONSITE
Job Description
JD for GCP Data Engineer.
Role name: Developer Role Description: Pyspark , Data engineer Developer Competencies: Digital : Google Data Engineering, Digital : PySpark Experience (Years): 6-8 Essential Skills: Pyspark , Data engineer Developer Roles and Responsibilities
,Role name: Developer Role Description: Pyspark , Data engineer Developer Competencies: Digital : Google Data Engineering, Digital : PySpark Experience (Years): 6-8 Essential Skills: Pyspark , Data engineer Developer Roles and Responsibilities
- Design, develop, and deploy scalable and reliable data pipelines using GCP services such as:
- BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer, Cloud Functions
-
- Implement ETL/ELT processes to ingest, transform, and store structured and unstructured data.
- Collaborate with Data Scientists, Analysts, and Business Stakeholders to define data requirements and deliver data products.
- Optimize data processing workflows for performance, cost, and reliability.
- Ensure data quality, security, and compliance with governance policies.
- Monitor and troubleshoot production data pipelines and workflows.
- Develop CI/CD pipelines for data workflows using tools like Cloud Build, GitLab CI/CD , etc.