Job Description
Hi,
We are hiring for GCP Data Engineer for PAN India. Interested candidates please share your updated resume on deepawaliprab.maski@hcltech.com with below details:
Job Location: Bangalore/Chennai/Noida/Pune
Total & Relevant Experience:
Current CTC & Expected CTC:
Current Location & Preferred Location
Notice Period:
Experience looking for :
4-15+ Years
Job Summary
We are seeking a skilled GCP Data Engineer to design, develop, and maintain scalable data pipelines and data processing solutions on Google Cloud Platform (GCP). The ideal candidate should have hands-on experience with Dataflow, BigQuery, Dataproc, and cloud-based data engineering practices. The candidate will be responsible for building robust ETL/ELT pipelines, optimizing data workflows, and enabling analytics and reporting solutions.
Key Responsibilities
- Design, develop, and maintain scalable batch and real-time data pipelines on GCP.
- Build and optimize ETL/ELT solutions using Google Cloud Dataflow (Apache Beam).
- Develop and manage large-scale data warehouses using BigQuery.
- Implement distributed data processing solutions using Dataproc (Apache Spark/Hadoop).
- Integrate data from multiple sources including databases, APIs, and cloud storage.
- Perform data modeling, partitioning, clustering, and query optimization in BigQuery.
- Ensure data quality, governance, security, and compliance standards are met.
- Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
- Automate deployment and orchestration of data workflows using CI/CD practices.
- Support production operations and resolve data-related issues.
Required Skills
GCP Services
- Google Cloud Platform (GCP)
- BigQuery
- Dataflow
- Dataproc
- Cloud Storage (GCS)
- Pub/Sub
- Cloud Composer (Airflow)
- Cloud Functions
Data Engineering
- ETL/ELT development
- Data Warehousing concepts
- Batch and Streaming Data Processing
- Data Modeling
- Data Quality and Governance
Programming
- Python (preferred)
- SQL (advanced)
- PySpark
- Shell Scripting
Big Data Technologies
- Apache Spark
- Hadoop Ecosystem
- Apache Beam
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
- 4+ years of experience in Data Engineering.
- 2+ years of hands-on experience with Google Cloud Platform.
- Strong expertise in BigQuery query optimization and performance tuning.
- Experience building scalable pipelines using Dataflow and Apache Beam.
- Experience with Dataproc and Spark-based processing frameworks.
- Strong SQL and Python programming skills.
- Experience with source control systems such as Git.
Preferred Qualifications
- GCP Professional Data Engineer Certification.
- Experience with Terraform or Infrastructure as Code (IaC).
- Knowledge of Kafka or Pub/Sub messaging systems.
- Experience working in Agile/Scrum environments.
- Exposure to DevOps and CI/CD tools.
Nice to Have
- Experience with Looker, Tableau, or Power BI.
- Knowledge of data governance and metadata management tools.
- Experience with machine learning data pipelines on GCP.
Interview Must-Have Skills
- GCP Data Engineering
- BigQuery
- Dataflow (Apache Beam)
- Dataproc (Spark)
- Python
- Advanced SQL
- ETL/ELT Design
- Data Warehousing
Keywords: GCP, Google Cloud Platform, BigQuery, Dataflow, Dataproc, Apache Beam, Spark, PySpark, SQL, Python, ETL, ELT, Data Lake, Data Warehouse, Cloud Composer, Pub/Sub, GCS, Data Engineering.Role & responsibilities
Hi,
We are hiring for GCP Data Engineer for PAN India. Interested candidates please share your updated resume on deepawaliprab.maski@hcltech.com with below details:
Job Location: Bangalore/Chennai/Noida/Pune
Total & Relevant Experience:
Current CTC & Expected CTC:
Current Location & Preferred Location
Notice Period:
Experience looking for :
4-15+ Years
Job Summary
- Python
- Advanced SQL
- ETL/ELT Design
- Data Warehousing
Keywords: GCP, Google Cloud Platform, BigQuery, Dataflow, Dataproc, Apache Beam, Spark, PySpark, SQL, Python, ETL, ELT, Data Lake, Data Warehouse, Cloud Composer, Pub/Sub, GCS, Data Engineering.
Preferred candidate profile
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.
