Golang, Python and Typescript

Posted on

Experience
8 - 13 yrs
Job Location
Indianapolis, IN, United States
Vacancy
1
Designation
Software Engineer
Job Type
ONSITE

Job Description

We are looking for a skilled GCP Data Engineer to design, develop, and maintain scalable data solutions on Google Cloud Platform. The ideal candidate will have hands-on experience with BigQuery, Python, and SQL, along with exposure to modern data pipeline and cloud technologies.

Key Responsibilities:

  • Develop and maintain data pipelines using GCP services
  • Work in an Agile/DevOps environment with cross-functional teams
  • Build and optimize data processing workflows using BigQuery, Dataflow, and Pub/Sub
  • Perform data extraction, transformation, and loading (ETL)
  • Integrate data from multiple sources using tools like Kafka/NiFi
  • Manage and optimize large datasets for performance and cost efficiency
  • Use Cloud Composer (Airflow) for workflow orchestration
  • Implement automation using Python, Terraform, and Shell scripting
  • Ensure data quality, reliability, and governance standards

Required Skills & Expertise:

  • 4+ years of experience in Data Engineering
  • Strong proficiency in:
    • Python
    • SQL
    • BigQuery
  • Hands-on experience with GCP services:
    • GCS (Google Cloud Storage)
    • BigQuery
    • Cloud Composer (Airflow)
    • Cloud SQL
    • Pub/Sub or Kafka
    • Dataflow
    • Google Cloud SDK
  • Basic knowledge of Hadoop ecosystem and tools like NiFi/Kafka
  • Understanding of Terraform and Shell scripting
  • Experience with RDBMS systems
  • Familiarity with Agile and DevOps practices

Preferred Qualifications:

  • GCP Data Engineer Certification
  • Experience in building batch and real-time data pipelines
  • Exposure to data warehousing and analytics use cases

No Referrers Available

There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.