Experience
2 - 3 yrs
Salary (CTC)
₹5.9L - ₹6.7L
Job Location
Hyderabad, India
Vacancy
1
Designation
ETL Developer
Job Type
Not specified
Job Description
Educational Requirements
Bachelor of Engineering, BTech, BSc, BCA, MSc, MTech, MCA
Service Line Data Analytics Unit
Responsibilities
- ETL Development: Design, develop, and maintain ETL pipelines using Python and PySpark
- Extract, transform, and load data from multiple structured and unstructured sources
- Build reusable and scalable data processing frameworks
- Ensure data quality, validation, and consistency
- PySpark / Big Data Processing
- Develop and optimize PySpark jobs for large-scale data processing
- Work with Spark DataFrames and RDDs
- Implement transformations, aggregations, and joins in Spark
- Optimize jobs for performance and scalability
- Python Development
- Develop backend logic and data processing scripts using Python
- Write modular, reusable, and efficient code
- Integrate APIs and automate workflows
- Data Management Integration
- Work with data lakes and warehouses (S3, HDFS, Redshift, Hive)
- Handle file formats like Parquet, ORC, JSON, CSV
- Perform data cleansing, enrichment, and transformation
- Collaboration Support
- Work with data engineers, analysts, and business stakeholders
- Debug and troubleshoot ETL/data pipeline issues
- Participate in Agile/Scrum ceremonies
- Maintain documentation and coding standards
Additional Responsibilities:
- Core Skills: 25 years of experience in Python and ETL development
- Hands-on experience with PySpark (mandatory)
- Strong understanding of data processing and pipelines
- Solid knowledge of SQL and database concepts
- Technical Skills: Experience with Apache Spark ecosystem
- Good knowledge of data structures and algorithms (basic to intermediate)
- Familiarity with Big Data technologies (Hadoop, Hive)
- Experience with version control (Git)
- Understanding of REST APIs and integrations
Technical and Professional Requirements:
- Primary skills:Domain->Finacle-Core-Functional->Finacle-Core-WMS->Grand Master
- Technology->ETL Data Quality->ETL - Others
- Technology->Machine Learning->Python
Preferred Skills:
- Technology->ETL Data Quality->ETL - Others
- Technology->AI-Data science->PYTHON
- Technology->Big Data - Data Processing->PySpark
No Referrers Available
There are currently no referrers available for this job. You can still apply, will let you know once there is any referrer available.