Experience
7 - 12 yrs
Job Location
Chennai, India
Vacancy
1
Designation
Data Engineer
Job Type
Not specified
Job Description
Greetings from Purple Drive Technologies!
We are hiring for a Data Engineer @ Chennai location
Experience: 7 - 12 years
- 7+ years of experience designing and building data pipelines using Apache Spark, Databricks, or equivalent big data frameworks.
- Hands-on expertise with streaming and messaging systems such as Apache Kafka (publish-subscribe architecture), Confluent Cloud, RabbitMQ, or Azure Event Hub. Experience creating producers, consumers, and topics and integrating them into downstream processing.
- Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle, or other RDBMSs; experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption.
- Proficiency in programming languages such as Python, Scala, or Java, and solid knowledge of SQL for data manipulation and transformation.
- Cloud platform expertise. Experience with Azure or AWS services for data storage, compute and orchestration (e.g., ADLS, S3, Azure Data Factory, AWS Glue, Airflow, DBX, DLT).
- Data modelling and warehousing. Knowledge of data Lakehouse architectures, Delta Lake, partitioning strategies and performance optimisation.
- Version control and DevOps. Familiarity with Git and CI/CD pipelines; ability to automate deployment and manage infrastructure as code.
- Strong problem-solving and communication skills. Ability to work with cross-functional teams and articulate complex technical concepts to nontechnical stakeholders.. Notice period: 0 - 30 days(Immediate Joiners - will be preferred)