Requirements

The ideal candidate for this Data Engineer role will possess the following qualifications:

3+ Years of experience in building and optimizing big data solutions required to fulfill business and technology requirements.
3+ years of technical expertise in areas of design and implementation using big data technology such as Hadoop, Hive, Spark, and languages like Python/Java.
Strong analytic skills to understand and create solutions for business use cases.
Ability to ensure best practices to implement data governance principles and data quality checks on each data layer.
A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
Strong project management and organizational skills.
Experience supporting and working with cross-functional teams in a dynamic environment.
Attained a Graduate degree in B.Tech/B.E.

Candidates should also demonstrate experience using the following software and tools:

Experience with big data technologies: Hadoop, Map Reduce, Hive, Spark, Kafka, Airflow etc.
Experience with relational SQL and NoSQL databases: MySQL, Postgres, MongoDB, HBase, Cassandra etc.
Experience with cloud Data platforms: AWS, Azure-HDInsight's, GCP, CDP.
Experience with real-time data processing: Storm, Spark-Streaming etc.
Experience with object-oriented/object function scripting languages: Java, Python, Scala, etc.

Data Engineer