You will lead and manage a large and rapidly growing data engineering team working on multiple project with multiple clients, and be responsible for the delivery of project and team goals
Play big data architect role and design solution frameworks to translate business requirements to scalable data models
Build & support data ingestion and processing pipelines. This will entail extract, load and transform of data from a wide variety of sources using latest data frameworks and technologies
Design, build, test, and maintain machine learning infrastructure and frameworks to empower data scientists to rapidly iterate on model development
Own and lead client engagement and communication on technical projects. Define project scopes and track project progress and delivery.
Lead team capability building and recruitment. Foster inter and intra team collaboration between members.
Coach and mentor other team members. Play a role in their development and retention.
Keep up to date with advances in big data technologies and run pilots to design the data architecture to scale with the increased data volume
Partner with software engineering teams to drive completion of multi functional projects

An ideal candidate will be/have:

Minimum 6 years of overall experience in data engineering and 2+ years leading a team as Engineering Manager and doing project and people management (performance appraisals, career development) for the engineers in the team.
Experience working with a global team and remote clients
Hands on experience in building data pipelines on various infrastructures
Knowledge of statistical and machine learning techniques. Hands on experience in integrating machine learning in data pipelines
Ability to work hands-on with the data engineers in the team in design and development of the solution using the relevant big data technologies and data warehouse concepts.
Strong knowledge of advanced SQL, data warehousing concepts, DataMart designing.
Have strong experience in in modern data platform components such as Spark, Python, etc.
Experience with setting up and maintaining Data warehouse (Google BigQuery, Redshift, Snowflake) and Data Lakes (GCS, AWS S3 etc.) for an organization
Experience in building data pipeline with AWS Glue, Azure Data Factory and Google Dataflow
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra / MongoDB.
Strong problem solving and communication skills.

Lead Data Engineer

Job Description