Proven Skills with:

Writing Complex SQL Queries
Unix Shell Scripting
Data Warehousing Fundamentals
Experience with ETL/ELT pipelines
Relational Database
SQL, NoSQL
Data Mapping, Data Modeling, Data Mining, and Data Warehousing/Mart Relational databases and SQL Query performance tuning
Hands-on experience with at least one programming language Python / Java
Good understanding of Big Data Fundamentals (Hadoop/Spark) and Data Processing Pipelines
Hands-on experience with at least one cloud platform (GCP, AWS, Azure)

Responsibilities

Design, Develop and Deploy scalable data pipelines and data services,
Design, develop, and test data processes per business requirements, following the development standards and best practices as well as participating in code peer reviews to ensure our applications comply with best practices.
Work with business analysts to gather business requirements from end users and translate them into technical specifications.
Gather requirements to define data definitions, transformation logic, and data model logical and physical designs, data flow, and process.
Provide estimates for development.
Perform data analysis and data profiling against source systems and data warehouse.
Test solutions to validate whether requirements have been met; develop test plans, test scripts, and test conditions based on the business and system requirements.
Provide end-user support in post-deployment phases; assess and evaluate all feedback to ensure that the requirements necessary to correct issues are addressed.
Integrate new data management technologies and software engineering tools into existing infrastructure,
Research opportunities for data acquisition and new uses for existing data
Collaborate with data scientists and researchers to develop algorithms including prototypes, predictive models, and proof of concepts,
Work with clients across geographies in an agile team environment,
Constantly learn new technologies, frameworks, and tools.
Exp. with Agile development.
Excellent verbal and written communication skills are a must.

Senior Data Engineer

Job Description

No Referrers Available