Senior Data Engineer |

Roles & Responsibility

1. Strong working experience in python programming.

2. Expertise with python frameworks - pyspark,

3. Must have experience On AWS glue and Pyspark

4. strong experience with using pandas , numpy, joblib and other popular libraries.

5. Good working experience with parallel batch processing with python

6. Good working experience On AWS Batch and Step functions

7. Good experience on aws ecs, ecr, docker

8. Good knowledge on cloud watch, athena and other aws

Requirements

Pyspark + AWS