Big Data Engineer

We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience in the Big Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and big data solutions
• Implement data transformations using Spark, Snowflake (Snowpark), Pig, and Sqoop
• Process large data volumes from diverse sources using Hadoop ecosystem tools
• Build end-to-end data workflows for batch and streaming pipelines
• Optimize data storage and retrieval processes in HBase, Hive, and other NoSQL databases
• Collaborate with data scientists and business stakeholders to design robust data infrastructure
• Ensure data integrity, consistency, and security in line with organizational policies
• Troubleshoot and tune performance for distributed systems and applications

Must Have Skills

• Data Engineering Big Data
• Tools: Snowflake (Snowpark), Spark, MapReduce, Hadoop, Sqoop, Pig, HBase
• Data Ingestion & ETL, Data Pipeline Design, Distributed Computing
• Strong understanding of Big Data architectures & performance tuning
• Hands-on experience with large-scale data storage and query optimization

Nice To Have

• Apache Airflow Oozie experience
• Knowledge of cloud platforms (AWS, Azure, or GCP)
• Proficiency in Python or Scala
• CI/CD and DevOps exposureLocation: Remote | Contract Duration: 6+ Months