Big Data Engineering Lead
- Proven track record in project management and agile methodologies
- Experience in requirements engineering, solution architecture, design, development and deployment
- Experience in integrating data into analytical platforms, namely Data Hub's
- Proven track record on ingestion technologies (NiFi, Spark, Kafka, Storm) and storage (HDFS, HBase, Hive)
- Proven track record in data profiling, source-target mappings, ELT development, SQL optimization, testing and implementation
- Expertise in SQL & other data manipulation languages essential (PIG, PYTON, JAVA)
- Experience with structured and unstructured data
- Track record of implementing databases and data access middleware and high volume batch processing involving large data sets