Big Data Engineer - Senior Consultant

Location – Pune/Chennai
Exp - 6 to 9

Requirements

Technology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)

Knowledge/Experience (Must):

· 6-9 years of experience in Hadoop/big data technologies.

· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event

based messaging.

· Relational and NoSQL database integration and data distribution principles experience

· Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala,

Spark, Kafka, Kudu, Solr)

· Experience with API development and use of JSON/XML/Hypermedia data formats.

· Strong development/automation skills

· Experience with all aspects of DevOps (source control, continuous integration,

deployments, etc.)

· 5+ years of hands-on experience as a Scala developer (with previous Java background)

Knowledge/Experience (Preferred):

· Experience in Core Banking functionality for generating various hand-offs

· Experience with containerization and related technologies (e.g. Docker, Kubernetes)

· Comprehensive knowledge of the principles of software engineering and data analytics

· Knowledge of agile(scrum) development methodology is a plus

· Cloudera/Hortonworks/AWS EMR, S3 experience a plus

Qualifications:

Strong academic record, ideally with a bachelor’s degree in engineering/mathematical or scientific

background.

· Strong Communication skills

· Self-Motivated

· Willingness to learn.

· Excellent planning and organizational skills