Data Engineer

Job Description

Data Engineer

Type : Full Time

Location : Kochi

Experience Required : 5 Year(s)

Industry : IT-Software/Software Services

Preferred Skills : Big Data Data Analysis Data Mining Data Research ETL Hadoop Hbase Mongo DB NoSQL

Job Description :

Minimal qualifications include:

-A bachelor’s degree in Computer Science or equivalent.

-5+ Years with at least 3+ years as Data Engineer.

Technical Skills:

-Experience in building large-scale data pipelines which process millions of events per day.

-Experience writing and maintaining ETLs, which operate on a variety of large structured and unstructured sources.

-Proficient understanding of distributed computing principles

-Experience with Hadoop and Spark

-Experience with various messaging systems, such as Kafka or RabbitMQ

-Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming

-Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala

-Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, Elasticsearch etc…

-Experience in implementing Data warehouse and Data lake

-Good understanding of Lambda Architecture would be an added advantage

-Experience in implementing ELT models would be an added advantage

-Experience in AWS and Azure cloud services would be an added advantage

-Good Knowledge with one of the Reporting solutions like Pentaho BI or Tableau would be an added advantage.