Previous Job
Previous
Big Data Engineer
Ref No.: 19-03655
Location: Richmond, Virginia
Hadoop / Big Data Engineer
Richmond, VA

Description
Very good hands on experience with Big Data technologies such as Hadoop with experience with specific distributions such as Cloudera, HortonWorks, MapR, 2- 4 years of experience with the Apache Hadoop stack, such as Spark, MapReduce, Pig, Hive, HBase, Flume 3 - Knowledge of NoSQL platforms such as Hbase, MongoDB, Cassandra, Accumulo, etc. 4 - Expertise in Scala,Java A Big Data certification will be advantage 5 - Expectations Extensive Experience in Setting Hadoop Cluster 6 - Decommissioning and commissioning the Node on running hadoop cluster 7 - Involved in writing the hive, Pig scripts to reduce the job execution time 8 - Strong Knowledge of Hadoop and Hives analytical functions 9 - Experience in working with structured,un-structured and semi-structured data. 10 - Very good experience in installation and configuration of various Hadoop Ecosystems like sqoop, pig, hive, flume and Hadoop Daemons. 11 - Involved in bench marking HadoopHBase cluster file systems various batch jobs and workloads Hands on experience in analyzing Log files for Hadoop and eco system services 12 - Experience in HDFS data storage and support for running Spark, map-reduce jobs 13 - Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems and vice-versa 14 - Scheduling all hadoophivesqoopHbase jobs using Oozie. Experience in database design using Stored Procedure, Functions, Triggers and strong experience in writing 15 - complex queries for SQL Server. Excellent communication, interpersonal, analytical skills, and strong ability to perform as part of team 16 - Exceptional ability to learn new concepts, Hard working and enthusiastic 17 - First- hand experience building enterprise data warehousing and in- depth knowledge of related concepts - PREFRED 18 - Fundamental concepts JVM, Java environment, primitive types, references, pass by value, packages, imports, static import, JAR concepts, command line arguments, system properties, assignments, expressions, operators, exception handling 19- API Contents of String related classes, Object, Wrapper classes, Auto boxing, File Streams, Serialization, Dates, Numbers, Currency, Parsing, Tokenizing, Formatting 20 - Should be having good hands-on experience with one of the IDEslike Eclipse, NetBeans, JBuilder, JDeveloper, IntelliJ to build, compile, run and debug an application. Should be having hands-on experience with at least one static analysis tool like PMD, Findbugs,JTest 21 - Should have worked on Amazon Web Services, RDS, EMR, S3