Previous Job
Previous
Big Data Developer
Ref No.: 18-01639
Location: Wayne, New Jersey
Title : BigData Developer
Location : NYC, NY


Responsibilities:
· Candidate will be working on existing and new initiatives within the Metrics and Data Analytics application area with primary focus on data ingestion technical stack to standardize processes and controls for ingesting data on Hadoop platform. Initiatives include customizations for evolving business needs as well as architectural and infrastructure improvements.
· Activities include designing, implementing, testing, deploying various applications following department SDLC standards.
· The candidate is expected to be able to drive architectural initiatives across the teams, communicate well with global teams, adapt rapidly and learn fast. Sound judgment and proactive initiative will be required to understand business use cases, design appropriate solutions, develop the underlying implementation and leverage team's strength for application success. Background in Hadoop tech stack and ingestion technologies (e.g. Informatica BDE) is required. Additional responsibilities but not limited to just these: Develop tools for proactive and predictive support of LCG Data Governance program. Responsible for ensuring that the architecture, framework and standards are enforced.
· Leverage Cloudera Manager and Cloudera Navigator to integrate with Informatica BDE/Intelligent Data platform to drive Risk Assessment Scorecard process.
· Create real-time tool trackers and daemons to determine where there's holes/gaps on the platform in the areas of security, entitlements, storage, processing efficiencies, table optimization (i.e. incremental loads vs cache)
· Leverage Cloudera Data Encryption or determine masking guidelines for PII data.
· Create processes to protect the HDFS and data environments from data breaches (i.e. copy from PROD to non-PROD)

Our current technology stack includes Clourera Hadoop, Spark, Scala, and Hadoop related stack.
We are looking for a hands-on technologist who is passionate about technology, has strong experience developing analytics based applications on big data platform.

Skills Required
· Big Data Platform (Hadoop, Spark, Scala, Hive, Kafka etc)
· RestFul/Web Services, JSON, Microservices (REST)
· UNIX/Linux, Scala, Java, Python
· Analytics: Exposure to data modeling and data analytics
· Strong oral and written communication skills
· Excellent interpersonal skills and professional approach

Skills Desired
· Strong hands on experience working on Core Java, AngularJ
· Data modeling, OLTP & OLAP, Bi-temporal databases
· Strong Database design skills including SQL, procedures and query tuning
· Service Design Concepts, OO and Functional Development concepts.
· High-quality software architecture and design methodologies and patterns
· Agile Development Methodologies



Title : BigData Admin
Location : NYC, NY


Skills Required
· Big Data Platform (Hadoop, Spark, Scala, Hive, Kafka etc)
· RestFul/Web Services, JSON, Microservices (REST)
· UNIX/Linux, Scala, Java, Python
· Analytics: Exposure to data modeling and data analytics
· Strong oral and written communication skills
· Excellent interpersonal skills and professional approach

Skills Desired
· Strong hands on experience working on Core Java, AngularJ
· Data modeling, OLTP & OLAP, Bi-temporal databases
· Strong Database design skills including SQL, procedures and query tuning
· Service Design Concepts, OO and Functional Development concepts.
· High-quality software architecture and design methodologies and patterns
· Agile Development Methodologies