Previous Job
Previous
Sr. Software Engineer [c]
Ref No.: 17-01464
Location: Sunnyvale, California
Position Type:Contract
Sr. Software Engineer
Sunnyvale, CA
Overview
-------------
our client was built to help professionals achieve more in their careers, and every day millions of people use our products to make connections, Client opportunities and gain insights. Our global reach means we get to make a direct impact on the world's workforce in ways no other company can. We're much more than a digital resume – we transform lives through innovative products and technology.

The Big Data Engineering team is responsible for building and maintaining the state-of-the-art ETL pipelines that makes this data available and accessible to the entire company to make data driven decisions. The team works closely with Data scientists, Product Managers, Executives and other key parts of the business across the globe to understand their data requirements and build appropriate solutions or platforms that meet or exceed those needs.

Responsibilities
----------------
  • Contributing at a senior-level to the data warehouse design and data preparation by implementing a solid, robust, extensible design that supports key business flows.
  • Performing all of the necessary data transformations to populate data into a warehouse table structure that is optimized for reporting.
  • Establishing efficient design and programming patterns for engineers as well as for non-technical individuals
  • Designing, integrating and documenting technical components for seamless data extraction and analysis on our big data platform.
  • Ensuring best practices that can be adopted in Big Data stack and share across teams and BUs.
  • Working in a team environment, interact with multiple groups on a daily basis (very strong communication skills).
Desired skills and experience
-----------------
  • 5+ years of relevant work experience in data
  • Ability to write, analyze, and debug SQL queries
  • Working experience with Hadoop projects/infrastructure
  • Experience with Data Warehouse design, ETL (Extract, Transform, Load), architecting efficient software solutions
  • Experience in the Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, etc.)
  • Knowledge of data modeling for both data warehousing and Big Data
  • Experience working extensively in multi-petabyte data environment
  • Experience in engineering large-scale distributed systems in a production environment
  • Experience with at least one scripting language (Shell, Python, Perl etc.) a bonus
  • Experience with an OO programming language like Java a bonus
Additional Job Information:    
Work with business users to redefine business logic (124 rules/tables) in SPEN
  1. document the business logic behind each rule/table
  2. analyze the dependencies of each table
  3. clarify and deprecate the rules
  4. Remove the dependency of computation in TD for final email list generation
  5. build the FETL for the needed rules by May 2018