Previous Job
Previous
Big Data - Entity Data Resolution
Ref No.: 18-05187
Category: Cleared Positions
Location: Chantilly, Virginia
Position Type:Direct Placement
Entity Resolution Engineer II
Chantilly, VA

MUST:
Experienced Entity Resolution Engineer II
3 years of experience using Hadoop or other large scale data warehouse technologies to support entity and relationship resolution and operations
1 year of experience in a Apache, Spark, Hive, Pig, ER Resolution Engines, Unix scripting Novetta Entity Analytics, Waremen Pro or similar ER engine
Experience with SQL is a plus
Experience with Linux scripting is a plus
Experience with AWK, PERL, BASH or other scripting language is a plus
Experience using SOLR is a plus
Experience configuring Jenkins to perform O&M operations is a plus
Experience with Spark is a plus
Active Top Secret Required

DUTIES:
Integrate complex data sources into operations
Develop new analytics and algorithms to support advanced data exploitation capabilities using Hadoop related technologies
Enhance the data processing infrastructure using open source and commercial technologies
Capture and define requirements for entity resolution features and functionality from a UI end-user perspective
Analyze documentation and source data of new data feeds.
Develop scripts to ETL source data into destination format
O&M monitoring and resolution of production web services using monitoring tools including Ganglia, Jenkins, and other means
Modify pipeline scripts to enhance functionality and support bug fixes
Resolve bugs by modifying pipeline scripts and entity resolution explanation service scripts
Coordinate development efforts in an agile team
*Quadrant, Inc. is an equal opportunity and affirmative action employer. Quadrant is committed to administering all employment and personnel actions on the basis of merit and free of discrimination based on race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, or status as an individual with a disability. Consistent with this commitment, we are dedicated to the employment and advancement of qualified minorities, women, individuals with disabilities, protected veterans, persons of all ethnic backgrounds and religions according to their abilities.