Previous Job
Previous
Big Data Engineer (Plano, TX)
Ref No.: 18-05750
Location: Plano, Texas
Position Type:Full Time/Contract
Start Date / End Date: 10/22/2018 to 01/21/2019
Paladin Consulting is currently hiring a Big Data Engineer to join our team working onsite at our client's office located in Plano, TX.

We work with companies that offer environments for our employees to contribute, learn, and advance their career. We treat you like you are part of the family.

Job Title: Big Data Engineer
Work Location: Plano, TX
Duration: 3 month contract
Education/Experience Required: 3+ years of experience with Big data technology and analytics; 3+ years of experience in ETL and ELT data modeling


Project Scope:
  • Build data quality check framework to validate data within Hadoop ecosystem and between Hadoop and external systems
  • Building framework to create new Hive datasets from HDFS
  • Implement new platform enhancements like implementing AtScale etc
Required Skills & Qualifications:
  • 8 + years of professional experience
  • 3+ years of experience with Big data technology and analytics
  • 3+ years of experience in ETL and ELT data modeling
  • Experience working with traditional warehouse and correlation into hive warehouse on bigdata technologies
  • Experience setting data modeling standards in Hive
  • Developing automated methods for ingesting large datasets into an enterprise-scale analytical system using Scoop, Spark and Kafka
  • Proficiency in using query languages such as SQL, Hive
  • Experience with streaming stacks like Nifi, Spark and PySpark
  • Understanding of Big Data tools (e.g., NoSQL DB, Hadoop, Hbase) and API development consumption.
  • Experience in one or more languages (e.g., Python or Java, Groovy)
Additional Skills:
  • Experience working with ELK stack or Solar indexing
  • Understanding of data governance, bigdata security like kerberos, ranger
  • Knowledge of setting standards around data dictionary and tagging data assets within datalake for business consumption.
  • Understanding of data preparation and manipulation using Datameer tool
  • Knowledge of SOA, IaaS, and Cloud Computing technologies, particularly in the AWS environment
  • Experience with Hadoop/Hive, Spark and Scoop highly desirable
  • Experience with data visualization tools like Tableau, Power BI
  • Knowledge of setting standards around data dictionary and tagging data assets within DataLake for business consumption.
  • Identifying technical implementation options and issues
  • Partners wand communicates cross-functionally across the enterprise
  • Ability to explain technical issues to senior leaders in non-technical and understandable terms
  • Foster the continuous evolution of best practices within the development team to ensure data standardization and consistency
  • Experience in agile software development paradigm (e.g., Scrum, Kanban)
  • Strong written and verbal communication
For more information or to view other opportunities, visit us at www.paladininc.com.

Paladin Consulting is an EEOC employer.