Previous Job
Previous
Data Engineer
Ref No.: 17-00165
Location: Chicago, Illinois
Position Type:Direct Placement
Who We Are
Networked Insights is an analytics company focused on social data. Our SaaS platform, Kairos, processes, classifies, and analyzes hundreds of millions of social posts per day, helping marketers from the world's leading brands uncover meaningful and valuable insights so that they can deeply understand their consumer audiences including how they feel about virtually any topic. Our technology makes it easy for them to create the best content, invest in the right media, and track their success in real time.

What You'll Do
We are seeing a candidate for a fulltime role, who will help us build and architect databases, data sets and systems to support our company's products. You will have the opportunity to use established and new technologies to help us accomplish these goals.

Responsibilities
  • You work with relational database technologies (e.g. PostgreSQL, Oracle, MySQL, or SQL Server) and write performant queries on large data sets.
  • You have worked with moving lots of data from one system to another and transforming it along the way (e.g. JSON to relational data sets). You have developed full load and incremental load ETL processes using tools such as Microsoft SSIS, Pentaho Data Integration, or custom scripts. You have also worked on enhancing existing data sets such as adding additional attributes.
  • You get things done using established tools and at the same time, enjoy exploring new technology for better/faster ways of processing data.
  • You are comfortable with the software development workflow: ie., moving and deploying code from development to QA to production.
  • You have a basic understanding of bottlenecks that may occur such as disk IO, CPU, or memory. You have improved the performance of a database system or query by making either DDL or DML changes or both.
  • You are familiar with ETL workflows which progress through several different database technologies.
  • We make heavy use of PostgreSQL for our OLTP databases and even some small OLAP databases.
  • Occasionally, the ability for database administration tasks such as management of database configuration, replication, access, backups, and so-on.
  • We use cloud technologies such as BigQuery and Amazon AWS RDS for some of our needs.
  • We use git, maven, and Jenkins, and Docker. You do not need to be an expert in these, but familiarity helps.
  • We practice sprints and use JIRA for project management.

What You'll Need
  • Bachelor's degree in Computer Science or a related field of Engineering, or equivalent combination of education and experience.
  • Significant background in creating complex functions/stored procedures in SQL
  • Experience with database modeling tools, database normalization, logical and physical database design and implementation
  • Familiarity with database internals such as binary logging, indexes, statistics, query planning, transactions, concurrency management, and high-performance loading.
  • Strong analytical skills
  • 5-8 years of experience in database development with RDBMS (PostgreSQL, MySQL, Oracle, etc.)
  • ETL operations
  • Big Data and Agile experience is a plus.
  • Experience preferred with Linux, Web Services, Postgres, Lucene, ElasticSearch and MapReduce frameworks such as Hadoop and Hive
  • Experience with Cloud platforms (eg., AWS, GCP, Azure, or similar)
  • Experience with higher-level languages such as Groovy or Python, particularly for authoring ETL.
  • Experience authoring webservices and webservice clients.
  • Bonus points are awarded if you have worked with append-only or distributed technologies.
  • You are also familiar with what data modeling approaches work well for transactional needs vs. analytical needs.
Who You Are
  • You work well with others and enjoy knowing the business reasons behind why we develop a new feature or product.
  • Initiative, results-oriented drive and a solid work ethic requiring minimal direction
  • Excellent time management and prioritization skills; ability to prioritize and manage competing tasks simultaneously in a fast-paced, time-sensitive environment
  • Assertive personality with a solid work ethic and initiative, requiring minimal direction
  • High energy and drive, coupled with resourcefulness, required to succeed in a start-up environment
  • A ferocious problem solver, capable of becoming productive quickly in an unfamiliar codebase.
What You'll Get
  • Ownership and challenge in your work
  • Collaborate with intelligent and highly skilled coworkers
  • Competitive compensation
  • Stock and Equity Options
  • Excellent benefits, including health, dental, vision, disability, 401(k) and life insurance
  • Generous paid time off policy including paid parental leave
  • Company Culture that is Committed to Work-Life Balance for each and every employee
  • Casual office environment with a startup feel – We have a particular fondness for Peanut M&Ms
Fantastic Downtown Location connected to the Merchandise Mart