1 day old

Lead Data Engineer - Data Engineering Discovery

Target
Sunnyvale, CA
Apply Now
Apply on the Company Site
  • Job Code
    1173000

Job Description


Lead Data Engineer - Data Engineering Discovery(Job Number:INF000DGP)

The Data Engineering & Discovery team enables insight discovery from large amounts of data and its presentation in a human-friendly and understandable way. The problem space we work on encompasses e-commerce search and ranking, discovering insights into big data lakes, query and general text understanding, business-domain chat bots, as well as other NLP tasks.

The search project presents a guest with the highly relevant products from Target’s several million inventory based on the guest’s query expressed in English language. Solr and deep learning models power our search technology. 

The insight discovery project helps understanding business phenomena using differential analysis of large data sets with colossal number of features. For example, if one wants to compare sales between Mountain View and Sunnyvale stores, our system returns an insight grounded on differential analysis of particular features such as demographics or time, e.g., “millennial males bought more apparels in Sunnyvale”.  The insight discovery is enabled by high-speed algorithms for approximate traversal of a large feature lattice implemented using C and RocksDB.

The business-domain chatbot answers questions formulated in English language, e.g., “Can you tell me last week’s sales?", based on the data available in the numerous database tables. The technology behind it involves complex algorithms for translation English into SQL queries.

Our team possesses a combination of deep expertise in machine learning approaches to data and text analysis as well as engineering techniques for their implementation, deployment, and maintenance in production.

Ultimately, we provide immediate, informed, relevant, personalized access and insights from data.   

Use your skills, experience and talents to be a part of groundbreaking thinking and visionary goals. You will be required to:

  • Understand how to build scalable, real time, Big Data systems
  • Have developed and been a key influential member in a fully delivered data product
  • Lead the architecture and design of several modules related to the backend of a search system, a real time relevance engine, a system that computes ranking functions on the data on the fly, etc.
  • Be a hands-on developer and lead by example as a programmer
  • Provide guidance and contribute to coding standards
  • Provide leadership in agile sprints, CI/CD and the DevOps efforts

 

Requirements

  • M.S. in computer science or related areas
  • 5 years of experience developing production grade software
  • Deep knowledge of data structures and algorithms
  • Proficient in Linux or related Unix systems
  • Expert in one or more of C , Java and Python. Exposure to modern programming languages such as Scala, Rust and Go a huge plus.
  • Experience building and deploying large scale distributed data systems
  • Has been involved in designing, tuning and maintaining production systems
  • Excellent written and verbal communication skills



Primary Location: United States-California-Sunnyvale
Posted: 2019-02-19 Expires: 2019-03-20

Featured Job

Featured Employer

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Lead Data Engineer - Data Engineering Discovery

Target
Sunnyvale, CA

Join us to start saving your Favorite Jobs!

Sign In Create Account
Powered ByCareerCast