Oh Snap!
This job is no longer active - but you can still view the details below.

Lead Data Platform Engineer

Discover. A more rewarding way to work.At Discover Financial Services, you’ll find yourself in the company of some of the industry’s smartest and most reliable professionals. And at a company that rewards dedication, values innovation and supports growth.Thrive in an environment that promotes teamwork and shared success. Build on a foundation of mutual respect. Join the company that understands rewarding careers like no other, with this exceptional opportunity: Job Description:
Do you want to be on the forefront of the next BIG thing in advancing the analytic technology landscape? Are you driven by the thought of being involved at the ground level of an enterprise wide transformation? Do you enjoy solving complex business problems in a fast paced, collaborative environment?Discover Financial Services is seeking a bright, driven, and talented individual to join a team of passionate and innovative technologists. *** THIS POSITION WILL BE BASED IN OUR HEADQUARTERS IN RIVERWOODS ILLINOIS WITH THE FLEXIBILITY OF WORKING A FEW DAYS A WEEK FROM OUR DOWNTOWN CHICAGO OFFICE *** In this role, you will use your experience and hands on approach with next generation technologies to contribute to a team that delivers the latest streaming & next generation data technologies.Responsibilities:

  • Contributing member of a high performing, agile team focused on next generation data & analytic technologies
  • Create and enhance analytic platforms & tools that enable state of the art, next generation Big Data capabilities to analytic users and applications
  • Engineering and integrating Hadoop modules such as YARN & MapReduce, and related Apache projects such as Hive, Hbase, Pig
  • Assist application development teams during application design and development for highly complex and critical data projects
  • Code and integrate open source solutions into the data analytic ecosystem
  • Develop fast prototype solutions by integrating various open source components
  • Operationalization of open source data analytic tools for enterprise use
  • Be part of teams delivering all data projects including migration to new data technologies for unstructured, streaming and high volume data
  • Building efficient data platform for structured and unstructured data
  • Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm and Kafka
  • Utilizing programming languages like Java, Spark, Python with an emphasis in tuning, optimization and best practices for application developers
  • Provide solutions for data engineers such as NIFI processors and workflows
  • Manage NoSQL databases like HBase, Cassandra and MongoDB
  • Developing data management and governance tools on an open source framework
  • Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of end user capabilities
  • Developing data solutions on cloud deployments such as AWS
  • Industry experience in Financial Services or other regulated industries
  • Hands on experience leading delivery through Agile methodologies
  • Management practices by adhering to required standards and processes
  • Promote a risk-aware culture, ensure efficient and effective risk and compliance management practices by adhering to require standards and processes.

Skills Required:

  • Bachelors Degree
  • 5+ years work experience
  • 2+ years Linux/Unix including basic commands, shell scripting and solution engineering
  • 0-1 years Hadoop administration
  • 0-1 years experience with various tools and frameworks that enable capabilities within the data ecosystem (Hadoop, Kafka, NIFI, Hive, YARN, HBase, NoSQL)

Skills Desired:

  • Experience developing software solutions to build out capabilities on a Big Data and other Enterprise Data Platforms
  • Experience with solving problems and delivering high quality results in a fast paced environment
  • Experience with NIFI specifically with developing custom processors and workflows
  • Experience managing NOSQL databases such HBASE , Casandra, MongoDB
  • Expertise in coding in Python, Hive, R, Spark, Java with emphasis on tuning / optimization
  • Experience developing data solutions on AWS
  • Experience designing, developing, and implementing ETL and relational database platforms
  • Experience working with automated build and continuous integration systems (Chef, Jenkins, Docker)
  • Experience managing code on Github
  • Experience with data mining, machine learning, statistical modeling tools or underlying algorithms

About Us
Since Discover launched in 1986, weve made a business of redefining the credit card industry for the better. We were first to have no annual fee, first to offer cash rewards, first to provide 24/7 customer service, and we rank #1 in customer loyalty. As a Fortune
500 company, we strive to provide our employees with an environment where they can contribute in a way thats different from other large institutions. If youre looking for a place to make a difference and let your voice shine through, wed love to meet you.
Apply today at discover.com/careers.
Discover Financial Services is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran status, among other things, or as a qualified individual with a disability. Skills:
Building and administering large scale data platforms such as Hadoop data Lake, integrating next-gen data analytic tools into the Big data ecosystem, Expertise in Real-time data technologies such as Spark, Flink, Kafka, NIFILeveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of end user capabilitiesUtilizing Hadoop modules such as YARN & MapReduce, and related Apache projects such as Hive, Hbase, PigUtilizing programming languages like Java, Python and NoSQL databases like CassandraDeveloping and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm and KafkaBe part of teams delivering all data projects including migration to new data technologies for unstructured, streaming and high volume dataProvide senior level technical consulting to application development teams during application design and development for highly complex and critical data projectsProvide senior level technical consulting to create and enhance analytic platforms & tools that enables state of the art, next generation Big Data capabilities to analytic users and applicationsBuild and lead a high-performing, agile team focused on next generation data & analytic technologies We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class.

Read Full Job Description

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • JavaLanguages
    • PythonLanguages
    • ScalaLanguages
    • SqlLanguages
    • Neo4jLanguages
    • RLanguages
    • AngularJSFrameworks
    • HadoopFrameworks
    • SparkFrameworks
    • SpringFrameworks
    • Amazon Web ServicesFrameworks
    • AnsibleFrameworks
    • AWS PortfolioFrameworks
    • BlockchainFrameworks
    • ChefFrameworks
    • CloudFoundryFrameworks
    • DockerFrameworks
    • Google Cloud PlatformFrameworks
    • KubernetesFrameworks
    • Lambda ArchitectureFrameworks
    • OpenAPIFrameworks
    • OpenShiftFrameworks
    • CassandraDatabases
    • HiveDatabases
    • MongoDBDatabases
    • OracleDatabases
    • TeradataDatabases
    • ServerlessDatabases
    • TerraformDatabases
    • Google AnalyticsAnalytics
    • SparkAnalytics
    • H20Analytics
    • Machine Learning Analytics
    • Natural Language Processing Analytics
    • Programmable BotsAnalytics
    • AgileManagement
    • SafeManagement
    • LeanManagement
    • Continuous Delivery Management
    • DevSecOpsManagement
    • Reactive ProgrammingManagement
    • Site Reliability EngineeringManagement
    • SalesforceCRM

Location

Our headquarters is located in the northwest suburbs of Chicago and we also have a downtown Chicago office which is known as the“The 606”.

An Insider's view of Discover Financial Services

What’s the vibe like in the office?

The cool thing about working at Discover is the wonderful collaborative environment we have and all the smart, talented and fun people we work with every day to continuously work on innovations.

Hiba

AWS Cloud Engineer

What does your typical day look like?

I enjoy working at Discover because I get to work with and collaborate with talented people who are passionate about what they do, and together we get to help others. We work constructively and cross-functionally to provide the best and newest products for our users and provide exceptional support for our customers!

Mandy

Project Manager, Advanced Analytics Platform

How does the company support your career growth?

There are two reasons I enjoy working at Discover. First, I enjoy the challenging and meaningful work. Second, my career path at Discover is mine to shape. My managers have supported me when I wanted to learn more and move within the company.

George

Senior Manager, Software Engineering

What is your vision for the company?

My vision of the company is that we create rewarding experiences in lives of our customers every day through analytics.

Kumar

SVP, CDO Advanced Analytics Platforms

What’s the vibe like in the office?

I love working at Discover because of how the company invests in its people and innovation. The environment is encouraging and the smart people around you makes it an amazing experience every day!

Brent

Director, Digital Analytics

What are Discover Financial Services Perks + Benefits

Discover Financial Services Benefits Overview

Start enjoying great benefits Day 1 — We support you with the same dedication we bring to all of our customers.Our comprehensive benefits package features first-class insurance, financial planning support and excellent perks designed to help you reach your goals and live a rich, healthy life.

Check out more of our amazing employee benefits at mydiscoverbenefits.com

Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
You can open a separate Health Care FSA (HCFSA) and contribute up to $2,650 tax-free from your paycheck to reimburse yourself for eligible out-of-pocket expenses.
Disability Insurance
Employees receive Short-Term Disability Insurance at no cost.
Dental Benefits
Discover offers two dental plan options — Standard and Premier — both are administered by MetLife.
Vision Benefits
Discover offers two vision plan options — Standard and Premier through VSP.
Health Insurance Benefits
Discover offers a variety of medical plans for you and eligible family members, so that you can choose the benefit plan that suits your needs.
Life Insurance
As a Discover employee, you receive Basic Life Insurance of one times your HWEE (up to $500,000) at no cost to you.
Pet Insurance
Purchase medical coverage at a discounted rate for your beloved family pet. The more pets you insure, the greater the discount.
Wellness Programs
Help balance your work and personal life with a wide variety of free and discounted resource and referral services including family and relationship counseling and financial guidance.
Onsite Gym
Discover has fitness centers and Weight Watchers® programs at all five major locations.
Retirement & Stock Options Benefits
401(K)
You may elect to contribute 1% to 30% of your eligible base salary, commissions and bonus on a pre-tax basis, up to IRS limits every year.
401(K) Matching
Discover matches up to 6% of the pre-tax contributions you make to the 401(k) Plan.
Employee Stock Purchase Plan
The ESPP provides eligible employees with an opportunity to purchase shares of Discover common stock through payroll deductions at a 5% discount.
Performance Bonus
Child Care & Parental Leave Benefits
Child Care Benefits
Generous Parental Leave
Flexible Work Schedule
Remote Work Program
Family Medical Leave
Adoption Assistance
Discover helps eligible employees and their families with the costs of adoption by reimbursing certain expenses.
Vacation & Time Off Benefits
Generous PTO
Discover has a Paid Time Off of 4 to 5 Weeks of paid time per year.
Paid Volunteer Time
Paid Holidays
Discover provides 7 paid holidays.
Paid Sick Days
Perks & Discounts
Casual Dress
Commuter Benefits
When you enroll in the Commuter Benefits Program at WageWorks, you’ll save on taxes on mass-transit passes, parking and other eligible expenses.
Company Outings
Game Room
Parking
Recreational Clubs
Relocation Assistance
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement
Discover provides tuition reimbursement and a full-ride bachelor's degree program for select online degree programs.
Diversity Program
More Jobs at Discover Financial Services51 open jobs
All Jobs
Data + Analytics
Dev + Engineer
Operations
Project Mgmt
Developer
new
North Suburbs
Developer
new
North Suburbs
Project Mgmt
new
North Suburbs
Operations
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
Chicago
Data + Analytics
new
Chicago
Data + Analytics
new
Chicago
Developer
new
North Suburbs
Project Mgmt
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Project Mgmt
new
North Suburbs
Project Mgmt
new
North Suburbs
Developer
new
North Suburbs
Developer
new
Chicago
Developer
new
North Suburbs
Operations
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Operations
new
North Suburbs
Project Mgmt
new
North Suburbs
Developer
new
Chicago
Data + Analytics
new
Chicago
Developer
new
Chicago
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs