Manager, Big Data Production Support Engineer

11 West 19th Street (22008), United States of America, New York, New York

At Capital One, we're building a leading information-based technology company. Still founder-led by Chairman and Chief Executive Officer Richard Fairbank, Capital One is on a mission to help our customers succeed by bringing ingenuity, simplicity, and humanity to banking. We measure our efforts by the success our customers enjoy and the advocacy they exhibit. We are succeeding because they are succeeding.

Guided by our shared values, we thrive in an environment where collaboration and openness are valued. We believe that innovation is powered by perspective and that teamwork and respect for each other lead to superior results. We elevate each other and obsess about doing the right thing. Our associates serve with humility and a deep respect for their responsibility in helping our customers achieve their goals and realize their dreams. Together, we are on a quest to change banking for good.

Manager, Big Data Production Support Engineer

At Capital One, we have seas of big data, with rivers of fast data and we're bringing all of that data to the Cloud (AWS)! To tame it all we're using tools like Spark, Scala, Akka, Cassandra, Accumulo, HBase, Hadoop, HDFS, AVRO, MongoDB, and Mesos – and we're on the look-out for anything else that will help us.

As a future Manager, Big Data Production Support Engineer at Capital One, you will be working on cutting edge, high profile projects and are motivated by delivering solutions on an aggressive schedule. You'll be able to identify and remove impediments, while successfully driving towards key initiatives. Building and maintaining strong relationships, earning and maintaining confidence with both customers and business leaders are critically important responsibilities.

Who you are:

  • Aren't satisfied with status quo, and regularly look for creative ways to solve problems and help your team meet commitments
  • Are insatiably curious - you ask why, you explore, and you're not afraid to blurt out your crazy idea
  • Love learning new technologies and sharing them with your team
  • Have a keen interest in using any and all appropriate tools, especially Cloud-based and Open Sourced, to solve the problem at hand
  • Have strong verbal and written communication skills, due to the dynamic nature of collaborations with customers, vendors, and other engineering teams to solve complex business problems together

What you'll be doing:

  • Work within a team of like-minded professionals to maintain our production environment of our internally hosted applications
  • Learning new skills to build, support and maintain our on prep data lake and new Amazon Web Service (AWS) hosted infrastructure and applications
  • Influence other teams and broader Engineering groups in adopting best practices

Responsibilities include:

  • Strong working knowledge on Unix and Linux platforms
  • Leverage structured problem solving skills to coordinate multi-disciplinary problem resolution (involving the appropriate resources and making fixes as quickly as possible) and work with Problem management to ensure procedures are followed and all problems within scope are documented and closed appropriately
  • Work directly with various system owners and internal teams in managing supported environment
  • Participate in system design improvements and performance enhancements
  • Oversee Production deployments of current data driven applications
  • Owning all aspects of service delivery-including participation in the service readiness process to validate that all required Conditions of Satisfaction are met prior to project rollout
  • Work with IT & business partners to define system metrics and SLAs
  • Reviewing system test scenarios & test cases
  • Monitoring operating efficiency of existing application systems
  • Maintains system support documentations and Maintains inventory of applications and associated artifacts (DR plans, contingency plans, support guides, CIs, etc.)
  • Participate in DR exercises to recover applications and provide support to Ops testers
  • Drives the resolution of incidents, involves the appropriate resources and ensures fixes are implemented as quickly as possible.
  • Identify reoccurring issues and work with IT & Business partners to remediate using the problem management process
  • Coordinates, approves, and/or performs changes to the systems within their portfolio and their infrastructure
  • Periodically review and update the DR scripts to keep them updated. Keep DR information (Recovery Time Objective, Recover Point Objective, etc) .


Basic Qualifications:

  • Bachelor's Degree or military experience
  • At least 5 years of experience Production Support experience in Hadoop Unix/Linux environments
  • At least 2 years of database experience with one of the following: Oracle or SQL Server or PostgreSQL or MongoDB
  • At least 2 years of experience with web services architecture
  • At least 1 year experience with Cloud hosting solutions
  • At least 1 year experience with DevOps tools such as Chef/Jenkins/Ansible/Puppet/Docker

Preferred Qualifications:

  • Master's Degree in Information Systems, Computer Science, or Engineering
  • 2+ years' experience scripting in languages such as Python/Ruby/Java
  • Experience working with Agile Development Practices
  • 2+ years' experience with monitoring and automation tools such as Service Now, Diagnostics, Service Manager, Operations Orchestration, or Server Automation
  • 2+ years' experience with monitoring tools such as Data Dog or Splunk
  • 1+ years' experience migrating data and applications from on prem to AWS

At this time, Capital One will not sponsor a new applicant for employment authorization for this position

No agencies please. Capital One is an Equal Opportunity Employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex, race, color, age, national origin, religion, physical and mental disability, genetic information, marital status, sexual orientation, gender identity/assignment, citizenship, pregnancy or maternity, protected veteran status, or any other status prohibited by applicable national, federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.

If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at

Meet Some of Capital One's Employees

Ryan P.

Head Of Design

Ryan and his team of designers and developers work at The Shop, a combined technology workshop and retail hub, to create meaningful financial products and services.

Emma S.

Product Manager

On Capital One’s exploratory Research and Development Group, Emma takes consumer-driven products from white space to market with innovative and interactive user-testing lab experiments.

Back to top