Senior Manager Distributed Data Engineering

11 West 19th Street (22008), United States of America, New York, New York

At Capital One, we're building a leading information-based technology company. Still founder-led by Chairman and Chief Executive Officer Richard Fairbank, Capital One is on a mission to help our customers succeed by bringing ingenuity, simplicity, and humanity to banking. We measure our efforts by the success our customers enjoy and the advocacy they exhibit. We are succeeding because they are succeeding.

Guided by our shared values, we thrive in an environment where collaboration and openness are valued. We believe that innovation is powered by perspective and that teamwork and respect for each other lead to superior results. We elevate each other and obsess about doing the right thing. Our associates serve with humility and a deep respect for their responsibility in helping our customers achieve their goals and realize their dreams. Together, we are on a quest to change banking for good.

Senior Manager Distributed Data Engineering

We are looking for an experienced data engineer in the open source big data ecosystem. You should bring engineering and development discipline to data engineering work within our Commercial Banking Innovation team. We value balanced teams and T-shaped specialists, so your expertise in data engineering should be augmented with software development or DevOps skillset. We understand that the field changes rapidly, so you need to demonstrate ability to learn and adapt quickly. We are a tightly-knit team that values egoless leadership. We are a part of a larger organization, so we will rely on your ability to get things done through others.

You will be evaluating, installing, configuring, and deploying software; you will be writing code and use thoughtful engineering practices to test it, deploy it, and run it.

Relevant knowledge and experience:

1. At least 3 years of software engineering fundamentals (source control, development practices, agile, testing, CI/CD)

2. At least 3 years big data engineering experience, focusing on open source tools, for instance:

a. Ingestion-NiFI, Kafka and other message brokers

b. Transformation-Spark, Beam, Flink, Storm

c. Storage-Cassandra, HBase, MongoDB, Parquet, Avro

d. Query-Impala, Druid

e. Analytics-H2O, Spark MLlib

3. At least 5 year experience in a single programming language and ecosystem (e.g. Java, Python, Scala, Go)

4. At least 3 years data modeling experience (dimensional modeling, temporal modeling, OLAP)

At this time, Capital One will not sponsor a new applicant for employment authorization for this position.

Meet Some of Capital One's Employees

Ryan P.

Head Of Design

Ryan and his team of designers and developers work at The Shop, a combined technology workshop and retail hub, to create meaningful financial products and services.

Al L.

Technology Recruiting Manager

Al leads a team of recruiters that support technology growth across the company. He focuses on bringing in top technology talent that can impact an industry ripe for change.

Back to top