Data Engineer - Director - Data & Analytics Engineering

Profile Description

We're looking for a skilled Data Engineer with minimum 5+ years of experience to join our team.

CDRR_Technology

The Cybersecurity organization's mission is to create an agile, adaptable organization with the skills and expertise needed to defend against increasingly sophisticated adversaries. This will be achieved by maintaining sound capabilities to identify and protect our assets, proactively assessing threats and vulnerabilities and detecting events, ensuring resiliency through our ability to respond to and recover from incidents and building awareness and increase vigilance while continually developing our cyber workforce.

Firmwide Data Office

Data COE team is distributed globally between New York, London, Budapest, India, and Shanghai; and are engaged in a wide array of projects touching all business units (Institutional Securities, Investment Management, Wealth Management) and functions (e.g., Operations, Finance, Risk, Trading, Treasury, Resilience) across the Firm. The team vision is a multi-year effort to simplify firm's data architecture and business processes front-to-back with goals of reducing infrastructure and manpower costs, improving the ability to demonstrate control of data, empowering developers by providing consistent means of handling data, facilitate data-driven insights & decision making, and providing a platform to implement future change initiatives faster, cheaper, and easier.

Data & Analytics Engineering

This is a Director position that provides specialist data analysis and expertise that drive decision-making and business insights as well as crafting data pipelines, implementing data models, optimizing data processes for improved data accuracy and accessibility, including applying machine learning and AI-based techniques.

Morgan Stanley is an industry leader in financial services, known for mobilizing capital to help governments, corporations, institutions, and individuals around the world achieve their financial goals.

At Morgan Stanley India, we support the Firm's global businesses, with critical presence across Institutional Securities, Wealth Management, and Investment management, as well as in the Firm's infrastructure functions of Technology, Operations, Finance, Risk Management, Legal and Corporate & Enterprise Services. Morgan Stanley has been rooted in India since 1993, with campuses in both Mumbai and Bengaluru. We empower our multi-faceted and talented teams to advance their careers and make a global impact on the business. For those who show passion and grit in their work, there's ample opportunity to move across the businesses for those who show passion and grit in their work.

Interested in joining a team that's eager to create, innovate and make an impact on the world? Read on...

What you'll do in the role:
The Firmwide Data Office department is recruiting for an enthusiastic, dynamic, hands-on and delivery focused Data and ETL Engineer.
As a member of our Software Development team, we look first and foremost for people who are passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner with stakeholders to stay focused on business goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment-one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally. You'll combine your design and development expertise with a never-ending quest to create innovative technology through solid engineering practices. You'll work with highly inspired and inquisitive team of technologists who are developing & delivering top quality technology products to our clients & stakeholders.

Responsibilities:
• Design, development and support of Data Ingestion Pipelines for Knowledge Graph using Python & Snowflake.
• Collaborate with business and other technology teams to translate business requirements into innovative solutions implementing performant, scalable, resilient distributed applications

What you'll bring to the role:

Required Skills & Qualifications:
• Minimum 5+ Years of strong development experience building robust Data ingestion pipelines using tools like Python, PySpark and Snowflake as well as Autosys/Airflow.
• Strong experience in writing multi-processing scripts using Python and distributed processing scripts using PySpark.
• Strong problem-solving skills, business acumen, and demonstrated excellent oral and written communication skills with both technical and non-technical audiences
• Experience in closely working with application teams and managing all the DB related activities such as DB modeling, design, development, maintenance and support
• 2+ Years of strong experience in python for automating data cleansing, data re-formatting, data transformations
• Strong Skills in Relational Databases including database design, writing complex queries and stored procedures, performance tuning
• Strong Data Modeling skills - Enterprise Data Model (OLTP) and Dimensional modeling. Well versed with principles, techniques and best practices of data modeling.
• Extensive experience in designing and developing of complex mappings, applying various transformations such as lookup, source qualifier, update strategy, router, sequence generator, aggregator, rank, stored procedure, filter, joiner and sorter transformations
• Experience in integration of various data sources like DB2, SQL Server, and Flat Files into the staging area
• Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, Remove duplicates, Filter, Dataset, Lookup file set, Modify, Aggregator, XML parsing stages.
• Knowledge about DevOps implementation in Data space
• Extensive experience working on UNIX/Linux platform, Python scripting and managing
• Bachelor's/Master's Degree in Computer Science, Computer Engineering, Data Analytics or related field

Good to Have: