Data Engineer for ABP 1 subcon

City: Bengaluru

State/Province: Karnataka

Posting Start Date: 2/6/26

Job Description:

Job Description

Experience Level : 7 - 18 years' experience inData Engineering development with end-to-end Data Platform implementation using AWS tech stack. Mandatory Skills: Excellent understanding and design experience of Big Data platform, Data Lake, Lakehouse architecture, Medallion architecture and modern data architecture. Excellent in SQL/PL-SQL scripting in columnar database Excellent Data Modelling experience Strong skills in Redshift, SQL, PL-SQL, Glue, PySpark, Spark, S3, Shell scripting Strong skills in Airflow, Kinesis, Step function and related ETL-DW data services Develop, enhance & optimize data pipelines using AWS service, custom ETL tools and automating data pipelines. Experience in code deployment in various environments Designing job scheduling, optimizing airflow job orchestration, designing batch/stream monitoring in systems, usage tracking etc. Excellent implementation skills in AWS tech stack, ETL & ELT, DW BI, EMR, S3, SQS, Step function, Lambda, Scala.

Dos

1. Managing the technical scope of the project in line with the requirements at all stages

a. Gather information from various sources (data warehouses, database, data integration and modelling) and interpret patterns and trends

b. Develop record management process and policies

c. Build and maintain relationships at all levels within the client base and understand their requirements.

d. Providing sales data, proposals, data insights and account reviews to the client base

e. Identify areas to increase efficiency and automation of processes

f. Set up and maintain automated data processes

g. Identify, evaluate and implement external services and tools to support data validation and cleansing.

h. Produce and track key performance indicators

2. Analyze the data sets and provide adequate information

a. Liaise with internal and external clients to fully understand data content

b. Design and carry out surveys and analyze survey data as per the customer requirement

c. Analyze and interpret complex data sets relating to customer’s business and prepare reports for internal and external audiences using business analytics reporting tools

d. Create data dashboards, graphs and visualization to showcase business performance and also provide sector and competitor benchmarking