Splunk Data Engineer - Logging And Analytics

3 weeks agoBangalore, India

Job Requisition ID #


Position Overview

We are looking for a savvy Data and Analytics Engineer to join our growing logging and data analytics team. The new hire will be responsible for expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, platforms and products.


  • Develop machine learning models and prototyping solutions, as well as analyzing large amounts of customer data for new opportunities to improve our technology and processes.
  • Deliver machine learning capabilities that enable the growth of Autodesk's logging and analytics platforms
  • Implement data processing pipelines to clean, transform and process large, complex data sets
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Work with Engineering and Product teams to define problems and integrate data solutions into customer facing products
  • Work with stakeholders to assist with data-related technical issues and support associated data infrastructure needs.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Keep up to date with the latest and greatest in feature-sets and capabilities from public cloud providers (such as AWS and Azure) and find ways to apply them back help their team

Minimum Qualifications
  • Advanced SQL and experience with big data technology such as Hive, Presto, Glue, or Athena
  • Experience with Machine Learning, including recommender systems, classification, regression and optimization techniques
  • Proficient with the Python data science stack, e.g. Pandas, Sklearn, Pytorch etc.
  • Experience with scripting languages such as Python and Scala
  • Experience with big data tools such as Splunk, Elasticsearch, PySpark
  • Experience with SQL and NoSQL databases, including Postgres and AWS Dynamodb
  • Experience with AWS cloud services used often for data engineering including S3, EC2, Glue, Lambda, RDS, Redshift
  • Experience working with APIs to pull and push data
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytical skills related to working with unstructured datasets.
  • Familiarity with Agile and SCRUM methodologies
  • Independently accountable and capable of solving problems with minimal guidance

Preferred Qualifications
  • Experience working with PowerBI to develop dashboards and reports
  • Experience working with agile, globally distributed teams
  • AWS Data Analytics Speciality Certification
  • AWS ML Certification

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers.

Job ID: autodesk-20WD41353