Azure Big Data Architect


Bringing big data together with other data systems can yield amazing insights, particularly when presented in ways that users can see information and make decisions that affect the business. As new technologies like Azure, Hadoop and "Open Source" enable cheaper distributed processing and improved analytical capabilities, the bar from getting insights from new types of data, as well as ever increasing volumes of data, has come down.

In short; Avanade helps customers realize results in a digital world through business technology solutions and managed services that combine insight, innovation and expertise focused on Microsoft® technologies.

As a business Avanade is technically competent, at the forefront of innovation, technology and change - they can interpret what clients may need before they turn it into a reality.

As is the nature of working within a global professional services environment, your clients and projects will change over time so the flexibility to travel is a pre requisite All of our roles are project based so typically will involve working on client site throughout the UK: we work both in and outside London and have major projects in cities including Manchester, Leeds, Birmingham, Swindon and Cambridge. You can expect up to 80% travel as well as periods working on a dedicated client site.

The Role

The Big Data Architect role drives high priority customer initiatives, leveraging Azure data services to solve the biggest and most complex data challenges faced by Avanade's enterprise customers. This is a technical role, accountable for the end-to-end deployment and usage for Azure data services.

The Big Data Architect own's the Azure Data Services technical architecture: data architecture design sessions, implementation projects and/or Proofs of Concepts. The ideal candidate will have experience in customer facing roles and success leading deep technical architecture and design discussions with senior executives.

Key Responsibilities

Interface with delivery teams to design Azure data services solutions in support of the over-arching analytics services solution, including SQL Database, Document DB, SQL Data Warehouse, HD Insight, Azure Machine Learning, Stream Analytics, Data Factory, Event Hubs and Notification Hubs

Architect scalable data processing and analytics solutions, including technical feasibility for Big Data storage, processing and consumption e.g., development of enterprise Data Lake strategy, heterogeneous data management, Polyglot Persistence, decision support over Data Lake

Design, coordinate and execute pilots, prototypes or proof of concepts, provide validation on specific scenarios. Report on progress of business objectives; Ensure plan execution, Document and share technical best practices / insights with Engineering teams and the solution architect community


Experience Required

Deep subject matter expertise and demonstrable hands on experience implementing Big Data solutions using Microsoft Data Platform and Azure Data Services; including Data Factory, Data Warehouse, Data Lake, Data Lake Analytics, Data Catalog, U-SQL, User Access Management

o Operationalizing end-to-end cloud analytics solutions - Create a data factory, orchestrate data processing activities in a data-driven workflow, monitor and manage the data factory, move, transform, and analyze data

o Design data pipelines to support machine-learning solutions - Create and manage experiments, determine when to pre-process or train inside Machine Learning Studio, select input/output types, apply custom processing steps with R and Python, publish web services

o Design big data real-time processing solutions - Ingest data for real-time processing, design and provision compute resources, design for lambda architecture, design for real-time processing

o Designing big data batch processing and interactive solutions -Ingest data for batch and interactive processing, design and provision compute clusters, design for data security, design for batch processing, design interactive queries for big data

5+ years of experience with deep understanding in both traditional and modern data architecture and processing concepts, including relational databases (e.g., SQL Server, MySQL, Oracle), Data warehousing, big data (Hadoop, Spark, Storm), noSQL, and business analytics

5+ years of success in consultative/complex technical design and deployment projects (where necessary, managing various stakeholder relationships to get consensus on solutions)

Understanding of big data use-cases and Hadoop-based design patterns Knowledge of real time/stream analytics trends

5+ years of architecture, design, implementation, and/or support of complex application architectures (i.e. having an architectural sense for connecting data sources, data visualization, structured and unstructured data, etc.)

Use Case and Business Case development, including co-ordinating and winning Executive sponsorship.

Deep technical experience in one or more of the following areas: Software design or development, Application Design, Systems Operations / Management, Database architecture, Virtualization, IP Networking, Storage, IT Security

Working knowledge with AGILE development, SCRUM and Application Lifecycle Management

Prior work experience in a DBA/Consulting/Architecture position within a software and/or services company such as Amazon, Google, IBM, Softlayer, Oracle, T-Systems, Wipro, CSC, HP, Infosys, ServiceNow, Dell, TCS, Rackspace, Cognizant

Technical Requirements

Excellent knowledge and "hands on" experience with Azure cloud computing including big data technologies.

Azure SQL DB/DW, HD Insight, Azure Data Lake Storage, Azure Data Lake Analytics, Azure Machine Learning, Stream Analytics, Azure Data Factory, and CosmosDB.

Desired certifications and accreditations preferably one or more of below or comparable:

Microsoft Azure Designing and Implementing Big Data Analytics Solutions (70-475)

Microsoft Azure Designing and Implementing Cloud Data Platform Solutions (70-473)

Microsoft Professional Program Certificate in Data Science

Hortonworks (Associate, HDPCD)

Experience of hybrid and/or cloud architectures that utilise Azure

Experience in or exposure to solutions that are analytical in nature, employing data centric architectures

Data technology literate with a detailed understanding of data architecture and data tools and technologies, in particular in memory/in database and open source technology.

Experience of advanced data analytics and insights techniques (eg, predictive, segmentation, recommendation and sentiment analytics, machine learning techniques and leveraging structured and unstructured data)

Experience working directly within teams developing solutions based on statistics, machine learning, regression models and optimization techniques to distil meaningful business insight from data

  • Expert knowledge and/or experience in one of the following;
  • C#, R, Python, SQL, PL/SQL, MDX, JSON, XML, .NET, C++, T-SQL, Java, JSON, PHP
  • Hadoop (Hortonworks or Cloudera), Spark, Storm, Pig/Hive
  • NoSQL, DocumentDb, MongoDb
  • PL/SQL Developer, SQL Query Analyzer, R Studio, PowerBI, Tableau, Spotfire, etc, Visual Studio, TFS
Technical BS degree, required

TOGAF certification

Requisition ID - 44934

Avanade is the leading provider of innovative digital and cloud-enabling services, business solutions and design-led experiences, delivered through the power of people and the Microsoft ecosystem. Majority owned by Accenture, Avanade was founded in 2000 by Accenture LLP and Microsoft Corporation and has 30,000 professionals in 24 countries. Visit us at

Back to top