Data Engineer

Mission Statement

This role is responsible for designing, developing, and maintaining data solutions on the Azure platform. As an Azure Data Engineer, you will work closely with data scientists, data analysts, and other stakeholders to ensure the efficient and reliable processing of data. You will build and manage data pipelines, ensure data quality, and support data-driven decision-making processes. You must possess strong technical skills, a deep understanding of data engineering practices, and the ability to work both independently and in teams

Your Responsibilities:

• Designing and implementing scalable and reliable data pipelines on the Azure platform
• Developing and maintaining data integration solutions using Azure Data Factory, Azure Databricks, and other Azure services
• Ensuring data quality and integrity by implementing best practices in data collection, processing, and storage
• Collaborating with data scientists, data analysts, and other stakeholders to understand their data needs and deliver actionable insights
• Managing and optimizing Azure data storage solutions such as Azure SQL Database, Azure Data Lake, and Azure Cosmos DB
• Monitoring the performance of data pipelines and implementing strategies for continuous improvement
• Developing and maintaining ETL processes to support data warehousing and analytics
• Implementing best practices for data governance, security, and compliance
• Staying up-to-date with the latest industry trends and technologies to continuously improve data engineering practices and methodologies
• Living Hitachi Energy's core values of safety and integrity, which means taking responsibility for your own actions while caring for your colleagues and the business.

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 8+ years of experience in data engineering, with a focus on Azure data services
• Relevant certifications in Azure data services or cloud computing will be an added advantage
• Proficiency in programming and scripting languages such as Python, SQL, or Scala
• Experience with Azure data services, including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake
• Strong understanding of data modeling, ETL processes, and data warehousing concepts
• Experience with big data technologies such as Hadoop and Spark
• Knowledge of data governance, security, and compliance best practices
• Familiarity with monitoring and logging tools such as Azure Monitor and Log Analytics
• Strong problem-solving and troubleshooting skills
• Excellent communication and collaboration skills to work effectively with cross-functional team.
• Strong attention to detail and organizational skills
• Ability to articulate and present ideas to senior management
• Problem-solving mindset with the ability to work independently and as part of a team
• Eagerness to learn and enhance knowledge unassisted
• Strong networking skills and global orientation
• Ability to coach and mentor team members
• Effective collaboration with internal and external stakeholders
• Adaptability to manage and lead transformational projects
• Proficiency in both spoken & written English language is required