Lead Data Engineer

JOB DESCRIPTION: Position is based in Charlotte, NC, some teleworking may be permitted. Travel to Lowe's offices may be required.

Translate intricate cross-functional business requirements and functional specifications into logical program designs and modules. Partner with the Product Team to deeply understand business needs and functional specifications. Collaborate with cross-functional teams to ensure that specifications are transformed into flexible, scalable, and maintainable solution designs. Evaluate project deliverables to guarantee they align with specifications and architectural standards. Guide development teams in designing and building complex Data and Platform solutions. Ensure that teams align with the architecture blueprint, standards, target state architecture, and strategic goals. Oversee the design, implementation, and maintenance of data warehouses, ensuring they support the organization's analytical and reporting needs. Select suitable data storage technologies and tools based on the organization's requirements. Lead and mentor a team of data engineers, providing guidance, support, and technical expertise. Foster the growth of junior team members, particularly in Data Engineering. Execute the development, maintenance, and enhancement of data ingestion solutions across various data sources, showcasing expertise in Data Ingestion. Execute the development, maintenance, and enhancement of BI solutions across different data sources, such as DBMS and File systems. Create and work with complex metrics, custom groups, consolidations, drilling, and complex filters. Demonstrate expertise in various database technologies (Teradata, Oracle, PostgreSQL, MySQL, Db2, Hadoop) by writing views for business requirements and utilizing freeform SQLs. Ensure compliance with data governance and privacy regulations, including CCPA and HIPAA, when handling and storing data. Administer crucial and complex Bigdata/Hadoop infrastructure to facilitate next-generation analytics and data science capabilities.

JOB REQUIREMENTS: Job requires a Bachelor's degree in Computer Science, CIS, Engineering or related field and 7 years of experience in any job title/occupation involving Data, BI, Platform Engineering, Data Warehousing/ETL, Databases, Software Engineering or a related field. Employer will accept single degree or combination of degrees, diplomas and/or professional experience equivalent to a Bachelor's degree.

Must have prior experience in:

• 6 years of experience in:
• Designing robust and scalable data architectures that align with business needs and industry best practices;
• Designing, implementing, and optimizing distributed computing systems for large-scale data processing;
• Creating and optimizing data models for efficient storage, retrieval, and processing of large datasets;
• Implementing robust data governance policies, ensuring data security, compliance, and privacy;
• Cloud platforms like AWS, Azure, or Google Cloud, including proficiency in leveraging cloud-native data services;
• Analyzing and optimizing the performance of data systems, including tuning queries, optimizing storage, and improving overall data processing efficiency.
• 5 years of experience in:
• Implementing data quality assurance processes, including anomaly detection, data profiling, and validation;
• Implementing and optimizing data warehousing solutions for analytical processing and reporting.
• 4 years of experience in:
• Big data frameworks and technologies such as Apache Hadoop, Apache Spark, and Apache Flink;
• Designing and orchestrating end-to-end data pipelines, ensuring data quality, reliability, and timely delivery.
• 3 years of experience in building real-time data processing systems for streaming analytics and immediate insights.