Senior Data Engineer

EMPLOYER: Delta Dental of California
TITLE: Senior Data Engineer

Location: 560 Mission Street, 13th Floor, San Francisco, CA 94105. Must appear in office 2-3 days per week.

Salary: $188,885 - $196,500/yr

Job Description: Design, develop, and maintain scalable data pipelines and ETL processes to collect, transform, and store large volumes of data. Collaborate with cross-functional teams to understand data requirements, identify opportunities for data integration, and propose efficient data engineering solutions. Implement data governance and quality control measures to ensure data accuracy, consistency, and integrity throughout the data lifecycle. Optimize and tune database systems and data processing frameworks for performance and scalability. Lead the evaluation, selection, and implementation of data engineering technologies, tools, and frameworks. Mentor and provide guidance to junior data engineers, assisting in their professional development. Collaborate with data scientists and analysts to support their data needs, providing efficient access to relevant datasets. Develop and maintain data models, schemas, and documentation to facilitate data understanding and accessibility. Work closely with infrastructure and DevOps teams to ensure data systems are secure, reliable, and properly integrated with existing infrastructure. Perform data profiling, analysis, and data mining tasks to identify patterns, trends, and insights in large datasets. Collaborate with stakeholders to identify business requirements and translate them into technical data engineering solutions. Implement data warehousing and data mart solutions to support reporting and analytics needs. Stay up-to-date with emerging data engineering technologies and best practices, and proactively recommend improvements to existing systems. Troubleshoot and resolve data-related issues, ensuring minimal disruption to data pipelines and systems. Collaborate with data privacy and compliance teams to ensure adherence to data privacy regulations and industry standards. Conduct performance monitoring and capacity planning to anticipate and address future data engineering needs. Develop and maintain data governance policies, procedures, and documentation. Participate in data architecture discussions and provide input on data storage, data flow, and data integration strategies. Collaborate with stakeholders to define and implement data retention and archival strategies. Continuously monitor and optimize data engineering processes, striving for efficiency, reliability, and scalability. Must appear in office 2-3 days per week.