Data Engineer Principal

HealthPartners is hiring a Data Engineer.

Our mission is to provide simple and affordable healthcare. HealthPartners teams use data to improve patient and member experience, improve health, and reduce the per capita cost of health care. HealthPartners data engineers are responsible for building, managing and optimizing data pipelines that facilitate data movement in service of these goals by implementing and testing methods (or build systems) that improve data reliability and quality. Data engineers work in collaborative scrum teams with other developers, analysts and data scientists and may share work efforts in order to achieve sprint goals. They champion and embrace leading practices in the field, and develop processes to effectively store, manage and deliver data. As part of their role, data engineers are responsible for reducing manual data work and improving productivity; they employ and test innovative tools, techniques and architectures to detect patterns and automate common or repetitive data preparation and integration tasks.

ACCOUNTABILITIES:

All team members must champion and model our values of partnership, curiosity, compassion, integrity, and excellence, and must contribute to a culture of continuous learning.

Work with stakeholders, data scientists and analysts to frame problems, clean and integrate data, and determine the best way to provision that data on demand

Collaborate with other engineers to design technology solutions that achieve measurable results at scale

Collaborate with data scientists to train, develop and operationalize learning models

Provide technical thought leadership for efficient data pipeline processes, warehouse architecture and business intelligence functions.

Identify, design and implement software architecture to manage software development tasks associated with developing, debugging, or designing software applications, operating systems, and databases according to provided design specifications.

Build enhancements within an existing software architecture and envision future improvements to the architecture.

Assist in the development of short, medium, and long-term plans to achieve strategic objectives.

Guide, mentor, influence, and adopt a cloud-first modern data architectural direction, and consistently adopt the associated standards and best practices

Monitor and analyze information and data systems and evaluate their performance to discover ways of enhancing them (such as new technologies and upgrades).

Collaborate with cross-function engineering teams to design interfaces that support data integration with internal and external platforms

Data engineers perform other duties as required, to meet team sprint goals

REQUIRED SKILLS/ QUALIFICATIONS:

Bachelor's degree in computer science, data or social science, operations research, statistics, applied mathematics, econometrics, or a related quantitative field AND 4+ years of experience in business analytics, data science, software development, data modeling and/or data engineering work OR Master's Degree in Computer Science, Math, Software is acceptable

10+ years of programming experience with command in at least two or more of the following programming languages: SQL, Python, Java, R or Spark

Expert proficiency in SQL; experience with Oracle, PostgreSQL, MySQL, or Microsoft SQL Server

10+ years of experience using a combination of tools such as Azure Data Factory, Synapse, Data Explorer, App Insights, Power BI, and Databricks

3+ years of experience using Azure CosmosDB and Azure Data Lake Storage

Must be motivated, self-driven, curious, and creative

Proven ability to lead projects and teams with minimal guidance

Must be skilled communicator, and demonstrate an ability to work with end users and business leaders

Demonstrate the ability to support and complement the work of a diverse development and/or operations team

Lead a collaborative, cross-functional team, Active participation in sprint reviews

Expert and a minimum of five year's experience in the following domains: Data management, software engineering, I&O (infrastructure and operations)

PREFERRED QUALIFICATIONS:

Knowledge of health care operations

Exposure to agile/scrum

Ability to work in a hybrid cloud environment consisting of on premise and public cloud infrastructure. An ideal candidate will have experience with one or more of the following skill sets

Expert in Relational databases like Oracle, SQL server

Expert in Optimizing and tuning SQL/Oracle queries, stored procedures and triggers

Expert in Python (numpy, pandas, matplotlib etc) and Jupyter notebooks for exploratory data analysis, machine learning, and process automation

Expert in areas of CI/CD, Continuous testing, and site reliability engineering.

Expert in Microsoft Azure applications such as Azure Data Factory, Synapse, Purview, Databricks /Spark, Power BI, PowerApps.

Expert in event streaming tools like NiFi, Kafka and Flink

Expert in data processing tools, like Apache's Sqoop, Spark and Hive

Expert in Document or NoSQL datastores, particularly MongoDB

Expert in Power BI data models using advanced Power Query and DAX

Expert in in AI/ML Ops

Interest and desire to contribute to emerging practices around DataOps (CI/CD, IaC, configuration management, etc.)

Collaborate effectively with product management, program management, engineers, and stakeholders.

Excellent analytical and critical thinking skills

Ability to influence without authority and thrive in an ambiguous environment.