Health Data Engineer
SVC HS Information Technology - Pennsylvania-Pittsburgh - (26002446)
A Health Data Engineer is sought for a growing data center which serves the schools of the health sciences. This person will manage the data lifecycle from ETL to data destruction in SQL Server on-prem or Cloud environments. On-prem work will be done in SQL Server with T-SQL and SSDT. When working in the cloud, this role uses tools such as Azure Synapse, Azure Data Factory, and Microsoft Fabric, along with Apache Spark.
The Data Engineer will receive data and load into SQL Server. The data will arrive in various formats including SAS, CSV, Parquet and fixed width. The format will change based on the data owner. All actions must be performed in our secure HIPAA compliant environment according to data center policies and procedures and thoroughly documented. The data engineer will monitor the SQL Server execution plans and make modifications to improve performance.
The incumbent will work with Principal Investigators and their teams to create analytic datasets in SQL server. This will require gathering specifications and listening to requirements from various teams. The position must be responsive to different requirements from different groups. In some cases, you will serve as an Honest Broker. Must be able to consider various options for data collection and recommend solution that works for customer. The candidate must be able to evaluate different performance metrics and recommend ETL solutions. Must be able to work as part of a team with strong communication skills.
Required skills include strong SQL Server skills with the ability to write advanced queries and excellent organizational, documentation and communication skills with proficiency in Microsoft Office. Experience with cloud services such as Azure Synapse, Azure Data Factory, and Microsoft Fabric, along with an understanding of Spark, is desired. Experience with tools such as with Python, C#, Powershell, Power BI, SAS, Stata, and Web technologies are needed. Experience with health datasets is ideal but not required. Familiarity with Execution Plans and optimization is a plus.
Required Qualifications:
- Bachelor's Degree in an IT related field
- Minimum Years of Experience Required - 3
- Experience with data ingestion/transformation Tools
- Strong SQL Server skills with the ability to write advanced SQL queries, views, and stored procedures
- At least 3 years of experience with SQL server
Preferred Qualifications:
- Experience with a combination of some tools such as with Python, C#, Powershell, Power BI, SAS, Stata, and Web technologies are needed.
- Experience with cloud services such as Azure Synapse, Azure Data Factory, and Microsoft Fabric, along with an understanding of Spark, is desired.
- Experience with health datasets is ideal but not required. Familiarity with Execution Plans and optimization is a plus.
Job Summary
Evaluates standard business requirements, creates data ingestion processes and modeling, and supports databases and relevant services. Ensures data quality and delivery. Supports data analysts and scientists with research and consulting.
Essential Functions
- Data ingestion/transformation
- Write SQL queries, views, and stored procedures
- Work independently on multiple projects
- Work with groups to understand and document project requirements
- Document processes
Physical Effort
Light, Little physical effort. Duties are primarily Sedentary. May be required to move objects up to 25 pounds occasionally.
Assignment Category: Full-time regular
Job Classification: Staff.Data Engineer I
Job Family: Information Technology
Job Sub Family: Database
Campus: Pittsburgh
Minimum Education Level Required: Bachelor's Degree
Minimum Years of Experience Required: 1
Will this position accept substitution in lieu of education or experience: Combination of education and relevant experience will be considered in lieu of education and/ or experience requirement.
Additional details about Required Licensure/Certification: Bachelor's Degree in an IT related field
Work Schedule: In-office two days a week and on campus for in-person meetings as required
Work Arrangement: Hybrid: Combination of On-Campus and Remote work as determined by the department.
Hiring Range: TBD Based Upon Qualifications
Relocation_Offered: No
Visa Sponsorship Provided: No
Background Check: For position finalists, employment with the University will require successful completion of a background check
Child Protection Clearances: Not Applicable
Required Documents: Resume
Optional Documents: Not Applicable
PI284061195