Senior Data Engineer

Rosemont, IL

You are eager to design, build, and optimize enterprise-grade data solutions, in a hands-on environment. You get excited about building modern, scalable, cloud-powered data platforms that drive real organizational impact. You're enthusiastic about solving complex data challenges and working with cutting-edge Microsoft technologies and want to join a high‑performing team that’s transforming how data empowers decision-making.

If this sounds like you, please read on!

Build Next‑Generation Data Platforms

  • Design, build, and maintain scalable enterprise data environments using Microsoft Fabric components including Lakehouse, Warehouse, OneLake, and Dataflows Gen2.

Engineering & Data Processing

  • Develop, optimize, and troubleshoot high-performance Spark workloads using PySpark and SparkSQL to process large-scale structured and semi-structured datasets.

ETL/ELT Architecture

  • Architect and implement enterprise-grade ETL/ELT solutions using Azure Data Factory (ADF), Microsoft Fabric Data Pipelines, Dataflows Gen2, and SSIS (including Azure‑SSIS IR and on‑prem migration scenarios).

Data Modeling & Storage

  • Implement modern data modeling frameworks such as Medallion Architecture (Bronze/Silver/Gold) and dimensional modeling (Star/Snowflake) with expertise in file types including Parquet, JSON, and XML.

Governance & Lineage

  • Integrate Microsoft Purview for enterprise cataloging, classification, and automated lineage across ADF, Fabric, SQL, and ADLS.

Data Security & Compliance

  • Enforce robust data security practices including RBAC, column-level security, dynamic data masking, and alignment with enterprise governance policies.

Travel

  • Up to 5 days per year

Qualifications:

Required

  • Hands-on experience with Microsoft Fabric (Lakehouse, Warehouse, OneLake, Dataflows Gen2, Data Pipelines) and Azure Data Services (ADF, ADLS, Azure SQL, Synapse).
  • Strong proficiency in PySpark and SparkSQL for building optimized, large-scale transformation pipelines.
  • Proven experience developing enterprise ETL/ELT solutions using ADF, Fabric Data Pipelines, and SSIS (including Azure‑SSIS IR and migration from on‑prem).
  • Expertise in Medallion architecture, dimensional modeling, and working with Parquet, JSON, XML.

Desired:

  • Experience working with healthcare, registry, clinical, or highly regulated data, with strong knowledge of privacy and compliance.
  • Background implementing CI/CD pipelines (Azure DevOps/GitHub), IaC (Bicep, ARM, Terraform), and automated deployment of data or governance assets.
  • Experience supporting MLOps pipelines or enabling AI/Advanced Analytics workloads in Azure/Fabric ecosystems.
  • Demonstrated ability in Fabric capacity optimization, Spark performance tuning, and cloud cost management.

Salary Range: $112,000-$120,000, depending on qualifications and experience.

Bring your expertise, creativity, and ambition, and help us build the future of data. If you’re driven by innovation, energized by solving complex data challenges, and excited to work with the very best of Microsoft’s cloud ecosystem, apply today!

Please share the following:

  • Clearly communicate why you are the ideal candidate for this role, providing specific examples and experiences as proof points.
  • Resumes must be accompanied by a cover letter with salary expectations to be considered.

Please note: This position is based in Rosemont, Illinois and is open to applicants who are able to commute at least twice per week to this office. Applicants must already be authorized to work in the United States on a full-time basis. We are unable to sponsor or take over sponsorship of work visas.

JOB CODE: 1000154