Senior Data Engineer Azure Databricks - Chicago (Hybrid) (Chicago) Job at Evolution USA, Chicago, IL

dEkrQ1FYem1VR3VEejRtSmNobE1KcENNK2c9PQ==
  • Evolution USA
  • Chicago, IL

Job Description

This range is provided by Evolution USA. Your actual pay will be based on your skills and experience talk with your recruiter to learn more.

Base pay range

$140,000.00/yr - $160,000.00/yr

Additional compensation types

Annual Bonus

Direct message the job poster from Evolution USA

Hiring elite Python talent across Engineering, Data, AI & ML for New England tech companies l Founder l Vice President, USA | Tech Podcast Host I 20+

Were hiring a Senior Data Engineer to design and deliver enterprise-grade data solutions using the latest in lakehouse and cloud technology. This is a senior-level, hands-on role offering autonomy, collaboration, and the opportunity to help lead the development of a high-performing data ecosystem.

Working with modern tools like Azure Databricks , Spark , and Delta Lake , youll play a critical role in building scalable data infrastructure that powers advanced analytics, BI, and data science across the organization.

What You'll Do:

As a Senior Data Engineer, youll be a key contributor to the architecture, development, and optimization of our data infrastructure. Your day-to-day will include:

  • Architect & Design robust, scalable data solutions on the Databricks Lakehouse Platform in Azure.
  • Develop & Maintain production-grade ELT/ETL pipelines using Spark (PySpark or Scala), SQL, notebooks, and Delta Live Tables (DLT).
  • Optimize performance and cost-efficiency through Delta Lake tuning, partitioning, and compute usage improvements.
  • Model data using medallion architecture , star-schema, and other frameworks tailored for analytics and reporting.
  • Collaborate with cross-functional teamsincluding data scientists, analysts, and engineersto deliver high-quality data products.
  • Mentor & Guide junior and mid-level engineers, fostering a culture of quality and technical excellence.
  • Standardize & Govern data engineering practices by establishing and maintaining technical documentation and best practices.
  • Stay Current with emerging technologies and trends in cloud data architecture.

Your background:

  • 5+ years of hands-on experience building modern data solutions at scale.
  • Deep expertise in Spark (PySpark or Scala), SQL , and data processing in Databricks .
  • Strong track record of delivering Lakehouse solutions using the medallion architecture in Azure.
  • Demonstrated success building metadata-driven ELT/ETL pipelines .
  • Experience with Azure Data Factory for data orchestration.
  • Familiarity with Lambda architectures (batch + streaming).
  • Background in agile development (Scrum, Kanban) and working within CI/CD frameworks.
  • Bachelors degree in Computer Science, Engineering, or a related field, or equivalent hands-on experience.
  • Excellent communicator with strong documentation habits and a collaborative mindset.

Bonus Points For:

  • Experience in the insurance or finance domain.
  • BI and data analysis experience; ability to support end-to-end data platform development.
  • Familiarity with offshore coordination or hybrid team structures.

Why Join Our Client?

Youll be part of a team thats driving innovation through data. We offer:

  • A hybrid work model (1-2 days p/wk in Downtown Chicago office) that blends flexibility with meaningful in-person collaboration
  • Access to a modern, cloud-first tech stack
  • A culture centered around trust, collaboration, community, mentorship, and ownership
  • The chance to lead initiatives and make a lasting impact

Ready to build the next generation of data platforms with a team that values quality, autonomy, and continuous learning? Wed love to hear from you.

Seniority level

  • Seniority level

    Mid-Senior level

Employment type

  • Employment type

    Full-time

Job function

  • Job function

    Information Technology
  • Industries

    Insurance, Insurance Agencies and Brokerages, and Data Infrastructure and Analytics

Referrals increase your chances of interviewing at Evolution USA by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Pension plan

Paid maternity leave

Paid paternity leave

Get notified about new Data Engineer jobs in Chicago, IL .

Chicago, IL $84,950.00-$124,800.00 3 days ago

Deerfield, IL $98,600.00-$157,500.00 1 month ago

Deerfield, IL $98,600.00-$157,500.00 1 month ago

Deerfield, IL $98,600.00-$157,500.00 1 month ago

Chicago, IL $100,000.00-$120,000.00 3 days ago

Chicago, IL $150,000.00-$220,000.00 1 week ago

Chicago, IL $95,600.00-$162,400.00 4 days ago

Chicago, IL $99,600.00-$139,440.00 2 weeks ago

Chicago, IL $90,000.00-$120,000.00 2 weeks ago

Glencoe, IL $75,000.00-$90,000.00 3 days ago

Chicago, IL $90,000.00-$140,000.00 3 days ago

Chicago, IL $120,000.00-$140,000.00 4 days ago

Rosemont, IL $165,000.00-$175,000.00 3 weeks ago

Chicago, IL $120,000.00-$150,000.00 3 days ago

Chicago, IL $75,000.00-$93,000.00 4 days ago

Glenview, IL $80,000.00-$120,000.00 1 week ago

Chicago, IL $150,000.00-$210,000.00 4 days ago

Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Job Tags

Full time, Work at office,

Similar Jobs

Ashley Distribution Services, LTD

CDL-A Local Dedicated Truck Driver Job at Ashley Distribution Services, LTD

 ...Job Description Job Description CDL-A Dedicated, Home Daily Truck Driver Jobs Offer Steady Miles, Pay, and Dedicated Routes Why are so many CDL-A truck drivers making Ashley their long-term career home? Because as one of the largest family-owned private fleets... 

Westaff

Forklift Operators/ Warehouse Associate Job at Westaff

 ...Job Description Job Description Salary: Westaff is Seeking Multiple Warehouse Associates and Forklift Operators for Manufacturers and Warehouses near the Meriden, CT Area! Entry Level - Mid Level Openings. Hours Vary: 1st, 2nd, and 3rd shifts available... 

Glass Law Group Inc

Bilingual Law Office Receptionist/Clerk Job at Glass Law Group Inc

 ...Health insurance ~ Paid time off The law firm, Glass Law Group Inc., specializes...  ...or call Monica at (***) ***-****. The Receptionist is responsible for answering all inbound...  ...other interesting tasks. Receptionist/Office Services clerk responsibilities include... 

Ferguson Construction Company

Sheet Metal: Roofing and Siding Job at Ferguson Construction Company

 ...Job Description Job Description Job description We are looking for skilled Sheet Metal workers to join our team. In this position, you would be performing standing seam roofing, metal siding, curbs, flashings and trims installation. We are looking for team-oriented... 

Heritage Bank

Bank Teller Job at Heritage Bank

 ...20.59 - $22.88 per hour Level II - $20.00 - $21.62 - $24.84 per hour Depending on experience a Customer Service Associate (Bank Teller) I, or Customer Service Associate (Bank Teller) II, may be considered. As part of our team youll enjoy a total rewards package...