Description

Our Personal Lines Operations team is currently seeking a Data Engineer II in our Worcester office. This is a full-time, exempt role. Fully remote arrangement will be considered for candidates with strong qualifications.

POSITION OVERVIEW:

The Hanover Insurance Group is hiring a Personal Lines Operations Data Engineer to own the day-to-day reliability and enhancement of our Azure Data Factory (ADF) pipelines and on-prem SQL Server data environment. This role builds and improves ETL workflows that populate SQL tables used by analysts to create Power BI semantic models and reports. The position is split approximately 50/50 between production operations/support and new development/enhancement, while also advancing platform maturity through improved monitoring/alerting, data quality validation, and formalized release practices.

What You'll Own:

• Production support and daily health of scheduled ADF pipelines.
• Build new pipelines and enhance existing pipelines to improve resiliency, maintainability, and scalability.
• Implement data validation controls, improve monitoring/alerts, and help define SLAs for data freshness and availability.
• Establish foundational SDLC practices for data engineering (Git usage, Dev → Prod promotion practices, and a more formal release process).
• Coordinate cross-team dependencies where upstream internal ETL timelines affect downstream pipeline completion; design dependency-aware orchestration and readiness checks.
• Contribute to future-state Azure data strategy recommendations (e.g., Data Lake/Blob Storage, notebooks) and support long-term migration planning from on-prem SQL Server to cloud databases (timeline not yet defined).

KEY RESPONSIBILITIES:

• Azure/Fabric Data Factory Engineering
  • Design and maintain curated SQL tables/views used for analytics and reporting; optimize for refresh performance and downstream usability.
  • Develop and maintain ADF pipelines (Copy activities and Data Flows) with consistent patterns for logging, error handling, retries, and notifications.
  • Implement parameterization and reusable components to reduce duplication and speed enhancements.
  • Implement incremental load and backfill strategies appropriate to volume.
• Production Support & Reliability
  • Monitor daily pipeline execution and triage incidents quickly to restore successful processing.
  • Perform root-cause analysis for failures and recurring issues; implement preventative controls and standardized patterns.
  • Create and maintain operational documentation/runbooks for critical pipelines and common support scenarios.
• Data Quality, Validation & Trust
  • Build automated validation routines and reconciliation checks (row counts, totals, null/duplicate thresholds, schema drift detection, anomaly flags).
  • Partner with analysts and stakeholders to define key business rules and quality thresholds for trusted reporting datasets.
  • Document data definitions, transformations, and lineage to improve transparency and troubleshooting.
• Stakeholder Collaboration & Dependency Management
  • Work directly with internal Operations Data Analysts, business stakeholders and external partner analysts to gather requirements and deliver datasets that enable robust Power BI semantic models, reporting and other analytical solutions.
  • Coordinate with upstream internal teams to align dependency readiness signals and timelines; implement orchestration controls to prevent downstream failures.
  • Provide technical coaching and mentoring to less experienced team members; including the usage of best practices.

KEY MEASURES OF SUCCESS:

• Pipelines meeting SLA / on-time delivery
• Pipeline success rate and reduced manual intervention
• Time-to-detect/time-to-resolve ETL failures (MTTD/MTTR)
• Improvements in query/runtime performance and cost efficiency
• Reduction in recurring data quality defects; completeness/accuracy checks passing
• Documentation coverage (runbooks for critical pipelines, data dictionary completeness)

Required Qualifications

• Bachelor's Degree preferred in a related field.
• 6+ years of experience in data engineering, ETL/ELT, or related roles.
• Hands-on experience building and supporting production pipelines in Azure Data Factory.
• Strong SQL/T-SQL skills and experience with SQL Server environments supporting analytics/reporting workloads.
• Advanced data modeling
• Experience integrating data from multiple sources including databases, flat files/SFTP, and APIs/vendor feeds.
• Familiarity with Azure data platform components (Data Lake/Blob Storage, notebooks) and/or cloud migration planning, or similar platforms.
• Strong troubleshooting, root-cause analysis, and operational ownership mindset.
• Ability to work directly with stakeholders to gather requirements and translate them into technical solutions.
• Strong communication and documentation skills: Data engineers are often called to present their findings or translate the data into an understandable document. You will need to write and speak clearly, easily communicating complex ideas.

Preferred Qualifications

• Experience establishing SDLC practices for data teams (Git, CI/CD, release management).
• Experience implementing monitoring/alerting and operational dashboards for data pipelines.
• Python and/or PowerShell for automation, data validation, and operational tooling.
• Insurance or operations/customer service experience
• Familiarity with prompt-based programming and tools (GitHub CoPilot)

This job posting provides cursory examples of some of the job duties associated with this position. The examples provided are not complete, and the position may entail other essential and job-related functions and responsibilities that employees will be required to perform.

CAREER DEVELOPMENT:

It's not just a job, it's a career, and we are here to support you every step of the way. We want you to be successful and fulfilled. Through on-the-job experiences, personalized coaching and our robust learning and development programs, we encourage you - at every level - to grow and develop.

BENEFITS:

We offer comprehensive benefits to help you be healthy, build financial security, and balance work and home life. At The Hanover, you'll enjoy what you do and have the support you need to succeed.

Benefits include:

• Medical, dental, vision, life, and disability insurance
• 401K with a company match
• Tuition reimbursement
• PTO
• Company paid holidays
• Flexible work arrangements
• Cultural Awareness Day in support of IDE
• On-site medical/wellness center (Worcester only)
• Click here for the full list of Benefits

EEO statement:

The Hanover values diversity in the workplace and among our customers. The company provides equal opportunity for employment and promotion to all qualified employees and applicants on the basis of experience, training, education, and ability to do the available work without regard to race, religion, color, age, sex/gender, sexual orientation, national origin, gender identity, disability, marital status, veteran status, genetic information, ancestry or any other status protected by law.

Furthermore, The Hanover Insurance Group is committed to providing an equal opportunity workplace that is free of discrimination and harassment based on national origin, race, color, religion, gender, ancestry, age, sexual orientation, gender identity, disability, marital status, veteran status, genetic information or any other status protected by law."

As an equal opportunity employer, Hanover does not discriminate against qualified individuals with disabilities. Individuals with disabilities who wish to request a reasonable accommodation to participate in the job application or interview process, or to perform essential job functions, should contact us at: HRServices@hanover.com and include the link of the job posting in which you are interested.

Privacy Policy:

To view our privacy policy and online privacy statement, click here .

Applicants who are California residents: To see the types of information we may collect from applicants and employees and how we use it, please click here .

Compensation:

The target hiring range for this role may vary based on geographic location and other factors, including merit or performance, demonstrated proficiency, skills for the role, education, travel requirements, and experience. Additional compensation may include an annual bonus (which could take the form of a general bonus, sales incentive, or short-term incentive), long-term incentive or spot recognition awards. The posted range reflects our ability to hire at different position titles and levels depending on background and experience.
Requisition #: 45242

6ahf9io63