Senior Data Engineer (Regulatory and Compliance Reporting Engineer)
- Collaborate Solutions, Inc.
- Columbia, Tennessee
- Full Time
Senior Data Engineer (Regulatory and Compliance Reporting Engineer)
Columbia, TN
Job Summary:
We are seeking an experienced Data Engineer to design, develop, and maintain data pipelines that extract transactional insurance data from on-premises Guidewire and legacy systems and deliver to regulatory bodies for compliance. The role requires someone who can work with Guidewire s complex relational schemas and the external insurance ecosystem, ensuring accurate and timely data delivery to regulatory bodies, risk aggregators, and specialized reinsurers.
Key Responsibilities:
- Design and automate complex downstream extracts like Bordereaux for Hartford Steam Boiler (HSB), CLUE, Current carrier, Verisk and other Insurance services offices.
- Develop and maintain Third Party mandatory industry reports for Verisk , LexisNexis (C.L.U.E) and Current Carrier .
- Develop and maintain Premium/loss and claims datasets, ensuring they reconcile with General ledger (GL).
- Develop and maintain the logic to calculate Written , Earned , and Unearned Premium (UEP) at the transaction level, accounting for mid-term endorsements and cancellations.
- Develop Extracts to match XML/JSON transformation, SFTP automation, and API-based data delivery.
- Develop and maintain data pipelines, ETL/ELT processes, and data integration workflows using Azure Data Factory (ADF), Databricks, and Storage Accounts.
- Provide technical leadership, mentoring, and guidance to team members while contributing as an independent contributor.
- Work in Agile development environments, participating in sprint planning, stand-ups, and retrospectives.
- Ensure data quality, governance, and security standards are maintained across all platforms.
Required Qualifications:
- 10+ years of professional experience in data engineering, data warehouse development, or related roles.
- Knowledge of Datahub/Info Center is highly preferred
- Experienced in developing complex extracts from Guidewire Policy center and billing center to Support Outbound Extracts for industry partners, ensuring compliance with proprietary file formats and transmission protocols
- Insurance industry experience, specifically with policies, quotes, claims, or related domains.
- Strong understanding of P&C insurance lifecycles (submissions, renewals, FNOL, subrogation).
- Strong Hands-on experience with Azure Data Stack:
- ADF (pipelines, orchestration, data flows)
- Storage Accounts
- Key Vaults
- Hands-on experience with Snowflake (SnowSQL, Snowpark, Snow pipe, Streams & Tasks, Dynamic Tables, Cortex AI).
- Experience in Agile development environments.
- Ability to work independently while providing leadership to projects and teams.
- Willingness to relocate or travel as required.