Data Engineer

Title:

Data Engineer

Department:

Application Development

Location:

Overland Park, KS

Job Description:

The Data Engineer has an essential role in shaping the firm's data ecosystem. This means

understanding all aspects of the data we collect, where it's stored, how it's used, and the

calculations applied in reporting. You will also support the ongoing development of our data

lake and data applications. With a focus on building scalable, robust, and efficient data

systems, your work will be instrumental in helping drive business intelligence, analytics, and

operational excellence.

We do not accept resume submissions from third-party recruiters or staffing agencies.

Please contact our recruiting team directly.

Responsibilities

Support the ongoing development of our Azure Databricks Lakehouse including data ingestion and storage.

Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources, including databases, APIs, and data files.

Manage data pipelines for both analytics and operational use, ensuring that data is reliably available for critical applications.

Ensure data accuracy and integrity across multiple sources and systems, proactively resolving discrepancies and improving data quality.

Develop structured, semi-structured, and unstructured data storage models.

Coordinate with responsible teams to implement security, application monitoring, and other capabilities, ensuring consistency and compliance across all data systems.

Author and maintain clear, concise, and up-to-date documentation for processes, procedures, and technical designs.

Improve data systems, identify opportunities for optimization, and ensure that solu- tions scale efficiently as business needs change.

Qualifications

Bachelor's degree in computer science or computer engineering.

Experience working with relational databases and applying them in various applica-

tions, including on the Microsoft Azure platform.

Experience developing and deploying solutions on the Azure cloud using .NET, Azure Storage, Data Factory, DevOps, and Pipelines.

Proficient with Databricks and familiar with data transformation processes for large- scale data environments.

Knowledge of database technologies including Microsoft SQL Server and NoSQL da- tabases.

Scripting proficiency in PowerShell or Python.

Strong attention to detail.

Ability to work with broad and evolving requirements.

Ability to work in a fast-paced environment.

Ability to work independently and collaboratively in a team environment.

Commitment to teamwork and excellence.

Motivated and results oriented.

Available to work outside of normal business hours when required.