Data Engineer

Job Description

Insight Global is seeking a Data Engineer to support a Joint Staff J7 program in Suffolk, VA. This team supports military training efforts by enabling data-driven solutions that help prepare forces to respond to global operations and crisis scenarios.

Responsibilities include but are not limited to:

Designing, developing, testing, and operating ETL/ELT data pipelines using tools such as Apache Spark

Ensuring data pipelines are reliable, performant, and cost-effective

Defining and enforcing data quality checks to maintain accuracy and integrity of data

Diagnosing and resolving issues across data ingestion, transformation, and query processes

Documenting workflows, processes, and data definitions to support knowledge sharing across teams

Maintaining up-to-date documentation in Confluence, including data dictionaries

Participating in data cataloging efforts and ensuring adherence to security and compliance requirements

Collaborating with functional business units to understand requirements, develop solutions, and present findings to support decision-making

Compensation:

$45/hr to $50/hr.

Exact compensation may vary based on several factors, including skills, experience, and education.

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to ... learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

• 2+ years of experience with a Bachelors degree in a related field, OR 0 years with a Masters, OR 6+ years of relevant experience with a High School diploma/equivalent

• Experience developing and working with data pipelines, including ETL/ELT processes

• Hands-on experience with tools such as Apache Spark, Airflow, and Python for data processing and analytics

• Familiarity with data visualization and analytics tools such as Superset, Qlik, or similar platforms

• Experience with version control and CI/CD pipelines (Git workflows)

• Working knowledge of agile tools such as JIRA or similar platforms

• Strong written and verbal communication skills

• Ability to work both independently and within a team environment

• Strong organizational skills with a high attention to detail

• Self-motivated with the ability to operate with minimal direction Experience configuring and using Apache Superset for connecting to data sources and building dashboards

Familiarity with Talend and Qlik data/analytics tools

Experience working with Apache Spark and Airflow in a development environment

Knowledge of Git workflows and CI/CD pipelines

Experience developing data analytics and processing pipeline applications using Python

Working knowledge of JIRA or similar Agile tools