Senior Data Engineer Platform Foundation

The Senior Data Engineer - Platform Foundation is a hands-on, senior-level contributor embedded in the Foundations squad. You will design, build, and evolve the shared ingestion platform that underpins data delivery across the company. The platform is the product - your job is to make it reliable, extensible, and easy for other teams to adopt.The Foundations squad operates across three pillars: simplifying the overall data platform landscape by reducing complexity and consolidating redundant patterns; enabling structured and unstructured data ingestion at scale; and supporting the exposure of data products to consumers across the organization. You contribute to all three - making architectural decisions, writing production code, and enabling other teams through documentation and hands-on support.Key Responsibilities:Platform Foundation DevelopmentDesign and implement reusable ingestion components using dlt and dbt-core, covering both structured and unstructured data sources, handling high-volume, append-heavy, and schema-drifting patternsOwn the Airflow platform end-to-end: extend and maintain DAGs and shared operators, handle deployments and version upgrades, and provide hands-on support to consuming teamsEnsure incremental loading strategies, data quality checks, and lineage metadata are first-class outputs of every pipelinePlatform Simplification & ArchitectureIdentify and eliminate redundant ingestion patterns across consuming teams, drive standardization onto shared Platform Foundation componentsCollaborate with Solution Architects to evolve the platform architecture in response to new data sources and shifting business requirementsSupport data product exposure: define and implement governed interfaces that make data reliably accessible to internal consumersContribute to Terraform-managed infrastructure; participate in multi-cloud (AWS / Azure) deployment patternsAI Tooling & Developer ProductivityActively use and evaluate AI-assisted development tools (GitHub Copilot, Claude Code, etc.) to accelerate platform Foundation deliveryChampion AI tooling adoption within the squad; share best practices and guardrails around AI-generated code reviewExplore AI-powered capabilities (RAG pipelines, LLM-assisted data cataloguing) for internal platform documentation and self-service enablementDevOps & ReliabilityMaintain and improve CI/CD pipelines (TeamCity, GitHub Actions) for platform Foundation componentsDefine and enforce observability standards: DAG/Task-level alerting, SLA trackingParticipate in on-call rotation for critical ingestion pipelines; drive post-incident improvementsTeam Enablement & Stakeholder ManagementProduce platform Foundation documentation, runbooks, and enablement materials for consuming squadsTranslate ambiguous or moving business requirements into concrete technical designs - comfortable challenging scope when neededMentor mid-level engineers; participate in hiring and technical assessments Basic Qualifications:Bachelor's degree in Business, Information Systems, Data/Analytics, Computer Science, or related fieldMinimum 5 years in data engineering roles, with at least 2 years in a senior / platform-level positionProven track record building production ingestion and transformation pipelines at scaleExperience contributing to a shared platform or internal developer tooling consumed by multiple teamsCore Technical Skills:Python: idiomatic, testable, production-grade code - not just scriptingdbt-core: advanced modelling (custom materializations), testing, documentation, packagesApache Airflow: DAG design patterns, custom operators, dynamic task mapping, SLA managementCloud data platforms: comfortable with one or more major cloud warehouses (Snowflake, BigQuery, Databricks, Microsoft Fabric)SQL: complex analytical queries, window functions, query profilingGit, CI/CD: trunk-based development, automated testing gates, pipeline-as-codeAI & Modern Tooling:Daily user of AI coding assistants (Copilot, Claude Code or equivalent)Understands the limits of AI-generated code - applies rigorous review, not blind trustInterest in LLM-powered data tooling (RAG pipelines, Cortex, semantic layers) is a plusBehavioral:Navigates ambiguity: comfortable when requirements shift mid-sprint; drives clarification rather than waiting. Comfortable working with global teamsPlatform mindset: builds for reuse, not one-off solutionsDirect communicator: raises blockers early, documents decisions, challenges assumptions constructivelyLearner: actively tracks technology evolutionThe Senior Data Engineer - Platform Foundation is a hands-on, senior-level contributor embedded in the Foundations squad. You will design, build, and evolve the shared ingestion platform that underpins data delivery across the company. The platform is the product - your job is to make it reliable, extensible, and easy for other teams to adopt.The Foundations squad operates across three pillars: simplifying the overall data platform landscape by reducing complexity and consolidating redundant patterns; enabling structured and unstructured data ingestion at scale; and supporting the exposure of data products to consumers across the organization. You contribute to all three - making architectural decisions, writing production code, and enabling other teams through documentation and hands-on support.Key Responsibilities:Platform Foundation DevelopmentDesign and implement reusable ingestion components using dlt and dbt-core, covering both structured and unstructured data sources, handling high-volume, append-heavy, and schema-drifting patternsOwn the Airflow platform end-to-end: extend and maintain DAGs and shared operators, handle deployments and version upgrades, and provide hands-on support to consuming teamsEnsure... For full info follow application link. Equal Opportunity Employer Minorities/Women/Protected Veterans/Disabled.