Data Platform Engineer/Architect

Data Platform Engineer/Architect

Profile 1: Data Platform

Core Responsibilities

Establish data flow patterns across batch, streaming, and ML use cases

Create decision frameworks for Google Cloud Platform technology selection

Develop reference architectures for real-time analytics and ML model deployment

Implement automated architecture validation in CI/CD pipelines

Design GitOps workflows for infrastructure and application deployments

Create standardized deployment patterns for different workload types

Develop IAM role assignments based on workload type

Create internal knowledge bases and documentation repositories

Lead training programs for data engineers and analysts

Technical Skills

Google Cloud Platform Services

: Expert in BigQuery, Dataproc, Dataflow, Data Fusion, Pub/Sub, Cloud Storage, Cloud Run

Infrastructure as Code

: Advanced Terraform skills with module development

Containers & Orchestration

: Deep experience with Docker, Kubernetes, and GKE

CI/CD

: Proficient with Cloud Build and GitLab CI/CD pipelines

Data Security

: Strong understanding of data governance, security, and compliance

Data Processing

: Expert in data pipeline design using Apache Spark, Apache Beam

Machine Learning Ops

: Working knowledge of Vertex AI, AI Platform, TensorFlow/PyTorch deployment

Streaming

: Experience with Kafka and Pub/Sub architectures

API Design

: RESTful API design with authentication and authorization patterns

Workflow Management

: Experience with Astronomer/Airflow for orchestration

Data Transformation

: DBT implementation experience

GitOps

: Proficient with GitOps principles and tools (ArgoCD, Flux)

Soft Skills

Strategic thinking and architectural vision

Advanced communication and stakeholder management

Ability to balance technical excellence with business needs

Strong mentorship and knowledge sharing capabilities

Collaborative approach to architectural decisions

Certifications

Google Cloud Professional Cloud Architect (Required)

Google Cloud Professional Data Engineer (Required)

Google Cloud Professional Security Engineer (Recommended)

Kubernetes CKA/CKAD (Recommended)

Terraform Associate (Recommended)

Employers have access to artificial intelligence language tools (AI) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Report this job

Dice Id:

90944144

Position Id:

8661194