System Architect

  • Galent
  • Dallas, Texas
  • Full Time
Contract Job Summary

We are seeking an experienced AI Systems Architect to design, build, and scale high-performance distributed AI systems. The ideal candidate will have deep expertise in GenAI, LLMs, and cloud-native architectures, along with hands-on experience in building enterprise-scale AI/ML platforms and agent-based systems.

Must-Have Skills
  • Strong experience in designing and implementing high-performance, large-scale distributed systems
  • Proven experience in implementing and deploying AI/ML platforms at scale
  • Expertise in building agent-based architectures, evaluation frameworks, and prompt/context engineering
  • Knowledge of MCP (Model Context Protocol) servers
  • Hands-on experience in LLM inference optimization, including batching and caching strategies
  • Strong experience with Kubernetes and cloud infrastructure (AWS/Azure/GCP)
  • Proficiency in at least one programming language (Python, Java, Go, etc.)
  • Hybrid search
  • Data freshness strategies
  • Memory systems
  • Graph reasoning
  • BM25 and advanced retrieval techniques
Key Responsibilities
  • Architect and deliver scalable, high-performance distributed systems
  • Design and deploy AI/ML and GenAI platforms at enterprise scale
  • Build and manage agent-based architectures, including:
  • Prompt and context engineering
  • MCP servers
  • Evaluation frameworks
  • Optimize LLM inference pipelines for latency, throughput, and efficiency
  • Design and implement agent data & retrieval systems (vector DBs, hybrid search, memory, graph-based reasoning)
  • Provide technical leadership, architecture governance, and hands-on mentoring to engineering teams
Nice to Have
  • Experience with RAG (Retrieval-Augmented Generation) frameworks
  • Familiarity with multi-agent systems and orchestration frameworks
  • Exposure to Real Time data pipelines and streaming architectures

We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation or gender identity), national origin, citizenship status, age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law.

Job ID: 523328538
Originally Posted on: 6/2/2026

Want to find more Technology opportunities?

Check out the 164,721 verified Technology jobs on iHireTechnology