Principal AI Infrastructure Architect (All Genders)
Remote • Kronberg, Campus Kronberg 1
Posted 14h ago
Job Location
Kronberg, Campus Kronberg 1
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
As a Principal AI Infrastructure Architect, you will be the firm's most senior technical authority on compute infrastructure for large-scale AI and machine learning systems. You will bring extensive experience as a lead and senior architect, with command over a broad landscape of technological options and the latest innovations. You have a proven track record of successfully designing and deploying large-scale infrastructure on which significant AI/ML solutions operate in production and demonstrably deliver business value. You will weigh and rationalize multiple viable architectures across compute, networking, storage, orchestration, and model serving, making authoritative decisions tailored to each client's situation, standards, and strategic objectives, and you will set the technical direction that senior and lead architects build upon. You will serve as a recognized expert across at least one hyperscaler cloud and be conversant across several, bringing deep, current knowledge of AI/ML services, accelerators, interconnects, and cost levers, while continuously scanning the horizon for promising emerging technologies. You will shape strategy and roadmaps, establish standards and reference architectures, mentor and elevate the architect community, and ensure the firm delivers AI/ML infrastructure that meets business SLAs, controls cost, scales to frontier workloads, and creates lasting business value.
Responsibilities
- Set the overarching technical vision and strategy for compute infrastructure supporting large-scale AI/ML systems.
- Own complex architecture decisions across compute, networking, storage, orchestration, and model serving.
- Architect and prototype large-scale, cost-optimized compute and distributed training systems.
- Define reference architectures, standards, and architectural patterns, and implement foundational tooling and automation.
- Lead enterprise-scale architecture assessments and design reviews.
- Shape and steward the AI infrastructure roadmap and technology strategy.
- Identify, evaluate, and pilot promising emerging technologies and innovations.
- Drive hands-on performance and cost optimization of the computational stack.
- Serve as the principal authority across hyperscaler cloud platforms for AI/ML services, accelerators, and interconnects.
- Lead deep troubleshooting and root-cause analysis of complex issues across the stack.
- Cultivate and lead relationships with infrastructure partners.
- Provide executive- and client-level technical advisory.
- Define monitoring, observability, and reliability strategy across InfraOps and MLOps.
- Ensure enterprise integration, security, compliance, and regulatory alignment of AI/ML infrastructure.
- Mentor and grow the architect community.
- Champion cost-efficiency and value realization for AI/ML infrastructure.
Requirements
- Bachelor's Degree in Computer Science, Computer Engineering, or related Engineering field.
- Considerable experience coding, building, monitoring, and troubleshooting AI/ML model applications.
- Experience selecting, designing, and deploying infrastructure for AI/ML models on-premise or on public cloud.
- Strong understanding of AI and machine learning.
- Strong understanding of computing infrastructure, with preferred knowledge of AI infrastructure.
- Strong proficiency in programming languages such as Python, Java, or C++.
- Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow).
- Strong problem-solving skills and ability to work in a fast-paced environment.