New: upload your resume and get matched to AI jobs. Free to start →

AI Large Language Model (LLM) Technology Architect

Oslo • Full-time

Posted 9d ago

About the job

As a hands-on AI/LLM Architect, you will be instrumental in designing and constructing advanced AI systems for enterprise clients. This role involves a significant amount of technical work, focusing on the architecture and engineering of real-world AI solutions that span classical machine learning, generative AI, and agentic systems. You will translate client requirements into architectural decisions, select design patterns, evaluate technical frameworks, and build reusable components. A key aspect of this role is designing and building AI agent architectures, including multi-agent orchestration, tool use, and memory systems, while also working with foundation models through fine-tuning and retrieval-augmented generation (RAG). You will engineer the AI context layer to connect enterprise knowledge bases and data sources, ensuring AI outputs are grounded and accurate. Additionally, you will design and validate systems against enterprise non-functional requirements such as security, observability, governance, performance, and scalability, producing tangible engineering and architecture deliverables like software components, architecture decision records, and diagrams.

Responsibilities

  • Independently design, build, and deliver software components across the AI architecture, owning them end-to-end.
  • Design and build AI agent architectures, including individual agents, their prompts, tools, skills, multi-agent orchestration, and memory systems.
  • Design and implement agent orchestration patterns for task handoffs, communication, state management, and error recovery.
  • Evaluate design options and technical approaches, balancing capability, cost, performance, and reliability.
  • Design, build, and run evaluation strategies and harnesses to measure agent and system quality.
  • Architect and implement foundation model integrations, selecting appropriate models and customization approaches (fine-tuning, RAG, custom integration).
  • Design and build model adaptation and fine-tuning pipelines, applying knowledge of transformer-based architectures.
  • Design and build the AI context layer, including context graph design and ingestion pipelines, and retrieval components.
  • Build embedding, vector storage, and retrieval into end-to-end RAG pipelines, connecting to enterprise data sources.
  • Design and implement context assembly and memory components for grounded, accurate outputs.
  • Identify, design, and build reusable components and solution patterns.
  • Design for cost efficiency and performance, optimizing model usage, inference patterns, caching, and resource utilization.
  • Design, build, and validate systems against enterprise non-functional requirements, implementing guardrails and defenses.
  • Build governance controls including versioning, audit logging, and lineage tracking.
  • Build observability into systems, including logging, tracing, monitoring, and alerting.
  • Produce detailed architecture artifacts such as architecture decision records, blueprints, and diagrams.
  • Continuously learn, evaluate, and apply new design patterns, frameworks, and technologies.
  • Collaborate with cross-functional delivery teams to translate requirements into concrete architecture decisions.

Requirements

  • Hands-on AI/LLM Architect experience.
  • Experience in designing and building advanced AI systems.
  • Proficiency in classical machine learning, generative AI, and agentic systems.
  • Ability to translate requirements into concrete architecture decisions.
  • Experience with AI agent architectures, multi-agent orchestration, tool use, and memory systems.
  • Hands-on experience with foundation models through fine-tuning and RAG.
  • Experience engineering AI context layers, connecting enterprise knowledge bases and data sources.
  • Ability to design and validate systems against enterprise non-functional requirements (security, observability, governance, performance, scalability).
  • Experience producing engineering and architecture deliverables (software components, ADRs, diagrams).
  • Experience working with cross-functional delivery teams (data engineers, ML engineers, application developers).
  • Working knowledge of transformer-based architectures.
  • Experience with embedding, vector storage, and retrieval (semantic, hybrid, reranking).
  • Experience with prompt injection defenses, PII handling, and Responsible AI.
  • Experience with versioning, audit logging, and lineage tracking.
  • Experience with logging, tracing, monitoring, and alerting for AI systems.
  • Bachelor's degree (implied by 'Ba').