Catalogue
/
Artificial Intelligence and Applied AI
/
Ollama for Local and Private AI Model Deployment

Ollama for Local and Private AI Model Deployment

A practical two day technical course for participants who are new to Ollama and want to deploy and integrate open-weight AI models in local and private environments. The agenda progresses from installation, model selection, and model management through configuration, APIs, application integration, tool calling, and operational considerations. The course focuses on building a practical foundation for using Ollama as a local AI runtime within development, automation, and enterprise application workflows.

What will you learn?

You will learn how to install and operate Ollama, select and manage models, configure model behavior, and expose local models through APIs. You will work with Modelfiles, REST APIs, OpenAI-compatible interfaces, Python and JavaScript integrations, and tool-enabled applications. You will also understand hardware requirements, model sizing, context configuration, security, and deployment considerations for reliable private AI environments.

  • Deploy and manage open-weight AI models locally with Ollama
  • Configure models, parameters, context, and reusable custom model definitions
  • Integrate Ollama through REST APIs, compatible interfaces, and application libraries
  • Design secure and maintainable local AI deployments for development and enterprise use

Requirements:

  • Technical background in software development, infrastructure, DevOps, data engineering, or a related field
  • Basic command-line experience
  • Basic programming knowledge, preferably Python or JavaScript
  • Previous Ollama or local LLM experience is not required

Course Outline*:

*We customize the course outline and content to your specific needs and relevant use cases.

Module 1: Ollama architecture and local AI deployment

  • Understanding Ollama as a runtime for local and privately deployed AI models
  • Installing and running Ollama on supported desktop and server environments
  • Understanding the Ollama service, CLI, model storage, and local API
  • Comparing local execution with optional remote or cloud model access

Module 2: Selecting and managing models

  • Finding and selecting models based on task, model size, capabilities, and hardware
  • Pulling, running, listing, inspecting, copying, and removing models
  • Understanding model variants, quantization, context requirements, and memory consumption
  • Choosing suitable models for chat, coding, reasoning, vision, embeddings, and tool use

Module 3: Configuring models with Modelfiles

  • Understanding the structure and purpose of an Ollama Modelfile
  • Defining base models, system instructions, templates, and runtime parameters
  • Configuring temperature, context length, stop sequences, and related generation behavior
  • Creating reusable customized models for specific applications and organizational requirements

Module 4: Hardware, performance, and runtime configuration

  • Understanding CPU, GPU, memory, and VRAM requirements for local model execution
  • Matching model size and quantization to available hardware
  • Configuring context length, model loading, and resource usage
  • Diagnosing common installation, memory, model loading, and performance issues

Module 5: Working with the Ollama API

  • Using the local REST API for chat, generation, embeddings, and model operations
  • Sending messages, parameters, and structured requests programmatically
  • Working with streaming responses and structured outputs
  • Understanding the OpenAI-compatible interface for applications built around common AI APIs

Module 6: Python and JavaScript application integration

  • Connecting applications to Ollama using the official Python and JavaScript libraries
  • Building basic chat and generation workflows around local models
  • Managing prompts, conversation history, model selection, and response handling
  • Structuring application code so models and configuration can be changed without major application changes

Module 7: Tool calling and external integrations

  • Understanding tool calling and selecting models that support tool use
  • Connecting model responses with application functions, APIs, and external services
  • Integrating Ollama with development tools and AI application frameworks
  • Designing controlled workflows where the model can request actions without receiving unrestricted system access

Module 8: Private deployment and operational readiness

  • Exposing Ollama to other applications and services within controlled environments
  • Considering network access, authentication layers, containers, and service boundaries
  • Managing models, versions, configuration, updates, and resource consumption
  • Building a practical deployment checklist covering privacy, security, hardware, monitoring, integrations, and maintenance

Hands-on learning with expert instructors at your location for organizations.

4,122€*
Graph Icon - Education X Webflow Template
Level:
advanced
Clock Icon - Education X Webflow Template
Duration:
14
Hours (days:
2
)
Camera Icon - Education X Webflow Template
Training customized to your needs
Star Icon - Education X Webflow Template
Immersive hands-on experience in a dedicated setting
*Price can range depending on number of participants, change of outline, location etc.

Master new skills guided by experienced instructors from anywhere.

3,097€*
Graph Icon - Education X Webflow Template
Level:
advanced
Clock Icon - Education X Webflow Template
Duration:
14
Hours (days:
2
)
Camera Icon - Education X Webflow Template
Training customized to your needs
Star Icon - Education X Webflow Template
Reduced training costs
*Price can range depending on number of participants, change of outline, location etc.

Upcoming Sessions

27-28 Jan 2027
Dublin
1-2 Apr 2027
Munich
28-29 Apr 2027
Vienna
5-6 May 2027
Stockholm
12-13 May 2027
Milan
2-3 Jun 2027
Paris
29-30 Jun 2027
Brussels

Can't find a suitable date? Get in touch and we'll arrange one that works for you.

We use cookies to improve site navigation, analyse how the site is used, and support our marketing. You can accept all cookies, reject non-essential ones, or choose individual categories. Read our Cookie Notice