AI / Local LLM
Featured Project
UlterNet Local LLM Assistant
Private local AI stack using Llama 3.2, Whisper, an OpenAI-compatible API, and desktop assistant workflows.
Client
UlterNet Systems
Date
May 2026
Technologies
Llama 3.2
Python
FastAPI
PyTorch
Whisper
Electron
React
TypeScript
OpenAI-Compatible API
Project Overview
Built a local AI assistant stack around Llama 3.2 3B Instruct running on CPU with an OpenAI-compatible FastAPI server, plus optional Whisper transcription and an Electron desktop assistant. The system supports private local inference, model checkpoint management, runtime scripts, integrity verification, local chat completion endpoints, and application integrations that need AI without sending data to external providers. The desktop layer combines React, Electron, screenshots, OCR, local LLM providers, and workflow shortcuts for real-time support.
Project Details
Technologies Used
Llama 3.2
Python
FastAPI
PyTorch
Whisper
Electron
React
TypeScript
OpenAI-Compatible API
Like This Project?
Let's discuss how we can create something amazing for your business too.
Get In TouchRelated Projects
Explore more projects that showcase our expertise in similar areas
Campaign Website
Pika Na Power (KPLC)
Public campaign website for Kenya Power's Pika Na Power electric cooking initiative.
View Project
Corporate Website & CMS
Alamat Group
Corporate website and admin-managed content platform for a cybersecurity and security solutions brand.
View Project
Point of Sale System
Atricare POS
Multi-branch POS system for retail, stock control, payments, staff, reporting, and white-label operations.
View Project
Moodle LMS Integration
Zetech University LMS Integration
Moodle integration connecting SMIS, Workload, Business Central Finance, and student academic workflows.
View Project