AI / Local LLM Featured Project

UlterNet Local LLM Assistant

Private local AI stack using Llama 3.2, Whisper, an OpenAI-compatible API, and desktop assistant workflows.

Client

UlterNet Systems

Date

May 2026

Technologies

Llama 3.2 Python FastAPI PyTorch Whisper Electron React TypeScript OpenAI-Compatible API
UlterNet Local LLM Assistant

Project Overview

Built a local AI assistant stack around Llama 3.2 3B Instruct running on CPU with an OpenAI-compatible FastAPI server, plus optional Whisper transcription and an Electron desktop assistant. The system supports private local inference, model checkpoint management, runtime scripts, integrity verification, local chat completion endpoints, and application integrations that need AI without sending data to external providers. The desktop layer combines React, Electron, screenshots, OCR, local LLM providers, and workflow shortcuts for real-time support.

Project Details

Client
UlterNet Systems
Completion Date
May 04, 2026
Category
AI / Local LLM

Technologies Used

Llama 3.2 Python FastAPI PyTorch Whisper Electron React TypeScript OpenAI-Compatible API

Like This Project?

Let's discuss how we can create something amazing for your business too.

Get In Touch

Related Projects

Explore more projects that showcase our expertise in similar areas

Moodle LMS Integration Platform
Education Systems & Moodle

Moodle LMS Integration Platform

A Moodle 5.x integration layer connecting the LMS to student records, Business Central finance, timetable/workload and results systems.

View Project
Payserve Property Management
Property Management Platform

Payserve Property Management

A property platform covering rent and levy billing, utility metering, payments and tenant onboarding, with eTIMS and QuickBooks built in.

View Project
UlterPOS Point of Sale
Point of Sale System

UlterPOS Point of Sale

Multi-branch retail point of sale — stock, barcode, purchasing and suppliers, with mobile money, bank payments and QuickBooks.

View Project
Lyra CMS
Open-Source Multi-Tenant CMS

Lyra CMS

Our open-source CMS: one deployment hosts many isolated sites, each with its own database, theme and installable modules — with AI-assisted page building.

View Project