ui: PWA support by allozaur · Pull Request #23871 · ggml-org/llama.cpp

allozaur · 2026-05-29T13:51:47Z

Overview

Close #23060

Shared build utility functions (version resolution, bundle path rewriting, SW content fixing, splash link generation)
PWA installability: manifest.webmanifest, service worker (sw.js), icons, dark mode support, standalone display mode
Service worker: Workbox-powered, auto-generated via SvelteKitPWA, precaches all static assets
Automatic update detection: useRegisterSW() polls every 60s for new SW version; shows "Update available" card when ready
Build version injection: LLAMA_UI_VERSION env var (from CMake) > git hash + epoch > fallback; used as cache-busting query param on bundles and in SW precache
Static bundle naming: SvelteKit's hashed bundle.<hash>.js/css replaced with bundle.js?v=<version> in index.html, SW, and bundle files; _app/ directory eliminated from output
Auto-generating PWA icons and + Apple splash screens: generated for all iPhone/iPad sizes (portrait + landscape, light + dark) via apple-splash-*.png files with proper media queries
Toggleable build version display: new settings key showBuildVersion; shows version string in bottom-right corner when enabled
Runtime API caching: Workbox NetworkFirst strategy for /v1/* and static endpoints (/health, /props, /models, etc.) with 24h TTL and 50-entry max

Additional information

Upgraded many dev dependencies (svelte 5.55.7 -> 5.56.1, tailwindcss 4.1.11 -> 4.3.0, typescript 5.8.3 -> 5.9.3, etc.)
Added workbox-window as explicit dep
New favicon SVGs: clean geometric Llama logo (light #111111 + dark #FAFAFA variants) replacing the old complex screenshot SVG

iOS Demo

pwa-ios-demo.mp4

macOS Demo

pwa-macos-demo.mp4

Requirements

I have read and agree with the contributing guidelines
AI usage disclosure:

allozaur

wip

allozaur · 2026-05-29T13:52:32Z

let's make sure we've got this file properly updated in the light of PWA implementation

allozaur

Last todos:

Version info in UI
Improve Reload alert UI

ServeurpersoCom · 2026-06-12T09:45:30Z

Testing is underway for the bug in the update warning popup with relatives urls

ServeurpersoCom · 2026-06-12T10:50:01Z

99b8e5a
WDYT ?

Keep the PWA hook object intact instead of destructuring needRefreshByStorage, which freezes the reactive getter. Also exclude loading.html from PWA precache to prevent 404 errors and broken SW installation.

CISC · 2026-06-12T19:31:29Z

Server CIs broke:
https://github.com/ggml-org/llama.cpp/actions/runs/27420106883/job/81043112834#step:5:540

ServeurpersoCom · 2026-06-12T20:27:52Z

Server CIs broke: https://github.com/ggml-org/llama.cpp/actions/runs/27420106883/job/81043112834#step:5:540

I think it's the pre-built asset bucket that's lagging behind the merge.

CISC · 2026-06-12T20:29:23Z

Server CIs broke: https://github.com/ggml-org/llama.cpp/actions/runs/27420106883/job/81043112834#step:5:540

I think it's the pre-built asset bucket that's lagging behind the merge.

That would explain it as release is broken, see my PR. :)

aldehir · 2026-06-12T20:40:21Z

I'm not sure the prebuilt UI path is going to work as intended. The ASSETS define what to download from the HF bucket, but if the bundle.*.js and bundle.*.css files are resolved from the build dir, then those will never get pulled down from the bucket.

Probably needs to grab the list from the checksum file and pull those on download. Or better, pull an archive ~~but that has some implications w.r.t cross-platform compatibility~~CMake 3.18 has ARCHIVE_EXTRACT support.

ngxson · 2026-06-13T00:29:07Z

@aldehir hmm I can confirm that bundle.js|css and index.html are missing from the download: https://github.com/ggml-org/llama.cpp/actions/runs/27450671336/job/81145091244?pr=24550

well I guess, maybe simply rename the file back to the old bundle.js|css after the build, then have the server to automatically route them back to the correct path; trying to do that on #24550

* feat: Add basic PWA support and service worker for offline caching * feat: Vite PWA implementation WIP * feat: Improve PWA icons generation * feat: Add PWA workbox to server routes * feat: Include `version.json` in static assets * feat: Add HTTP cache headers for PWA static assets * feat: Update app name for `apple-mobile-web-app-title` * feat: Implement PWA versioning and automatic update detection * chore: Update `.gitignore` files * feat: Splash Screens * feat: Add dark mode favicon support * refactor: Cleanup * fix: Use dark logo for dark splash screens * refactor: Simplify favicons SVG code * fix: Adjust caching and polling for reliable service worker updates * fix: Add missing favicon entry * fix: Align PWA service worker configuration with SvelteKit build structure * fix: Replace hashed bundle paths with versioned static paths * test: Add PWA tests * ci: Add build output for unit tests * refactor: Cleanup * fix: Server build & release versioning * chore: Update package-lock.json * chore: Increase PWA cache size * chore: Update packages * feat: Update favicons * refactor: Post-merge fix * feat: support explicit build version for PWA cache busting * fix: CI * feat: Improve PWA Refresh Alert UI * feat: Add toggleable build version display * refactor: Cleanup * feat: Add version mismatch detection and manual app reload * refactor: replace dynamic imports with static * refactor: Cleanup * feat: Add safe space for `pwa-<size>.png` rendered icons * fix: use relative paths for PWA assets to support base path deployment * feat: add PWA mode detection via URL query parameter * feat: Use ?cache=true for SW-cached PWA assets * refactor: Build process cleanup * refactor: Decouple PWA versioning and remove ?cache=true workaround * chore: Update README logo * feat: Include PWA Assets generation in build script * refactor: `usePwa` hook for core layout * fix: Relativize base vite plugin * fix: remove unnecessary backslash escapes in test regexes * test: update static asset paths for API Key test * refactor: Move SvelteKit PWA Options config to constants * ui: fix update notification never appearing Keep the PWA hook object intact instead of destructuring needRefreshByStorage, which freezes the reactive getter. Also exclude loading.html from PWA precache to prevent 404 errors and broken SW installation.

github-actions Bot added script Script related examples devops improvements to build systems and github actions server server/ui labels May 29, 2026

allozaur commented May 29, 2026

View reviewed changes

allozaur force-pushed the allozaur/llama-ui-pwa branch 2 times, most recently from ca56cf5 to 28cdbcb Compare May 29, 2026 18:25

allozaur commented May 29, 2026

View reviewed changes

Comment thread tools/ui/pwa-assets.config.ts Outdated

Comment thread tools/ui/vite.config.ts Outdated

Comment thread tools/ui/vite.config.ts Outdated

allozaur force-pushed the allozaur/llama-ui-pwa branch from 28cdbcb to c7f42bb Compare May 29, 2026 19:12

allozaur commented May 29, 2026

View reviewed changes

allozaur force-pushed the allozaur/llama-ui-pwa branch from b3b24f5 to 877222e Compare May 30, 2026 06:02

allozaur mentioned this pull request May 30, 2026

ui: exclude generated build dirs from prettier and eslint so lint errors stop being masked #23910

Merged

allozaur force-pushed the allozaur/llama-ui-pwa branch 17 times, most recently from 83ac740 to 60ee2f2 Compare June 4, 2026 14:15

allozaur added 9 commits June 12, 2026 10:45

feat: Use ?cache=true for SW-cached PWA assets

b7c52a0

refactor: Build process cleanup

149703a

refactor: Decouple PWA versioning and remove ?cache=true workaround

0ae3da5

chore: Update README logo

ab024dc

feat: Include PWA Assets generation in build script

1c591fc

refactor: usePwa hook for core layout

e667e44

fix: Relativize base vite plugin

657847d

fix: remove unnecessary backslash escapes in test regexes

134701e

test: update static asset paths for API Key test

917edae

allozaur force-pushed the allozaur/llama-ui-pwa branch from aa0e72b to 917edae Compare June 12, 2026 08:45

refactor: Move SvelteKit PWA Options config to constants

31ca2b3

ui: fix update notification never appearing

295579e

Keep the PWA hook object intact instead of destructuring needRefreshByStorage, which freezes the reactive getter. Also exclude loading.html from PWA precache to prevent 404 errors and broken SW installation.

ServeurpersoCom approved these changes Jun 12, 2026

View reviewed changes

allozaur merged commit f7ca93d into ggml-org:master Jun 12, 2026
30 checks passed

OtherCrashOverride mentioned this pull request Jun 12, 2026

Compile bug: UI: HF download failed #24534

Closed

agustinmista mentioned this pull request Jun 12, 2026

CI: release job broken after merging PWA support #24542

Closed

CISC mentioned this pull request Jun 12, 2026

ci : unbreak release #24544

Merged

CISC mentioned this pull request Jun 12, 2026

ci : unbreak release harder #24545

Merged

ngxson mentioned this pull request Jun 13, 2026

server: clean up static assets handling #24550

Merged

aldehir mentioned this pull request Jun 13, 2026

cmake/ui : improve UI build to better handle many assets #24551

Closed

Rhys-T mentioned this pull request Jun 14, 2026

The "load" button doesn't work for only one specific model. mostlygeek/llama-swap#844

Closed

allozaur deleted the allozaur/llama-ui-pwa branch June 19, 2026 08:25

Uh oh!

Conversation

allozaur commented May 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview

Additional information

iOS Demo

macOS Demo

Requirements

Uh oh!

allozaur left a comment

Choose a reason for hiding this comment

Uh oh!

allozaur May 29, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

allozaur left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ServeurpersoCom commented Jun 12, 2026

Uh oh!

ServeurpersoCom commented Jun 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

CISC commented Jun 12, 2026

Uh oh!

ServeurpersoCom commented Jun 12, 2026

Uh oh!

CISC commented Jun 12, 2026

Uh oh!

aldehir commented Jun 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ngxson commented Jun 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

allozaur commented May 29, 2026 •

edited

Loading

allozaur left a comment •

edited

Loading

ServeurpersoCom commented Jun 12, 2026 •

edited

Loading

aldehir commented Jun 12, 2026 •

edited

Loading