100100 Ideas AI
Submit Tool

CleverWick

Open source

Portable offline AI assistant desktop app running GGUF models locally via llama.cpp.

52

Electron + Next.js desktop AI assistant that runs GGUF models locally using llama.cpp. Designed for offline use, portability, and zero-install deployment.

Pros

  • +100% offline and private, no data leaves device
  • +Portable: runs from USB drive without installation
  • +Supports multiple GGUF models (Qwen, Phi, Mistral)
  • +Modern UI with Next.js and Turbopack

Cons

  • −Requires manual model download and placement
  • −Performance depends on CPU, may be slow on low-end hardware
  • −Windows-centric setup scripts (setup.bat, start_pocketnode.bat)

Target audience: Privacy-conscious users and developers who need a portable, offline AI assistant on Windows machines.

Related tools

Other open-source tools that share tags with CleverWick.