Virtual pet & autonomous
desktop agent.
Meet Jacky, an autonomous desktop companion for Windows and macOS powered by LLMs and computer vision. Far more than a simple screen buddy, Jacky wanders with gravity physics, chats, searches the web, launches apps, and can click or type directly on your screen.
Aww, that feels so nice! ❤️
Jacky (Getting Pet)
State: GETTING_PET • Frame count: 35 • Speed: 16 FPS
Jacky (Rocking & Vibing)
State: ROCKING • Frame count: 27 • Speed: 16 FPS
Jacky (Walking)
State: WALKING • Frame count: 12 • Speed: 16 FPS
Featured Workshop Packages
Hand-picked community creations to customize your desktop pet experience.
No featured packages found
One pet, a whole toolbox of powers
A quick map of everything your desktop companion can do. Scroll down for live, interactive demos of the highlights.
Lives on your desktop
Walks window title bars & screen edges with optional gravity physics.
Voice in & out
Push-to-talk speech recognition and spoken replies, local or cloud.
Agentic tool calling
Searches the web, launches apps, and runs real OS actions for you.
Sees your screen
Multimodal vision analyzes what's on screen, DPI & multi-monitor aware.
Clicks & types
Set-of-Mark vision pipeline locates UI to click, type, close or minimize.
Timers & alarms
Countdowns, reminders, and daily alarms by voice or menu — they persist.
Routines & OAuth
Custom JSON API workflows with Google, GitHub, Spotify & more.
7 personalities
Distinct archetypes change dialogue, persona, and TTS voice.
Tamagotchi care
Hunger, happiness, training & hygiene stats that decay over time.
AI collectibles
Random item drops with LLM-generated lore and rarity to collect.
Multi-instance peers
Run many Jackys that greet, chase, dance, and fight each other.
Operation modes
Silent, Gamer, Focus (Pomodoro) and Music modes adapt to your activity.
Memory & knowledge
Remembers recent chats and persistent facts about you across sessions.
Exclusion zones
Paint off-limits areas Jacky never enters — solid walls under gravity.
Multilanguage
Ships with Spanish & English; add a language with a single JSON file.
System events
Reacts to battery level, charging, and welcomes you back after idle.
Auto-updates
One-click background updates with safe JSON data migrations.
Desktop Companionship, Reimagined
Equipped with physics, voice interaction, local computer vision pipelines, and full agentic tool calling, Jacky goes far beyond a static sprite. He interacts directly with your operating system and custom APIs.
Agentic LLM Tool Calling
Native OS commands & Routine integrations
Instead of just chatting, Jacky can decide to execute desktop operations. He maps your verbal instructions into actual API calls to search the web, manage programs, schedule alarms, or sync data.
You: Who won the latest Formula 1 Monaco GP?
Jacky's Action: Searching the web for Monaco Grand Prix winners...
Result: Found latest Monaco GP result (Charles Leclerc).
Jacky: "It was Charles Leclerc! He took a beautiful victory on his home turf in Monaco! 🏎️🏆"
Set-of-Mark Screen Interaction
OmniParser ONNX UI segmentation & coordinates clicks
Jacky uses local screenshots and an ONNX-based OmniParser Set-of-Mark (SoM) model to recognize interactive buttons, links, and forms on your screen. The LLM selects the correct index mark to click, type, or minimize.
1: const pet = new Jacky();
2: pet.enableGravity(true);
3: pet.setPersonality("nerdy");
Ready. Press 'Simulate Click' to trigger the computer vision targeting loop.
Tamagotchi Pet Mode
Decaying vitals & responsive actions
Care for Jacky directly on your desktop! He has hunger, happiness, training, and hygiene stats that decay over time. Neglecting them triggers sad animations.
Jacky: "Cruising along the top of your windows! Ready when you are. 🐾"
Distinct Personalities
7 archetypes with unique TTS and dialogues
Choosing a personality modifies the LLM system prompt, text-to-speech voice profiles, and custom catchphrase overlays for autonomous events (like detecting Spotify playlists or low batteries).
Small, energetic, and always excited to help. Enjoys walking along window borders and doing flips.
Talk to Jacky, Hear Him Back
Push-to-talk STT + spoken TTS replies
Press Ctrl+Shift+Space and speak. Jacky transcribes your voice and replies out loud. Run it fully offline with local Whisper + Piper, or switch to cloud providers for extra polish.
Whisper ONNX (Sherpa)
🔒 Offline • FREE
Piper ONNX (local)
⚡ Zero latency • FREE
Tap the mic to simulate push-to-talk
Built for Security, Privacy & Control
Explore Jacky's background engine settings. Interact with the sandbox components below to simulate desktop physics, granular permission gates, and local offline stacks.
Privacy-First & Local Execution
Run fully offline without metered subscription costs
Jacky is designed to run locally. You can use local ONNX Whisper speech models and local Piper voice synthesis combined with Ollama to work 100% offline.
Status: All system requests are fully sandboxed. No data leaves your machine.
Desktop Physics & Gravity
Walks on titles, falls when dropped, shoves windows
Jacky interacts physically with your open apps. He roams titles, respects desktop boundaries, and falls down naturally when dragged.
Long-Term Knowledge Extraction
Extracts persistent facts from chat automatically
Jacky reviews conversation threads in the background and consolidates facts into knowledge.json to remember you across sessions.
Jacky: "Type something about yourself, and I'll extract it to my config! 📝"
Granular Security Permissions
Dual-gated security credentials & sandboxed execution
Deep desktop automation requires total trust. Jacky runs under strict user boundaries. Turn individual capabilities on or off dynamically.