# OpenHuman ## πŸ‡ΊπŸ‡Έ/πŸ‡¬πŸ‡§ English - [Welcome to OpenHuman](https://tinyhumans.gitbook.io/openhuman/overview/readme.md): Personal AI assistant for your desktop. Connects to 118+ services, builds a local-first memory of your life, self-reflects, and can interact with you over audio and video. - [Getting Started](https://tinyhumans.gitbook.io/openhuman/overview/getting-started.md): Install OpenHuman, walk through the in-app onboarding (sign in, connect Gmail, choose how AI runs), and run your first request against your own Memory Tree. - [Troubleshooting Sign-In](https://tinyhumans.gitbook.io/openhuman/overview/troubleshooting-sign-in.md): Diagnose sign-in failures, OAuth callbacks that do not complete, and remote core RPC authentication problems. - [Realtime Mascot](https://tinyhumans.gitbook.io/openhuman/features/mascot.md): The on-screen face of OpenHuman, a desktop mascot that speaks, reacts, joins your meetings, and thinks in the background even when you aren't looking at it. - [Meeting Agents](https://tinyhumans.gitbook.io/openhuman/features/mascot/meeting-agents.md): The mascot joins meetings as a real participant: listens, takes notes, speaks back into the call, animates its face into the camera grid, and uses tools mid-meeting. More than a notetaker. - [Obsidian-Style Memory](https://tinyhumans.gitbook.io/openhuman/features/obsidian-wiki.md): Every memory chunk also lives as a Markdown file in an Obsidian-compatible vault you can open and edit. Inspired by Karpathy's obsidian-wiki workflow. - [Memory Trees](https://tinyhumans.gitbook.io/openhuman/features/obsidian-wiki/memory-tree.md): OpenHuman's local-first knowledge base. Ingest from your tools, canonicalize into Markdown, chunk, score, and fold into hierarchical summary trees. - [agentmemory backend](https://tinyhumans.gitbook.io/openhuman/features/obsidian-wiki/agentmemory-backend.md): Optional \`Memory\` trait backend that delegates to a locally-running agentmemory REST server, for users who self-host agentmemory across Claude Code, Cursor, Codex, OpenCode, and OpenHuman. - [Auto-fetch from Integrations](https://tinyhumans.gitbook.io/openhuman/features/obsidian-wiki/auto-fetch.md): Every twenty minutes, OpenHuman walks every active integration and folds new data into your memory tree. No prompts, no polling loops you have to write. - [Third-party Integrations (118+)](https://tinyhumans.gitbook.io/openhuman/features/integrations.md): 118+ third-party integrations - Gmail, Notion, GitHub, Slack, Stripe, Calendar and more - with one-click OAuth and zero API keys. - [Triggers](https://tinyhumans.gitbook.io/openhuman/features/integrations/triggers.md): Live events from connected integrations (a new Gmail message, a Notion edit, a Stripe charge) arrive as triggers, get classified by a triage agent, and can fire agent actions automatically. - [Smart Token Compression](https://tinyhumans.gitbook.io/openhuman/features/token-compression.md): TokenJuice - a rule overlay that compacts verbose tool output before it ever enters LLM context. Sweeping through thousands of emails stays cheap. - [Automatic Model Routing](https://tinyhumans.gitbook.io/openhuman/features/model-routing.md): One subscription, many models. Tasks pick their model via hint prefixes: reasoning goes to a strong model, fast paths go to a fast one, vision to vision. - [Local AI (optional)](https://tinyhumans.gitbook.io/openhuman/features/model-routing/local-ai.md): Optional, opt-in local AI via Ollama or LM Studio. Powers memory embeddings, summary-tree building, background loops, and explicitly routed chat/reasoning workloads on-device. - [Available Tools](https://tinyhumans.gitbook.io/openhuman/features/native-tools.md): The full toolset OpenHuman's agent has out of the box - research, code, control your machine, schedule jobs, talk back to you, and call into 118+ third-party services. - [Web Search](https://tinyhumans.gitbook.io/openhuman/features/native-tools/web-search.md): A native search tool the agent can call directly - no API key required. - [Web Scraper](https://tinyhumans.gitbook.io/openhuman/features/native-tools/web-scraper.md): A purpose-built "GET-and-read" tool that returns clean text, not raw HTML. - [Coder](https://tinyhumans.gitbook.io/openhuman/features/native-tools/coder.md): A complete toolset for working on real codebases - read, write, edit, search, git, lint, test. - [Browser & Computer Control](https://tinyhumans.gitbook.io/openhuman/features/native-tools/browser-and-computer.md): Open URLs, take screenshots, click, type, and move the mouse - natively. - [Cron & Scheduling](https://tinyhumans.gitbook.io/openhuman/features/native-tools/cron.md): Recurring jobs, one-off reminders, and scheduled agent runs - first-class. - [Voice](https://tinyhumans.gitbook.io/openhuman/features/native-tools/voice.md): Native voice - speech-to-text in, text-to-speech out, mascot lip-sync, and a live Google Meet agent that listens and speaks. - [Memory Tools](https://tinyhumans.gitbook.io/openhuman/features/native-tools/memory-tools.md): How the agent reads, writes, and searches its own long-term memory. - [Tool-Scoped Memory](https://tinyhumans.gitbook.io/openhuman/features/native-tools/tool-memory.md): Durable, tool-scoped rules for safety-critical guidance and learnings. - [Third-party Integrations](https://tinyhumans.gitbook.io/openhuman/features/native-tools/integrations.md): The agent's view of the 119+ connected third-party services. - [Agent Coordination](https://tinyhumans.gitbook.io/openhuman/features/native-tools/agent-coordination.md): Tools the agent uses to plan, delegate, and ask for help. - [System & Utilities](https://tinyhumans.gitbook.io/openhuman/features/native-tools/system-and-utilities.md): Shell, node, SQL, current time, push notifications - the small tools that round out the toolbelt. - [Subconscious Loop](https://tinyhumans.gitbook.io/openhuman/features/subconscious.md): Background loop that evaluates user / system tasks against the workspace and decides what to do. - [Privacy & Security](https://tinyhumans.gitbook.io/openhuman/features/privacy-and-security.md) - [OS Keyring & Secret Storage](https://tinyhumans.gitbook.io/openhuman/features/privacy-and-security/os-keyring-and-secret-storage.md) - [Platform & Availability](https://tinyhumans.gitbook.io/openhuman/features/platform.md): What OpenHuman ships as (native React + Tauri v2 desktop app with a Rust core), supported platforms, and what's in scope today. - [Cloud Deploy](https://tinyhumans.gitbook.io/openhuman/features/cloud-deploy.md): Hosting the headless openhuman-core in the cloud - DigitalOcean App Platform, Fly.io, or Docker Compose on any VPS. - [Overview](https://tinyhumans.gitbook.io/openhuman/developing/developing.md): Build, run, test, and ship OpenHuman from source. - [Getting Set Up](https://tinyhumans.gitbook.io/openhuman/developing/getting-set-up.md): How to build OpenHuman from source - toolchain, vendored Tauri CLI, and local desktop builds. - [Building the Rust Core](https://tinyhumans.gitbook.io/openhuman/developing/building-rust-core.md): Build the Rust core from scratch on a fresh machine. - [Testing Strategy](https://tinyhumans.gitbook.io/openhuman/developing/testing-strategy.md): How OpenHuman tests its product - Vitest, cargo test, WDIO E2E. Where each test goes. - [E2E Testing](https://tinyhumans.gitbook.io/openhuman/developing/e2e-testing.md): End-to-end testing with WDIO + tauri-driver / Appium. CI and local setup. - [Release Policy](https://tinyhumans.gitbook.io/openhuman/developing/release-policy.md): Release cadence, version policy, OAuth-and-installer rules. How shipping works. - [Polymarket Integration (v1 Read + Trading)](https://tinyhumans.gitbook.io/openhuman/developing/polymarket.md) - [Chromium Embedded Framework](https://tinyhumans.gitbook.io/openhuman/developing/cef.md): Why OpenHuman ships its own Chromium runtime, what we use it for today, and what the same CDP surface unlocks next. - [Agent Observability](https://tinyhumans.gitbook.io/openhuman/developing/agent-observability.md): Artifact-capture layer that makes E2E tests debuggable. Logs, traces, screenshots. - [Architecture](https://tinyhumans.gitbook.io/openhuman/developing/architecture.md): High-level shape of the OpenHuman system (desktop shell, Rust core, Memory Tree, agent loop). Pointer to the deep developer architecture in the repo. - [Agent Harness](https://tinyhumans.gitbook.io/openhuman/developing/architecture/agent-harness.md): How an agent turn actually runs - the tool-call loop, sub-agent dispatch, archetypes, triage, hooks, and the cost/budget machinery around them. - [Frontend (app/src/)](https://tinyhumans.gitbook.io/openhuman/developing/architecture/frontend.md): The React + Vite frontend (\`app/src/\`) - architecture, state, services, providers, routing, components, hooks. - [Tauri Shell (app/src-tauri/)](https://tinyhumans.gitbook.io/openhuman/developing/architecture/tauri-shell.md): The desktop host (\`app/src-tauri/\`) - Tauri v2 + WebView, IPC, embedded core lifecycle, core bridge. - [Terms & Conditions](https://tinyhumans.gitbook.io/openhuman/legal/terms-of-use.md): Terms and conditions governing use of the OpenHuman service. - [Privacy Policy](https://tinyhumans.gitbook.io/openhuman/legal/privacy-policy.md): How OpenHuman collects, uses, processes, stores, and protects information when you use the service. --- # Agent Instructions: Querying This Documentation If you need additional information, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on a page URL with the `ask` query parameter: ``` GET https://tinyhumans.gitbook.io/openhuman/overview/readme.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.