msty - privacy-first AI with screen context

Msty is a privacy-first AI platform (desktop + web) that natively supports MCP via its Toolbox feature — both STDIO and HTTP modes. screenpipe works out of the box with Msty, giving it access to your screen history, audio transcriptions, and more.

setup

STDIO mode

make sure screenpipe is running on your machine
open Msty and go to Settings → Toolbox
add a new tool with the following configuration:

{
  "mcpServers": {
    "screenpipe": {
      "command": "npx",
      "args": ["-y", "screenpipe-mcp"]
    }
  }
}

save and enable the tool

HTTP mode

if you need remote access, use the HTTP transport instead. start the HTTP MCP server:

npx -y screenpipe-mcp-http --port 3031

then point Msty’s Toolbox at the HTTP endpoint:

{
  "mcpServers": {
    "screenpipe": {
      "url": "http://localhost:3031/mcp"
    }
  }
}

usage

once configured, Msty can search your screen history and get context about what you’ve been working on:

> what was I working on this morning?

> find that documentation about async/await patterns I was reading earlier

> what error messages have I seen in my terminal today?

> search for the API response format I was looking at in the browser

example workflows

recall context from earlier:

> I was reading a blog post about rust macros earlier today,
> search screenpipe and summarize the key points

reference meeting discussion:

> search my audio transcriptions for what was discussed
> about the deployment timeline, then help me plan next steps

debug from memory:

> I saw an error message flash on screen, search screenpipe
> to find it and help me fix the issue

find code examples:

> search screenpipe for the python code I was looking at
> in the browser yesterday about asyncio patterns

available tools

screenpipe provides these MCP tools to Msty:

tool	description
`search-content`	search screen text (accessibility-first, OCR fallback), audio transcriptions, and input
`activity-summary`	lightweight overview of app usage, speakers, and recent texts for a time range
`search-elements`	search structured UI elements from the accessibility tree
`frame-context`	full accessibility tree, URLs, and text for a specific frame
`list-meetings`	list detected meetings with duration, app, and attendees
`export-video`	export screen recordings as MP4 for a time range

requirements

screenpipe running on localhost:3030 (or localhost:3031 for HTTP mode)
Msty desktop or web app
Node.js >= 18.0.0

need help? join our discord.

get started

pipes

connect

use cases

integrations

reference

deployment

compare

resources

msty - privacy-first AI with screen context

setup

STDIO mode

HTTP mode

usage

example workflows

available tools

requirements

​setup

​STDIO mode

​HTTP mode

​usage

​example workflows

​available tools

​requirements

setup

STDIO mode

HTTP mode

usage

example workflows

available tools

requirements