All projectsSpecial Jury PrizeProject 14 of 22 · Build Agents That Remember

OCTOHANDY

OctoHandy is a seller-side marketplace agent built on two pieces: Screenpipe, the eyes, and Hermes, the agent.

The project

OctoHandy is a seller-side marketplace agent built on two pieces: Screenpipe, the eyes, and Hermes, the agent. Screenpipe watches what the seller does on screen and understands what they mean. It is both the eyes and the fuel of the agent's brain. That context turns the user's intent into a step-by-step roadmap, and Hermes runs it on its own dedicated VM, a remote desktop with its own browser, so nothing needs to be installed on the seller's computer.

In practice:

Publish from the chat: drop two photos and ask Hermes to list a T-shirt on Vinted. Hermes opens Vinted on its VM, uploads the photos, writes the title and description, sets the category, condition and price, and publishes the listing on its own.
Teach by doing: record a task once (for example, searching Vinted for Mewtwo Pokémon cards). Hermes reads the Screenpipe recording and writes a reusable workflow with a trigger, a goal and steps. After that, a single chat message can run it at any time.

Never miss a buyer: Screenpipe keeps an eye on messages across marketplaces (Vinted, eBay, Leboncoin, Vestiaire Collective, Depop) and remembers them.

No rigid scripts: OctoHandy understands intent, and sensitive actions stay under the seller's approval.

How it’s built

Tech stack

Frontend: Next.js, React, Tailwind, deployed on Vercel.
Backend: FastAPI (Python) and SQLite, on Hetzner, Screenpipe.

Agent: Hermes behind an OpenAI-compatible gateway, with Nebius DeepSeek as the fallback LLM and screenpipe as the eye and fuel the memory of the agent.

Dedicated VM: an A4000 GPU machine running Chrome, Screenpipe and Hermes, streamed to the dashboard through noVNC behind Caddy, with short-lived HMAC tokens.

How we integrated Screenpipe

Screenpipe runs on the agent's VM, next to its Chrome, so nothing is installed on the seller's computer.

Teach by doing: the backend pulls the recorded time window from the Screenpipe API (OCR text, window titles, UI events) and compresses it. Hermes turns it into a workflow (trigger, goal, steps).
Inbox watch: Screenpipe watches the Messages tab of each connected marketplace (Vinted, eBay, Leboncoin, Etsy). A check runs when a notification e-mail arrives, or every 2 minutes. Hermes only wakes up when a new buyer message appears (0 tokens otherwise) and triggers the reply workflow. Discounts above the seller's limit need approval.

Running workflows: Hermes reads the recording of Screenpipe to plan its actions.

Clicking: clicks target real elements from Screenpipe's latest frame.

🇫🇷 made with love <3 by @nass