About

Imported from mayukh4/huskylens-agent (SKILL.md). Install upstream with npx skills add mayukh4/huskylens-agent. Copyright stays with the author (MIT).

tars-vision

Name: tars-vision
Author: mayukh4

Physical embodiment for Hermes Agent. The Pi drives three independent loops that share a single HuskyLens camera over I2C:

Always-on gesture control — open palm, fist, and victory sign trigger Home Assistant switches and Hermes web-search queries.
Heartbeat (every 5 min) — sequentially runs face recognition then emotion recognition, feeds "<name> is here, they seem <mood>" to Hermes, and speaks the reply.
Tap-to-speak voice — touch the screen to record, transcribe with Whisper, route through Hermes, speak the reply with OpenAI TTS (Onyx voice).

The face is rendered in the browser (Chromium kiosk) from assets/static/ and driven by a Flask API on localhost:5555. Hermes can push face state with POST /state from any skill.

Install

git clone https://github.com/MayukhBuilds/huskylens-agent.git
cd huskylens-agent
bash scripts/install.sh
# edit .env with your OPENAI_API_KEY
bash scripts/start.sh

Full hardware wiring, HuskyLens I2C setup, and optional Home Assistant config: see references/SETUP.md.

Architecture deep-dive (threading model, heartbeat rationale, why I2C won over UART/USB-MCP): see references/ARCHITECTURE.md.

TARS personality prompt (copied to ~/.hermes/SOUL.md by install.sh): references/SOUL.md.

Face API

curl -X POST localhost:5555/state      -d '{"state":"happy"}'
curl -X POST localhost:5555/expression -d '{"expression":"surprised","duration":3}'
curl       localhost:5555/health

States: idle, listening, recording, thinking, speaking, happy, curious, surprised, sleeping.

Use it

Copy one of these into your project. Installing also returns the manifest and these snippets.

yaml

targets:
  - https://api.opensmartroute.ai/api/v1/registry/mayukh4-huskylens-agent-tars-vision/manifest   # or paste the manifest below

Manifest

An Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.

mayukh4-huskylens-agent-tars-vision.ocm.jsonjson

{
  "ocm": "1",
  "id": "mayukh4-huskylens-agent-tars-vision",
  "kind": "skill",
  "name": "tars-vision",
  "description": "Matrix-style AI face display for Raspberry Pi 5 that gives Hermes Agent a physical body. HuskyLens V2 camera over I2C for face, emotion, and gesture recognition. Animated Three.js holographic face on a DSI touchscreen. OpenAI Whisper plus TTS voice pipeline. Optional Home Assistant smart-home gestures. TARS (Interstellar) personality with 75% humor.",
  "publisher": "mayukh4",
  "version": "1.0.0",
  "capabilities": {
    "domains": [
      "math"
    ],
    "tags": [
      "skill-md",
      "hardware",
      "vision",
      "huskylens",
      "raspberry-pi",
      "face-display",
      "voice",
      "home-automation",
      "tars",
      "github"
    ],
    "languages": [
      "en"
    ]
  },
  "quality_prior": 0.6,
  "examples": [
    "Matrix-style AI face display for Raspberry Pi 5 that gives Hermes Agent a physical body. HuskyLens V2 camera over I2C for face, emotion, and gesture recognition. Animated Three.js holographic face on a DSI touchscreen. OpenAI Whisper plus TTS voice pipeline. Optional Home Assistant smart-home gestures. TARS (Interstellar) personality with 75% humor."
  ],
  "primary": false,
  "metadata": {
    "source": {
      "provider": "github",
      "repository": "https://github.com/mayukh4/huskylens-agent",
      "path": "SKILL.md",
      "ref": "95a618aa43e8177e020c2eaa43f4cf65bef80910",
      "url": "https://github.com/mayukh4/huskylens-agent/blob/95a618aa43e8177e020c2eaa43f4cf65bef80910/SKILL.md",
      "key": "mayukh4/huskylens-agent/SKILL.md"
    },
    "compatibility": "Raspberry Pi 5 with Raspberry Pi OS (Bookworm). HuskyLens V2 (firmware v1.2.2+) set to I2C mode. 800x480 DSI touchscreen. USB microphone and speaker. PipeWire audio server. Requires OPENAI_API_KEY. Ho",
    "license": "MIT"
  },
  "instructions": "# tars-vision\n\nPhysical embodiment for Hermes Agent. The Pi drives three independent loops that share a single HuskyLens camera over I2C:\n\n- **Always-on gesture control** — open palm, fist, and victory sign trigger Home Assistant switches and Hermes web-search queries.\n- **Heartbeat (every 5 min)** — sequentially runs face recognition then emotion recognition, feeds `\"<name> is here, they seem <mood>\"` to Hermes, and speaks the reply.\n- **Tap-to-speak voice** — touch the screen to record, transcribe with Whisper, route through Hermes, speak the reply with OpenAI TTS (Onyx voice).\n\nThe face is ",
  "cost": {
    "context_tokens": 419
  }
}

Fetch it by URL: GET /api/v1/registry/mayukh4-huskylens-agent-tars-vision/manifest?version=1.0.0

Reviews

Star ratings from people who tried it. One review per account; edit yours any time.

No reviews yet. Install it, try it, and be the first to rate it.