VibeConsole FAQs

Question 1

What is VibeConsole?

Accepted Answer

VibeConsole is an MCP (Model Context Protocol) server that enables AI agents to control Proxmox virtual machine consoles. It facilitates interaction, including during early boot stages, using noVNC and the Proxmox API for comprehensive VM management.

Question 2

How do AI agents interact with VMs using VibeConsole?

Accepted Answer

AI agents gain full control, able to send keyboard input, capture real JPEG/PNG screenshots, use enhanced OCR for text and grid locations, and perform grid-based clicking (e.g., 'K9'). It also supports raw text I/O via serial console.

Question 3

Does VibeConsole require any software to be installed inside the virtual machines?

Accepted Answer

No, VibeConsole works entirely through the Proxmox API and noVNC/termproxy. This eliminates the need for any agents or software installations within your guest VMs, simplifying setup and deployment.

Question 4

What Proxmox permissions are necessary for VibeConsole to function?

Accepted Answer

VibeConsole requires a Proxmox user or API token with `VM.Console`, `VM.Audit`, and `VM.PowerMgmt` privileges. This allows it to connect to consoles, monitor VM state, and control power functions.

Question 5

Can VibeConsole manage virtual machines during their early boot stages?

Accepted Answer

Yes, a core feature of VibeConsole is its ability to provide AI agents with control over VM consoles even during early boot stages, before an operating system is fully loaded. This is achieved through noVNC integration.

VibeConsole

VibeConsole

Key Features

Use Cases

Key Features

Use Cases