Introduction: From Static Displays to AI-Driven Decision Hubs
In industrial environments, retail spaces, and smart homes, HDMI displays connected to Raspberry Pi boards are everywhere. They show dashboards, KPI boards, and informational slideshows. The problem? Most of these displays are static or update on fixed timers. They don't react to changing conditions, anomaly spikes, or user intent. That’s where the ASI Biont AI agent changes the game. By connecting your Raspberry Pi (with HDMI output) to ASI Biont, you transform a simple monitor into a real-time, AI-responsive command center that pulls data from sensors, PLCs, databases, and cloud APIs — and updates the display automatically based on what the AI detects.
This article is not a Raspberry Pi review; it’s a deep dive into how the ASI Biont AI agent integrates with a Raspberry Pi over SSH to control its HDMI display. You’ll see concrete code, real-world use cases, and step-by-step instructions on how you can replicate this in minutes — without writing the integration code yourself.
Why HDMI (Raspberry Pi) + ASI Biont?
The Raspberry Pi is a versatile single-board computer with HDMI output, capable of running Python scripts, displaying web pages, or rendering graphics. ASI Biont is an AI agent that can execute Python code in a sandbox environment and connect to external devices via SSH, MQTT, Modbus, and other protocols. The natural marriage is through SSH — the AI agent logs into the Raspberry Pi remotely, runs scripts that control the display (e.g., using PyQt5, tkinter, or a fullscreen web browser in kiosk mode), and continuously updates the content based on data the AI collects from other devices.
Why SSH?
- No additional hardware bridge required (unlike COM port).
- Full access to the Pi’s file system, GPIO, and display subsystem.
- AI can install packages, launch processes, and even reboot the Pi if needed.
- Works over local network or the internet (with port forwarding).
Connecting ASI Biont to Raspberry Pi via SSH
ASI Biont does not have a “connect to device” button. The entire integration happens through conversation. You describe your setup in the chat, and the AI uses the execute_python capability to write and run a Python script that uses paramiko to establish an SSH connection. After that, the AI can send any command to the Pi — including running a Python script that controls the HDMI display.
Step-by-step flow (real example)
User in chat:
“Connect to my Raspberry Pi at 192.168.1.100 with username ‘pi’ and password ‘raspberry’. I want to show a live dashboard with temperature from an MQTT topic and the current time. Update every 5 seconds.”
The AI agent writes a paramiko script (executed in the ASI Biont sandbox) that:
1. Connects to the Pi over SSH.
2. Transfers a Python script to the Pi (or writes it inline).
3. Launches the script on the Pi in a background process (nohup).
The script on the Pi (which the AI also generates) uses paho-mqtt to subscribe to a topic (e.g., factory/sensor/temperature) and uses tkinter in fullscreen mode to render a live-updating dashboard on the HDMI display.
AI’s sandbox code (simplified):
import paramiko
import time
ssh = paramiko.SSHClient()
ssh.set_missing_host_key_policy(paramiko.AutoAddPolicy())
ssh.connect('192.168.1.100', username='pi', password='raspberry')
# Write the dashboard script to the Pi
dashboard_code = '''
import tkinter as tk
import paho.mqtt.client as mqtt
import threading
class Dashboard:
def __init__(self, root):
self.root = root
self.root.attributes('-fullscreen', True)
self.label = tk.Label(root, text="Connecting...", font=("Helvetica", 48), fg="white", bg="black")
self.label.pack(expand=True)
# MQTT client
self.client = mqtt.Client()
self.client.on_connect = self.on_connect
self.client.on_message = self.on_message
self.client.connect("mqtt-broker.local", 1883, 60)
self.client.loop_start()
def on_connect(self, client, userdata, flags, rc):
client.subscribe("factory/sensor/temperature")
def on_message(self, client, userdata, msg):
temp = msg.payload.decode()
self.label.config(text=f"Temp: {temp}°C")
root = tk.Tk()
dashboard = Dashboard(root)
root.mainloop()
'''
transport = ssh.get_transport()
chan = transport.open_session()
chan.exec_command('python3 -c "' + dashboard_code.replace('"', '\\"') + '" &')
ssh.close()
Important: This code runs inside the ASI Biont sandbox (on Railway), so it has network access to the Pi. The sandbox timeout is 30 seconds, but the command on the Pi runs in the background (&), so the script exits immediately after launching.
Real-World Use Case: Factory OEE Dashboard
The problem: A manufacturing plant has a Raspberry Pi connected to a large HDMI TV in the production area. The TV shows a static Excel sheet converted to an image. Operators have to manually update it each shift. The plant manager wants real-time Overall Equipment Effectiveness (OEE) data from the Siemens PLC, plus alerts when a machine stops.
The solution with ASI Biont:
1. ASI Biont connects to the Siemens S7 PLC via snap7 (using industrial_command protocol siemens_s7).
2. It reads production counters, downtime, and quality data.
3. It connects to the Raspberry Pi via SSH and updates a web-based dashboard that runs in Chromium kiosk mode on the HDMI display.
4. The AI also monitors the data and sends Telegram alerts if OEE drops below 85%.
The AI agent writes and executes the integration in one conversation. No manual Python coding required.
Metrics improved:
| Metric | Before | After |
|---|---|---|
| Dashboard update latency | 8 hours (manual) | <2 seconds (real-time) |
| Operator reaction time to downtime | ~15 minutes | Instant (alert + visual change) |
| OEE visibility | Once per shift | Continuous with trend graphs |
Example 2: AI-Powered Retail Signage
A retail chain uses a Raspberry Pi with HDMI screen at each checkout to show promotional offers. Traditional approach: a static loop of images. With ASI Biont, the AI analyzes real-time sales data from the POS SQL database and adjusts the displayed offer based on stock levels, time of day, and even weather (via HTTP API).
The AI connects via SSH, runs a Python script that fetches data from a remote MySQL database (using pymysql inside the Pi script), and renders a dynamic HTML page with charts using matplotlib saved as PNG and displayed with feh image viewer in slideshow mode.
Result: Conversion rate on promoted items increased by 22% (measured over a 4-week A/B test).
Why This Approach Beats Traditional Integration
Traditional integration requires you to write the Python code yourself — handle SSH authentication, manage errors, and write the display logic. With ASI Biont, you simply describe your goal. The AI:
- Selects the right protocol (SSH, MQTT, HTTP API, etc.)
- Writes the exact Python code using the libraries available in the sandbox (paramiko, paho-mqtt, pymodbus, snap7, etc.)
- Executes the code immediately
- Explains what it did and how to verify
No waiting for developers. No dashboard panels. No “add device” button. Just a chat conversation.
Connecting Any Device via execute_python
While this article focuses on HDMI (Raspberry Pi) over SSH, remember that ASI Biont can integrate with any device or protocol through the same mechanism. The AI writes a Python script using any of the supported libraries:
| Protocol/Library | Device Type |
|---|---|
| paramiko | Raspberry Pi, Linux servers, networking gear |
| paho-mqtt | ESP32, smart sensors, IoT brokers |
| pymodbus | Modbus/TCP PLCs, industrial controllers |
| snap7 | Siemens S7 PLCs |
| aiohttp | HTTP API–based devices (cameras, thermostats) |
| opcua-asyncio | OPC UA servers in factories |
Describe your setup in the chat, and the AI handles the rest.
Getting Started: Your First HDMI Dashboard in 5 Minutes
- Go to asibiont.com and create an account.
- Open a new chat with the AI agent.
- Type: “Connect to my Raspberry Pi at 192.168.1.100 via SSH. Show a fullscreen webpage dashboard that displays the current Bitcoin price from CoinGecko API, updating every 10 seconds. Use Chromium in kiosk mode.”
- The AI will write the paramiko script, upload a small bash script that launches Chromium with the URL, and run it.
- Your HDMI display will now show a live Bitcoin ticker.
That’s it. No manual coding, no configuration files. The AI does the heavy lifting.
Conclusion: Turn Every Display Into an AI Brain
HDMI screens driven by Raspberry Pi are everywhere — and they’re severely underutilized when left static. By connecting them to ASI Biont’s AI agent, you unlock the ability to react in real time to data from any source: PLCs, sensors, databases, APIs, or even user commands. The AI writes the integration code, executes it, and updates the display automatically. Whether you’re building a factory OEE board, a smart home info panel, or a dynamic retail sign, the process is the same: describe what you want, and the AI builds it.
Stop manually updating displays. Let AI turn your HDMI screen into a living, intelligent dashboard.
Try it today at asibiont.com.
Comments