From Zero to Digital Signage: How ASI Biont’s AI Agent Controls a Raspberry Pi Over HDMI Without a Single Line of Code

Introduction

You have a spare Raspberry Pi and a monitor with an HDMI port. You want to turn it into a real-time dashboard for your factory KPIs, server metrics, or even a live news ticker. Traditionally, this would require writing a full-stack web app, configuring a kiosk mode, and maintaining a cron job to refresh data. With ASI Biont’s AI agent, that entire workflow disappears. The agent connects to your Raspberry Pi over SSH, writes a Python script on the fly, and pushes a continuously updating visualization to the HDMI display. No manual coding, no waiting for developers.

The Connection Method: SSH – The Universal Remote for SBCs

ASI Biont uses SSH to talk to single-board computers like Raspberry Pi, Orange Pi, or BeagleBone. Here’s why SSH is the right choice:

  • Zero hardware setup: The Pi only needs to be on the same network and have SSH enabled. No extra USB-to-serial adapters or MQTT brokers.
  • Full control: SSH gives the AI agent access to the Pi’s filesystem, GPIO, and display server. It can install packages, launch browsers in kiosk mode, and update content in real time.
  • Security: SSH keys (or password) are passed once via the chat; the AI never stores credentials.

The agent runs a Python script inside ASI Biont’s sandbox using the execute_python tool. The script uses paramiko to open an SSH session, execute commands on the Pi, and retrieve output. The entire interaction happens through natural language conversation – you describe what you want, the AI writes the integration code.

Use Case: Real-Time Factory Dashboard on HDMI

Imagine a factory floor with a 42-inch monitor mounted on the wall. You need to display:
- Current production line speed (pulled from a Modbus TCP PLC)
- Temperature/humidity from an ESP32 (via MQTT)
- OEE (Overall Equipment Effectiveness) calculated from both sources

Step 1: Describe the task in chat

User: “Connect to my Raspberry Pi at 192.168.1.100 (user: pi, password: raspberry). Install Flask and create a dashboard that shows live Modbus registers and MQTT sensor data. The dashboard should run in full-screen Chromium in kiosk mode.”

Step 2: AI writes and executes the code

ASI Biont’s sandbox contains all necessary libraries – paramiko, pymodbus, paho-mqtt. The AI constructs a Python script that:
1. SSH into the Pi
2. Installs Flask, pymodbus, paho-mqtt if missing
3. Creates a simple Flask web app that serves an HTML page with auto-refreshing charts
4. Uses subprocess on the Pi to launch Chromium in fullscreen

Example snippet generated by the AI (simplified):

import paramiko

ssh = paramiko.SSHClient()
ssh.set_missing_host_key_policy(paramiko.AutoAddPolicy())
ssh.connect('192.168.1.100', username='pi', password='raspberry')

# Install dependencies
ssh.exec_command('pip install flask pymodbus paho-mqtt')

# Create dashboard script on Pi
dashboard_script = """
from flask import Flask, render_template_string
app = Flask(__name__)

HTML = '''
<!DOCTYPE html>
<html><head>
  <meta http-equiv="refresh" content="5">
  <title>Factory Dashboard</title>
  <style>body { background: #111; color: #0f0; font-family: monospace; font-size: 4vw; }</style>
</head><body>
  <h1>Line Speed: {{ speed }} units/min</h1>
  <h2>Temperature: {{ temp }}°C | Humidity: {{ hum }}%</h2>
  <h3>OEE: {{ oee }}%</h3>
</body></html>
'''

@app.route('/')
def dash():
    # In real setup, fetch from Modbus and MQTT here
    return render_template_string(HTML, speed=120, temp=24.5, hum=55, oee=87)

if __name__ == '__main__':
    app.run(host='0.0.0.0', port=5000)
"""

# Write to Pi
sftp = ssh.open_sftp()
with sftp.open('/home/pi/dashboard.py', 'w') as f:
    f.write(dashboard_script)
sftp.close()

# Start Flask and Chromium
ssh.exec_command('python3 /home/pi/dashboard.py &')
ssh.exec_command('DISPLAY=:0 chromium-browser --kiosk http://localhost:5000 &')

ssh.close()

Step 3: Result

Within seconds, the monitor connected to the Raspberry Pi’s HDMI port displays a full-screen dashboard with live metrics. The AI has not only written the integration code but also deployed it and launched the kiosk. If the user wants to change the layout or add a new metric, they simply ask – the AI updates the script over SSH without ever touching the physical Pi.

Why This Matters

  • No coding required: The user describes the desired outcome, the AI generates all the code.
  • Instant deployment: The entire integration – from idea to functioning dashboard – takes under a minute.
  • Vendor-independent: The same SSH approach works with any HDMI device that runs Linux (Raspberry Pi OS, Ubuntu, etc.).

Connecting Any Device with execute_python

ASI Biont’s execute_python tool runs in a cloud sandbox with over 40 pre-installed libraries (paramiko, pyserial, paho-mqtt, pymodbus, aiohttp, etc.). It’s the universal adapter: you tell the agent what device to connect to and how (IP, port, API key), and the AI writes the Python script that handles the protocol. Whether it’s an OPC UA server, a CAN bus, or an ESP32 over MQTT – the process is identical. No waiting for a “device support update”.

Conclusion

Integrating an HDMI display with an AI agent is no longer a complex development project. ASI Biont’s SSH-based approach turns a Raspberry Pi into a smart, AI-managed digital signage solution in seconds. From factory dashboards to real-time weather monitors, the only limit is what you can describe in plain language. Try it yourself today at asibiont.com – create an account, start a chat, and say: “Connect to my Raspberry Pi over SSH and show me a live dashboard on HDMI.”

← All posts

Comments