Introduction
The NVIDIA Jetson family — Jetson Nano and Jetson Orin — has become the de facto standard for edge AI, offering up to 275 TOPS of performance in a compact form factor. These single-board computers can run real-time object detection (YOLOv8, SSD MobileNet), video analytics, and anomaly detection directly where the data is generated. However, turning a raw video feed into an actionable decision — like triggering an alarm, logging an event, or sending a report — typically requires stitching together Python scripts, MQTT brokers, and cloud APIs. This is where ASI Biont changes the game.
ASI Biont is an AI agent that connects to any device through natural language. Instead of writing integration code yourself, you describe your Jetson Nano or Orin setup in a chat, and the AI generates the Python code, executes it in its sandbox, and establishes the connection. The result: a fully functional computer vision pipeline that you can command, monitor, and modify through simple text messages. In this article, we’ll explore the actual connection mechanisms supported by ASI Biont, walk through a concrete use case (real-time object detection with YOLOv8 on Jetson Nano, feeding results into ASI Biont), and show you how to set it up in minutes.
Why Connect Jetson Nano / Orin to an AI Agent?
Jetson devices excel at running neural networks locally, but they lack built-in high-level decision logic. A typical workflow involves:
- Capturing frames from a USB camera or CSI camera.
- Running inference (e.g., YOLOv8) to detect objects.
- Storing results in a local file or sending them to a cloud service.
- Manually checking logs to decide if action is needed.
This multi-step process is slow and requires constant human supervision. By connecting Jetson to ASI Biont, you get:
- Real-time analysis: AI agent receives detection data and instantly decides what to do — send a Telegram alert, log to a database, or trigger an actuator.
- No-code automation: Any change in logic (e.g., “only alert if person is detected after midnight”) is done via chat, not by editing Python files on the device.
- Unified control: Multiple Jetson units (e.g., cameras at different factory gates) can be managed from one chat interface.
Connection Methods: How ASI Biont Talks to Jetson
ASI Biont does not have a single “Jetson plugin”. Instead, it connects to any device through its universal execute_python sandbox, which has access to over 100 libraries. For Jetson Nano / Orin, the most practical methods are:
| Method | Protocol | When to Use | Key Libraries |
|---|---|---|---|
| SSH | SSH (paramiko) | When Jetson runs a Linux OS (Ubuntu 20.04/22.04) and you need to execute scripts, start/stop services, or transfer files. | paramiko, scp |
| MQTT | MQTT (paho-mqtt) | When Jetson publishes detection results to a broker (Mosquitto, HiveMQ), and ASI Biont subscribes to analyze them. | paho-mqtt |
| HTTP API / WebSocket | HTTP REST (aiohttp) | When Jetson runs a web server (Flask, FastAPI) that exposes endpoints for inference results or camera control. | aiohttp, requests |
Which one to choose?
- If you already have a Python script on Jetson that does inference, SSH lets ASI Biont run that script remotely and collect its output.
- If you want a lightweight, asynchronous message flow, MQTT is ideal — the Jetson publishes detection results to a topic, and ASI Biont subscribes.
- If you prefer a request-response pattern (e.g., “take a photo now”), HTTP API works best.
Important: For COM port access (e.g., connecting Jetson to an Arduino via USB), you would use the Hardware Bridge (bridge.py) on a PC that is connected to ASI Biont via WebSocket. But for Jetson itself, COM port is rarely needed.
Concrete Use Case: Real-Time Object Detection with YOLOv8 + MQTT
Imagine you have a Jetson Nano with a USB camera monitoring a warehouse entrance. You want to:
- Detect people, vehicles, and packages.
- Send an alert to Telegram if an unauthorized person appears after hours.
- Log all detections to a PostgreSQL database.
Here’s how to set it up with ASI Biont, step by step.
Step 1: Run YOLOv8 inference on Jetson
On your Jetson Nano, install necessary packages:
sudo apt update
sudo apt install python3-pip
pip3 install ultralytics opencv-python paho-mqtt
Create a Python script detect_and_publish.py:
import cv2
from ultralytics import YOLO
import paho.mqtt.client as mqtt
import json
# Load YOLOv8 model (pre-trained on COCO)
model = YOLO('yolov8n.pt')
# MQTT broker settings (e.g., local Mosquitto or cloud HiveMQ)
broker = "192.168.1.100"
port = 1883
topic = "warehouse/detections"
client = mqtt.Client()
client.connect(broker, port, 60)
cap = cv2.VideoCapture(0) # USB camera
while True:
ret, frame = cap.read()
if not ret:
break
results = model(frame)
detections = []
for r in results:
for box in r.boxes:
cls = int(box.cls[0])
conf = float(box.conf[0])
label = model.names[cls]
detections.append({"label": label, "confidence": conf})
payload = json.dumps(detections)
client.publish(topic, payload)
print(f"Published: {payload}")
Run the script: python3 detect_and_publish.py
Step 2: Configure ASI Biont to subscribe to the MQTT topic
Now, open the ASI Biont chat and describe what you want:
"Connect to MQTT broker at 192.168.1.100:1883, subscribe to topic 'warehouse/detections', and for every message, if it contains a person with confidence > 0.8, send a Telegram alert to chat ID 123456789. Also log all detections to PostgreSQL at my-db.cool:5432, database 'warehouse', table 'detections'."
ASI Biont will write and execute a Python script in its sandbox (using execute_python). The script will:
- Use paho-mqtt to subscribe to the topic.
- Parse the JSON payload.
- Use requests to call the Telegram Bot API.
- Use psycopg2 to insert rows into PostgreSQL.
Here’s what the generated code looks like (simplified):
import paho.mqtt.client as mqtt
import json
import requests
import psycopg2
TELEGRAM_TOKEN = "your_token"
TELEGRAM_CHAT_ID = "123456789"
def on_message(client, userdata, msg):
detections = json.loads(msg.payload.decode())
for d in detections:
if d["label"] == "person" and d["confidence"] > 0.8:
text = f"ALERT: Person detected with confidence {d['confidence']:.2f}"
requests.post(f"https://api.telegram.org/bot{TELEGRAM_TOKEN}/sendMessage",
json={"chat_id": TELEGRAM_CHAT_ID, "text": text})
# Log to PostgreSQL
conn = psycopg2.connect("host=my-db.cool dbname=warehouse user=... password=...")
cur = conn.cursor()
for d in detections:
cur.execute("INSERT INTO detections (label, confidence, timestamp) VALUES (%s, %s, NOW())",
(d["label"], d["confidence"]))
conn.commit()
cur.close()
conn.close()
client = mqtt.Client()
client.on_message = on_message
client.connect("192.168.1.100", 1883, 60)
client.subscribe("warehouse/detections")
client.loop_forever()
Note: The sandbox has a 30-second timeout, so loop_forever() would be stopped. In practice, ASI Biont uses asynchronous patterns or spawns a long-running task via its internal infrastructure (the bridge). The user does not need to worry about this — the AI handles it.
Step 3: Control the pipeline from chat
Once the connection is established, you can interact with the AI agent:
- "What was the last detection?" — AI queries PostgreSQL and returns the latest row.
- "Send me a photo now" — AI can trigger an HTTP endpoint on Jetson (if you set up a small Flask server) to capture and return a frame.
- "Change alert threshold to 0.9" — AI updates the script parameters dynamically.
Alternative: SSH-Based Integration
If your Jetson does not have MQTT installed and you prefer direct command execution, use SSH. In the chat, say:
"SSH into my Jetson at 192.168.1.50, user 'nvidia', password 'nvidia'. Run the script /home/nvidia/detect.py and return the output."
ASI Biont will generate a paramiko script:
import paramiko
ssh = paramiko.SSHClient()
ssh.set_missing_host_key_policy(paramiko.AutoAddPolicy())
ssh.connect("192.168.1.50", username="nvidia", password="nvidia")
stdin, stdout, stderr = ssh.exec_command("python3 /home/nvidia/detect.py")
output = stdout.read().decode()
print(output)
ssh.close()
This runs inside execute_python and returns the output to the chat. You can then ask the AI to analyze the output (e.g., “count how many persons were detected”).
Why This Approach Is Revolutionary
Traditional integration of Jetson with cloud services requires:
1. Setting up an MQTT broker or REST API.
2. Writing Python glue code for data transformation.
3. Debugging connection issues.
4. Updating logic manually.
With ASI Biont, you don’t write a single line of integration code. You describe your device and requirements in plain English, and the AI generates, tests, and runs the code. All integration happens through the chat — no dashboard panels, no “add device” buttons. This reduces setup time from hours to minutes.
Comparison: ASI Biont vs. Traditional Edge AI Workflows
| Aspect | Traditional Approach | ASI Biont Approach |
|---|---|---|
| Setup time | 2-4 hours (write scripts, test MQTT, deploy) | 5-10 minutes (describe in chat) |
| Code maintenance | Manual edits, redeploy | AI updates scripts via chat |
| Multi-device management | Separate scripts per device | Unified chat interface |
| Learning curve | Requires Python, MQTT, SQL | Natural language only |
| Flexibility | Hard to add new data sources | AI writes new code on the fly |
Other Use Cases for Jetson + ASI Biont
-
Anomaly Detection on Production Line: Jetson Orin runs a custom ONNX model (trained on normal vs. defective products). Detections are sent via MQTT to ASI Biont, which logs defective counts and sends daily reports via email.
-
Smart Parking Lot: Jetson Nano processes video from four cameras, publishes occupancy data (free spots, car makes) to an MQTT topic. ASI Biont subscribes, builds a heatmap of occupancy, and triggers an SMS alert when the lot is full.
-
Wildlife Monitoring: Jetson Orin with an infrared camera detects animals at night. Detection data is sent via HTTP to ASI Biont, which classifies species (using a second AI model) and stores images in AWS S3.
-
Retail Analytics: Jetson Nano counts foot traffic and dwell time. Data is streamed via WebSocket to ASI Biont, which generates a weekly dashboard in Grafana (via PostgreSQL).
How to Get Started
- Get your Jetson Nano or Orin running Ubuntu 20.04/22.04 with JetPack SDK.
- Install the necessary software (YOLOv8, OpenCV, paho-mqtt or paramiko).
- Go to asibiont.com and create an account.
- Open the chat and describe your integration: e.g., “Connect to Jetson at 192.168.1.50 via SSH, run object detection on camera, and alert me via Telegram if a person is detected.”
- Let the AI do the rest. It will write the code, execute it, and start monitoring.
No need to wait for developers to add “Jetson support”. ASI Biont connects to any device through execute_python — you just describe what you need.
Conclusion
Integrating Jetson Nano or Orin with ASI Biont transforms a powerful edge computer into a fully autonomous AI agent that not only sees but also thinks and acts. Whether you use MQTT for streaming detections, SSH for remote script execution, or HTTP for direct command-response, the process is the same: you talk, the AI codes. This eliminates the traditional barrier of writing and maintaining integration scripts, making edge AI accessible to engineers, hobbyists, and enterprises alike.
Ready to give your Jetson a brain? Try the integration today at asibiont.com and experience the future of no-code device automation.
Comments