Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Overview

The Embodied Artificial Intelligence (Embodied AI) Labs are a core experiential component of the CSE 494/598 Topic: Intelligent and Safe Cyber-Physical Systems (ISCPS) course at Arizona State University.

Students design, implement, and evaluate intelligent agents that interact with the physical world, with a strong emphasis on:

  • safety and robustness,
  • timing and physical consequences,
  • authentication and authorization,
  • coordination under communication failures,
  • interpretability of decisions,
  • and principled reasoning in environments where cyber-physical systems operate.

Lab sequence

The four labs progress from language-based reasoning to visual decision-making, action authorization, and coordination among multiple embodied agents:

LabAgentSystem and safety focus
A: Agentic Driving CoachLLM agentLogical time, inference deadlines, deterministic fallback, and stopping outcomes
B: Embodied Agent AuthenticationVLM agentSensor impersonation, authenticated inputs, and independent post-run evaluation
C: Safe Agent ActuationVLA agent (recorded)Recorded pi0-FAST response inspection, synthetic ALOHA fixtures, and SST-backed EXECUTE/HOLD enforcement
D: Safe Multi-Embodied AgentsMultiple vehicle agentsIntersection reservations, delayed or lost messages, and the tradeoff between exclusion and progress

Each project combines a concrete embodied-agent system with reproducible experiments. Students connect model behavior and computer-system mechanisms to observable outcomes rather than evaluating the AI model in isolation.

Start a lab

Open the page for your assigned project, then follow the repository’s README.md for setup and ASSIGNMENT.md for graded tasks and deliverables. The public repositories are course templates; students complete their work in private group repositories created from those templates.

Labs A and B use live models, with ASU Sol as the primary platform. Lab C’s graded experiments use CPU compute, a committed model capture, and synthetic fixtures. Lab D runs entirely on a CPU using native Ubuntu, native macOS, or Sol; it requires no model download or GPU. See Lab Format & Logistics for the shared workflow and each repository for its specific setup.


Copyright © Hokeun Kim 2026–2026