Physical AI Infrastructure
Physical AI Infrastructure covers the complete workflow from demonstration capture to model deployment: record real robot operations, organize them into trainable datasets, train a model, and deploy it for inference so the robot can learn and execute tasks from demonstrations.
Supported Platform
- The Linux x86 version supports the complete Physical AI Infrastructure module.
- The Windows version supports Data Collection, Dataset Management, and Model Training.
Workflow
- Data Collection: manage collection tasks, configure devices, and record real-time operations to generate training data segments.
- Dataset Management: organize collected data, preview segments, assess quality, run cloud conversion, and publish to Hugging Face.
- Model Training: select converted data artifacts, configure the model and training specification, and track training results.
- Inference Deployment: load a trained model, configure cameras and robotic arms, and run online inference tasks.
Usage Tips
- Keep camera roles and robotic arm configuration consistent across data collection, model training, and inference deployment to reduce input differences between stages.
- Before starting data collection, confirm that robot serial ports, camera feeds, and the storage directory are all configured.
- Before training, preview segments in dataset management and delete records with missing images, interrupted motion, or poor quality.
- Model training uses cloud resources and account points. For offline or local validation, you can first deploy inference with a downloaded model.