Robotic Control & Embodied Intelligence
A six-axis desktop robotic arm with multimodal perception, enabling master-slave teleoperation to precise 3D spatial grasping and embodied intelligence development.
For scenarios such as agricultural sorting, light-assembly loading/unloading, booth interactive demonstrations, and auxiliary workstations, traditional robotic arm instruction starts with mathematical kinematics and low-level motor drivers, resulting in long learning curves for application engineers. Large language models remain largely restricted to text generation without standardized pathways to physical actuators; building sorting and pick-and-place demos from scratch requires co-debugging visual recognition, motion planning, and gripping sequences across disparate systems; novices operating motorized robotic arms also face physical collision hazards and workspace intrusion risks.
- Difficulty
- Beginner
- Duration
- L1 1 day / L2 2–3 days / L3 3–5 days
- Shortest Format
- 1 day (Taster Session · L1)
- Teaching Format
- 3 tiers: Taster / Workshop / Bootcamp
- Core Actuator
- reBot DevArm B601-RS Six-Axis Robotic Arm
- Core Toolchain
- SenseCraft Robotics / Pinocchio / Motorbridge SDK / LeRobot
- Track
- Build AI Products
- Who This Course Is For
- Solution consultants and business sales · Curriculum development teams and hands-on instructors · Robotics and automation engineering technicians · Partner institution and government/enterprise training students
- Prerequisites
- L1: none (zero baseline, basic computer operation skills). L2: basic network configuration and system linkage concepts. L3: basic Python programming and Linux skills.
Typical Scenarios
- Agricultural and industrial part appearance sorting: classified grasping of qualified, defective, and suspected items
- Lightweight automated production-line assistance: material transfer, workpiece pushing, sequential stacking
- Exhibition booths and teaching demos: voice/vision interactive welcome, trajectory display
- Auxiliary operations and automated workstations: scheduled fixed-point inspection imaging, lightweight collaborative grasping
- Research and Training: Embodied Intelligence Algorithm Verification, Robotic Kinematics Teaching Experiments
Three depths and where each one gets you
- L1 Demo Level 1 day
Selection Awareness, Safety Standards, and Out-of-Box Setup
Teleoperate Six-Axis Robotic Arm, Real-Time Sync Multi-DOF Motions
- Understand industrial manipulator categories (Cartesian, SCARA, Delta, 6-axis articulated) and trade-offs among speed, accuracy, payload, safety, and unit cost
- Master robotic-arm physical workspace boundaries, hardware emergency stop usage, and safety operation procedures
- Master out-of-the-box connectivity on SenseCraft, completing master-slave teleoperation and voice-command pick-and-place
- L2 Consultant Level 3 days
Scenario Analysis, Spatial Intuition, and Multimodal Orchestration
Sequence multi-step motions and trigger grasps from vision events
- Clearly articulate to clients why 3D spatial tasks require 6-axis arms and define commercial selection boundaries
- Master SenseCraft multi-action workflow sequencing and the "Generate → 3D Preview → Human Confirm → Physical Execute" safety gate
- Master workstation vision-based event triggers and mini-workcell assembly, achieving 3 consecutive stable cycles
- L3 Design Level 5 days
End-to-End 3D Spatial Grasping and Embodied AI Outlook
Get 3D coordinates from a depth camera and drive the real arm from Python
- Acquire target 3D world coordinates with an RGB-D depth camera, compute joint angles via Pinocchio in Python, and drive hardware pick-and-place with error recovery using Motorbridge
- Master master-slave teleoperation demonstration dataset recording (LeRobot format) and grasp core principles of VLA embodied foundation models and Isaac Sim simulation
- Deliver turnkey Python pick-and-place source code, teleoperation datasets, and architecture design documentation
What learners can do afterwards
- Robotic-arm selection and commercial trade-off judgment
- Hardware emergency stop and workspace safety standard operation
- Master-slave arm teleoperation and voice command control
- Multi-action flow orchestration and safety-confirmation mechanism configuration
- Workstation vision event triggering and micro-scenario integration testing
- RGB-D depth camera 3D localization and hand-eye calibration
- Pinocchio inverse kinematics solving and exception handling
- Motorbridge driver hardware spatial pick-and-place workflow
- Teleoperation motion dataset collection (LeRobot format)
- VLA embodied foundation models and Isaac Sim digital twin exploration
Hardware and toolchain
This course centers on "six-axis desktop robotic arm + multimodal perception + edge compute" as core teaching hardware, covering the full pipeline from teleoperation to 3D grasping.
- ARM reBot DevArm B601-RS Six-axis slave actuator arm · includes electric gripper and bus servos
- MASTER Star Arm 102 Master teach arm · 1:1 master-slave teleoperation · LeRobot-compatible
- EDGE reComputer Super J4012 Jetson Orin NX 16GB · control hub and inference host
- DEPTH Orbbec Gemini 2 RGB-D depth camera · 3D spatial coordinate positioning
- ESTOP Industrial-Grade Independent Emergency Stop Button Normally-closed hardware circuit · hard-cuts power · not connected to software
Illustrated list of 6 devices
-
reBot DevArm B601-RS Robotic Arm (100019336)
6+1 DOF open-source slave robotic arm assembly, includes electric gripper and bus servos
Follower arm executing movements and grasping; powered by an independent regulated 48V/600W industrial power supply, requiring physical clamping to the bench with 6-inch G-clamps to prevent tipping.
-
Star Arm 102 Master Teach Arm (100004723)
6-DOF modular master teach arm, LeRobot-compatible
Master teaching arm for manual teleoperation and real-time 1:1 pose mirroring to the follower arm; powered independently by a 12V/2A multi-plug adapter, equipped with XT30 male cable.
-
reComputer Super J4012（114110314）
Jetson Orin NX 16GB edge compute host
Control hub, running robotic-arm kinematics solving, control services, and LLM inference; factory-preinstalled JetPack 6.2, verify SenseCraft Robotics service and Python (Pinocchio / Motorbridge SDK) runtime environment are ready; powered by 19V/4.7A high-power adapter.
-
Orbbec Gemini 2 3D Camera (101090144)
Dual infrared 3D depth camera, Type-C interface
Spatial 3D vision guidance, directly reads the 3D physical coordinates (X, Y, Z) of objects in space to achieve spatial closed-loop grasping; at L3, hand-eye calibration alignment with the robotic-arm base coordinate frame is required to ensure measured coordinates can be correctly converted to joint angles by Pinocchio.
-
ET-S231 Wide-Angle 1080P USB Camera (100035502)
Workstation image capture terminal
Used for robotic-arm workstation material arrival detection, process event triggering, and embodied data-collection vision input; paired with a dual-camera mount for front/top multi-angle capture, providing state-trigger signals in a structured constant-lighting environment.
-
Industrial-Grade Independent Emergency Stop Button (100091373)
Large mushroom-head emergency stop switch with normally-closed mechanical contacts
Safety gate, wired in series with the power circuit; pressing it immediately hard-cuts power; an independent hardware normally-closed circuit not connected to software control, placed within easy reach of the operator.
Additionally configured with dual-camera mount (100006505), robotic-arm data collection light-control box (100094392), reSpeaker Flex voice kit (100005504 / 100099135), screen, integrated power design, router, and other common accessories.
From No-Code Teleoperation to Deterministic Engineering Grasping
SenseCraft Robotics delivers out-of-the-box teleoperation demos, Python + Pinocchio + Motorbridge enables real-machine spatial grasping, and LeRobot with Isaac Sim covers embodied intelligence and simulation validation.
-
SenseCraft Robotics + Master Arm
Zero-code action orchestration · master-slave 1:1 mirror teleoperation · voice command triggering
- Out-of-box connection
- Master-slave teleoperation / voice commands
- Multi-action flow orchestration and safety confirmation
-
Python + Pinocchio + Motorbridge SDK
Inverse kinematics solving · real-machine spatial grasping closed loop · exception handling and safe retraction
- Depth camera 3D positioning
- Pinocchio inverse kinematics solving
- Motorbridge-driven real-machine grasping
-
LeRobot + VLA + Isaac Sim
Action dataset standard · embodied LLM · digital twin simulation
- Teleoperation action data collection
- VLA model principle understanding
- Isaac Sim simulation verification
Key turning point · from zero-code teleoperation demo to deterministic engineering grasping SenseCraft lowers the barrier to entry, letting students test teleoperation and voice-command gripping on day one; combining Python, Pinocchio, and Motorbridge equips the system with deterministic 3D spatial grasping capabilities, turning stage demos into deliverable engineering projects.
Additionally requires HTTP / MQTT message notifications (workstation vision event triggering and cross-system integration) and reSpeaker Flex voice kit (natural-language command capture and announcement).
Syllabus and formats
15 teaching units in total. The delivery formats come first; the full syllabus expands below.
Taster Session
No final project1 day · 6–8h · L1 presentation layer · focusing on selection awareness, safety standards, and SenseCraft out-of-box teleoperation
Hands-On Course
Includes final project2–3 days · 14–20h · L1+L2 · scenario analysis + action orchestration + workstation vision event-triggered integration
Delivery Course
Includes final project3–5 days · 24–35h · L1+L2+L3 · full coverage including deterministic 3D spatial grasping closed loop and cutting-edge embodied intelligence exploration
The robotic arm is a powered mechanism; during hands-on operation, safety procedures must be strictly followed, and body parts must not enter the robotic arm motion envelope. The emergency stop button is an independent hardware normally-closed circuit, not connected to software control, placed within easy reach of the operator.
The reBot DevArm B601-RS is powered by a 48V/600W industrial-grade switching power supply and must be physically secured to the lab bench with a 6-inch G-clamp to prevent tipping during motion. Before power-on, the instructor must confirm wiring and fixation status.
Control scenarios are strictly prohibited from extending to high-voltage strong-current and safety braking systems. This course does not provide ISO 10218/TS 15066 industrial robot safety certification endorsement and does not replace statutory industrial safety certification.
The taster session does not include workstation vision integration or 3D spatial grasping development content. Do not promise clients that taster session students can independently complete spatial grasping — that is the bootcamp delivery standard.
One of the lessons · 01
Pre-class Preparation and Environment Pre-check
Hardware bench inventory, robotic-arm physical fixation and power-on self-test, safety isolation zone setup, control hub and network pre-configuration, vision capture kit and light-control box readiness
—
Show the full syllabus of 15 units and the schedule for each format
| Module / Output | Taster1 day | Workshop2–3 days | Bootcamp3–5 days | ||
|---|---|---|---|---|---|
| 01 | Pre-class Preparation and Environment Pre-checkHardware bench inventory, robotic-arm physical fixation and power-on self-test, safety isolation zone setup, control hub and network pre-configuration, vision capture kit and light-control box readiness | — | Full | Full | Full |
| 02 | Robotic-Arm Selection and Commercial Trade-offsCommon configurations (Cartesian/SCARA/Delta/six-axis), speed/precision/load/safety/cost trade-offs, six-axis general-purpose preferred logic | — | Full | Full | Full |
| 03 | Hands-On Safety First Lesson and Emergency Stop DrillWorkspace boundary delineation, hardware emergency stop physical power-cut principle and drill, collision prevention and slow-speed operation, power on/off and safe reset procedures | Hardware emergency stop button | Full | Full | Full |
| 04 | SenseCraft Out-of-Box Setup and Master-Slave TeleoperationB601 joint structure and interface familiarization, browser access to SenseCraft console, device connection and basic jogging, master-slave arm 1:1 mirror teleoperation and trajectory recording | SenseCraft Robotics / Star Arm 102 | Full | Full | Full |
| 05 | Voice Command Control and First Grasp VerificationreSpeaker microphone array integration, natural-language triggering of preset grasping actions, milestone deliverable: one successful grasp triggered by voice command | reSpeaker Flex / SenseCraft | Full | Full | Full |
| 06 | Deployment Scenarios and Cycle Time CalculationRobotic-arm applicable scenarios (lightweight sorting/loading-unloading/booth interaction/fixed-point inspection), non-applicable boundaries (>1 piece/sec high-speed mass production/overload), process cycle time and throughput estimation | — | None | Full | Full |
| 07 | 3D Spatial Intuition and the Necessity of Six AxesCylinder/conveyor 2D planar limitations vs robotic-arm 3D space (X,Y,Z) + rotational pose, 3D interface understanding of reach limits and singularity dead zones | SenseCraft 3D Preview | None | Full | Full |
| 08 | Action Orchestration and Safety Confirmation MechanismMulti-waypoint serial operation flow (Move → Open Gripper → Descend → Close Gripper → Lift → Place), "Generate → 3D Preview → Human Confirm → Real-Machine Execute" confirmation gate | SenseCraft Robotics | None | Full | Full |
| 09 | Workstation Vision Data Collection and Event IntegrationLight-control box constant-lighting structured environment, ET-S231 camera workstation image capture, material arrival detection as event trigger, integrated grasping flow, group micro-scenario setup (3 consecutive stable runs) | ET-S231 / Light-Control Box / SenseCraft | None | Full | Full |
| 10 | Depth Camera 3D Positioning and Hand-Eye CalibrationMonocular vs depth camera, RGB-D reading of object 3D physical coordinates (X,Y,Z), hand-eye calibration from camera coordinate frame to robotic-arm base coordinate frame | Orbbec Gemini 2 / Python | None | None | Full |
| 11 | Pinocchio inverse kinematics solving and exception handlingPython calling Pinocchio library, automatic calculation of 6 joint angles from target coordinates, out-of-workspace/solve-failure exception alerting and safe retraction | Python / Pinocchio | None | None | Full |
| 12 | Motorbridge Real-Machine Driving and End-to-End Grasping Closed LoopPython calling Motorbridge SDK to drive smooth motion and gripper control, integrating the full pipeline: depth camera detection → Pinocchio inverse kinematics → Motorbridge-driven grasping | Python / Motorbridge SDK | None | None | Full |
| 13 | Teleoperation Action Dataset Collection (LeRobot)Embodied LLM data collection logic, light-control box + dual-camera front/top view capture, master-slave teleoperation recording of joint angles and vision frames, LeRobot standard format dataset | Star Arm 102 / LeRobot / Dual-Camera Mount | None | None | Partial |
| 14 | VLA Embodied LLM and Isaac Sim Simulation IntroductionVLA model input text + image output action architecture understanding, Isaac Sim loading robotic-arm 3D assets, virtual physics collision and simulation control, "simulate first, then real machine" development approach | VLA / Isaac Sim | None | None | Partial |
| 15 | Solution Review and Delivery SummaryGroup solution rehearsal and configuration review, exception and failure case retrospective, demo-line vs industrial production-line engineering gap summary (repeatability accuracy/continuous operation reliability/industrial cycle time/safety certification), source code documentation and configuration archiving | — | Partial | Full | Full |
● Full◐ Partial— None●＋ Extended
The taster session focuses on L1 selection awareness, safety standards, and SenseCraft out-of-box teleoperation, excluding vision integration and 3D grasping development; the workshop covers full L1+L2 scenario analysis, action orchestration, and workstation vision event triggering; the bootcamp fully covers L1+L2+L3, including deterministic 3D spatial grasping closed loop and cutting-edge embodied intelligence exploration.
Taster Session
- Day 1 MorningModules 01 + 02 + 03
Environment pre-check → Robotic-arm selection and commercial trade-offs → Hands-on safety first lesson and emergency stop drill
- Day 1 AfternoonModules 04 + 05 + 15 (abbreviated)
SenseCraft out-of-box setup and master-slave teleoperation → Voice command grasping first verification → Summary review
Does not include workstation vision integration or 3D spatial grasping development.
Hands-On Course
- Day 1Modules 01–05
Environment pre-check → Selection awareness → Safety emergency stop → SenseCraft teleoperation → Voice grasping first verification
- Day 2Modules 06–09
Deployment scenarios and cycle time calculation → 3D spatial intuition → Action orchestration and safety confirmation → Workstation vision event integration
- Day 3 (optional)Module 15
Solution Review and Delivery Summary
The workshop delivers one micro-scenario operation system triggered by workstation vision (3 consecutive stable runs). Student prerequisite: basic network configuration and system integration concepts.
Delivery Course
- Day 1–2Modules 01–09
Full L1+L2 content (selection safety + teleoperation voice + scenario orchestration + vision integration)
- Day 3Modules 10–12
Depth camera 3D positioning and hand-eye calibration → Pinocchio inverse kinematics solving → Motorbridge end-to-end grasping closed loop
- Day 4Modules 13–14
LeRobot teleoperation action dataset collection → VLA embodied LLM and Isaac Sim simulation introduction
- Day 5Module 15
Solution Review and Delivery Archiving
The bootcamp goal is the ability to independently deliver deterministic 3D spatial grasping engineering. Student prerequisite: basic Python programming and Linux skills, familiarity with L1–L2 competencies.
The taster course takes one day, needs no coding, and stops at "the arm moves and voice controls it". It suits trade shows, open days and first meetings with a client.
Workshop Day 3 is an optional flexible day: if students have a strong foundation, it can be compressed to 2 days (Day 2 afternoon merged with review); if more micro-scenario integration time is needed, use the full 3 days.
What You Take Away
The following are full-version (bootcamp) deliverables; the workshop delivers the first 3 items; the taster session delivers abbreviated versions of items 1 and 2.
- 01
Robotic-arm workspace layout and safety operation records
Includes physical isolation zone delineation diagram, emergency stop normally-closed circuit wiring confirmation, G-clamp fixation inspection records, and power on/off and safe reset procedure execution records.
- 02
SenseCraft action workflow configuration and workstation vision-triggered demo system
Includes multi-action flow orchestration configuration, "Generate → 3D Preview → Human Confirm → Real-Machine Execute" safety-confirmation mechanism setup, workstation vision event-triggered integration flow, and micro-scenario system 3 consecutive run verification records.
- 03
3D Spatial Auto-Grasping Python Project Source Code
Includes depth camera 3D coordinate reading module, Pinocchio inverse kinematics solving and exception handling, Motorbridge SDK real-machine driving and gripper control, and end-to-end grasping closed loop main program (L3).
- 04
Teleoperation action dataset samples and solution design delivery document
Includes LeRobot standard format action dataset (joint angles + dual-camera vision frames), hand-eye calibration parameter records, solution design description, and delivery acceptance records (L3).
- 05
Robotic-Arm Selection and Scenario Cycle Time Assessment Report
Includes target scenario configuration matching analysis, speed/precision/load/safety/cost selection trade-offs, process cycle time and throughput estimation, and applicable/non-applicable boundary determination.
- 06
Hardware Bench Inventory and Deployment Operations Guide
Includes 19-item equipment procurement bill of materials, bench wiring topology, environment setup procedures for SenseCraft/Pinocchio/Motorbridge, and daily inspection/storage protocols.
Open-source projects you can reproduce
These projects use the same hardware and methods as the course, and what we learn in class is fed back into them.
Voice-controlled grasping arm
Say "Hey Jarvis, grab the water bottle" and a reBot B601-DM arm finds the object with an RGB-D wrist camera and picks it up in about 11 seconds. It grasps boxes, bottles, bananas, cups and oranges, with the whole voice stack running locally on a Jetson Orin NX.
Voice-controlled SO-ARM arm
Control a SO-ARM101 6-DoF arm with natural-language commands; speech recognition, synthesis and the LLM all run locally on a Jetson Orin NX. An HTTP endpoint exposes live joint state.
Translate vision guidance and kinematics into reliable robotic grasping
M6 centers on the coordination among visual guidance, kinematic algorithms, and robotic manipulators. The curriculum starts with zero-code master-slave teleoperation, progresses through Python inverse kinematics programming to embodied AI dataset curation, and provides instructors with comprehensive safety protocols and reference engineering code.
Extension 01
Adapt to your site conditions
Unit 09 accommodates custom manipulation tasks. Sorting targets can be replaced with electronic components, produce models, or irregular parts, prompting students to tailor grasp strategies to diverse materials and poses.
Extension 02
Connect your own instruments
The robotic workcell can easily link with upstream photoelectric sensors or M4 object detection events, triggering pick-and-place routines autonomously based on external signals.
Extension 03
Integrate Teaching Experience
Strict instructional oversight on emergency stop circuit wiring, zero-point calibration offset correction, and motor overload protection forms the indispensable baseline for safe real-hardware labs.
Scope Boundaries & Compliance
Low-speed supervised control + independent hardware emergency stop, not a replacement for safety-critical systems.
In Scope
- Lightweight sorting demos, booth interaction, teaching and training, and low-speed supervised control scenarios
- Agricultural and industrial part appearance classification grasping, material transfer, and sequential stacking
- Voice/vision interactive welcome, trajectory display, and fixed-point inspection imaging
- Deterministic 3D spatial grasping engineering development based on RGB-D depth cameras
- Embodied intelligence algorithm verification, LeRobot standard action dataset collection, and research training
Out of Scope
- Control scenarios are strictly prohibited from extending to high-voltage strong-current and safety braking systems.
- Does not provide ISO 10218/TS 15066 industrial robot safety certification endorsement; this course does not replace statutory industrial safety certification.
- The emergency stop is an independent hardware normally-closed circuit, not connected to software control; replacing the hardware emergency stop with software commands is strictly prohibited.
- Does not cover high-speed industrial cycle times (>1 piece/sec), high-precision force-controlled assembly, or 7×24 unattended harsh operating conditions
- Does not include micron-level precision assembly (e.g., precision pin-hole insertion) or complex flexible irregular material grasping
- Does not promise specific grasping success rates for particular scenarios (affected by lighting conditions, object material reflectivity, and placement pose; acceptance criteria are based on on-site measured records)
- The robotic arm contains precision reducers; during transition and storage, a custom shock-absorbing case must be used to fix the pose, avoiding transport impact damage to joint gears
Put M6 on your timetable
Budgets are based on participant count and hardware requirements. Email us your expected group size and target depth to receive a detailed syllabus and kit plan within 3 business days.