RHINO AI
An LLM-Based 3D Modeling Assistant for Procedural Instructions and Demonstrations
MY ROLE
UI/UX Designer, Machine Learning Engineer
COLLABORATORS
LLM, AI Assistant, Modeling Tool, Hand Gesture, 3D Generation
Viola Tan, Melo Chen
TAGS
DESCIPRTION
RhinoAI provides detailed step-by-step guidance, generating procedurally modeled sample results through LLM-generated executable scripts, utilizing a multi-agent architecture for image analysis, task decomposition, and script generation.
PROJECT OBJECTIVES
> How can human inputs be translated to machine commands, aligning human and machine representations?
> How can LLM be integrated in Rhino and assist 3D modeling beginners through instructions and demonstrations?

USER RESEARCH
Through experiments and user evaluations, we assess the system's effectiveness in teaching beginners, automating complex tasks, and providing robust error-handling mechanisms. The insights gained from this research also have implications for enhancing AI-guided workflows in other technical domains.
PRIMARY CHALLENGES
-
Hard to find the correct command
-
Interface navigation
-
how to describe the current problems
-
Helpers does not access to your project
-
Hard to find specific tutorial
TARGET AUDIENCE

.png)
3D LEARNING ENHANCEMENT METHODS
.png)
COMPONENTS




_edited.jpg)
TEACHABLE AI ASSISTANT FRAMEWORK:
2.png)
USER FLOW
The system’s user flow ensures an intuitive experience, enabling users to interact effectively with Rhino AI to create 3D models. The integration of UI elements establishes a structured process for gathering inputs, analyzing data, navigating step-by-step instructions, and producing actionable outputs.
.png)
SAMPLE RECORD
FINAL OUTPUT MODEL
_edited.png)

_edited.jpg)
TEACHABLE AI ASSISTANT FRAMEWORK:
2.png)
HAND TRACKING PACKAGE
Intuitive way of scaling objects (similar to squeezing and stretching real objects) as an add-on for users
RECORD SAMPLE
A sample record of 3D modeling beginner guided by Rhino AI for building a Christmas Tree
REFERENCED IMG TO RESULTS
.png)
