top of page
  • Instagram
  • LinkedIn
logo-grayscale-inverted_edited_edited.jpg

RHINO AI

An LLM-Based 3D Modeling Assistant for Procedural Instructions and Demonstrations

MY ROLE

UI/UX Designer, Machine Learning Engineer

COLLABORATORS

LLM, AI Assistant, Modeling Tool, Hand Gesture, 3D Generation

Viola Tan, Melo Chen

TAGS

DESCIPRTION

RhinoAI provides detailed step-by-step guidance, generating procedurally modeled sample results through LLM-generated executable scripts, utilizing a multi-agent architecture for image analysis, task decomposition, and script generation.

PROJECT OBJECTIVES

> How can human inputs be translated to machine commands, aligning human and machine representations?

> How can LLM be integrated in Rhino and assist 3D modeling beginners through instructions and demonstrations?

RhinoAIHeroDiagram5.png

USER RESEARCH

Through experiments and user evaluations, we assess the system's effectiveness in teaching beginners, automating complex tasks, and providing robust error-handling mechanisms. The insights gained from this research also have implications for enhancing AI-guided workflows in other technical domains.

PRIMARY CHALLENGES

  • Hard to find the correct command

  • Interface navigation

  • how to describe the current problems

  • Helpers does not access to your project

  • Hard to find specific tutorial

TARGET AUDIENCE

Xnip2025-01-20_10-24-56.png
unnamed (1).png

3D LEARNING ENHANCEMENT METHODS

unnamed (2).png

COMPONENTS

Xnip2025-01-20_11-07-33.jpg
Xnip2025-01-20_11-07-33.jpg
Xnip2025-01-20_11-07-33.jpg
Xnip2025-01-20_11-43-07.png
unnamed (13)_edited.jpg

TEACHABLE AI ASSISTANT FRAMEWORK:

unnamed (8)2.png

USER FLOW

The system’s user flow ensures an intuitive experience, enabling users to interact effectively with Rhino AI to create 3D models. The integration of UI elements establishes a structured process for gathering inputs, analyzing data, navigating step-by-step instructions, and producing actionable outputs. 

unnamed (14).png

SAMPLE RECORD

FINAL OUTPUT MODEL

unnamed (3)_edited.png
Xnip2025-01-20_11-43-07.png
unnamed (13)_edited.jpg

TEACHABLE AI ASSISTANT FRAMEWORK:

unnamed (6)2.png

HAND TRACKING PACKAGE

Intuitive way of scaling objects (similar to squeezing and stretching real objects) as an add-on for users

RECORD SAMPLE

A sample record of 3D modeling beginner guided by Rhino AI for building a Christmas Tree

REFERENCED IMG TO RESULTS

unnamed (5).png
Xnip2025-01-14_14-29-54.jpg

OTHER PROJECTS

bottom of page