An Accurate Acupuncture Feedback Platform
VR/AR PROJECT ·
An Accurate Acupuncture Feedback Platform
MAKING AN ACCURATE ACUPUNCTURE FEEDBACK PLATFORM
IN VIRTUAL TEACHING ENVIRONMENT
From Digital Design Studio, School of Simulation and Visualisation, the Glasgow School of Art
01. DELIVER THE KNOWLEDGE OF ACUPUNCTURE AND ANATOMY TO THE YOUNG GENERATION
02. AN ACCURATE NEEDLING FEEDBACK PLATFORM
PROJECT DEMO:
THE ACCURATE ACUPUNCTURE FEEDBACK PLATFORM IS BUILT ON UNITY 3D ENGINE BY THE COMBINATION OF HTC VIVE AND PHANTOM OMNI.
Project Demo - it also has a Chinese version for Chinese learners
GRAPHIC ILLUSTRATION:
USER - HTC VIVE + PHANTOM OMNI
Headset (HTC VIVE, 2015)
The virtual environment:
Acupuncture teaching and training room
3D anatomy models
Acupuncture needles
Virtual Reality Headset
Controller
(HTC Vive, 2015)
Virtual Reality interaction
.jpg)
Phantom Omni
(SensAble, 1994)
Haptic feedback -
build the acupuncture
feedback platform
Virtual Reality Controller
Left hand
Haptic Device
Right hand
AIMS:
DELIVER KNOWLEDGE; TRAINING METHOD
Deliver the rationale and knowledge of acupuncture to the young generation by the friendly image information.
Develop an efficient information feedback strategy in the form of concurrent and terminal feedback to support the training and learning of acupuncture.
THE PREVIOUS IMPORTANT RESEARCH:
SHOW THE DATA OF THE FORCE FEEDBACK; SHOW THE POSITION OF THE ACUPOINT IN THE VIRTUAL HUMAN BODY
THE PREVIOUS RESEARCH'S DEFICIENCY:
01. The introduction and instruction of virtual acupuncture operation are insufficient, and the user can not understand the function and operation method of the application.
02. The needling training can not combined with the anatomy, and there is a lack of 3D acupuncture anatomy display.
03. Only showing the real-time feedback of the force, it is impossible to judge whether the virtual acupuncture operation is correct.
THINK THREE PROBLEMS IN DESIGNING MY APPLICATION:
How to combine the virtual needling training with the knowledge of the anatomy?
How to deliver the knowledge of the acupuncture and the 3D anatomy to the young generation?
How to judge the correctness of the virtual needling training?
THE ANALYSIS OF DESIGNING MY APPLICATION:
DYNAMIC VISUALISATION OF THE KNOWLEDGE IN THE ACUPUNCTURE AND THE ANATOMY;
THE STANDARD AND ACCURATE NEEDLING FEEDBACK HAS FOUR PARTS:
POSITION OF ACUPOINT;
ANGLE OF NEEDLING;
FORCE OF NEEDLING
DEPTH OF ACUPOINT;
FLOWCHART OF THE DESIGN PROCESS:
REQUIREMENT DIAGRAM:
HAPTIC-ENABLED VIRTUAL REALITY ACUPUNCTURE TEACHING TRAINING PLATFORM
STORYBOARD:
RESULTS:
INTRODUCTION ANIMATION
01. The introduction animation of the periarthritis of shoulder
The user can understand the pathogeny, symptom, and treatment of the disease.
02. The introduction animation of the professional acupuncture term
The user can understand the common acupuncture term, and it is preparation before the acupuncture training.
RESULTS:
APPLICATION RESULTS
TESTING:
INTERVIEW AND QUESTIONAIRE
The testing situation
Question 01. How to calibrate the parameter of haptics?
Question 02. How to combine the knowledge of anatomy with the training of needling in real time?
Question 03. How to improve the simulation of the needling training?
FURTHER CONSIDERATION:
CALIBRATION;
COMBINE THE KNOWLEDGE OF 3D ANATOMY WITH THE TRAINING OF NEEDLING;
TESTING FOR STUDENTS MAJORING IN ACUPUNCTURE
01. CALIBRATION
The 6DoF of Phantom Omni
The needling feedback force across the skin, Unity 3D Engine
The needling feedback force across the muscle, Unity 3D Engine
Show the calibration of haptic properties, which adjusted by the acupuncturists in Unity 3D Engine
02. COMBINE THE KNOWLEDGE OF 3D ANATOMY WITH THE TRAINING OF NEEDLING
Beta 01. - Present
Present real-time feedback in the needling training -
position of acupoint; angle of needle; depth of acupoint; force of needling
Learn the knowledge of 3D anatomy
Beta 02. - Further Consideration
Z
X
Y
Combine the needling training with the 3D anatomy in real time
Z
X
Y
Position of acupoint
Angle of needle
Depth of acupoint
Force of needling
When the virtual needle touches the huamn body, the feedback of needling and the 3D anatomy will show the same time
03. NEXT STEP - TESTING FOR STUDENTS MAJORING IN ACUPUNCTURE
Group 01 students: use the application as the learning tool
Group 02 students: use the traditional learning tools
Explore the guiding effect of application on students majoring in acupuncture