PORTFOLIO
ABOUT
CONTACT

Dance in Mirror

Introduction: People who just lost limbs are troubled by phantom lib pain and most disabled people cannot be dancers as common one. So this is to apply mirror therapy in and complete their dancing dream in VR world.

那些刚刚失去肢体的人们通常被幻肢痛所困扰,并且多数残疾人不能再成为一名舞者。 所以这个项目是常识在VR世界中应用镜像疗法并完成他们的舞蹈梦想。

Time: 2019.07- 2019.09

Type: Conceptual Design

Tool: Unity, Kinect

What Happend to Dancers after Getting Injured

“And I remember just getting in that car after the appointment and I just start howling. It was like a 45 minutes drive home and I just cried the whole time.”

“我记得在离开医院后刚进那辆车,我就开始嚎叫。开车回家需要 45 分钟,我一直在哭”

“It was like if I was getting suffocated. You know you are angry and you know why did I get injured and then you get jealous because some one`s taking the parts you work so hard to gain.”

“就像要窒息一样。 你知道你很生气,你知道为什么我会受伤,然后你会嫉妒,因为有人拿走了你努力工作获得的部分。”

“High-intensity training caused my knees to be injured. I didn't go to the doctor. I feel that any treatment of injuries takes a long break to recover, and long-term rest is fatal to the dancers.”

“高强度的训练导致我的膝盖受伤。我没有去看医生。 我觉得任何对伤病的治疗都需要长时间的休息才能恢复,长期的休息对舞者来说是致命的。”

What Prevent the Disabled from Dancing Freely

When first see somebody dancing gracefully, even the disables are appealed and long to be one of them.

当第一次看到有人优雅地跳舞时,即使是残疾人也会被吸引并渴望成为他们中的一员。

Shooting a video and sharing it on social network can be their first step to present in public. But no one give response because it is less beautiful then normal dancers` performance.

拍摄视频并在社交网络上分享可能是他们公开展示的第一步。 但没有人给出回应,因为它不如普通舞者的表演漂亮。

While there is value in the therapeutic use of the arts, people around reckon that people with disabilities are somehow incapable of creating art worthy of being seen by others.

虽然艺术的治疗用途是有价值的,但周围的人认为残疾人在某种程度上无法创造值得被他人看到的艺术。

Some disables have tried to take course and get professionally trained. But their specialty can bring problems to coach or they are afraid of delaying schedule.

一些残疾人试图参加课程并接受专业培训。但是他们的特长会给教练带来问题,或者他们害怕延误日程。

1. Human Body Detection

Motion Capture has enabled us record actions of humans and use that information to animate a digital character or analyse poses. Movie makers and game developers have embraced such technologies. 动作捕捉使我们能够记录人类的动作,并使用这些信息来制作数字角色的动画或分析姿势。 电影制作人和游戏开发已经接受了此类技术。 Today, a new system is making it possible to detect human body language directly from images. We now can Imagine a world where every camera is a real time body language detector and every video can be analysed.

今天,一种新系统使得直接从图像中检测人体语言成为可能。 我们现在可以想象一个世界,每个摄像头都是实时肢体语言检测器,每个视频都可以被分析。

2. Rehabiliation of Venus de Milo

Cosmo Wenman is an artist who wanted to recreate Venus de Milo as a spinner. Cosmo Wenman 是一位艺术家,他想修补断臂的维纳斯,复原成一位纺织的妇女。 In the 19th century, a sculptor might have tested the idea, spinning Venus with a plaster cast. In the 21st, we have a cheaper, simpler, more versatile option. 在 19 世纪,一位雕塑家可能已经测试过这个想法,用石膏模型旋转维纳斯。 在 21世纪,我们有更便宜、更简单、更通用的选择。 Consulting Baber`s sketch ancient images of spinning available online, and a YouTube tutorial on how to use a simple drop spindle, he worked with a digital anatomist to develop a 3-D rendering that preserved the statue’s existing pose intact. After a few iterations, the result was a convincing digital model.

参考 Baber 提供的古代纺织行为的草图,以及关于如何使用简单落轴的 YouTube 教程,他与数字解剖学家合作开发了 3D 渲染,以完整地保留雕像的现有姿势。 经过几次迭代,结果是一个令人信服的电子模型。

3. Phantom Limb Pain and Its Mirror Therapy

Phantom limb pain is a painful sensation that is perceived within a body part that no longer exists. 幻肢痛是一种在不再存在的身体部位内感知到的痛苦感觉。 More than 50% - 85% of phantom limb pain develops after amputation. It can develop immediately after an amputation procedure. One of the most effective treatments is mirror therapy. 超过 50% - 85% 的幻肢痛发生在截肢后。它可能会在截肢手术后很快产生。最有效的治疗方法之一是镜像疗法。

Under this therapy, a patient is allowed to feel the imaginary movement of the removed body part behaving as normal body movement through a mirror. The mirror image of the normal body part helps reorganize and integrate the mismatch between proprioception and visual feedback of the removed body. Thus, enhancing the treatment effect for phantom limb pain.

在这种疗法下,患者可以通过镜子感受到被切除的身体部位的假想运动,就像正常的身体运动一样。正常身体部位的镜像有助于重组和整合移除身体的本体感觉和视觉反馈之间的不匹配。 从而提高幻肢痛的治疗效果。

Design Concept

#1 Complementing the incomplete dancing posture The missing part is always a regret. This system can extend out the non-existent limb according to the detection and analysis of the user`s body. 缺少的部分总是一种遗憾。该系统可以根据对用户身体的检测和分析,伸展出不存在的肢体。
#2 Unifying people`s appearance with shadow The final image will be presented as shadow. Dancing is a kind of body language and people with defect in appearance or want to hide identity can be satisfied in this way. 最终图像将以人物剪影的方式呈现。 跳舞是一种肢体语言,外表有缺陷或想隐藏身份的人都可以通过这种方式得到满足。
#3 Publishing the dancing video on social network The system can record the whole process as a video, which is convenient for users to upload it on social network. This can help them better blend in mainstream society. 我的系统可以将整个过程记录为视频,方便用户上传到社交网络。这可以帮助他们更好地融入主流社会。
#4 Helping rebuild confidence of the disabled Some disabled feel hard to accept their difference in physical, especially for those with acquired disability. This system can help retrieve their feeling as a normal people. 一些残疾人很难接受他们在身体上的差异,尤其是那些后天残疾的人。我们的系统可以帮助他们重拾正常人的感觉。
#5 Ending the restriction in location and dressing The system mainly record the movement so the background and other details can be adjusted in setting part. The time spend in finding suitable stadium and costume can be saved if willing. 我们系统主要记录下身体的运动轨迹。在设置环节可以自主选择舞蹈背景,服装和其他细节,这样可以节省寻找合适的表演场所和服装的时间。

Technical Support and Device

Advantages:
Disadvantages:
- Fully immersive. - Can change view angle flexibly

- 完全沉浸

- 可以灵活调节视角

- Uncomfortable for long time wearing

- Hard to avoid vibrating of view angle that presents on screen.

- 长时间佩戴很不舒服

- 很难避免呈现在屏幕上视角的抖动

- Can help identify user`s action to virtual world. - Free user`s hands from handles. - 可以把用户的动作投影到虚拟世界 - 在操作过程中不需要拿着手柄

- The space need for movement is still too big.

- The appearance of any obstacle will greatly affect the accurate identification

- 需要很大的活动空间

- 任何障碍的出现都会影响到识别的准确性

- Convenient for altering settings - 方便调节设置

- The screen is not big enough to present all details

屏幕的大小不足以展示所有的细节

Concept Model

用户通过戴上VR眼镜沉浸在设计好的虚拟世界中,然后开始跳舞。kinect 可以识别用户的动作并将它们同步到计算机。 计算机将虚拟世界中的舞蹈和背景记录在一起,用户可以将其导入视频,便于在互联网上共享。

Function already relaized

-The movement of user can be synchronized to the character in virtual world.

-Decoration of the stage and the appearance of this character can be changed in softawer Unity. This time I choose the cyberpunk theme.

-The whole dancing process demonstrated on screen can be recorded and shared as video.

Function Remain Unfullfilled

-Hope that in the future, limb calculation technology can be realized so that the movement of the unexisted limb can be calculated out automatically.

-The video angle can be adjusted flexibly.