The Sound of Sinking

The Sound of Sinking

MR Multiplayer Immersive Performance

Overview

Category

MR Experience

Development

Year

2025

Showcase

2025 Taipei Fine Arts Museum

The Sound of Sinking

"The Sound of Sinking" is artist Chia-Wei Hsu's interdisciplinary work that brings together underwater archaeology, underwater acoustics, and virtual reality. The work is anchored by shipwrecks in the waters surrounding Penghu—the warship "Guangbing/Kohei" from the First Sino-Japanese War and the vessels "Yamafuji Maru" and "Mansei Maru" from World War II. Developed in partnership with the Research Center for Underwater Archaeology and Heritage at National Tsing Hua University, the project captures the archaeological team's fieldwork at the "Yamafuji Maru" site. Using sonar and underwater recording technologies alongside performers who dive to play specially designed sound instruments, the work orchestrates an acoustic dialogue with these submerged vessels.

The exhibition places participants within a networked, multi-user mixed reality environment featuring interwoven visual and sonic performances. These include improvisational renderings of Penghu maritime ballads (thó-hái-kua), environmental soundscapes captured at wreck sites, sonar transmissions reimagined from Qing dynasty naval music, live mixing on the ocean surface, underwater instrumental performances, and digital recreations of wartime military music. The experience transitions between multi-channel video installation, live sound performance, and sculptural presentation, charting a conceptual journey from south to north that unfolds across both physical and virtual realms.

Through a multi-user MR (Mixed Reality) experience that combines VR virtual environments with AR augmentation, participants embark on an immersive adventure where reality and fiction intertwine. They will take on the roles of five virtual characters—a Qing Dynasty naval officer, a WWII Japanese military officer, two early-era divers, and the legendary Qing-era creature known as the “Sea Monk.”

Credits

Commissioned by Chia-Wei Hsu Production

Produced by NAXS STUDIO


Production Team
Directed by: Chia-Wei Hsu
Music Supervisor: Tak-Cheung Hui
Underwater Archaeology Consultant: Ellen Hsieh

Actor / Actress (In order of appearance)
Penghu Traditional Folk Song (Po-kua) Singer: Cheng-Ren Yeh
Underwater Performers: Ken Lee, Tiffany Hsueh, Cheng-Feng Wu

Underwater Archaeological Collaborator:
Research Center for Underwater Archaeology and Heritage, National Tsing Hua University
Director: Cheng-Hwa Tsang
Deputy Director: Ellen Hsieh
Crew Involved: Han-Zhang Huang (crew leader), Chih-Yuan Hsieh, Chun-Cheng Chang, Chao-Hsin Hsueh, Jiann-Jer Shyu
Research Assistant: Tan Li Hong

Underwater Acoustics Collaborator:
Institute of Undersea Technology, National Sun Yat-sen University
Distinguished Professor & Director: Linus Y.S. Chiu
Research Assistant: Chang-Chieh Huang
EchoingOcean
General Manager: Andrea Y.Y. Chang

Executive Producer: You-I Liu
Line Producer: Leah Lee
Project Manager: Rachel Huang
Research Assistant: Chi-Ting Huang
Pre-production Motion Capture Administrative Support: Shang-Jung Huang

Underwater Filmmaking: Taiwan Underwater Production
Underwater Cinematography: Hsu-Hu Yuan
Camera Assistant: Oscar Chien, You-Cheng Chang, BEY JUN JIE
Free Diving Safety Instructor: Che-Hao Chung
Scuba Safety Instructor: Ken Lee
Underwater Performers: Ken Lee, Tiffany Hsueh, Cheng-Feng Wu
Makeup Artist: Selina Wei

Cameraman: Neng-Chen Chang, You-Ren Lu, Min-Kang Tsai
Aerial Cameraman: Chun-Ting Chen, Chen-Kun Zheng
Captain: Ming-Hung Cheng, Chun-Kai Tsai, Yun-Wen Chang, Rui-Lung Chiu
Crew Members: Wei-Jie Chen, Ya-Yu Chuang, Kuan-Hong Lu
Dive Guides: Chia-Zhong Yeh, Chih-Hao Zheng

Field Recording: Chih-Ming Feng, Yi-Cing Chen, Chieh-Hsi Chen
Underwater Sound Record: Chih-Ming Feng, Yi-Cing Chen, Chieh-Hsi Chen

Underwater Musical Instrument Making: Chuang Teng-Shiang Art Studio
Prop Making: Teng-Shiang Chuang, Pei-Shan Wu
Cello Performance Instructor: Ming-Hui Chien

Music by: Tak-Cheung Hui
Sound Designer: Tak-Cheung Hui
Colorist: Tzu-Yi Yang

VR Production: NAXS STUDIO
VR Project Lead: Han-Yu Feng
VR Creative and Artistic Direction: Han-Yu Feng
Technical Lead: Yu-Jie Huang
Project Manager: Dai-Yun Nien
Administrative Manager: Chun-Ting Chen
Multiplayer Shared Spatial Tracking: Kuokpan Wong
Content and Audio Integration: Gim Chuang
Multiplayer Networking System: Yi Kuo
Scene Design: Jin Ng, Eg Lio
Character Design: Felix Onorato, Eg Lio
Animation Design: Eg Lio
VFX Design: Kevin Hsieh, Felix Onorato
System and Art Optimization: Eg Lio, Gim Chuang, Felix Onorato
3D Modeling Assistance: Tzu-Yi Yang

Motion Capture Tech Support: ET@T
Motion Capture Technical Manager: Meng-Ru Tsai
Motion Capture Technical Support: Yen-Fang Kuo, Ming-Da Yang
3D Animation Consultant: Hsiang-Hua Chang
3D Animation Production: Meng-Ru Tsai, Yen-Fang Kuo, Yu-Fang Lin, Hsiang-Hua Chang
Motion Capture Performers: Cheng-Yu Wu, Hao-Teng Liu, Chin-Lung Leon Yang, Kuan-Chieh Wang, Dan Luo

Special Thanks: Po-Wei Wang, Lin Shu-Zhen Music Studio, Patrick Lin, Shu-Ying Wen, James Wu

This project was funded by “Act for the Future”, the National Culture and Arts Foundation.

Exhibition Production Team

TFAM Team

Exhibition Supervisor: Cheng-Yi Chien

Exhibition Coordinator: Feng Hsin

Exhibition Assistant: Chia-Yun Tung

Design Coordinator: Hanyu Chih

Installation Team: Ru-Shuan Yang, Wen-Zhi Wang

Former Exhibition Coordinator: Frankie Su

Former Exhibition Assistant: Sandy Huang

Exhibition Production Manager: Rachel Huang

Underwater Archaeology Consultant: Ellen Hsieh

HCW Studio Administrative Assistant: Leah Lee

Exhibition Assistant: Elsie Lam

Exhibition Technical Coordinator: Zi-Ping Tian

Lighting Design: Zi-Ping Tian

Technical Team: Shepherd Technology Art

Installing & Lighting: Chih-Wen Liao, I-Ting Lee, Jerry Lin, Yu-Chen Huang, Cheng-Yu Han

Sound Design: Tak-Cheung Hui

Sound Technical Coordinator: Mothra Productions

Sound Stage: Chih-Ming Feng

Sonar Lender: Institute of Undersea Technology, National Sun Yat-sen University

Artifacts Lender: Bureau of Cultural Heritage, Ministry of Culture

Artifacts Humidity Sensors: Deqin Showcase

Wall-Text Editors

Underwater Archaeology Text: Ellen Hsieh

Shipwreck Data Collection: Ying Cheng

Underwater Archaeology Interviewees: Han-Zhang Huang, Wei-Lun Tsai, Chih-Yuan Hsieh

Underwater Acoustics Text: Andrea Y.Y. Chang

Key Vision Design: Adeiv Tsai

Exhibition Graphic Design: Adeiv Studio

Translator: Nicole Wang

Proofreading: Melmel Chen, Leah Lee, Nicole Wang

Show Crew:

Chao-Tsung Kang, Jerry Lin, Pin-Lin Li, Chi-Hsien Chen, Elsie Lam, Yu-Yung Lin, Jing Liao, Joanne Zheng, Tong-Hsuan Yen, Yu-Hsuan Hsian, Luiz Lin, Chia-Lan Chen, Jeh-Hsin Shieh

Sponsored by:

Act for the Future, National Culture and Arts Foundation

Ocean Affairs Council

Control System Host PC Sponsored by:

INTEL, ASRock, TEAMGROUP, T-CREATE, Palit, InWin

Special Thanks:

Patrick Lin, REE, Li-Jen Chen, Yu-Yung Lin

Exhibition Production Team

TFAM Team

Exhibition Supervisor: Cheng-Yi Chien

Exhibition Coordinator: Feng Hsin

Exhibition Assistant: Chia-Yun Tung

Design Coordinator: Hanyu Chih

Installation Team: Ru-Shuan Yang, Wen-Zhi Wang

Former Exhibition Coordinator: Frankie Su

Former Exhibition Assistant: Sandy Huang

Exhibition Production Manager: Rachel Huang

Underwater Archaeology Consultant: Ellen Hsieh

HCW Studio Administrative Assistant: Leah Lee

Exhibition Assistant: Elsie Lam

Exhibition Technical Coordinator: Zi-Ping Tian

Lighting Design: Zi-Ping Tian

Technical Team: Shepherd Technology Art

Installing & Lighting: Chih-Wen Liao, I-Ting Lee, Jerry Lin, Yu-Chen Huang, Cheng-Yu Han

Sound Design: Tak-Cheung Hui

Sound Technical Coordinator: Mothra Productions

Sound Stage: Chih-Ming Feng

Sonar Lender: Institute of Undersea Technology, National Sun Yat-sen University

Artifacts Lender: Bureau of Cultural Heritage, Ministry of Culture

Artifacts Humidity Sensors: Deqin Showcase

Wall-Text Editors

Underwater Archaeology Text: Ellen Hsieh

Shipwreck Data Collection: Ying Cheng

Underwater Archaeology Interviewees: Han-Zhang Huang, Wei-Lun Tsai, Chih-Yuan Hsieh

Underwater Acoustics Text: Andrea Y.Y. Chang

Key Vision Design: Adeiv Tsai

Exhibition Graphic Design: Adeiv Studio

Translator: Nicole Wang

Proofreading: Melmel Chen, Leah Lee, Nicole Wang

Show Crew:

Chao-Tsung Kang, Jerry Lin, Pin-Lin Li, Chi-Hsien Chen, Elsie Lam, Yu-Yung Lin, Jing Liao, Joanne Zheng, Tong-Hsuan Yen, Yu-Hsuan Hsian, Luiz Lin, Chia-Lan Chen, Jeh-Hsin Shieh

Sponsored by:

Act for the Future, National Culture and Arts Foundation

Ocean Affairs Council

Control System Host PC Sponsored by:

INTEL, ASRock, TEAMGROUP, T-CREATE, Palit, InWin

Special Thanks:

Patrick Lin, REE, Li-Jen Chen, Yu-Yung Lin

Exhibition Production Team

TFAM Team

Exhibition Supervisor: Cheng-Yi Chien

Exhibition Coordinator: Feng Hsin

Exhibition Assistant: Chia-Yun Tung

Design Coordinator: Hanyu Chih

Installation Team: Ru-Shuan Yang, Wen-Zhi Wang

Former Exhibition Coordinator: Frankie Su

Former Exhibition Assistant: Sandy Huang

Exhibition Production Manager: Rachel Huang

Underwater Archaeology Consultant: Ellen Hsieh

HCW Studio Administrative Assistant: Leah Lee

Exhibition Assistant: Elsie Lam

Exhibition Technical Coordinator: Zi-Ping Tian

Lighting Design: Zi-Ping Tian

Technical Team: Shepherd Technology Art

Installing & Lighting: Chih-Wen Liao, I-Ting Lee, Jerry Lin, Yu-Chen Huang, Cheng-Yu Han

Sound Design: Tak-Cheung Hui

Sound Technical Coordinator: Mothra Productions

Sound Stage: Chih-Ming Feng

Sonar Lender: Institute of Undersea Technology, National Sun Yat-sen University

Artifacts Lender: Bureau of Cultural Heritage, Ministry of Culture

Artifacts Humidity Sensors: Deqin Showcase

Wall-Text Editors

Underwater Archaeology Text: Ellen Hsieh

Shipwreck Data Collection: Ying Cheng

Underwater Archaeology Interviewees: Han-Zhang Huang, Wei-Lun Tsai, Chih-Yuan Hsieh

Underwater Acoustics Text: Andrea Y.Y. Chang

Key Vision Design: Adeiv Tsai

Exhibition Graphic Design: Adeiv Studio

Translator: Nicole Wang

Proofreading: Melmel Chen, Leah Lee, Nicole Wang

Show Crew:

Chao-Tsung Kang, Jerry Lin, Pin-Lin Li, Chi-Hsien Chen, Elsie Lam, Yu-Yung Lin, Jing Liao, Joanne Zheng, Tong-Hsuan Yen, Yu-Hsuan Hsian, Luiz Lin, Chia-Lan Chen, Jeh-Hsin Shieh

Sponsored by:

Act for the Future, National Culture and Arts Foundation

Ocean Affairs Council

Control System Host PC Sponsored by:

INTEL, ASRock, TEAMGROUP, T-CREATE, Palit, InWin

Special Thanks:

Patrick Lin, REE, Li-Jen Chen, Yu-Yung Lin

Actor From Golden Triangle

Energizing Product Design

Actor From Golden Triangle

Energizing Product Design

Actor From Golden Triangle

Energizing Product Design