Riku has been a Ph.D. student at Human-Computer Interaction Institute (HCII), School of Computer Science, Carnegie Mellon University since 2021.08. He is advised by Dr. Mayank Goel and working on applied machine learning with a focus on health sensing. Before coming to CMU, he received his B.E. and M.S. from The University of Tokyo, Japan, where he worked with Dr. Hiroshi Saruwatari on real-time voice conversion using DNN, and Dr. Masahiko Inami on auditory intervention for behavioral change.

In a nutshell, he's passionate about human-computer interaction (HCI), human-AI interaction (HAI), and, after a long day, the occasional human-beer interaction (HBI).


previous news


My research aims to develop intelligent systems for guiding human in a better direction with multimodal sensing/ML techniques and human-AI interaction perspectives. I research the following themes by smartly digitizing user information (pose, gaze, context, physiological state, etc.) and designing trustful interventions with domain experts.

  1. how we use AIs to augment our everyday life [Interaction Techniques]
  2. how we deploy AIs to real-world situations with the high need and human context [Health, Social Signal Processing]

My inventions on social signal processing have been licensed to several companies in diverse fields such as executive coaching, sales enablement, online classroom, human assessment, and entertainment. I leverage such collaborations to study the actual deployment process of AI systems as an external researcher ("AI for human assessment [CHI’23 case study]" is an example).

Peer-Reviewed Conferences & Journals

MI-Poser: Human Body Pose Tracking using Magnetic and Inertial Sensor Fusion with Metal Interference Mitigation

Riku Arakawa, Bing Zhou, Gurunandan Krishnan, Mayank Goel, Shree K. Nayar

PACM IMWUT 2023 (Ubicomp'23)

Paper Video Blog (Japanese)

LemurDx: Using Unconstrained Passive Sensing for an Objective Measurement of Hyperactivity in Children with no Parent Input

Riku Arakawa, Karan Ahuja, Kristie Mak, Gwendolyn Thompson, Sam Shaaban, Oliver Lindhiem, Mayank Goel

PACM IMWUT 2023 (Ubicomp'23)

Paper Blog (Japanese)

CatAlyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Models

Riku Arakawa*, Hiromu Yakura*, Masataka Goto (*: equal contribution)

ACM CHI 2023

Paper Slide Video Blog (Japanese) Blog (English) 

IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbuds

Vimal Mollyn, Riku Arakawa, Mayank Goel, Chris Harrison, Karan Ahuja

ACM CHI 2023 (: Honorable Mention Award, top 5%)

Paper Video GitHub 

uKnit: A Position-Aware Reconfigurable Machine-Knitted Wearable for Gestural Interaction and Passive Sensing using Electrical Impedance Tomography

Tianhong Catherine Yu, Riku Arakawa, James McCann, Mayank Goel

ACM CHI 2023

Paper Video

PrISM-Tracker: A Framework for Multimodal Procedure Tracking Using Wearable Sensors and State Transition Information with User-Driven Handling of Errors and Uncertainty

Riku Arakawa, Hiromu Yakura, Vimal Mollyn, Suzanne Nie, Emma Russell, Dustin P. Dimeo, Haarika A. Reddy, Alexander K. Maytin, Bryan T. Carroll, Jill Fain Lehman, Mayank Goel

PACM IMWUT 2022 (Ubicomp'23)

Paper Video GitHub  Blog (Japanese) Blog (English) 

RGBDGaze: Gaze Tracking on Smartphones with RGB and Depth Data

Riku Arakawa, Mayank Goel, Chris Harrison, Karan Ahuja


Paper Slide Video GitHub 

VoLearn: A Cross-Modal Operable Motion-Learning System Combined with Virtual Avatar and Auditory Feedback

Chengshuo Xia, Xinrui Fang, Riku Arakawa, Yuta Sugiura

PACM IMWUT 2022 (Ubicomp)

Paper Video 

VocabEncounter: NMT-powered Vocabulary Learning by Presenting Computer-Generated Usages of Foreign Words into Users' Daily Lives

Riku Arakawa*, Hiromu Yakura*, Sosuke Kobayashi (*: equal contribution)

ACM CHI 2022

Paper Slide Video Blog (Japanese) Blog (English) 

BeParrot: Efficient Interface for Transcribing Unclear Speech via Respeaking

Riku Arakawa*, Hiromu Yakura*, Masataka Goto (*: equal contribution)

ACM IUI 2022

Paper Slide Video Blog (Japanese) Blog (English)

Digital Speech Makeup: Voice Conversion Based Altered Auditory Feedback for Transforming Self-Representation

Riku Arakawa, Zendai Kashino, Shinnosuke Takamichi, Adrien Verhulst, Masahiko Inami


Paper Blog (Japanese)

Reaction or Speculation: Building Computational Support for Users in Catching-Up Series Based on an Emerging Media Consumption Phenomenon

Riku Arakawa*, Hiromu Yakura* (*: equal contribution)


Paper Slide Blog (Japanese) Blog (English)

Mindless Attractor: A False-Positive Resistant Intervention for Drawing Attention Using Auditory Perturbation

Riku Arakawa*, Hiromu Yakura* (*: equal contribution)

ACM CHI 2021 (: Honorable Mention Award, top 5%)

Paper Slide Video GitHub  Blog (Japanese)  Blog (English)

Hand with Sensing Sphere: Body-Centered Spatial Interactions with a Hand-Worn Spherical Camera

Riku Arakawa, Azumi Maekawa, Zendai Kashino, Masahiko Inami

ACM SUI 2020

Paper Video

INWARD: A Computer-Supported Tool for Video-Reflection Improves Efficiency and Effectiveness in Executive Coaching

Riku Arakawa*, Hiromu Yakura* (*: equal contribution)

ACM CHI 2020

Paper Slide Video Blog (Japanese) Blog (English)

PenSight: Enhanced Interaction with a Pen-Top Camera

Fabrice Matulic, Riku Arakawa, Brian Vogel, Daniel Vogel

ACM CHI 2020 (: Best Paper Award, top 1%)

Paper Video

REsCUE: A framework for REal-time feedback on behavioral CUEs using multimodal anomaly detection

Riku Arakawa*, Hiromu Yakura* (*: equal contribution)

ACM CHI 2019, Travel Grant by NEC C&C Foundation

Paper Slide Blog (Japanese) Blog (English)

Workshops, Posters, and Demos

AI for human assessment: What do professional assessors need?

Riku Arakawa*, Hiromu Yakura* (*: equal contribution)

ACM CHI 2023 Case Study (: Honorable Case Study Recognition, top 3)

Workshop on Trust and Reliance in AI-Human Teams (TRAIT’22) at CHI 2022

Paper  Slide Poster Blog (Japanese)

Human-AI communication for human-human communication: Applying interpretable unsupervised anomaly detection to executive coaching

Riku Arakawa*, Hiromu Yakura* (*: equal contribution)

Communication in Human-AI Interaction Workshop (CHAI’22) at IJCAI 2022

Paper Slide

Low-Cost Millimeter-Wave Interactive Sensing through Origami Reflectors

Riku Arakawa, Yang Zhang

1st CHIIoT Workshop (: Best Paper Award)

Paper Video

Exploration of Reinforcement Learning for Event Camera using Car-like Robots

Riku Arakawa*, Shintaro Shiba* (*: equal contribution)

IEEE ICRA 2020 Unconventional Sensors in Robotics workshop

Paper Video

BulkScreen: Saliency-Based Automatic Shape Representation of Digital Images with a Vertical Pin-Array Screen

Riku Arakawa*, Yudai Tanaka*, Hiromu Kawarasaki, Kiyosu Maeda (*: equal contribution)

ACM TEI 2020 Work-in-Progress

Paper Video

TransVoice: Real-Time Voice Conversion for Augmenting Near-Field Speech Communication

Riku Arakawa, Shinnosuke Takamichi, Hiroshi Saruwatari

ACM UIST 2019 Poster

Paper Poster

Implementation of DNN-based real-time voice conversion and its improvements by audio data augmentation and mask-shaped device

Riku Arakawa, Shinnosuke Takamichi, Hiroshi Saruwatari

The 10th ISCA Speech Synthesis Workshop

Paper Video Poster

DQN-TAMER: Human-in-the-Loop Reinforcement Learning with Intractable Feedback

Riku Arakawa, Sosuke Kobayashi, Yuya Unno, Yuta Tsuboi, Shin-ichi Maeda

IEEE ICRA 2019 RT-DUNE workshop (Extended Abstract)

Paper Poster

Honors and Awards

Fellowship, Scholarship and Grant-in-Aid

Academic Honors and Awards

Other Awards and Honors


I am willing to have talks, especially to (junior) high school students. This comes from my personal experience of having been exposed to the joy of science and technology at seminars I attended when in high school.

Media Coverage


[first name].[family name]1996 [at]