Profile

Riku has been a Ph.D. student at Human-Computer Interaction Institute (HCII), School of Computer Science, Carnegie Mellon University since 2021.08. He is advised by Dr. Mayank Goel and working on applied machine learning with a focus on health sensing. Before coming to CMU, he received his B.E. and M.S. from The University of Tokyo, Japan, where he worked with Dr. Hiroshi Saruwatari on real-time voice conversion using DNN, and Dr. Masahiko Inami on auditory intervention for behavioral change.

In a nutshell, he's passionate about human-computer interaction (HCI), human-AI interaction (HAI), and, after a long day, occasional human-beer interaction (HBI).

News

2024.07, I am selected as one of the QUAD Fellows! Excited to join the community.
2024.07, I gave a research talk at SciFi Lab at Cornell University. I appleciate the warm welcome.
2024.07, "PrISM-Observer" is conditionally accepted to ACM UIST 2024. See you in Pittsburgh!
2024.05, "Coaching Copilot" is accepted to ACM CUI 2024. Deployment efforts.
2024.05, I attended CHI 2024 in Hawaii. Inspired by many cool works and discussions.
2024.05, I am listed on Forbes Asia 30 under 30 in Healthcare & Science category (coincidentally with Karan!).
2024.04, I presented a paper at IEEE ICASSP and gave a talk at Seoul National University. Loved the city and the people.
2024.03, I will be serving as a Paper Chair Assistant at CHI2025.

previous news

2023.12, I had fun time in Japan with fellow HCI researchers (attending WISS and giving talks).
2023.12, One paper (at Google during summer 2023) is accepted to IEEE ICASSP. First time in signal processing conference!
2023.10, I attended ACM Ubicomp in Cancun to present "PrISM-Tracker", "LemurDx", and "MI-Poser". Fun conference and cenote.
2023.08, I am listed on Forbes Japan 30 under 30 in Science & Technology category.
2023.07, "MI-Poser" (at Snap Research during summer 2022) is accepted to ACM IMWUT.
2023.05, Moved to Bay Area for research internship at Google. Awesome weather!
2023.04, "LemurDx" is accepted to ACM IMWUT. One of my first projects at SmashLab.
2023.04, "AI for human assessment" received Honorable Case Study Recognition (top 3) at ACM CHI 2023. Deployment efforts.
2023.04, "IMUPoser" received Honorable Mention Award (top 5%) at ACM CHI 2023.
2023.01, Following on from last year, I'll be serving as one of the Program Committee Members at ACM CHI LBW 2023.
2023.01, Attended APSARD 2023 in Orlando. First time in a medical conference.
2023.01, Super lucky to get three papers accepted to CHI2023. Awesome collaborators!
2022.12, I received Snap Research Fellowship!
2022.10, "PrISM-Tracker" is accepted (with minor revision) to IMWUT.
2022.09, Passed CommTalk at CMU HCII, great chance for practice with lots of useful feedback.
2022.09, Back in Pittsburgh for a new semester! (+ CHI push)
2022.08, Submitted a paper to IMWUT. Thanks to my collaborators!
2022.07, "RGBDGaze" got accepted to ACM ICMI 2022. My first work at CMU!
2022.06, I am selected for Masason Foundation Scholarship .
2022.05, Moved to NYC for the exciting summer at Snap Research (computational imaging team)!
2022.05, Attended CHI'22 in NOLA. Everything was great except that I got Covid...(fortunately mild symptom).
2022.03, "CalmResponses" got accepted to ACM IMX 2022. Congrats Kiyosu!
2022.01, I'll be serving as one of the Program Committee Members at ACM CHI LBW 2022.
2021.12, "BeParrot" got accepted to ACM IUI 2022. Fun side project.
2021.12, Visited Lifestyle Computing Lab. Honored and excited to introduce my projects.
2021.12, Visited UCLA. Great catching up with Anthony, Yang, and their students.
2021.11, Our patent is acquired by ACES, Inc.. link
2021.11, "VocabEncounter" got conditionally accepted to ACM CHI 2022.
2021.08, Moved to Pittsburgh, officially starting my Ph.D. journey.
2021.07, "Digital Speech Makeup" got accepted to ACM ICMI 2021.
2021.04, It's been a long journey and I'm thrilled to announce that I'll be joining CMU HCII this fall as a Ph.D. student!
2021.03, "Mindless Attractor" received Honorable Mention Award (top 5%) at ACM CHI 2021. Proud of the collaboration.
2021.03, Received Dean's Award and was selected for the representative student of the Graduate School of Information Science and Technology, The University of Tokyo.
2021.02, "Origami Reflector" received the Best Paper Award at the 1st CHIIoT Workshop! Thanks Yang!
2020.12, "Reaction or Speculation" got conditionally accepted to ACM CSCW 2021. Fun side project.
2020.12, "Mindless Attractor" got conditionally accepted to ACM CHI 2021.
2020.11, I am selected for Funai Overseas Scholarship.
2018. This page is up. Huge thanks to Hiromu Kawarasaki for the design.

Research

I develop adaptable, intelligent agents to support and affect users in the physical world with multimodal sensing techniques and human-AI interaction perspectives. I achieve this by smartly digitizing user information (pose, gesture, gaze, activity, speech, etc.) and designing helpful intervention with practical devices, such as smartwatch. I investigate the following research questions:

how we develop reliable AI systems from imperfect sensing and machine learning [Health / Well-Being]
how we enable computers to deal with communication contexts that are ambiguous and highly human [Social Signal Processing]
how we augment our ways to interact with computers [Interaction Technique]

My inventions have been licensed to several companies in diverse fields such as executive coaching, sales enablement, online classroom, human assessment, and entertainment. I leverage such collaborations to study the actual deployment process of AI systems (e.g., "AI for Human Assessment" [W.7], "Coaching Copilot" [C.19]).

Honors and Awards

Fellowship, Scholarship and Grant-in-Aid

2024 QUAD Fellowship
2023 Center for Machine Learning and Health, Translational Fellowship in Digital Health
2022 Snap Research Fellowship
2022 Masason Foundation Scholarship
2021 Funai Overseas Scholarship
2021 Kuma Creator Scholarship
2021 INNO-vation Program, Ministry of Internal Affairs and Communications, Japan
2021 Research Fellowship for Young Scientists (DC1), Japan Society for the Promotion of Science (until 2021.8)
2020 TOYOTA/Dwango AI Scholarship
2020 Fixstars Scholarship
2019 NEC C&C Grant for Attending International Conferences
2018 IPA Mitou Advanced Program, Ministry of Economy, Trade, and Industry, Japan

Academic Honors and Awards

2023.04 Honorable Mention Award, CHI2023 (top 5%) [IMUPoser]
2023.04 Honorable Case Study Recognition, CHI2023 (top 3) [AI for human assessment]
2021.04 Honorable Mention Award, CHI2021 (top 5%) [Mindless Attractor]
2021.03 Representative Student, Graduate School of Information Science and Technology at the University of Tokyo
2021.03 Dean's Award, Graduate School of Information Science and Technology at the University of Tokyo
2021.02 Best Paper Award, 1st CHIIoT workshop (top 1) [Origami Reflector]
2020.04 Best Paper Award, CHI2020 (top 1%) [PenSight]
2019.06 Best Student Presentation Award, The Acoustical Society of Japan [Real-Time Voice Conversion]
2015.03 Tokyo Governor Award (academic activities)
2015.03 Tokyo Private School Foundation Award (academic activities)

Other Awards and Honors

2024.05 Forbes Asia 30 under 30, Healthcare & Science
2023.08 Forbes Japan 30 under 30, Science & Technology
2022.12 Finalist for INNO-vation Generation Award, Ministry of Internal Affairs and Communications, Japan [BeParrot]
2021.12 Finalist for INNO-vation Generation Award, Ministry of Internal Affairs and Communications, Japan [Mindless Attractor]
2019.11 International Virtual Reality Contest, Laval Virtual prize & Unity prize [Kininaruki]
2019.06 Spajam Hackathon Tokyo League, 1st prize [Picdoc]
2018.10 James Dyson Award, National Winner in Japan [YourPacifier]
2018.06 UTokyo Environment, Safety & Health Slogan Contest, ESH Executive Vice President’s Award
2018.02 RUNHACK, 1st prize
2017.11 JPHACKS, Innovator & three prizes [LoverDuck]
2017.10 Stanford Healthcare Hackathon, 3rd prize & design prize [YourPacifier]
2017.06 Jiro Hackathon, prize
2017.05 Primary Industries Hackathon, 1st prize
2017.03 London Deep Learning Hackathon, 1st prize & best pitch prize
2017.03 LINE Bot Awards, finalist and prize
2017.01 TwitCasting Hackathon, 1st prize
2016.11 HackerWars, prize
2016.07 AI chat bot hackathon, 1st prize
2015.08 Beijing IoT Competition, design prize
2014.09 Asian Science Camp, math prize

Talks

I am willing to have talks, especially to (junior) high school students. This comes from my personal experience of having been exposed to the joy of science and technology at seminars I attended when in high school.

2024.07 Talk@SciFi Lab (Cornell University) hosted by Prof. Cheng Zhang, [Using Imperfect Sensing for Ubiquitous, Reliable Assistant]
2024.04 Talk@HCS Lab (Seoul National University) hosted by Prof. Youngki Lee, [Using Imperfect Sensing for Ubiquitous, Reliable Assistant]
2023.12 Talk@海外大学院留学説明会 (The University of Tokyo)
2023.12 Talk@Koike Lab (Tokyo Institute of Technology) hosted by Dr. Erwin Wu, [Toward 24/7 Human Digitization]
2023.12 Talk@The University of Tokyo hosted by Prof. Koji Yatani, [Augmenting Health Experts' Practice with Human Behavior Sensing]
2023.12 Talk@Lifestyle Computing Lab (Keio University) hosted by Prof. Yuta Sugiura, [Toward 24/7 Human Digitization]
2023.12 Pitch@Masason Foundation, [Interactions toward Invisible AI]
2023.12 Talk@Life is Tech !, Inc.
2023.10 Qualification Talk@CMU HCII, [Coming Soon]
2023.08 Talk@Japanese Academic Seminars at Stanford hosted by Dr. Ryo Eguchi. [Invisible AI for Behavioral Change] Slide
2023.06 Talk@AIST Creative HCI Seminar hosted by Dr. Jun Kato. [CMU HCII, IMUPoser, LemurDx, PrISM-Tracker] Slide
2023.04 Talk@NLP Colloquium hosted by Dr. Naoki Otani, [VocabEncounter, CatAlyst] Slide
2023.04 Talk@MoSHI (University of Pittsburgh) hosted by Prof. Carissa A. Low, [LemurDx, PrISM-Tracker] Slide
2023.03 Talk@Life is Tech !, Inc. Spring Camp [What is being creative in the era of generative AI?]
2023.01 Talk@APSARD 2023 Conference, [LemurDx] Slide
2022.12 Talk@Information Somatics Lab (UTokyo), hosted by Prof. Masahiko Inami [IMUPoser, uKnit, LemurDx]
2022.09 Qualification Talk@CMU HCII, [RGBDGaze] Slide
2021.12 Talk@Lifestyle Computing Lab (Keio University) hosted by Prof. Yuta Sugiura, [Hand-with-Sensing-Sphere, PenSight]
2020.08 Talk@ヒューマンインターフェース学会トップカンファレンスアドバンストワークショップ, [INWARD]
2020.07 Panel Discussion@ THE FUTURE CONFERENCE 次世代を担う若き研究者たちの戦略
2020.03 Panel Discussion@数理の翼伊計島セミナー
2019.10 Talk@深層学習全学横断研究会 hosted by Prof. Yutaka Matsuo, [Real-Time Voice Conversion, TransVoice] Slide