News

2023.12, I had fun time in Japan with fellow HCI researchers (attending WISS and giving talks).
2023.12, One paper (at Google during summer 2023) is accepted to IEEE ICASSP.
2023.10, I attended ACM Ubicomp in Cancun.
2023.08, I am selected for Forbes Japan 30 under 30.

2023.07, "MI-Poser" (at Snap Research during summer 2022) is accepted to ACM IMWUT.
2023.05, Moved to Bay Area for research internship at Google. Awesome weather!
2023.04, "LemurDx" is accepted to ACM IMWUT.
2023.04, "AI for human assessment" received Honorable Case Study Recognition (top 3) at ACM CHI 2023.
2023.04, "IMUPoser" received Honorable Mention Award (top 5%) at ACM CHI 2023.
2023.01, Following on from last year, I'll be serving as one of the Program Committee Members at ACM CHI LBW 2023.
2023.01, Attended APSARD 2023 in Orlando. First time in a medical conference.
2023.01, Super lucky to get three papers accepted to CHI2023. Awesome collaborators!
2022.12, I received Snap Research Fellowship!
2022.11, "AI for human assessment" is accepted to CHI2023 case study.
2022.10, "PrISM-Tracker" is accepted (with minor revision) to IMWUT.
2022.09, Passed CommTalk at CMU HCII, great chance for practice with lots of useful feedback.
2022.09, Back in Pittsburgh for a new semester! (+ CHI push)
2022.08, Submitted a paper to IMWUT. Thanks to my collaborators, especially for my advisor's last-minute help with Covid.
2022.07, "RGBDGaze" got accepted to ACM ICMI 2022. My first work at CMU!
2022.06, I am selected for Masason Foundation Scholarship .
2022.05, Moved to NYC for the exciting summer at Snap Research (computational imaging team)!
2022.05, Attended CHI'22 in NOLA. Everything was great except that I got Covid...(fortunately mild symptom).
2022.04, I'll attend TRAIT workshop at CHI'22 to present a case study of our conversational analysis project at ACES, Inc..
2022.03, "CalmResponses" got accepted to ACM IMX 2022. Congrats Kiyosu!
2022.01, I'll be serving as one of the Program Committee Members at ACM CHI LBW 2022.
2021.12, "BeParrot" got accepted to ACM IUI 2022.
2021.12, Visited Lifestyle Computing Lab. Honored and excited to introduce my projects.
2021.12, Visited UCLA. Great catching up with Anthony, Yang, and their students.
2021.11, Our patent of "REsCUE" is acquired by ACES, Inc.. link
2021.11, "VocabEncounter" got conditionally accepted to ACM CHI 2022.
2021.08, Moved to Pittsburgh, officially starting my Ph.D. journey.
2021.07, "Digital Speech Makeup" got accepted to ACM ICMI 2021.
2021.04, It's been a long journey and I'm thrilled to announce that I'll be joining CMU HCII this fall as a Ph.D. student!
2021.03, "Mindless Attractor" received Honorable Mention Award (top 5%) at ACM CHI 2021.
2021.03, Received Dean's Award and was selected for the representative student of the Graduate School of Information Science and Technology, The University of Tokyo.
2021.02, "Origami Reflector" received the Best Paper Award at the 1st CHIIoT Workshop!
2021.01, "Origami Reflector" got accepted to 1st CHIIoT Workshop.
2021.01, Submitted "Origami Reflector" to 1st CHIIoT Workshop. Thank you Yang Zhang for mentoring!
2020.12, "Reaction or Speculation" got conditionally accepted to ACM CSCW 2021.
2020.12, "Mindless Attractor" got conditionally accepted to ACM CHI 2021.
2020.11, I am selected for Funai Overseas Scholarship.
2020.08, "Hand with Sensing Sphere" got accepted to ACM SUI 2020.
2020.08, "Mimicker-in-the-Browser" got accepted to ACM ICMI 2020.
2020.03, "PenSight" received Best Paper Award (top 1%) at ACM CHI 2020.
2019.12, "INWARD" and "PenSight" got accepted to ACM CHI 2020.
2019.11, "Kininaruki" won Laval Virtual prize at International Virtual Reality Contest 2019.
2019.11, "BulkScreen" got accepted to ACM TEI Work-in-Progress 2020.
2019.08, "TransVoice" paper got accepted to ACM UIST Poster 2019.
2019.07, "DNN Real-time Voice Conversion" got accepted to The 10th ISCA Speech Synthesis Workshop.
2019.06, I received The 19th Best Student Presentation Award of The Acoustical Society of Japan, Sep. 2019. link
2019.04, "DQN-TAMER" got accepted to RT-DUNE workshop at IEEE ICRA 2019. link
2019.03, We exhibited "BulkScreen", a pin-array-based shape display, at SXSW 2019.
2019.01, I was featured as one Under30 person in NewsPicks. link
2018.12, "REsCUE" got accepted to ACM CHI 2019.
2018.10, "Your Pacifier" received the national grand prize in James Dyson Award 2018. link

Research

My research aims to develop intelligent systems for guiding human in a better direction with multimodal sensing/ML techniques and human-AI interaction perspectives. I research the following themes by smartly digitizing user information (pose, gaze, activity, physiological state, etc.) and designing trustful interventions with domain experts (Human-AI / Expert-AI interaction).

how we deploy AI systems to real-world situations with high need and human context [Health / Well-Being, Social Signal Processing]
how we augment our ways to interact with computers [Input Technique]

My inventions have been licensed to several companies in diverse fields such as executive coaching, sales enablement, online classroom, human assessment, and entertainment. I leverage such collaborations to study the actual deployment process of AI systems as an external researcher ("[W.7] AI for human assessment, CHI’23 case study" is an example).

Honors and Awards

Fellowship, Scholarship and Grant-in-Aid

2023 Center for Machine Learning and Health, Translational Fellowship in Digital Health
2022 Snap Research Fellowship
2022 Masason Foundation Scholarship
2021 Funai Overseas Scholarship
2021 Kuma Creator Scholarship
2021 INNO-vation Program, Ministry of Internal Affairs and Communications, Japan
2021 Research Fellowship for Young Scientists (DC1), Japan Society for the Promotion of Science (until 2021.8)
2020 TOYOTA/Dwango AI Scholarship
2020 Fixstars Scholarship
2019 NEC C&C Grant for Attending International Conferences
2018 IPA Mitou Advanced Program, Ministry of Economy, Trade, and Industry, Japan

Academic Honors and Awards

2023.04 Honorable Mention Award, CHI2023 (top 5%) [IMUPoser]
2023.04 Honorable Case Study Recognition, CHI2023 (top 3) [AI for human assessment]
2021.03 Honorable Mention Award, CHI2021 (top 5%) [Mindless Attractor]
2021.03 Representative Student, Graduate School of Information Science and Technology at the University of Tokyo
2021.03 Dean's Award, Graduate School of Information Science and Technology at the University of Tokyo
2021.02 Best Paper Award, 1st CHIIoT workshop (top 1) [Origami Reflector]
2020.03 Best Paper Award, CHI2020 (top 1%) [PenSight]
2019.06 Best Student Presentation Award, The Acoustical Society of Japan [Real-Time Voice Conversion]
2015.03 Tokyo Governor Award (academic activities)
2015.03 Tokyo Private School Foundation Award (academic activities)

Other Awards and Honors

2023.08 Forbes Japan 30 under 30
2022.12 Finalist for INNO-vation Generation Award, Ministry of Internal Affairs and Communications, Japan [BeParrot]
2021.12 Finalist for INNO-vation Generation Award, Ministry of Internal Affairs and Communications, Japan [Mindless Attractor]
2019.11 International Virtual Reality Contest, Laval Virtual prize & Unity prize [Kininaruki]
2019.06 Spajam Hackathon Tokyo League, 1st prize [Picdoc]
2018.10 James Dyson Award, National Winner in Japan [YourPacifier]
2018.06 UTokyo Environment, Safety & Health Slogan Contest, ESH Executive Vice President’s Award
2018.02 RUNHACK, 1st prize
2017.11 JPHACKS, Innovator & three prizes [LoverDuck]
2017.10 Stanford Healthcare Hackathon, 3rd prize & design prize [YourPacifier]
2017.06 Jiro Hackathon, prize
2017.05 Primary Industries Hackathon, 1st prize
2017.03 London Deep Learning Hackathon, 1st prize & best pitch prize
2017.03 LINE Bot Awards, finalist and prize
2017.01 TwitCasting Hackathon, 1st prize
2016.11 HackerWars, prize
2016.07 AI chat bot hackathon, 1st prize
2015.08 Beijing IoT Competition, design prize
2014.09 Asian Science Camp, math prize

Talks

I am willing to have talks, especially to (junior) high school students. This comes from my personal experience of having been exposed to the joy of science and technology at seminars I attended when in high school.

2024.04 Talk@Seoul National University hosted by Prof. Youngki Lee
2023.12 Talk@海外大学院留学説明会
2023.12 Talk@Koike Lab (Tokyo Institute of Technology) hosted by Dr. Erwin Wu, [Toward 24/7 Human Digitization]
2023.12 Talk@The University of Tokyo hosted by Prof. Koji Yatani, [Augmenting Health Experts' Practice with Human Behavior Sensing]
2023.12 Talk@Lifestyle Computing Lab (Keio University) hosted by Prof. Yuta Sugiura, [Toward 24/7 Human Digitization]
2023.12 Pitch@Masason Foundation, [Interactions toward Invisible AI]
2023.12 Talk@Life is Tech !, Inc.
2023.10 Qualification Talk@CMU HCII, [Coming Soon]
2023.08 Talk@Japanese Academic Seminars at Stanford hosted by Dr. Ryo Eguchi. [Invisible AI for Behavioral Change] Slide
2023.06 Talk@AIST Creative HCI Seminar hosted by Dr. Jun Kato. [CMU HCII, IMUPoser, LemurDx, PrISM-Tracker] Slide
2023.04 Talk@NLP Colloquium hosted by Dr. Naoki Otani, [VocabEncounter, CatAlyst] Slide
2023.04 Talk@MoSHI (University of Pittsburgh) hosted by Prof. Carissa A. Low, [LemurDx, PrISM-Tracker] Slide
2023.03 Talk@Life is Tech !, Inc. Spring Camp [What is being creative in the era of generative AI?]
2023.01 Talk@APSARD 2023 Conference, [LemurDx] Slide
2022.12 Talk@Information Somatics Lab (UTokyo), hosted by Prof. Masahiko Inami [IMUPoser, uKnit, LemurDx]
2022.09 Qualification Talk@CMU HCII, [RGBDGaze] Slide
2021.12 Talk@Lifestyle Computing Lab (Keio University) hosted by Prof. Yuta Sugiura, [Hand-with-Sensing-Sphere, PenSight]
2020.08 Talk@ヒューマンインターフェース学会トップカンファレンスアドバンストワークショップ, [INWARD]
2020.07 Panel Discussion@ THE FUTURE CONFERENCE 次世代を担う若き研究者たちの戦略
2020.03 Panel Discussion@数理の翼伊計島セミナー
2019.10 Talk@深層学習全学横断研究会 hosted by Prof. Yutaka Matsuo, [Real-Time Voice Conversion, TransVoice] Slide

Profile