Ryo Hachiuma

Ryo Hachiuma

Computer Vision Researcher

Publications

Journal Papers

  1. Ryo Hachiuma, Hideo Saito, “Pose Estimation of Primitive-Shaped Objects from a Depth Image Using Superquadric Representation”, Applied Science, MDPI, 2020, 10, 5442. paper
  2. Tomohiro Shimizu, Ryo Hachiuma, Hiroki Kajita, Yoshifumi Takatsume, Hideo Saito, “Hand Motion-Aware Surgical Tool Localization and Classification from an Egocentric Camera”, Journal of Imaging, MDPI, 2021, 7(2), 15. paper
  3. Ryo Fujii, Jayakorn Vongkulbhisal, Ryo Hachiuma, Hideo Saito, “A Two-Block RNN-based Trajectory Prediction from Incomplete Trajectory”, IEEE Access, doi: 10.1109/ACCESS.2021.3072135. paper
  4. Reina Ishikawa, Ryo Hachiuma, Hideo Saito, “Self-Supervised Audio-Visual Feature Learning for Single-modal Incremental Terrain Type Clustering”, IEEE Access, doi: 10.1109/ACCESS.2021.3075582. paper
  5. Moi Hoon Yap, Ryo Hachiuma, Azadeh Alavi, Raphael Brüngel, Bill Cassidy, Manu Goyal, Hongtao Zhu, Johannes Rückert, Moshe Olshansky, Xiao Huang, Hideo Saito, Saeed Hassanpour, Christoph M. Friedrich, David Ascher, Anping Song, Hiroki Kajita, David Gillespie, Neil D. Reeves, Joseph Pappachan, Claire O’Shea, Eibe Frank, “Deep Learning in Diabetic Foot Ulcers Detection: A Comprehensive Evaluatio”, Computers in Biology and Medicine, doi:https://doi.org/10.1016/j.compbiomed.2021.104596 paper
  6. Yuki Saito, Ryo Hachiuma, Hideo Saito, Hiroki Kajita, Yoshifumi Takatsume, Tetsu Hayashida, “Camera Selection for Occlusion-less Surgery Recording via Training with an Egocentric Camera”, IEEE Access, doi: 10.1109/ACCESS.2021.3118426. paper
  7. Keitaro Yoshida, Ryo Hachiuma, Hisako Tomita, Jingjing Pan, Kris Kitani, Hiroki Kajita, Tetsu Hayashida, Maki Sugimoto, “Spatiotemporal Video Highlight by Neural Network Considering Gaze and Hands of Surgeon in Egocentric Surgical Videos”, Journal of Medical Robotics Research. paper
  8. Alessio Xompero, Santiago Donaher, Vladimir Iashin, Francesca Palermo, Gökhan Solak, Claudio Coppola, Reina Ishikawa, Yuichi Nagao, Ryo Hachiuma, Qi Liu, Fan Feng, Chuanlin Lan, Rosa HM Chan, Guilherme Christmann, Jyun-Ting Song, Gonuguntla Neeharika, Chinnakotla KT Reddy, Dinesh Jain, Bakhtawar Ur Rehman, Andrea Cavallaro, “The CORSMAL benchmark for the prediction of the properties of containers”, IEEE Access, doi: 10.1109/ACCESS.2022.3166906. paper
  9. Ryosuke Hori, Ryo Hachiuma, Mariko Isogawa, Dan Mikami, Hideo Saito, “Silhouette-based 3D Human Pose Estimation Using a Single Wrist-mounted 360° Camera”, IEEE Access, doi: 10.1109/ACCESS.2022.3177623. paper

Journal Papers (in Japanese)

  1. Ryo Hachiuma, Christian Pirchheim, Hideo Saito, and Dieter Schmalstieg, Real-time Multiple Object Tracking and Reconstruction with a Moving RGBD Camera, IEICE Transactions on Information and Systems, Vol.J104-D, No.4, pp.368-376．paper
  2. Yuki Saito, Ryo Hachiuma, Masahiro Yamaguchi, and Hideo Saito, Training-free Approach to Improve the Accuracy of Monocular Depth Estimation with In-Plane Rotation, IEICE Transactions on Information and Systems, Vol.J104-D, No.4, pp.377-387． paper

Preprints

  1. Zhengyi Luo*, Ryo Hachiuma*, Ye Yuan, Shun Iwase, Kris M. Kitani, “Kinematics-Guided Reinforcement Learning for Object-Aware 3D Ego-Pose Estimation”, arxiv:2011.04837 paper (* Equal contribution)
  2. Moi Hoon Yap, Ryo Hachiuma, Azadeh Alavi, Raphael Brungel, Manu Goyal, Hongtao Zhu, Bill Cassidy, Johannes Ruckert, Moshe Olshansky, Xiao Huang, Hideo Saito, Saeed Hassanpour, Christoph M Friedrich, David Ascher, Anping Song, Hiroki Kajita, David Gillespie, Neil D Reeves, Joseph Pappachan, Claire O’Shea, Eibe Frank, “Deep Learning in Diabetic Foot Ulcers Detection: A Comprehensive Evaluation”, arxiv:2010.03341 paper
  3. Zhengyi Luo, Ryo Hachiuma, Ye Yuan, Kris Kitani, “Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation”, arxiv:2106.05969 paper
  4. Alessio Xompero, Santiago Donaher, Vladimir Iashin, Francesca Palermo, Gökhan Solak, Claudio Coppola, Reina Ishikawa, Yuichi Nagao, Ryo Hachiuma, Qi Liu, Fan Feng, Chuanlin Lan, Rosa H. M. Chan, Guilherme Christmann, Jyun-Ting Song, Gonuguntla Neeharika, Chinnakotla Krishna Teja Reddy, Dinesh Jain, Bakhtawar Ur Rehman, Andrea Cavallaro, “Multi-modal estimation of the properties of containers and their content: survey and evaluation “, arxiv:2107.12719 paper

International conference (First Author)

  1. Ryo Hachiuma, Tomohiro Shimizu, Hideo Saito, Hiroki Kajita, Yoshihumi Takatsume, “Deep Selection: A Fully Supervised Camera Selection Network for Surgery Recordings”, 23rd International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2020. paper
  2. Ryo Hachiuma, Christian Pirchheim, Dieter Schmalstieg and Hideo Saito, “DetectFusion: Detecting and Segmenting Both Known and Unknown Dynamic Objects in Real-time SLAM”, 30th British Machine Vision Conference (BMVC), September, 2019. paper
  3. Ryo Hachiuma and Hideo Saito, “Volumetric Representation of Semantically Segmented Human Body Parts Using Superquadrics”, The 16th EuroVR Conference, pp.52-61, October, 2019. paper
  4. Ryo Hachiuma and Hideo Saito, “Volumetric Representation of Human Body Parts Using Superquadrics”, IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp.187-188, October, 2019. paper
  5. Ryo Hachiuma, Yuko Ozasa and Yorozu Ayanori, “Socially Adaptive Manner for Motion Planning from Human Server in Café”, IEEE/RSJ International Conference on Intelligent Robots and Systems Workshops (IROSW), pp.1-2, October, 2018. paper
  6. Ryo Hachiuma, Yuko Ozasa and Hideo Saito, “CNN-based Superquadric Parameter Prediction via RGBD Image”, The First IEEE International Symposium on Artificial Intelligence for ASEAN Development (ASEAN-AI), pp.1-6, 2018. paper
  7. Ryo Hachiuma, Yuko Ozasa and Hideo Saito, “Primitive Shape Recognition via Superquadric Representation using Large Margin Nearest Neighbor Classifier”, International Joint Conference on Computer Vision, Image and Computer Graphics Theory and Applications (VISAPP), March, 2017. paper
  8. Ryo Hachiuma and Hideo Saito, “Recognition and Pose Estimation of Primitive Shapes from Depth Images for Spatial Augmented Reality”, IEEE Virtual Reality Workshop (IEEEVRW), March, 2016. paper

International conference (Co-Author)

  1. Zhengyi Luo, Ryo Hachiuma, Ye Yuan, Kris Kitani, “Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation”, NeurIPS 2021 paper.
  2. Mateo Perez Rubio, Ryo Hachiuma, Ryo Fujii, Hideo Saito and Luis Salgado, “2D Human Pose Completion using GANs and Graph Convolutional Networks”, The 7th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2021).
  3. Mana Masuda, Ryo Hachiuma, Ryo Fujii, Hideo Saito, Yusuke Sekikawa, “Event Camera Anomaly Detection in Unsupervised Manner”, The 7th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2021).
  4. Reina Ishikawa, Ryo Hachiuma, Hideo Saito, Ryo Fujiwara, Shoji Yachida, “Audio-Visual Judgement of In-Play or Out-of-Play in Volleyball Match Videos”, The 7th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2021).
  5. Ryosuke Hori, Ryo Hachiuma, Hideo Saito, Mariko Isogawa, Dan Mikami, “Silhouette-based Synthetic Data Generation for 3D Human Pose Estimation with a Single Wrist-mounted 360° Camera”, International Conference on Image Processing (ICIP 2021). paper
  6. Mana Masuda, Ryo Hachiuma, Ryo Fujii, Hideo Saito, Yusuke Sekikawa, “Toward Unsupervised 3D Point Cloud Anomaly Detection using Variational Autoencoder”, International Conference on Image Processing (ICIP 2021). paper
  7. Kana Matsuo, Ryo Hachiuma, Hideo Saito, Yuta Sugiura, “Interactive Missing Completion System for 3D Scan Data”, International Conference on 3D Vision, Demo session, 2020.
  8. Hisako Tomita, Keitaro Yoshida, Ryo Hachiuma, Hiroki Kajita, Tetsu Hayashida, Naoto Ienaga, Maki Sugimoto, “Predicting Gaze of Surgeon by Hand Regions in First-Person Surgical Video”, Asian Conference on Computer Aided Surgery (ACCAS), 2020.
  9. Keitaro Yoshida, Ryo Hachiuma, Jingjing Pan, Hiroki Kajita, Tetsu Hayashida, Maki Sugimoto, “Learning Gaze for AI Based Spatial Video Editing in Egocentric Surgical Videos”, Asian Conference on Computer Aided Surgery (ACCAS), 2020.
  10. Reina Ishikawa, Ryo Hachiuma, Akiyoshi Kurobe, Hideo Saito, “Single-modal Incremental Terrain Clustering from Self-Supervised Audio-Visual Feature Learning”, International Conference on Pattern Recognition (ICPR), 2020. paper
  11. Mana Masuda, Ryo Hachiuma, Ryo Fujii, Hideo Saito, “Unsupervised Anomaly Detection of the First Person in Gait from an Egocentric Camera”, International Symposium on Visual Computing (ISVC), 2020. paper
  12. Elena Pena-Tapia, Ryo Hachiuma, Antoine Pasquali, Hideo Saito, “LCR-SMPL: Toward Real-time Human Detection and 3D Reconstruction from a Single RGB Image”, IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2020. paper
  13. Ryo Fujii, Ryo Hachiuma, Hideo Saito, “RGB-D Image Inpainting Using Generative Adversarial Network with a Late Fusion Approach”, International Conference on Augmented Reality, Virtual Reality and Computer Graphics (AVR), September, 2020. paper
  14. Daiki Matsuno, Ryo Hachiuma, Hideo Saito, Junichi Sugano, Hideyuki Adachi, “Pose Estimation of Stacked Rectangular Objects from Depth Images”, IEEE 29th International Symposium on Industrial Electronics (ISIE), May 2020. paper
  15. Yuki Saito, Ryo Hachiuma, Masahiro Yamaguchi, and Hideo Saito, “In-Plane Rotation-Aware Monocular Depth Estimation using SLAM”, The International Workshop on Frontiers of Computer Vision (IW-FCV) February, 2020. paper
  16. Tomohiro Shimizu, Kei Oishi, Ryo Hachiuma, Hiroki Kajita, and Hideo Saito, “Surgery Recording without Occlusions by Multi-View Surgical Videos”, International Joint Conference on Computer Vision, Image and Computer Graphics Theory and Applications (VISAPP), March, 2020. paper
  17. Tomohiro Shimizu, Ryo Hachiuma, Hideo Saito, Takashi Yoshikawa, Chonho Lee, “Prediction of Future Shot Direction using Pose and Position of Tennis Player”, International Workshop on Multimedia Content Analysis in Sports (MM-Sports), pp.59-66, October, 2019. paper
  18. Hiroki Kajita, Yoshifumi Takatsume, Kei Oishi, Tomohiro Shimizu, Hideo Saito, Ryo Hachiuma, Maki Sugimoto, Keitaro Yoshida, Yoshiaki Sakamoto, Keisuke Okabe, Tatsuya Kato, Nobuaki Imanishi, Kazuo Kishi, “Development of Multi-Camera Mounted Surgical Lamp That Realizes Complete Automatic Recording of Plastic Surgery Videos without Cameraman”, Plastic Surgery, September, 2019.
  19. Ryo Fujii, Ryo Hachiuma, and Hideo Saito, “Joint Inpainting of RGB and Depth Images by Generative Adversarial Network with a Late Fusion Approach”, IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp.203-204, October, 2019. paper
  20. Yuki Ishikawa, Ryo Hachiuma, Naoto Ienaga, Wakaba Kuno, Yuta Sugiura, Hideo Saito, “Semantic Segmentation of 3D Point Cloud to Virtually Manipulate Real Living Space”, Asia Pacific Workshop on Mixed and Augmented Reality (APMAR), March, 2019. [BEST PAPER AWARD] paper
  21. Kazumasa Oniki, Yuko Ozasa, Hideo Saito and Ryo Hachiuma, “Classification of Potsherds into Each Earthenware Using 3D Object Retrieval”, The International Workshop on Frontiers of Computer Vision (IW-FCV), February, 2018.

Domestic conference (in Japanese)

  1. 八馬遼,　中山祐介,　齋藤俊太,　斎藤英雄,ロボットによる物体把持のための部分形状モデルを用いた物体認識, 第 19 回クラウドネットワークロボット研究会, 2015.
  2. 八馬遼,　佐野真之,　斎藤英雄,法線ベクトルマップの勾配に着目した空間型 AR のための物体識別と位置推定,動的画像処理実用化ワークショップ, 2016.
  3. 八馬遼,　斎藤英雄,空間型 AR のための距離情報を用いた基本形状の物体識別と位置姿勢推定,第 202 回コンピュータビジョンとイメージメディア研究会, 2016. [最優秀賞]
  4. 石井誉仁,　中村高大,　八馬遼,　中山祐介,　黒須純,　萬礼応,　森田武史,　高橋正樹,　山口高平, PRINTEPSにおけるオントロジーとマニピュレーションの統合～喫茶店業務への適用２～，第30 回人工知能学会全国大会, 2016.
  5. 八馬遼,　小篠裕子,　斎藤英雄,超二次関数を用いた 3次元実物体認識,第 19 回画像の認識・理解シンポジウム, 2016.
  6. 八馬遼,　小篠裕子,　斎藤英雄,制約条件付き非線形最小二乗法を用いた3次元実物体の超二次関数推定,第 203 回コンピュータビジョンとイメージメディア研究会,2016.
  7. 小篠裕子,　八馬遼,　斎藤英雄,SVM を用いた超二次関数モデル表現に基づく三次元物体認識,パターン認識・メディア理解研究会,2016.
  8. 中村 高大, 八馬 遼, 森田 武史, 山口 高平，ユーザ向けAIアプリ開発ツールPRINTEPSによるロボット喫茶店の実装と評価，情報システム学会　第12回全国大会・研究発表大会，2016.
  9. 八馬遼,　小篠裕子,　斎藤英雄,LMNN を用いた超二次関数表現に基づく基本形状認識,第 205回コンピュータビジョンとイメージメディア研究会, 2017.
  10. 八馬遼,　小篠裕子，　斎藤英雄,超二次関数を用いた Score Level Fusion に基づく三次元一般物体認識,パターン認識・メディア理解研究会, 2017.
  11. 番原常公,　八馬遼,　家永直人,　小篠裕子,　斎藤英雄,画像による物体検出を用いた飲食行動認識の検討,パターン認識・メディア理解研究会, 2017.
  12. 八馬遼, 小篠 裕子, 斎藤英雄,物体の対称性を利用した超二次関数モデルフィッティングによる物体の不可視領域形状補完,第 20 回画像の認識・理解シンポジウム,2017.
  13. 八馬遼,　小篠裕子,　斎藤英雄,Multi-task CNN を用いた単眼 RGB 画像からの超二次関数推定,第 210 回コンピュータビジョンとイメージメディア研究会, 2018.
  14. 八馬遼,　小篠裕子,　斎藤英雄,RGB 画像からの物体検出と三次元基本形状推定,第 21 回画像の認識・理解シンポジウム,2018.
  15. 梶田大樹，高詰佳史，斎藤英雄，坂本好昭，岡部圭介，清水友博，八馬遼，杉本麻樹，吉田啓太郎，加藤達也，平尾高行，石井龍之，髙谷健人，今西宣晶，貴志和生，マルチカメラ搭載型無影灯の製作と手術室における実証，第28回日本コンピュータ外科学会大会，2019.
  16. 梶田大樹，高詰佳史，斎藤英雄，坂本好昭，岡部圭介，清水友博，八馬遼，杉本麻樹，吉田啓太郎，加藤達也，平尾高行，今西宣晶，貴志和生，マルチカメラ搭載型無影灯による術野の多視点撮影および3次元表面形状の取得の試み，日本形成外科学会基礎学術集会，2019.
  17. 齋藤祐貴，八馬遼，山口真弘，斎藤英雄，SLAMを用いたRoll方向回転に頑健な単眼depth推定の精度改善手法，第222回コンピュータビジョンとイメージメディア研究会，2020． [優秀賞]
  18. 八馬遼，石川 礼，家永直人，久能若葉，杉浦裕太，斎藤英雄, 3Dセマティックセグメンテーションを用いた実環境における家具再配置シミュレーション, 第25回知能メカトロニクスワークショップ, 2020.
  19. 松尾佳奈，八馬遼，斎藤英雄，杉浦裕太，部屋3次元スキャンデータのための対話的欠損補完システム，第178回ヒューマンインタフェース学会研究会，2020.