Weiyu Guo

Weiyu Guo

HKUST

I am currently a P.h.D student at Artificail Intelligence Thrust, Information Hub, The Hong Kong University of Science and Technology, Guangzhou, supervised by Prof. Hui Xiong.

I am now working on vision-language-action model, human in the loop and Neural Interface research. If you are seeking any form of academic cooperation, please feel free to email me at guoweiyu96@gmail.com.

My research interest includes Bio-Inspired Neural Network, Neural Interface, Multimodal Large Langugae Model and Robotic manipulation. I have published 20+ papers at the top international AI conferences such as ICML, NeurIPS, ECCV, THMS. And I aslo pubilished 10+ papers in top journals of Neural Engineering and Robotics such as JNE, TNSRE, RA-L.

🔥 News

  • 2025.09: 🎉 One paper accepted at IJCV 2025!
  • 2025.09: 🎉 Two paper accepted at NeurIPS 2025!
  • 2025.01: 🎉 One paper accepted at ICLR 2025!

📚 Achievements

  • Published 27 international papers.
  • Applied for 15 patents, including 2 PCT international patents.
  • Involved in writing one book chapter (Generalization with Deep Learning) on world scientific book.
  • Reported by media such as People’s Daily（人民日报）, China Central Television(央视新闻), and Guangzhou Daily.
  • Founded a company with a valuation of more than 70 million yuan.

🎓 Education

  • 2022.08 - NOW, The Hong Kong University of Science and Technology, Artifical Intelligence, P.h.D candidate (2022-至今)
  • 2019.08 - 2022.6, University of Chinese Academy of Science, School of Artificail Intelligence, Master graduate (2019-2022)
  • 2015.09 - 2019.06, Dalian Universty of Technology(大连理工大学), School of Software Engineering, Bachelor degree (2015-2019)

🎓 COOPERTATION

• 2021.9 - 2022.6, RA at Johns Hopkins University, supervised by Professor Alan Yuille (IEEE Fellow) and published a paper in ECCV together.
• 2019.9 - Now, Collaboration with Professor Dario Farina of Imperial College London (ICL) and we published paper in JNE, THMS together.

📝 Selected Publications

NeurIPS 2025
sym
  • Guo, Weiyu, Ziyang Chen, Shaoguang Wang, Jianxiang He, Yijie Xu, Jinhui Ye, Ying Sun, and Hui Xiong. “Logic-in-Frames: Dynamic Keyframe Search via Visual Semantic-Logical Verification for Long Video Understanding.” NeurIPS 2025. [预览]
ICML 2025
sym
  • Guo, Weiyu, Ziyue Qiao, Ying Sun, Yijie Xu, and Hui Xiong. “Revisiting Noise Resilience Strategies in Gesture Recognition: Short-Term Enhancement in Surface Electromyographic Signal Analysis” ICML (2025). [预览]
NeurIPS 2024
sym
  • Guo, Weiyu, Ying Sun, Yijie Xu, Ziyue Qiao, Yongkui Yang, and Hui Xiong. “SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network.” NeurIPS (2024). [预览]
ECCV. 2024
sym
  • Guo, Weiyu, Li, Zhaoshuo, Yang, Yongkui, Wang, Zheng, Taylor, Russell H, Unberath, Mathias, Yuille, Alan, Li, Yingwei. “Context-Enhanced Stereo Transformer.” ECCV2022 (2022) [预览]
JNE
sym
  • Guo, Weiyu, Ma, Chenfei, Wang, Zheng, Zhang, Hang, Farina, Dario, Jiang, Ning, Lin, Chuang. “Long exposure convolutional memory network for accurate estimation of finger kinematics from surface electromyographic signals.” Journal of Neural Engineering 18(2) 026027 (2021). IOP Publishing
THMS. 2023
sym
  • Guo, Weiyu, Jiang, Ning, Farina, Dario, Su, Jingyong, Wang, Zheng, Lin, Chuang, Xiong, Hui. “Multi-attention feature fusion network for accurate estimation of finger kinematics from surface electromyographic signals.” IEEE Transactions on Human-Machine Systems 53(3) 512-519 (2023). IEEE

  • Guo, Weiyu, Ma, Chenfei, Wang, Zheng, Zhang, Hang, Farina, Dario, Jiang, Ning, Lin, Chuang. “Long exposure convolutional memory network for accurate estimation of finger kinematics from surface electromyographic signals.” Journal of Neural Engineering 18(2) 026027 (2021). IOP Publishing

  • Wang, Chao, Guo, Weiyu, Zhang, Hang, Guo, Linlin, Huang, Changcheng, Lin, Chuang. “sEMG-based continuous estimation of grasp movements by long-short term memory network.” Biomedical Signal Processing and Control 59 101774 (2020). Elsevier

  • Guo, Linlin, Zhang, Hang, Wang, Chao, Guo, Weiyu, Diao, Guangqiang, Lu, Bingxian, Lin, Chuang, Wang, Lei. “Towards CSI-based diversity activity recognition via LSTM-CNN encoder-decoder neural network.” Neurocomputing 444 260-273 (2021). Elsevier

  • Guo, Weiyu, Wang, Chao, Lin, Chuang, Wang, Chenrui. “Long short term memory model based continuous estimation of human finger joint angles.” 2019 IEEE International Conference on Real-time Computing and Robotics (RCAR) 288-292 (2019). IEEE

  • Zhang, Hang, Wang, Chao, Guo, Weiyu, Guo, Linlin, Lin, Chuang. “DFNN-based gesture recognition with the shift and damage of the HD-sEMG electrodes.” 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO) 1275-1279 (2019). IEEE

  • Guo, Linlin, Zhang, Hang, Guo, Weiyu, Fang, Jian, Lu, Bingxian, Ma, Chenfei, Li, Guanglin, Lin, Chuang, Wang, Lei. “Deep Learning for Device-free Human Activity Recognition Using WiFi Signals.” Generalization With Deep Learning: For Improvement On Sensing Capability 101-137 (2021)

  • Chen, Chao, Guo, Weiyu, Ma, Chenfei, Yang, Yongkui, Wang, Zheng, Lin, Chuang. “sEMG-based continuous estimation of finger kinematics via large-scale temporal convolutional network.” Applied Sciences 11(10) 4678 (2021). MDPI

  • Wang, Zheng, Wang, Zhuo, Liao, Jian, Chen, Chao, Yang, Yongkui, Dong, Bo, Chen, Weiguang, Chen, Wenxuan, Lei, Ming, Guo, Weiyu. “CNN-DMA: a predictable and scalable direct memory access engine for convolutional neural network with sliding-window filtering.” Proceedings of the 2021 Great Lakes Symposium on VLSI 115-121 (2021)

  • Chen, Wenxuan, Wang, Zheng, Lei, Ming, Dong, Bo, Wang, Zhuo, Yang, Yongkui, Chen, Chao, Guo, Weiyu, Liang, Chen, Zhang, Qian. “Improving system latency of AI accelerator with on-chip pipelined activation preprocessing and multi-mode batch inference.” 2021 IEEE 3rd International Conference on Artificial Intelligence Circuits and Systems (AICAS) 1-4 (2021). IEEE

  • Ma, Chenfei, Guo, Weiyu, Zhang, Hang, Samuel, Oluwarotimi Williams, Ji, Xiaopeng, Xu, Lisheng, Li, Guanglin. “A novel and efficient feature extraction method for deep learning based continuous estimation.” IEEE Robotics and Automation Letters 6(4) 7341-7348 (2021). IEEE

  • Ma, Chenfei, Lin, Chuang, Samuel, Oluwarotimi Williams, Guo, Weiyu, Zhang, Hang, Greenwald, Steve, Xu, Lisheng, Li, Guanglin. “A bi-directional LSTM network for estimating continuous upper limb movement from surface electromyography.” IEEE Robotics and Automation Letters 6(4) 7217-7224 (2021). IEEE

  • Chen, Rui, Chen, YuanZhi, Guo, Weiyu, Chen, Chao, Wang, Zheng, Yang, Yongkui. “SEMG-based gesture recognition using GRU with strong robustness against forearm posture.” 2021 IEEE International Conference on Real-time Computing and Robotics (RCAR) 275-280 (2021). IEEE

  • Ma, Chenfei, Guo, Weiyu, Xu, Lisheng, Li, Guanglin. “Finger joint angle estimation based on sEMG signals and deep learning method.” 2021 IEEE International Conference on Real-time Computing and Robotics (RCAR) 638-643 (2021). IEEE

  • Guo, Weiyu, Li, Zhaoshuo, Yang, Yongkui, Wang, Zheng, Taylor, Russell H, Unberath, Mathias, Yuille, Alan, Li, Yingwei. “Context-Enhanced Stereo Transformer.” ECCV2022 (2022)

  • Lin, Chuang, Chen, Xingjian, Guo, Weiyu, Jiang, Ning, Farina, Dario, Su, Jingyong. “A BERT based method for continuous estimation of cross-subject hand kinematics from surface electromyographic signals.” IEEE Transactions on Neural Systems and Rehabilitation Engineering 31 87-96 (2022). IEEE

  • Guo, Weiyu, Jiang, Ning, Farina, Dario, Su, Jingyong, Wang, Zheng, Lin, Chuang, Xiong, Hui. “Multi-attention feature fusion network for accurate estimation of finger kinematics from surface electromyographic signals.” IEEE Transactions on Human-Machine Systems 53(3) 512-519 (2023). IEEE

  • Zhang, He, Sun, Ying, Guo, Weiyu, Liu, Yafei, Lu, Haonan, Lin, Xiaodong, Xiong, Hui. “Interactive interior design recommendation via coarse-to-fine multimodal reinforcement learning.” Proceedings of the 31st ACM International Conference on Multimedia 6472-6480 (2023)

  • Zhang, Gaomin, Guo, Weiyu, Xiong, Xi, Guan, Zhongcheng. “A hybrid approach combining data envelopment analysis and recurrent neural network for predicting the efficiency of research institutions.” Expert Systems with Applications 238 122150 (2024). Pergamon

  • Qiao, Ziyue, Xiao, Meng, Guo, Weiyu, Luo, Xiao, Xiong, Hui. “Information filtering and interpolating for semi-supervised graph domain adaptation.” Pattern Recognition 153 110498 (2024). Pergamon

  • Lu, Yunfan, Xu, Yijie, Ma, Wenzong, Guo, Weiyu, Xiong, Hui. “Event camera demosaicing via swin transformer and pixel-focus loss.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 1095-1105 (2024)

  • Guo, Weiyu, Qiao, Ziyue, Sun, Ying, Xiong, Hui. “Revisiting Noise Resilience Strategies in Gesture Recognition: Short-Term Enhancement in Surface Electromyographic Signal Analysis.” arXiv preprint arXiv:2404.11213 (2024)

  • Chen, Xingjian, Guo, Weiyu, Lin, Chuang, Jiang, Ning, Su, Jingyong. “Cross-subject lifelong learning for continuous estimation from surface electromyographic signal.” IEEE Transactions on Neural Systems and Rehabilitation Engineering (2024). IEEE

  • Guo, Weiyu, Sun, Ying, Xu, Yijie, Qiao, Ziyue, Yang, Yongkui, Xiong, Hui. “SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network.” Neurips 2024 (2024)

  • Wu, Yaqi, Fan, Zhihao, Chu, Xiaofeng, Ren, Jimmy S, Li, Xiaoming, Yue, Zongsheng, Li, Chongyi, Zhou, Shangcheng, Feng, Ruicheng, Dai, Yuekun. “Mipi 2024 challenge on demosaic for hybridevs camera: Methods and results.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 1136-1143 (2024)

  • Lin, Chuang, Zhao, Chunxiao, Zhang, Jianhua, Chen, Chen, Jiang, Ning, Farina, Dario, Guo, Weiyu. “Continuous Estimation of Hand Kinematics from Electromyographic Signals based on Power-and Time-Efficient Transformer Deep Learning Network.” IEEE Transactions on Neural Systems and Rehabilitation Engineering (2024). IEEE

  • Yunfan, LU, Xu, Xiaogang, Hao, LU, Qian, Yanlin, Yang, Bin, Li, Junyi, Cai, Qianyi, Guo, Weiyu, Xiong, Hui. “SEE: See Everything Every Time-Broader Light Range Image Enhancement via Events.” (n.d.)

  • Guo, Weiyu, Sun, Guoying, He, JianXiang, Shao, Tong, Wang, Shaoguang, Chen, Ziyang, Hong, Meisheng, Sun, Ying, Xiong, Hui. “A Survey of fMRI to Image Reconstruction.” arXiv preprint arXiv:2502.16861 (2025)

  • Lu, Yunfan, Xu, Xiaogang, Lu, Hao, Qian, Yanlin, Li, Pengteng, Yao, Huizai, Yang, Bin, Li, Junyi, Cai, Qianyi, Guo, Weiyu. “SEE: See Everything Every Time–Adaptive Brightness Adjustment for Broad Light Range Images via Events.” arXiv preprint arXiv:2502.21120 (2025)

  • Guo, Weiyu, Chen, Ziyang, Wang, Shaoguang, He, Jianxiang, Xu, Yijie, Ye, Jinhui, Sun, Ying, Xiong, Hui. “Logic-in-Frames: Dynamic Keyframe Search via Visual Semantic-Logical Verification for Long Video Understanding.” arXiv preprint arXiv:2503.13139 (2025)

Selected Patents

  • Training method, training device of continuous motion information prediction model PCT/CN2020/133443
  • Intelligent interactive glove with AI chip, interactive method and storage medium PCT/CN2021/107108
  • Power efficiency test method, adjustment method, computer equipment CN202010389035.4
  • An in-memory computing accelerator and its optimization method CN202011406904.6
  • An automatic optimization method of graph data processing framework CN202011358762.0

🏅 Awards

  • National scholarship for Postgraduates 2021
  • The President Scholarship of CAS 2021
  • Merit Student of UCAS 2020
  • Outstanding graduates of DUT (top 1%) 2019
  • Merit Student of DUT 2018
  • Outstanding graduates of Liaoning Province (top 1%) 2019