Shuo Ren (任烁)

Shuo Ren (任烁)

Introduction

I am currently an associate researcher at the Institute of Automation, Chinese Academy of Sciences (CASIA). I received my PhD in June 2021 under the supervision of Prof. Shuai Ma of Beihang University (BUAA) and Prof. Ming Zhou of MSRA.

Email: renshuo@microsoft.com

Research Interests

Neural Machine Translation, Low-resource and Unsupervised Machine Translation, Muti-modal pre-training

Publications

Journal & Conference Papers

  • 2022
    • Shuo Ren, Shujie Liu, Yu Wu, Long Zhou, Furu Wei, Speech Pre-training with Acoustic Piece, (INTERSPEECH 2022). paper
    • Wei Wang, Shuo Ren, Yao Qian, Shujie Liu, Yu Shi, Yanmin Qian, Michael Zeng, Optimizing Alignment of Speech and Language Latent Spaces for End-to-End Speech Recognition and Understanding, (ICASSP 2022). paper
    • Junyi Ao, Rui Wang, Long Zhou, Shujie Liu, Shuo Ren, Yu Wu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei, Speecht5: Unified-modal Encoder-decoder Pre-training for Spoken Language Processing, The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022). paper
    • Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei, WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing, (submitted to the IEEE Journal of Selected Topics in Signal Processing). paper
  • 2021
    • Shuo Ren, Long Zhou, Shujie Liu, Furu Wei, Ming Zhou, Shuai Ma, SemFace: Pre-training Encoder and Decoder with a Semantic Interface for Neural Machine Translation, The 59th Annual Meeting of the Association for Computational Linguistics (ACL 2021). paper
    • Daya Guo, Shuo Ren, Shuai Lu, et al., Graphcodebert: Pre-training Code Representations with Data Flow, The 9th International Conference on Learning Representations (ICLR 2021). paper
    • Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, et al., CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation, NeurIPS 2021 Datasets and Benchmarks Track. paper
  • 2020
    • Shuo Ren, Shujie Liu, Ming Zhou, Shuai Ma, A Graph-based Coarse-to-fine Method for Unsupervised Bilingual Lexicon Induction, The 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020). paper
    • Shuo Ren, Yu Wu, Shujie Liu, Ming Zhou, Shuai Ma, A Retrieve-and-Rewrite Initialization Method for Unsupervised Machine Translation, The 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020). paper
    • Chengyi Wang, Yu Wu, Yujiao Du*, Jinyu Li*, Shujie Liu*, Liang Lu*, Shuo Ren*, Guoli Ye, Sheng Zhao, Ming Zhou, Semantic Mask for Transformer based End-to-End Speech Recognition, (INTERSPEECH 2020). (* alphabetical order) paper
  • 2019
    • Shuo Ren, Yu Wu, Shujie Liu, Ming Zhou, Shuai Ma, Explicit Cross-lingual Pre-training for Unsupervised Machine Translation, 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP 2019). paper
    • Shuo Ren*, Zhirui Zhang*, Shujie Liu, Ming Zhou and Shuai Ma, Unsupervised Neural Machine Translation with SMT as Posterior Regularization, The 33rd AAAI Conference on Artificial Intelligence (AAAI 2019). (* equal contribution) paper
  • 2018
    • Shuo Ren, Wenhu Chen, Shujie Liu, Mu Li, Ming Zhou, Shuai Ma, Triangular Architecture for Rare Language Translation, The 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018). paper
    • Wenhu Chen, Guanlin Li, Shuo Ren, Shujie Liu, Zhirui Zhang, Mu Li, Ming Zhou, Generative Bridging Network for Neural Sequence Prediction, The 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2018). paper
  • 2016
    • Chen Shi, Shujie Liu, Shuo Ren, Shi Feng, Mu Li, Ming Zhou‡, Xu Sun, Houfeng Wang, Knowledge-Based Semantic Embedding for Machine Translation, The 54th Annual Meeting of the Association for Computational Linguistics (ACL 2018). paper

Preprints

  • Zhirui Zhang*, Shuo Ren*, Shujie Liu, Jianyong Wang, Peng Chen, Mu Li, Ming Zhou and Enhong Chen, Style Transfer as Unsupervised Machine Translation, 2018. (* equal contribution) paper

Education and Experience

Education

  • Sept. 2016 - 2021
    • Ph.D. candidate in Computer Science & Joint Ph.D. Program with Microsoft Research Asia Beihang University
  • Sept. 2012 - June 2016
    • B.S. in Computer Science Beihang University

Research Experience

  • January 2024 till Now *
    • Associate Researcher, CASIA
  • July 2021 - August 2022 *
    • Researcher, MSRA
  • June 2017 - 2021
    • Research Intern, Natural Language Computing Group, Microsoft Research Asia Conducting researching in Machine Translation, mentored by Shujie Liu.
  • July 2015 - July 2016
    • Research Intern, Natural Language Computing Group, Microsoft Research Asia Conducting researching in NLP, mentored by Mu Li.

Award

  • 2019 National Scholarship