Zhouhui Lian(连宙辉)

Associate Professor, Ph.D.

Wangxuan Institute of Computer Technology (WICT)

Peking University

No. 128 Zhongguancun North Street, Haidian District Beijing, China

Phone: 86-10-82529245

Email: lianzhouhui@pku.edu.cn Our research group: IGCL

(中文版)

News

Bio

Research

Achievements

Publications

Courses

Others

News:

     [2022-09-05] Our paper "SinMPI: Novel View Synthesis from a Single Image with Expanded Multiplane Images" has been accepted by SIGGRAPH Asia 2023 (source code and data are available)

     [2023-03-08] I will serve as an Area Chair for NeurIPS 2023.

     [2023-03-01] Our papers "DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Quality" and "VecFontSDF: Learning to Reconstruct and Synthesize High-quality Vector Fonts via Signed Distance Functions" have been accepted by CVPR 2023 (source code and data are available)

     [2022-09-14] I will serve as an Area Chair for CVPR 2023.

     [2022-09-05] Our paper "DifferSketching: How Differently Do People Sketch 3D Objects?" has been accepted in ACM Transactions on Graphics (to be presented at SIGGRAPH Asia 2022)

     [2022-07-07] Our paper "Semi-supervised Semantic Segmentation via Prototypical Contrastive Learning" has been accepted by ACM MM 2022 (source code and data)

     [2022-04-26] Our paper "DCT-Net: Domain-calibrated Translation for Portrait Stylization" has been accepted in ACM Transactions on Graphics (to be presented at SIGGRAPH 2022) and our paper "CVFont: Synthesizing Chinese Vector Fonts via Deep Layout Inferring" has been accepted in Computer Graphics Forum (CGF) (Code and data will be available)  

     [2022-03-20] Our paper "Controllable Image Synthesis with Attribute-Decomposed GAN" has been accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) (Source code will be updated soon)

     [2022-03-02] Our papers "Aesthetic Text Logo Synthesis via Content-aware Layout Inferring" and "Unpaired Cartoon Image Synthesis via Gated Cycle Mapping" have been accepted by CVPR 2022 (source code and data are available)

     [2021-09-29] Our paper "CentripetalText: An Efficient Text Instance Representation for Scene Text Detection" has been accepted by NeurIPS 2021 (source code)

     [2021-08-05] Our paper "DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning" has been accepted in ACM Transactions on Graphics (to be presented at SIGGRAPH Asia 2021

Representative Works:


Bio:

I was graduated from School of Automation Science and Electrical Engineering, Beihang University in Sep. 2011 with Ph.D. From Jan. 2008 to Jan. 2009, supported by the China Scholarship Council (CSC), I visited School of Computer Science, Cardiff University, UK as a visiting scholar. Then, I worked as a Guest Researcher at the Information Technology Lab (ITL), National Institute of Standards and Technology (NIST), U.S. from Jul. 2009 to Jul. 2011. After that, I came back to China and worked as a postdoctoral researcher at ICST, Peking University, where I became an Assistant Professor in Jun. 2013 and was promoted to Associate Professor in Aug. 2015.

Education:

Working Experience:


Research:                    Back to top

My research interests include Computer Graphics, Computer Vision, Pattern Recognition and Artificial Intelligence. More specifically, we have been working on the following topics in last few years. (1) Easy/automatic generation of large-scale Chinese font libraries. we proposed a series of solutions including radical assembling based and style learning based methods, making the easy/automatic generation of large-scale Chinese fonts become possible. (2) Calligraphic aesthetic assessment and font recognition. We proposed to adopt several machine learning approaches (e.g., artificial neural networks, sparse coding, etc.) to effectively evaluate the aesthetic visual quality of Chinese handwritings and recognize font styles. (3) Non-rigid 3D shape retrieval. We developed a number of canonical form construction methods to covert non-rigid 3D shape searching tasks into rigid cases, for which several view-based 3D shape matching approaches are proposed to effectively address the problems.

 

Students:

PhD Students:

Yitian Liu

Guo Pu

Master Students:

Shiyao Xu

Shilong Li

Bojun Xiong

Hua Li

Jialei Cui

Yuqing Wang

 

Alumni

Zeqing Xia (PhD 2023)

Yizhi Wang (PhD 2022)

Zenggui Chen (Master 2023)

Jie Chen (Master 2021)

Yue Gao (Master 2021)

Shuseng Tang (Master 2021)

Tao Sheng (Master 2021)

Xiang Zhang (Master 2021)

Yifang Men (Master 2020)

Xiao Sun (Master 2020)

Yichen Gao (Master 2020)

Wenguan Wang (Master 2020)

Juncheng Liu (PhD 2019)

Yuan Guo (Master 2019)

Yue Jiang (Master 2019)

Xudong Chen (Master 2017)

Chendong Liu (Master 2017)

Weikang Song (Master 2016)

Rongju Sun (Master 2016)

Wanqiong Pan (Master 2015)

Hao Sun (Master 2015)

Jun Zhang (Master 2015)

Wenyan Dong (Master 2015)

Tianyang Yi (Master 2014)

Chenxi Wang (Master 2013)

Yang Liu (Master 2012)

Hongmei Li (Master 2012)

 

Reading List:

2019

               

Achievements:                    Back to top

I have published more than 70 academic papers, including 1 ESI Highly Cited Paper (top 1%), 5 full papers in ACM Transactions on Graphics (TOG), 1 full paper in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 3 full papers in International Journal of Computer Vision (IJCV, a top-tier journal in Computer Vision), and several top conference (e.g., SIGGRAPH/SIGGRAPH Asia, CVPR, NeurIPS, IJCAI, AAAI, MM, etc.) papers. I was the principal investigator of several projects funded by the National Natural Science Foundation of China, Beijing Nova Program of Science and Technology, etc., and have led our group to successfully develop two practical systems for the generation of Chinese fonts. These systems and techniques related to computer fonts have been adopted by a company called Founder Handwriting since 2016 to create font products that have served millions of users, making significant social and economic benefits. Our works on 3D shape analysis and retrieval have been cited more than 2000 times (until March 2022) by papers published in prestigious journals and conferences including IJCV, TPAMI, TOG, CVPR, etc.

 

               

Publications (selected):         Back to top

    1. G. Pu, Y. Men, Y. Mao, Y. Jiang, W. Ma, Z. Lian*. Controllable Image Synthesis with Attribute-Decomposed GAN. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). 2022 (Accepted) (Code)
    2. C. Xiao, W. Su, J. Liao, Z. Lian, Y. Song, H. Fu. How Differently Do People Sketch 3D Objects? ACM Transactions on Graphics (TOG) (presented at SIGGRAPH Asia 2022) (CCF-A) 
    3. Y. Men, Y. Yao, M. Cui, Z. Lian*, X. Xie. DCT-Net: Domain-calibrated Translation for Portrait Stylization. ACM Transactions on Graphics (TOG). (Accepted)(to be presented at SIGGRAPH 2022) (CCF-A)
    4. Y. Wang, Z. Lian*. DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning. ACM Transactions on Graphics (TOG) (presented at SIGGRAPH Asia 2021) (CCF-A) (Code)
    5. Y. Wang, Y. Gao, Z. Lian*. Attribute2Font: Creating Fonts You Want From Attributes. ACM Transactions on Graphics (TOG) (presented at SIGGRAPH 2020) (CCF-A) (Code)
    6. Z. Lian*, B. Zhao, X. Chen, J. Xiao. EasyFont: A Style Learning based System to Easily Build Your Large-scale Handwriting Fonts. ACM Transactions on Graphics (TOG). vol. 38, no. 1, Article No. 6, 2019 (presented at SIGGRAPH 2019) (CCF-A) (Code&Data)
    7. Y. Gao, Y. Guan, Z. Lian*, Y. Tang, J. Xiao.  Artistic Glyph Image Synthesis via One-Stage Few-Shot Learning. ACM Transactions on Graphics (TOG). vol. 38, no. 6, Article No. 185, 2019 (presented at SIGGRAPH Asia 2019) (CCF-A) (Code)
    8. Z. Lian*, Y. Gao. CVFont: Synthesizing Chinese Vector Fonts via Deep Layout Inferring,  Computer Graphics Forum (CGF), 2022 (Accepted) (CCF-B)
    9. S. Tang, Z. Lian*. Write Like You: Synthesizing Your Cursive Online Chinese Handwriting via Metric-based Meta Learning, Computer Graphics Forum (CGF) (presented at Eurographics 2021) (CCF-B) (Code)
    10. S. Tang, Z. Xia, Z. Lian*, Y. Tang, J. Xiao. FontRNN: Generating Large-scale Chinese Fonts via Recurrent Neural Network,  Computer Graphics Forum (CGF) , vol. 38, no. 7, 2019 (CCF-B) (Code)
    11. D. Pickup, X. Sun, P. L. Rosin, R. R. Martin, Z. Cheng, Z. Lian, M. Aono, A. Ben Hamza, A. Bronstein, M. Bronstein, S. Bu, U. Castellani, S. Cheng, V. Garro, A. Giachetti, A. Godil, L. Isaia, J. Han, H. Johan, L. Lai, B. Li, C. Li, H. Li, R. Litman, X. Liu, Z. Liu, Y. Lu, L. Sun, G. Tam, A. Tatsuma, J. Yeshow less. Shape Retrieval of Non-rigid 3D Human Models. International Journal of Computer Vision (IJCV). vol. 120, no. 2, pp. 169-193, 2016 (CCF-A)
    12. Z. Lian*, A. Godil, et al. A Comparison of Methods for Non-rigid 3D Shape Retrieval, Pattern Recognition (PR), vol. 46, no. 1, pp.449-461, 2013 (ESI Highly Cited Paper (top 1%)) (CCF-B) (Data)
    13. Z. Lian*, A. Godil, J. Xiao. Feature-preserved 3D Canonical Form, International Journal of Computer Vision (IJCV), vol. 102, no. 1-3, pp. 221-238, 2013 (CCF-A)
    14. Z. Lian*, P.L. Rosin, X. Sun. Rectilinearity of 3D meshes, International Journal of Computer Vision (IJCV), vol. 89, no. 2-3, pp. 130-151, 2010 (CCF-A)
    15. Y. Wang, Y. Wang, L. Yu, Y. Zhu, Z. Lian*. DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Quality. CVPR 2023 (accepted) (CCF-A)
    16. Z. Xia, B. Xiong, Z. Lian*. VecFontSDF: Learning to Reconstruct and Synthesize High-quality Vector Fonts via Signed Distance Functions. CVPR 2023 (accepted) (CCF-A)
    17. Z. Chen, Z. Lian*. Semi-supervised Semantic Segmentation via Prototypical Contrastive Learning. ACM MM 2022 (CCF-A) 
    18. Y. Wang, G. Pu, W. Luo, Y. Wang, P. Xiong, H. Kang, Z. Lian*. Aesthetic Text Logo Synthesis via Content-aware Layout Inferring. CVPR 2022 (CCF-A) (Code)
    19. Y. Men, Y. Yao, M. Cui, Z. Lian, X. Xie, X. Hua. Unpaired Cartoon Image Synthesis via Gated Cycle Mapping. CVPR 2022(CCF-A)
    20. T. Sheng, J. Chen, Z. Lian*. CentripetalText: An Efficient Text Instance Representation for Scene Text Detection, NeurIPS 2021 (CCF-A) (Code)
    21. Y. Gao, F. Wei, J. Bao, S. Gu, D. Chen, F. Wen, Z. Lian*. High-Fidelity and Arbitrary Face Editing, CVPR 2021 (CCF-A)
    22. X. Zhang, X. Sun, Z. Lian*. BoW Pooling: A Plug-and-Play Unit for Feature Aggregation of Point Clouds, AAAI 2021 (CCF-A)
    23. Y. Liu, Z. Lian*. FontRL: Chinese Font Synthesis via Deep Reinforcement Learning, AAAI 2021 (CCF-A)
    24. Y. Men, Y. Mao, Y. Jiang, W. Ma, Z. Lian*. Controllable Person Image Synthesis with Attribute-Decomposed GAN. CVPR 2020, pp. 5084-5093, 2020 (Oral, Acceptance rate 5.7%) (CCF-A) (Code)
    25. Y. Wang, Z. Lian*. Exploring Font-independent Features for Scene Text Recognition. ACM MM, 2020 (CCF-A) (Code)
    26. X. Sun, Z. Lian*, J. Xiao, SRINet: Learning Strictly Rotation-Invariant Representations for Point Cloud Classification and Segmentation, ACM MM, 2019 (CCF-A)
    27. Y. Jiang, Z. Lian*, Y. Tang, J. Xiao. SCFont: Structure-guided Chinese Font Generation via Deep Stacked Networks, AAAI 2019 (CCF-A)
    28. Y. Men, Z. Lian*, Y. Tang, J. Xiao. DynTypo: Example-based Dynamic Text Effects Transfer. CVPR 2019, pp. 5870-5879, 2019 (CCF-A)
    29. Y. Men, Z. Lian*, Y. Tang, J. Xiao. A Common Framework for Interactive Texture Transfer. CVPR 2018, pp. 6353-6362, 2018 (Spotlight, Acceptance rate 6.7%) (CCF-A)
    30. J. Liu, Z. Lian*, Y. Wang, J. Xiao. Incremental Kernel Null Space Discriminant Analysis for Novelty Detection. CVPR 2017, pp. 792-800, 2017 (CCF-A)  (Data&Code)
    31. S. Yang, J. Liu, Z. Lian, Z. Guo. Awesome Typography: Statistics-Based Text Effects Transfer. CVPR 2017, pp. 2886-2895 (CCF-A)
    32. R. Sun, Z. Lian*, Y. Tang, J. Xiao. Aesthetic Visual Quality Evaluation of Chinese Handwritings. IJCAI 2015, pp. 2510-2516, 2015 (CCF-A) (Data)
    33. Z. Lian*, A. Godil, P.L. Rosin, X. Sun. A New Convexity Measurement for 3D Meshes, CVPR 2012, pp. 119-126, 2012 (CCF-A)

Full list


Courses:       Back to top

  1. Spring (2014~now): Elementary Number Theory

  2. Fall (2017~now): Intelligent Optimization Methods


Awards:       Back to top

  1. 2021, China Patent Award of Excellence (ranked 1st)

  2. 2020-2021, CVPR Outstanding Reviewer

  3. 2019, Wu Wenjun Outstanding Youth Award of Artificial Intelligence, CAAI

  4. 2018, First class award of "Wang Xuan young teacher award" in ICST, Peking University

  5. 2014, First class award of the 14th teaching skill contest for young teachers in Peking University (top 2)

  6. 2012, Excellent postdoctoral researcher in Peking University (top 1%)


Research Activities 

  1. Area Chairs for NeurIPS-23, CVPR-23, ICCV-21; SPCs for  IJCAI-21, AAAI-22.

  2. IEEE/ACM/CAAI member, CCF/CSIG senior member

  3. Reviewers for journals including TPAMI, ACM Transactions on Graphics, TIP, TMM, ACM TOMM, Pattern Recognition, IJDAR, Multimedia Systems, Parallel Computing, Computers & Graphics, The Visual Computer, International Journal of Machine Learning and Cybernetics, Displays, etc.

  4. PC members for CVPR, ICCV, IJCAI, AAAI, MM, ECCV, ICDAR, ICIP, ACCV, WACV, EG 3DOR, etc.

  5. Talk: 2020-08-02, VALSE 2020, "Glyph Image and Shape Synthesis and Their Applications"

  6. Talk: 2020-05-18, CVPR pre-conference 2020, "Controllable Person Image Synthesis with Attribute-Decomposed GAN"


Last update on

Aug. 13, 2020

                                         

visits since May. 2015