Jiakai Sun

I am currently pursuing a master's degree in Software Engineering at the College of Computer Science and Technology (CCST) of Zhejiang University (ZJU). I earned my bachelor's degree from CCST, ZJU, in 2022.

My research interests are centered around Computer Graphics and Computer Vision. I am particularly focused on Neural Rendering, Inverse Rendering, and 3D Vision, exploring the cutting-edge developments within these domains.

I will complete my Master's in March 2025 and am actively seeking job opportunities. Please contact me if you're interested in my background 😊

Email  /  GitHub  /  Google Scholar  

profile photo

Selected Publications

project image

3DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videos



Jiakai Sun, Han Jiao, Guangyuan Li, Zhanjie Zhang, Lei Zhao, Wei Xing
CVPR, 2024 (Highlight)
project / paper / code /

We introduce a system designed for efficient Free-Viewpoint Videos streaming of real-world dynamic scenes, achieving fast on-the-fly per-frame reconstruction within 12 seconds and real-time rendering at 200 FPS.

project image

Joint Optimization of Triangle Mesh, Material, and Light from Neural Fields with Neural Radiance Cache



Jiakai Sun, Zhanjie Zhang, Tianyi Chu, Guangyuan Li, Lei Zhao, Wei Xing
Arxiv, 2023
paper /

Our framework merges neural fields and radiance caching to account for global illuination in single-bounce differentiable Monte Carlo ray tracing, achieving high-quality mesh and material reconstruction.

project image

VGOS: Voxel Grid Optimization for View Synthesis from Sparse Inputs



Jiakai Sun, Zhanjie Zhang, Jiafu Chen, Guangyuan Li, Boyan Ji, Lei Zhao, Wei Xing
IJCAI, 2023
project / paper / code /

We present a novel approach that rapidly reconstructs high-quality radiance fields from as few as 3-10 views in just 3-5 minutes, overcoming the limitations of voxel grid overfitting and artifacts in sparse input scenarios through an incremental training strategy and regularization techniques.




Other Publications

Single-Mask Inpainting for Voxel-based Neural Radiance Fields



Jiafu Chen, Tianyi Chu, Jiakai Sun, Wei Xing*, Lei Zhao*


*Corresponding Authors

ECCV, 2024

Rethinking Video Deblurring with Wavelet-Aware Dynamic Transformer and Diffusion Model



Chen Rao^, Guangyuan Li^*, Zehua Lan, Jiakai Sun, Junsheng Luan, Wei Xing*, Lei Zhao*, Huaizhong Lin, Jianfeng Dong, Dalong Zhang

^Equal Contribution
*Corresponding Authors

ECCV, 2024

PNeSM: Arbitrary 3D Scene Stylization via Prompt-Based Neural Style Mapping



Jiafu Chen, Wei Xing*, Jiakai Sun, Tianyi Chu, Yiling Huang, Boyan Ji, Lei Zhao*, Huaizhong Lin*, Haibo Chen, Zhizhong Wang*


*Corresponding Authors

AAAI, 2024

ArtBank: Artistic Style Transfer with Pre-trained Diffusion Model and Implicit Style Prompt Bank



Zhanjie Zhang, Quanwei Zhang, Guangyuan Li, Wei Xing*, Lei Zhao*, Jiakai Sun, Zehua Lan, Junsheng Luan, Yiling Huang, Huaizhong Lin*


*Corresponding Authors

AAAI, 2024
paper / code /

Attack Deterministic Conditional Image Generative Models for Diverse and Controllable Generation



Tianyi Chu, Wei Xing, Jiafu Chen, Zhizhong Wang, Jiakai Sun, Lei Zhao*, Haibo Chen, Huaizhong Lin*


*Corresponding Authors

AAAI, 2024
code /

DuDoINet: Dual-Domain Implicit Network for Multi-Modality MR Image Arbitrary-scale Super-Resolution



Guangyuan Li, Wei Xing*, Lei Zhao*, Zehua Lan, Zhanjie Zhang, Jiakai Sun, Haolin Yin, Huaizhong Lin, Zhijie Lin


*Corresponding Authors

ACM Multimedia, 2023
paper /

Self-Reference Image Super-Resolution via Pre-trained Diffusion Large Model and Window Adjustable Transformer



Guangyuan Li, Wei Xing*, Lei Zhao*, Zehua Lan, Jiakai Sun, Zhanjie Zhang, Quanwei Zhang, Huaizhong Lin, Zhijie Lin


*Corresponding Authors

ACM Multimedia, 2023
paper / code /

Rethinking fast fourier convolution in image inpainting



Tianyi Chu, Jiafu Chen, Jiakai Sun, Shuobin Lian, Zhizhong Wang, Zhiwen Zuo*, Lei Zhao, Wei Xing, Dongming Lu


*Corresponding Authors

ICCV, 2023
paper /

Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling



Guangyuan Li, Lei Zhao*, Jiakai Sun, Zehua Lan, Zhanjie Zhang, Jiafu Chen, Zhijie Lin, Huaizhong Lin, Wei Xing*


*Corresponding Authors

ICCV, 2023
paper / code /





Source code from Leonid Keselman's website, which is designed from Jon Barron's website.