Article Source

awesome neural rendering

Neural Rendering

Intruduction of Neural Rendering

Neural Rendering is a new and rapidly emerging field that combines generative machine learning techniques with physical knowledge from computer graphics, e.g., by the integration of differentiable rendering into network training.

Ayush Tewari et. al. define Neural Rendering as

Deep image or video generation approaches that enable explicit or implicit control of scene properties such as illumination, camera parameters, pose, geometry, appearance, and semantic structure.

A typical neural rendering approach takes as input images corresponding to certain scene conditions (for example, viewpoint, lighting, layout, etc.), builds a “neural” scene representation from them, and “renders” this representation under novel scene properties to synthesize novel images.

CVPR 2020 tutorial define Neural Rendering as

Neural rendering is a new class of deep image and video generation approaches that enable explicit or implicit control of scene properties such as illumination, camera parameters, pose, geometry, appearance, and semantic structure. It combines generative machine learning techniques with physical knowledge from computer graphics to obtain controllable and photo-realistic outputs.

Given high-quality scene specifications, Classic Rendering Methods can render photorealistic images for a variety of complex real-world phenomena. Moreover, rendering gives us explicit editing control over all the elements of the scene-camera viewpoint, lighting, geometry and materials. However, building high-quality scene models, especially directly from images, requires significant manual effort, and automated scene modeling from images is an open research problem. On the other hand, Deep Generative Networks are now starting to produce visually compelling images and videos either from random noise, or conditioned on certain user specifications like scene segmentation and layout. However, they do not yet allow for fine-grained control over scene appearance and cannot always handle the complex, non-local, 3D interactions between scene properties. In contrast, neural rendering methods hold the promise of combining these approaches to enable controllable, high-quality synthesis of novel images from input images/videos.

Advances in Neural Rendering.
Ayush Tewari*, Justus Thies*, Ben Mildenhall*, Pratul Srinivasan*, Edgar Tretschk, Yifan Wang, Christoph Lassner, Vincent Sitzmann, Ricardo Martin-Brualla, Stepehen Lombardi, Tomas Simon, Christian Theobalt, Matthias Niessner, Jonathan T. Barron, Gordon Wetzstein, Michael Zollhoefer, and Vladislav Golyanik.
Eurographics State-of-the-Art Report 2022.

State of the Art on Neural Rendering.
Ayush Tewari, Ohad Fried, Justus Thies, Vincent Sitzmann, Stephen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Nießner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Shechtman, Dan B Goldman, Michael Zollhöfer.
Eurographics 2020.

CVPR 2020 tutorial on Neural Rendering.
Ayush Tewari, Ohad Fried, Justus Thies, Vincent Sitzmann, Stephen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Nießner, Rohit K. Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Shechtman, Dan B. Goldman, Michael Zollhöfer.

Differentiable Rendering: A Survey.
Hiroharu Kato, Deniz Beker, Mihai Morariu, Takahiro Ando, Toru Matsuoka, Wadim Kehl, Adrien Gaidon.

Neural Inverse Rendering (Neural De-rendering)

GAN2X: Non-Lambertian Inverse Rendering of Image GANs.
Xingang Pan, Ayush Tewari, Lingjie Liu, Christian Theobalt.
3DV 2022. [PDF] [Project]

Modeling Indirect Illumination for Inverse Rendering.
Yuanqing Zhang, Jiaming Sun, Xingyi He, Huan Fu, Rongfei Jia, Xiaowei Zhou.
CVPR 2022. [PDF]

IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenes.
Rui Zhu, Zhengqin Li, Janarbek Matai, Fatih Porikli, Manmohan Chandraker.
CVPR 2022. [PDF]

De-rendering 3D Objects in the Wild.
Felix Wimbauer, Shangzhe Wu, Christian Rupprecht.
CVPR 2022. [PDF] [Project]

NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination.
Xiuming Zhang, Pratul P. Srinivasan, Boyang Deng, Paul Debevec, William T. Freeman, Jonathan T. Barron.
SIGGRAPH Asia (TOG) 2021. [PDF] [Project] [Github]

Unified Shape and SVBRDF Recovery using Differentiable Monte Carlo Rendering.
Fujun Luan, Shuang Zhao, Kavita Bala, Zhao Dong.
EGSR 2021. [PDF] [Project] [Video]

PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting.
Kai Zhang, Fujun Luan, Qianqian Wang, Kavita Bala, Noah Snavely.
CVPR 2021. [PDF] [Project]

Invertible Neural BRDF for Object Inverse Rendering.
Zhe Chen, Shohei Nobuhara, Ko Nishino.
ECCV 2020. [PDF]

Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF From a Single Image.
Zhengqin Li, Mohammad Shafiei, Ravi Ramamoorthi, Kalyan Sunkavalli, Manmohan Chandraker.
CVPR 2020.[PDF] [Project] [Github]

Polarimetric Multi-View Inverse Rendering.
Jinyu Zhao, Yusuke Monno, Masatoshi Okutomi.
ECCV 2020. [PDF]

NiLBS: Neural Inverse Linear Blend Skinning.
Timothy Jeruzalski, David I.W. Levin, Alec Jacobson, Paul Lalonde, Mohammad Norouzi, Andrea Tagliasacchi.
arxiv 2020. [PDF]

Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer.
Wenzheng Chen, Jun Gao, Huan Ling, Edward J. Smith, Jaakko Lehtinen, Alec Jacobson, Sanja Fidler.
NeurIPS 2019. [PDF]

DRWR: A Differentiable Renderer without Rendering for Unsupervised 3D Structure Learning from Silhouette Images.
Zhizhong Han, Chao Chen, Yu-Shen Liu, Matthias Zwicker.
ICML 2020. [PDF]

InverseRenderNet: Learning Single Image Inverse Rendering.
Ye Yu, William A. P. Smith.
CVPR 2019. [PDF] [Github] [IIW Dataset]

Learning Inverse Rendering of Faces from Real-world Videos.
Yuda Qiu, Zhangyang Xiong, Kai Han, Zhongyuan Wang, Zixiang Xiong, Xiaoguang Han.
arxiv 2020. [PDF] [Github]

Neural Rerendering

MetaNLR: Fast Training of Neural Lumigraph Representations using Meta Learning.
Alexander W. Bergman, Petr Kellnhofer, and Gordon Wetzstein.
arxiv 2021. [PDF] [Project] [Video]

Hybrid Neural Fusion for Full-frame Video Stabilization.
Yu-Lun Liu, Wei-Sheng Lai, Ming-Hsuan Yang, Yung-Yu Chuang, Jia-Bin Huang.
arxiv 2021. [PDF] [Github]

StyleUV: Diverse and High-fidelity UV Map Generative Model.
Myunggi Lee, Wonwoong Cho, Moonheum Kim, David Inouye, Nojun Kwak.
arxiv 2020. [PDF]

Neural Lumigraph Rendering.
Petr Kellnhofer, Lars Jebe, Andrew Jones, Ryan Spicer, Kari Pulli, Gordon Wetzstein.
CVPR 2021. [PDF] [Project] [Data]

Neural Re-Rendering of Humans from a Single Image.
Kripasindhu Sarkar, Dushyant Mehta, Weipeng Xu, Vladislav Golyanik, Christian Theobalt.
ECCV 2020. [PDF]

Neural Rerendering in the Wild.
Moustafa Meshry, Dan B Goldman, Sameh Khamis, Hugues Hoppe, Rohit Pandey, Noah Snavely, Ricardo Martin-Brualla.
CVPR 2019. [PDF]

Revealing Scenes by Inverting Structure from Motion Reconstructions.
Francesco Pittaluga, Sanjeev J. Koppal, Sing Bing Kang, Sudipta N. Sinha.
CVPR 2019. [PDF]

Differentiable Rendering

ShAPO: Implicit Representations for Multi Object Shape Appearance and Pose Optimization.
Muhammad Zubair Irshad, Sergey Zakharov, Rares Ambrus, Thomas Kollar, Zsolt Kira, Adrien Gaidon
ECCV 2022. [Paper] [Webpage] [Video]

Differentiable Volumetric Rendering (DVR): Learning Implicit 3D Representations without 3D Supervision.
Michael Niemeyer, Lars Mescheder, Michael Oechsle, Andreas Geiger.
CVPR 2020. [PDF] [Github]

Modular Primitives for High-Performance Differentiable Rendering.
Samuli Laine, Janne Hellsten, Tero Karras, Yeongho Seol, Jaakko Lehtinen, Timo Aila.
TOG 2020. [PDF] [Github]

Neural Re-Rendering of Humans from a Single Image.
Kripasindhu Sarkar, Dushyant Mehta, Weipeng Xu, Vladislav Golyanik, Christian Theobalt.
ECCV 2020. [PDF]

Monocular Differentiable Rendering for Self-Supervised 3D Object Detection.
Deniz Beker, Hiroharu Kato, Mihai Adrian Morariu, Takahiro Ando, Toru Matsuoka, Wadim Kehl, Adrien Gaidon.
ECCV 2020. [PDF]

Volumetric Performance Capture (Free Viewpoint Video)

Free-Viewpoint RGB-D Human Performance Capture and Rendering.
Phong Nguyen, Nikolaos Sarafianos , Christoph Lassner, Janne Heikkila, Tony Tung.
ECCV 2022. [PDF] [Project]

HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capture.
Ziyan Wang, Giljoo Nam, Tuur Stuyck, Stephen Lombardi, Michael Zollhoefer, Jessica Hodgins, Christoph Lassner.
CVPR 2022. [PDF] [Project]

Appearance Editing with Free-viewpoint Neural Rendering.
Pulkit Gera, Aakash KT, Dhawal Sirikonda, Parikshit Sakurikar, P.J. Narayanan.
arxiv 2021. [PDF]

Geometry-Free View Synthesis: Transformers and No 3D Priors.
Robin Rombach, Patrick Esser, Bjorn Ommer.
ICCV 2021. [PDF]

iButter: Neural Interactive Bullet Time Generator for Human Free-viewpoint Rendering.
Liao Wang, Ziyu Wang, Pei Lin, Yuheng Jiang, Xin Suo, Minye Wu, Lan Xu, Jingyi Yu.
ACM MM 2021. [PDF]

ST-NeRF: Editable Free-viewpoint Video Using a Layered Neural Representation.
Jiakai Zhang, Xinhang Liu, Xinyi Ye, Fuqiang Zhao, Yanshun Zhang, Minye Wu, Yingliang Zhang, Lan Xu, Jingyi Yu.
SIGGRAPH 2021. [PDF] [Project] [Github]

POSEFusion: Pose-guided Selective Fusion for Single-view Human Volumetric Capture.
Zhe Li, Tao Yu, Zerong Zheng, Kaiwen Guo, Yebin Liu.
CVPR 2021 (oral). [PDF] [Github]

NSVF: Neural Sparse Voxel Fields.
Lingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua, Christian Theobalt.
NeurIPS 2020. [PDF] [Project] [Code]

Monocular Real-Time Volumetric Performance Capture.
Ruilong Li, Yuliang Xiu, Shunsuke Saito, Zeng Huang, Kyle Olszewski, Hao Li.
ECCV 2020. [PDF]

Volumetric Capture of Humans with a Single RGBD Camera via Semi-Parametric Learning.
Rohit Pandey, Anastasia Tkach, Shuoran Yang, Pavel Pidlypenskyi, Jonathan Taylor, Ricardo Martin-Brualla, Andrea Tagliasacchi, George Papandreou, Philip Davidson, Cem Keskin, Shahram Izadi, Sean Fanello.
CVPR 2019. [PDF]

Neural Volumes: Learning Dynamic Renderable Volumes from Images.
Stephen Lombardi, Tomas Simon, Jason Saragih, Gabriel Schwartz, Andreas Lehrmann, Yaser Sheikh.
TOG 2019. [PDF]

Semantic Photo Synthesis and Manipulation

StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows.
Rameen Abdal, Peihao Zhu, Niloy Mitra, Peter Wonka.
TOG 2020. [PDF] [Github]

Layered Neural Rendering for Retiming People in Video.
Erika Lu, Forrester Cole, Tali Dekel, Weidi Xie, Andrew Zisserman, David Salesin, William T. Freeman, Michael Rubinstein.
TOG 2020. [PDF] [Project]

Neural Hair Rendering.
Menglei Chai, Jian Ren, Sergey Tulyakov.
ECCV 2020. [PDF]

MichiGAN: Multi-Input-Conditioned Hair Image Generation for Portrait Editing.
Zhentao Tan, Menglei Chai, Dongdong Chen, Jing Liao, Qi Chu, Lu Yuan, Sergey Tulyakov, Nenghai Yu.
TOG 2020. [PDF]

pix2pixHD: High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs.
Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Andrew Tao, Jan Kautz, Bryan Catanzaro.
CVPR 2018. [PDF] [Github]

SPADE: Semantic Image Synthesis with Spatially-Adaptive Normalization.</br> Taesung Park, Ming-Yu Liu, Ting-Chun Wang, Jun-Yan Zhu.
CVPR 2019. [PDF] [Github]

Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generation.
Hao Tang, Dan Xu, Yan Yan, Philip H. S. Torr, Nicu Sebe.
CVPR 2020. [PDF] [Github]

SelectionGAN: Multi-Channel Attention Selection GAN with Cascaded Semantic Guidance for Cross-View Image Translation.
Hao Tang, Dan Xu, Nicu Sebe, Yanzhi Wang, Jason J. Corso, Yan Yan.
VPR 2019. [PDF] [Github]

Texture and Surface Embedding or Mapping

Clustered Vector Textures.
Peihan Tu, Li-Yi Wei, Matthias Zwicker.
TOG (SIGGRAPH) 2022. [PDF] [Project]

Continuous Curve Textures.
Peihan Tu, Li-Yi Wei, Koji Yatani, Takeo Igarashi, Matthias Zwicker.
TOG (SIGGRAPH Asia) 2020. [PDF] [Project]

Texturify: Generating Textures on 3D Shape Surfaces.
Yawar Siddiqui, Justus Thies, Fangchang Ma, Qi Shan, Matthias Nießner, Angela Dai.
arxiv 2022. [PDF] [Project]

Fine Detailed Texture Learning for 3D Meshes with Generative Models.
Aysegul Dundar, Jun Gao, Andrew Tao, Bryan Catanzaro.
arxiv 2022. [PDF] [Project]

Transposer: Universal Texture Synthesis Using Feature Maps as Transposed Convolution Filter.
Guilin Liu, Rohan Taori, Ting-Chun Wang, Zhiding Yu, Shiqiu Liu, Fitsum A. Reda, Karan Sapra, Andrew Tao, Bryan Catanzaro.
arxiv 2020. [PDF]

Wasserstein Generative Models for Patch-based Texture Synthesis.
Antoine Houdard, Arthur Leclaire, Nicolas Papadakis, Julien Rabin.
arxiv 2020. [PDF] [Github]

GramGAN: Deep 3D Texture Synthesis From 2D Exemplars.
Tiziano Portenier, Siavash Bigdeli, Orçun Göksel.
arxiv 2020. [PDF]

AUV-Net: Learning Aligned UV Maps for Texture Transfer and Synthesis.
Zhiqin Chen, Kangxue Yin, Sanja Fidler.
CVPR 2022. [PDF] [Project]

Learning Texture Generators for 3D Shape Collections from Internet Photo Sets.
Rui Yu, Yue Dong, Pieter Peers, Xin Tong.
BMVC 2021. [PDF]

IALS: Learning High-Fidelity Face Texture Completion without Complete Face Texture.
Jongyoo Kim, Jiaolong Yang, Xin Tong.
ICCV 2021. [PDF] [Github]

Neural Surface Maps.
Luca Morreale, Noam Aigerman, Vladimir Kim, Niloy J. Mitra.
CVPR 2021. [PDF] [Github]

NeuTex: Neural Texture Mapping for Volumetric Neural Rendering.
Fanbo Xiang, Zexiang Xu, Miloš Hašan, Yannick Hold-Geoffroy, Kalyan Sunkavalli, Hao Su.
CVPR 2021. [PDF]

Better Patch Stitching for Parametric Surface Reconstruction.
Zhantao Deng, Jan Bednařík, Mathieu Salzmann, Pascal Fua.
3DV 2020. [PDF]

Continuous Surface Embeddings.
Natalia Neverova, David Novotny, Marc Szafraniec, Vasil Khalidov, Patrick Labatut, Andrea Vedaldi.
NerIPS 2020. [PDF]

Deep Geometric Texture Synthesis.
Amir Hertz, Rana Hanocka, Raja Giryes, Daniel Cohen-Or.
TOG 2020. [PDF]

Leveraging 2D Data to Learn Textured 3D Mesh Generation.
Paul Henderson, Vagia Tsiminaki, Christoph H. Lampert.
CVPR 2020. [PDF]

Articulation-aware Canonical Surface Mapping.
Nilesh Kulkarni, Abhinav Gupta, David F. Fouhey, Shubham Tulsiani.
CVPR 2020. [PDF] [Github] [Project]

UnrealText: Synthesizing Realistic Scene Text Images from the Unreal World.
Shangbang Long, Cong Yao.
CVPR 2020. [PDF] [Github]

Adversarial Texture Optimization from RGB-D Scans.
Jingwei Huang, Justus Thies, Angela Dai, Abhijit Kundu, Chiyu Jiang, Leonidas Guibas, Matthias Nießner, Thomas Funkhouser.
CVPR 2020. [PDF] [Project] [Github] [pyRender]

Learning Elementary Structures For 3D Shape Generation And Matching.
Theo Deprelle, Thibault Groueix, Matthew Fisher, Vladimir G. Kim, Bryan C. Russell, Mathieu Aubry.
TOG 2019. [PDF] [Project] [Github]

Learning to Generate Textures on Meshes.
Amit Raj, Cusuh Ham, Connelly Barnes, Vladimir Kim, Jingwan Lu, James Hays.
CVPR 2019 Workshops on Deep Generative Models for 3D Understanding (Best Paper). [PDF]

CSM: Canonical Surface Mapping via Geometric Cycle Consistency.
Nilesh Kulkarni, Abhinav Gupta, Shubham Tulsiani.
ICCV 2019. [PDF] [Github] [Project]

Texture Fields: Learning Texture Representations in Function Space.
Michael Oechsle, Lars Mescheder, Michael Niemeyer, Thilo Strauss, Andreas Geiger.
ICCV 2019. [PDF]

Learning Category-Specific Mesh Reconstruction from Image Collections.
Angjoo Kanazawa, Shubham Tulsiani Alexei A. Efros, Jitendra Malik.
ECCV 2018. [Github] [Project]

AtlasNet: A Papier-Mache Approach to Learning 3D Surface Generation.
Thibault Groueix, Matthew Fisher, Vladimir Kim, Bryan Russell, Mathieu Aubry.
CVPR 2018. [PDF] [Project] [Github]

Texture Mapping for 3D Reconstruction with RGB-D Sensor.
Yanping Fu, Qingan Yan, Long Yang, Jie Liao, Chunxia Xiao.
CVPR 2018. [PDF] [thecvf] [Code on Github]

Let There Be Color! - Large-Scale Texturing of 3D Reconstructions.
Waechter, Michael and Moehrle, Nils and Goesele, Michael.
ECCV 2018. [PDF] [Project] [Github] [rayint] [Eigen] [Multi-View Environment] [mapMAP]

Unsupervised Texture Transfer from Images to Model Collections.
Tuanfeng Yand Wang, Hao Su, Qixing Huang, Jingwei Huang, Leonidas J. Guibas, Niloy J. Mitra.
TOG 2016. [PDF] [Project] [Data]

Implicit Neural Representation and Rendering

[Awesome Neural Radiance Fields]

[Awesome-Implicit-NeRF-Robotics]

[NeRF Explosion 2020]

NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review.
Kyle Gao, Yina Gao, Hongjie He, Denning Lu, Linlin Xu, Jonathan Li.
arxiv 2022. [PDF]

S3-NeRF: Neural Reflectance Field from Shading and Shadow under a Single Viewpoint.
Wenqi Yang, Guanying Chen, Chaofeng Chen, Zhenfang Chen, Kwan-Yee K. Wong.
NeurIPS. [PDF]

Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentation.
Xiao Fu, Shangzhan Zhang, Tianrun Chen, Yichong Lu, Lanyun Zhu, Xiaowei Zhou, Andreas Geiger, Yiyi Liao.
3DV 2022. [PDF] [Project] [Github]

Dual-Space NeRF: Learning Animatable Avatars and Scene Lighting in Separate Spaces.
Yihao Zhi, Shenhan Qian, Xinhao Yan, Shenghua Gao.
3DV 2022. [PDF]

Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objects.
Ziyu Wang, Yu Deng, Jiaolong Yang, Jingyi Yu, Xin Tong.
Pacific Graphics & CGF 2022. [PDF] [Github]

LoRD: Local 4D Implicit Representation for High-Fidelity Dynamic Human Modeling.
Boyan Jiang, Xinlin Ren, Mingsong Dou, Xiangyang Xue, Yanwei Fu, Yinda Zhang.
ECCV 2022. [PDF] [Github]

PRIF: Primary Ray-based Implicit Function.
Brandon Yushan Feng, Yinda Zhang, Danhang Tang, Ruofei Du, Amitabh Varshney.
ECCV 2022. [PDF] [Project]

Neural Radiance Transfer Fields for Relightable Novel-view Synthesis with Global Illumination.
Linjie Lyu, Ayush Tewari, Thomas Leimkuehler, Marc Habermann, Christian Theobalt.
ECCV 2022. [PDF] [Project]

Implicit Feature Networks for Texture Completion from Partial 3D Data.
Julian Chibane, Gerard Pons-Moll.
ECCV 2022 Workshops. [PDF] [Project]

Transformers as Meta-Learners for Implicit Neural Representations.
Yinbo Chen, Xiaolong Wang.
ECCV 2022. [PDF] [Project] [Github]

ARF: Artistic Radiance Fields.
Kai Zhang, Nick Kolkin, Sai Bi, Fujun Luan, Zexiang Xu, Eli Shechtman, Noah Snavely.
ECCV 2022. [PDF] [Project] [Github]

NeuMan: Neural Human Radiance Field from a Single Video.
Wei Jiang, Kwang Moo Yi, Golnoosh Samei, Oncel Tuzel, Anurag Ranjan.
ECCV 2022. [PDF] [Github]

Neural Density-Distance Fields.
Itsuki Ueda, Yoshihiro Fukuhara, Hirokatsu Kataoka, Hiroaki Aizawa, Hidehiko Shishido, Itaru Kitahara.
ECCV 2022. [PDF] [Project] [Github]

Neural Strands: Learning Hair Geometry and Appearance from Multi-View Images.
Radu Alexandru Rosu, Shunsuke Saito, Ziyan Wang, Chenglei Wu, Sven Behnke, Giljoo Nam.
ECCV 2022. [PDF] [Github]

Depth Field Networks for Generalizable Multi-view Scene Representation.
Vitor Guizilini, Igor Vasiljevic, Jiading Fang, Rares Ambrus, Greg Shakhnarovich, Matthew Walter, Adrien Gaidon.
ECCV 2022. [PDF] [Github]

Neural Radiance Fields for Outdoor Scene Relighting.
Viktor Rudnev, Mohamed Elgharib, William Smith, Lingjie Liu, Vladislav Golyanik, Christian Theobalt.
ECCV 2022. [PDF] [Project] [Code]

Neural-Sim: Learning to Generate Training Data with NeRF.
Yunhao Ge, Harkirat Behl, Jiashu Xu, Suriya Gunasekar, Neel Joshi, Yale Song, Xin Wang, Laurent Itti, Vibhav Vineet.
ECCV 2022. [PDF]

PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo.
Wenqi Yang, Guanying Chen, Chaofeng Chen, Zhenfang Chen, Kwan-Yee K. Wong.
ECCV 2022. [PDF] [Project]

Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis.
Shuai Shen, Wanhua Li, Zheng Zhu, Yueqi Duan, Jie Zhou, Jiwen Lu.
ECCV 2022. [PDF] [Project]

NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editing.
Bangbang Yang, Chong Bao, Junyi Zeng, Hujun Bao, Yinda Zhang, Zhaopeng Cui, Guofeng Zhang.
ECCV 2022 (oral). [PDF] [Project]

HDR-Plenoxels: Self-Calibrating High Dynamic Range Radiance Fields.
Kim Jun-Seong, Kim Yu-Ji, Moon Ye-Bin, Tae-Hyun Oh.
ECCV 2022. [PDF]

NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priors.
Jiepeng Wang, Peng Wang, Xiaoxiao Long, Christian Theobalt, Taku Komura, Lingjie Liu, Wenping Wang.
ECCV 2022. [PDF] [Github]

NeRF for Outdoor Scene Relighting.
Viktor Rudnev, Mohamed Elgharib, William Smith, Lingjie Liu, Vladislav Golyanik, Christian Theobalt.
ECCV 2022. [PDF] [Project] [Github]

Deforming Radiance Fields with Cages.
Tianhan Xu, Tatsuya Harada.
ECCV 2022. [PDF] [Project]

AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fields.
Andreas Kurz, Thomas Neff, Zhaoyang Lv, Michael Zollhöfer, Markus Steinberger.
ECCV 2022. [PDF] [Project]

SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse views.
Xiaoxiao Long, Cheng Lin, Peng Wang, Taku Komura, Wenping Wang.
ECCV 2022. [PDF] [Project] [Github]

Unified Implicit Neural Stylization.
Zhiwen Fan, Yifan Jiang, Peihao Wang, Xinyu Gong, Dejia Xu, Zhangyang Wang.
ECCV 2022. [PDF] [Project] [Github]

SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image.
Dejia Xu, Yifan Jiang, Peihao Wang, Zhiwen Fan, Humphrey Shi, Zhangyang Wang.
ECCV 2022. [PDF] [Project] [Github]

BungeeNeRF: Progressive Neural Radiance Field for Extreme Multiscale Scene Rendering.
Yuanbo Xiangli, Linning Xu, Xingang Pan, Nanxuan Zhao, Anyi Rao, Christian Theobalt, Bo Dai, and Dahua Lin.
ECCV 2022. [PDF] [Project] [Github]

Learning Local Implicit Fourier Representation for Image Warping.
Jaewon Lee, Kwang Pyo Choi, Kyong Hwan Jin.
ECCV 2022. [PDF] [Project]

DoF-NeRF: Depth-of-Field Meets Neural Radiance Fields.
Zijin Wu, Xingyi Li, Juewen Peng, Hao Lu, Zhiguo Cao, Weicai Zhong.
ACM MM 2022. [PDF]

EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyes.
Gengyan Li, Abhimitra Meka, Franziska Müller, Marcel C. Bühler, Otmar Hilliges.
TOG 2022. [PDF]

Implicit Neural Representation for Physics-driven Actuated Soft Bodies.
Lingchen Yang, Byungsoo Kim, Gaspard Zoss, Baran Gozcu, Markus Gross, Barbara Solenthaler.
SIGGRAPH 2022. [PDF]

SNeRF: Stylized Neural Implicit Representations for 3D Scenes.
Thu Nguyen-Phuoc, Feng Liu, Lei Xiao.
SIGGRAPH 2022. [PDF] [Project]

SPAGHETTI: Editing Implicit Shapes Through Part Aware Generation.
Amir Hertz, Or Perel, Raja Giryes, Olga Sorkine-Hornung, Daniel Cohen-Or.
SIGGRAPH 2022. [PDF] [Github]

NeROIC: Neural Object Capture and Rendering from Online Image Collections.
Zhengfei Kuang, Kyle Olszewski, Menglei Chai, Zeng Huang, Panos Achlioptas, Sergey Tulyakov.
SIGGRAPH 2022. [PDF] [Project] [Github]

Artemis: Articulated Neural Pets with Appearance and Motion Synthesis.
Haimin Luo, Teng Xu, Yuheng Jiang, Chenglin Zhou, Qiwei Qiu, Yingliang Zhang, Wei Yang, Lan Xu, Jingyi Yu.
SIGGRAPH 2022. [PDF] [Project] [Github]

Learning Smooth Neural Functions via Lipschitz Regularization.
Hsueh-Ti Derek Liu, Francis Williams, Alec Jacobson, Sanja Fidler, Or Litany.
SIGGRAPH 2022. [PDF] [Project] [Github]

Instant Neural Graphics Primitives with a Multiresolution Hash Encoding.
Thomas Müller, Alex Evans, Christoph Schied, Alexander Keller.
ACM Transactions on Graphics (SIGGRAPH) 2022. [PDF] [Project][Github]

Neural 3D Video Synthesis from Multi-view Video.
Tianye Li, Mira Slavcheva, Michael Zollhoefer, Simon Green, Christoph Lassner, Changil Kim, Tanner Schmidt, Steven Lovegrove, Michael Goesele, Richard Newcombe, Zhaoyang Lv.
CVPR 2022. [PDF] [Project]

VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolution.
Zeyuan Chen, Yinbo Chen, Jingwen Liu, Xingqian Xu, Vidit Goel, Zhangyang Wang, Humphrey Shi, Xiaolong Wang.
CVPR 2022. [PDF] [Project]

Motion-Adjustable Neural Implicit Video Representation.
Long Mai, Feng Liu.
CVPR 2022. [PDF] [Project]

Plenoxels: Radiance Fields without Neural Networks.
Alex Yu, Sara Fridovich-Keil, Matthew Tancik, Qinhong Chen, Benjamin Recht, Angjoo Kanazawa.
CVPR 2022 (Oral). [PDF] [Project] [Github]

DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Rendering.
Liwen Wu, Jae Yong Lee, Anand Bhattad, Yuxiong Wang, David A. Forsyth.
CVPR 2022. [PDF] [Project] [Github]

Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesis.
Tianhan Xu, Yasuhiro Fujita, Eiichi Matsumoto.
CVPR 2022. [PDF]

Towards Implicit Text-Guided 3D Shape Generation.
Zhengzhe Liu, Yi Wang, Xiaojuan Qi, Chi-Wing Fu.
CVPR 2022. [PDF] [Github]

Revealing Occlusions with 4D Neural Fields.
Basile Van Hoorick, Purva Tendulka, Didac Suris, Dennis Park, Simon Stent, Carl Vondrick.
CVPR 2022 (Oral). [PDF]

GeoNeRF: Generalizing NeRF With Geometry Priors.
Mohammad Mahdi Johari, Yann Lepoittevin, François Fleuret.
CVPR 2022. [PDF]

GIFS: Neural Implicit Function for General Shape Representation.
Jianglong Ye, Yuntao Chen, Naiyan Wang, Xiaolong Wang.
CVPR 2022. [PDF] [Project]

HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputs.
Fuqiang Zhao, Wei Yang, Jiakai Zhang, Pei Lin, Yingliang Zhang, Jingyi Yu, Lan Xu.
CVPR 2022. [PDF] [Project]

HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video.
Chung-Yi Weng, Brian Curless, Pratul Srinivasan,Jonathan T. Barron, Ira Kemelmacher-Shlizerman.
CVPR 2022. [PDF] [Project]

AutoRF: Learning 3D Object Radiance Fields from Single View Observations.
Norman Müller, Andrea Simonelli, Lorenzo Porzi, Samuel Rota Bulò, Matthias Nießner, Peter Kontschieder.
CVPR 2022. [PDF] [Project]

Gradient-SDF: A Semi-Implicit Surface Representation for 3D Reconstruction.
Christiane Sommer, Lu Sang, David Schubert, Daniel Cremers.
CVPR 2022. [PDF]

Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Augmentations.
Tianlong Chen, Peihao Wang, Zhiwen Fan, Zhangyang Wang.
CVPR 2022. [PDF]

RayMVSNet: Learning Ray-based 1D Implicit Fields for Accurate Multi-View Stereo.
Junhua Xi, Yifei Shi, Yijie Wang, Yulan Guo, Kai Xu.
CVPR 2022. [PDF]

Exemplar-bsaed Pattern Synthesis with Implicit Periodic Field Network.
Haiwei Chen, Jiayi Liu, Weikai Chen, Shichen Liu, Yajie Zhao.
CVPR 2022. [PDF]

LISA: Learning Implicit Shape and Appearance of Hands.
Enric Corona, Tomas Hodan, Minh Vo, Francesc Moreno-Noguer, Chris Sweeney, Richard Newcombe, Lingni Ma.
CVPR 2022. [PDF]

Continuous Scene Representations for Embodied AI.
Samir Yitzhak Gadre, Kiana Ehsani, Shuran Song, Roozbeh Mottaghi.
CVPR 2022. [PDF]

Structured Local Radiance Fields for Human Avatar Modeling.
Zerong Zheng, Han Huang, Tao Yu, Hongwen Zhang, Yandong Guo, Yebin Liu.
CVPR 2022. [PDF]

NeuralFusion: Neural Volumetric Rendering under Human-object Interactions.
Yuheng Jiang, Suyi Jiang, Guoxing Sun, Zhuo Su, Kaiwen Guo, Minye Wu, Jingyi Yu, Lan Xu.
CVPR 2022. [PDF] [Project]

ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representations.
Mingwu Zheng, Hongyu Yang, Di Huang, Liming Chen.
CVPR 2022. [PDF]

Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation.
Abhijit Kundu, Kyle Genova, Xiaoqi Yin, Alireza Fathi, Caroline Pantofaru, Leonidas J. Guibas, Andrea Tagliasacchi, Frank Dellaert, Thomas Funkhouser.
CVPR 2022. [PDF]

NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction.
Xiaoshuai Zhang, Sai Bi, Kalyan Sunkavalli, Hao Su, Zexiang Xu.
CVPR 2022. [PDF] [Project]

BANMo: Building Animatable 3D Neural Models from Many Casual Videos.
Gengshan Yang, Minh Vo, Natalia Neverova, Deva Ramanan, Andrea Vedaldi, Hanbyul Joo.
CVPR 2022. [PDF] [Project] [Github]

Dense Depth Priors for Neural Radiance Fields from Sparse Input Views.
Barbara Roessle, Jonathan T. Barron, Ben Mildenhall, Pratul P. Srinivasan, Matthias Nießner.
CVPR 2022. [PDF] [Project]

Point-NeRF: Point-based Neural Radiance Fields.
Qiangeng Xu, Zexiang Xu, Julien Philip, Sai Bi, Zhixin Shu, Kalyan Sunkavalli, Ulrich Neumann.
CVPR 2022. [PDF]

Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow.
Shanlin Sun, Kun Han, Deying Kong, Hao Tang, Xiangyi Yan, Xiaohui Xie.
CVPR 2022. [PDF] [Github]

LISA: Learning Implicit Shape and Appearance of Hands.
Enric Corona, Tomas Hodan, Minh Vo, Francesc Moreno-Noguer, Chris Sweeney, Richard Newcombe, and Lingni Ma.
CVPR 2022. [PDF] [Project]

Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-time.
Liao Wang, Jiakai Zhang, Xinhang Liu, Fuqiang Zhao, Yanshun Zhang, Yingliang Zhang, Minye Wu, Lan Xu, Jingyi Yu.
CVPR 2022 (Oral). [PDF] [Project]

Block-NeRF: Scalable Large Scene Neural View Synthesis.
Matthew Tancik, Vincent Casser, Xinchen Yan, Sabeek Pradhan, Ben Mildenhall, Pratul P. Srinivasan, Jonathan T. Barron, Henrik Kretzschmar.
CVPR 2022. [PDF] [Project]

FENeRF: Face Editing in Neural Radiance Fields.
Jingxiang Sun, Xuan Wang, Yong Zhang, Xiaoyu Li, Qi Zhang, Yebin Liu, Jue Wang.
CVPR 2022. [PDF]

RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputs.
Michael Niemeyer, Jonathan T. Barron, Ben Mildenhall, Mehdi S. M. Sajjadi, Andreas Geiger, Noha Radwan.
CVPR 2022. [PDF] [Project]

DeepCurrents: Learning Implicit Representations of Shapes With Boundaries.
David Palmer, Dmitriy Smirnov, Stephanie Wang, Albert Chern, Justin Solomon.
CVPR 2022. [PDF]

Urban Radiance Fields.
Konstantinos Rematas, Andrew Liu, Pratul P. Srinivasan, Jonathan T. Barron, Andrea Tagliasacchi, Thomas Funkhouser, Vittorio Ferrari.
CVPR 2022. [PDF] [Project]

NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images.
Ben Mildenhall, Peter Hedman, Ricardo Martin-Brualla, Pratul Srinivasan, Jonathan T. Barron.
CVPR 2022. [PDF] [Project]

Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields.
Jonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan, Peter Hedman.
CVPR 2022. [PDF]

Depth-supervised NeRF: Fewer Views and Faster Training for Free.
Kangle Deng, Andrew Liu, Jun-Yan Zhu, Deva Ramanan.
CVPR 2022. [PDF] [Project] [Github]

CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields.
Can Wang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao.
CVPR 2022. [PDF] [Project] [Github]

Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translation.
Shengqu Cai, Anton Obukhov, Dengxin Dai, Luc Van Gool.
CVPR 2022. [PDF]

DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Rendering.
Ruizhi Shao, Hongwen Zhang, He Zhang, Yanpei Cao, Tao Yu, Yebin Liu.
CVPR 2022. [PDF] [Project]

3D-aware Image Synthesis via Learning Structural and Textural Representations.
Yinghao Xu, Sida Peng, Ceyuan Yang, Yujun Shen, Bolei Zhou.
CVPR 2022. [PDF] [Project] [Github]

GRAM: Generative Radiance Manifolds for 3D-Aware Image Generation.
Yu Deng, Jiaolong Yang, Jianfeng Xiang, Xin Tong.
CVPR 2022. [PDF] [Project] [Github]

EfficientNeRF: Efficient Neural Radiance Fields.
Tao Hu, Shu Liu, Yilun Chen, Tiancheng Shen, Jiaya Jia.
CVPR 2022. [PDF]

Improving Neural Implicit Surfaces Geometry with Patch Warping.
François Darmon, Bénédicte Bascle, Jean-Clément Devaux, Pascal Monasse, Mathieu Aubry.
CVPR 2022. [PDF] [Project] [Github]

InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Rendering.
Mijeong Kim, Seonguk Seo, Bohyung Han.
CVPR 2022. [PDF] [Project] [Github]

UNIST: Unpaired Neural Implicit Shape Translation Network.
Qimin Chen, Johannes Merz, Aditya Sanghi, Hooman Shayani, Ali Mahdavi-Amiri, Hao Zhang.
CVPR 2022. [PDF] [Project]

CoNeRF: Controllable Neural Radiance Fields.
Kacper Kania, Kwang Moo Yi, Marek Kowalski, Tomasz Trzciński, Andrea Taliasacchi.
CVPR 2022. [PDF] [Project]

Exemplar-Based Pattern Synthesis With Implicit Periodic Field Network.
Haiwei Chen, Jiayi Liu, Weikai Chen, Shichen Liu, Yajie Zhao.
CVPR 2022. [PDF]

Hallucinated Neural Radiance Fields in the Wild.
Xingyu Chen, Qi Zhang, Xiaoyu Li, Yue Chen, Feng Ying, Xuan Wang, Jue Wang.
CVPR 2022. [PDF] [Project] [Github]

Neural Point Light Fields.
Julian Ost, Issam Laradji, Alejandro Newell, Yuval Bahat, Felix Heide.
CVPR 2022. [PDF]

NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fields.
Lin Yen-Chen, Pete Florence, Jonathan T. Barron, Tsung-Yi Lin, Alberto Rodriguez, Phillip Isola.
ICRA 2022. [PDF] [Project] [Github]

CLA-NeRF: Category-Level Articulated Neural Radiance Field.
Wei-Cheng Tseng, Hung-Ju Liao, Yen-Chen Lin, Min Sun.
ICRA 2022. [PDF]

Differentiable Gradient Sampling for Learning Implicit 3D Scene Reconstructions from a Single Image.
Shizhan Zhu, Sayna Ebrahimi, Angjoo Kanazawa, Trevor Darrell.
ICLR 2022. [PDF]

Unsupervised Discovery of Object Radiance Fields.
Hong-Xing Yu, Leonidas J. Guibas, Jiajun Wu.
ICLR 2022. [PDF] [Github] [Project]

CoordX: Accelerating Implicit Neural Representation with a Split MLP Architecture.
Ruofan Liang, Hongyi Sun, Nandita Vijaykumar.
ICLR 2022. [PDF]

Geometry-Consistent Neural Shape Representation with Implicit Displacement Fields.
Wang Yifan, Lukas Rahmann, Olga Sorkine-Hornung.
ICLR 2022. [PDF] [Project] [Github]

Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation.
Anthony Simeonov, Yilun Du, Andrea Tagliasacchi, Joshua B. Tenenbaum, Alberto Rodriguez, Pulkit Agrawal, Vincent Sitzmann.
ICRA 2022. [PDF] [Project] [GIthub]

NeuroFluid: Fluid Dynamics Grounding with Particle-Driven Neural Radiance Fields.
Shanyan Guan, Huayu Deng, Yunbo Wang, Xiaokang Yang.
ICML 2022. [PDF]

FiG-NeRF: Figure Ground Neural Radiance Fields for 3D Object Category Modelling.
Christopher Xie, Keunhong Park, Ricardo Martin-Brualla, Matthew Brown.
3DV 2021. [PDF] [Project]

ImpliCity: City Modeling from Satellite Images with Deep Implicit Occupancy Fields.
Corinne Stucker, Bingxin Ke, Yuanwen Yue, Shengyu Huang, Iro Armeni, Konrad Schindler.
ISPRS Congress 2022. [PDF]

Mip-NeRF RGB-D: Depth Assisted Fast Neural Radiance Fields.
Arnab Dey, Yassine Ahmine, Andrew I. Comport.
WSCG 2022. [PDF]

SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generation.
Xin-Yang Zheng, Yang Liu, Peng-Shuai Wang, Xin Tong.
Computer Graphics Forum 2022. [PDF]

X-NeRF: Explicit Neural Radiance Field for Multi-Scene 360∘ Insufficient RGB-D Views.
Haoyi Zhu, Hao-Shu Fang, Cewu Lu.
arxiv 2022. [PDF]

NerfAcc: A General NeRF Acceleration Toolbox.
Ruilong Li, Matthew Tancik, Angjoo Kanazawa.
arxiv 2022. [PDF] [Project]

Structure-Aware NeRF without Posed Camera via Epipolar Constraint.
Shu Chen, Yang Zhang, Yaxin Xu, Beiji Zou.
arxiv 2022. [PDF]

LATITUDE: Robotic Global Localization with Truncated Dynamic Low-pass Filter in City-scale NeRF.
Zhenxin Zhu, Yuantao Chen, Zirui Wu, Chao Hou, Yongliang Shi, Chuxuan Li, Pengfei Li, Hao Zhao, Guyue Zhou.
arxiv 2022. [PDF]

StructNeRF: Neural Radiance Fields for Indoor Scenes with Structural Hints.
Zheng Chen, Chen Wang, Yuan-Chen Guo, Song-Hai Zhang.
arxiv 2022. [PDF]

im2nerf: Image to Neural Radiance Field in the Wild.
Lu Mi, Abhijit Kundu, David Ross, Frank Dellaert, Noah Snavely, Alireza Fathi.
arxiv 2022. [PDF]

Multi-NeuS: 3D Head Portraits from Single Image with Neural Implicit Functions.
Egor Burkov, Ruslan Rakhimov, Aleksandr Safin, Evgeny Burnaev, Victor Lempitsky.
arxiv 2022. [PDF]

PeRFception: Perception using Radiance Fields.
Yoonwoo Jeong, Seungjoo Shin, Junha Lee, Christopher Choy, Animashree Anandkumar, Minsu Cho, Jaesik Park.
arxiv 2022. [PDF] [Project] [Github]

DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Images.
Bing Wang, Lu Chen, Bo Yang.
arxiv 2022. [PDF] [Github]

UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene.
Yaosen Chen, Qi Yuan, Zhiqiang Li, Yuegen Liu Wei Wang Chaoping Xie, Xuming Wen, Qien Yu.
arxiv 2022. [PDF][Github] [[Project](https://sherwinbahmani.github.io/3dvidgen/]

FDNeRF: Few-shot Dynamic Neural Radiance Fields for Face Reconstruction and Expression Editing.
Jingbo Zhang, Xiaoyu Li, Ziyu Wan, Can Wang, Jing Liao.
arxiv 2022. [PDF]

360Roam: Real-Time Indoor Roaming Using Geometry-Aware 360∘ Radiance Fields.
Huajian Huang, Yingshu Chen, Tianjian Zhang, Sai-Kit Yeung.
arxiv 2022. [PDF]

GAUDI: A Neural Architect for Immersive 3D Scene Generation.
Miguel Angel Bautista, Pengsheng Guo, Samira Abnar, Walter Talbott, Alexander Toshev, Zhuoyuan Chen, Laurent Dinh, Shuangfei Zhai, Hanlin Goh, Daniel Ulbricht, Afshin Dehghan, Josh Susskind.
arxiv 2022. [PDF] [Github]

Is Attention All NeRF Needs?
Mukund Varma T, Peihao Wang, Xuxi Chen, Tianlong Chen, Subhashini Venugopalan, Zhangyang Wang.
arxiv 2022. [PDF]

3D Concept Grounding on Neural Fields.
Yining Hong, Yilun Du, Chunru Lin, Chuang Gan, Josh Tenenbaum.
arxiv 2022. [PDF] [Project]

3D-Aware Video Generation.
Sherwin Bahmani, Jeong Joon Park, Despoina Paschalidou, Hao Tang, Gordon Wetzstein, Leonidas Guibas, Luc Van Gool, Radu Timofte.
arxiv 2022. [PDF] [Project] [Github]

VMRF: View Matching Neural Radiance Fields.
Jiahui Zhang, Fangneng Zhan, Rongliang Wu, Yingchen Yu, Wenqing Zhang, Bai Song, Xiaoqin Zhang, Shijian Lu.
arxiv 2022. [PDF]

LaTeRF: Label and Text Driven Object Radiance Fields.
Ashkan Mirzaei, Yash Kant, Jonathan Kelly, Igor Gilitschenski.
arxiv 2022. [PDF]

Generative Neural Articulated Radiance Fields.
Alexander W. Bergman, Petr Kellnhofer, Yifan Wang, Eric R. Chan, David B. Lindell, Gordon Wetzstein.
arxiv 2022. [PDF]

EventNeRF: Neural Radiance Fields from a Single Colour Event Camera.
Viktor Rudnev, Mohamed Elgharib, Christian Theobalt, Vladislav Golyanik.
arxiv 2022. [PDF] [Github]

TAVA: Template-free Animatable Volumetric Actors.
Ruilong Li, Julian Tanke, Minh Vo, Michael Zollhofer, Jurgen Gall, Angjoo Kanazawa, Christoph Lassner.
arxiv 2022. [PDF] [Project] [Github]

NeMF: Neural Motion Fields for Kinematic Animation.
Chengan He, Jun Saito, James Zachary, Holly Rushmeier, Yi Zhou.
arxiv 2022. [PDF] [Project]

UV Volumes for Real-time Rendering of Editable Free-view Human Performance.
Yue Chen, Xuan Wang, Xingyu Chen, Qi Zhang, Xiaoyu Li, Yu Guo, Jue Wang, Fei Wang.
arxiv 2022. [PDF] [Project] [Github]

VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids.
Katja Schwarz, Axel Sauer, Michael Niemeyer, Yiyi Liao, Andreas Geiger.
arxiv 2022. [PDF] [Project]

NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors.
Hao-Kang Liu, I-Chao Shen, Bing-Yu Chen.
arxiv 2022. [PDF] [Project]

MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction.
Zehao Yu, Songyou Peng, Michael Niemeyer, Torsten Sattler, Andreas Geiger.
arxiv 2022. [PDF] [Project]

Decomposing NeRF for Editing via Feature Field Distillation.
Sosuke Kobayashi, Eiichi Matsumoto, Vincent Sitzmann.
arxiv 2022. [PDF] [Project]

DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes.
Jia-Wei Liu, Yan-Pei Cao, Weijia Mao, Wenqiao Zhang, David Junhao Zhang, Jussi Keppo, Ying Shan, Xiaohu Qie, Mike Zheng Shou.
arxiv 2022. [PDF]

Differentiable Point-Based Radiance Fields for Efficient View Synthesis.
Qiang Zhang, Seung-Hwan Baek, Szymon Rusinkiewicz, Felix Heide.
arxiv 2022. [PDF]

Fast Dynamic Radiance Fields with Time-Aware Neural Voxels.
Jiemin Fang, Taoran Yi, Xinggang Wang, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Matthias Nießner, Qi Tian.
arxiv 2022. [PDF] [Project]

Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolation.
Jian Zhang, Yuanqing Zhang, Huan Fu, Xiaowei Zhou, Bowen Cai, Jinchi Huang, Rongfei Jia, Binqiang Zhao, Xing Tang.
arxiv 2022. [PDF]

Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation.
Abhijit Kundu, Kyle Genova, Xiaoqi Yin, Alireza Fathi, Caroline Pantofaru, Leonidas Guibas, Andrea Tagliasacchi, Frank Dellaert, Thomas Funkhouser.
arxiv 2022. [PDF] [Project]

BlobGAN: Spatially Disentangled Scene Representations.
Dave Epstein, Taesung Park, Richard Zhang, Eli Shechtman, Alexei A. Efros.
arxiv 2022. [PDF] [Project] [Github]

Neural Implicit Representations for Physical Parameter Inference from a Single Video.
Florian Hofherr, Lukas Koestler, Florian Bernard, Daniel Cremers.
arxiv 2022. [PDF]

AE-NeRF: Auto-Encoding Neural Radiance Fields for 3D-Aware Object Manipulation.
Mira Kim, Jaehoon Ko, Kyusun Cho, Junmyeong Choi, Daewon Choi, Seungryong Kim.
arxiv 2022. [PDF]

Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis.
Wei Cheng, Su Xu, Jingtan Piao, Chen Qian, Wayne Wu, Kwan-Yee Lin, Hongsheng Li.
arxiv 2022. [PDF] [Project] [Github]

Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulation.
Verica Lazova, Vladimir Guzov, Kyle Olszewski, Sergey Tulyakov, Gerard Pons-Moll.
arxiv 2022. [PDF]

A Level Set Theory for Neural Implicit Evolution under Explicit Flows.
Ishit Mehta, Manmohan Chandraker, Ravi Ramamoorthi.
arxiv 2022. [PDF] [Project]

Neural Vector Fields for Surface Representation and Inference.
Edoardo Mello Rella, Ajad Chhatkuli, Ender Konukoglu, Luc Van Gool.
arxiv 2022. [PDF]

Learning Neural Acoustic Fields.
Andrew Luo, Yilun Du, Michael J. Tarr, Joshua B. Tenenbaum, Antonio Torralba, Chuang Gan.
arxiv 2022. [PDF] [Project] [Github]

Unified Implicit Neural Stylization.
Zhiwen Fan, Yifan Jiang, Peihao Wang, Xinyu Gong, Dejia Xu, Zhangyang Wang.
arxiv 2022. [PDF] [Project] [Github]

Animatable Neural Radiance Fields from Monocular RGB-D.
Tiantian Wang, Nikolaos Sarafianos, Ming-Hsuan Yang, Tony Tung.
arxiv 2022. [PDF]

MPS-NeRF: Generalizable 3D Human Rendering from Multiview Images.
Xiangjun Gao, Jiaolong Yang, Jongyoo Kim, Sida Peng, Zicheng Liu, Xin Tong.
arxiv 2022. [PDF]

DDNeRF: Depth Distribution Neural Radiance Fields.
David Dadon, Ohad Fried, Yacov Hel-Or.
arxiv 2022. [PDF]

3D Equivariant Graph Implicit Functions.
Yunlu Chen, Basura Fernando, Hakan Bilen, Matthias Nießner, Efstratios Gavves.
arxiv 2022. [PDF]

R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis.
Huan Wang, Jian Ren, Zeng Huang, Kyle Olszewski, Menglei Chai, Yun Fu, Sergey Tulyakov.
arxiv 2022. [PDF] [Project]

DRaCoN: Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars.
Amit Raj, Umar Iqbal, Koki Nagano, Sameh Khamis, Pavlo Molchanov, James Hays, Jan Kautz.
arxiv 2022. [PDF] [Project]

AutoAvatar: Autoregressive Neural Fields for Dynamic Avatar Modeling.
Ziqian Bai, Timur Bagautdinov, Javier Romero, Michael Zollhöfer, Ping Tan, Shunsuke Saito.
arxiv 2022. [PDF] [Project]

ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers.
Jonáš Kulhánek, Erik Derner, Torsten Sattler, Robert Babuška.
arxiv 2022. [PDF]

TensoRF: Tensorial Radiance Fields.
Anpei Chen, Zexiang Xu, Andreas Geiger, Jingyi Yu, Hao Su.
arxiv 2022. [PDF] [Project] [Github]

NeReF: Neural Refractive Field for Fluid Surface Reconstruction and Implicit Representation.
Ziyu Wang, Wei Yang, Junming Cao, Lan Xu, Junqing Yu, Jingyi Yu.
arxiv 2022. [PDF]

RC-MVSNet: Unsupervised Multi-View Stereo with Neural Rendering.
Di Chang, Aljaž Božič, Tong Zhang, Qingsong Yan, Yingcong Chen, Sabine Süsstrunk, Matthias Nießner.
arxiv 2022. [PDF] [Github]

NeuVV: Neural Volumetric Videos with Immersive Rendering and Editing.
Jiakai Zhang, Liao Wang, Xinhang Liu, Fuqiang Zhao, Minzhang Li, Haizhao Dai, Boyuan Zhang, Wei Yang, Lan Xu, Jingyi Yu.
arxiv 2022. [PDF]

NeAT: Neural Adaptive Tomography.
Darius Rückert, Yuanhao Wang, Rui Li, Ramzi Idoughi, Wolfgang Heidrich.
arxiv 2022. [PDF] [Data]

VaxNeRF: Revisiting the Classic for Voxel-Accelerated Neural Radiance Field.
Naruya Kondo, Yuya Ikeda, Andrea Tagliasacchi, Yutaka Matsuo, Yoichi Ochiai, Shixiang Shane Gu.
arxiv 2021. [PDF] [Github]

DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Rendering.
Shunyu Yao, RuiZhe Zhong, Yichao Yan, Guangtao Zhai, Xiaokang Yang.
arxiv 2021. [PDF]

HeadNeRF: A Real-time NeRF-based Parametric Head Model.
Yang Hong, Peng Bo, Haiyao Xiao, Ligang Liu, Juyong Zhang.
arxiv 2021. [PDF] [Project]

PERF: Performant, Explicit Radiance Fields.
Sverker Rasmuson, Erik Sintorn, Ulf Assarsson.
arxiv 2021. [PDF]

CityNeRF: Building NeRF at City Scale.
Yuanbo Xiangli, Linning Xu, Xingang Pan, Nanxuan Zhao, Anyi Rao, Christian Theobalt, Bo Dai, Dahua Lin.
arxiv 2021. [PDF] [Project]

DD-NeRF: Double-Diffusion Neural Radiance Field as a Generalizable Implicit Body Representation.
Guangming Yao, Hongzhi Wu, Yi Yuan, Kun Zhou.
arxiv 2021. [PDF]

Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering.
Mingfei Chen, Jianfeng Zhang, Xiangyu Xu, Lijuan Liu, Jiashi Feng, Shuicheng Yan.
arxiv 2021. [PDF]

CG-NeRF: Conditional Generative Neural Radiance Fields.
Kyungmin Jo, Gyumin Shim, Sanghun Jung, Soyoung Yang, Jaegul Choo.
arxiv 2021. [PDF]

Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields.
Dor Verbin, Peter Hedman, Ben Mildenhall, Todd Zickler, Jonathan T. Barron, Pratul P. Srinivasan.
CVPR 2022. [PDF] [Project]

Deblur-NeRF: Neural Radiance Fields from Blurry Images.
Li Ma, Xiaoyu Li, Jing Liao, Qi Zhang, Xuan Wang, Jue Wang, Pedro V. Sander.
CVPR 2022. [PDF]

Light Field Neural Rendering.
Mohammed Suhail, Carlos Esteves, Leonid Sigal, Ameesh Makadia.
CVPR 2022. [PDF]

Domain Adaptation on Point Clouds via Geometry-Aware Implicits.
Yuefan Shen, Yanchao Yang, Mi Yan, He Wang, Youyi Zheng, Leonidas J. Guibas.
CVPR 2022. [PDF]

NeRFReN: Neural Radiance Fields with Reflections.
Yuan-Chen Guo, Di Kang, Linchao Bao, Yu He, Song-Hai Zhang.
CVPR 2022. [PDF] [[Project](https://bennyguo.github.io/nerfren/]

LOLNeRF: Learn from One Look.
Daniel Rebain, Mark Matthews, Kwang Moo Yi, Dmitry Lagun, Andrea Tagliasacchi.
CVPR 2022. [PDF] [Project]

Mega-NERF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs.
Haithem Turki, Deva Ramanan, Mahadev Satyanarayanan.
CVPR 2022. [PDF]

Pix2NeRF: Unsupervised Conditional p-GAN for Single Image to Neural Radiance Fields Translation.
Shengqu Cai, Anton Obukhov, Dengxin Dai, Luc Van Gool.
CVPR 2022. [PDF]

StylizedNeRF: Consistent 3D Scene Stylization As Stylized NeRF via 2D-3D Mutual Learning.
Yi-Hua Huang, Yue He, Yu-Jie Yuan, Yu-Kun Lai, Lin Gao.
CVPR 2022. [PDF]

Learning Neural Light Fields with Ray-Space Embedding Networks.
Benjamin Attal, Jia-Bin Huang, Michael Zollhoefer, Johannes Kopf, Changil Kim.
CVPR 2022. [PDF] [Project]

HDR-NeRF: High Dynamic Range Neural Radiance Fields.
Xin Huang, Qi Zhang, Feng Ying, Hongdong Li, Xuan Wang, Qing Wang.
CVPR 2021. [PDF] [[Project](https://shsf0817.github.io/hdr-nerf/]

MoFaNeRF: Morphable Facial Neural Radiance Field.
Yiyu Zhuang, Hao Zhu, Xusen Sun, Xun Cao.
arxiv 2021. [PDF]

HumanNeRF: Generalizable Neural Human Radiance Field from Sparse Inputs.
Fuqiang Zhao, Wei Yang, Jiakai Zhang, Pei Lin, Yingliang Zhang, Jingyi Yu, Lan Xu.
arxiv 2021. [PDF]

NeSF: Neural Shading Field for Image Harmonization.
Zhongyun Hu, Ntumba Elie Nsampi, Xue Wang, Qing Wang.
arxiv 2021. [PDF]

Zero-Shot Text-Guided Object Generation with Dream Fields.
Ajay Jain, Ben Mildenhall, Jonathan T. Barron, Pieter Abbeel, Ben Poole.
arxiv 2021. [PDF] [Project]

NeuSample: Neural Sample Field for Efficient View Synthesis.
Jiemin Fang, Lingxi Xie, Xinggang Wang, Xiaopeng Zhang, Wenyu Liu, Qi Tian.
arxiv 2021. [PDF] [[Project](https://jaminfong.cn/neusample/]

Learning Continuous Environment Fields via Implicit Functions.
Xueting Li, Shalini De Mello, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz, Sifei Liu.
arxiv 2021. [PDF]

Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction.
Cheng Sun, Min Sun, Hwann-Tzong Chen.
arxiv 2021. [PDF] [Github]

Learning Neural Transmittance for Efficient Rendering of Reflectance Fields.
Mohammad Shafiei, Sai Bi, Zhengqin Li, Aidas Liaudanskas, Rodrigo Ortiz-Cayon, Ravi Ramamoorthi.
arxiv 2021. [PDF]

CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesis.
Peng Zhou, Lingxi Xie, Bingbing Ni, Qi Tian.
arxiv 2021. [PDF] [Github]

Seeing Implicit Neural Representations as Fourier Series.
Nuri Benbarka, Timon Höfer, Hamd ul-moqeet Riaz, Andreas Zell.
arxiv 2021. [PDF]

StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis.
Jiatao Gu, Lingjie Liu, Peng Wang, Christian Theobalt.
arxiv 2021. [PDF] [Project]

Neural Volume Rendering: NeRF And Beyond.
Frank Dellaert, Lin Yen-Chen.
arxiv 2021. [PDF] [Github]

FLAME-in-NeRF: Neural control of Radiance Fields for Free View Face Animation.
ShahRukh Athar, Zhixin Shu, Dimitris Samaras.
arxiv 2021. [PDF] [Project]

NeRF in Detail (NeRF-ID): Learning to Sample for View Synthesis.
Relja Arandjelović, Andrew Zisserman.
arxiv 2021. [PDF]

Deep Medial Fields.
Daniel Rebain, Ke Li, Vincent Sitzmann, Soroosh Yazdani, Kwang Moo Yi, Andrea Tagliasacchi.
arxiv 2021. [PDF]

Recursive-NeRF: An Efficient and Dynamically Growing NeRF.
Guo-Wei Yang, Wen-Yang Zhou, Hao-Yang Peng, Dun Liang, Tai-Jiang Mu, Shi-Min Hu.
arxiv 2021. [PDF] [Github]

NeRF–: Neural Radiance Fields Without Known Camera Parameters.
Zirui Wang, Shangzhe Wu, Weidi Xie, Min Chen, Victor Adrian Prisacariu.
arxiv 2021. [PDF] [Project] [Github]

CodeNeRF: Disentangled Neural Radiance Fields for Object Categories.
Wonbong Jang, Lourdes Agapito.
ICCV 2021. [PDF] [Project] [Github]

SIMONe: View-Invariant, Temporally-Abstracted Object Representations via Unsupervised Video Decomposition.
Rishabh Kabra, Daniel Zoran, Goker Erdogan, Loic Matthey, Antonia Creswell, Matthew Botvinick, Alexander Lerc.
NeurIPS 2021. [PDF]

Light Field Networks (LFNS): Neural Scene Representations with Single-Evaluation Rendering.
Vincent Sitzmann, Semon Rezchikov, William T. Freeman, Joshua B. Tenenbaum, Fredo Durand.
NeurIPS 2021. [PDF] [Project]

Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering.
Bangbang Yang, Yinda Zhang, Yinghao Xu, Yijin Li, Han Zhou, Hujun Bao, Guofeng Zhang, Zhaopeng Cui](https://zhpcui.github.io/).
ICCV 2021. [PDF] [Project] [Github]

Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video.
Edgar Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhöfer, Christoph Lassner, Christian Theobalt.
ICCV 2021. [PDF] [Project] [Github]

Learning Compositional Radiance Fields of Dynamic Human Heads.
Ziyan Wang, Timur Bagautdinov, Stephen Lombardi, Tomas Simon, Jason Saragih, Jessica Hodgins, Michael Zollhöfer.
CVPR 2021. [PDF]

OSF: Object-Centric Neural Scene Rendering.
Michelle Guo, Alireza Fathi, Jiajun Wu, Thomas Funkhouser.
arxiv 2020. [PDF] [Project]

Portrait Neural Radiance Fields from a Single Image.
Chen Gao, Yichang Shih, Wei-Sheng Lai, Chia-Kai Liang, Jia-Bin Huang.
arxiv 2020. [PDF] [Project]

A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Pose.
Shih-Yang Su, Frank Yu, Michael Zollhoefer, Helge Rhodin.
NeurIPS 2021. [PDF] [Project]

H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motion .
Hongyi Xu, Thiemo Alldieck, Cristian Sminchisescu.
NeurIPS 2021. [PDF]

A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis.
Xingang Pan, Xudong Xu, Chen Change Loy, Christian Theobalt, Bo Dai.
NeurIPS 2021. [PDF]

Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Rendering.
Youngjoong Kwon, Dahun Kim, Duygu Ceylan, Henry Fuchs.
NeurIPS 2021. [PDF] [Project] [Github]

Volume Rendering of Neural Implicit Surfaces.
Lior Yariv, Jiatao Gu, Yoni Kasten, Yaron Lipman.
NeurIPS 2021 (Oral). [PDF] [Project] [Github]

OctField: Hierarchical Implicit Functions for 3D Modeling.
Jia-Heng Tang, Weikai Chen, Jie Yang, Bo Wang, Songrun Liu, Bo Yang, Lin Gao.
NeurIPS 2021. [PDF]

Neural Relightable Participating Media Rendering.
Quan Zheng, Gurprit Singh, Hans-Peter Seidel.
NeurIPS 2021. [PDF]

NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction.
Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, Wenping Wang.
NeurIPS 2021. [PDF]

NeRV: Neural Representations for Videos.
Hao Chen, Bo He, Hanyu Wang, Yixuan Ren, Ser-Nam Lim, Abhinav Shrivastava.
NeurIPS 2021. [PDF] [Github]

NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wild.
Jason Y. Zhang, Gengshan Yang, Shubham Tulsiani, Deva Ramanan.
NeurIPS 2021. [PDF] [Project] [Github] [Data]

TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis.
Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin, Matthew O’Toole.
NeurIPS 2021. [PDF] [Github]

Non-line-of-Sight Imaging via Neural Transient Fields.
Siyuan Shen, Zi Wang, Ping Liu, Zhengqing Pan, Ruiqian Li, Tian Gao, Shiying Li, Jingyi Yu.
TPAMI 2021. [PDF]

Mixture of Volumetric Primitives for Efficient Neural Rendering.
Stephen Lombardi, Tomas Simon, Gabriel Schwartz, Michael Zollhoefer, Yaser Sheikh, Jason Saragih.
TOG 2021. [PDF]

HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields.
Keunhong Park, Utkarsh Sinha, Peter Hedman, Jonathan T. Barron, Sofien Bouaziz, Dan B Goldman, Ricardo Martin-Brualla, Steven M. Seitz.
TOG 2021. [PDF] [Project]

GRF: Learning a General Radiance Field for 3D Representation and Rendering.
Alex Trevithick, Bo Yang.
ICCV 2021. [PDF]

FastNeRF: High-Fidelity Neural Rendering at 200FPS.
Stephan J. Garbin, Marek Kowalski, Matthew Johnson, Jamie Shotton, Julien Valentin.
ICCV 2021. [PDF]

Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies.
Sida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang, Qing Shuai, Xiaowei Zhou, Hujun Bao.
ICCV 2021. [PDF]

AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis.
Yudong Guo, Keyu Chen, Sen Liang, Yongjin Liu, Hujun Bao, Juyong Zhang.
ICCV 2021. [PDF] [Project] [Video]

In-Place Scene Labelling and Understanding With Implicit Scene Representation.
Shuaifeng Zhi, Tristan Laidlow, Stefan Leutenegger, Andrew J. Davison.
ICCV 2021. [PDF]

MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis.
Jiaxin Li, Zijian Feng, Qi She, Henghui Ding, Changhu Wang, Gim Hee Lee.
ICCV 2021. [PDF] [Github]

NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo.
Yi Wei, Shaohui Liu, Yongming Rao, Wang Zhao, Jiwen Lu, Jie Zhou.
ICCV 2021. [PDF] [Project]

Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observations.
Zike Yan, Yuxin Tian, Xuesong Shi, Ping Guo, Peng Wang, Hongbin Zha.
ICCV 2021. [PDF]

NeRD: Neural Reflectance Decomposition from Image Collections.
Mark Boss, Raphael Braun, Varun Jampani, Jonathan T. Barron, Ce Liu, Hendrik P. A. Lensch.
ICCV 2021. [PDF] [Project] [Github]

Self-Calibrating Neural Radiance Fields.
Yoonwoo Jeong, Seokjun Ahn, Christopher Choy, Animashree Anandkumar, Minsu Cho, Jaesik Park.
ICCV 2021. [PDF]

BARF: Bundle-Adjusting Neural Radiance Fields.
Chen-Hsuan Lin, Wei-Chiu Ma, Antonio Torralba, Simon Lucey.
ICCV 2021. [PDF] [Github]

MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo.
Anpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang, Fanbo Xiang, Jingyi Yu, Hao Su.
ICCV 2021. [PDF] [Project] [Github]

GNeRF: GAN-based Neural Radiance Field without Posed Camera.
Quan Meng, Anpei Chen, Haimin Luo, Minye Wu, Hao Su, Lan Xu, Xuming He, Jingyi Yu.
ICCV 2021 (Oral). [PDF] [Github]

ConvNeRF: Convolutional Neural Opacity Radiance Fields.
Haimin Luo, Anpei Chen, Qixuan Zhang, Bai Pang, Minye Wu, Lan Xu, Jingyi Yu.
ICCP 2021. [PDF]

Semantic-NeRF: In-Place Scene Labelling and Understanding with Implicit Scene Representation.
Shuaifeng Zhi, Tristan Laidlow, Stefan Leutenegger, Andrew J. Davison.
ICCV 2021. [PDF] [Project]

GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering.
Alex Trevithick, Bo Yang.
ICCV 2021. [PDF] [Github]

Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields.
Jonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, Pratul P. Srinivasan.
ICCV 2021. [PDF] [Project]

PlenOctrees for Real-time Rendering of Neural Radiance Fields.
Alex Yu, Ruilong Li, Matthew Tancik, Hao Li, Ren Ng, Angjoo Kanazawa.
ICCV 2021. [PDF] [Project] [Github]

Nerfies: Deformable Neural Radiance Fields.
Keunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz, Dan B Goldman, Steven M. Seitz, Ricardo-Martin Brualla.
ICCV 2021. [PDF] [Project] [Github]

Unconstrained Scene Generation with Locally Conditioned Radiance Fields.
Terrance DeVries, Miguel Angel Bautista, Nitish Srivastava, Graham W. Taylor, Joshua M. Susskind.
ICCV 2021. [PDF]

Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis.
Ajay Jain, Matthew Tancik, Pieter Abbeel.
ICCV 2021. [PDF] [Project]

KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs.
Christian Reiser, Songyou Peng, Yiyi Liao, Andreas Geiger.
ICCV 2021. [PDF] [Github]

SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes.
Xu Chen, Yufeng Zheng, Michael J. Black, Otmar Hilliges, Andreas Geiger.
ICCV 2021. [PDF]

UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction.
Michael Oechsle, Songyou Peng, Andreas Geiger.
ICCV 2021. [PDF]

Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapes.
Towaki Takikawa, Joey Litalien, Kangxue Yin, Karsten Kreis, Charles Loop, Derek Nowrouzezahrai, Alec Jacobson, Morgan McGuire, Sanja Fidler.
CVPR 2021. [PDF] [Project] [Github]

Iso-Points: Optimizing Neural Implicit Surfaces with Hybrid Representations.
Wang Yifan, Shihao Wu, Cengiz Oztireli, Olga Sorkine-Hornung.
CVPR 2021. [PDF] [Project] [Github]

STaR: Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Rendering.
Wentao Yuan, Zhaoyang Lv, Tanner Schmidt, Steven Lovegrove.
CVPR 2021. [PDF] [Project]

DeepSurfels: Learning Online Appearance Fusion.
Marko Mihajlovic, Silvan Weder, Marc Pollefeys, Martin R. Oswald.
CVPR 2021. [PDF] [Porject]

Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis.
Yaxuan Zhu, Ruiqi Gao, Siyuan Huang, Song-Chun Zhu, Ying Nian Wu.
CVPR 2021. [PDF]

Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondence.
Yu Deng, Jiaolong Yang, Xin Tong.
CVPR 2021. [PDF]

Learned Initializations for Optimizing Coordinate-Based Neural Representations.
Matthew Tancik, [Ben Mildenhall, Terrance Wang, Divi Schmidt, Pratul P. Srinivasan, Jonathan T. Barron, Ren Ng.
CVPR 2021 [PDF] [Project]

Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction.
Guy Gafni, Justus Thies, Michael Zollhöfer, Matthias Nießner.
CVPR 2021. [PDF] [Project] [Video]

Learned Initializations for Optimizing Coordinate-Based Neural Representations.
Matthew Tancik, Ben Mildenhall, Terrance Wang, Divi Schmidt](https://www.matthewtancik.com/learnit#), Pratul P. Srinivasan, Jonathan T. Barron, Ren Ng.
CVPR 2021. [Github] [Project] [Phototourism Data]

Neural Scene Graphs for Dynamic Scenes.
Julian Ost, Fahim Mannan, Nils Thuerey, Julian Knodt, Felix Heide.
CVPR 2021 (Oral). [PDF] [Project]

NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis.
Pratul P. Srinivasan, Boyang Deng, Xiuming Zhang, Matthew Tancik, Ben Mildenhall, Jonathan T. Barron.
CVPR 2021. [PDF] [Project]

pixelNeRF: Neural Radiance Fields from One or Few Images.
Alex Yu, Vickie Ye, Matthew Tancik, Angjoo Kanazawa.
CVPR 2021. [PDF] [Project]

AutoInt: Automatic Integration for Fast Neural Volume Rendering.
David B. Lindell, Julien N. P. Martel, Gordon Wetzstein.
CVPR 2021 (oral). [PDF] [Project]

DeRF: Decomposed Radiance Fields.
Daniel Rebain, Wei Jiang, Soroosh Yazdani, Ke Li, Kwang Moo Yi, Andrea Tagliasacchi.
CVPR 2021. [PDF] [Project]

D-NeRF: Neural Radiance Fields for Dynamic Scenes.
Albert Pumarola, Enric Corona, Gerard Pons-Moll, Francesc Moreno-Noguer.
CVPR 2021. [PDF] [Project] [Github] [Data]

Space-time Neural Irradiance Fields for Free-Viewpoint Video.
Wenqi Xian, Jia-Bin Huang, Johannes Kopf, Changil Kim.
CVPR 2021. [PDF] [Project]

GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields.
Michael Niemeyer, Andreas Geiger.
CVPR 2021 (Best Paper). [PDF] [Project] [Github]

DONeRF: Towards Real-Time Rendering of Neural Radiance Fields using Depth Oracle Networks.
Thomas Neff, Pascal Stadlbauer, Mathias Parger, Andreas Kurz, Chakravarty R. Alla Chaitanya, Anton Kaplanyan, Markus Steinberger.
Computer Graphics Forum (EGSR) 2021. [PDF] [Project]

iNeRF: Inverting Neural Radiance Fields for Pose Estimation.
Lin Yen-Chen, Pete Florence, Jonathan T. Barron, Alberto Rodriguez, Phillip Isola, Tsung-Yi Lin.
IROS 2021. [PDF] [Project] [Github]

JIIF: Joint Implicit Image Function for Guided Depth Super-Resolution.
Jiaxiang Tang, Xiaokang Chen, Gang Zeng.
ACM MM 2021. [PDF] [Github]

Spline Positional Encoding for Learning 3D Implicit Signed Distance Fields.
Peng-Shuai Wang, Yang Liu, Yu-Qi Yang, and Xin Tong.
IJCAI 2021. [PDF]

Convolutional Neural Opacity Radiance Fields.
Haimin Luo, Anpei Chen, Qixuan Zhang, Bai Pang, Minye Wu, Lan Xu, Jingyi Yu.
ICCP 2021. [PDF]

O-CNN: Unsupervised 3D Learning for Shape Analysis via Multiresolution Instance Discrimination.
Peng-Shuai Wang, Yu-Qi Yang, Qian-Fang Zou, Zhirong Wu, Yang Liu, Xin Tong.
AAAI 2021. [PDF] [Github]

ShaRf: Shape-conditioned Radiance Fields from a Single View.
Konstantinos Rematas, Ricardo Martin-Brualla, Vittorio Ferrari.
ICML 2021. [PDF] [Project]

PolyGen: An Autoregressive Generative Model of 3D Meshes.
Charlie Nash, Yaroslav Ganin, S. M. Ali Eslami, Peter W. Battaglia.
ICML 2020. [PDF] [Github]

Learning Implicit Surface Light Fields.
Michael Oechsle, Michael Niemeyer, Lars Mescheder, Thilo Strauss, Andreas Geiger.
3DV 2020. [PDF] [Github]

NSVF: Neural Sparse Voxel Fields.
Lingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua, Christian Theobalt.
NeurIPS 2020. [PDF] [Project] [Github]

BlockGAN: Learning 3D Object-Aware Scene Representations from Unlabelled Images.
Thu Nguyen-Phuoc, Christian Richardt, Long Mai, Yong-Liang Yang, Niloy Mitra.
NeurIPS 2020. [PDF] [Project] [Github]

Neural Unsigned Distance Fields for Implicit Function Learning.
Julian Chibane, Aymen Mir, Gerard Pons-Moll.
NeurIPS 2020. [PDF] [Github]

SIREN: Implicit Neural Representations with Periodic Activation Functions.
Vincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell, Gordon Wetzstein.
NeurIPS 2020 (Oral). [PDF] [Project] [Github] [Data]

GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis.
Katja Schwarz, Yiyi Liao, Michael Niemeyer, Andreas Geiger.
NeurIPS 2020. [PDF] [Project] [Github]

Learning 3D Part Assembly from a Single Image.
Yichen Li, Kaichun Mo, Lin Shao, Minhyuk Sung, Leonidas Guibas.
ECCV 2020. [PDF] [Github]

CoReNet: Coherent 3D Scene Reconstruction From a Single RGB Image.
Stefan Popov, Pablo Bauszat, Vittorio Ferrari.
ECCV 2020. [PDF] [Github]

Geometric Correspondence Fields: Learned Differentiable Rendering for 3D Pose Refinement in the Wild.
Alexander Grabner, Yaming Wang, Peizhao Zhang, Peihong Guo, Tong Xiao, Peter Vajda, Peter M. Roth, Vincent Lepetit.
ECCV 2020. [PDF]

Curriculum DeepSDF.
Yueqi Duan, Haidong Zhu, He Wang, Li Yi, Ram Nevatia, Leonidas J. Guibas.
ECCV 2020. [PDF] [Github]

PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representations.
Edgar Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhöfer, Carsten Stoll, Christian Theobalt.
ECCV 2020. [PDF] [Github] [Project]

LIMP: Learning Latent Shape Representations with Metric Preservation Priors.
Luca Cosmo, Antonio Norelli, Oshri Halimi, Ron Kimmel, Emanuele Rodolà.
ECCV 2020. [PDF]

Convolutional Occupancy Networks.
Songyou Peng, Michael Niemeyer, Lars Mescheder, Marc Pollefeys, Andreas Geiger.
ECCV 2020. [PDF] [Project] [Github]

Equivariant Neural Rendering.
Emilien Dupont, Miguel Angel Bautista, Alex Colburn, Aditya Sankar, Carlos Guestrin, Josh Susskind, Qi Shan.
ICML 2020. [PDF] [Github]

Pix2Shape: Towards Unsupervised Learning of 3D Scenes from Images using a View-based Representation.
Sai Rajeswar, Fahim Mannan, Florian Golemo, Jérôme Parent-Lévesque, David Vazquez, Derek Nowrouzezahrai, Aaron Courville.
IJCV 2020. [PDF]

Local Deep Implicit Functions for 3D Shape.
Kyle Genova, Forrester Cole, Avneesh Sud, Aaron Sarna, Thomas Funkhouser.
CVPR 2020. [PDF]

Single-View View Synthesis with Multiplane Images.
Richard Tucker and Noah Snavely.
CVPR 2020. [PDF] [Project]

PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization.
Shunsuke Saito, Tomas Simon, Jason Saragih, Hanbyul Joo.
CVPR 2020. [PDF] [Project] [Github]

DualSDF: Semantic Shape Manipulation using a Two-Level Representation.
Zekun Hao, Hadar Averbuch-Elor, Noah Snavely, Serge Belongie.
CVPR 2020. [PDF]

Learning a Neural 3D Texture Space from 2D Exemplars.
Philipp Henzler, Niloy J. Mitra, Tobias Ritschel.
CVPR 2020. [PDF] [Project]

Neural Contours: Learning to Draw Lines from 3D Shapes.
Difan Liu, Mohamed Nabail, Aaron Hertzmann, Evangelos Kalogerakis.
CVPR 2020. [PDF] [Github]

Learning View Priors for Single-view 3D Reconstruction.
Hiroharu Kato, Tatsuya Harada.
CVPR 2019. [PDF] [Project] [Github]

IM-Net: Learning Implicit Fields for Generative Shape Modeling.
Zhiqin Chen, Hao Zhang.
CVPR 2019. [PDF] [Project] [Github]

C3DPO: Canonical 3D Pose Networks for Non-Rigid Structure From Motion.
David Novotny, Nikhila Ravi, Benjamin Graham, Natalia Neverova, Andrea Vedaldi.
ICCV 2019. [PDF] [Github] [Project]

CSM: Canonical Surface Mapping via Geometric Cycle Consistency.
Nilesh Kulkarni, Abhinav Gupta, Shubham Tulsiani.
ICCV 2019. [PDF] [Github] [Project]

NASA: Neural Articulated Shape Approximation.
Boyang Deng, JP Lewis, Timothy Jeruzalski, Gerard Pons-Moll, Geoffrey Hinton, Mohammad Norouzi, Andrea Tagliasacchi.
ECCV 2020. [PDF] [Project] [Github]

NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.
Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, Ren Ng.
ECCV 2020. [PDF] [Project] [Gtihub-Tensorflow] [krrish94-PyTorch] [yenchenlin-PyTorch]

VCN: Volumetric Correspondence Networks for Optical Flow.
Gengshan Yang, Deva Ramanan.
NeurIPS 2019. [PDF] [GitHub] [Project]

Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations.
Vincent Sitzmann, Michael Zollhöfer, Gordon Wetzstein.
NeurIPS 2019 (Oral, Honorable Mention “Outstanding New Directions”). [PDF] [Project] [Github] [Dataset]

Transformable Bottleneck Networks.
Kyle Olszewski, Sergey Tulyakov, Oliver Woodford, Hao Li, Linjie Luo.
ICCV 2019. [PDF]

Equivariant Multi-View Networks.
Carlos Esteves, Yinshuang Xu, Christine Allen-Blanchette, Kostas Daniilidis.
ICCV 2019. [PDF]

PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization.
Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima, Angjoo Kanazawa, Hao Li.
ICCV 2019. [PDF] [Project] [Github]

Occupancy Flow: 4D Reconstruction by Learning Particle Dynamics.
Michael Niemeyer, Lars Mescheder, Michael Oechsle, Andreas Geiger.
ICCV 2019. [PDF] [Project] [Github]

DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation.
eong Joon Park, Peter Florence, Julian Straub, Richard Newcombe, Steven Lovegrove.
CVPR 2019. [PDF] [Github]

DeepVoxels: Learning Persistent 3D Feature Embeddings.
Vincent Sitzmann, Justus Thies, Felix Heide, Matthias Nießner, Gordon Wetzstein, Michael Zollhöfer.
CVPR 2019 (Oral). [Project] [PDF] [Code]

Occupancy Networks: Learning 3D Reconstruction in Function Space.
Lars Mescheder, Michael Oechsle, Michael Niemeyer, Sebastian Nowozin, Andreas Geiger.
CVPR 2019. [PDF] [Project] [Github]

LLFF: Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines.
Ben Mildenhall, Pratul Srinivasan, Rodrigo Ortiz-Cayon, Nima Khademi Kalantari, Ravi Ramamoorthi, Ren Ng, Abhishek Kar.
TOG 2019. [PDF] [Project] [Github]

Neural Volumes: Learning Dynamic Renderable Volumes from Images.
Stephen Lombardi, Tomas Simon, Jason Saragih, Gabriel Schwartz, Andreas Lehrmann, Yaser Sheikh.
TOG 2019. [PDF] [Github]

Neural Scene Representation and Rendering.
S M Ali Eslami, Danilo Jimenez Rezende, Frederic Besse, Fabio Viola, Ari S Morcos, Marta Garnelo, Avraham Ruderman, Andrei A Rusu, Ivo Danihelka, Karol Gregor, David P Reichert, Lars Buesing, Theophane Weber, Oriol Vinyals, Dan Rosenbaum, Neil Rabinowitz, Helen King, Chloe Hillier, Matt Botvinick, Daan Wierstra, Koray Kavukcuoglu, Demis Hassabis.
Science 360(6394) 2018. [PDF] [Project] [Data]

Novel-View Synthesis for Objects and Scenes

Novel-View Synthesis

By Implicit Neural Representations

Seeing 3D Objects in a Single Image via Self-Supervised Static-Dynamic Disentanglement.
Prafull Sharma, Ayush Tewari, Yilun Du, Sergey Zakharov, Rares Ambrus, Adrien Gaidon, William T. Freeman, Fredo Durand, Joshua B. Tenenbaum, Vincent Sitzmann.
arxiv 2022. [PDF] [Project]

Vision Transformer for NeRF-Based View Synthesis from a Single Input Image.
Kai-En Lin, Lin Yen-Chen, Wei-Sheng Lai, Tsung-Yi Lin, Yi-Chang Shih, Ravi Ramamoorthi.
arxiv 2022. [PDF] [Project]

Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representations.
Atsuhiro Noguchi, Xiao Sun, Stephen Lin, Tatsuya Harada.
arxiv 2022. [PDF] [Project] [Github]

PVSeRF: Joint Pixel-, Voxel- and Surface-Aligned Radiance Field for Single-Image Novel View Synthesis.
Xianggang Yu, Jiapeng Tang, Yipeng Qin, Chenghong Li, Linchao Bao, Xiaoguang Han, Shuguang Cui.
arxiv 2022. [PDF]

3D-Aware Semantic-Guided Generative Model for Human Synthesis.
Jichao Zhang, Enver Sangineto, Hao Tang, Aliaksandr Siarohin, Zhun Zhong, Nicu Sebe, Wei Wang.
ECCV 2022. [PDF] [Github]

LiveView: Dynamic Target-Centered MPI for View Synthesis.
Sushobhan Ghosh, Zhaoyang Lv, Nathan Matsuda, Lei Xiao, Andrew Berkovich, Oliver Cossairt.
arxiv 2021. [PDF]

NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field.
Celong Liu, Zhong Li, Junsong Yuan, Yi Xu.
arxiv 2021. [PDF]

NeRF++: Analyzing and Improving Neural Radiance Fields.
Kai Zhang, Gernot Riegler, Noah Snavely, Vladlen Koltun.
arxiv 2020. [PDF] [Github]

DyNeRF: Neural 3D Video Synthesis.
Tianye Li, Mira Slavcheva, Michael Zollhoefer, Simon Green, Christoph Lassner, Changil Kim, Tanner Schmidt, Steven Lovegrove, Michael Goesele, Zhaoyang Lv.
CVPR 2022 (oral). [PDF] [Project]

Neural Rays for Occlusion-aware Image-based Rendering.
Yuan Liu, Sida Peng, Lingjie Liu, Qianqian Wang, Peng Wang, Christian Theobalt, Xiaowei Zhou, Wenping Wang.
CVPR 2022. [PDF] [Github] [Github]

Novel-View Synthesis of Human Tourist Photos.
Jonathan Freer, Kwang Moo Yi, Wei Jiang, Jongwon Choi, Hyung Jin Chang.
WACV 2022. [PDF]

Fast and Explicit Neural View Synthesis.
Pengsheng Guo, Miguel Angel Bautista, Alex Colburn, Liang Yang, Daniel Ulbricht, Joshua M. Susskind, Qi Shan.
WACV 2022. [PDF]

LENS: Localization enhanced by NeRF synthesis.
Arthur Moreau, Nathan Piasco, Dzmitry Tsishkou, Bogdan Stanciulescu, Arnaud de La Fortelle.
CoRL 2021. [PDF]

Dynamic View Synthesis from Dynamic Monocular Video.
Chen Gao, Ayush Saraf, Johannes Kopf, Jia-Bin Huang.
ICCV 2021. [PDF] [Project]

MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis.
Jiaxin Li, Zijian Feng, Qi She, Henghui Ding, Changhu Wang, Gim Hee Lee.
ICCV 2021. [PDF] [Github]

NeRFlow: Neural Radiance Flow for 4D View Synthesis and Video Processing.
Yilun Du, Yinan Zhang, Hong-Xing Yu, Joshua B. Tenenbaum, Jiajun Wu.
ICCV 2021. [PDF] [Project]

Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Video.
Edgar Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhofer, Christoph Lassner, Christian Theobalt.
ICCV 2021 (oral). [PDF]

Baking Neural Radiance Fields for Real-Time View Synthesis.
Peter Hedman, Pratul P. Srinivasan, Ben Mildenhall, Jonathan T. Barron, Paul Debevec.
ICCV 2021 (oral). [PDF] [Project]

Animatable Neural Radiance Fields for Human Body Modeling.
Sida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang, Qing Shuai, Hujun Bao, Xiaowei Zhou.
ICCV 2021. [PDF] [Project] [Github]

3D Shape Generation with Grid-based Implicit Functions.
Moritz Ibing, Isaak Lim, Leif Kobbelt.
CVPR 2021. [PDF]

Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes.
Julian Chibane, Aayush Bansal, Verica Lazova, Gerard Pons-Moll.
CVPR 2021. [PDF]

ID-Unet: Iterative Soft and Hard Deformation for View Synthesis.
Mingyu Yin, Li Sun, Qingli Li.
CVPR 2021. [PDF]

NSFF: Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes.
Zhengqi Li, Simon Niklaus, Noah Snavely, Oliver Wang.
CVPR 2021. [PDF] [Project] [Github]

Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans.
Sida Peng, Yuanqing Zhang, Yinghao Xu, Qianqian Wang, Qing Shuai, Hujun Bao, Xiaowei Zhou.
CVPR 2021 (Best paper candidate). [PDF] [Project] [Github]

NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections.
Ricardo Martin-Brualla, Noha Radwan, Mehdi S. M. Sajjadi, Jonathan T. Barron, Alexey Dosovitskiy, Daniel Duckworth.
CVPR 2021 (oral). [PDF] [Github]

pixelNeRF: Neural Radiance Fields from One or Few Images.
Alex Yu, Vickie Ye, Matthew Tancik, Angjoo Kanazawa.
CVPR 2021. [PDF] [Project] [Github]

X-Fields: Implicit Neural View-, Light- and Time-Image Interpolation.
MOJTABA BEMANA, KAROL MYSZKOWSKI, HANS-PETER SEIDEL, TOBIAS RITSCHEL.
TOG 2020. [PDF]

GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis.
Katja Schwarz, Yiyi Liao, Michael Niemeyer, Andreas Geiger.
NeurIPS 2020. [PDF] [Project] [Github]

From Single Image

Unsupervised Novel View Synthesis from a Single Image.
Pierluigi Zama Ramirez, Alessio Tonioni, Federico Tombari.
arxiv 2021. [PDF]

Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image.
Andrew Liu, Richard Tucker, Varun Jampani, Ameesh Makadia, Noah Snavely, Angjoo Kanazawa.
ICCV 2021. [PDF] [Project] [Gtihub]

Worldsheet: Wrapping the World in a 3D Sheet for View Synthesis from a Single Image.
Ronghang Hu, Deepak Pathak.
ICCV 2021. [PDF] [Project]

Layout-Guided Novel View Synthesis from a Single Indoor Panorama.
Jiale Xu, Jia Zheng, Yanyu Xu, Rui Tang, Shenghua Gao.
CVPR 2021. [PDF]

pixelNeRF: Neural Radiance Fields from One or Few Images.
Alex Yu, Vickie Ye, Matthew Tancik, Angjoo Kanazawa.
CVPR 2021. [PDF] [Project]

ShaRF: Shape-conditioned Radiance Fields from a Single View.
Konstantinos Rematas, Ricardo Martin-Brualla, Vittorio Ferrari.
ICML 2021. [PDF] [Project]

Generative View Synthesis: From Single-view Semantics to Novel-view Images.
Tewodros Habtegebrial, Varun Jampani, Orazio Gallo, Didier Stricker.
NeurIPS 2020. [PDF] [Project]

Others

A Portable Multiscopic Camera for Novel View and Time Synthesis in Dynamic Scenes.
Tianjia Zhang, Yuen-Fui Lau, Qifeng Chen.
IROS 2022. [PDF]

CompNVS: Novel View Synthesis with Scene Completion.
Zuoyue Li, Tianxing Fan, Zhenqiang Li, Zhaopeng Cui, Yoichi Sato, Marc Pollefeys, Martin R. Oswald.
ECCV 2022. [PDF]

NeurMiPs: Neural Mixture of Planar Experts for View Synthesis.
Zhi-Hao Lin, Wei-Chiu Ma, Hao-Yu Hsu, Yu-Chiang Frank Wang, Shenlong Wang.
CVPR 2022. [PDF] [Project] [Github]

Novel View Synthesis for High-fidelity Headshot Scenes.
Satoshi Tsutsui, Weijia Mao, Sijing Lin, Yunyi Zhu, Murong Ma, Mike Zheng Shou.
arxiv 2022. [PDF]

Learning Dynamic View Synthesis With Few RGBD Cameras.
Shengze Wang, YoungJoong Kwon, Yuan Shen, Qian Zhang, Andrei State, Jia-Bin Huang, Henry Fuchs.
arxiv 2022. [PDF]

ProbNVS: Fast Novel View Synthesis with Learned Probability-Guided Sampling.
Yuemei Zhou, Tao Yu, Zerong Zheng, Ying Fu, Yebin Liu.
arxiv 2022. [PDF]

Geometry-Free View Synthesis: Transformers and no 3D Priors.
Robin Rombach, Patrick Esser, Björn Ommer.
arxiv 2021. [PDF] [Github]

Deep View Synthesis via Self-Consistent Generative Network.
Zhuoman Liu, Wei Jia, Ming Yang, Peiyao Luo, Yong Guo, Mingkui Tan.
arxiv 2021. [PDF]

Vid2Actor: Free-viewpoint Animatable Person Synthesis from Video in the Wild.
Chung-Yi Weng, Brian Curless, Ira Kemelmacher-Shlizerman.
arxiv 2020. [PDF] [Project] [Video]

Object-Centric Neural Scene Rendering.
Michelle Guo, Alireza Fathi, Jiajun Wu, Thomas Funkhouser.
arxiv 2020. [PDF] [Project]

Neural Point-Based Graphics.
Kara-Ali Aliev, Artem Sevastopolsky, Maria Kolos, Dmitry Ulyanov, Victor Lempitsky.
arxiv 2020. [PDF] [Project] [Github]

RGBD-Net: Predicting Color and Depth Images for Novel Views Synthesis.
Phong Nguyen, Animesh Karnewar, Lam Huynh, Esa Rahtu, Jiri Matas, Janne Heikkila.
arxiv 2020. [PDF] [GIthub]

SofGAN: A Portrait Image Generator with Dynamic Styling.
Anpei Chen, Ruiyang Liu, Ling Xie, Jingyi Yu.
TOG 2021. [PDF] [Github]

Dynamic View Synthesis From Dynamic Monocular Video.
Chen Gao, Ayush Saraf, Johannes Kopf, Jia-Bin Huang.
ICCV 2021. [PDF]

Embedding Novel Views in a Single JPEG Image.
Yue Wu, Guotao Meng, Qifeng Chen.
ICCV 2021. [PDF]

Learning To Stylize Novel Views.
Hsin-Ping Huang, Hung-Yu Tseng, Saurabh Saini, Maneesh Singh, Ming-Hsuan Yang.
ICCV 2021. [PDF]

Deep 3D Mask Volume for View Synthesis of Dynamic Scenes.
Kai-En Lin, Lei Xiao, Feng Liu, Guowei Yang, Ravi Ramamoorthi.
ICCV 2021. [PDF] [Project]

PixelSynth: Generating a 3D-Consistent Experience from a Single Image.
Chris Rockwell, David F. Fouhey, Justin Johnson.
ICCV 2021. [PDF] [Project]

Self-Supervised Visibility Learning for Novel View Synthesis.
Yujiao Shi, Hongdong Li, Xin Yu.
CVPR 2021. [PDF]

Nex: Real-time View Synthesis with Neural Basis Expansion.
S. Wizadwongsa, P. Phongthawee, J. Yenphraphai, S. Suwajanakorn.
CVPR 2021 (oral). [PDF] [Project]

ID-Unet: Iterative Soft and Hard Deformation for View Synthesis.
Mingyu Yin, Li Sun, Qingli Li.
CVPR 2021. [PDF] [Github]

IBRNet: Learning Multi-View Image-Based Rendering.
Qianqian Wang, Zhicheng Wang, Kyle Genova, Pratul Srinivasan, Howard Zhou, Jonathan T. Barron, Ricardo Martin-Brualla, Noah Snavely, Thomas Funkhouser.
CVPR 2021. [PDF] [Project]

SVS: Stable View Synthesis.
Gernot Riegler, Vladlen Koltun.
CVPR 2021. [PDF] [Github] [Video]

Bowtie Networks: Generative Modeling for Joint Few-Shot Recognition and Novel-View Synthesis.
Zhipeng Bao, Yu-Xiong Wang, Martial Hebert.
ICLR 2021. [PDF]

Novel View Synthesis via Depth-guided Skip Connections.
Yuxin Hou, Arno Solin, Juho Kannala.
WACV 2021. [PDF] [Github]

FVS: Free View Synthesis.
Gernot Riegler, Vladlen Koltun.
ECCV 2020. [PDF] [Code&Data]

Rotationally-Temporally Consistent Novel-View Synthesis of Human Performance Video.
Youngjoong Kwon, Stefano Petrangeli, Dahun Kim, Haoliang Wang, Eunbyung Park, Viswanathan Swaminathan, Henry Fuchs.
ECCV 2020. [pdf] [Supplement]

A Recurrent Transformer Network for Novel View Action Synthesis.
Kara Marie Schatz, Erik Quintanilla, Shruti Vyas, Yogesh S Rawat.
ECCV 2020. [pdf] [Supplement]

MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images.
Benjamin Attal, Selena Ling, Aaron Gokaslan, Christian Richardt, James Tompkin.
ECCV 2020. [pdf] [Supplement]

Novel View Synthesis on Unpaired Data by Conditional Deformable Variational Auto-Encoder.
Mingyu Yin, Li Sun, Qingli Li.
ECCV 2020. [pdf] [Supplement]

Deep Multi Depth Panoramas for View Synthesis.
Kai-En Lin, Zexiang Xu, Ben Mildenhall, Pratul P. Srinivasan, Yannick Hold-Geoffroy, Stephen DiVerdi, Qi Sun, Kalyan Sunkavalli, Ravi Ramamoorthi.
ECCV 2020. [pdf] [Supplement]

Semantic View Synthesis.</br> Hsin-Ping Huang, Hung-Yu Tseng, Hsin-Ying Lee, Jia-Bin Huang.</br> ECCV 2020. [PDF] [Project]

Unsupervised Continuous Object Representation Networks for Novel View Synthesis.
Nicolai Häni, Selim Engin, Jun-Jee Chao, Volkan Isler.
arxiv 2020. [PDF]

AUTO3D: Novel View Synthesis Through Unsupervisely Learned Variational Viewpoint and Global 3D Representation.
Xiaofeng Liu, Tong Che, Yiqun Lu, Chao Yang, Site Li, Jane You.
ECCV 2020. [PDF]

Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Camera.
Jae Shin Yoon, Kihwan Kim, Orazio Gallo, Hyun Soo Park, Jan Kautz.
CVPR 2020. [PDF]

Self-Supervised 3D Human Pose Estimation via Part Guided Novel Image Synthesis.
Jogendra Nath Kundu, Siddharth Seth, Varun Jampani, Mugalodi Rakesh, R. Venkatesh Babu, Anirban Chakraborty.
CVPR 2020. [PDF]

IGNOR: Image-guided Neural Object Rendering.
Justus Thies, Michael Zollhöfer, Christian Theobalt, Marc Stamminger, Matthias Nießner.
ICLR 2020. arxiv, 26 Nov 2018 (15 Jan 2020). [PDF] [Project]

Monocular Neural Image Based Rendering with Continuous View Control.
Xu Chen, Jie Song, Otmar Hilliges.
ICCV 2019. [PDF]

Extreme View Synthesis.
Inchang Choi, Orazio Gallo, Alejandro Troccoli, Min H. Kim, Jan Kautz.
ICCV 2019. [PDF]

Transformable Bottleneck Networks.
Kyle Olszewski, Sergey Tulyakov, Oliver Woodford, Hao Li, Linjie Luo.
ICCV 2019. [PDF]

View Independent Generative Adversarial Network for Novel View Synthesis.
Xiaogang Xu, Ying-Cong Chen, Jiaya Jia.
ICCV 2019. [PDF]

PVA: Pixel-Aligned Volumetric Avatars.
Amit Raj, Michael Zollhöfer, Tomas Simon, Jason Saragih, Shunsuke Saito, James Hays, Stephen Lombardi.
CVPR 2021 [PDF][Project]

Neural Volumes: Learning Dynamic Renderable Volumes from Images.
Stephen Lombardi, Tomas Simon, Jason Saragih, Gabriel Schwartz, Andreas Lehrmann, Yaser Sheikh.
SIGGRAPH 2019. [PDF] [Github]

Light, Reflectance, Illuminance, and Shade

Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptation.
Yu-Ying Yeh, Koki Nagano, Sameh Khamis, Jan Kautz, Ming-Yu Liu, Ting-Chun Wang.
TOG (SIGGRAPH Asia 2022). [PDF] [Project]

StyleLight: HDR Panorama Generation for Lighting Estimation and Editing.
Guangcong Wang, Yinuo Yang, Chen Change Loy, Ziwei Liu.
ECCV 2022. [PDF] [Project] [Github]

Geometry-aware Single-image Full-body Human Relighting.
Chaonan Ji, Tao Yu, Kaiwen Guo, Jingxin Liu, Yebin Liu.
ECCV 2022. [PDF]

Relighting4D: Neural Relightable Human from Videos.
Zhaoxi Chen, Ziwei Liu.
ECCV 2022. [PDF] [Project] [Github]

Face Relighting with Geometrically Consistent Shadows.
Andrew Hou, Michel Sarkis, Ning Bi, Yiying Tong, Xiaoming Liu.
CVPR 2022. [PDF]

Active Exploration for Neural Global Illumination of Variable Scenes.
Stavros Diolatzis, Julien Philip, George Drettakis.
TOG 2022. [PDF] [Project]

Local Relighting of Real Scenes.
Audrey Cui, Ali Jahanian, Agata Lapedriza, Antonio Torralba, Shahin Mahdizadehaghdam, Rohit Kumar, David Bau.
arxiv 2022. [PDF]

SunStage: Portrait Reconstruction and Relighting using the Sun as a Light Stage.
Yifan Wang, Aleksander Holynski, Xiuming Zhang, Xuaner Cecilia Zhang.
arxiv 2022. [PDF] [Project]

Physically-Based Editing of Indoor Scene Lighting from a Single Image.
Zhengqin Li, Jia Shi, Sai Bi, Rui Zhu, Kalyan Sunkavalli, Miloš Hašan, Zexiang Xu, Ravi Ramamoorthi, Manmohan Chandraker.
arxiv 2022. [PDF]

Deep Portrait Delighting.
Joshua Weir, Junhong Zhao, Andrew Chalmers, Taehyun Rhee.
arxiv 2022. [PDF]

Learning to Adapt to Light.
Kai-Fu Yang, Cheng Cheng, Shi-Xuan Zhao, Xian-Shi Zhang, Yong-Jie Li.
arxiv 2022. [PDF]

SIRfyN: Single Image Relighting from your Neighbors.
D.A. Forsyth, Anand Bhattad, Pranav Asthana, Yuanyi Zhong, Yuxiong Wang.
arxiv 2021. [PDF]

Neural Radiance Fields for Outdoor Scene Relighting.
Viktor Rudnev, Mohamed Elgharib, William Smith, Lingjie Liu, Vladislav Golyanik, Christian Theobalt.
arxiv 2021. [PDF] [Project]

Intrinsic Image Transfer for Illumination Manipulation.
Junqing Huang, Michael Ruzhansky, Qianying Zhang, Haihui Wang.
arxiv 2021. [PDF]

DSRN: an Efficient Deep Network for Image Relighting.
Sourya Dipta Das, Nisarg A. Shah, Saikat Dutta, Himanshu Kumar.
arxiv 2021. [PDF]

Relightable 3D Head Portraits from a Smartphone Video.
Artem Sevastopolsky, Savva Ignatiev, Gonzalo Ferrer, Evgeny Burnaev, Victor Lempitsky.
arxiv 2020. [PDF] [Project] [Video]

A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis.
Xingang Pan, Xudong Xu, Chen Change Loy, Christian Theobalt, Bo Dai.
NeurIPS 2021. [PDF]

Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decomposition.
Mark Boss, Varun Jampani, Raphael Braun, Ce Liu, Jonathan T. Barron, Hendrik P.A. Lensch.
NeurIPS 2021. [PDF] [Project]

C5: Cross-Camera Convolutional Color Constancy.
Mahmoud Afifi, Jonathan T. Barron, Chloe LeGendre, Yun-Ta Tsai, Francois Bleibel.
ICCV 2021. [PDF] [GIthub]

NeLF: Neural Light-transport Field for Portrait View Synthesis and Relighting.
Tiancheng Sun, Kai-En Lin, Sai Bi, Zexiang Xu, Ravi Ramamoorthi.
EGSR 2021. [PDF] [Project]

Deep Portrait Lighting Enhancement with 3D Guidance.
Fangzhou Han, Can Wang, Hao Du, Jing Liao.
CGF 2021. [PDF] [Project]

Total Relighting: Learning to Relight Portraits for Background Replacement.
Rohit Pandey, Sergio Orts-Escolano, Chloe LeGendre, Christian Haene, Sofien Bouaziz, Christoph Rhemann, Paul Debevec, and Sean Fanello.
TOG 2021. [PDF] [Project]

Deep Relightable Appearance Models for Animatable Faces.
Sai Bi, Stephen Lombardi, Shunsuke Saito, Tomas Simon, Shih-En Wei, Kevyn McPhail, Ravi Ramamoorthi, Yaser Sheikh, Jason Saragih.
TOG 2021. [PDF] [Project]

Neural Light Transport for Relighting and View Synthesis.
Xiuming Zhang, Sean Fanello, Yun-Ta Tsai, Tiancheng Sun, Tianfan Xue, Rohit Pandey, Sergio Orts-Escolano, Philip Davidson, Christoph Rhemann, Paul Debevec, Jonathan T. Barron, Ravi Ramamoorthi, William T. Freeman.
TOG 2021. [PDF] [Project]

Deferred Neural Lighting: Free-viewpoint Relighting from Unstructured Photographs.
Duan Gao, Guojun Chen, Yue Dong, Pieter Peers, Kun Xu, Xin Tong.
TOG 2020. [PDF]

Learning Illumination from Diverse Portraits.
Chloe LeGendre, Wan-Chun Ma, Rohit Pandey, Sean Fanello, Christoph Rhemann, Jason Dourgarian, Jay Busch, Paul Debevec.
TOG 2020. [PDF]

Light Stage Super-Resolution: Continuous High-Frequency Relighting.
Tiancheng Sun, Zexiang Xu, Xiuming Zhang, Sean Fanello, Christoph Rhemann, Paul Debevec, Yun-Ta Tsai, Jonathan T. Barron, Ravi Ramamoorthi.
TOG 2020. [PDF]

NuI-Go: Recursive Non-Local Encoder-Decoder Network for Retinal Image Non-Uniform Illumination Removal.
Chongyi Li, Huazhu Fu, Runmin Cong, Zechao Li, Qianqian Xu.
ACM MM 2020. [PDF]

Learning to Factorize and Relight a City.
Andrew Liu, Shiry Ginosar, Tinghui Zhou, Alexei A. Efros, Noah Snavely.
ECCV 2020. [PDF] [Project]

Object-based Illumination Estimation with Rendering-aware Neural Networks.
Xin Wei, Guojun Chen, Yue Dong, Stephen Lin, Xin Tong.
ECCV 2200. [PDF]

Enlighten Me: Importance of Brightness and Shadow for Character Emotion and Appeal.
Pisut Wisessing, Katja Zibrek, Douglas W. Cunningham, John Dingliana, Rachel McDonnell.
TOG 2020. [PDF]

Portrait Shadow Manipulation.
Xuaner Cecilia Zhang, J onathan T. Barron, Yun-Ta Tsai, Rohit Pandey, Xiuming Zhang, Ren Ng, David E. Jacobs.
TOG 2020. [PDF] [Project]

Generating Digital Painting Lighting Effects via RGB-space Geometry.
Lvmin Zhang, Edgar Simo-Serra, Yi Ji, and Chunping Liu.
TOG 2020. [Priject] [Github]

Single Image Portrait Relighting.
Tiancheng Sun, Jonathan T. Barron, Yun-Ta Tsai, Zexiang Xu, Xueming Yu, Graham Fyffe, Christoph Rhemann, Jay Busch, Paul Debevec, Ravi Ramamoorthi.
TOG 2019. [PDF]

Multi-view Relighting using a Geometry-Aware Network.
Julien Philip, Michael Gharbi, Tinghui Zhou, Alexei (Alyosha) Efros, George Drettakis.
TOG 2019. [PDF]

Lighthouse: Predicting Lighting Volumes for Spatially-Coherent Illumination.
Pratul P. Srinivasan, Ben Mildenhall, Matthew Tancik, Jonathan T. Barron, Richard Tucker, Noah Snavely.
CVPR 2020. [PDF] GitHub] [Project]

Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images.
Sai Bi, Zexiang Xu, Kalyan Sunkavalli, David Kriegman, Ravi Ramamoorthi.
CVPR 2020. [PDF]

DNR: A Neural Rendering Framework for Free-Viewpoint Relighting.
Zhang Chen, Anpei Chen, Guli Zhang, Chengyuan Wang, Yu Ji, Kiriakos N. Kutulakos, Jingyi Yu.
CVPR 2020. [PDF]

Learning to Shade Hand-drawn Sketches.
Qingyuan Zheng, Zhuoru Li, Adam Bargteil.
CVPR 2020. [PDF]

Deep Single-Image Portrait Relighting.
Hao Zhou, Sunil Hadap, Kalyan Sunkavalli, David W. Jacobs.
ICCV 2019. [PDF] [Github] [Project] [DPR Dataset]

Deep Parametric Indoor Lighting Estimation.
Marc-André Gardner, Yannick Hold-Geoffroy, Kalyan Sunkavalli, Christian Gagné, and Jean-François Lalonde.
ICCV 2019. [PDF] [Supplementary material] [Laval Indoor HDR Database and Depth] [Project]

GLoSH: Global-Local Spherical Harmonics for Intrinsic Image Decomposition.
Hao Zhou, Xiang Yu, David W Jacobs.
ICCV 2019. [PDF] [Supplement] [Poster] [Spherical Harmonic Tools]

Fast Spatially-Varying Indoor Lighting Estimation.
Mathieu Garon, Kalyan Sunkavalli, Sunil Hadap, Nathan Carr, Jean-François Lalonde.
CVPR 2019. [PDF] [Supplementary material] [Project] [Lavel Indoor Spatially Varying HDR Dataset / 79 HDR Light Probes]

Neural Illumination: Lighting Prediction for Indoor Environments.
Shuran Song and Thomas Funkhouser.
CVPR 2019. [PDF] [Project]

SfSNet: Learning Shape, Reflectance and llluminance of Faces in the Wild.
Soumyadip Sengupta, Angjoo Kanazawa, Carlos D. Castillo, David W. Jacobs.
CVPR 2018. [Project] [PDF] [Github]

Illumination Decomposition for Photograph with Multiple Light Sources.
Ling Zhang, Qingan Yan, Zheng Liu, Hua Zou, Chunxia Xiao.
TIP 2017. [PDF] [Github]

Learning to Predict Indoor Illumination from a Single Image.
Marc-André Gardner, Kalyan Sunkavalli, Ersin Yumer, Xiaohui Shen, Emiliano Gambaretto, Christian Gagné, and Jean-François Lalonde.
TOG 2017. [PDF] [Dataset] [Homepage]

Occlusion-aware 3D Morphable Models and an Illumination Prior for Face Image Analysis.
Bernhard Egger, Sandro Schoenborn, Andreas Schneider, Adam Kortylewski, Andreas Morel-Forster, Clemens Blumer and Thomas Vetter.
IJCV 2018. [BIP Dataset] [PDF]

Deep Shading: Convolutional Neural Networks for Screen-Space Shading.
Oliver Nalbach, Elena Arabadzhiyska, Dushyant Mehta, Hans-Peter Seidel, Tobias Ritschel.
CFG 2016. [PDF] [Github]

Dubbing and Talking-Head Animation

Talking Head from Speech Audio using a Pre-trained Image Generator.
Mohammed M. Alghamdi, He Wang, Andrew J. Bulpitt, David C. Hogg.
ACM Multimedia 2022. [PDF] [Github]

FNeVR: Neural Volume Rendering for Face Animation.
Bohan Zeng, Boyu Liu, Hong Li, Xuhui Liu, Jianzhuang Liu, Dapeng Chen, Wei Peng, Baochang Zhang.
arxiv 2022. [PDF]

Free-HeadGAN: Neural Talking Head Synthesis with Explicit Gaze Control.
Michail Christos Doukas, Evangelos Ververas, Viktoriia Sharmanska, Stefanos Zafeiriou.
arxiv 2022. [PDF]

Dynamic Neural Textures: Generating Talking-Face Videos with Continuously Controllable Expressions.
Zipeng Ye, Zhiyao Sun, Yu-Hui Wen, Yanan Sun, Tian Lv, Ran Yi, Yong-Jin Liu.
arxiv 2022. [PDF]

StableFace: Analyzing and Improving Motion Stability for Talking Face Generation.
Jun Ling, Xu Tan, Liyang Chen, Runnan Li, Yuchao Zhang, Sheng Zhao, Li Song.
arxiv 2022. [PDF]

Speech Driven Tongue Animation.
Salvador Medina, Denis Tome, Carsten Stoll, Mark Tiede, Kevin Munhall, Alexander G. Hauptmann, Iain Matthews.
CVPR 2022. [PDF]

Talking Face Generation With Multilingual TTS.
Hyoung-Kyu Song, Sang Hoon Woo, Junhyeok Lee, Seungmin Yang, Hyunjae Cho, Youseong Lee, Dongho Choi, Kang-wook Kim.
CVPR 2022. [PDF]

Thin-Plate Spline Motion Model for Image Animation.
Jian Zhao, Hui Zhang.
CVPR 2022. [PDF]

Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation.
Xian Liu, Qianyi Wu, Hang Zhou, Yinghao Xu, Rui Qian, Xinyi Lin, Xiaowei Zhou, Wayne Wu, Bo Dai, Bolei Zhou.
CVPR 2022. [PDF]

Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation.
Lincheng Li, Suzhen Wang, Zhimeng Zhang, Yu Ding, Yixing Zheng, Xin Yu, Changjie Fan.
arxiv 2022. [PDF]

LiP-Flow: Learning Inference-time Priors for Codec Avatars via Normalizing Flows in Latent Space.
Emre Aksan, Shugao Ma, Akin Caliskan, Stanislav Pidhorskyi, Alexander Richard, Shih-En Wei, Jason Saragih, Otmar Hilliges.
arxiv 2022. [PDF]

DialogueNeRF: Towards Realistic Avatar Face-to-face Conversation Video Generation.
Zanwei Zhou, Zi Wang, Shunyu Yao, Yichao Yan, Chen Yang, Guangtao Zhai, Junchi Yan, Xiaokang Yang.
arxiv 2022. [PDF]

Depth-Aware Generative Adversarial Network for Talking Head Video Generation.
Fa-Ting Hong, Longhao Zhang, Li Shen, Dan Xu
CVPR 2022. [PDF] [Github]

DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Rendering.
Shunyu Yao, RuiZhe Zhong, Yichao Yan, Guangtao Zhai, Xiaokang Yang.
arxiv 2021. [PDF]

FaceFormer: Speech-Driven 3D Facial Animation with Transformers.
Yingruo Fan, Zhaojiang Lin, Jun Saito, Wenping Wang, Taku Komura.
arxiv 2020. [PDF]

Large-Scale Multilingual Audio Visual Dubbing.
Yi Yang, Brendan Shillingford, Yannis Assael, Miaosen Wang, Wendi Liu, Yutian Chen, Yu Zhang, Eren Sezener, Luis C. Cobo, Misha Denil, Yusuf Aytar, Nando de Freitas.
arxiv 2020. [PDF] [Video]

EBT: Everybody’s Talkin’: Let Me Talk as You Want.
Linsen Song, Wayne Wu, Chen Qian, Ran He, Chen Change Loy.
arxiv 2020. [PDF] [Project]

Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose.
Ran Yi, Zipeng Ye, Juyong Zhang, Hujun Bao, Yong-Jin Liu.
arxiv 2020. [PDF] [Github]

Speech Driven Talking Face Generation from a Single Image and an Emotion Condition.
Sefik Emre Eskimez, You Zhang, Zhiyao Duan.
arxiv 2020. [PDF]

SAFA: Structure Aware Face Animation.
Qiulin Wang, Lu Zhang, Bo Li.
3DV 2021. [PDF] [Github]

One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning.
Suzhen Wang, Lincheng Li, Yu Ding, Xin Yu.
AAAI 2022. [PDF]

Talking Head Generation with Audio and Speech Related Facial Action Units.
Sen Chen, Zhilei Liu, Jiaxing Liu, Zhengxiang Yan, Longbiao Wang.
BMVC 2021. [PDF]

Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation.
Yuanxun Lu, Jinxiang Chai, Xun Cao.
SIGGRAPH Asia 2021. [PDF]

DECA: Learning an Animatable Detailed 3D Face Model from In-The-Wild Images.
Yao Feng, Haiwen Feng, Michael J. Black, Timo Bolkart.
SIGGRAPH 2021. [PDF] [Github]

Towards Realistic Visual Dubbing with Heterogeneous Sources.
Tianyi Xie, Liucheng Liao, Cheng Bi, Benlai Tang, Xiang Yin, Jianfei Yang, Mingjie Wang, Jiali Yao, Yang Zhang, Zejun Ma.
ACM MM 2021. [PDF]

Learned Spatial Representations for Few-Shot Talking-Head Synthesis.
Moustafa Meshry, Saksham Suri, Larry S. Davis, Abhinav Shrivastava.
ICCV 2021. [PDF]

The Right To Talk: An Audio-Visual Transformer Approach.
Thanh-Dat Truong, Chi Nhan Duong, The De Vu, Hoang Anh Pham, Bhiksha Raj, Ngan Le, Khoa Luu.
ICCV 2021. [PDF]

Speech Drives Templates: Co-Speech Gesture Synthesis With Learned Templates.
Shenhan Qian, Zhi Tu, Yihao Zhi, Wen Liu, Shenghua Gao.
ICCV 2021. [PDF]

AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis.
Yudong Guo, Keyu Chen, Sen Liang, Yongjin Liu, Hujun Bao, Juyong Zhang.
ICCV 2021. [PDF] [Project] [Video]

FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning.
Chenxu Zhang, Yifan Zhao, Yifei Huang, Ming Zeng, Saifeng Ni, Madhukar Budagavi, Xiaohu Guo.
ICCV 2021. [PDF]

MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement.
Alexander Richard, Michael Zollhoefer, Yandong Wen, Fernando de la Torre, Yaser Sheikh.
ICCV 2021. [PDF] [Video]

HeadGAN: Video-and-Audio-Driven Talking Head Synthesis.
Michail Christos Doukas, Stefanos Zafeiriou, Viktoriia Sharmanska.
ICCV 2021. [PDF]

Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion.
Suzhen Wang, Lincheng Li, Yu Ding, Changjie Fan, Xin Yu.
IJCAI 2021. [PDF]

Imitating Arbitrary Talking Style for Realistic Audio-Driven Talking Face Synthesis.
Haozhe Wu, Jia Jia, Haoyu Wang, Yishun Dou, Chao Duan, Qingshan Deng.
ACM MM 2021. [PDF] [GIthub]

LipSync3D: Data-Efficient Learning of Personalized 3D Talking Faces from Video using Pose and Lighting Normalization.
Avisek Lahiri, Vivek Kwatra, Christian Frueh, John Lewis, Chris Bregler.
CVPR 2021. [PDF]

Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation.
Hang Zhou, Yasheng Sun, Wayne Wu, Chen Change Loy, Xiaogang Wang, Ziwei Liu.
CVPR 2021. [PDF] [Project] [Github]

Everything’s Talkin’: Pareidolia Face Reenactment.
Linsen Song, Wayne Wu, Chaoyou Fu, Chen Qian, Chen Change Loy, Ran He.
CVPR 2021. [PDF] [Project] [Github]

One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing.
Ting-Chun Wang, Arun Mallya, Ming-Yu Liu.
CVPR 2021 (oral). [PDF] [Project]

MEAD: A Large-scale Audio-visual Dataset for Emotional Talking Face Generation.
Kaisiyuan Wang, Qianyi Wu, Linsen Song, Zhuoqian Yang, Wayne Wu, Chen Qian, Ran He, Yu Qiao, Chen Change Loy.
ECCV 2020. [PDF] [Project] [Github]

MakeItTalk: Speaker-Aware Talking-Head Animation.
Yang Zhou, Xintong Han, Eli Shechtman, Jose Echevarria, Evangelos Kalogerakis, Dingzeyu Li.
TOG 2020. [PDF] [Github]

FLNet: Landmark Driven Fetching and Learning Network for Faithful Talking Facial Animation Synthesis.
Kuangxiao Gu, Yuqian Zhou, Thomas Huang.
AAAI 2020. [PDF] [GitHub]

Text-based Editing of Talking-head Video.
Ohad Fried, Ayush Tewari, Michael Zollhöfer, Adam Finkelstein, Eli Shechtman, Dan B Goldman Kyle Genova, Zeyu Jin, Christian Theobalt, Maneesh Agrawala.
TOG 2019. [PDF] [Project]

ATVGnet: Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Loss.
Lele Chen, Ross K. Maddox, Zhiyao Duan, Chenliang Xu.
CVPR 2019. [PDF] [Github]

Talking Face Generation by Adversarially Disentangled Audio-Visual Representation.
Hang Zhou, Yu Liu, Ziwei Liu, Ping Luo, Xiaogang Wang.
AAAI 2019. [PDF] [Github] [Project]

Motion Transfer, Retargeting, and Reenactment

[awesome-human-motion]

Motion Transformer for Unsupervised Image Animation.
Jiale Tao, Biao Wang, Tiezheng Ge, Yuning Jiang, Wen Li, Lixin Duan.
arxiv 2022. [PDF]

NeMF: Neural Motion Fields for Kinematic Animation.
Chengan He, Jun Saito, James Zachary, Holly Rushmeier, Yi Zhou.
arxiv 2022. [PDF]

Video2StyleGAN: Disentangling Local and Global Variations in a Video.
Rameen Abdal, Peihao Zhu, Niloy J. Mitra, Peter Wonka.
arxiv 2022. [PDF]

One-Shot Face Reenactment on Megapixels.
Wonjun Kang, Geonsu Lee, Hyung Il Koo, Nam Ik Cho.
arxiv 2022. [PDF]

3D GAN Inversion for Controllable Portrait Image Animation.
Connor Z. Lin, David B. Lindell, Eric R. Chan, Gordon Wetzstein.
arxiv 2022. [PDF] [Project]

FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment.
Yuval Nirkin, Yosi Keller, Tal Hassner.
arxiv 2021. [PDF]

Towards Using Clothes Style Transfer for Scenario-aware Person Video Generation.
Jingning Xu, benlai Tang, Mingjie Wang, Siyuan Bian, Wenyi Guo, Xiang Yin, Zejun Ma.
arxiv 2021. [PDF] [Github]

Mesh Draping: Parametrization-Free Neural Mesh Transfer.
Amir Hertz, Or Perel, Raja Giryes, Olga Sorkine-Hornung, Daniel Cohen-Or.
arxiv 2021. [PDF]

Self-appearance-aided Differential Evolution for Motion Transfer.
Peirong Liu, Rui Wang, Xuefei Cao, Yipin Zhou, Ashish Shah, Maxime Oquab, Camille Couprie, Ser-Nam Lim.
arxiv 2021. [PDF]

Neural Human Video Rendering: Joint Learning of Dynamic Textures and Rendering-to-Video Translation.
Lingjie Liu, Weipeng Xu, Marc Habermann, Michael Zollhoefer, Florian Bernard, Hyeongwoo Kim, Wenping Wang, Christian Theobalt.
arxiv 2020. [PDF]

Generative Adversarial Networks in Human Emotion Synthesis:A Review.
Noushin Hajarolasvadi, Miguel Arjona Ramírez, Hasan Demirel.
arxiv 2020. [PDF]

Learning to Generate Diverse Dance Motions with Transformer.
Jiaman Li, Yihang Yin, Hang Chu, Yi Zhou, Tingwu Wang, Sanja Fidler, Hao Li.
arxiv 2020. [PDF]

Neural Human Video Rendering by Learning Dynamic Textures and Rendering-to-Video Translation.
Lingjie Liu, Weipeng Xu, Marc Habermann, Michael Zollhoefer, Florian Bernard, Hyeongwoo Kim, Wenping Wang, Christian Theobalt.
arxiv 2020. [PDF]

Implicit Warping for Animation with Image Sets.
Arun Mallya, Ting-Chun Wang, Ming-Yu Liu.
NeurIPS 2022. [PDF] [Project]

Dual-Generator Face Reenactment.
Gee-Sern Hsu, Chun-Hung Tsai, Hung-Yi Wu.
CVPR 2022. [PDF]

EMOCA: Emotion Driven Monocular Face Capture and Animation.
Radek Daněček, Michael J. Black, Timo Bolkart.
CVPR 2022. [PDF]

Audio-Driven Neural Gesture Reenactment With Video Motion Graphs.
Yang Zhou, Jimei Yang, Dingzeyu Li, Jun Saito, Deepali Aneja, Evangelos Kalogerakis.
CVPR 2022. [PDF]

RigNeRF: Fully Controllable Neural 3D Portraits.
ShahRukh Athar, Zexiang Xu, Kalyan Sunkavalli, Eli Shechtman, Zhixin Shu](https://zhixinshu.github.io/).
CVPR 2022. [PDF] [Project]

Learning Realistic Human Reposing using Cyclic Self-Supervision with 3D Shape, Pose, and Appearance Consistency.
Soubhik Sanyal, Alex Vorobiov, Timo Bolkart, Matthew Loper, Betty Mohler, Larry Davis, Javier Romero, Michael J. Black.
ICCV 2021. [PDF]

Contact-Aware Retargeting of Skinned Motion.
Ruben Villegas, Duygu Ceylan, Aaron Hertzmann, Jimei Yang, Jun Saito.
ICCV 2021. [PDF]

PIRenderer: Controllable Portrait Image Generation via Semantic Neural Rendering.
Yurui Ren, Ge Li, Yuanqi Chen, Thomas H. Li, Shan Liu.
ICCV 2021. [PDF]

Intrinsic-Extrinsic Preserved GANs for Unsupervised 3D Pose Transfer.
Haoyu Chen, Hao Tang, Henglin Shi, Wei Peng, Nicu Sebe, Guoying Zhao.
ICCV 2021. [PDF] [Github]

Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-On and Outfit Editing.
Aiyu Cui, Daniel McKee, Svetlana Lazebnik.
ICCV 2021. [PDF]

HeadGAN: One-shot Neural Head Synthesis and Editing.
Michail Christos Doukas, Stefanos Zafeiriou, Viktoriia Sharmanska.
ICCV 2021. [PDF]

Contact-Aware Retargeting of Skinned Motion.
Ruben Villegas, Duygu Ceylan, Aaron Hertzmann, Jimei Yang, Jun Saito.
ICCV 2021. [PDF]

SimPoE: Simulated Character Control for 3D Human Pose Estimation.
Ye Yuan, Shih-En Wei, Tomas Simon, Kris Kitani, Jason Saragih.
CVPR 2021. [PDF] [Project]

Few-Shot Human Motion Transfer by Personalized Geometry and Texture Modeling.
Zhichao Huang, Xintong Han, Jia Xu, Tong Zhang.
CVPR 2021. [PDF]

Single-Shot Freestyle Dance Reenactment.
Oren Nuriel, Oron Ashual, Lior Wolf.
CVPR 2021. [PDF]

Human Motion Transfer from Poses in the Wild.
Jian Ren, Menglei Chai, Sergey Tulyakov, Chen Fang, Xiaohui Shen, Jianchao Yang.
ECCV 2020 Workshop. [PDF]

Local Motion Phases for Learning Multi-Contact Character Movements.
Sebastian Starke, Yiwei Zhao, Taku Komura, Kazi Zaman.
Siggraph 2020. [PDF] [AI4Animation]

Neural State Machine for Character-Scene Interactions.
Sebastian Starke, He Zhang, Taku Komura, Jun Saito.
TOG 2019. [PDF] [Code & Data]

High-Fidelity Neural Human Motion Transfer from Monocular Video.
Moritz Kappel, Vladislav Golyanik, Mohamed Elgharib, Jann-Ole Henningson, Hans-Peter Seidel, Susana Castillo, Christian Theobalt, Marcus Magnor.
arxiv 2020. [PDF] [Project]

Image Animation with Perturbed Masks.
Yoav Shalev, Lior Wolf.
arxiv 2020. [PDF] [Github]

Photorealistic Audio-driven Video Portraits.
Xin Wen, Miao Wang, Christian Richardt, Ze-Yin Chen, Shi-Min Hu.
TVCG (ISMAR 2020). [PDF] [Github] [Project]

FACEGAN: Facial Attribute Controllable rEenactment GAN.
Soumya Tripathy, Juho Kannala, Esa Rahtu.
WACV 2021. [PDF]

Mesh Guided One-shot Face Reenactment using Graph Convolutional Networks.
Guangming Yao, Yi Yuan, Tianjia Shao, Kun Zhou.
ACM MM 2020. [PDF]

Action2Motion: Conditioned Generation of 3D Human Motions.
Chuan Guo, Xinxin Zuo, Sen Wang, Shihao Zou, Qingyao Sun, Annan Deng, Minglun Gong, Li Cheng.
ACM MultiMedia 2020. [PDF]

ReenactNet: Real-time Full Head Reenactment.
Mohammad Rami Koujan, Michail Christos Doukas, Anastasios Roussos, Stefanos Zafeiriou.
FG 2020. [PDF]

FaR-GAN for One-Shot Face Reenactment.
Hanxiang Hao, Sriram Baireddy, Amy R. Reibman, Edward J. Delp.
AI for content creation workshop at CVPR 2020. [PDF]

Skeleton-Aware Networks for Deep Motion Retargeting.
Kfir Aberman, Peizhuo Li, Dani Lischinski, Olga Sorkine-Hornung, Daniel Cohen-Or, Baoquan Chen.
SIGGRAPH 2020. [Github] [Project]

Unpaired Motion Style Transfer from Video to Animation.
Kfir Aberman, Yijia Weng, Dani Lischinski, Daniel Cohen-Or, Baoquan Chen.
SIGGRAPH 2020. [Github] [Project]

LipGAN: Towards Automatic Face-to-Face Translation.
Prajwal K R, Rudrabha Mukhopadhyay, Jerin Philip, Abhishek Jha, Vinay Namboodiri, C.V. Jawahar.
ACM MM 2019. [PDF] [Github]

One-Shot Identity-Preserving Portrait Reenactment.
Sitao Xiang, Yuming Gu, Pengda Xiang, Mingming He, Koki Nagano, Haiwei Chen, Hao Li.
arriv, 2020. [PDF]

Neural Head Reenactment with Latent Pose Descriptors.
Egor Burkov, Igor Pasechnik, Artur Grigorev, Victor Lempitsky.
CVPR 2020. [PDF]

StyleRig: Rigging StyleGAN for 3D Control over Portrait Images.
A. Tewari, M. Elgharib, G. Bharaj, F. Bernard, H-P. Seidel, P. Perez, M. Zollhöfer, C.Theobalt.
CVPR 2020. [PDF] [Project]

TransMoMo: Invariance-Driven Unsupervised Video Motion Retargeting.
Zhuoqian Yang, Wentao Zhu, Wayne Wu, Chen Qian, Qiang Zhou, Bolei Zhou, Chen Change Loy.
CVPR 2020. [PDF] [Github] [Project]

First Order Motion Model for Image Animation.
Aliaksandr Siarohin, Stéphane Lathuilière, Sergey Tulyakov, Elisa Ricci, Nicu Sebe.
NeurIPS 2019. [PDF] [Project] [Github]

Deferred Neural Rendering: Image Synthesis using Neural.
Justus Thies, Michael Zollhöfer, Matthias Nießner.
SIGGRAPH 2019. [PDF]

LOGAN: Unpaired Shape Transform in Latent Overcomplete Space.
Kangxue Yin, Zhiqin Chen, Hui Huang, Daniel Cohen-Or, Hao Zhang.
SIGGRAPH Asia, 2019. [PDF]

Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesis.
Wen Liu, Zhixin Piao, Jie Min, Wenhan Luo, Lin Ma, Shenghua Gao.
ICCV 2019. [PDF] [HomePage] [Github].

Learning Character-Agnostic Motion for Motion Retargeting in 2D.
Kfir Aberman, Rundi Wu, Dani Lischinski, Baoquan Chen, Daniel Cohen-Or.
SIGGRAPH 2019. [PDF] [Github] [Project]

Progressive Pose Attention Transfer for Person Image Generation.
Zhen Zhu, Tengteng Huang, Baoguang Shi, Miao Yu, Bofei Wang, Xiang Bai.
CVPR 2019. [Project] [PDF]

Textured Neural Avatars.
Aliaksandra Shysheya, Egor Zakharov, Kara-Ali Aliev, Renat Bashirov, Egor Burkov, Karim Iskakov, Aleksei Ivakhnenko, Yury Malkov, Igor Pasechnik, Dmitry Ulyanov, Alexander Vakhitov, Victor Lempitsky.
CVPR 2019 (oral). [PDF] [Project]

Appearance Composing GAN: A General Method for Appearance-Controllable Human Video Motion Transfer.
Dongxu Wei, Haibin Shen, Kejie Huang.
arxiv 2019. [PDF]

ANR: Articulated Neural Rendering of Virtual Avatars
Amit Raj, Julian Tanke, James Hays, Minh Vo, Carsten Stoll, Christoph Lassner.
CVPR 2021 [PDF][Project]

License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Stop Thinking, Just Do!