AbstractTemporal information in event streams plays a critical role in event‐based video frame interpolation as it provides temporal context cues complementary to images. Most previous event‐based methods first transform the unstructured event data to structured data formats through voxelisation, and then employ advanced CNNs to extract temporal information. However, voxelisation inevitably leads to information loss, and processing the sparse voxels introduces severe computation redundancy. To address these limitations, this study proposes a point‐image fusion network (PIFNet). In our PIFNet, rich temporal information from the events can be directly extracted at the point level. Then, a fusion module is designed to fuse complementary cues from both points and images for frame interpolation. Extensive experiments on both synthetic and real datasets demonstrate that our PIFNet achieves state‐of‐the‐art performance with high efficiency.

More from our Archive

• DOI: 10.1049/ipr2.12854 2023

  Image segmentation technology based on transformer in medical decision‐making system

  Keke He, Fangfang Gou, Jia Wu

• DOI: 10.3390/jimaging9070140 2023

  Conv-ViT: A Convolution and Vision Transformer-Based Hybrid Feature Extraction Method for Retinal Disease Detection

  Pramit Dutta, Khaleda Akther Sathi, Md. Azad Hossain, M. Ali Akber Dewan

• DOI: 10.1049/cit2.12259 2023

  Thermoelectric energy harvesting for internet of things devices using machine learning: A review

  Tereza Kucova, Michal Prauzek, Jaromir Konecny, Darius Andriukaitis, Mindaugas Zilys, Radek Martinek

• DOI: 10.1049/ipr2.12841 2023

  Multimodal predictive classification of Alzheimer's disease based on attention‐combined fusion network: Integrated neuroimaging modalities and medical examination data

  Hui Chen, Huiru Guo, Longqiang Xing, Da Chen, Ting Yuan, Yunpeng Zhang, Xuedian Zhang

• DOI: 10.3390/jimaging9070134 2023

  Diagnostic Applications of Intraoral Scanners: A Systematic Review

  Francesca Angelone, Alfonso Maria Ponsiglione, Carlo Ricciardi, Giuseppe Cesarelli, Mario Sansone, Francesco Amato

• DOI: 10.1049/cvi2.12221 2023

  Mirror complementary transformer network for RGB‐thermal salient object detection

  Xiurong Jiang, Yifan Hou, Hui Tian, Lin Zhu

• DOI: 10.1142/s0219467824500402 2023

  Computer-Aided Classification of Cell Lung Cancer Via PET/CT Images Using Convolutional Neural Network

  Dhekra El Hamdi, Ines Elouedi, Ihsen Slim

• DOI: 10.3390/jimaging9070144 2023

  Varroa Destructor Classification Using Legendre–Fourier Moments with Different Color Spaces

  Alicia Noriega-Escamilla, César J. Camacho-Bello, Rosa M. Ortega-Mendoza, José H. Arroyo-Núñez, Lucia Gutiérrez-Lazcano

• DOI: 10.1049/ipr2.12871 2023

  LiteDEKR: End‐to‐end lite 2D human pose estimation network

  Xueqiang Lv, Wei Hao, Lianghai Tian, Jing Han, Yuzhong Chen, Zangtai Cai

• DOI: 10.1049/ipr2.12870 2023

  FCUnet: Refined remote sensing image segmentation method based on a fuzzy deep learning conditional random field network

  Xiangyue Ma, Jindong Xu, Qiangpeng Chong, Shifeng Ou, Haihua Xing, Mengying Ni