摘要
Convolutional neural networks are paramount in image and signal processing, and are responsible for the majority of image recognition power consumption today, concentrated mainly in convolution computations. With convolution operations being computationally intensive, next-generation hardware accelerators need to offer parallelization and high efficiency. Diffractive optics offers the promise of low-latency, highly parallel convolution operations. However, thus far parallelism is only partially harvested, thereby significantly underdelivering in comparison to its throughput potential. Here, a parallelized operation high-throughput Fourier optic convolutional accelerator is demonstrated. For the first time, simultaneous processing of multiple kernels in Fourier domain enabled by optical diffraction orders is achieved alongside input parallelism. The proposed approach can offer approximate to 100x speedup over the previous generation optical diffraction-based processor and 10x speedup over other state-of-the-art optical Fourier classifiers.
学科与关键词
- Optical Neuromorphic Processor at 11 TeraOPs/s based on Kerr Soliton Crystal Micro-combsTan, Mengxi; Xu, Xingyuan; Wu, Jiayang; Boes, Andreas; Corcoran, Bill; Nguyen, Thach G.; Chu, Sai T.; Little, Brent E.; Hicks, Damien G.; Morandotti, Roberto; Mitchell, Arnan; Moss, David J.*Optical Fiber Communications Conference and Exhibition (OFC), San Diego, CA, 2022-03-06 To 2022-03-10.
- Sophisticated deep learning with on-chip optical diffractive tensor processingHuang, Yuyao; Fu, Tingzhao; Huang, Honghao; Yang, Sigang; Chen, Hongwei*Photonics Research, 2023, 11(6): 1125-1138.被引 11
- Meta-optic accelerators for object classifiersZheng, Hanyu; Liu, Quan; Zhou, You; Kravchenko, Ivan I.; Huo, Yuankai; Valentine, Jason*Science Advances, 2022, 8(30): eabo6410.被引 33
