• PCA技术辅助的紧凑光学神经网络的性能研究

    Research on the compact optical neural networks assisted by PCA technique

    • 随着张量数据结构复杂度不断提升,光学神经网络(Optical Neural Network, ONN)中的计算复杂度和计算量大幅增加,而且所需的光学器件数量和复杂度也在升高。为了降低神经网络的复杂度并提高其可应用性,对张量数据进行降维处理是一种有效方法。分别搭建GridNet和FFTNet架构的ONN,其中的线性光学处理单元由马赫曾德尔干涉仪(Mach-Zehnder Interferometer, MZI)实现,采用主成分分析(Principal Components Analysis, PCA)方法降低ONN输入的维数,模拟训练出高鲁棒性且结构紧凑的ONN。分别采用SGD、RMSprop、Adam 和 Adagrad 这4种训练算法以及不同的学习率,针对MNIST手写数字数据集完成ONN的前向传播和反向训练,并表征分析对应网络的性能和鲁棒性。研究结果表明:采用PCA方法减少ONN输入维度可以在有效减小网络规模的同时,保持一定的识别精确度及对MZI器件误差的鲁棒性;为达到优良的训练效果(识别精确率大于90%),需要对不同输入维度即不同规模和架构的ONN 要选择合适的训练算法和学习率。进一步,FFTNet架构对于输入维度的变化表现出了较低的敏感性。而且,不同输入维度、不同隐藏层个数的FFTNet在处理相位误差和分束器误差方面展现出了很高的鲁棒性。因此,在PCA技术辅助下,FFTNet架构的ONN结构紧凑,能够在不同规模的数据集上保持稳定的性能,且更为可靠。

       

      Abstract: As the complexity of tensor data structures continues to increase, the computational complexity and workload within Optical Neural Network (ONN) have soared, accompanied by a rise in the number and sophistication of the required optical components. To reduce the complexity of neural networks and enhance their applicability, the dimensionality reduction of tensor data emerges as an effective strategy. In this paper, we construct ONN based on GridNet and FFTNet architectures, where the linear optical processing units are implemented using Mach-Zehnder Interferometer (MZI). The Principal Component Analysis (PCA) method is employed to reduce the dimensionality of ONN inputs, enabling the simulation and training of highly robust and compact ONN. We utilize four training algorithms, Stochastic Gradient Descent (SGD), RMSprop, Adam, and Adagrad, along with various learning rates, to complete the forward propagation and backward training of the ONN on the MNIST handwritten digit dataset. Subsequently, we characterize and analyze the performance and robustness of the respective networks. The research results reveal that reducing the input dimensionality of ONN using PCA can effectively reduce the network size while maintaining a certain level of recognition accuracy and robustness against MZI device errors. Furthermore, to achieve superior training results (the recognition accuracy greater than 90%), it is crucial to select appropriate training algorithms and learning rates for ONN with different input dimensions, scales, and architectures. Furthermore, the performance of the FFTNet architecture exhibits low sensitivity to changes in input dimension, and FFTNet with varying input dimensions and numbers of hidden layers demonstrates high robustness in handling phase errors and splitter errors. Thus, assisted by PCA technique, the ONN with FFTNet architecture is compact, capable of maintaining stable performance on datasets of different sizes, and more reliable.

       

    /

    返回文章
    返回