volume | PIER Journals

Abstract

To address the stressful and time-consuming problem with the current notched antenna modelling optimization tools, an improved deep multilayer perceptron (DMLP) neural network framework is designed. The method introduces an attention mechanism (Attn) layer to improve the interpretability of the model, uses the leaky ReLU activation function to prevent the gradient from vanishing, and optimizes the structure of the DMLP model using an improved particle swarm algorithm (PSO) to improve the model prediction accuracy. Then, the notch structure geometric parameters of the designed double-notch ultra-wideband (UWB) antenna serve as input to predict the return loss S₁₁ of the antenna. The experimental results show that the method reduces the root mean square error of prediction for S₁₁ by 73.01% compared to the traditional MLP and 64.14% compared to the unimproved DMLP, which provides a solution for modelling notched UWB antennas and helps to optimize the design of this type of antenna.

1. Jing, Hua, Ge He, Jiahao Sun, and Shengyao Wang, "Design of a Reconfigurable Band Notch Antenna for UWB Applications," Progress In Electromagnetics Research C, Vol. 127, 101-112, 2022. Google Scholar

2. Rayala, Ranjit Kumar and Singaravelu Raghavan, "Artificial Neural Network Based SIW Bandpass Filter Design Using Complementary Split Ring Resonators," Progress In Electromagnetics Research C, Vol. 115, 277-289, 2021. Google Scholar

3. Khan, Mohammad Monirujjaman, Sazzad Hossain, Puezia Mozumdar, Shamima Akter, and Ratil H. Ashique, "A review on machine learning and deep learning for various antenna design applications," Heliyon, Vol. 8, No. 4, Apr. 2022.
doi:10.1016/j.heliyon.2022.e09317 Google Scholar

4. Jin, Jing, Chao Zhang, Feng Feng, Weicong Na, Jianguo Ma, and Qi-Jun Zhang, "Deep Neural Network Technique for High-Dimensional Microwave Modeling and Applications to Parameter Extraction of Microwave Filters," IEEE Transactions on Microwave Theory and Techniques, Vol. 67, No. 10, 4140-4155, Oct. 2019.
doi:10.1109/TMTT.2019.2932738 Google Scholar

5. Cheng, Gong, Mingyu Wang, Wei Zhang, and Xianping Liu, "Advanced Deep Neural Network Technique for Microwave Parametric Modeling," 2021 IEEE MTT-S International Wireless Symposium (IWS), 1-3, China, May 2021.
doi:10.1109/IWS52775.2021.9499429

6. Nan, Jingchang, Huan Xie, Mingming Gao, Yang Song, and Wendong Yang, "Design of UWB Antenna Based on Improved Deep Belief Network and Extreme Learning Machine Surrogate Models," IEEE Access, Vol. 9, 126541-126549, 2021.
doi:10.1109/ACCESS.2021.3111902 Google Scholar

7. Wang, Shui-Hua, Muhammad Attique Khan, Ziquan Zhu, and Yu-Dong Zhang, "WACPN: A Neural Network for Pneumonia Diagnosis," Computer Systems Science and Engineering, Vol. 45, No. 1, 21-34, 2023.
doi:10.32604/csse.2023.031330 Google Scholar

8. Neog, D. K., S. S. Pattnaik, D. C. Panda, S. Devi, B. Khuntia, and M. Dutta, "Design of a wideband microstrip antenna and the use of artificial neural networks in parameter calculation," IEEE Antennas and Propagation Magazine, Vol. 47, No. 3, 60-65, Jun. 2005.
doi:10.1109/MAP.2005.1532541 Google Scholar

9. Sun, Zhang, Xin Hu, Zhijun Liu, Linlin Sun, Kang Han, Weidong Wang, and Fadhel M. Ghannouchi, "Deep neural network behavioral modeling based on transfer learning for broadband wireless power amplifier," IEEE Microwave and Wireless Components Letters, Vol. 31, No. 7, 917-920, Jul. 2021.
doi:10.1109/LMWC.2021.3078459 Google Scholar

10. Zhou, S. H. and X. Zhao, "Prediction of conductor transmission line coupling cross section based on BP neural network," Modern Computer, Vol. 29, 85-90, 2023. Google Scholar

11. Liu, Zhijun, Xin Hu, Ting Liu, Xiuhua Li, Weidong Wang, and Fadhel M. Ghannouchi, "Attention-based deep neural network behavioral model for wideband wireless power amplifiers," IEEE Microwave and Wireless Components Letters, Vol. 30, No. 1, 82-85, Jan. 2020.
doi:10.1109/LMWC.2019.2952763 Google Scholar

12. Liu, Z. Y., S. S. Ma, J. Liang, C. M. Zhu, and Y. Lei, "Channel estimation algorithm for millimeter-wave large-scale MIMO systems with attention mechanism CNN," Systems Engineering and Electronics Technology, Vol. 44, 307-312, 2022. Google Scholar

13. Kingma, D. and J. Ba, "Adam: A Method for Stochastic Optimization," Computer Science, 2014. Google Scholar

14. Srivastava, Nitish, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov, "Dropout: a simple way to prevent neural networks from overfitting," Journal of Machine Learning Research, Vol. 15, 1929-1958, Jun. 2014. Google Scholar

15. Mahdi, Bejani Mohammad and Mehdi Ghatee, "A systematic review on overfitting control in shallow and deep neural networks," Artificial Intelligence Review, Vol. 54, No. 8, 6391-6438, Dec. 2021.
doi:10.1007/s10462-021-09975-1 Google Scholar

16. Xue, Ying, "An overview of overfitting and its solutions," 2018 International Conference on Computer Information Science and Application Technology, Vol. 1168, Ne Petr Univ, Daqing, Dec. 2019.
doi:10.1088/1742-6596/1168/2/022022

17. Sergey, Ioffe and Szegedy Christian, "Batch normalization: Accelerating deep network training by reducing internal covariate shift," International Conference on Machine Learning, Vol. 37, 448-456, Lille, France, Jul. 2015.

18. Kennedy, J. and R. Eberhart, "Particle swarm optimization," Proceedings of ICNN'95 - International Conference on Neural Networks, Vol. 4, 1942-1948, 1995.
doi:10.1109/ICNN.1995.488968 Google Scholar

19. Cai, L. G., Y. Q. Hou, Y. S. Zhao, and J. H. Wang, "Application research and improvement of particle swarm optimization algorithm," 2020 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS), 238-241, 2020. Google Scholar

20. Tang, J., S. Q. Zheng, Z. C. Wang, Z. H. Hong, and Y. B. Zhang, "An improved particle swarm optimization algorithm for learning factor and compression factor," Yunnan hydropower, Vol. 38, 77-79, 2022. Google Scholar

21. Niu, Zhaoyang, Guoqiang Zhong, and Hui Yu, "A review on the attention mechanism of deep learning," Neurocomputing, Vol. 452, 48-62, Sep. 2021.
doi:10.1016/j.neucom.2021.03.091 Google Scholar

22. Nayef, Bahera H., Siti Norul Huda Sheikh Abdullah, Rossilawati Sulaiman, and Zaid Abdi Alkareem Alyasseri, "Optimized leaky ReLU for handwritten Arabic character recognition using convolution neural networks," Multimedia Tools and Applications, Vol. 81, No. 2, 2065-2094, Jan. 2022.
doi:10.1007/s11042-021-11593-6 Google Scholar

23. Gao, M. M., H. L. Niu, and J. C. Nan, "Miniaturized dual band-notched ultra-wideband antenna," 2021 National Antenna Annual Conference, 990-993, 2021. Google Scholar

24. Lyu, Zimeng, AbdElRahman ElSaid, Joshua Karns, Mohamed Mkaouer, and Travis Desell, "An experimental study of weight initialization and lamarckian inheritance on neuroevolution," Applications of Evolutionary Computation, Evoapplications 2021, Vol. 12694, 584-600, Electr Network, Apr. 2021.
doi:10.1007/978-3-030-72699-7_37

Dr. Wenjin Liu

Ms. Chen Yang

Dr. Jingchang Nan

Dr. Mingming Gao

Dr. Hongliang Niu