volume | PIER Journals

Abstract

This paper focuses on optimizing the radiation pattern of sparse array antennas using reinforcement learning, with many algorithms. The paper aims to leverage Proximal Policy Optimization's (PPO's) advantages in optimization and its effectiveness in handling stochastic transitions and rewards to achieve a reduced number of elements while maintaining desired signal performance and minimizing unnecessary side lobe signals. By removing a few of the antennas using reinforcement learning and PPO optimization, the same results as a complete array have been obtained. The anticipated outcomes of this research hold the promise of significantly enhancing the effectiveness and utility of sparse array antennas in communication systems.

1. Liu, Yanhui, Zaiping Nie, and Qing Huo Liu, "Reducing the number of elements in a linear antenna array by the matrix pencil method," IEEE Transactions on Antennas and Propagation, Vol. 56, No. 9, 2955-2962, 2008. Google Scholar

2. Merino-Fernandez, Irene, Sunil L. Khemchandani, Javier Del Pino, and Jose Saiz-Perez, "Phased array antenna analysis workflow applied to gateways for LEO satellite communications," Sensors, Vol. 22, No. 23, 9406, 2022. Google Scholar

3. Luo, Qi, Steven Shichang Gao, Wei Liu, and Chao Gu, Low-cost Smart Antennas, John Wiley & Sons, 2019.

4. Rahmat-Samii, Yahya, Joshua M. Kovitz, and Harish Rajagopalan, "Nature-inspired optimization techniques in communication antenna designs," Proceedings of the IEEE, Vol. 100, No. 7, 2132-2144, Jul. 2012. Google Scholar

5. Koziel, Slawomir and Anna Pietrenko-Dabrowska, "Accelerated gradient-based optimization of antenna structures using multifidelity simulations and convergence-based model management scheme," IEEE Transactions on Antennas and Propagation, Vol. 69, No. 12, 8778-8789, Dec. 2021. Google Scholar

6. Casula, Giovanni Andrea, Giuseppe Mazzarella, and Nicola Sirena, "Evolutionary design of wide-band parasitic dipole arrays," IEEE Transactions on Antennas and Propagation, Vol. 59, No. 11, 4094-4102, Nov. 2011. Google Scholar

7. Bray, Matthew G., Douglas H. Werner, Daniel W. Boeringer, and David W. Machuga, "Optimization of thinned aperiodic linear phased arrays using genetic algorithms to reduce grating lobes during scanning," IEEE Transactions on Antennas and Propagation, Vol. 50, No. 12, 1732-1742, 2002. Google Scholar

8. Larmour, C., N. Buchanan, V. Fusco, and M. Ali Babar Abbasi, "Sparse array mutual coupling reduction," IEEE Open Journal of Antennas and Propagation, Vol. 5, No. 1, 201-216, Feb. 2024. Google Scholar

9. Wang, Shuoguang, Shiyong Li, Bailing Ren, Ke Miao, Guoqiang Zhao, and Houjun Sun, "Convex optimization-based design of sparse arrays for 3-D near-field imaging," IEEE Sensors Journal, Vol. 23, No. 9, 9640-9648, May 2023. Google Scholar

10. Huan, Mingsai, Junli Liang, Yifan Wu, Yongkang Li, and Wei Liu, "SASA: Super-resolution and ambiguity-free sparse array geometry optimization with aperture size constraints for MIMO radar," IEEE Transactions on Antennas and Propagation, Vol. 71, No. 6, 4941-4954, Jun. 2023. Google Scholar

11. Willey, R., "Space tapaering of linear and planar arrays," IRE Transactions on Antennas and Propagation, Vol. 10, No. 4, 369-377, Jul. 1962. Google Scholar

12. Haupt, Randy L., "Thinned arrays using genetic algorithms," IEEE Transactions on Antennas and Propagation, Vol. 42, No. 7, 993-999, Jul. 1994. Google Scholar

13. Deparateanu, Daniel, Florin Enache, Andrei Enache, Florin Popescu, and Ioan Nicolaescu, "Sparse array antenna optimization using genetic alghoritms," 2016 8th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), 1-4, Ploiesti, Romania, 2016.

14. Yang, Ping, Bin Chen, and Ke-Ren Shi, "A novel method to design sparse linear arrays for ultrasonic phased array," Ultrasonics, Vol. 44, e717-e721, Dec. 2006. Google Scholar

15. Balanis, Constantine A., Antenna Theory: Analysis and Design, John Wiley & Sons, 2016.

16. Yang, Xin, Deqiang Yang, Yanwen Zhao, Jin Pan, and Yongpin Chen, "Synthesis of linear sparse array using DNN-based machine-learning method," IEEE Transactions on Antennas and Propagation, Vol. 71, No. 8, 6513-6522, Aug. 2023. Google Scholar

17. Li, Hailin, Yachao Jiang, Yuan Ding, Jing Tan, and Jianjiang Zhou, "Low-sidelobe pattern synthesis for sparse conformal arrays based on PSO-SOCP optimization," IEEE Access, Vol. 6, 77429-77439, 2018. Google Scholar

18. Liang, Zhipeng, Jun Ouyang, and Feng Yang, "A hybrid GA-PSO optimization algorithm for conformal antenna array pattern synthesis," Journal of Electromagnetic Waves and Applications, Vol. 32, No. 13, 1601-1615, 2018. Google Scholar

19. Cui, Liangze, Yao Zhang, Runren Zhang, and Qing Huo Liu, "A modified efficient KNN method for antenna optimization and design," IEEE Transactions on Antennas and Propagation, Vol. 68, No. 10, 6858-6866, Oct. 2020. Google Scholar

20. Willey, R., "Space tapaering of linear and planar arrays," IRE Transactions on Antennas and Propagation, Vol. 10, No. 4, 369-377, 1962. Google Scholar

21. Lapan, Maxim, Deep Reinforcement Learning Hands-on: Apply Modern RL Methods to Practical Problems of Chatbots, Robotics, Discrete Optimization, Web Automation, and More, Packt Publishing Ltd, 2020.

22. Fu, Kai, Xiwen Cai, Bo Yuan, Yang Yang, and Xin Yao, "An efficient surrogate assisted particle swarm optimization for antenna synthesis," IEEE Transactions on Antennas and Propagation, Vol. 70, No. 7, 4977-4984, Jul. 2022. Google Scholar

23. He, Yuanzhi and Changxu Wang, "Optimization design for sparse planar array in satellite communications," Electronics, Vol. 12, No. 8, 1763, 2023. Google Scholar

Dr. Sajad Mohammad-Ali-Nezhad

Dr. Mohammad Hassan Kassem