J4

• 计算机科学 • 上一篇    下一篇

一种基于遗传算法和LM算法的混合学习算法

张长胜, 欧阳丹彤, 岳娜, 张永刚   

  1. 吉林大学 计算机科学与技术学院, 长春 130012; 吉林大学 符号计算与知识工程教育部重点实验室, 长春 130012
  • 收稿日期:2007-08-20 修回日期:1900-01-01 出版日期:2008-07-26 发布日期:2008-07-26

A Hybrid Algorithm Based on Genetic Algorithmand LevenbergMarquardt

ZHANG Changsheng, OUYANG Dan tong, YUE Na, ZHANG Yonggang   

  1. College of Computer Science and Technology, Jilin University, Changchun 130012, China; Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China
  • Received:2007-08-20 Revised:1900-01-01 Online:2008-07-26 Published:2008-07-26

摘要: 针对遗传算法与神经网络结合方式中存在的早熟收敛、泛化能力弱等问题, 提出一种交替使用遗传算法和LevenbergMarquardt算法优化神经网络的混合学习算法(GALM算法). 该算法先通过遗传算法粗调得到一组全局最优近似解, 再以该近似解为初值, 交替使用遗传算法和LM算法优化神经网络训练, 直至发现满意的网络参数. 实验结果表明, 新算法提高了网络的学习能力和收敛速度.

关键词: LM算法, 遗传算法, 神经网络, GALM算法

Abstract: In order to overcome the insufficiencies of premature convergence and weak extensive ability in the combination of Genetic Algorithm and Artificial Neural Networks, we proposed a new hybrid study algorithmGALM, which uses the Genetic Algorithm and Levenberg Marquardt in turn to optimize the neural network. This algorithm mainly includes two stages: First a group of solutions were obtained which approximate the global optimum through cursorily adjusting the genetic algorithm. Then these approximate solutions were taken as the initial values, the GA and LM algorithms were used to optimize the neural networktraining in turn until the satisfactory network parameters were found. Finally we compared the GALM algorithm with other relevant algorithms through experimentation. The results indicate that our algorithm can effectively overcome the problem about falling into the local optimal solutions, and remarkably improves the network learning capability and the convergence rate.

Key words: LM algorithm, genetic algorithm, neural network, GALM algorithm

中图分类号: 

  • TP18