Linear Quadratic Differential Game Formulation for Leaderless Formation Control

Document Type: Research Paper


1 Young Researchers and Elite Club, Ahar Branch, Islamic Azad University, Ahar, Iran

2 Department of Computer Engineering, Karadeniz Technical University, Trabzon, Turkey

3 Department of Applied Mathematics, Faculty of Electrical Engineering and Informatics, VŠB - Technical University of Ostrava, Ostrava, Czech Republic


The leaderless formation control problem for a multi-robot system with double integrator dynamics is studied. The interaction dynamics among robots and the formation objective are added together and expressed in terms of individual cost functions. The problem is posed as a linear quadratic differential game. For the non cooperative mode of play, the open-loop Nash equilibrium solution of the formation control differential game problem is discussed. It is shown that the existence of a unique Nash equilibrium solution for the formation problem, whose cost functions are Mayer type, depends on the invertibility of a matrix introduced. A triangle formation is tested to justify the models and the results.


Main Subjects

Balch, T., Arkin, R. (1998).Behavior-based formation control for multi-robot systems.IEEE Transactions on Robotics and Automation,14(2), 926–939.

Basar, T., Olsder G. (1999).Dynamic noncooperative game theory.SIAM, 2nd edition.

Benzerrouk, A., Adouane, L., Lequievre, L., et al. (2010). Navigation of multi-robot formation in unstructured environment using dynamical virtual structures.Proceedings of the 23rd IEEE/RSJ International Conference on Intelligent Robots and Systems , Oct 18- 22, Taipei, Taiwan: 5589–5594.

Das, A., Fierro, R., Kumar, V., et al. (2002). A vision-based formation control framework.IEEE Transactions on Robotics and Automation,18(5), 813–825.

Dong, X., Xiang, J., Han, L., et al. (2017).Distributed time-varying formation tracking analysis and design for second-order multi-agent systems.Journal of Intelligent & Robotic Systems, 86(2), 277-289.

Engwerda, J.C. (1998). On the open-loop Nash equilibrium in LQ-games.Journal of Economic Dynamics and Control, 22, 729–762.

Engwerda, J.C. (2005). LQ dynamic optimization and differential games.Chichester: John Wiley & Sons.

Engwerda, J.C., Weeren, A.J.T.M. (1995). The open-loop Nash equilibrium in LQ-games revisited. Discussion Papers / CentER for Economic Research, 9551.

Gu, D. (2008). A differential game approach to formation control.IEEE Transactions on Control Systems Technology,16(1), 85-93.

Lee, S., Kim, H., Lee, S., et al. (2014).Nash equilibrium-based geometric pattern formation control for nonholonomic mobile robots.Advances in Robotics Research, 1(1).

Lin, W. (2014).Distributed UAV formation control using differential game approach.Aerospace Science and Technology, 35, 54–62.

Lin, W., Qu, Z., Simaan, M. A. (2015). Nash strategies for pursuit-evasion differential games involving limited observations. IEEE Transactions on Aerospace and Electronic Systems, 51(2), 1347-1356.

Lissaman, P.B.S, Shollenberger, C.A. (1970). Formation flight of birds.Science, 168 (3934), 1003-1005.

Merris, R. (1994). Laplacian matrices of graphs: a survey, Linear Algebra Applications.197/198; 143-176.

Mylvaganam, T., Astolfi, A. (2015).A differential game approach to formation control for a team of agents with one leader.American Control Conference, July 1–3, Chicago, IL, 1469-1474.

Özgüler, A.B., Yıldız, A. (2014). Foraging swarms as Nash equilibria of dynamic games. IEEE Transactions on Cybernetics,44(6), 979-987.

Rantzer, A. (2008). Using game theory for distributed control engineering. Sweden: Department of Automatic Control, Lund Institute of Technology, Lund University, Report TFRT; 7620.

Ren, W., Sorensen, N. (2008).Distributed coordination architecture for multi-robot formation control.Robotics and Autonomous Systems,56(4), 324-333.

Semsar-Kazerooni, E., Khorasani, K. (2009). Multi-agent team cooperation: A game theory approach. Automatica,45, 2205-2213.

Xu, D., Zhang, X., Zhu, Z., et al. (2014). Behavior-based formation control of swarm robots.Mathematical Problems in Engineering, doi/10.1155/2014/205759.

Xu, H., Zhou, X. (2013). Differential game based cooperative power control in cognitive radio networks. Wireless Personal Communications, 73, 651-662.

Zhang, J., Qi, D., Yu, M. (2014).A game theoretic approach for the distributed control of multi-agent systems under directed and time-varying topology.International Journal of Control, Automation and Systems,12(4), 749-758.

Peng, H., Zhang, S., Wu, Z., Chen, B. (2013). Precise Integration Method for Solving Noncooperative LQ Differential Game.Mathematical Problems in Engineering, vol. 2013, Article ID 713725, 9 pages, 2013. doi:10.1155/2013/713725.