Multi-Agent Reinforcement Learning for Secure Data Sharing in Blockchain-Empowered Vehicular Networks

Li Ming-lei; Zhang Yang; Kang Jia-wen; Xu Min-rui; Dusit Niyato

doi:10.12052/gdutxb.210112

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

Multi-Agent Reinforcement Learning for Secure Data Sharing in Blockchain-Empowered Vehicular Networks

更新时间：2026-05-27

- Multi-Agent Reinforcement Learning for Secure Data Sharing in Blockchain-Empowered Vehicular Networks
- Vol. 38, Issue 6, Pages: 62-69(2021)
- 作者机构：
  
  1. 武汉理工大学计算机科学与技术学院,湖北,武汉,430000
  2. 南京航空航天大学计算机科学与技术学院,江苏,南京,210016
  3. 广东工业大学自动化学院,广东,广州,510006
  4. 新加坡南洋理工大学计算机科学与工程学院,新加坡,639798
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.210112
  CLC： TP393
- Online First：10 November 2021，
  
  Published：2021
- 稿件说明：
移动端阅览
李明磊, 章阳, 康嘉文, 徐敏锐, DusitNiyato. 基于多智能体强化学习的区块链赋能车联网中的安全数据共享[J]. 广东工业大学学报, 2021, 38(6): 62-69.

Li Ming-lei, Zhang Yang, Kang Jia-wen, et al. Multi-Agent Reinforcement Learning for Secure Data Sharing in Blockchain-Empowered Vehicular Networks[J]. 2021, 38(6): 62-69.
李明磊, 章阳, 康嘉文, 徐敏锐, DusitNiyato. 基于多智能体强化学习的区块链赋能车联网中的安全数据共享[J]. 广东工业大学学报, 2021, 38(6): 62-69. DOI： 10.12052/gdutxb.210112.

Li Ming-lei, Zhang Yang, Kang Jia-wen, et al. Multi-Agent Reinforcement Learning for Secure Data Sharing in Blockchain-Empowered Vehicular Networks[J]. 2021, 38(6): 62-69. DOI： 10.12052/gdutxb.210112.

摘要

针对基于委托权益证明(Delegated Proof-of-Stake

DPoS) 共识算法的区块链赋能车联网系统中区块验证的安全性与可靠性问题

矿工通过引入轻节点(如智能手机等边缘节点)共同参与区块验证，提高区块验证的安全性和可靠性。为了激励矿工主动引入轻节点

采用了斯坦伯格(Stackelberg)博弈模型对区块链用户与矿工进行建模

实现区块链用户的效用和矿工的个人利润最大化。作为博弈主方的区块链用户设定最优的区块验证的交易费

而作为博弈从方的矿工决定最优的招募验证者(即轻节点)的数量。为了找到所设计Stackelberg博弈的纳什均衡

设计了一种基于多智能体强化学习算法来搜索接近最优的策略。最后对本文方案进行验证

结果表明该方案既能实现区块链用户和矿工效益最大化

也能保证区块验证的安全性与可靠性。

Abstract

To achieve secure and reliable block verification

miner nodes of Delegated Proof-of-Stake (DPoS) consensus algorithm can collaborate with nearby light nodes (e.g.

smart phones) to verify new block data for secure blockchain-empowered vehicular networks. In order to encourage miners to actively cooperate with light nodes in block verification

a Stackelberg game model is proposed to formulate the interaction between blockchain users and miners

thus jointly maximizing the utility of blockchain users and the profits of miners. The blockchain user acts as the leader setting the optimal transaction fee for block verification

and the miners as the followers determining the optimal number of verifiers to be recruited for block verification. To find out the Nash equilibrium of the game model

a multi-agent reinforcement learning algorithm is designed to search for a strategy close to the optimal one. The numerical results show that the proposed scheme can jointly maximize the benefits of blockchain users and miners and also ensure the safety and reliability of block verification.

关键词

Keywords

references

LIU Z W, SONG H K, HAO H, et al . Innovation and development strategies of China’s new-generation smart vehicles based on 4S integration [J ] . Engineering Sciences, 2021, 23(3): 153-162.

YANG Z, YANG K, LEI L, et al . Blockchain-based decentralized trust management in vehicular networks [J ] . IEEE Internet of Things Journal, 2018, 6(2): 1495-1505.

WANG C D, LUO W W, MO X L, et al . Survey on mutual trust authentication and secure communication of internet of vehicles [J ] . Computer Science, 2020, 47(11): 1-9.

CHEN C, WU J, LIN H, et al . A secure and efficient blockchain-based data trading approach for Internet of vehicles [J ] . IEEE Transactions on Vehicular Technology, 2019, 68(9): 9110-9121.

YUAN Y, WANG F Y. Towards blockchain-based intelligent transportation systems[C]//2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC). Rio de Janeiro: IEEE, 2016: 2663-2668.

KANG J, YU R, HUANG X, et al . Enabling localized peer-to-peer electricity trading among plug-in hybrid electric vehicles using consortium blockchains [J ] . IEEE Transactions on Industrial Informatics, 2017, 13(6): 3154-3164.

TAN M S, YANG J, DING L, et al . Review of consensus mechanism of blockchain [J ] . Computer Engineering, 2020, 46(12): 1-11.

GAO Y, TAN X C. Improvement of DPoS consensus mechanism [J]. Application Research of Computers, 2020, 37(10): 3086-3090.

KANG J, XIONG Z, NIYATO D, et al . Toward secure blockchain-enabled Internet of vehicles: optimizing consensus management using reputation and contract theory [J ] . IEEE Transactions on Vehicular Technology, 2019, 68(3): 2906-2920.

OMETOV A, BAEDINOVA Y, AFANASYEVA A, et al . An Overview on blockchain for smartphones: state-of-the-art, consensus, implementation, challenges and future trends [J ] . IEEE Access, 2020, 8: 103994-104015.

KANG J, XIONG Z, NIYATO D, et al . Incentivizing consensus propagation in proof-of-stake based consortium blockchain networks [J ] . IEEE Wireless Communications Letters, 2018, 8(1): 157-160.

DAI Y, XU D, ZHANG K, et al . Deep reinforcement learning and permissioned blockchain for content caching in vehicular edge computing and networks [J ] . IEEE Transactions on Vehicular Technology, 2020, 69(4): 4312-4324.

MOLLAH M B, ZHAO J, NIYATO D, et al . Blockchain for the Internet of vehicles towards intelligent transportation systems: a survey [J ] . IEEE Internet of Things Journal, 2021, 8(6): 4157-4185.

TOMESCU A, DEVADAS S. Catena: efficient non-equivocation via bitcoin[C]//2017 IEEE Symposium on Security and Privacy (SP). San Jose: IEEE, 2017: 393-409.

HSUEH C W, CHIN C T. EPoW: solving blockchain problems economically[C]//2017 IEEE Smart World, Ubiquitous Intelligence Computing, Advanced Trusted Computed, Scalable Computing Communications, Cloud Big Data Computing, Internet of People and Smart City Innovation . San Francisco: IEEE, 2017: 1-8.

LI L, OTA K, DONG M. Sustainable CNN for robotic: an offloading game in the 3D vision computation [J]. IEEE Transactions on Sustainable Computing, 2018, 4(1): 67-76.

YANG D, XUE G, FANG X, et al . Incentive mechanisms for crowdsensing: crowdsourcing with smartphones [J ] . IEEE/ACM Transactions on Networking, 2015, 24(3): 1732-1744.

LIU X, WANG W, NIYATO D, et al . Evolutionary game for mining pool selection in blockchain networks [J ] . IEEE Wireless Communications Letters, 2018, 7(5): 760-763.

DECKER C, WATTENHOFER R. Information propagation in the bitcoin network[C]//IEEE P2P 2013 Proceedings. Trento: IEEE, 2013: 1-10.

WU Y X, CAI T, ZHANG D B. Computing power trading and pricing mobile edge computing based on Stackelberg game [J]. Journal of Computer Applications, 2020, 40(9): 2683-2690.

YE P W, JIA X D, YANG X R, et al . Collaborative edge and cloud offloading for Internet of vehicles using multi-agent reinforcement learning [J ] . Computer Engineering, 2021, 47(4): 13-20.

CHEN Q B, TAN Q, HE L Q, et al . Research on resource allocation and offloading decision based on multi-agent architecture in cloud-fog hybrid network [J ] . Journal of Electronics and Information Technology, 2021, 43(9): 2654-2662.

HERNANDEZ-LEAL P, KARTAL B, TAYLOR M E. A survey and critique of multiagent deep reinforcement learning [J]. Autonomous Agents and Multi-Agent Systems, 2019, 33(6): 750-797.

GUO D, TANG L, ZHANG X, et al . Joint optimization of handover control and power allocation based on multi-agent deep reinforcement learning [J ] . IEEE Transactions on Vehicular Technology, 2020, 69(11): 13124-13138.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

A Research on the Analysis Method of System Income Based on the Behavior Game Between Operators and Managers

Decision Making and Coordination of Three-layer E-commerce Supply Chain Based on F2F

A Study of the Incompatible Problem of Air Occupancy Rates

Analysis of the Badminton Match-throwing at London Olympic Games Based on ESGS

Ground Deformation Monitoring and Influencing Factors Analysis in Fuzhou City Based on PSI Technology

Related Author

Li Sha-sha

Cui Tie-jun

Xu Hui-ting

Wang Na-na

Liu Wei

Qiu Jin-long

Yang Hong-zhi

Liu Wei

Related Institution

College of Business Administration, Liaoning Technical University

College of Safety Science and Engineering, Liaoning Technical University

College of Finance and Business, Xiamen City University

School of Maritime Economics and Management, Dalian Maritime University

School of Science, Dalian Maritime University

AI问答

⁰