Outline

Ingegneria Sismica

Ingegneria Sismica

Exploration of deep deterministic policy gradient algorithm in high-frequency trading strategy in power market

Author(s): Yunpeng Feng1
1School of Automation Science and Engineering, South China University of Technology, Guangzhou, 510000, Guangdong, China
Feng, Yunpeng. “Exploration of deep deterministic policy gradient algorithm in high-frequency trading strategy in power market.” Ingegneria Sismica Volume 43 Issue 2: 1-23, doi:10.65102/is2026549.

Abstract

This paper focuses on the strategy generation task in high-frequency trading in the electricity market, and explores the application of deep deterministic policy gradient algorithm in continuous bidding decision-making. Based on the information of node marginal electricity price, load deviation, renewable output and offer depth, a transaction dataset consisting of 168,000 market time slices, 42 price variables, six bidding features and 18,400 settlement records is constructed. Through time series feature encoding, market interaction environment modeling and Actor-Critic structure, the continuous bidding actions under revenue and risk constraints are jointly learned. Compared with DQN, PPO and rule-based methods, the proposed framework achieves 18.7% cumulative return rate, 1.64 Sharpe ratio and 9.8% maximum backoff, and the average decision delay remains at 7.8 ms. The results show that DDPG can provide more stable strategy learning ability, more accurate continuous bidding control effect, higher computational execution efficiency and online deployment ability for the power market trading system.

 

Keywords
DDPG; Electricity market; High-frequency trading; Strategy learning

Related Articles

Huiqiao Liu1
1Yinchuan University of Energy, Ningxia, 750000, China
Xin Zhao1, Yan Li1, Xiangyang Cao1, Qiushuang Li1, Jianing Zhang1
1State Grid Shandong Electric Power Company Economic and Technological Research Institute ShanDong JiNan 250001, China
Dan Yang1
1School of Marxism, Suzhou Polytechnic University, Suzhou, 215104, China
Liuhang Shen1, Xiangwen Sun1
1Ulster college at Shaanxi University of Science &Technology, Xi’an,710021, Shaanxi, China