Outline

Ingegneria Sismica

Ingegneria Sismica

Exploration of deep deterministic policy gradient algorithm in high-frequency trading strategy in power market

Author(s): Yunpeng Feng1
1School of Automation Science and Engineering, South China University of Technology, Guangzhou, 510000, Guangdong, China
Feng, Yunpeng. “Exploration of deep deterministic policy gradient algorithm in high-frequency trading strategy in power market.” Ingegneria Sismica Volume 43 Issue 2: 1-23, doi:10.65102/is2026549.

Abstract

This paper focuses on the strategy generation task in high-frequency trading in the electricity market, and explores the application of deep deterministic policy gradient algorithm in continuous bidding decision-making. Based on the information of node marginal electricity price, load deviation, renewable output and offer depth, a transaction dataset consisting of 168,000 market time slices, 42 price variables, six bidding features and 18,400 settlement records is constructed. Through time series feature encoding, market interaction environment modeling and Actor-Critic structure, the continuous bidding actions under revenue and risk constraints are jointly learned. Compared with DQN, PPO and rule-based methods, the proposed framework achieves 18.7% cumulative return rate, 1.64 Sharpe ratio and 9.8% maximum backoff, and the average decision delay remains at 7.8 ms. The results show that DDPG can provide more stable strategy learning ability, more accurate continuous bidding control effect, higher computational execution efficiency and online deployment ability for the power market trading system.

 

Keywords
DDPG; Electricity market; High-frequency trading; Strategy learning

Related Articles

Qianwen Xiong1, Yuhong Chen1
1Guangzhou University of Chinese Medicine, School of Pharmaceutical Medicine, Guangzhou,Guangdong,China,510006
Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China