img

Wechat

Adv. Search

Gold Science and Technology ›› 2023, Vol. 31 ›› Issue (4): 613-623.doi: 10.11872/j.issn.1005-2518.2023.04.171

• Mining Technology and Mine Management • Previous Articles     Next Articles

Application of CNN-LSTM Model in Slope Reliability Analysis

Guangxu RONG1(),Zongyang LI2   

  1. 1.School of Geology and Construction Engineering, Anhui Technical College of Industry and Economy, Hefei 230051, Anhui, China
    2.The First Institute of Hydrology and Engineering Geological Prospecting, Anhui Geological Prospecting Bureau, Bengbu 233000, Anhui, China
  • Received:2022-11-12 Revised:2023-02-03 Online:2023-08-30 Published:2023-09-20

Abstract:

When the traditional limit equilibrium method is used for slope reliability analysis,because of the performance function is implicit and the form is complicated,the iterative process of solving the function becomes complicated and the computational efficiency is low.Aiming at the above problems,a CNN-LSTM model method was proposed.The principle of this method is to first extract the data features by using convolutional neural network(CNN),and then predict the slope failure probability by using short and long time memory network(LSTM).On the basis of fully considering the value range of the CNN-LSTM model’s hyperparameters,the five-factor and four-level orthogonal test table was used to design the hyperparameters.Finally,the convolutional output dimension of the first layer and the second layer of the CNN network architecture in the CNN-LSTM model were determined to be 64 and 8 respectively.Dropout ratio is 0.5,the number of the first layer of the LSTM structure is 5 units and the number of the second layer of hidden layers is 20 units,respectively.The 420 slope sample data collected from central and western regions of China were used to train the model according to the ratio of 7∶3 between the training set and the verification set,and the optimal parameters of the CNN-LSTM model were obtained. Finally,Yanshanji landslide was taken as an example to illustrate the feasibility of the model method.The CNN-LSTM model was compared with Monte Carlo method(MCS),response surface method,single CNN,LSTM model and multiple linear regression model in terms of computational efficiency and failure probability prediction.The results show that:(1)When the MCS sampling times is 10 000,compared with the traditional MCS,although the CNN-LSTM model has a relative error of 4.35% in predicting the slope failure probability,in terms of computational efficiency,the CNN-LSTM model takes 45.28 s and the MCS takes 119 s,so the CNN-LSTM model increases the efficiency nearly 2 times.(2)When the single CNN model and LSTM model both adopt two-layer architecture,although the number of parameters of the CNN-LSTM model is not optimal,it has excellent performance in terms of calculation time and prediction accuracy of failure probability due to the small overfitting risk of the model.Compared with the multiple linear regression model,the relative error of CNN-LSTM prediction is 4.35%,and that of multiple linear regression is 34.78%.Through the above two points,the CNN-LSTM model can well complete the analysis of slope reliability,and avoid solving the implicit performance function,and the work efficiency is high.

Key words: slope, reliability, orthogonal test design, hyperparameter, CNN-LSTM model

CLC Number: 

  • TU43

Fig.1

Schematic diagram of CNN model"

Fig.2

Block diagram of ‘Cells’ in the LSTM"

Fig.3

Structure of the CNN-LSTM model"

Table 1

Range of hyperparameters"

超参数取值范围
kernel1,2,3,4,5,6,7,8
filters8,16,32,64,256,512
hidden8,16,32,64,256
dropout0.1,0.2,0.3,0.4,0.5,0.6,0.7,0.8,0.9

Table 2

Orthogonal test data and RMSE results"

方案编号ABCDERMSE
188550.30.2878
281610100.40.1366
383215150.50.1307
486420200.60.1150
516810150.60.1849
616165200.50.1266
716322050.40.1452
8166415100.30.1632
932815200.40.1594
10321620150.30.1438
1132325100.60.1460
1232641050.50.1512
1364820100.50.0837
1464161550.60.1648
15643210200.30.1653
1664645150.40.2099

Fig.4

Calculation flow of CNN-LSTM model based on orthogonal test design"

Table 3

Partial data of data sets"

样本编号h/mα/(°)μc/kPaφ/(°)γ/(kN·m-3p/mm稳定状态标签值
样本190.0180.2719.559.9123.049501
样本2136.5220.3221.3010.1020.031 2000
样本337.0250.3411.008.5020.501 0951
样本433.0150.3221.0010.0018.809951
样本570.0130.309.6110.4419.471 0200
?????????
样本41641.7120.2934.7213.3019.941 2701
样本41785.0180.3518.6015.1019.501 0671
样本418183.0400.2817.6020.3025.001 1100
样本41950.0130.3031.0015.7319.301 3201
样本42040.0120.3120.8014.5819.321 2600

Table 4

Description of the relevant indexes of datasets"

项目h/mα/(°)μc/kPaφ/(°)

γ

/(kN·m-3

p/mm
最大值511.0053.000.42107.0045.0031.301 479.00
最小值16.668.000.270.000.0012.00876.00
平均值112.4334.510.3227.9423.0120.811 203.00
标准差129.2910.110.0622.5716.333.366.77

Fig.5

Training loss function value(MSE) of the CNN-LSTM model"

Table 5

Reliability analysis results of different methods for example 1"

分析方法失效概率/%相对误差/%
蒙特卡洛法(安正明等,2022)15.36-
本文方法15.400.26

Fig.6

Yanshanji landslide"

Table 6

Parameters of Yanshanji landslide"

参数及单位参数值参数及单位参数值
h/m78c/kPa9.81
α/(°)13φ/(°)9.34
μ0.31p/mm1 191.3
γ/(kN·m-319.58

Table 7

Comparison of calculation results between CNN-LSTM and other models"

模型失效概率/%相对误差/%计算耗时/s
MCS0.0023-119
CNN-LSTM0.00244.3545
RSM0.0062169.6068
FORM0.0062169.60151

Table 8

Comparison of parameter and testing results of each model"

模型名称模型描述参数数量/个训练用时/s测试用时/s
CNN1filter3283 23245.212.23
CNN2filter64166 17647.532.26
LSTM150个单元74 20043.722.10
LSTM2100个单元168 40048.242.16
CNN-LSTM

CNN:第一层卷积核为64,第二层卷积核为8;

LSTM:第一层20个单元,第二层10个单元

76 71343.301.98

Fig.7

Training set/validation set loss value(MSE) of each model"

Table 9

Comparison of predictive performance and results of each model"

模型MAERMSE失效概率/%pf相对误差/%
MCS--0.0023-
CNN0.09490.10240.0047104.00
LSTM0.09260.09420.004491.30
CNN-LSTM0.07940.08370.00244.35
MLR0.08210.08860.003134.78
Ahmed R, Sreeram V, Mishra Y,et al,2020.A review and evaluation of the state of the art in PV solar power forecasting:Techniques and optimization[J].Renewable and Sustainable Energy Reviews,124:109792.
An Zhengming, Fang Zhengfeng, Zhou Xingtong,et al,2022.Reliability analysis of the slope stability of the soil disposal area in a mountainous highway construction[J].Soil Engineering and Foundation,36(4):626-629.
Bisharad D, Laskar R H,2019.Music genre recognition using convolutional recurrent neural network architecture[J].Expert Systems,36(4):e12429.
Chen K, Zhou Y, Dai F,2015.A LSTM-based method for stock returns prediction:A case study of China stock market[C]//IEEE International Conference on Big Data.Santa Clara:IEEE.
Chen T, Xu R, He Y,et al,2017.Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN[J].Expert Systems with Applications,72:221-230.
Das S K, Biswal R K, Sivakugan N,et al,2011.Classification of slopes and prediction of factor of safety using differential evolution neural networks[J].Environmental Earth Sciences,64(1):201-210.
Devesa R, Moldes A, Diaz-Fierros F,et al,2007.Extraction study of algal pigments in river bed sediments by applying factorial designs[J].Talanta,72(4):1546-1551.
Diederik P K, Jimmy B,2016.Adam:A method for stochastic optimization[C]//The 4th International Conference on Learning Representations(ICLR),2016.San Juan,Puerto Rico:International Machine Learning Society.
Duan Nan, Xue Huimin, Pan Yue,2002.A method for determining the number realizations in the calculation of reliability by Monte Carlo simulation method[J].Coal Mine Machinery,(3):13-14.
Graves A, Jaitly N, Mohamed A,2013.Hybrid speech recognition with deep bidirectional LSTM[C]//2013 IEEE Workshop on Automatic Speech Recognition and Understanding.Xi’an:IEEE: 273-278.
Huang Zhuotao,2022.Reliability Analysis of Heterogeneous Reservoir Slopes Using Machine Learning Algorithms[D].Nanchang:Nanchang University.
Ji Jian, Jiang Zhen, Yin Xin,et al,2022.Slope reliability analysis based on deep learning of digital images of random fields using CNN[J].Chinese Journal of Geotechnical Engineering,44(8):1463-1473.
Jiang Shuihua, Li Dianqing, Zhou Chuangbing,2013.Non-intrusive stochastic finite element method for slope reliability analysis based on Latin hypercube sampling[J].Chinese Journal of Geotechnical Engineering,35(Supp.2):70-76.
Liu C, Hou W, Liu D,2017.Foreign exchange rates forecasting with convolutional neural network[J].Neural Processing Letters,46(2):1095-1119.
Liu Y, Zhao Z, Zhang S,et al,2020.Identification of abnormal processes with spatial-temporal data using convolutional neural networks[J].Processes,8(1):73-91.
Niu Caoyuan, Wang Lehua, Xu Xiaoliang,2017.Study on impact from statistical characteristics of soil mass shear strength parameters on slope reliability[J].Water Resources and Hydropower Engineering,48(12):195-198,206.
Pedregosa F, Varoquaux G,et al,2011.Scikit-learn:Machine learning in python[J].Journal of Machine Learn Research,12:2825-2830.
Rawat W, Wang Z,2017.Deep convolutional neural networks for image classification:A comprehensive review[J].Neural Computer,29(9):2352-2449.
Rong Guangxu, Peng Yan, Tian Kai,2021.Application of ABAQUS finite element strength reduction program based on Python in slope stability analysis[J].Journal of North University of China(Natural Science Edition),42(4):332-339.
Shu Suxun, Gong Wenhui,2014.Fuzz random reliability analysis of slopes considering spatial variability of soil parameters[J].Huazhong University of Science and Technology(Natural Science Edition),42(9):93-97.
Suman S, Khan S Z, Das S K,et al,2016.Slope stability analysis using artificial intelligence techniques[J].Natural Hazards,84(2):727-748.
Sun X, Li C, Ren F,2016.Sentiment analysis for Chinese microblog based on deep neural networks with convolutional extension features[J].Neurocomputing,210:227-236.
Wan H B, Lan W G, Wong M K,et al,1994.Orthogonal array designs for the optimization of liquid chromatographic analysis of pesticides[J].Analytica Chimica Acta,289(3):371-380.
Wang Chaoyang, Li Limin, Wen Zongzhou,et al,2022.Dynamic prediction of landslide displacement based on time series and CNN-LSTM[J].Foreign Electronic Measurement Technology,41(3):1-8.
Wang Z Z, Goh S G,2021.Novel approach to efficient slope reliability analysis in spatially variable soils[J].Engineering Geology,281:105989.
Xie Xiudong, Fang Jianrui, Fan Wei,et al,2008.Research on analysis of slope stability based on reliability theory[J].Journal of Natural Disasters,17(2):110-115.
Xu Xiaoyuan, Wang Han, Yan Zheng,et al,2021.Overview of power system uncertainty and its solutions under energy transition[J].Automation of Electric Power Systems,45(16):2-13.
Xue X,2017.Prediction of slope stability based on hybrid PSO and LSSVM[J].Journal of Computing in Civil Engineering,31(1):04016041.
Yang L Q, Li P C, Fan S J,2008.The extraction of pigments from fresh Laminaria japonica[J].Chinese Journal of Oceanology and Limnology,26(2):193-196.
Zong Guangchang,2021.Study on Slope Displacement Prediction Based on Conv-LSTM[D].Shijiazhuang:Shijiazhuang Tiedao University.
安正明,方正峰,周兴彤,等,2022.山区高速公路弃渣场边坡稳定性可靠度分析[J].土工基础,36(4):626-629.
段楠,薛会民,潘越,2002.用蒙特卡洛法计算可靠度时模拟次数的选择[J].煤矿机械,(3):13-14.
黄卓涛,2022.基于机器学习算法的非均质水库边坡可靠度分析[D].南昌:南昌大学.
姬建,姜振,殷鑫,等,2022.边坡随机场数字图像特征CNN深度学习及可靠度分析[J].岩土工程学报,44(8):1463-1473.
蒋水华,李典庆,周创兵,2013.基于拉丁超立方抽样的边坡可靠度分析非侵入式随机有限元法[J].岩土工程学报,35(增2):70-76.
牛草原,王乐华,许晓亮,2017.土体抗剪强度参数统计特性对边坡可靠性影响研究[J].水利水电技术,48(12):195-198,206.
荣光旭,彭艳,田凯,2021.基于Python的ABAQUS有限元强度折减法程序在边坡稳定性分析中的应用[J].中北大学学报(自然科学版),42(4):332-339.
舒苏荀,龚文惠,2014.考虑参数空间变异性的边坡模糊随机可靠度分析[J].华中科技大学学报(自然科学版),42(9):93-97.
王朝阳,李丽敏,温宗周,等,2022.基于时间序列和CNN-LSTM的滑坡位移动态预测[J].国外电子测量技术,41(3):1-8.
谢秀栋,方建瑞,范炜,等,2008.基于可靠度理论的边坡稳定性分析研究[J].自然灾害学报,17(2):110-115.
徐潇源,王晗,严正,等,2021.能源转型背景下电力系统不确定性及应对方法综述[J].电力系统自动化,45(16):2-13.
宗广昌,2021.基于Conv-LSTM的边坡位移预测研究[D].石家庄:石家庄铁道大学.
[1] Zhixiang LIU,Kai WANG,Xiaocong YANG,Chuanchuan WAN,Yucheng ZHOU. Reliability Analysis of Intelligent Shoveling System Based on Fuzzy Fault Tree and Monte Carlo Method [J]. Gold Science and Technology, 2023, 31(3): 477-486.
[2] Ensheng KANG,Zexi ZHAO,Haidong MENG. Displacement Prediction of Dump Slope Based on EEMD-HW-PSO-ELM Coupling Model [J]. Gold Science and Technology, 2022, 30(4): 594-602.
[3] Tiandong SHI,Lin BI. Research on Automatic Extraction Method of Top and Bottom Line of Open-Pit Slope Based on DEM [J]. Gold Science and Technology, 2021, 29(4): 612-619.
[4] Xiuzhi SHI,Chunsheng DING,Yaguang QIN. Research on the Effect Mechanism of Safety Culture on Employee Safety Behavior in Metal Mines [J]. Gold Science and Technology, 2021, 29(4): 593-601.
[5] Ensheng KANG, Haidong MENG, Zihao ZHAO, Tao HE. Investigation on Factors Affecting Slope Instability in Open-pit Mines Based on Geophysical Prospecting Technology [J]. Gold Science and Technology, 2020, 28(3): 363-371.
[6] Zilong ZHOU,Yifan WANG,Changtao KE. Reliability Evaluation of Pillars System Based on Domino Failure Effect [J]. Gold Science and Technology, 2018, 26(6): 729-735.
[7] Jinguo XU,Xingguo DAI,Zezheng YAN. Stability Evaluation of Rock-soil Slope Based on D-S Evidence Theory and Normal Degree of Membership [J]. Gold Science and Technology, 2018, 26(6): 780-787.
[8] Ju ZHANG,Liguan WANG,Huaqiang SONG,Zhuli REN,Lin BI. Optimization and Application of Geometric Constraint Model for Boundary Optimization in Open Mine [J]. Gold Science and Technology, 2018, 26(6): 795-802.
[9] Bo PENG. Numerical Simulation Study of Seepage Stability of Mudstone Slope with Dif-ferent Rainfall Types Coupled with Sudden Drop of Reservoir Water Level [J]. Gold Science and Technology, 2018, 26(5): 647-655.
[10] SHENGJianlong, ZHAIMingyang. Reliability Analysis and Sampling Method Comparison of Jinjiling Rock Slope Based on Stochastic Response Surface Method [J]. Gold Science and Technology, 2018, 26(3): 297-304.
[11] YANG Chao, SHI Xiuzhi. Mine Safety Standardization Grade Evaluation Based on Fisher Discriminant Model [J]. Gold Science and Technology, 2018, 26(2): 187-194.
[12] YANG Mingcai, SHENG Jianlong, YE Zuyang, DONG Shu. Analysis of Sensitivity Factors of Open-pit Mine Slope Stability and Impact Based on FlAC3D [J]. Gold Science and Technology, 2018, 26(2): 179-186.
[13] KE Yuxian,WANG Xinmin,LIU Qi,LIU Enyan. Reliability Evaluation of Mine’s Six-System Based on Entropy Weight and Matter Element Analysis [J]. Gold Science and Technology, 2018, 26(1): 31-39.
[14] ZHAO Bin,LI Xiaobei,DAI Xingguo,WANG Xinmin,ZHANG Deming. Uncertainty Measurement Analysis of Slope Stability Based on Variable Weight Theory [J]. Gold Science and Technology, 2016, 24(6): 90-95.
[15] NIE Xingxin,ZHANG Guodan. [J]. Gold Science and Technology, 2016, 24(6): 72-77.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] LI Chu-Fang, XU Yong-An, CHAO Yin-Yin, WANG Mei-Juan, ZHANG Dai, LIU Jun, SUN Liang-Liang. Looking for Strata Bound Type Gold Deposit in Liaodong Metallogenic Belt[J]. J4, 2010, 18(3): 59 -62 .
[2] ZHANG Kai, GAO Chunguo, WANG Junli, LU Xintao. The Harm and TreatmentMethods of Harmon ic in the Runn ing Process of Inverter[J]. J4, 2008, 16(6): 58 -59 .
[3] ZHANG Yujie,SHEN Yongsheng,REN Jixu. Analysis of Geological Characteristics and Ore—forming about Gold Deposit and Ore Prospects in Eastern Laji Montain,Qinghai Provinc[J]. J4, 2008, 16(5): 23 -26 .
[4] HU Qin-Xia, CHEN Kai, CHEN Chao, ZHANG Ku-Xiao. Analysis on Geological Features and Metallogenic Regularities of Nacheng Silver Gold Deposit in Guangdong[J]. J4, 2011, 19(1): 16 -20 .
[5] ZHAO Bingxin, SONG Bingjian, ZHOU Dianyu, HUAI Baofeng. Geological Features and Ore-Forming Rule of the Shabaoshi Gold Deposit in Mohe,Heilongjian[J]. J4, 2007, 15(2): 20 -25 .
[6] CUI Yong-Xia, SHEN Yan. The Difficult Processing Gold Mine Stone Refines The Technique Research Development[J]. J4, 2007, 15(3): 53 -57 .
[7] SU Jian-Hua, LIU Shu-Lin. Study of Gold Extraction from Tail Solution with High Acid Content and Low Concentration[J]. J4, 2010, 18(3): 72 -75 .
[8] GAO Ruofeng,JING Longhua,WEI Lianxi. Geological Features and Genesis of Gold Deposit in Copper,Tungsten and Molubdenum Baoshan Xunke Canton[J]. J4, 2008, 16(2): 46 -47 .
[9] CHEN Hong-Bing, LIU Hua-Jie. Discussing of Maintance Principium and Timbering Methods in Unstable Drifts[J]. J4, 2007, 15(1): 45 -47 .
[10] SHENG Xiaojun. The Repair Process of Mainshaft Bearing Liner in Ball Mill[J]. J4, 2007, 15(6): 59 -61 .