Aiming at the problems that gearbox fault information is susceptible to strong noise interference, single sensor cannot meet the requirements of reliability and accuracy of gear fault diagnosis (GFD) in complex scenarios, and fault feature extraction and fusion of gearbox are difficult in GFD, a novel and intelligent improved attention feature fusion (IAFF) residual network (IAFFRNet) is proposed to mine global and local gearbox fault feature and obtain superior FD results. First, the acoustic and vibration signals extracted by various types of sensors are converted into two-dimensional images by Gramian angular difference fields encoding, which are further feature-spliced and fused. Then, a multiscale large kernel convolution module is constructed to capture and fuse different-scale image features, and the multiscale features are extracted, and the location information is aggregated by the designed attention residual module. Furthermore, the IAFF module assigns different weights to the fused features, thus fusing the multi-sensor features extracted at different stages. Finally, the better effectiveness and generalization ability of the presented IAFFRNet are comprehensively verified by the created NEU dataset and the publicly available SEU dataset. The experimental results indicate that the IAFFRNet method can accurately classify the gear fault and possesses excellent FD ability compared with other methods.
ZhangYCYuKRenZH, et al. Joint domain alignment and class alignment method for cross-domain fault diagnosis of rotating machinery. IEEE Trans Instrum Meas2021; 70: 3526212.
2.
ChenZYGrylliasKLiWH.Intelligent fault diagnosis for rotary machinery using transferable convolutional neural network. IEEE Trans Ind Inform2020; 16(1): 339–349.
3.
YuJBWangSYWangL, et al. Gearbox fault diagnosis based on a fusion model of virtual physical model and data-driven method. Mech Syst Signal Process2023; 188: 109980.
4.
ShiJHPengDKPengZX, et al. Planetary gearbox fault diagnosis using bidirectional-convolutional LSTM networks. Mech Syst Signal Process2022; 162: 107996.
5.
XiaoYMShaoHDYanS, et al. Domain generalization for rotating machinery fault diagnosis: a survey. Adv Eng Inform2025; 64: 103063.
6.
WangHXuJWYanRQ, et al. A new intelligent bearing fault diagnosis method using SDP representation and SE-CNN. IEEE Trans Instrum Meas2020; 69(5): 2377–2389.
7.
MiaoJGWangJYMiaoQ.An enhanced multifeature fusion method for rotating component fault diagnosis in different working conditions. IEEE Trans Reliab2021; 70(4): 1611–1620.
8.
ChengYWLinMXWuJ, et al. Intelligent fault diagnosis of rotating machinery based on continuous wavelet transform-local binary convolutional neural network. Knowl Based Syst2021; 216: 106796.
9.
WangJHYangJWWangYZ, et al. Ensemble decision approach with dislocated time–frequency representation and pre-trained CNN for fault diagnosis of railway vehicle gearboxes under variable conditions. Int J Rail Transp2022; 10(5): 655–673.
10.
WangHLiuZLPengDD, et al. Attention-guided joint learning CNN with noise robustness for bearing fault diagnosis and vibration signal denoising. ISA Trans2022; 128: 470–484.
11.
ZhongHYLvYYuanR, et al. Bearing fault diagnosis using transfer learning and self-attention ensemble lightweight convolutional neural network. Neurocomputing2022; 501: 765–777.
12.
FanZXXuXGWangRJ, et al. Fan fault diagnosis based on lightweight multiscale multiattention feature fusion network. IEEE Trans Ind Inform2022; 18(7): 4542–4554.
13.
WangLHuZMKongQ, et al. Infrared and visible image fusion via attention-based adaptive feature fusion. Entropy2023; 25: 407.
14.
YangQCTangBPShenYZ, et al. Self-attention parallel fusion network for wind turbine gearboxes fault diagnosis. IEEE Sens J2023; 23(19): 23210–23220.
15.
XieJSLiuJDingTQ, et al. Self-attention metric learning based on multiscale feature fusion for few-shot fault diagnosis. IEEE Sens J2023; 23(17): 19771–19782.
16.
ZhangSLiuZWChenYP, et al. Selective kernel convolution deep residual network based on channel-spatial attention mechanism and feature fusion for mechanical fault diagnosis. ISA Trans2023; 133: 369–383.
17.
YanSZhongXShaoHD, et al. Digital twin-assisted imbalanced fault diagnosis framework using subdomain adaptive mechanism and margin-aware regularization. Reliab Eng Syst Safe2023; 239: 109522.
18.
TangTWangJWYangTY, et al. An improved prototypical network with L2 prototype correction for few-shot cross-domain fault diagnosis. Measurement2023; 217: 113065.
19.
YuTZJiangZYRenZH, et al. A cooperative convolutional neural network framework for multisensor fault diagnosis of rotating machinery. IEEE Sens J2024; 24(22): 38309–38317.
20.
ChenHPHuNQChengZ, et al. A deep convolutional neural network based fusion method of two-direction vibration signal data for health state identification of planetary gearboxes. Measurement2019; 146: 268–278.
21.
WuPLNieXYXieG.Multi-sensor signal fusion for a compound fault diagnosis method with strong generalization and noise-tolerant performance. Meas Sci Technol2021; 32: 035108.
22.
WangXMaoDXLiXD.Bearing fault diagnosis based on vibro-acoustic data fusion and 1D-CNN network. Measurement2021; 173: 108518.
23.
HuangHHTangBPLuoJ, et al. Residual gated dynamic sparse network for gearbox fault diagnosis using multisensor data. IEEE Trans Ind Inform2022; 18: 4.
24.
GuoYMHuTZhouYF, et al. Multi-channel data fusion and intelligent fault diagnosis based on deep learning. Meas Sci Technol2023; 34: 015115.
25.
XuYDFengKYanXA, et al. CFCNN: a novel convolutional fusion framework for collaborative fault identification of rotating machinery. Inform Fusion2023; 95: 1–16.
26.
FengJSuJYFengXL.A residual multihead self-attention network using multimodal shallow feature fusion for motor fault diagnosis. IEEE Sens J2023; 23(23): 29131–29142.
27.
XingSWangJRHanBK, et al. A novel collaborative bearing fault diagnosis method based on multi-scale dynamic fusion network under speed fluctuating condition. Meas Sci Technol2024; 35: 015126.
28.
YuTZRenZHZhangYC, et al. LAFICNN: A novel convolutional adaptive fusion framework for fault diagnosis of rotating machinery. IEEE Trans Instrum Meas2024; 73: 3515306.
29.
ZhangYZZhaoXQHuiYY, et al. SA-DACNN gearbox fault diagnosis method based on multi-sensor data fusion. J Control Decis2024; 39(11): 3699–3708.
30.
WangXLFuRQJinHW, et al. Performance degradation assessment of rolling bearing by fusing texture feature of Gramian angular difference field. J Vib Eng2024; 2024; 1–8.
31.
ZhouMLLangSJZhangTP, et al. Attentional feature fusion for end-to-end blind image quality assessment. IEEE Trans Broad2023; 69(1): 144–152.
32.
KarenSAndrewZ. Very deep convolutional networks for large-scale image recognition. In: 3rd International conference on learning representations (ICLR), San Diego, CA USA, 7–9 May, 2015, pp. 1–14. lthaca, NY, USA: arXiv.
33.
ShafiqMGuZQ.Deep residual learning for image recognition: a survey. Appl Sci Basel2022; 12(18): 8972.
34.
HeKCXuYWWangY, et al. Intelligent diagnosis of rolling bearings fault based on multisignal fusion and MTF-ResNet. Sensor2023; 23(14): 6281.
35.
HouQBZhouDQFengJS. Coordinate attention for efficient mobile network design. In: 2021 IEEE/CVF conference on computer vision and pattern recognition (CVPR), Nashville, TN, USA, 19–25 June 2021, pp. 13708–13717. IEEE Computer Soc.
36.
HowardAGZhuMLChenB, et al. MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861v1, 2017.
37.
ZhaoMHZhongSSFuXY, et al. Deep residual shrinkage networks for fault diagnosis. IEEE Trans Ind Inform2020; 16(7): 4681–4690.
38.
LiuZMaoHZWuCY, et al. A convnet for the 2020s. In: 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR), 2022, pp. 11966–11976.
39.
ShaoSYMcAleerSYanRQ, et al. Highly accurate machine fault diagnosis using deep transfer learning. IEEE Trans Ind Inform2019; 15(4): 2446.
