摘要
In this paper, we introduce a transformer into the field of credit scoring based on user online behavioral data and develop an end-to-end feature embedded transformer (FE-Transformer) credit scoring approach. The FE-Transformer neural network is composed of two parts: a wide part and a deep part. The deep part uses the transformer deep neural network. The output of the deep neural network and the feature data of the wide part are concentrated in a fusion layer. The experimental results show that the FE-Transformer deep learning model proposed in this paper outperforms the LR, XGBoost, LSTM, and AM-LSTM comparison methods in terms of area under the receiver operating characteristic curve (AUC) and the Kolmogorov-Smirnov (KS). This shows that the FE-Transformer deep learning model proposed in this paper can accurately predict user default risk.
学科与关键词
- Deep learning for credit scoring: Do or don't?Gunnarsson, Bjorn Rafn*; Broucke, Seppe vanden; Baesens, Bart; Oskarsdottir, Maria; Lemahieu, WilfriedEUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2021, 295(1): 292-305.被引 98
- Credit risk evaluation model with textual features from loan descriptions for P2P lendingZhang, Weiguo; Wang, Chao*; Zhang, Yue; Wang, JunboElectronic Commerce Research and Applications, 2020, 42: 100989.被引 20
- Emerging Trends in Deep Learning for Credit Scoring: A ReviewHayashi, Yoichi*Electronics, 2022, 11(19): 3181.被引 7
