Explainable Deep Clustering for Financial Customer Profiling
For more details, check out my note on Notion: [link]
Starting as a project for BigData Competition in NH Investment & Securities with the topic of Advanced Customer Profiling and Personalized Investment Portfolio Curation, I extended our project with teammates into an academic research initiative using high-dimensional cross-sectional data from Korea Institute of Public Finance.
Effective customer segmentation and communication of these findings to non-experts is a pressing task in the financial services sector, with the potential for widespread applications. This study employs a three-stage dimension reduction and clustering technique to segment a large, high-dimensional dataset, emphasizing explainability and intuitive visualization. We present the high-dimensional data and feature set using novel network-based visualization methods and identify the multi-stage process’s optimal configuration. Finally, we derive investment portfolios for each segment to demonstrate an expert system application in financial investment advisory to underscore the importance of explainable segmentations.
This paper is published in EAAI Vol 128. Using these findings, I also presented a poster in IE Frontier, an internal research poster competition in KAIST ISE Department. Also, I have applied this framework to cluster financial securities including stock, and wrote a paper on Stock Deep Clustering and its application to Fama-French Factor Model.