๐Ÿ ๋จธ์‹ ๋Ÿฌ๋‹ | ๋”ฅ๋Ÿฌ๋‹/์ถ”์ฒœ์‹œ์Šคํ…œ

[K-Data x ๋Ÿฌ๋‹์Šคํ‘ผ์ฆˆ] 3-1. ๋ชจ๋ธ ๊ธฐ๋ฐ˜ ํ˜‘์—… ํ•„ํ„ฐ๋ง?

xod22 2022. 1. 19. 01:05
728x90

์ง€๊ธˆ๊นŒ์ง€ ์œ ์ €/์•„์ดํ…œ ๊ฐ„์˜ ์œ ์‚ฌ๋„๋ฅผ ๊ตฌํ•ด ์ถ”์ฒœ์„ ํ•˜๋Š” User-based๋‚˜ Item-based ๊ฐ™์€ Neighborhood-based CF์— ๋Œ€ํ•ด ๊ณต๋ถ€๋ฅผ ํ•ด๋ดค์Šต๋‹ˆ๋‹ค!

์ด๋ฒˆ ํฌ์ŠคํŒ…์—์„œ๋Š” ๋จธ์‹ ๋Ÿฌ๋‹ ๋ชจ๋ธ์„ ํ™œ์šฉํ•˜๋Š” Model-based CF์— ๋Œ€ํ•ด ์ ์–ด๋ณด๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค!

# ๋ชจ๋ธ ๊ธฐ๋ฐ˜ ํ˜‘์—… ํ•„ํ„ฐ๋ง?

-SVD(Singular Value Decomposition)

-MF(Matrix Factorization) / SGD, ALS, BPR ๋“ฑ์˜ ์ข…๋ฅ˜๊ฐ€ ์žˆ์Œ..

 

์œ ์ €/์•„์ดํ…œ ๊ฐ„์˜ ์œ ์‚ฌ๋„์— ์˜์กดํ•˜๋Š” ๊ธฐ๋ฒ•๋“ค์€ ๋ฐ์ดํ„ฐ์˜ sparsity(๋ฐ์ดํ„ฐ์˜ ๋นˆ๊ณต๊ฐ„?)์— ์ทจ์•ฝํ•˜๊ณ 

์ถ”์ฒœ ๊ฒฐ๊ณผ๋ฅผ ์ƒ์„ฑํ•  ๋•Œ๋งˆ๋‹ค ๋งŽ์€ ์—ฐ์‚ฐ์„ ์š”๊ตฌํ•˜๊ฒŒ ๋ฉ๋‹ˆ๋‹ค!

< Model-based CF์˜ ํŠน์ง• >

- Model-based CF๋Š” ๋จธ์‹ ๋Ÿฌ๋‹ ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•˜๋ฉฐ ๋ฐ์ดํ„ฐ ์ •๋ณด๊ฐ€ ํŒŒ๋ผ๋ฏธํ…‰ ํ˜•ํƒœ๋กœ ๋ชจ๋ธ์— ๋‚˜ํƒ€๋‚˜๋ฉฐ ์ตœ์ ํ™”๋ฅผ ํ†ตํ•ด ์ด๋ฅผ ์—…๋ฐ์ดํŠธ!

- ์ด์›ƒ๊ธฐ๋ฐ˜ CF๋Š” ์œ ์ €/์•„์ดํ…œ ๋ฒกํ„ฐ๋ฅผ ๋ฐ์ดํ„ฐ๋ฅผ ํ†ตํ•ด ๊ณ„์‚ฐ๋œ ํ˜•ํƒœ๋กœ ์ €์žฅํ•˜๋Š” ๋ฐ˜๋ฉด Model-based CF์˜ ๊ฒฝ์šฐ ์œ ์ €, ์•„์ดํ…œ ๋ฒกํ„ฐ๋Š” ํ•™์Šต์„ ํ†ตํ•ด ๋ณ€ํ•จ!!

- ์ตœ๊ทผ์—” Model-based CF์›๋ฆฌ๋ฅผ ๋”ฅ๋Ÿฌ๋‹์— ์‘์šฉํ•œ ๋ชจ๋ธ์ด ๋†’์€ ์„ฑ๋Šฅ์„ ๋ƒ„

< Model-based CF์˜ ์žฅ์  >

1) ๋ชจ๋ธ์˜ ํ•™์Šต/์„œ๋น™

: ์œ ์ €/์•„์ดํ…œ ๋ฐ์ดํ„ฐ๋Š” ํ•™์Šต์—๋งŒ ์‚ฌ์šฉ๋˜๊ณ  ์ด๋ฏธ ํ•™์Šต๋œ ๋ชจ๋ธ์„ ํ†ตํ•ด ์ถ”์ฒœ๊ฒฐ๊ณผ๋ฅผ ์„œ๋น™ -> ์†๋„๊ฐ€ ๋น ๋ฆ„

 

2) Sparsity/Scalability ๊ทน๋ณต

: ์ด์›ƒ๊ธฐ๋ฐ˜ CF์— ๋น„ํ•ด sparseํ•œ ๋ฐ์ดํ„ฐ(๋นˆ๊ณต๊ฐ„์ด ์žˆ๋Š” ๋ฐ์ดํ„ฐ)์—์„œ๋„ ์ข‹์€ ์„ฑ๋Šฅ์„ ๋ณด์ž„,

๋˜ํ•œ ์‚ฌ์šฉ์ž/์•„์ดํ…œ ๊ฐœ์ˆ˜๊ฐ€ ๋Š˜์–ด๋‚˜๋„ ์ข‹์€ ์ถ”์ฒœ ์„ฑ๋Šฅ์„ ๋ณด์ž„

=> Limited Coverage

: ์ด์›ƒ ๊ธฐ๋ฐ˜ CF์˜ ๊ฒฝ์šฐ ๊ณตํ†ต์˜ ์œ ์ €/์•„์ดํ…œ์„ ๋งŽ์ด ๊ณต์œ ํ•ด์•ผ ์œ ์‚ฌ๋„ ๊ฐ’์ด ์ •ํ™•ํ•ด์ง„๋‹ค.

์œ ์‚ฌ๋„ ๊ฐ’์ด ์ •ํ™•ํ•˜์ง€ ์•Š์€ ๊ฒฝ์šฐ ์ด์›ƒ์˜ ํšจ๊ณผ๋ฅผ ๋ณด๊ธฐ ์–ด๋ ต๋‹ค. Model-based CF๋Š” ์ด์›ƒ ๊ธฐ๋ฐ˜ CF๋ณด๋‹ค๋Š” ์ด ๋ฌธ์ œ๊ฐ€ ๋œํ•˜๋‹ค(?)๋Š” ์žฅ์ 

 

3) Overfitting ๋ฐฉ์ง€

 

 


์˜ค๋Š˜์€ ๊ฐ„๋‹จํ•˜๊ฒŒ Model-based CF์˜ ํŠน์ง•์— ๋Œ€ํ•ด ์ •๋ฆฌํ•ด๋ณด์•˜์Šต๋‹ˆ๋‹ค!

๋‹ค์Œ ํฌ์ŠคํŒ…์—์„œ๋Š” ์กฐ๊ธˆ ๋” ์ž์„ธํ•˜๊ฒŒ Model-based CF์˜ ์—ฌ๋Ÿฌ ๋ฐฉ๋ฒ•์— ๋Œ€ํ•ด ๊ฐ€์ ธ์˜ค๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค

๋~~~

 

 

728x90