Unresolved Questions

5 questions across all topics

ํ•œ๊ตญ ์žฌ๊ฐœ๋ฐœ ๋‹จ๊ณ„๋ณ„ ์™„์ „ ๊ฐ€์ด๋“œ โ€” ๋งค์ˆ˜์ž ๊ด€์ 

  • ์‹ ์†ํ†ตํ•ฉ๊ธฐํš ์ ์šฉ ์‹œ ์‹ค์ œ ์†Œ์š” ๊ธฐ๊ฐ„์€ ๊ธฐ์กด ๋Œ€๋น„ ์–ผ๋งˆ๋‚˜ ๋‹จ์ถ•๋˜๋Š”๊ฐ€?
  • ๋น„๋ก€์œจ์ด 100% ๋ฏธ๋งŒ์ธ ์‚ฌ์—…์žฅ์—์„œ๋„ ์กฐํ•ฉ์› ๋ถ„์–‘๊ฐ€ ํ• ์ธ์œผ๋กœ ์ˆ˜์ต์ด ๋‚  ์ˆ˜ ์žˆ๋Š” ๊ตฌ์กฐ๋Š”?

CLS ํ† ํฐ๊ณผ Patch ํ† ํฐ ์ƒํ˜ธ์ž‘์šฉ ์žฌ๊ณ 

  • Decoupled ๊ตฌ์กฐ์—์„œ CLS branch๋ฅผ ์•„์˜ˆ ์ œ๊ฑฐํ•˜๊ณ  global avg pooling๋งŒ ์“ฐ๋ฉด?
  • ๊ธฐ์กด pretrained ViT์—์„œ fine-tuning์œผ๋กœ decoupling์„ ์ ์šฉํ•  ์ˆ˜ ์žˆ๋Š”์ง€?
  • patch feature ์œ ์‚ฌ๋„ ๊ธฐ๋ฐ˜ K-means vs CLS feature ๊ธฐ๋ฐ˜ K-means ๋น„๊ต ์‹คํ—˜

halbielee-wiki