Posts

Showing posts with the label paper_background

Background) (1) Basic Concepts Overview - (1-1) Information Theory - Understanding Quantity of Information, ENTROPY, Information Gain, KL Divergence, and Cross-Entropy (Lecture: YouTube)

Image
Topics Covered : Quantity of Information Entropy Information Gain KL Divergence Cross-Entropy These topics are fundamental to understanding how information is processed and measured in machine learning and deep learning models. By studying and organizing these concepts, I aim to improve my understanding of the underlying principles and their applications in AI models.

(Background) Math symbols & Greece symbols

Image
One of the reasons I found reviewing research papers difficult was because I had trouble memorizing the mathematical symbols (or Greek symbols) that appeared in them. To address this challenge and avoid the hassle of searching for the names of symbols whenever I forget them, I decided to document them on my blog for easy reference.