CHAN LOG

Deep Learning & Modern Generative AI

3D Data Science

Computer Vision

3D Computer vision 

VLA / Physical AI

제어공학 / 자율주행 센서처리 /  센서 및 계측공학 / 임베디드 소프트웨어 / 컴퓨터 시뮬레이션

Applied Natural Language Processing (NLP)

강화학습 (Reinforcement Learning)

XR Adative AI

멀티미디어 개론 

컴퓨터그래픽스 

AI를 위한 인간컴퓨터상호작용(HCI)

게임 프로그래밍

Embodied AI를 다시 공부한다면

KOR

Support Vector Machine (SVM)

Most Commonly used classifcation algorithms before deep learning

Works well with kernel trick

This image illustrates the core intuition behind Support Vector Machines (SVMs).

Strong theoretical guarantees

Intuition

The blue and red points represent data samples from two different classes. The solid line in the middle is the decision boundary (hyperplane) that separates the two classes, while the two dashed lines indicate the margins. These dashed lines pass through the data points that are closest to the decision boundary, known as support vectors.

The key idea conveyed by the figure is that the farther the decision boundary is from the data points, the better. Rather than choosing any separating line, SVM aims to find the hyperplane that maximizes the margin, i.e., the distance between the decision boundary and the nearest data points from each class.

Support Vector Machine (SVM) / Decision Tree / Boosting

Define Margin; Distance to Hyperplane

Project Overview

Results

3 Analysis of Dataset

Relabeling and Sampling

Average length before cleaning: 317.2775

Totally, from the dataset,

Average length after cleaning: 301.1736

A Report of Hands-on Project of Text Representations and the Use of Text Classification for Sentiment Analysis

How I relabeled and sampled

Pre-processing

NLP & Prompt Enginnering

Comparision of Finetuned CLIP and in Sub-city Level

Overview

Data Collection

Finetuning CLIP

Accuracy was improved on test dataset 0.14 → 0.41

Target: CLIP ViT-32

After Finetuning,

After Finetuning (Because of Data Collection was stopped)

Before Finetuning

[Geolocation] First Experiment for Fine-tuning CLIP

Research

Geolocation

Neural Nets & CNN

Neural Nets

Definition

Linear models are not always adequate

Each node is called a neuron 

hhh is called the activation function

The number of layers refers to the number of hidden layers and Deep Neural Nets can have many layers and millions of parameters

This is a feedforward, fully connected neural net and there are many variants.

Math Formulation

Neural Nets & CNN

How can we swtich binary classification into multiclass classification?

Multiclass Classification & Kernel Method

Multiclass Classification

Multinomial Classification

Recall

What should a linear model look like for multiclass tasks?

How do we generalize perceptron / hinge / logistic loss? (Focus on logistic loss)

Optimization (Apply SGD)

Once we have learned the weight matrix

W

(where each row

w_k

corresponds to the weight vector for class

k

), we have several options for making predictions on new data points:

Deterministic Prediction: The most straightforward approach is to make a deterministic prediction by selecting the class with the highest score:

\hat{y} = \arg\max_{k \in [K]} w_k^\top x

. This means we compute the score

w_k^\top x

for each class

k

and predict the class that achieves the maximum score. This approach is simple, fast, and gives a single definite answer.

Randomized (Probabilistic) Prediction: Alternatively, we can make a randomized prediction by sampling from the probability distribution defined by the softmax function:

P(y = k | x) = \frac{e^{w_k^\top x}}{\sum_{j=1}^K e^{w_j^\top x}}

. In this approach, we compute the probability for each class using the softmax function, then draw a random sample from this distribution. Classes with higher probabilities are more likely to be selected, but there's still a chance of selecting lower-probability classes.

Multiclass Classification & Kernel Method

[Geolocation] First Experiment for Fine-tuning CLIP

Research

All of my posts are below. Hope you can find what you need :D
Search on the database view below, and you will get what you are looking for!

Gallery

Research

Visual Transformer & DETR

A Review LLM/VLM Architectures, FineTuning Methods, PEFT Methods

[Geolocation] CSP: Self-Supervised Contrastive Spatial Pre-Training for Getspatial-Visual Representations

2025/11/17

Week 1

CSP

[Geolocation] Research Topic Suggestion; Fine-Grained Street-Level Geolocation Using Vision–Language Models

[Geolocation] Geolocation Performance Comparison Using Vision-Language Models

2025/10/30

Week 10

Geolocation

[3DSU] Week7 - VLMs Which Understands Physics Law and Hierarchical Elements

2025/10/14

3D Scene Understanding

3D Scene Graph

[Geolocation] - Week 6 - Evaluating Geographic Reasoning Capabilities of CLIP

AI/ML Engineer

All of my posts are below. Hope you can find what you need :D
Search on the database view below, and you will get what you are looking for!

Gallery

NLP & Prompt Enginnering

A Report of Hands-on Project of Text Representations and the Use of Text Classification for Sentiment Analysis

Ollama 특정 GPU만 사용하기 설정 방법

2025/02/03

Ollama

RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

What is Vector Similarity Search? : 2. How Does Vector Similarity Work

2024/02/26

Vector Similiarty Search

Vector Embedding

What is Vector Similarity Search? : 1. Introduction

2024/02/26

Vector Similiarty Search

Support Vector Machine (SVM) / Decision Tree / Boosting

Multiclass Classification & Kernel Method

2026/01/03

Classification & Logistic Regression

Overview of ML & Classification

What is an “Instruct Model” in LLM?

Ollama Template 파헤치기 - Go Template 문법을 중심으로

Colab 으로 Llama 3 파인튜닝하기 (feat. Unsloth, Ollama)

LLM

A Review of Llama 4 Architecture

Embodied AI

A Survey on Robotics with Foundation Models: toward Embodied AI

2025/06/18

Embodied AI

Robotics

Algorithm

코테 대비 C++/Python/SQL 주요 자료구조와 내장 함수들 정리

Priority Queue (feat. Heap)

Binary Search (feat. Binary Search Tree)

Basics of Dynamic Programming

Graph - Breadth First Search

Graph - Depth First Search

Introduction to Graph Algorithm

2024/10/16

Graph

Comparison of Sorting Algorithm (feat. External Sort)

Sorting Algorithm - Quick Sort (쾌속 정렬)

Sorting Algorithm - Merge Sort (합병 정렬)

Sorting Algorithm - Shell Sort (쉘 정렬)

Sorting Algorithm - Insertion Sort (삽입 정렬)

Sorting Algorithm - Bubble Sort (버블 정렬)

Sorting Algorithm - Selection Sort (선택 정렬)

Introduction to From the Bottom - Algorithm Series

CSE

Dev Log

Dev Log [05.29.25] : Handling CPU-bound Tasks in FastAPI

Dev Log [03.05.25] : PyTorch Integer Type Conversion

Dev Log [02.11.2025] : Pydantic 모델에서 Union(|) 연산자로 상속 문제 해결하기

Dev Log [02.07.25] : Unity Event 오랜만에..

2025/02/07

Dev Log [02.04.25] : Open Source Contribution; Bringing BERTScore with score_with_vectors

2025/02/04

Dev Log 03.24.24 : Draw Outline of Selected Objects

2024/03/24

Shader

Dev Log 03.09.24 : UI Rotation Following the Camera

2024/03/09

Dev Log 03.04.24 : Object of type 'FieldInfo' is not JSON serializable

2024/03/04

Dev Log 03.03.24 : Pydantic Error - ConfigError: unable to infer type for attribute "introduction"

2024/03/03

Dev Log 02.28.24 : Quest3 VR Application Trouble Shooting

2024/03/01

Dev Log 02.18.24 : Python Object Reference

2024/02/18

Dev Log 02.16.24 : Pydantic Error : Field Required

Dev Log 02.15.24 : VS Code Python Interpreter Setting

Dev Log 02.15.24 : Python Print Text Color

Setting

Dev Log 02.14.24 : Python Mutable Obejct & Shallow Copy

Dev Log 02.12.24 : Meta XR Simulator

2024/02/12

Dev Log 02.10.24 : Initializer of Constructor..?

Dev Log 02.01.24 : Tiny Experience on SW Requirement..

2024/02/01

Dev Log 01.27.24 : My First Watch Dog

2024/01/27

Watch Dog

Dev Log 01.23.24 : Git Error - src refspec master does not match any

2024/01/23

Dev Log: 01.17.24: LangChain ChromaDB

2024/01/17

Dev Log 01-03-24: Python File RW

2024/01/03

Dev Log 12.26.23 : Git Rebase Drop

Life Log

Ultra-Learning On My Mind

All of my posts are below. Hope you can find what you need :D
Search on the database view below, and you will get what you are looking for!

Gallery

Meta XR SDK: 1) Ray 기반 UI Button 구현

GPP - Part 1. GoF’s Design Patterns - 3) Observer Pattern

Initialization

Unity

2024/03/02

GPP - Part 1. GoF’s Design Patterns - 2) Flyweight Pattern

GPP - Part 1. GoF’s Design Patterns - 1) Commander Pattern (C#, Unity)

2024/01/08

GPP - Part 1. GoF’s Design Patterns - 1) Commander Pattern

2024/01/08

GPP - Part 0. Preface

2024/01/07

코테 대비 C++/Python/SQL 주요 자료구조와 내장 함수들 정리

Computer Science

All of my posts are below. Hope you can find what you need :D
Search on the database view below, and you will get what you are looking for!

Gallery

Algorithm

Priority Queue (feat. Heap)

Binary Search (feat. Binary Search Tree)

Basics of Dynamic Programming

Graph - Breadth First Search

Graph - Depth First Search

Introduction to Graph Algorithm

2024/10/16

Graph

Comparison of Sorting Algorithm (feat. External Sort)

Sorting Algorithm - Quick Sort (쾌속 정렬)

Sorting Algorithm - Merge Sort (합병 정렬)

Sorting Algorithm - Shell Sort (쉘 정렬)

Sorting Algorithm - Insertion Sort (삽입 정렬)

Sorting Algorithm - Bubble Sort (버블 정렬)

Sorting Algorithm - Selection Sort (선택 정렬)

Introduction to From the Bottom - Algorithm Series

CSE

NC/LC

739. Daily Temperatures

2025/11/10

150. Evaluate Reverse Polish Notation

42. Trapping Rain Water

2025/11/10

11. Container With Most Water

167. Two Sum II - Input Array Is Sorted

2025/11/08

125. Valid Palindrome

2025/11/08

128. Lonest Consecutive Sequence

2025/11/08

347. Top K Frequent Elements

217. Contains Duplicate

Life Log

All of my posts are below. Hope you can find what you need :D
Search on the database view below, and you will get what you are looking for!

Gallery

Life Log

Ultra-Learning On My Mind

DEV LOG

Here are my logs as a developer.

Section

Basic

Dev Log 02.18.24 : Python Object Reference

2024/02/18

Dev Log 02.18.24 : Python Object Reference

2024/02/18

Dev Log 02.15.24 : Python Print Text Color

Dev Log 02.15.24 : Python Print Text Color

Dev Log 02.14.24 : Python Mutable Obejct & Shallow Copy

Dev Log 02.14.24 : Python Mutable Obejct & Shallow Copy

Dev Log: 01.17.24: LangChain ChromaDB

2024/01/17

Dev Log: 01.17.24: LangChain ChromaDB

2024/01/17

Dev Log 01-03-24: Python File RW

2024/01/03

Dev Log 01-03-24: Python File RW

2024/01/03

Trouble Shooting

Dev Log [03.05.25] : PyTorch Integer Type Conversion

Dev Log [03.05.25] : PyTorch Integer Type Conversion

Dev Log 03.04.24 : Object of type 'FieldInfo' is not JSON serializable

2024/03/04

Dev Log 03.04.24 : Object of type 'FieldInfo' is not JSON serializable

2024/03/04

Dev Log 03.03.24 : Pydantic Error - ConfigError: unable to infer type for attribute "introduction"

2024/03/03

Dev Log 03.03.24 : Pydantic Error - ConfigError: unable to infer type for attribute "introduction"

2024/03/03

Dev Log 02.28.24 : Quest3 VR Application Trouble Shooting

2024/03/01

Dev Log 02.28.24 : Quest3 VR Application Trouble Shooting

2024/03/01

Dev Log 02.16.24 : Pydantic Error : Field Required

Dev Log 02.16.24 : Pydantic Error : Field Required

Dev Log 02.15.24 : VS Code Python Interpreter Setting

Dev Log 02.15.24 : VS Code Python Interpreter Setting

Setting

Dev Log 01.23.24 : Git Error - src refspec master does not match any

Setting

2024/01/23

Dev Log 01.23.24 : Git Error - src refspec master does not match any

2024/01/23

Dev Log 12.26.23 : Git Rebase Drop

2023/12/26

Dev Log 12.26.23 : Git Rebase Drop

Rebase

2023/12/26

Dev Log 01.27.24 : My First Watch Dog

Rebase

Project

2024/01/27

Watch Dog

Dev Log 01.27.24 : My First Watch Dog

2024/01/27

Watch Dog

Log

Dev Log [05.29.25] : Handling CPU-bound Tasks in FastAPI

Dev Log [05.29.25] : Handling CPU-bound Tasks in FastAPI

Dev Log [02.11.2025] : Pydantic 모델에서 Union(|) 연산자로 상속 문제 해결하기

Dev Log [02.11.2025] : Pydantic 모델에서 Union(|) 연산자로 상속 문제 해결하기

Dev Log [02.07.25] : Unity Event 오랜만에..

2025/02/07

Dev Log [02.07.25] : Unity Event 오랜만에..

2025/02/07

Dev Log 02.12.24 : Meta XR Simulator

2024/02/12

Dev Log 02.12.24 : Meta XR Simulator

2024/02/12

Dev Log 02.01.24 : Tiny Experience on SW Requirement..

2024/02/01

Dev Log 02.01.24 : Tiny Experience on SW Requirement..

2024/02/01

Programming

Dev Log 03.24.24 : Draw Outline of Selected Objects

2024/03/24

Shader

Dev Log 03.24.24 : Draw Outline of Selected Objects

2024/03/24

Shader

Dev Log 02.10.24 : Initializer of Constructor..?

Dev Log 02.10.24 : Initializer of Constructor..?

Dev Log [03.05.25] : PyTorch Integer Type Conversion

Code

Dev Log [03.05.25] : PyTorch Integer Type Conversion

Dev Log [02.11.2025] : Pydantic 모델에서 Union(|) 연산자로 상속 문제 해결하기

Dev Log [02.11.2025] : Pydantic 모델에서 Union(|) 연산자로 상속 문제 해결하기

Dev Log [02.04.25] : Open Source Contribution; Bringing BERTScore with score_with_vectors

2025/02/04

Dev Log [02.04.25] : Open Source Contribution; Bringing BERTScore with score_with_vectors

2025/02/04

Dev Log 03.09.24 : UI Rotation Following the Camera

2024/03/09

Dev Log 03.09.24 : UI Rotation Following the Camera

2024/03/09