Back to Cinamon showcase

Cinamon Inc. ยท Text-to-Motion

๐Ÿ”  Text-to-Motion

ํ”„๋กœ์ ํŠธ ๊ธฐ๊ฐ„: 2025. 12 - 2026. 03

Tech stack

PyTorch PyTorch Lightning Lightning Fabric TensorBoard Triton FastAPI GitHub

ํ…์ŠคํŠธ ์กฐ๊ฑด์œผ๋กœ ==์›ํ•˜๋Š” ๊ธธ์ด==์˜ 3D ๋ชจ์…˜ ์‹œํ€€์Šค๋ฅผ ์ƒ์„ฑํ•˜๋Š” ==diffusion ๊ธฐ๋ฐ˜ text-to-motion ์‹œ์Šคํ…œ==์„ ์„ค๊ณ„ํ•˜๊ณ  ๋ฐฐํฌํ–ˆ์Šต๋‹ˆ๋‹ค. Triton๊ณผ FastAPI๋ฅผ ์ด์šฉํ•œ ๋ชจ๋ธ ์ตœ์ ํ™”์™€ ์„œ๋น™์œผ๋กœ ==๊ธฐ์กด ๋Œ€๋น„ 10๋ฐฐ ๋น ๋ฅธ ์ถ”๋ก  ์†๋„==๋ฅผ ๋‹ฌ์„ฑํ–ˆ์Šต๋‹ˆ๋‹ค. ๋ฐ์ดํ„ฐ, ๋ชจ๋ธ ํ•™์Šต, ์ตœ์ ํ™”, ๋ฐฐํฌ, ์„œ๋น„์Šค ์—ฐ๋™์— ์ด๋ฅด๋Š” ==ML lifecycle์„ ์ง์ ‘ ์šด์šฉ==ํ–ˆ์Šต๋‹ˆ๋‹ค.

Media

API๊ฐ€ ์—ฐ๋™๋œ ๋ฐ๋ชจ ํŽ˜์ด์ง€์—์„œ ์ƒ์„ฑ ์š”์ฒญ์„ ๋ณด๋‚ด๊ณ , ๊ฒฐ๊ณผ๋ฅผ ๋ฐ”๋กœ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ“ ์—…๋ฌด ์ˆ˜ํ–‰ ๋‚ด์šฉ

flowchart LR Client[Client] --> FastAPI[FastAPI API Server] Retrieve[Retrieve Service
length lookup] FastAPI -. optional .-> Retrieve FastAPI --> Gen subgraph Triton[Triton Server] direction TB Gen[t2m_generate] Refiner[motion_refine] Gen --> Refiner end Refiner --> FastPost[FastAPI post-process] FastPost --> Response[API Response]
- ์ƒ์„ฑ ๋ชจ๋ธ์€ ๋ฐ์ดํ„ฐ์…‹์— ์—†๋Š” ๋ชจ์…˜์„ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์—ˆ์ง€๋งŒ penetration์„ ๋น„๋กฏํ•œ ==์•„ํ‹ฐํŒฉํŠธ๊ฐ€ ๋ฐœ์ƒ==ํ•ด ์‹œ๊ฐ์  ํ’ˆ์งˆ์„ ๋–จ์–ด๋œจ๋ ธ๊ณ , ==๋А๋ฆฐ ์ถ”๋ก  ์†๋„==๋กœ ์ธํ•ด ์„œ๋น„์Šค ์ ์šฉ์ด ์–ด๋ ค์› ์Šต๋‹ˆ๋‹ค. - Collision์„ ํƒ์ง€ํ•˜๋Š” ์ž‘์—…์€ ๊ณ„์‚ฐ ๋น„์šฉ์ด ์ปธ๊ธฐ ๋•Œ๋ฌธ์—, ๋ชจ์…˜ ๋ถ„ํฌ๋ฅผ ํ•™์Šตํ•œ ๋ณด์ • ๋ชจ๋ธ์„ ์ด์šฉํ•œ =='์ƒ์„ฑ โ†’ ๋ณด์ •' 2๋‹จ๊ณ„ ํŒŒ์ดํ”„๋ผ์ธ์„ ์„ค๊ณ„==ํ–ˆ์Šต๋‹ˆ๋‹ค. - ONNX ๊ธฐ๋ฐ˜ ์ตœ์ ํ™” ํ›„ ์–ธ๋ฆฌ์–ผ ์—”์ง„์— ์ง์ ‘ ํƒ‘์žฌํ•˜๋Š” ๋Œ€์‹ , ์žฅ๊ธฐ์ ์ธ ์œ ์ง€๋ณด์ˆ˜์™€ ํ™•์žฅ์„ฑ์„ ๊ณ ๋ คํ•ด ==API ํ˜•ํƒœ ์„œ๋น™== ๊ตฌ์กฐ๋ฅผ ์„ ํƒํ–ˆ์Šต๋‹ˆ๋‹ค. - ์ด์ „ ํ”„๋กœ์ ํŠธ์˜ ๊ฒฐ๊ณผ๋ฌผ์ธ motion refinement model์„ ์ ์šฉํ•ด ==๋ชจ๋ธ ์žฌ์‚ฌ์šฉ์„ฑ==์„ ๋†’์˜€์Šต๋‹ˆ๋‹ค. - ํ…์ŠคํŠธ ์ •ํ•ฉ์„ฑ์„ ์œ ์ง€ํ•œ mirror augmentation์œผ๋กœ ๋ฐ์ดํ„ฐ ๋ถ€์กฑ ๋ฌธ์ œ๋ฅผ ๋ณด์™„ํ–ˆ๊ณ , ๋ชจ์…˜ ๋ฐ์ดํ„ฐ๋Š” ==2๋ฐฐ==, ํ…์ŠคํŠธ ์–ด๋…ธํ…Œ์ด์…˜์€ ==30%== ํ™•์žฅํ–ˆ์Šต๋‹ˆ๋‹ค. - ==Triton๊ณผ FastAPI==๋ฅผ ๊ฒฐํ•ฉํ•œ ์„œ๋น™ ๊ตฌ์กฐ๋ฅผ ์ฑ„ํƒํ•ด ์ถ”๋ก  ์ตœ์ ํ™”(Triton)์™€ ์„œ๋น„์Šค I/O(FastAPI)๋ฅผ ๋ถ„๋ฆฌํ–ˆ์Šต๋‹ˆ๋‹ค. - Dynamic batching์„ ์ ์šฉํ•ด ==GPU ์ž์› ํ™œ์šฉ์„ ์ตœ์ ํ™”==ํ–ˆ์Šต๋‹ˆ๋‹ค. - Triton Ensemble์„ ์ ์šฉํ•ด ๋‹จ์ผ Triton ์„œ๋ฒ„ ํ˜ธ์ถœ๋กœ 2๋‹จ๊ณ„ ==์ถ”๋ก  ํŒŒ์ดํ”„๋ผ์ธ์„ ๋‹จ์ˆœํ™”==ํ–ˆ์Šต๋‹ˆ๋‹ค.