Repository navigation
Expand file tree
/
Copy pathindex.html
More file actions
172 lines (144 loc) Β· 17.7 KB
/
Copy pathindex.html
File metadata and controls
172 lines (144 loc) Β· 17.7 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>Fantasy AIGC Family - Unifying Human, World, and Interaction with Generative AI</title>
<link rel="preconnect" href="https://fonts.googleapis.com">
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
<link href="https://fonts.googleapis.com/css2?family=Inter:wght@300;400;600&family=Space+Grotesk:wght@300;700&display=swap" rel="stylesheet">
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/font-awesome/6.4.0/css/all.min.css">
<link rel="stylesheet" href="style.css">
</head>
<body>
<div class="ambient-light one"></div>
<div class="ambient-light two"></div>
<div class="grid-overlay"></div>
<nav>
<div class="logo">Fantasy AIGC Family</div>
<div class="nav-links">
<a href="#overview">Home</a>
<a href="https://github.com/Fantasy-AMAP/">Projects</a>
<a href="#news">News</a>
<a href="index.zh.html" class="lang-btn">δΈζ</a>
</div>
</nav>
<header class="hero">
<h1>Fantasy AIGC Family</h1>
<p>Unifying Human, World, and Interaction with Generative AI</p>
</header>
<main class="container">
<!-- overview Section -->
<section id="overview" class="overview">
<h2 class="section-title"><i class="fas fa-lightbulb"></i> Overview</h2>
<div class="text-content">
<p>Fantasy AIGC Family is built on <strong><a href='https://www.wan-ai.co/'>Wan</a></strong> as a unified video generation foundation, radiating into spatial intelligence, world modeling, embodied intelligence, and AI creativity through a single strong generative core, and forming a tri unified family of models and system interfaces across <strong>Human</strong>, <strong>World</strong>, and <strong>Interaction</strong>: the Human axis consolidates controllable expression and consistent representations for trustworthy avatars, the World axis consolidates explorable scene representations with verifiable consistency for usable world models, and the Interaction axis consolidates Action driven closed loop control and coordination mechanisms for scalable interactive systems, so all three share representations, data, and engineering pipelines and evolve as a capability flywheel with continuous feedback.</p>
</div>
</section>
<!-- News Section -->
<section id="news" class="news-section">
<h2 class="section-title"><i class="fas fa-bolt"></i> Latest News & Milestones</h2>
<div class="news-list">
<div class="news-item"><div class="news-text">π <strong>Jan 2026</strong> β <a href='https://fantasy-amap.github.io/fantasy-vln/'><strong>FantasyVLN</strong></a> is accepted by CVPR 2026.</div></div><div class="news-item"><div class="news-text">π <strong>Jan 2026</strong> β <a href='https://fantasy-amap.github.io/fantasy-world/'><strong>FantasyWorld</strong></a> is accepted by ICLR 2026.</div></div><div class="news-item"><div class="news-text">π’ <strong>Jan 2026</strong> β We released the training and inference code and model weights of <a href='https://fantasy-amap.github.io/fantasy-vln/'><strong>FantasyVLN</strong></a>.</div></div><div class="news-item"><div class="news-text">π <strong>Dec 2025</strong> - <a href='https://fantasy-amap.github.io/fantasy-world/'><strong>FantasyWorld</strong></a> ranked <strong>1st</strong> on the <a href='https://huggingface.co/spaces/Howieeeee/WorldScore_Leaderboard'><strong>WorldScore</strong></a> Leaderboard (by <strong>Stanford Prof. Fei-Fei Li's Team</strong>), validating our approach against global state-of-the-art models.</div></div><div class="news-item"><div class="news-text">π <strong>Nov 2025</strong> β Two papers from our family, <a href='https://fantasy-amap.github.io/fantasy-talking2/'><strong>FantasyTalking2</strong></a> and <a href='https://fantasy-amap.github.io/fantasy-hsi/'><strong>FantasyHSI</strong></a>, have been accepted to <strong>AAAI 2026</strong>.</div></div><div class="news-item"><div class="news-text">π <strong>Nov 2025</strong> β Two papers from our family, <a href='https://fantasy-amap.github.io/fantasy-talking2/'><strong>FantasyTalking2</strong></a> and <a href='https://fantasy-amap.github.io/fantasy-hsi/'><strong>FantasyHSI</strong></a>, have been accepted to <strong>AAAI 2026</strong>.</div></div><div class="news-item"><div class="news-text">π <strong>Jul 2025</strong> β <a href='https://fantasy-amap.github.io/fantasy-talking/'><strong>FantasyTalking</strong></a> is accepted by <strong>ACM MM 2025</strong>.</div></div><div class="news-item"><div class="news-text">π’ <strong>Apr 2025</strong> β We released the inference code and model weights of <a href='https://fantasy-amap.github.io/fantasy-talking/'><strong>FantasyTalking</strong></a> and <a href='https://fantasy-amap.github.io/fantasy-id/'><strong>FantasyID</strong></a>.</div></div>
</div>
</section>
<!-- Projects Section -->
<section id="projects">
<article class="project-card">
<div class="video-container">
<video controls style="width: 100%; height: 100%;">
<source src="https://fantasy-amap.github.io/fantasy-vln/assets/FantasyVLN-demo.mp4" type="video/mp4">
Your browser does not support the video tag.
</video>
</div>
<div class="card-content">
<div class="project-header">
<div class="project-title">FantasyVLN</div>
<div class="project-badges"><a href="https://fantasy-amap.github.io/fantasy-vln/" target="_blank" class="badge badge-project"><i class="fas fa-globe"></i> Project</a> <a href="https://arxiv.org/abs/2601.13976" target="_blank" class="badge badge-arxiv"><i class="fas fa-file-pdf"></i> arXiv</a> <a href="https://github.com/Fantasy-AMAP/fantasy-vln" target="_blank" class="badge badge-github" data-github-repo="Fantasy-AMAP/fantasy-vln"><i class="fab fa-github"></i> Code<span class="star-suffix" style="display:none"> (<span class="star-count"></span> <i class="fas fa-star"></i>)</span></a> <a href="https://huggingface.co/acvlab/FantasyVLN" target="_blank" class="badge badge-huggingface"><i class="fas fa-face-smile"></i> HuggingFace</a> <a href="https://modelscope.cn/models/amap_cvlab/FantasyVLN" target="_blank" class="badge badge-modelscope"><i class="fas fa-cube"></i> ModelScope</a> </div>
</div>
<div class="project-desc">A unified multimodal Chain-of-Thought (CoT) reasoning framework that internalizes the inference capabilities of world models into the VLN architecture, enabling efficient and precise navigation based on natural language instructions and visual observations.</div>
</div>
</article>
<article class="project-card">
<div class="video-container">
<iframe width="922" height="519" src="https://www.youtube.com/embed/_gLKZL5ytEo" title="FantasyWorld" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
</div>
<div class="card-content">
<div class="project-header">
<div class="project-title">FantasyWorld</div>
<div class="project-badges"><a href="" target="_blank" class="badge badge-publish"><i class="fas fa-landmark"></i> ICLR 2026</a> <a href="https://fantasy-amap.github.io/fantasy-world/" target="_blank" class="badge badge-project"><i class="fas fa-globe"></i> Project</a> <a href="https://arxiv.org/abs/2509.21657" target="_blank" class="badge badge-arxiv"><i class="fas fa-file-pdf"></i> arXiv</a> <a href="https://github.com/Fantasy-AMAP/fantasy-world" target="_blank" class="badge badge-github" data-github-repo="Fantasy-AMAP/fantasy-world"><i class="fab fa-github"></i> Code<span class="star-suffix" style="display:none"> (<span class="star-count"></span> <i class="fas fa-star"></i>)</span></a> </div>
</div>
<div class="project-desc">Corresponds to the "Worlds" dimension. A unified world model integrating video priors and geometric grounding for synthesizing explorable and geometrically consistent 3D scenes. It emphasizes spatiotemporal consistency driven by Action and serves as a verifiable structural anchor for spatial intelligence.</div>
</div>
</article>
<article class="project-card">
<div class="video-container">
<iframe width="922" height="519" src="https://www.youtube.com/embed/L8iBGuuJKlE" title="FantasyTalking" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
</div>
<div class="card-content">
<div class="project-header">
<div class="project-title">FantasyTalking</div>
<div class="project-badges"><a href="https://dl.acm.org/doi/10.1145/3746027.3755217" target="_blank" class="badge badge-publish"><i class="fas fa-landmark"></i> ACM MM 2025</a> <a href="https://fantasy-amap.github.io/fantasy-talking/" target="_blank" class="badge badge-project"><i class="fas fa-globe"></i> Project</a> <a href="https://arxiv.org/abs/2504.04842" target="_blank" class="badge badge-arxiv"><i class="fas fa-file-pdf"></i> arXiv</a> <a href="https://github.com/Fantasy-AMAP/fantasy-talking" target="_blank" class="badge badge-github" data-github-repo="Fantasy-AMAP/fantasy-talking"><i class="fab fa-github"></i> Code<span class="star-suffix" style="display:none"> (<span class="star-count"></span> <i class="fas fa-star"></i>)</span></a> <a href="https://huggingface.co/acvlab/FantasyTalking" target="_blank" class="badge badge-huggingface"><i class="fas fa-face-smile"></i> HuggingFace</a> <a href="https://huggingface.co/spaces/acvlab/FantasyTalking" target="_blank" class="badge badge-huggingface"><i class="fas fa-face-smile"></i> HuggingFace Space</a> <a href="https://modelscope.cn/models/amap_cvlab/FantasyTalking" target="_blank" class="badge badge-modelscope"><i class="fas fa-cube"></i> ModelScope</a> </div>
</div>
<div class="project-desc">The first Wan-based high-fidelity audio-driven avatar system that synchronizes facial expressions, lip motion, and body gestures in dynamic scenes through dual-stage audio-visual alignment and controllable motion modulation.</div>
</div>
</article>
<article class="project-card">
<div class="video-container">
<iframe width="922" height="519" src="https://www.youtube.com/embed/XJAP9SsXdPg" title="FantasyTalking2" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
</div>
<div class="card-content">
<div class="project-header">
<div class="project-title">FantasyTalking2</div>
<div class="project-badges"><a href="https://doi.org/10.48550/arXiv.2508.11255" target="_blank" class="badge badge-publish"><i class="fas fa-landmark"></i> AAAI 2026</a> <a href="https://fantasy-amap.github.io/fantasy-talking2/" target="_blank" class="badge badge-project"><i class="fas fa-globe"></i> Project</a> <a href="https://arxiv.org/abs/2508.11255v1" target="_blank" class="badge badge-arxiv"><i class="fas fa-file-pdf"></i> arXiv</a> <a href="https://github.com/Fantasy-AMAP/fantasy-talking2" target="_blank" class="badge badge-github" ><i class="fab fa-github"></i> Coming Soon</a> </div>
</div>
<div class="project-desc">A novel Timestep-Layer Adaptive Multi-Expert Preference Optimization (TLPO) method enhances the quality of audio-driven avatar in three dimensions: lip-sync, motion naturalness, and visual quality.</div>
</div>
</article>
<article class="project-card">
<div class="video-container">
<iframe width="922" height="519" src="https://www.youtube.com/embed/cgbjvqiv0sw" title="FantasyPortrait" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
</div>
<div class="card-content">
<div class="project-header">
<div class="project-title">FantasyPortrait</div>
<div class="project-badges"><a href="https://fantasy-amap.github.io/fantasy-portrait/" target="_blank" class="badge badge-project"><i class="fas fa-globe"></i> Project</a> <a href="https://arxiv.org/abs/2507.12956" target="_blank" class="badge badge-arxiv"><i class="fas fa-file-pdf"></i> arXiv</a> <a href="https://github.com/Fantasy-AMAP/fantasy-portrait" target="_blank" class="badge badge-github" data-github-repo="Fantasy-AMAP/fantasy-portrait"><i class="fab fa-github"></i> Code<span class="star-suffix" style="display:none"> (<span class="star-count"></span> <i class="fas fa-star"></i>)</span></a> </div>
</div>
<div class="project-desc">A novel expression-driven video-generation method that pairs emotion-enhanced learning with masked cross-attention, enabling the creation of high-quality, richly expressive animations for both single and multi-portrait scenarios.</div>
</div>
</article>
<article class="project-card">
<div class="video-container">
<video controls style="width: 100%; height: 100%;">
<source src="https://fantasy-amap.github.io/fantasy-hsi/assets/first_video_audio.mp4" type="video/mp4">
Your browser does not support the video tag.
</video>
</div>
<div class="card-content">
<div class="project-header">
<div class="project-title">FantasyHSI</div>
<div class="project-badges"><a href="https://doi.org/10.48550/arXiv.2509.01232" target="_blank" class="badge badge-publish"><i class="fas fa-landmark"></i> AAAI 2026</a> <a href="https://fantasy-amap.github.io/fantasy-hsi/" target="_blank" class="badge badge-project"><i class="fas fa-globe"></i> Project</a> <a href="https://arxiv.org/abs/2509.01232" target="_blank" class="badge badge-arxiv"><i class="fas fa-file-pdf"></i> arXiv</a> <a href="https://github.com/Fantasy-AMAP/fantasy-hsi" target="_blank" class="badge badge-github" ><i class="fab fa-github"></i> Coming Soon</a> </div>
</div>
<div class="project-desc">Corresponds to the "Interaction" dimension. A graph-based multi-agent framework that grounds video generation within 3D world dynamics. It unifies the action space with a broader interaction loop, transforming video generation from a content endpoint into a control channel for interactive systems.</div>
</div>
</article>
<article class="project-card">
<div class="video-container">
<iframe width="922" height="519" src="https://www.youtube.com/embed/_7Mo6TrXTZs" title="FantasyID" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
</div>
<div class="card-content">
<div class="project-header">
<div class="project-title">FantasyID</div>
<div class="project-badges"><a href="https://fantasy-amap.github.io/fantasy-id/" target="_blank" class="badge badge-project"><i class="fas fa-globe"></i> Project</a> <a href="https://arxiv.org/abs/2502.13995" target="_blank" class="badge badge-arxiv"><i class="fas fa-file-pdf"></i> arXiv</a> <a href="https://github.com/Fantasy-AMAP/fantasy-id" target="_blank" class="badge badge-github" data-github-repo="Fantasy-AMAP/fantasy-id"><i class="fab fa-github"></i> Code<span class="star-suffix" style="display:none"> (<span class="star-count"></span> <i class="fas fa-star"></i>)</span></a> <a href="https://huggingface.co/acvlab/FantasyID" target="_blank" class="badge badge-huggingface"><i class="fas fa-face-smile"></i> HuggingFace</a> <a href="https://modelscope.cn/models/amap_cvlab/FantasyID" target="_blank" class="badge badge-modelscope"><i class="fas fa-cube"></i> ModelScope</a> </div>
</div>
<div class="project-desc">A tuning-free text-to-video model that leverages 3D facial priors, multi-view augmentation, and layer-aware guidance injection to deliver dynamic, identity-preserving video generation.</div>
</div>
</article>
</section>
</main>
<footer>
<p>Β© 2026 Fantasy AIGC Team</p>
</footer>
<script src="script.js"></script>
</body>
</html>