BQ-Wang0511

浏览器里 30 FPS 出说话视频 TalkLikeYou 的 demo 做实时 talking head，能给图片配音频，也能换掉源视频里的说话动作，RTX 3090 上 30 FPS 以上。 BQ-Wang0511/TalkLikeYou-Streaming-RealTime-Demo t.co

Talk Like You: Imitating How You Speak in Real-Time Talking Head Generation In daily life, each person exhibits unique speaking habits, leading to subtle yet consistent lip-shape variations even when pronouncing the same word. Although recent talking head generation methods have achieved impressive visual fidelity and lip synchronization, they largely overlook user-specific customization, especially the motion patterns that characterize individual speaking habits. These habits are difficult to model and capture, as their motion patterns are highly fine-grained and often similar across individuals. As a result, many approaches produce overly uniform facial motions and fail to capture diverse, person-specific articulation patterns. To address this, we propose TalkLikeYou, an efficient framework that imitates how a target person speaks in talking head generation. Our method models habit in motion-space and achieves real-time performance through Flow Matching with only one sampling step during inference. We further adopt a two-stage imitation learning strategy to capture subtle distinctions between habits, allowing users to specify a target habit through either a preset style from the dataset or a reference video. In addition, we introduce a new metric PLAD that projects mouth motions onto representative articulation axes to evaluate imitation accuracy and generation diversity. Extensive experiments demonstrate that TalkLikeYou generates high-quality talking heads in real-time and significantly improves speaking habit imitation compared with prior methods. The code is available at: BQ-Wang0511/TalkLikeYou Comments: 18 pages,10 figures. Project Page: bq-wang0511.github.io