Project 1: Motion Vector Preprocessor using TopVid

Project Overview

Build a ComfyUI node that uses Google's TopVid algorithm to track keypoints in videos and generate motion vector fields. This preprocessing step will give us better motion control in our v2v pipeline by extracting trajectory data from input videos.

Deliverables

1. Working ComfyUI node for TopVid processing
2. Integration pipeline connecting to v2v
3. Test results with performance metrics
4. Usage docs for the team

Technical Implementation

Phase 1: TopVid Setup

• Get TopVid running locally from Google's code/paper
• Test on sample videos to understand inputs/outputs
• Figure out key parameters and settings

Phase 2: ComfyUI Node

• Wrap TopVid in a custom ComfyUI node
• Handle video I/O properly for ComfyUI
• Add parameter controls for tracking settings