Swift Sampling: Selecting Temporal Surprises via Taylor Series

Swift Sampling is a training-free video frame selection method that works in latent space.

It predicts future feature trajectories with Taylor expansion and keeps frames that deviate the most as informative moments.

The approach is reported to be much cheaper than competing methods while improving long-video benchmark performance.

It offers a lightweight way to sample long videos more efficiently and boost downstream accuracy with less compute.