Riesz Pyramids for Fast Phase-Based Video Magnification

Non-Exclusively Licensed

Some embodiments are directed to a method, corresponding system, and corresponding apparatus for rendering a video and/or image display to amplify small motions through video magnification. Some embodiments include a new compact image pyramid representation, the Riesz pyramid, that may be used for real-time, high-quality phase-based video magnification. Some embodiments are less overcomplete than even the smallest two orientation, octave-bandwidth complex steerable pyramid. Some embodiments are implemented using compact, efficient linear filters in the spatial domain. Some embodiments produce motion magnified videos that are of comparable quality to those using the complex steerable pyramid. In some embodiments, the Riesz pyramid is used with phase-based video magnification. The Riesz pyramid may phase-shift image features along their dominant orientation, rather than along every orientation like the complex steerable pyramid.

Researchers

William Freeman / Neal Wadhwa / Michael Rubinstein / Fredo Durand (he/him/his)

Departments: Dept of Electrical Engineering & Computer Science
Technology Areas: Artificial Intelligence (AI) and Machine Learning (ML) / Computer Science: Networking & Signals / Sensing & Imaging: Imaging
Impact Areas: Connected World

  • riesz pyramids for fast phase-based video magnification
    United States of America | Granted | 9,338,331

License this technology

Interested in this technology? Connect with our experienced licensing team to initiate the process.

Sign up for technology updates

Sign up now to receive the latest updates on cutting-edge technologies and innovations.