Research

Video Analysis

Models that describe video in the wild — news, sports, streaming — and that let you search video catalogues with a sketch.

Videos are a rich source of multimodal information; they include images, audio and temporal behavior. These features make video analysis a very attractive area as well as a challenge, especially for building an efficient model dealing with such a vast amount of data. Our team is working on models to describe video content in the wild, including news, sports, and streaming. In addition, we also exploit sketches for querying into video catalogs.

Video analysis pipeline

Associated projects

  • Automatic video description, including a benchmarking methodology for open-source video large language models on news videos
  • Video representation learning
← All research