Sentence Tracker — Video Retrieval

A video search engine that supports sentential queries over 10 full-length Hollywood movies. Given a sentential query which conforms to a grammar it returns ranked clips which depict the query sentence using the techniques developed in

Andrei Barbu, N. Siddharth, Jeffrey Mark Siskind, 'Saying what you're looking for: linguistics meets video search', CoRR, September 2013.
To use this search engine form sentences from the template below and use the input box at the bottom of this page or click some of the sample sentences.

Template for sentential queries

\[ \textit{The}\; \left\{\begin{array}{l} \textit{person}\\ \textit{horse} \end{array}\right\}\; \left\{\begin{array}{l} \textit{approached}\; \textit{the}\; \left\{\begin{array}{l} \textit{person}\\ \textit{horse} \end{array}\right\}\; \left\{\begin{array}{l} \epsilon\\ \textit{quickly}\\ \textit{slowly} \end{array}\right\}\; \left\{\begin{array}{l} \epsilon\\ \textit{from the left}\\ \textit{from the right} \end{array}\right\}\\ \left\{\begin{array}{l} \textit{lead}\\ \textit{rode} \end{array}\right\}\; \textit{the}\; \left\{\begin{array}{l} \textit{person}\\ \textit{horse} \end{array}\right\}\; \left\{\begin{array}{l} \epsilon\\ \textit{quickly}\\ \textit{slowly} \end{array}\right\}\; \left\{\begin{array}{l} \epsilon\\ \textit{leftward}\\ \textit{rightward}\\ \left\{\begin{array}{l} \textit{towards}\\ \textit{away from} \end{array}\right\}\; \textit{the}\; \left\{\begin{array}{l} \textit{person}\\ \textit{horse} \end{array}\right\} \end{array}\right\} \end{array}\right\} \]

The 10 Hollywood movies
Black Beauty (Warner Brothers, 1994)
The Black Stallion (MGM, 1979)
Blazing Saddles (Warner Brothers, 1974)
Easy Rider (Columbia Pictures, 1969)
The Good the Bad and the Ugly (Columbia Pictures, 1966)
Hidalgo (Touchstone Pictures, 2004)
National Velvet (MGM, 1944)
Once Upon a Time in Mexico (Columbia Pictures, 2003)
Seabiscuit (Universal Pictures, 2003)
Unforgiven (Warner Brothers, 1992)
Sample sentences

No results


Back to the Research page