Computers watching Movies

Nette Arbeit von Benjamin Grosser, der 'ne Software entwickelt hat, die Filme „ansieht“ und das „Eyetracking“ visualisiert. Ich hätte da ja gerne ein paar technische Details, der Infotext bleibt da leider nur sehr diffus („what a computational system sees“, „uses computer vision algorithms and artificial intelligence routines“). Ich gehe davon aus, dass die Software Bildunterschiede in den Frames (aka Bewegung) und Helligkeitswerte der Pixel erkennt (aka Licht) und daraus sowas wie eine Bewegungsstudie der Filmszenen erstellt.

Video oben: The Matrix, hier unten: American Beauty, Snip:

Computers Watching Movies shows what a computational system sees when it watches the same films that we do. The work illustrates this vision as a series of temporal sketches, where the sketching process is presented in synchronized time with the audio from the original clip. […]

Computers Watching Movies was computationally produced using software written by the artist. This software uses computer vision algorithms and artificial intelligence routines to give the system some degree of agency, allowing it to decide what it watches and what it does not. Six well-known clips from popular films are used in the work, enabling many viewers to draw upon their own visual memory of a scene when they watch it. The scenes are from the following movies: 2001: A Space Odyssey, American Beauty, Inception, Taxi Driver, The Matrix, and Annie Hall.

Computers Watching Movies