Computers watching Movies

Gepostet vor 3 Jahren, 7 Monaten in #Design #Movies #AI #Art #Coding #feat #NewAesthetics

Share: Twitter Facebook Mail

Nette Arbeit von Benjamin Grosser, der 'ne Software entwickelt hat, die Filme „ansieht“ und das „Eyetracking“ visualisiert. Ich hätte da ja gerne ein paar technische Details, der Infotext bleibt da leider nur sehr diffus („what a computational system sees“, „uses computer vision algorithms and artificial intelligence routines“). Ich gehe davon aus, dass die Software Bildunterschiede in den Frames (aka Bewegung) und Helligkeitswerte der Pixel erkennt (aka Licht) und daraus sowas wie eine Bewegungsstudie der Filmszenen erstellt.

Video oben: The Matrix, hier unten: American Beauty, Snip:

Computers Watching Movies shows what a computational system sees when it watches the same films that we do. The work illustrates this vision as a series of temporal sketches, where the sketching process is presented in synchronized time with the audio from the original clip. […]

Computers Watching Movies was computationally produced using software written by the artist. This software uses computer vision algorithms and artificial intelligence routines to give the system some degree of agency, allowing it to decide what it watches and what it does not. Six well-known clips from popular films are used in the work, enabling many viewers to draw upon their own visual memory of a scene when they watch it. The scenes are from the following movies: 2001: A Space Odyssey, American Beauty, Inception, Taxi Driver, The Matrix, and Annie Hall.

Computers Watching Movies

DeepMind releases StarCraft AI

Google und Blizzard haben ihre StarCraft AI veröffentlicht: Testing our agents in games that are not specifically designed for AI…

Digital Skin

Emilio Vavarella: The Digital Skin Series, 2016. „Archival inkjet prints on metallic paper. 18 elements. X:150; Y:115 cm, each.“ Von…

Monospaced Programming Fonts with Ligatures

Didn't know these exist, love it: Monospaced Programming Fonts with Ligatures. Three of the most interesting and thoughtful monospaced programming…

Salvador Dalís Moustache totally still a Moustache

Nachdem sie Savador Dalís Leiche wegen eines Vaterschaftsstreits ausbuddeln mussten, stellten man fest, dass der Schnurri vom Dalí noch 1a…

Neural Network-Faces synched to Music

„My first attempt to map a song made by @kamptweets onto GAN generated proto-faces.“ Bohemian Rhapsody next. The Three Nightingans.…

AI-Animations with human Sounds

Google vor ein paar Tagen so: „Yay, wir haben hier 'ne neue AI-based Animation-Tech, hooray!“ (Paper) Hayayo Miyazaki über AI-based…

Frankenstein vs Ingmar Bergman: Persona and the Monster

Fascinating (and awesome and gory) Movie-Mashup from Filmscalpel: „In 1816, Mary Wollstonecraft Shelley began writing what was to become her…

Visual AI-Spaces Auto-Pilot

Ich habe schon ein paar mal über Mario Klingemanns Arbeiten hier gebloggt, derzeit jagt er Neural Networks durch Feedback-Loops und…

Synthesizing Obama from Audio

Im Mai bloggte ich über ein damals noch nicht veröffentlichtes Paper zur SigGraph2017, in dem sie eine Methode für generative…

Stereographic Torus Knot

I'm not sure what's going on here but I like it: „This is very similar to Rise Up, though with…

Moarph

Mario Klingemann does some weird shit again with CycleGAN Feedback Loops (Neural Networks feeding their results back to each other).…