Using Photographs to Enhance Videos of a Static Scene

Using Photographs to Enhance Videos of a Static Scene from pro on Vimeo.
Scientists at the University of Washington are pushing the boundaries of what can be done with video by computers. They can use a series of still images taken of the same scene a video was taken, and extract some of the superior qualities of the still images to enhance the video. Lighting, resolution, texture and camera movement can all be enhanced.

Other things the software can be used for include the ability to edit a few frames of video to remove unpleasant objects, and have the computer propagate those edits through the whole video. Examples shown include removing a "no parking" sign from the foreground of a flower shop, and removing an unsightly scar from a tree.
These researchers are making progress toward what I'm looking for: the ability of a computer to watch my videos for me, and create an artificial reality populated with the people and places in those videos.

Watch the video to get an idea of all the capabilities that these researchers are working on.