Moveable Projected Displays using Projector Based Tracking

By using high-speed structured light patterns emitted by a project and embedded light sensors, we can discover the location and track objects in real-time. Project by Johnny Chung Lee - 2004

WEBVTT
Kind: captions
Language: en

00:00:09.200 --> 00:00:10.790 align:start position:0%

Hello.<00:00:09.679><c> I'd</c><00:00:09.920><c> like</c><00:00:10.080><c> to</c><00:00:10.160><c> show</c><00:00:10.240><c> you</c><00:00:10.400><c> a</c><00:00:10.559><c> system</c>

00:00:10.790 --> 00:00:10.800 align:start position:0%
Hello. I'd like to show you a system

00:00:10.800 --> 00:00:12.070 align:start position:0%
Hello. I'd like to show you a system
that<00:00:10.960><c> we've</c><00:00:11.200><c> developed</c><00:00:11.519><c> for</c><00:00:11.759><c> creating</c>

00:00:12.070 --> 00:00:12.080 align:start position:0%
that we've developed for creating

00:00:12.080 --> 00:00:14.070 align:start position:0%
that we've developed for creating
movable<00:00:12.480><c> projected</c><00:00:12.960><c> displays</c><00:00:13.599><c> using</c><00:00:13.920><c> a</c>

00:00:14.070 --> 00:00:14.080 align:start position:0%
movable projected displays using a

00:00:14.080 --> 00:00:16.310 align:start position:0%
movable projected displays using a
projector-based<00:00:14.799><c> tracking</c><00:00:15.200><c> technique.</c><00:00:16.080><c> I</c>

00:00:16.310 --> 00:00:16.320 align:start position:0%
projector-based tracking technique. I

00:00:16.320 --> 00:00:17.750 align:start position:0%
projector-based tracking technique. I
have<00:00:16.480><c> with</c><00:00:16.640><c> me</c><00:00:16.800><c> here</c><00:00:16.960><c> one</c><00:00:17.119><c> of</c><00:00:17.199><c> the</c><00:00:17.359><c> surfaces</c>

00:00:17.750 --> 00:00:17.760 align:start position:0%
have with me here one of the surfaces

00:00:17.760 --> 00:00:19.910 align:start position:0%
have with me here one of the surfaces
that<00:00:17.920><c> we</c><00:00:18.080><c> use</c><00:00:18.240><c> in</c><00:00:18.400><c> our</c><00:00:18.560><c> tracking</c><00:00:18.960><c> system.</c><00:00:19.680><c> It</c>

00:00:19.910 --> 00:00:19.920 align:start position:0%
that we use in our tracking system. It

00:00:19.920 --> 00:00:22.150 align:start position:0%
that we use in our tracking system. It
contains<00:00:20.320><c> four</c><00:00:20.560><c> optical</c><00:00:21.039><c> sensors,</c><00:00:21.760><c> one</c><00:00:21.920><c> in</c>

00:00:22.150 --> 00:00:22.160 align:start position:0%
contains four optical sensors, one in

00:00:22.160 --> 00:00:23.750 align:start position:0%
contains four optical sensors, one in
each<00:00:22.320><c> corner,</c><00:00:22.720><c> and</c><00:00:22.880><c> a</c><00:00:23.039><c> touch</c><00:00:23.359><c> sensitive</c>

00:00:23.750 --> 00:00:23.760 align:start position:0%
each corner, and a touch sensitive

00:00:23.760 --> 00:00:26.230 align:start position:0%
each corner, and a touch sensitive
surface.<00:00:24.960><c> When</c><00:00:25.119><c> we</c><00:00:25.359><c> place</c><00:00:25.519><c> the</c><00:00:25.760><c> surface</c><00:00:26.000><c> into</c>

00:00:26.230 --> 00:00:26.240 align:start position:0%
surface. When we place the surface into

00:00:26.240 --> 00:00:28.150 align:start position:0%
surface. When we place the surface into
the<00:00:26.400><c> projection</c><00:00:26.800><c> area,</c><00:00:27.279><c> we</c><00:00:27.439><c> can</c><00:00:27.599><c> discover</c><00:00:27.920><c> the</c>

00:00:28.150 --> 00:00:28.160 align:start position:0%
the projection area, we can discover the

00:00:28.160 --> 00:00:30.070 align:start position:0%
the projection area, we can discover the
locations<00:00:28.560><c> of</c><00:00:28.720><c> each</c><00:00:28.960><c> corner</c><00:00:29.439><c> by</c><00:00:29.679><c> using</c><00:00:29.920><c> a</c>

00:00:30.070 --> 00:00:30.080 align:start position:0%
locations of each corner by using a

00:00:30.080 --> 00:00:31.669 align:start position:0%
locations of each corner by using a
sequence<00:00:30.400><c> of</c><00:00:30.560><c> patterns</c><00:00:30.880><c> that</c><00:00:31.119><c> uniquely</c>

00:00:31.669 --> 00:00:31.679 align:start position:0%
sequence of patterns that uniquely

00:00:31.679 --> 00:00:33.830 align:start position:0%
sequence of patterns that uniquely
identify<00:00:32.160><c> each</c><00:00:32.399><c> pixel.</c><00:00:33.200><c> Once</c><00:00:33.440><c> we</c><00:00:33.680><c> have</c>

00:00:33.830 --> 00:00:33.840 align:start position:0%
identify each pixel. Once we have

00:00:33.840 --> 00:00:36.069 align:start position:0%
identify each pixel. Once we have
discovered<00:00:34.320><c> each</c><00:00:34.559><c> sensor's</c><00:00:35.040><c> location,</c><00:00:35.840><c> we</c>

00:00:36.069 --> 00:00:36.079 align:start position:0%
discovered each sensor's location, we

00:00:36.079 --> 00:00:37.670 align:start position:0%
discovered each sensor's location, we
can<00:00:36.239><c> project</c><00:00:36.559><c> smaller</c><00:00:36.960><c> tracking</c><00:00:37.280><c> patterns</c>

00:00:37.670 --> 00:00:37.680 align:start position:0%
can project smaller tracking patterns

00:00:37.680 --> 00:00:39.830 align:start position:0%
can project smaller tracking patterns
over<00:00:37.920><c> each</c><00:00:38.239><c> corner</c><00:00:38.719><c> to</c><00:00:38.960><c> continuously</c><00:00:39.600><c> track</c>

00:00:39.830 --> 00:00:39.840 align:start position:0%
over each corner to continuously track

00:00:39.840 --> 00:00:42.389 align:start position:0%
over each corner to continuously track
the<00:00:40.079><c> surface</c><00:00:40.399><c> at</c><00:00:40.640><c> interactive</c><00:00:41.200><c> rates.</c><00:00:42.160><c> This</c>

00:00:42.389 --> 00:00:42.399 align:start position:0%
the surface at interactive rates. This

00:00:42.399 --> 00:00:44.630 align:start position:0%
the surface at interactive rates. This
allows<00:00:42.719><c> us</c><00:00:42.879><c> to</c><00:00:43.040><c> use</c><00:00:43.200><c> a</c><00:00:43.360><c> projector</c><00:00:44.000><c> to</c><00:00:44.239><c> simulate</c>

00:00:44.630 --> 00:00:44.640 align:start position:0%
allows us to use a projector to simulate

00:00:44.640 --> 00:00:47.590 align:start position:0%
allows us to use a projector to simulate
an<00:00:44.879><c> active</c><00:00:45.200><c> display</c><00:00:45.520><c> on</c><00:00:45.680><c> a</c><00:00:45.920><c> passive</c><00:00:46.600><c> surface.</c>

00:00:47.590 --> 00:00:47.600 align:start position:0%
an active display on a passive surface.

00:00:47.600 --> 00:00:49.270 align:start position:0%
an active display on a passive surface.
As<00:00:47.840><c> you</c><00:00:48.000><c> may</c><00:00:48.160><c> have</c><00:00:48.320><c> noticed,</c><00:00:48.719><c> the</c><00:00:48.879><c> tracking</c>

00:00:49.270 --> 00:00:49.280 align:start position:0%
As you may have noticed, the tracking

00:00:49.280 --> 00:00:51.350 align:start position:0%
As you may have noticed, the tracking
patterns<00:00:49.680><c> seem</c><00:00:49.920><c> to</c><00:00:50.079><c> appear</c><00:00:50.320><c> as</c><00:00:50.640><c> solid</c><00:00:51.039><c> gray</c>

00:00:51.350 --> 00:00:51.360 align:start position:0%
patterns seem to appear as solid gray

00:00:51.360 --> 00:00:53.510 align:start position:0%
patterns seem to appear as solid gray
squares.<00:00:52.239><c> This</c><00:00:52.480><c> is</c><00:00:52.559><c> not</c><00:00:52.719><c> an</c><00:00:52.879><c> artifact</c><00:00:53.280><c> of</c><00:00:53.360><c> the</c>

00:00:53.510 --> 00:00:53.520 align:start position:0%
squares. This is not an artifact of the

00:00:53.520 --> 00:00:55.189 align:start position:0%
squares. This is not an artifact of the
video<00:00:53.760><c> camera,</c><00:00:54.000><c> but</c><00:00:54.239><c> the</c><00:00:54.480><c> result</c><00:00:54.719><c> of</c><00:00:54.879><c> a</c><00:00:55.039><c> method</c>

00:00:55.189 --> 00:00:55.199 align:start position:0%
video camera, but the result of a method

00:00:55.199 --> 00:00:57.430 align:start position:0%
video camera, but the result of a method
of<00:00:55.360><c> projecting</c><00:00:55.760><c> the</c><00:00:56.000><c> location</c><00:00:56.399><c> patterns</c><00:00:57.039><c> in</c><00:00:57.280><c> a</c>

00:00:57.430 --> 00:00:57.440 align:start position:0%
of projecting the location patterns in a

00:00:57.440 --> 00:01:00.069 align:start position:0%
of projecting the location patterns in a
manner<00:00:57.760><c> non-visible</c><00:00:58.320><c> to</c><00:00:58.480><c> the</c><00:00:58.640><c> human</c><00:00:58.879><c> eye.</c><00:00:59.840><c> The</c>

00:01:00.069 --> 00:01:00.079 align:start position:0%
manner non-visible to the human eye. The

00:01:00.079 --> 00:01:01.910 align:start position:0%
manner non-visible to the human eye. The
way<00:01:00.160><c> we</c><00:01:00.399><c> accomplish</c><00:01:00.879><c> this</c><00:01:01.120><c> is</c><00:01:01.280><c> by</c><00:01:01.520><c> using</c><00:01:01.680><c> a</c>

00:01:01.910 --> 00:01:01.920 align:start position:0%
way we accomplish this is by using a

00:01:01.920 --> 00:01:04.469 align:start position:0%
way we accomplish this is by using a
modified<00:01:02.480><c> DLP</c><00:01:03.039><c> projector</c><00:01:03.680><c> to</c><00:01:03.920><c> project</c><00:01:04.239><c> two</c>

00:01:04.469 --> 00:01:04.479 align:start position:0%
modified DLP projector to project two

00:01:04.479 --> 00:01:05.990 align:start position:0%
modified DLP projector to project two
versions<00:01:04.720><c> of</c><00:01:04.960><c> gray</c><00:01:05.199><c> that</c><00:01:05.439><c> have</c><00:01:05.600><c> the</c><00:01:05.840><c> same</c>

00:01:05.990 --> 00:01:06.000 align:start position:0%
versions of gray that have the same

00:01:06.000 --> 00:01:07.910 align:start position:0%
versions of gray that have the same
apparent<00:01:06.400><c> intensity,</c><00:01:07.200><c> but</c><00:01:07.439><c> are</c><00:01:07.600><c> rendered</c>

00:01:07.910 --> 00:01:07.920 align:start position:0%
apparent intensity, but are rendered

00:01:07.920 --> 00:01:09.630 align:start position:0%
apparent intensity, but are rendered
with<00:01:08.080><c> two</c><00:01:08.320><c> different</c><00:01:08.560><c> frequencies</c><00:01:09.040><c> of</c><00:01:09.280><c> light</c>

00:01:09.630 --> 00:01:09.640 align:start position:0%
with two different frequencies of light

00:01:09.640 --> 00:01:11.750 align:start position:0%
with two different frequencies of light
modulation.<00:01:10.640><c> The</c><00:01:10.880><c> lighting</c><00:01:11.200><c> here</c><00:01:11.360><c> may</c><00:01:11.600><c> look</c>

00:01:11.750 --> 00:01:11.760 align:start position:0%
modulation. The lighting here may look

00:01:11.760 --> 00:01:13.750 align:start position:0%
modulation. The lighting here may look
uniform,<00:01:12.640><c> but</c><00:01:12.799><c> there</c><00:01:12.960><c> is</c><00:01:13.040><c> a</c><00:01:13.200><c> boundary</c><00:01:13.600><c> between</c>

00:01:13.750 --> 00:01:13.760 align:start position:0%
uniform, but there is a boundary between

00:01:13.760 --> 00:01:15.910 align:start position:0%
uniform, but there is a boundary between
a<00:01:14.000><c> low</c><00:01:14.240><c> frequency</c><00:01:14.640><c> area</c><00:01:14.880><c> on</c><00:01:15.119><c> the</c><00:01:15.280><c> left</c><00:01:15.600><c> and</c><00:01:15.760><c> a</c>

00:01:15.910 --> 00:01:15.920 align:start position:0%
a low frequency area on the left and a

00:01:15.920 --> 00:01:18.149 align:start position:0%
a low frequency area on the left and a
high<00:01:16.159><c> frequency</c><00:01:16.640><c> area</c><00:01:16.880><c> on</c><00:01:17.040><c> the</c><00:01:17.200><c> right.</c><00:01:17.920><c> This</c>

00:01:18.149 --> 00:01:18.159 align:start position:0%
high frequency area on the right. This

00:01:18.159 --> 00:01:19.670 align:start position:0%
high frequency area on the right. This
difference<00:01:18.479><c> is</c><00:01:18.720><c> invisible</c><00:01:19.119><c> to</c><00:01:19.280><c> a</c><00:01:19.439><c> human</c>

00:01:19.670 --> 00:01:19.680 align:start position:0%
difference is invisible to a human

00:01:19.680 --> 00:01:21.749 align:start position:0%
difference is invisible to a human
observer,<00:01:20.320><c> but</c><00:01:20.560><c> is</c><00:01:20.720><c> easily</c><00:01:21.040><c> detected</c><00:01:21.360><c> by</c><00:01:21.520><c> a</c>

00:01:21.749 --> 00:01:21.759 align:start position:0%
observer, but is easily detected by a

00:01:21.759 --> 00:01:23.910 align:start position:0%
observer, but is easily detected by a
light<00:01:22.000><c> sensor.</c><00:01:22.799><c> This</c><00:01:22.960><c> allows</c><00:01:23.280><c> us</c><00:01:23.439><c> to</c><00:01:23.520><c> hide</c><00:01:23.759><c> the</c>

00:01:23.910 --> 00:01:23.920 align:start position:0%
light sensor. This allows us to hide the

00:01:23.920 --> 00:01:25.670 align:start position:0%
light sensor. This allows us to hide the
location<00:01:24.320><c> tracking</c><00:01:24.720><c> patterns</c><00:01:25.200><c> in</c><00:01:25.439><c> what</c>

00:01:25.670 --> 00:01:25.680 align:start position:0%
location tracking patterns in what

00:01:25.680 --> 00:01:29.230 align:start position:0%
location tracking patterns in what
appear<00:01:25.920><c> to</c><00:01:26.080><c> be</c><00:01:26.240><c> solid</c><00:01:26.560><c> gray</c>

00:01:29.230 --> 00:01:29.240 align:start position:0%

00:01:29.240 --> 00:01:31.830 align:start position:0%

squares.<00:01:30.240><c> One</c><00:01:30.560><c> possible</c><00:01:31.040><c> application</c><00:01:31.600><c> of</c>

00:01:31.830 --> 00:01:31.840 align:start position:0%
squares. One possible application of

00:01:31.840 --> 00:01:33.670 align:start position:0%
squares. One possible application of
using<00:01:32.079><c> this</c><00:01:32.320><c> tracking</c><00:01:32.720><c> technique</c><00:01:33.200><c> is</c><00:01:33.439><c> to</c>

00:01:33.670 --> 00:01:33.680 align:start position:0%
using this tracking technique is to

00:01:33.680 --> 00:01:35.510 align:start position:0%
using this tracking technique is to
simulate<00:01:34.079><c> the</c><00:01:34.240><c> functionality</c><00:01:34.799><c> of</c><00:01:34.960><c> a</c><00:01:35.119><c> tablet</c>

00:01:35.510 --> 00:01:35.520 align:start position:0%
simulate the functionality of a tablet

00:01:35.520 --> 00:01:37.670 align:start position:0%
simulate the functionality of a tablet
PC.<00:01:36.400><c> We</c><00:01:36.640><c> can</c><00:01:36.720><c> use</c><00:01:36.880><c> a</c><00:01:37.040><c> touch-</c><00:01:37.360><c> sensitive</c>

00:01:37.670 --> 00:01:37.680 align:start position:0%
PC. We can use a touch- sensitive

00:01:37.680 --> 00:01:39.830 align:start position:0%
PC. We can use a touch- sensitive
surface<00:01:38.000><c> to</c><00:01:38.240><c> obtain</c><00:01:38.560><c> input</c><00:01:38.960><c> from</c><00:01:39.119><c> the</c><00:01:39.280><c> user,</c>

00:01:39.830 --> 00:01:39.840 align:start position:0%
surface to obtain input from the user,

00:01:39.840 --> 00:01:42.069 align:start position:0%
surface to obtain input from the user,
creating<00:01:40.240><c> fully</c><00:01:40.560><c> interactive</c><00:01:41.119><c> surfaces.</c>

00:01:42.069 --> 00:01:42.079 align:start position:0%
creating fully interactive surfaces.

00:01:42.079 --> 00:01:44.149 align:start position:0%
creating fully interactive surfaces.
These<00:01:42.400><c> clips</c><00:01:43.040><c> show</c><00:01:43.360><c> example</c><00:01:43.759><c> tablet</c>

00:01:44.149 --> 00:01:44.159 align:start position:0%
These clips show example tablet

00:01:44.159 --> 00:01:46.389 align:start position:0%
These clips show example tablet
applications<00:01:45.040><c> such</c><00:01:45.200><c> as</c><00:01:45.360><c> a</c><00:01:45.600><c> drawing</c><00:01:45.920><c> program</c>

00:01:46.389 --> 00:01:46.399 align:start position:0%
applications such as a drawing program

00:01:46.399 --> 00:01:59.870 align:start position:0%
applications such as a drawing program
or<00:01:46.720><c> interacting</c><00:01:47.200><c> with</c><00:01:47.280><c> a</c><00:01:47.520><c> web</c>

00:01:59.870 --> 00:01:59.880 align:start position:0%

00:01:59.880 --> 00:02:02.149 align:start position:0%

browser.<00:02:00.880><c> When</c><00:02:01.119><c> working</c><00:02:01.360><c> with</c><00:02:01.600><c> interactive</c>

00:02:02.149 --> 00:02:02.159 align:start position:0%
browser. When working with interactive

00:02:02.159 --> 00:02:03.990 align:start position:0%
browser. When working with interactive
surfaces,<00:02:02.880><c> properly</c><00:02:03.280><c> detecting</c><00:02:03.759><c> and</c>

00:02:03.990 --> 00:02:04.000 align:start position:0%
surfaces, properly detecting and

00:02:04.000 --> 00:02:06.069 align:start position:0%
surfaces, properly detecting and
handling<00:02:04.399><c> occlusions</c><00:02:05.200><c> or</c><00:02:05.439><c> other</c><00:02:05.680><c> loss</c><00:02:05.920><c> of</c>

00:02:06.069 --> 00:02:06.079 align:start position:0%
handling occlusions or other loss of

00:02:06.079 --> 00:02:08.229 align:start position:0%
handling occlusions or other loss of
tracking<00:02:06.479><c> signal</c><00:02:07.040><c> is</c><00:02:07.360><c> essential</c><00:02:07.680><c> for</c><00:02:07.840><c> such</c><00:02:08.080><c> a</c>

00:02:08.229 --> 00:02:08.239 align:start position:0%
tracking signal is essential for such a

00:02:08.239 --> 00:02:10.790 align:start position:0%
tracking signal is essential for such a
system<00:02:08.479><c> to</c><00:02:08.640><c> be</c><00:02:08.800><c> useful.</c><00:02:09.840><c> In</c><00:02:10.080><c> this</c><00:02:10.239><c> clip,</c><00:02:10.560><c> we</c>

00:02:10.790 --> 00:02:10.800 align:start position:0%
system to be useful. In this clip, we

00:02:10.800 --> 00:02:12.550 align:start position:0%
system to be useful. In this clip, we
generate<00:02:11.200><c> several</c><00:02:11.520><c> instances</c><00:02:12.000><c> of</c><00:02:12.160><c> tracking</c>

00:02:12.550 --> 00:02:12.560 align:start position:0%
generate several instances of tracking

00:02:12.560 --> 00:02:15.110 align:start position:0%
generate several instances of tracking
loss.<00:02:13.280><c> Sometimes</c><00:02:13.760><c> due</c><00:02:14.000><c> to</c><00:02:14.080><c> a</c><00:02:14.319><c> hand</c><00:02:14.560><c> covering</c><00:02:14.879><c> a</c>

00:02:15.110 --> 00:02:15.120 align:start position:0%
loss. Sometimes due to a hand covering a

00:02:15.120 --> 00:02:17.190 align:start position:0%
loss. Sometimes due to a hand covering a
sensor<00:02:15.680><c> and</c><00:02:15.920><c> sometimes</c><00:02:16.400><c> due</c><00:02:16.560><c> to</c><00:02:16.720><c> the</c><00:02:16.879><c> surface</c>

00:02:17.190 --> 00:02:17.200 align:start position:0%
sensor and sometimes due to the surface

00:02:17.200 --> 00:02:19.670 align:start position:0%
sensor and sometimes due to the surface
exiting<00:02:17.599><c> the</c><00:02:17.760><c> projection</c><00:02:18.160><c> area.</c><00:02:19.120><c> The</c><00:02:19.360><c> edge</c><00:02:19.599><c> of</c>

00:02:19.670 --> 00:02:19.680 align:start position:0%
exiting the projection area. The edge of

00:02:19.680 --> 00:02:21.350 align:start position:0%
exiting the projection area. The edge of
the<00:02:19.840><c> projection</c><00:02:20.160><c> area</c><00:02:20.480><c> is</c><00:02:20.720><c> highlighted</c><00:02:21.120><c> here</c>

00:02:21.350 --> 00:02:21.360 align:start position:0%
the projection area is highlighted here

00:02:21.360 --> 00:02:23.990 align:start position:0%
the projection area is highlighted here
by<00:02:21.680><c> the</c><00:02:21.840><c> long</c><00:02:22.080><c> stationary</c><00:02:22.720><c> white</c><00:02:23.040><c> line.</c>

00:02:23.990 --> 00:02:24.000 align:start position:0%
by the long stationary white line.

00:02:24.000 --> 00:02:26.229 align:start position:0%
by the long stationary white line.
Notice<00:02:24.319><c> that</c><00:02:24.560><c> even</c><00:02:24.720><c> when</c><00:02:24.879><c> a</c><00:02:25.040><c> sensor</c><00:02:25.440><c> is</c><00:02:25.599><c> lost,</c>

00:02:26.229 --> 00:02:26.239 align:start position:0%
Notice that even when a sensor is lost,

00:02:26.239 --> 00:02:27.990 align:start position:0%
Notice that even when a sensor is lost,
the<00:02:26.480><c> movement</c><00:02:26.640><c> of</c><00:02:26.800><c> the</c><00:02:26.879><c> wireframe</c><00:02:27.440><c> geometry</c>

00:02:27.990 --> 00:02:28.000 align:start position:0%
the movement of the wireframe geometry

00:02:28.000 --> 00:02:30.229 align:start position:0%
the movement of the wireframe geometry
seems<00:02:28.239><c> to</c><00:02:28.400><c> be</c><00:02:28.480><c> largely</c><00:02:29.000><c> unaffected.</c><00:02:30.000><c> The</c>

00:02:30.229 --> 00:02:30.239 align:start position:0%
seems to be largely unaffected. The

00:02:30.239 --> 00:02:31.990 align:start position:0%
seems to be largely unaffected. The
system<00:02:30.560><c> estimates</c><00:02:31.040><c> the</c><00:02:31.200><c> locations</c><00:02:31.680><c> of</c><00:02:31.840><c> any</c>

00:02:31.990 --> 00:02:32.000 align:start position:0%
system estimates the locations of any

00:02:32.000 --> 00:02:34.229 align:start position:0%
system estimates the locations of any
lost<00:02:32.400><c> sensor</c><00:02:32.959><c> based</c><00:02:33.280><c> on</c><00:02:33.440><c> the</c><00:02:33.599><c> movement</c><00:02:33.840><c> of</c><00:02:34.000><c> the</c>

00:02:34.229 --> 00:02:34.239 align:start position:0%
lost sensor based on the movement of the

00:02:34.239 --> 00:02:36.150 align:start position:0%
lost sensor based on the movement of the
remaining<00:02:34.560><c> available</c><00:02:35.040><c> sensors.</c><00:02:35.760><c> When</c><00:02:36.000><c> a</c>

00:02:36.150 --> 00:02:36.160 align:start position:0%
remaining available sensors. When a

00:02:36.160 --> 00:02:37.910 align:start position:0%
remaining available sensors. When a
sensor<00:02:36.480><c> becomes</c><00:02:36.800><c> visible</c><00:02:37.120><c> by</c><00:02:37.360><c> the</c><00:02:37.519><c> projector</c>

00:02:37.910 --> 00:02:37.920 align:start position:0%
sensor becomes visible by the projector

00:02:37.920 --> 00:02:39.910 align:start position:0%
sensor becomes visible by the projector
again,<00:02:38.400><c> the</c><00:02:38.640><c> tracking</c><00:02:38.959><c> is</c><00:02:39.120><c> reacquired</c><00:02:39.680><c> and</c>

00:02:39.910 --> 00:02:39.920 align:start position:0%
again, the tracking is reacquired and

00:02:39.920 --> 00:02:42.309 align:start position:0%
again, the tracking is reacquired and
the<00:02:40.080><c> estimated</c><00:02:40.560><c> geometry</c><00:02:41.040><c> is</c><00:02:41.200><c> updated.</c><00:02:42.080><c> You</c>

00:02:42.309 --> 00:02:42.319 align:start position:0%
the estimated geometry is updated. You

00:02:42.319 --> 00:02:43.910 align:start position:0%
the estimated geometry is updated. You
can<00:02:42.400><c> see</c><00:02:42.560><c> that</c><00:02:42.720><c> the</c><00:02:42.879><c> overall</c><00:02:43.280><c> behavior</c><00:02:43.680><c> is</c>

00:02:43.910 --> 00:02:43.920 align:start position:0%
can see that the overall behavior is

00:02:43.920 --> 00:02:45.150 align:start position:0%
can see that the overall behavior is
quite

00:02:45.150 --> 00:02:45.160 align:start position:0%
quite

00:02:45.160 --> 00:02:47.589 align:start position:0%
quite
robust.<00:02:46.160><c> By</c><00:02:46.400><c> unifying</c><00:02:46.879><c> the</c><00:02:47.040><c> tracking</c><00:02:47.360><c> and</c>

00:02:47.589 --> 00:02:47.599 align:start position:0%
robust. By unifying the tracking and

00:02:47.599 --> 00:02:49.270 align:start position:0%
robust. By unifying the tracking and
imaging<00:02:48.000><c> technology</c><00:02:48.480><c> into</c><00:02:48.800><c> a</c><00:02:48.959><c> single</c>

00:02:49.270 --> 00:02:49.280 align:start position:0%
imaging technology into a single

00:02:49.280 --> 00:02:51.190 align:start position:0%
imaging technology into a single
mechanism,<00:02:50.000><c> we</c><00:02:50.239><c> can</c><00:02:50.400><c> greatly</c><00:02:50.720><c> reduce</c><00:02:50.959><c> the</c>

00:02:51.190 --> 00:02:51.200 align:start position:0%
mechanism, we can greatly reduce the

00:02:51.200 --> 00:02:52.790 align:start position:0%
mechanism, we can greatly reduce the
cost<00:02:51.440><c> and</c><00:02:51.680><c> complexity</c><00:02:52.239><c> involved</c><00:02:52.560><c> with</c>

00:02:52.790 --> 00:02:52.800 align:start position:0%
cost and complexity involved with

00:02:52.800 --> 00:02:54.790 align:start position:0%
cost and complexity involved with
creating<00:02:53.200><c> systems</c><00:02:53.840><c> that</c><00:02:54.080><c> combine</c><00:02:54.480><c> motion</c>

00:02:54.790 --> 00:02:54.800 align:start position:0%
creating systems that combine motion

00:02:54.800 --> 00:02:57.270 align:start position:0%
creating systems that combine motion
tracking<00:02:55.120><c> with</c><00:02:55.360><c> projected</c><00:02:55.879><c> imagery.</c><00:02:56.879><c> To</c>

00:02:57.270 --> 00:02:57.280 align:start position:0%
tracking with projected imagery. To

00:02:57.280 --> 00:02:58.550 align:start position:0%
tracking with projected imagery. To
illustrate<00:02:57.519><c> the</c><00:02:57.760><c> simplicity</c><00:02:58.160><c> of</c><00:02:58.319><c> this</c>

00:02:58.550 --> 00:02:58.560 align:start position:0%
illustrate the simplicity of this

00:02:58.560 --> 00:03:00.390 align:start position:0%
illustrate the simplicity of this
approach,<00:02:59.120><c> we</c><00:02:59.280><c> have</c><00:02:59.440><c> implemented</c><00:03:00.000><c> several</c>

00:03:00.390 --> 00:03:00.400 align:start position:0%
approach, we have implemented several

00:03:00.400 --> 00:03:02.309 align:start position:0%
approach, we have implemented several
demonstration<00:03:01.040><c> interaction</c><00:03:01.599><c> techniques.</c>

00:03:02.309 --> 00:03:02.319 align:start position:0%
demonstration interaction techniques.

00:03:02.319 --> 00:03:04.710 align:start position:0%
demonstration interaction techniques.
Here<00:03:02.800><c> is</c><00:03:02.959><c> a</c><00:03:03.120><c> simple</c><00:03:03.440><c> magic</c><00:03:03.840><c> lens</c><00:03:04.080><c> interaction</c>

00:03:04.710 --> 00:03:04.720 align:start position:0%
Here is a simple magic lens interaction

00:03:04.720 --> 00:03:06.550 align:start position:0%
Here is a simple magic lens interaction
where<00:03:04.959><c> the</c><00:03:05.120><c> user</c><00:03:05.360><c> can</c><00:03:05.519><c> physically</c><00:03:06.080><c> manipulate</c>

00:03:06.550 --> 00:03:06.560 align:start position:0%
where the user can physically manipulate

00:03:06.560 --> 00:03:08.390 align:start position:0%
where the user can physically manipulate
the<00:03:06.800><c> display</c><00:03:07.120><c> surface</c><00:03:07.680><c> to</c><00:03:07.920><c> obtain</c><00:03:08.159><c> an</c>

00:03:08.390 --> 00:03:08.400 align:start position:0%
the display surface to obtain an

00:03:08.400 --> 00:03:10.190 align:start position:0%
the display surface to obtain an
alternative<00:03:08.879><c> view</c><00:03:09.040><c> of</c><00:03:09.200><c> the</c><00:03:09.360><c> map</c>

00:03:10.190 --> 00:03:10.200 align:start position:0%
alternative view of the map

00:03:10.200 --> 00:03:12.869 align:start position:0%
alternative view of the map
data.<00:03:11.200><c> Instead</c><00:03:11.519><c> of</c><00:03:11.680><c> using</c><00:03:11.920><c> a</c><00:03:12.159><c> passive</c><00:03:12.560><c> display</c>

00:03:12.869 --> 00:03:12.879 align:start position:0%
data. Instead of using a passive display

00:03:12.879 --> 00:03:14.710 align:start position:0%
data. Instead of using a passive display
surface<00:03:13.280><c> constructed</c><00:03:13.760><c> from</c><00:03:14.000><c> foam</c><00:03:14.239><c> board</c><00:03:14.560><c> and</c>

00:03:14.710 --> 00:03:14.720 align:start position:0%
surface constructed from foam board and

00:03:14.720 --> 00:03:16.710 align:start position:0%
surface constructed from foam board and
paper,<00:03:15.360><c> we</c><00:03:15.519><c> can</c><00:03:15.680><c> use</c><00:03:15.840><c> this</c><00:03:16.000><c> tracking</c><00:03:16.400><c> frame</c>

00:03:16.710 --> 00:03:16.720 align:start position:0%
paper, we can use this tracking frame

00:03:16.720 --> 00:03:18.710 align:start position:0%
paper, we can use this tracking frame
containing<00:03:17.200><c> just</c><00:03:17.360><c> the</c><00:03:17.599><c> four</c><00:03:17.840><c> light</c><00:03:18.159><c> sensors</c>

00:03:18.710 --> 00:03:18.720 align:start position:0%
containing just the four light sensors

00:03:18.720 --> 00:03:20.949 align:start position:0%
containing just the four light sensors
to<00:03:18.959><c> track</c><00:03:19.200><c> the</c><00:03:19.360><c> location</c><00:03:19.680><c> of</c><00:03:19.760><c> a</c><00:03:20.000><c> tablet</c><00:03:20.319><c> PC</c>

00:03:20.949 --> 00:03:20.959 align:start position:0%
to track the location of a tablet PC

00:03:20.959 --> 00:03:22.550 align:start position:0%
to track the location of a tablet PC
containing<00:03:21.280><c> a</c><00:03:21.440><c> highresolution</c><00:03:22.239><c> liquid</c>

00:03:22.550 --> 00:03:22.560 align:start position:0%
containing a highresolution liquid

00:03:22.560 --> 00:03:25.110 align:start position:0%
containing a highresolution liquid
crystal<00:03:23.000><c> display.</c><00:03:24.000><c> This</c><00:03:24.239><c> provides</c><00:03:24.560><c> us</c><00:03:24.720><c> with</c><00:03:24.879><c> a</c>

00:03:25.110 --> 00:03:25.120 align:start position:0%
crystal display. This provides us with a

00:03:25.120 --> 00:03:27.430 align:start position:0%
crystal display. This provides us with a
movable<00:03:25.519><c> version</c><00:03:25.920><c> of</c><00:03:26.080><c> a</c><00:03:26.319><c> focus</c><00:03:26.640><c> plus</c><00:03:26.959><c> context</c>

00:03:27.430 --> 00:03:27.440 align:start position:0%
movable version of a focus plus context

00:03:27.440 --> 00:03:29.670 align:start position:0%
movable version of a focus plus context
display.<00:03:28.159><c> The</c><00:03:28.319><c> pixel</c><00:03:28.720><c> density</c><00:03:29.120><c> ratio</c><00:03:29.440><c> between</c>

00:03:29.670 --> 00:03:29.680 align:start position:0%
display. The pixel density ratio between

00:03:29.680 --> 00:03:31.270 align:start position:0%
display. The pixel density ratio between
the<00:03:29.840><c> projected</c><00:03:30.319><c> image</c><00:03:30.720><c> and</c><00:03:30.879><c> the</c><00:03:31.040><c> liquid</c>

00:03:31.270 --> 00:03:31.280 align:start position:0%
the projected image and the liquid

00:03:31.280 --> 00:03:33.910 align:start position:0%
the projected image and the liquid
crystal<00:03:31.680><c> display</c><00:03:32.000><c> is</c><00:03:32.239><c> approximately</c><00:03:32.879><c> 10</c><00:03:33.120><c> to1</c>

00:03:33.910 --> 00:03:33.920 align:start position:0%
crystal display is approximately 10 to1

00:03:33.920 --> 00:03:35.670 align:start position:0%
crystal display is approximately 10 to1
allowing<00:03:34.239><c> a</c><00:03:34.480><c> much</c><00:03:34.640><c> greater</c><00:03:34.959><c> level</c><00:03:35.120><c> of</c><00:03:35.360><c> detail</c>

00:03:35.670 --> 00:03:35.680 align:start position:0%
allowing a much greater level of detail

00:03:35.680 --> 00:03:37.949 align:start position:0%
allowing a much greater level of detail
over<00:03:36.080><c> selected</c>

00:03:37.949 --> 00:03:37.959 align:start position:0%
over selected

00:03:37.959 --> 00:03:40.630 align:start position:0%
over selected
area.<00:03:38.959><c> Here</c><00:03:39.280><c> we</c><00:03:39.599><c> demonstrate</c><00:03:40.080><c> tracking</c><00:03:40.400><c> more</c>

00:03:40.630 --> 00:03:40.640 align:start position:0%
area. Here we demonstrate tracking more

00:03:40.640 --> 00:03:41.910 align:start position:0%
area. Here we demonstrate tracking more
than<00:03:40.799><c> one</c><00:03:40.959><c> surface</c><00:03:41.280><c> with</c><00:03:41.440><c> a</c><00:03:41.680><c> single</c>

00:03:41.910 --> 00:03:41.920 align:start position:0%
than one surface with a single

00:03:41.920 --> 00:03:44.070 align:start position:0%
than one surface with a single
projector.<00:03:42.720><c> The</c><00:03:42.959><c> marginal</c><00:03:43.360><c> added</c><00:03:43.680><c> cost</c><00:03:43.920><c> of</c>

00:03:44.070 --> 00:03:44.080 align:start position:0%
projector. The marginal added cost of

00:03:44.080 --> 00:03:46.710 align:start position:0%
projector. The marginal added cost of
the<00:03:44.239><c> second</c><00:03:44.480><c> display</c><00:03:44.879><c> is</c><00:03:45.120><c> less</c><00:03:45.280><c> than</c><00:03:45.519><c> $10.</c>

00:03:46.710 --> 00:03:46.720 align:start position:0%
the second display is less than $10.

00:03:46.720 --> 00:03:48.229 align:start position:0%
the second display is less than $10.
Additionally,<00:03:47.360><c> since</c><00:03:47.599><c> we</c><00:03:47.760><c> use</c><00:03:47.840><c> the</c><00:03:48.080><c> same</c>

00:03:48.229 --> 00:03:48.239 align:start position:0%
Additionally, since we use the same

00:03:48.239 --> 00:03:50.070 align:start position:0%
Additionally, since we use the same
projector<00:03:48.640><c> for</c><00:03:48.799><c> tracking</c><00:03:49.120><c> both</c><00:03:49.360><c> surfaces,</c>

00:03:50.070 --> 00:03:50.080 align:start position:0%
projector for tracking both surfaces,

00:03:50.080 --> 00:03:51.830 align:start position:0%
projector for tracking both surfaces,
the<00:03:50.319><c> geometric</c><00:03:50.879><c> relationship</c><00:03:51.360><c> between</c><00:03:51.599><c> the</c>

00:03:51.830 --> 00:03:51.840 align:start position:0%
the geometric relationship between the

00:03:51.840 --> 00:03:54.149 align:start position:0%
the geometric relationship between the
two<00:03:52.000><c> displays</c><00:03:52.400><c> is</c><00:03:52.640><c> readily</c><00:03:53.040><c> available</c><00:03:53.680><c> and</c><00:03:53.920><c> is</c>

00:03:54.149 --> 00:03:54.159 align:start position:0%
two displays is readily available and is

00:03:54.159 --> 00:03:56.309 align:start position:0%
two displays is readily available and is
represented<00:03:54.560><c> here</c><00:03:54.799><c> using</c><00:03:55.040><c> the</c><00:03:55.280><c> two</c><00:03:55.440><c> arrows.</c>

00:03:56.309 --> 00:03:56.319 align:start position:0%
represented here using the two arrows.

00:03:56.319 --> 00:03:58.309 align:start position:0%
represented here using the two arrows.
Their<00:03:56.640><c> size</c><00:03:56.879><c> and</c><00:03:57.120><c> orientation</c><00:03:57.760><c> indicate</c><00:03:58.080><c> the</c>

00:03:58.309 --> 00:03:58.319 align:start position:0%
Their size and orientation indicate the

00:03:58.319 --> 00:03:59.830 align:start position:0%
Their size and orientation indicate the
direction<00:03:58.640><c> and</c><00:03:58.879><c> distance</c><00:03:59.200><c> to</c><00:03:59.439><c> the</c><00:03:59.599><c> other</c>

00:03:59.830 --> 00:03:59.840 align:start position:0%
direction and distance to the other

00:03:59.840 --> 00:04:02.309 align:start position:0%
direction and distance to the other
screen.<00:04:00.640><c> This</c><00:04:00.799><c> allows</c><00:04:01.200><c> easy</c><00:04:01.599><c> exploration</c><00:04:02.159><c> of</c>

00:04:02.309 --> 00:04:02.319 align:start position:0%
screen. This allows easy exploration of

00:04:02.319 --> 00:04:04.070 align:start position:0%
screen. This allows easy exploration of
interaction<00:04:02.879><c> techniques</c><00:04:03.519><c> involving</c>

00:04:04.070 --> 00:04:04.080 align:start position:0%
interaction techniques involving

00:04:04.080 --> 00:04:06.190 align:start position:0%
interaction techniques involving
location<00:04:04.560><c> sensitive</c>

00:04:06.190 --> 00:04:06.200 align:start position:0%
location sensitive

00:04:06.200 --> 00:04:08.550 align:start position:0%
location sensitive
displays.<00:04:07.200><c> We</c><00:04:07.439><c> can</c><00:04:07.599><c> also</c><00:04:07.920><c> track</c><00:04:08.239><c> single</c>

00:04:08.550 --> 00:04:08.560 align:start position:0%
displays. We can also track single

00:04:08.560 --> 00:04:11.589 align:start position:0%
displays. We can also track single
sensors<00:04:09.120><c> to</c><00:04:09.360><c> create</c><00:04:09.760><c> physical</c><00:04:10.239><c> input</c><00:04:10.720><c> pucks.</c>

00:04:11.589 --> 00:04:11.599 align:start position:0%
sensors to create physical input pucks.

00:04:11.599 --> 00:04:13.350 align:start position:0%
sensors to create physical input pucks.
In<00:04:11.920><c> this</c><00:04:12.080><c> demonstration,</c><00:04:12.640><c> we</c><00:04:12.799><c> are</c><00:04:12.959><c> using</c><00:04:13.120><c> the</c>

00:04:13.350 --> 00:04:13.360 align:start position:0%
In this demonstration, we are using the

00:04:13.360 --> 00:04:15.429 align:start position:0%
In this demonstration, we are using the
pucks<00:04:13.760><c> to</c><00:04:13.920><c> control</c><00:04:14.239><c> a</c><00:04:14.480><c> two-handed</c><00:04:15.040><c> physical</c>

00:04:15.429 --> 00:04:15.439 align:start position:0%
pucks to control a two-handed physical

00:04:15.439 --> 00:04:18.670 align:start position:0%
pucks to control a two-handed physical
mapping

00:04:18.670 --> 00:04:18.680 align:start position:0%

00:04:18.680 --> 00:04:21.189 align:start position:0%

tool.<00:04:19.680><c> Alternatively,</c><00:04:20.560><c> we</c><00:04:20.720><c> can</c><00:04:20.880><c> use</c><00:04:20.959><c> the</c>

00:04:21.189 --> 00:04:21.199 align:start position:0%
tool. Alternatively, we can use the

00:04:21.199 --> 00:04:23.270 align:start position:0%
tool. Alternatively, we can use the
pucks<00:04:21.519><c> to</c><00:04:21.680><c> control</c><00:04:21.919><c> input</c><00:04:22.320><c> elements</c><00:04:22.880><c> in</c><00:04:23.120><c> a</c>

00:04:23.270 --> 00:04:23.280 align:start position:0%
pucks to control input elements in a

00:04:23.280 --> 00:04:25.469 align:start position:0%
pucks to control input elements in a
planning<00:04:23.600><c> task</c><00:04:23.919><c> or</c><00:04:24.160><c> in</c><00:04:24.320><c> a</c><00:04:24.479><c> real-time</c>

00:04:25.469 --> 00:04:25.479 align:start position:0%
planning task or in a real-time

00:04:25.479 --> 00:04:27.830 align:start position:0%
planning task or in a real-time
simulation.<00:04:26.479><c> The</c><00:04:26.720><c> projector-based</c><00:04:27.440><c> tracking</c>

00:04:27.830 --> 00:04:27.840 align:start position:0%
simulation. The projector-based tracking

00:04:27.840 --> 00:04:29.670 align:start position:0%
simulation. The projector-based tracking
technique<00:04:28.160><c> we</c><00:04:28.400><c> have</c><00:04:28.560><c> presented</c><00:04:29.280><c> greatly</c>

00:04:29.670 --> 00:04:29.680 align:start position:0%
technique we have presented greatly

00:04:29.680 --> 00:04:31.749 align:start position:0%
technique we have presented greatly
reduces<00:04:30.160><c> the</c><00:04:30.320><c> complexity</c><00:04:30.880><c> and</c><00:04:31.120><c> cost</c><00:04:31.440><c> of</c>

00:04:31.749 --> 00:04:31.759 align:start position:0%
reduces the complexity and cost of

00:04:31.759 --> 00:04:33.909 align:start position:0%
reduces the complexity and cost of
implementing<00:04:32.320><c> applications</c><00:04:33.199><c> that</c><00:04:33.440><c> combine</c>

00:04:33.909 --> 00:04:33.919 align:start position:0%
implementing applications that combine

00:04:33.919 --> 00:04:35.990 align:start position:0%
implementing applications that combine
motion<00:04:34.240><c> tracking</c><00:04:34.560><c> with</c><00:04:34.720><c> projected</c><00:04:35.199><c> imagery.</c>

00:04:35.990 --> 00:04:36.000 align:start position:0%
motion tracking with projected imagery.

00:04:36.000 --> 00:04:37.990 align:start position:0%
motion tracking with projected imagery.
This<00:04:36.240><c> technique</c><00:04:36.720><c> may</c><00:04:36.960><c> help</c><00:04:37.199><c> bring</c><00:04:37.440><c> visions</c><00:04:37.759><c> of</c>

00:04:37.990 --> 00:04:38.000 align:start position:0%
This technique may help bring visions of

00:04:38.000 --> 00:04:40.070 align:start position:0%
This technique may help bring visions of
future<00:04:38.400><c> ubiquitous</c><00:04:38.880><c> computing</c><00:04:39.199><c> environments</c>

00:04:40.070 --> 00:04:40.080 align:start position:0%
future ubiquitous computing environments

00:04:40.080 --> 00:04:44.680 align:start position:0%
future ubiquitous computing environments
closer<00:04:40.479><c> to</c><00:04:40.639><c> becoming</c><00:04:41.040><c> a</c><00:04:41.280><c> practical</c><00:04:41.680><c> reality.</c>