WEBVTT
Kind: captions
Language: en

1
00:00:00.299 --> 00:00:01.550
I can't see any of this.

2
00:00:01.550 --> 00:00:04.560
I can't see the mountaintop, or the yawning
chasm in front of me,

3
00:00:04.560 --> 00:00:08.240
and this isn't some magical drone camera hovering
out in mid-air.

4
00:00:08.240 --> 00:00:11.290
This is the Mixed Reality Lab at YouTube Space
New York,

5
00:00:11.290 --> 00:00:15.059
and if I want to see anything around me other
than these green walls,

6
00:00:15.059 --> 00:00:16.910
I'm going to have to wear this headset.

7
00:00:16.910 --> 00:00:19.359
The challenge with virtual reality is that

8
00:00:19.359 --> 00:00:21.999
while the person who's in it is amazed,

9
00:00:21.999 --> 00:00:24.249
and waving their arms around and experiencing
it,

10
00:00:24.249 --> 00:00:27.019
the rest of us don't know what's going on.

11
00:00:27.019 --> 00:00:30.789
And so mixed reality is a way of letting everyone
else see

12
00:00:30.789 --> 00:00:33.019
what it would be like if we were there too.

13
00:00:33.019 --> 00:00:37.239
We have an actual camera that is filming you
in the headset,

14
00:00:37.239 --> 00:00:38.600
in front of a green screen,

15
00:00:38.600 --> 00:00:41.930
and then the game just needs to know where
the virtual camera should be.

16
00:00:41.930 --> 00:00:47.039
We're using an HTC Vive for the VR, and if
we use a third hand controller

17
00:00:47.039 --> 00:00:49.530
and attach that controller to the camera,

18
00:00:49.530 --> 00:00:52.850
now the game understands where the camera
is

19
00:00:52.850 --> 00:00:57.519
and so we can have both the actual camera
and the virtual camera

20
00:00:57.519 --> 00:01:00.929
moving through the space and recording what
it would be like

21
00:01:00.929 --> 00:01:03.360
if we were inside there with you.

22
00:01:03.360 --> 00:01:07.230
We're using a PC that's specced-out with the
highest-end Intel processor,

23
00:01:07.230 --> 00:01:11.960
32 gigs of RAM, and the current high-level
consumer video card,

24
00:01:11.960 --> 00:01:14.310
which is an NVIDIA GTX 1080.

25
00:01:14.310 --> 00:01:16.120
We're rendering at 4K,

26
00:01:16.120 --> 00:01:20.110
and anything less than that is going to run
into an issue!

27
00:01:20.110 --> 00:01:21.870
What's needed to make the mixed reality work

28
00:01:21.870 --> 00:01:27.230
is a small config file that sits right in
the root folder of the game that you're playing

29
00:01:27.230 --> 00:01:32.280
and that config file contains the offset between
where that controller sits

30
00:01:32.280 --> 00:01:34.210
and where the actual lens of the camera is.

31
00:01:34.210 --> 00:01:38.840
And then you also need to match the rotation
and the field of view of the camera

32
00:01:38.840 --> 00:01:43.210
so other than that, it should work with any
recent built of Unity.

33
00:01:43.210 --> 00:01:47.030
Unity is a framework for building 3D stuff
that a lot of programmers use.

34
00:01:47.030 --> 00:01:48.720
And because the system ties into it,

35
00:01:48.720 --> 00:01:52.040
the Mixed Reality Lab can work with a lot
of different VR games.

36
00:01:52.040 --> 00:01:53.780
Not all of them, but a lot.

37
00:01:53.780 --> 00:01:56.920
And because the tracking on the HTC Vive is
so accurate,

38
00:01:56.920 --> 00:01:59.360
we can do things like go in for a close-up
on the laser gun

39
00:01:59.360 --> 00:02:01.160
that I reckon I'm holding right now.

40
00:02:01.160 --> 00:02:03.960
Granted, there's a Vive controller sticking
out of the middle of it,

41
00:02:03.960 --> 00:02:07.350
but the positioning is pretty much perfect.

42
00:02:07.350 --> 00:02:09.470
When you're playing in VR normally,

43
00:02:09.470 --> 00:02:13.700
all the computer needs to output is the view
that you see in the headset.

44
00:02:13.700 --> 00:02:16.500
When we're doing mixed reality, we also output
the view

45
00:02:16.500 --> 00:02:20.840
as seen from this third controller, this virtual
camera.

46
00:02:20.840 --> 00:02:26.480
And so what that gives us is four views instead
of just the one.

47
00:02:26.480 --> 00:02:29.780
The four views are, yes, the headset view
as usual,

48
00:02:29.780 --> 00:02:34.480
we also see the background, as seen from the
perspective of this virtual camera,

49
00:02:34.480 --> 00:02:36.420
and then we have two layers of foreground,

50
00:02:36.420 --> 00:02:40.930
one of them is the image itself, everything
that should appear in front of the player,

51
00:02:40.930 --> 00:02:44.990
and then we have just a luma layer to help
you key out the black space.

52
00:02:44.990 --> 00:02:48.819
The SteamVR plugin automatically selects the
foreground and the background

53
00:02:48.819 --> 00:02:50.850
based on the position of the headset.

54
00:02:50.850 --> 00:02:56.270
And anything that is between the headset and
the third controller is foreground

55
00:02:56.270 --> 00:03:00.100
and anything that's beyond the headset becomes
background.

56
00:03:00.100 --> 00:03:04.290
Here in our studio, we're doing a live composite
on the fly.

57
00:03:04.290 --> 00:03:08.590
And this is a rough idea of what you'll get
in your final edit.

58
00:03:08.590 --> 00:03:11.440
The live composite is a bit rough around the
edges,

59
00:03:11.440 --> 00:03:14.110
but you can also take the original assets

60
00:03:14.110 --> 00:03:18.620
and do a much more detailed composite in post-production
later.

61
00:03:18.620 --> 00:03:21.260
Now, virtual studios aren't a new thing.

62
00:03:21.260 --> 00:03:23.950
The BBC have been using one for election night
for years,

63
00:03:23.950 --> 00:03:26.320
although it uses carefully pre-arranged graphics,

64
00:03:26.320 --> 00:03:28.440
lots of expensive broadcast-quality equipment,

65
00:03:28.440 --> 00:03:33.470
and the host has to rehearse and hit all their
marks exactly for things to look right.

66
00:03:33.470 --> 00:03:36.770
And let's face it, replace this headset with
a Helmet of Justice

67
00:03:36.770 --> 00:03:40.580
and you've got 1990s British kids show Knightmare.

68
00:03:40.580 --> 00:03:43.180
All those were fancy, custom-built affairs,
though:

69
00:03:43.180 --> 00:03:45.830
this uses more off-the-shelf components.

70
00:03:45.830 --> 00:03:47.300
If you want to do this at home,

71
00:03:47.300 --> 00:03:51.000
you're going to need a large, wrap-around
green screen,

72
00:03:51.000 --> 00:03:52.490
but you could paint your walls!

73
00:03:52.490 --> 00:03:54.430
You're going to need a very powerful computer,

74
00:03:54.430 --> 00:03:58.080
you'll need a camera that can feed a signal
back into your computer,

75
00:03:58.080 --> 00:04:00.980
you're going to need a capture card and third
controller,

76
00:04:00.980 --> 00:04:03.590
but if you have all of those things,

77
00:04:03.590 --> 00:04:05.790
you can build a mixed reality setup at home!

78
00:04:05.790 --> 00:04:08.910
Thanks to everyone at YouTube Space New York,
and the Mixed Reality Lab.

79
00:04:08.910 --> 00:04:11.830
You can find out more about them at the links
in the description.

80
00:04:16.540 --> 00:04:17.720
(Are you going to keep the bump?)

81
00:04:17.720 --> 00:04:18.420
(That's actually...!)

82
00:04:18.420 --> 00:04:19.420
Yeah, that's nice!

83
00:04:19.420 --> 00:04:20.420
All right, that's good!

84
00:04:21.689 --> 00:04:22.310
That's a wrap!