00:02

Okay, I have recorded this already.

00:05

It was way too long, so I'm gonna try keep it short,

00:08

but there's a lot of information here.

00:10

So here it goes.

00:12

I've been looking into double masking

00:15

and this looks like a lot of work for double masking.

00:20

And it obviously looks a little scary,

00:23

so I'm going to try, take you through it

00:25

and in a quick way show you my thinking.

00:29

So basically where I started was kind of like

00:32

looking into how we mask in our current app.

00:36

And at the moment we actually have two ways to mask.

00:40

The first one is by using the green screen mask layouts

00:44

and the second one, which can sometimes achieve

00:46

the same result and alongside here,

00:49

is by using the portrait bulges and kind of like playing

00:52

with this background and this foreground,

00:57

these little toggles and these sliders.

01:00

And so what I kind of realized by doing this

01:02

is that you can actually get some really interesting

01:05

looking layouts in the app at the moment,

01:08

but to do that and to get to these results

01:11

is really complicated with this kind of interaction.

01:15

And I feel like we should remove this completely.

01:18

I think that this is a lot of power,

01:23

but I don't think that the user needs to see this.

01:26

And it definitely shouldn't be the only way

01:28

for them to get to these results.

01:30

So it kind of got me thinking like we have this

01:33

current portrait filter way of masking.

01:35

And when I think about masking, I think about cutout,

01:38

I think about portrait, I think about background removal

01:43

and those kinds of words.

01:45

And I can't help but think that the masking concept

01:49

belongs more in the portrait filter

01:52

or like the cutout effect area

01:55

more than it belongs in the layout area.

01:57

And so that's kind of where my thinking started to begin.

02:03

Especially because this is a picture and picture layout,

02:06

but it has a portrait mask on it.

02:09

And you can kind of achieve that same green screen layout

02:12

using this tool.

02:15

So I also then kind of delved into like, well,

02:18

before thinking about how to do this,

02:21

like what are we actually trying to achieve

02:24

and what sort of look would we want to actually achieve

02:27

with double masking?

02:28

Like what kind of cool look does that do,

02:32

especially for a portrait video?

02:34

So I started playing around with some styles here,

02:36

which you can see just to kind of gauge

02:40

like what ingredients would we need?

02:42

I think the one thing that came out quite apparently

02:45

for me in this was the canvas background.

02:48

When you cut out two people,

02:50

you kind of left with that blank space behind you.

02:53

And what do we do with that?

02:56

And how do we make that cool?

02:58

And one of the things I thought would be really cool

03:00

is these like blurry backgrounds

03:02

that take primary colors from your sources

03:05

to make it feel like it all belongs together.

03:08

And there was some more interesting things explored here

03:12

around like potentially, you know,

03:14

not when you apply a shape.

03:16

Maybe it's not to both sources.

03:18

Maybe it's just two one.

03:20

Maybe there's sometimes a circle

03:22

but the other one's not a circle, things like that.

03:24

And then also like shadows were really interesting

03:27

and colors.

03:30

Yeah, so just moving on quickly,

03:32

what I kind of like, I came up with quite a few insights

03:36

and I thought the one thing that was interesting

03:38

to think about was what's going to make double masking

03:42

and exciting and discoverable feature.

03:45

And these were some of the things I came up with.

03:47

Better canvas backgrounds was one

03:50

because when I'm masking two people,

03:52

what's behind them becomes really important.

03:55

Better layouts combining the two segmented people.

03:58

So like now that people are cut out,

03:59

like how do they work together,

04:02

especially in a portrait sense so that it looks cool.

04:06

Depth effects like shadows, so when you're,

04:08

you know, when you're cut out,

04:09

you kind of maybe want to create that depth.

04:12

Matching of colors, so when you have backgrounds

04:16

that you need to use, can we be smart

04:18

about using the right colors so that it looks like it's cohesive?

04:23

Very much simplifying the experience.

04:25

So I think that with our current way

04:28

of using portrait filters is very complicated.

04:31

And I feel like that's where we need to simplify a lot,

04:34

especially if double masking is going to live there.

04:38

And then also potentially being able to start

04:41

with something so like if we communicate this feature

04:44

and we show people like what kind of videos you can get,

04:49

how will they go from that goal of like,

04:52

I want a video that looks like that

04:54

to downloading IAP and then getting to that in a faster way.

04:59

And potentially there's a way to start with a certain look

05:02

so that that connection is a little bit more seamless.

05:06

Cool.

05:07

So the key thing to kind of take in at this point

05:13

is that what I've decided to do is put masking

05:17

as a concept within a effects tool,

05:21

a portrait effects tool, and keep masking out of layout.

05:26

So I think layout is about positioning of your sources.

05:29

So I'm choosing where are they going to be.

05:32

And then portrait effects and shape effects

05:35

are more these like visual changes to my sources

05:38

that are kind of bringing it to life.

05:40

So I thought that within the portrait effects,

05:43

we could have the double masking

05:45

or the masking of sources,

05:47

potentially the segmentation with the blur background,

05:51

potentially choosing a color for your source background.

05:54

And I think things in here could,

05:57

we could add the AI stuff in here,

05:59

we could add some more filters as a category in here.

06:02

Essentially what this is is like the visual look of your video

06:06

and layout would be like this foundational aspect

06:09

that kind of informs a lot of what you do later.

06:11

So like layout is just kind of where they are placed

06:15

and there's not really like a cut out effect in that tool.

06:19

And then the canvas is where we could be smart

06:22

and kind of provide some really cool backgrounds

06:25

that actually work with a cut out effect.

06:28

And then one other thing that I thought would be interesting

06:31

to explore is like using these toggles on the canvas

06:34

for really simple actions such as adding a shadow.

06:38

So for example, like if you toggled this on and off,

06:41

you would get this shadow on the segment,

06:43

you can't really see it here,

06:44

but here's a better example.

06:46

You would get the shadow and if you toggled it off,

06:47

you wouldn't and the same for potentially the layout.

06:52

You could toggle a shadow on an actual layout canvas

06:55

or a frame.

06:57

So you could kind of play with shadows

06:59

to create depth in the sense,

07:01

but this is like not double masking.

07:03

This is kind of just like thinking about

07:05

how to take double masking into a very cool looking role.

07:10

But yeah, that would be like a little additional thing.

07:15

Yeah, so the thing I want to show you essentially is

07:21

how would someone jump into the app

07:23

and get from this very standard side by side layout.

07:26

So they've recorded a multiplayer video

07:30

and they want to really make it look super cool.

07:32

So they want to take it from that to this,

07:35

how would they get there?

07:38

So what they would do is go,

07:39

well, let me change my layout.

07:41

So they might go, okay, I'd rather prefer to have one person

07:45

being in one person small.

07:47

Then next to that, I think we should have effect

07:50

and inside effect, I would be able to then visually

07:53

style my video.

07:54

So I could add a mask and mask both people.

07:59

I could potentially use a segmented blur

08:02

so the background of the sources would blur.

08:04

I could potentially use a color.

08:06

I would have to think about how the color works here,

08:08

but I could maybe change the color of the background

08:11

of the actual source.

08:13

And I could maybe potentially toggle

08:16

which source gets that particular effect.

08:19

So maybe I don't want the mask on all of them.

08:21

I could actually toggle which one gets it.

08:23

So if I wanted just a green screen with a person here,

08:27

I could actually choose this one and then toggle

08:32

the mask so that it only applies to one source.

08:36

And then with shape, I would be able to then also choose

08:39

like visual changes such as a fade shape

08:41

or rounded edges or circular or device

08:45

really depends on whether you've chosen a mask or not,

08:47

whether these some of these are gonna look good.

08:50

But shape would kind of like stay the same

08:52

and be within the effects tool.

08:56

Just because it feels like it's more of a visual thing here.

09:00

Yeah, and I could also potentially toggle a shadow.

09:03

So this was another toggle where I could toggle

09:06

a shadow on and off which would then apply

09:08

to the segmented view in this particular tool.

09:14

And then in order to now that I've changed my layout

09:18

and have applied effects to my sources,

09:20

I would then wanna change the canvas.

09:23

So in this instance, I think with our current options,

09:27

it would be very unrelated to what is actually happening here.

09:32

So any of these options would kind of just look

09:35

quite strange and I think people would struggle

09:39

to find something cool here versus something like this

09:42

where we could potentially use the information

09:45

from the sources to generate some really cool backgrounds

09:48

here that actually look like they might be in context.

09:52

I think that would help us or help the user

09:56

to create a really interesting effect.

09:58

And so now they've gone from this very boring side by side

10:03

layout to this very interesting cool looking

10:07

double-mossed layout.

10:09

And then the one other thing that I thought would be

10:13

an interesting approach as well is to think about

10:16

how people start in the app.

10:18

So as you can see, even with all of those steps,

10:20

it's quite a lot of steps to get from what we would do

10:24

with Multiplayer, which is like,

10:25

those standard sources with their backgrounds

10:27

to something visually interesting.

10:30

And I thought maybe starting with a few presets would be cool.

10:35

So maybe when you start, you have your goals,

10:38

but you also have some layouts or some ways to kind of

10:41

like set the fade, I mean, set the shape and the mask

10:46

and the canvas backgrounds, et cetera, before you even start.

10:51

So you kind of like set up with something that's really cool.

10:54

In this context, these are all Multiplayer.

10:56

So that wouldn't really work.

10:57

I think we would have to have some single player layouts in here.

11:01

But maybe when you tap to this Multiplayer icon,

11:04

there could be, while you're waiting for your guest

11:06

to join or inviting your guest,

11:07

you could actually select a layout that works

11:10

or a look that works for your video

11:13

and then it would kind of use those presets.

11:16

Yeah, but they thought like maybe a starting point

11:18

like this could be interesting too.

11:20

Yeah, and that's where I am so far.

11:25

Hopefully this is not as long as it was before,

11:28

trying to keep it short.

11:30

There's a lot of information in here,

11:32

but yeah, would love any thoughts on that approach so far.

11:35

I think in a nutshell, what I would like to do

11:38

is just really simplify portrait filters

11:41

because I think they're really complicated at the moment

11:44

and decide that masking is actually something

11:47

that lives within portrait and layout

11:50

is kind of the separate placing of the different sources.

11:55

Yeah, let me know what you think. Thanks.