Mixed Reality Headset 'Removal' with Google Research

Soon after the launch of the Tilt Brush Artist in Residence program, fellow VR artist Steve Teeps and I were asked by the Google Research and Daydream Labs team to participate in some brand spankin new technology for mixed reality! It's best if you see it here, as explained by Tom Small and Avneesh Sud: Here's a visual breakdown of what all the different phases look like:

1. Green Screen Video: this is what it looks like to ppl on the outside when I'm painting in VR.
2. Virtual Environment: I can set the VR camera to show my painting and where I am in that space (the glowy Vive controllers), but still doesn't effectively depict what is going on.
3. Traditional Mixed Reality Output: this shows my VR painting and me in the shot. But the VR headset is isolating and blocks the human connection aspects of this.
4. Mixed Reality + Headset Removal: the Google Research team overlayed my eyes on top of the headset! You can SEE me again! :D

Here's a moving image example:

You can read all about this on Google's blog here:

Google Research and Daydream Labs: Seeing eye to eye in mixed reality

For more specifics of how Avneesh Sud and Christian Frueh pulled off this magic, read all about it on the Google Research Blog here: Headset “Removal” for Virtual and Mixed Reality (The above images and video originated from these Google blog posts.)

Thanks so much again, Google, for asking me to help out! I had a blast with the YouTube and Research teams! A few friends have joked that Teeps and I have literally become the face of the face of VR. hahaha

Behind the Scenes!

Sharing with my 96-year-old Grandma ^-^

Even more crazy is that my dad found me in the Chinese newspaper! I didn't believe him at first, thinking he was talking about the general 'you', perhaps speaking about any VR related stuff.

Nope. That's me! This was the moment my immigrant parents finally realized that what I'm doing is actual legitimate (because the Chinese newspaper is, like, the bible, amirite?). We showed my 96 year old grandma the newspaper article. This is also the moment when she realized that I'm doing something big, too.

Grandma is the sweetest. She smiles, cackles her signature laugh, and gives me a thumbs up. And what was the first thing she has to say after seeing all this in the newspaper?

"Oh, you didn't wear sleeves!" 

<3

Tilt Brush Butterfly Metamorphosis

When I had the very honoring opportunity to join Tilt Brush for their Artist in Residence program, I knew I had to make something different, and that this would be one of my biggest VR pieces yet.

Designing My Problem:

• I had to design something within Tilt Brush.
• I wanted to create something that other people weren't doing.
• I wanted to create a piece that utilizes the Tilt Brush playback feature.
• I wanted to create a meaningful piece that was more than just a pretty picture; I wanted people to experience both the technology and something magical. It should be something anyone can view and understand. It needed to touch the hearts of the viewer.

Searching and Working Towards My Solution:

• Everyone making pieces in Tilt Brush were making really jawdropping finished pieces. The finished pieces were the main focus of the art. I needed to do something different. I needed to create a piece that focused on the PROCESS rather than the finish. That is, the process and growth of the piece needed to be much more interesting than just viewing it as one static image.
• It needed to be a narrative in some way. It didn't need to be a crazy complex thing. It just needed to show something GROW. Like a normal storytelling narrative, it needed a beginning, a middle, an end. Super basic, super fundamental for anyone to understand. No learning or backstory necessary.

• It needed to feel like the piece was appearing out of thin air, it needed to be MAGIC. So I planned it out, the painting process / choreography. It needed to be seamless. It needed to LOOK effortless. It's like hiding the strings to a magic trick — I had to conceal my secret for how I did it. People WANT to believe in magic. People WANT to be dazzled and amazed. So I played on this.
• Lastly, it needed a personal message. As an illustrator/image maker, I know the best ones are when I draw from my own experience. I went thru a lot of reformative changes in the last few years, a LOT of letting go, a LOT of reshaping. Yes seeing a butterfly emerge is cool to see, but it needed the personal touch to really wrap it all together to show the PURPOSE of the piece. This is the part that touches people's heart. It's not just another pretty painting — there is MEANING behind the content, the process, the message that makes it ALL beautiful in one cohesive piece.
• The butterfly metamorphosis was the best process that fit ALL of these. It's simple. Everyone knows it. Everyone has gone thru changes, or they will at some point.

How Did I Paint It?

• I spent several days planning out the composition, the look and feel, and how I would paint it all in order. I can't understate the amount of planning necessary.
• A few trial runs followed.
• Then one go at the final piece!
• The Tilt Brush playback feature shows every stroke in the order of how you paint the piece. I had to paint each phase step by step — this was indeed a narrative and performative piece!

More:

My piece is also featured in the Tilt Brush showcase (in the app) and on the Tilt Brush Artist in Residence page.

You can read more about the Tilt Brush AiR program's inception here in this NYT article.

Student Leadership Award Speech

Our system has encountered an error. This exception has been automatically logged and reported. M6L7SFR3P478J42LB5ME

During my graduating term at Art Center College of Design, I was awarded the Student Leadership Award. Thank you, students, faculty, and staff! Which... also means I had to give a speech at my graduation. OY! This was one of my proudest moments, but also sooo nerve-racking.

I evidently made a mistake and said I was 25 when I started Art Center. I was 28. -_-. Thank you, Ray Quirolgico, for the lovely intro. Miss you lots. :)

Re-emerging from a four year hermit hole

Hello, World! My, oh, my. Attending Art Center was no easy feat. Since I found out I got admitted to the college in early 2012, I made a conscious decision to cut out a lot of things in order to fully commit and focus on my intense new program.

A lot happened, and I ended up cutting out a lot of things I never anticipated to. I guess that's what happens when you go into a rigorous grad-esque program. But I'm grateful to say that I came out with a better idea of who I am, my intentions in life, and how I want to continue on with the rest of my life.

I know. Total esoteric shit.

I matured a lot in a short amount of time. And I became very familiar with my creative self and her process. You learn a lot about your raw self when you can only get four hours of sleep every night. ;)

As I was left the web design/development world in late 2011, a lot of things have naturally progressed in the web world. Not to mention all the new technologies that have emerged since then, too. I find myself behind in learning things like git, javascript, SVG, and oh wut ppl don't use Wordpress as much anymore? I am an absolute dinosaur now.

But!! I've picked up some amazing new skills along the way, I swear!

• I'm frickin bomb at drawing and painting by hand now!
• I frequently create sketchbooks and prints!
• One of my pieces was published in Comic-con International's publication!
• I've learned how to sell my artwork at conventions and shows!
• I've been trained by top Disney art directors and artists, and I can whip out concept art pieces for entertainment!
• My school awarded me the Student Leadership Award (they just wanted me to stop asking questions, get outta their hair, or something). More about this soon. :)
• I managed to setup and showcase one of my pieces in virtual reality (VR) at my graduating show. (Second person from my school to ever do so, following the exceptional Ashley Pinnick; First person to do so with an HTC Vive!)

There's a lot to catch up on. And part of my un-hermit-ing will include documenting and sharing more about my process again.

Monkey Derek Zoolander Paper Toy — Free PDF Download!

papertoy-05

In the spirit of Zoolander 2's release week, I'm sharing a project I did a few years ago: a paper toy of monkey Derek! Please play responsibly; don't bring to freak gasoline fights.

Click here to download the Monkey Derek PDF (252 KB). Happy Zoolander week! <3