Lunch Meeting at Liberty Cafe

Today's lunch meeting with Tom is scheduled at Liberty Cafe. The weather forecast indicates that it will be mostly sunny and 71 degrees, making for a pleasant outdoor dining experience. As part of the arrangements, the directions to Liberty Cafe have been sent to the attendee's car via Car Skill.

Upcoming Review with Cyrus

The next quarterly review with Cyrus Neff is scheduled for Tuesday, June 11th at 10:00 a.m. Additionally, a dry run meeting with Benjamin McIntosh has been arranged for Friday prior to the review. The attendees confirm that this schedule works for them.

Spatial Collaboration App Demonstration

A demonstration of the new spatial collaboration app will be held by the Spatial team. They aim to show how their customers, including Mattel's ID eights design and collaborate across global borders on multiple brands such as Hot Wheels, Barbie, and Fisher-Price. The session is scheduled to take place after lunch.

Using Microsoft Teams for Mixed Reality

The presenter starts the session by jumping onto their PC and logging into a team's channel. They post an update and show how it can be upgraded to a live spatial meeting using the spatial tab in Teams. The presenter then clicks on the spatial tab, allowing them to see everyone in the room. Since they are wearing a HoloLens, they switch from a 2D screen to a 3D meeting experience.

Joining with Hololens

The presenter invites Amanda to join the virtual meeting by scanning a QR code using their HoloLens. The avatar of Amanda appears in the room, and all content that was posted on the team channel is displayed on the wall. Amanda confirms her presence in the virtual space.

Using Hand Tracking Capabilities

Amanda comments on the hand tracking capabilities of the new Mixed Reality Toolkit. The presenter then uses these capabilities to pull up a holographic image of the Sky Justice 3D model, which they can zoom and manipulate in 3D space.

Freehand Annotation and Accessory

The presenter introduces freehand annotation capabilities and gives Amanda some virtual accessories, such as a bracelet. The attendees appreciate the interactive features of this new app.

Joining from a PC

Lynn joins the meeting remotely via their PC connected to Teams via the spatial tab. They confirm that they can easily browse and upload content directly from their laptop. Lynn invites Jacob to join them by using Azure Spatial Anchors, which allows for hardware-agnostic participation in the virtual experience.

"WEBVTTKind: captionsLanguage: enmorning good morning and welcome to build 2019 it's fantastic to see you all in Seattle you know build has always had a very special meaning for me I remember they distinctly be in the audience in 1991 at our very first developer conference and that's when I decided to join Microsoft and ever since I've marked the passage of time and life and tech paradigms and so it's great to be back here at build and talking about technology now one service I wanted to showcase today is the Azure speech service now not only is the speech service getting better and better when it comes to speech recognition in fact what you'll see in this demo is even for commodity hardware to replace any complex micro array set up so that your speech recognition is world-class so imagine a transcript that gets created that has the ability to understand the local jargon that's specific to your organization your industry the bad way making the transcript that much more useful so let's throw it to our team out on the gallery to show you speech translation and transcription today my colleagues and I are going to give you a demo of new research that we believe will make meeting transcriptions more easily available to everyone in the future we are going to show you this demo using just the microphones built into this laptop and these two smartphones we have in front of us with these we create a microphone array in the cloud that enables after speech services to provide accurate in person meeting transcription even without a special meeting device also you'll notice that I didn't bring my phone but the service can still recognize my voice and correctly identify me because I've given it permission to use my voice print to transcribe what I say now the second thing we're going to show you is that the language model of our speech service can be trained on the data and your company's Microsoft 365 tenant so can learn the unique vocabulary of your end this tree or company this is available in private preview today most of these assistants are command systems where you have to invoke these skills one at a time what if we can imagine a future where you can cross domains without having to invoke each skill by name so what is a true multi domain assistant we need a multi agent word the idea that you're always going to start with one wake word and one assistant it's just not like how we start on the web for example just imagine what is what is an open assistant future look like similar to an open web that's what we want to really ensure happens when it comes to the personal assistants what do I have today here's what your day looks like today you have take a walk outside at 8 a.m. dear one-on-one with Anjali at 10 a.m. lunch with Tom at noon and your app kick off at 3 p.m. go ahead and reschedule my walk just Amaro at the same time sure I can move take a walk outside - tomorrow at 8 a.m. is that right yeah that sounds great ok I've moved it to tomorrow I'm scheduled cram session with Nicholas and his manager from 9 to 1:30 today and we're gonna need a room in Bellevue oh ok I'll invite Nicholas Cohn and Michelle Estes to the cram session and I'll put your meeting in city centre - 605 does that look good to you yeah and push back my one-on-one with Anjali - tomorrow alright I've booked your meeting and here are a couple of options to meet with Anjali bot tomorrow is there anything later in the day let's see how about this one yeah that'll work and is she invited to the apt kick-off this afternoon no she's not on the invite no please send it to her ok I've forwarded the app kickoff to Anjali Bhatt oh right after my last meeting today's special thirty minutes to pick up a birthday cake sure pick up the birthday cake at 4:00 p.m. is that right yep I remind me where is my lunch meeting today lunch with Tom is at Liberty Cafe what's the weather goingto be like it'll be mostly sunny and 71 degrees at Liberty cafe at noon today can we get outside there yes Liberty Cafe has outdoor seating and can you send directions to my car connecting to car skill sure directions to Liberty cafe have been sent to your car when's our next review with Cyrus your next quarterly review with Cyrus Neff on e is Tuesday June 11th at 10:00 a.m. schedule to our dry run with Benjamin McIntosh the Friday before that all right does this work for you yep that looks great I've scheduled your dry run with Benjamin thank you happy to help I'm excited to show you our fellow developers how we at spatial been able to enrich our existing holographic collaboration app with hololens to measure spatial anchors the Microsoft graph and teams we're going to show you how our customer Mattel ID eights designs and collaborates across global borders on multiple brands that we all know and love like Hot Wheels Barbie and fisher-price let's take a look so I'm gonna jump onto my PC here and I'm already in a team's channel and I can see Amanda's posted some cool new content but why don't we upgrade this to a live spatial meeting to get everyone on the same page I'm actually just gonna click over to the spatial tab in teams and I get this really cool 3d dollhouse view I'm going to click into the room where I can see everybody but since I have a hall lens too here why don't I take this off a 2d screen into a 3d meeting all I have to do is scan the QR code in the corner I'll put on the device and scan the code here we go hey Amanda what's up it looks like you're already in here yep I'm here in my office also wearing a hololens too so you'll see me in the room show up as an avatar and all of our content that you just saw from that team channel is already up here on the wall you can even see some of the comments things to the Microsoft graph API cool and with the new finger hand tracking in hololens - it's so easy to quickly triage content so I can quickly just grab a document off the wall and toss it right up there on our shared workspace so we can all take a look and if I want Amanda to check out something I can just pull it off the wall and toss it to her what do you think of that one Amanda wow that looks great and just to recap what happened here I grabbed a holographic image on the wall as a real person in this room and threw it to an avatar who could be anywhere in the world wow this is awesome now with a new hand tracking capabilities in the mixed reality toolkit I can also have this cool new hand doc so let's pull it up and it lets me pull up content from a variety of locations like my onedrive I'm just going to scroll the 3d models that are stored on and select sky justice there we go and let's make this life-sized and soon this up a little bigger and you know Amanda I'm thinking why don't we show off the new freehand annotation capabilities and give her some accessories absolutely I think she really could use a bracelet and of course the finishing touch a hololens everyone needs a hololens awesome oh hey Lynn it looks like clintus joins hey everyone I love this joining from my PC I'm still able to participate in the experience even without a hololens so are you ready to see what I've been working on yeah let's check it out since I've joined from my laptop via the spatial tab in teams you saw earlier I can easily browse and upload content directly from my PC and upload it to the meeting check out this 3d model of a hover pad this is cool you know Amanda since this is mixed reality why don't you jump in and give it a spin of course let's try it out wow it's even cooler on the inside now that's spacious a Hardware agnostic platform you don't need just a headset to join the experience let me invite Jacob onto the stage that was going to show you how you can join from the device in your pocket oh oh this is so dope I love it great work Lynn with Azure spatial anchors this mixed reality experience here's a map across hololens and a our kit and a our core this means that I could have the most immersive experience on a hololens or I can use this Android phone here to not only see what everyone else is seeing but actively participate and modify the content as well nice thanks guys solid meeting and really looking forward to showing this the rest the team tomorrowmorning good morning and welcome to build 2019 it's fantastic to see you all in Seattle you know build has always had a very special meaning for me I remember they distinctly be in the audience in 1991 at our very first developer conference and that's when I decided to join Microsoft and ever since I've marked the passage of time and life and tech paradigms and so it's great to be back here at build and talking about technology now one service I wanted to showcase today is the Azure speech service now not only is the speech service getting better and better when it comes to speech recognition in fact what you'll see in this demo is even for commodity hardware to replace any complex micro array set up so that your speech recognition is world-class so imagine a transcript that gets created that has the ability to understand the local jargon that's specific to your organization your industry the bad way making the transcript that much more useful so let's throw it to our team out on the gallery to show you speech translation and transcription today my colleagues and I are going to give you a demo of new research that we believe will make meeting transcriptions more easily available to everyone in the future we are going to show you this demo using just the microphones built into this laptop and these two smartphones we have in front of us with these we create a microphone array in the cloud that enables after speech services to provide accurate in person meeting transcription even without a special meeting device also you'll notice that I didn't bring my phone but the service can still recognize my voice and correctly identify me because I've given it permission to use my voice print to transcribe what I say now the second thing we're going to show you is that the language model of our speech service can be trained on the data and your company's Microsoft 365 tenant so can learn the unique vocabulary of your end this tree or company this is available in private preview today most of these assistants are command systems where you have to invoke these skills one at a time what if we can imagine a future where you can cross domains without having to invoke each skill by name so what is a true multi domain assistant we need a multi agent word the idea that you're always going to start with one wake word and one assistant it's just not like how we start on the web for example just imagine what is what is an open assistant future look like similar to an open web that's what we want to really ensure happens when it comes to the personal assistants what do I have today here's what your day looks like today you have take a walk outside at 8 a.m. dear one-on-one with Anjali at 10 a.m. lunch with Tom at noon and your app kick off at 3 p.m. go ahead and reschedule my walk just Amaro at the same time sure I can move take a walk outside - tomorrow at 8 a.m. is that right yeah that sounds great ok I've moved it to tomorrow I'm scheduled cram session with Nicholas and his manager from 9 to 1:30 today and we're gonna need a room in Bellevue oh ok I'll invite Nicholas Cohn and Michelle Estes to the cram session and I'll put your meeting in city centre - 605 does that look good to you yeah and push back my one-on-one with Anjali - tomorrow alright I've booked your meeting and here are a couple of options to meet with Anjali bot tomorrow is there anything later in the day let's see how about this one yeah that'll work and is she invited to the apt kick-off this afternoon no she's not on the invite no please send it to her ok I've forwarded the app kickoff to Anjali Bhatt oh right after my last meeting today's special thirty minutes to pick up a birthday cake sure pick up the birthday cake at 4:00 p.m. is that right yep I remind me where is my lunch meeting today lunch with Tom is at Liberty Cafe what's the weather goingto be like it'll be mostly sunny and 71 degrees at Liberty cafe at noon today can we get outside there yes Liberty Cafe has outdoor seating and can you send directions to my car connecting to car skill sure directions to Liberty cafe have been sent to your car when's our next review with Cyrus your next quarterly review with Cyrus Neff on e is Tuesday June 11th at 10:00 a.m. schedule to our dry run with Benjamin McIntosh the Friday before that all right does this work for you yep that looks great I've scheduled your dry run with Benjamin thank you happy to help I'm excited to show you our fellow developers how we at spatial been able to enrich our existing holographic collaboration app with hololens to measure spatial anchors the Microsoft graph and teams we're going to show you how our customer Mattel ID eights designs and collaborates across global borders on multiple brands that we all know and love like Hot Wheels Barbie and fisher-price let's take a look so I'm gonna jump onto my PC here and I'm already in a team's channel and I can see Amanda's posted some cool new content but why don't we upgrade this to a live spatial meeting to get everyone on the same page I'm actually just gonna click over to the spatial tab in teams and I get this really cool 3d dollhouse view I'm going to click into the room where I can see everybody but since I have a hall lens too here why don't I take this off a 2d screen into a 3d meeting all I have to do is scan the QR code in the corner I'll put on the device and scan the code here we go hey Amanda what's up it looks like you're already in here yep I'm here in my office also wearing a hololens too so you'll see me in the room show up as an avatar and all of our content that you just saw from that team channel is already up here on the wall you can even see some of the comments things to the Microsoft graph API cool and with the new finger hand tracking in hololens - it's so easy to quickly triage content so I can quickly just grab a document off the wall and toss it right up there on our shared workspace so we can all take a look and if I want Amanda to check out something I can just pull it off the wall and toss it to her what do you think of that one Amanda wow that looks great and just to recap what happened here I grabbed a holographic image on the wall as a real person in this room and threw it to an avatar who could be anywhere in the world wow this is awesome now with a new hand tracking capabilities in the mixed reality toolkit I can also have this cool new hand doc so let's pull it up and it lets me pull up content from a variety of locations like my onedrive I'm just going to scroll the 3d models that are stored on and select sky justice there we go and let's make this life-sized and soon this up a little bigger and you know Amanda I'm thinking why don't we show off the new freehand annotation capabilities and give her some accessories absolutely I think she really could use a bracelet and of course the finishing touch a hololens everyone needs a hololens awesome oh hey Lynn it looks like clintus joins hey everyone I love this joining from my PC I'm still able to participate in the experience even without a hololens so are you ready to see what I've been working on yeah let's check it out since I've joined from my laptop via the spatial tab in teams you saw earlier I can easily browse and upload content directly from my PC and upload it to the meeting check out this 3d model of a hover pad this is cool you know Amanda since this is mixed reality why don't you jump in and give it a spin of course let's try it out wow it's even cooler on the inside now that's spacious a Hardware agnostic platform you don't need just a headset to join the experience let me invite Jacob onto the stage that was going to show you how you can join from the device in your pocket oh oh this is so dope I love it great work Lynn with Azure spatial anchors this mixed reality experience here's a map across hololens and a our kit and a our core this means that I could have the most immersive experience on a hololens or I can use this Android phone here to not only see what everyone else is seeing but actively participate and modify the content as well nice thanks guys solid meeting and really looking forward to showing this the rest the team tomorrow\n"