"WEBVTTKind: captionsLanguage: entoday I just wanted to share a few things I have been working on lately so this is using the real time API to actually try to build an agent that we can use on our computer and how this could change how we operate computers in the future so we are using function calling with the realtime API so this means that we can create a bunch of functions that can do actions on our computer just by using our voice so you can see some of the functions I have created here so we have open up the browser navigate the browser scroll up scroll down we have added a open notepad function that can write notes to our notepad uh yeah right to notepad uh take an analyze screenshot so we take a screenshot send it to gp4 O for analysis to get like the content back uh write on screen so we can use voice to write copy text paste text and these are all the functions I have uh done so far so I just wanted to make this video like a uh yeah preview of what's to come so let me just show you how this works now so if we fire up this now good morning Ava could you go to YouTube please good morning Chris sure I can help with that going to YouTube going to YouTube okay that's great I also need to go to Hacker News let's head over to hackernews going there now yeah great uh I might have to copy some text here on Hacker News uh could you help me with that I'll let you know when I've highlighted some text here of course Chris just let me know when you've highlighted the text you want to copy and I'll assist you with the rest okay I highlighted some text uh use the copy text uh function please I've already copied the text you highlighted is there anything else you'd like okay that's great now open up a notepad please paste the text okay that's good could you just summarize this into like one sentence the text you just pasted please certainly the text describes a new hugging face repo featuring melam 7B instruct v1.5 a Greek large language model and introduces Lama file a format by Milla oo that packages an entire okay so I had to cut that short because it was very annoying but you can see here uh we did a function call right openup youtube.com we did a second function call hacker news.com and this is the way it works so we basically call the functions we have in our code just by using the voice right and it's pretty cool and you can add a a bunch of different functions here so this is just going to be uh a preview of what I have tested out so far so the next part of the video is just going to be me sitting in my chair and just testing out this uh I try a few different things uh found it pretty interesting but there's a lot more to explore here so yeah hope you enjoyed it hope this give you some inspiration I would love to hear if you have any cool things you think I should add here so yeah like I said a lot to explore uh hope you enjoyed it and yeah we speak soon I wanted to do a bit of python learning could you go to YouTube for me just give me one suggestion for a YouTube channel that has good videos on learning python a great YouTube channel for learning python is Corey Schaffer he has a wide range of tutorials on python programming from beginner to Advanced topics check out his channel for some quality python content yeah so I'm looking at his channel now could you screenshot this could you write the code from the video into a notepad could you copy it paste okay that was pretty cool but could we actually do this without using the sort function could we do it like without using like a shortcut sure you can sort a list manually without using the sort function here's a simple way to do it using a bubble sort algorithm write the bubble sort to the notepad paste it now you can kind of explain the differences here sure in Python the do sort method or the sorted function is a built-in way to sort lists they are highly optimized and implemented in C making them much faster than most manual sorting algorithms they also offer additional functionality such as specifying a custom key for sorting on the other hand the bubble sort algorithm is a simple manually implemented sorting technique it repeatedly steps through the list Compares adjacent elements and swaps them if they are in the wrong order could you go to hacker news.com please I believe you meant to https colher news.com yeah I was reading like a blog post here it says John Cormac could you tell me like on a very high level who he is John carmac is a renowned programmer and video game developer he's best known for his work in developing groundbreaking 3D Graphics in video games particularly as the co-founder of ID software carac played a key role in the creation of popular games like Doom quake and Wolfenstein 3 use the screenshot function so I just wanted you to explain this uh figure here for me how reasoning works but just do it very high level and speak very fast sure the figure illustrates reasoning in AI models over three conversation turns one the model receives an input green box process it using internal reasoning gray box and produces an output blue box two another input is given prompting further reasoning and output generation three a third input leads to reasoning and output but with a truncated output Red Box indicating a shortened response the diagram shows how reasoning helps AI models process inputs and generate outputs in a structured way okay thanks that that was pretty good I like that one you're welcome I'm glad you found it helpful if you have any other questions feel free to ask I have highlighted some text on the screen could you copy it from this code here uh what is a good next test we could write given the code snippet a good next test could be to verify that the generate code function returns a string of the correct length write that text to my notepad paste in the text you copied there's an error message for my code uh how can I fix this just give me a short answer he error occurs because the random module is not imported to fix this add import random at ah okay I see let me fix that it says I don't have the string defined to fix the error that string is not defined you need to import the string module add import string at the top of your script along with the import random line okay yeah that worked now it works now I generate a land random string here okay thank you you're welcome I'm glad it's working now hello how can I help you today let's start by opening up youtube.com sure let's open up YouTube please give me a moment take a screenshot of this so in this video I'm watching there's this blue or purple an orange crab here do you know what kind of crab this is based on the description of a crab with a vibrant purple claw and an orange body it could be a Halloween crab also known known as a gearus quadratus these crabs are known for their distinct and striking coloration commonly found in Central America yeah I think it does but just to confirm this let's do uh open up a Google Search google.com with the name of the crab in the URL uh query it says here that the Halloween crab is also known as blackback land crab is that correct yes that's correct the Halloween crab scientifically known as garus quadratus is also referred to as the blackback land crab due to the dark coloration on its carpes it is known for its striking coloration resembling the colors of Halloween in the same video I can see this guy he has these plastic bottles that is kind of filled up with some water inside I think it's salt water it's out in the sand here do you know why this why he does this in survival situations using plastic bottles filled with salt water and placing them in the sand might be an attempt to create a solar still this is a method to desalinate salt water turning it into drinkable fresh water here's how it generally works 100% a hole is dug in the sand and a container is placed in the center to collect fresh water 200% salt water is is added around the container not inside it alternatively damp sand can be used I found this video here from Lex fredman do you know if he has a homepage yes Lex Freedman has a homepage you can find it at Lex Freedman docomo to that web page scroll down UPF is there anything else you'd like to on this web page go to Lex freed man.com podcast I can see he has a podcast here uh with cursor could you do a search on google.com with the search query cursor AI okay go to cursor. comom scroll down a bit up again go to cursor. comom Features I selected all the text here could you copy this tell me on kind of high level what is the cursor features cursor offers features to help you build software faster powerful auto complete cursor predicts your your next edits suggesting code changes across multiple lines based on your recent modifications multi-line edits and smart rewrites IT suggests multiple edits at once and fixes mistakes in your code cursor prediction predicts your next cursor position for smooth code navigation seven AI chat with an AI that understands your codebase helping with questions and bug identification six codebase answerstoday I just wanted to share a few things I have been working on lately so this is using the real time API to actually try to build an agent that we can use on our computer and how this could change how we operate computers in the future so we are using function calling with the realtime API so this means that we can create a bunch of functions that can do actions on our computer just by using our voice so you can see some of the functions I have created here so we have open up the browser navigate the browser scroll up scroll down we have added a open notepad function that can write notes to our notepad uh yeah right to notepad uh take an analyze screenshot so we take a screenshot send it to gp4 O for analysis to get like the content back uh write on screen so we can use voice to write copy text paste text and these are all the functions I have uh done so far so I just wanted to make this video like a uh yeah preview of what's to come so let me just show you how this works now so if we fire up this now good morning Ava could you go to YouTube please good morning Chris sure I can help with that going to YouTube going to YouTube okay that's great I also need to go to Hacker News let's head over to hackernews going there now yeah great uh I might have to copy some text here on Hacker News uh could you help me with that I'll let you know when I've highlighted some text here of course Chris just let me know when you've highlighted the text you want to copy and I'll assist you with the rest okay I highlighted some text uh use the copy text uh function please I've already copied the text you highlighted is there anything else you'd like okay that's great now open up a notepad please paste the text okay that's good could you just summarize this into like one sentence the text you just pasted please certainly the text describes a new hugging face repo featuring melam 7B instruct v1.5 a Greek large language model and introduces Lama file a format by Milla oo that packages an entire okay so I had to cut that short because it was very annoying but you can see here uh we did a function call right openup youtube.com we did a second function call hacker news.com and this is the way it works so we basically call the functions we have in our code just by using the voice right and it's pretty cool and you can add a a bunch of different functions here so this is just going to be uh a preview of what I have tested out so far so the next part of the video is just going to be me sitting in my chair and just testing out this uh I try a few different things uh found it pretty interesting but there's a lot more to explore here so yeah hope you enjoyed it hope this give you some inspiration I would love to hear if you have any cool things you think I should add here so yeah like I said a lot to explore uh hope you enjoyed it and yeah we speak soon I wanted to do a bit of python learning could you go to YouTube for me just give me one suggestion for a YouTube channel that has good videos on learning python a great YouTube channel for learning python is Corey Schaffer he has a wide range of tutorials on python programming from beginner to Advanced topics check out his channel for some quality python content yeah so I'm looking at his channel now could you screenshot this could you write the code from the video into a notepad could you copy it paste okay that was pretty cool but could we actually do this without using the sort function could we do it like without using like a shortcut sure you can sort a list manually without using the sort function here's a simple way to do it using a bubble sort algorithm write the bubble sort to the notepad paste it now you can kind of explain the differences here sure in Python the do sort method or the sorted function is a built-in way to sort lists they are highly optimized and implemented in C making them much faster than most manual sorting algorithms they also offer additional functionality such as specifying a custom key for sorting on the other hand the bubble sort algorithm is a simple manually implemented sorting technique it repeatedly steps through the list Compares adjacent elements and swaps them if they are in the wrong order could you go to hacker news.com please I believe you meant to https colher news.com yeah I was reading like a blog post here it says John Cormac could you tell me like on a very high level who he is John carmac is a renowned programmer and video game developer he's best known for his work in developing groundbreaking 3D Graphics in video games particularly as the co-founder of ID software carac played a key role in the creation of popular games like Doom quake and Wolfenstein 3 use the screenshot function so I just wanted you to explain this uh figure here for me how reasoning works but just do it very high level and speak very fast sure the figure illustrates reasoning in AI models over three conversation turns one the model receives an input green box process it using internal reasoning gray box and produces an output blue box two another input is given prompting further reasoning and output generation three a third input leads to reasoning and output but with a truncated output Red Box indicating a shortened response the diagram shows how reasoning helps AI models process inputs and generate outputs in a structured way okay thanks that that was pretty good I like that one you're welcome I'm glad you found it helpful if you have any other questions feel free to ask I have highlighted some text on the screen could you copy it from this code here uh what is a good next test we could write given the code snippet a good next test could be to verify that the generate code function returns a string of the correct length write that text to my notepad paste in the text you copied there's an error message for my code uh how can I fix this just give me a short answer he error occurs because the random module is not imported to fix this add import random at ah okay I see let me fix that it says I don't have the string defined to fix the error that string is not defined you need to import the string module add import string at the top of your script along with the import random line okay yeah that worked now it works now I generate a land random string here okay thank you you're welcome I'm glad it's working now hello how can I help you today let's start by opening up youtube.com sure let's open up YouTube please give me a moment take a screenshot of this so in this video I'm watching there's this blue or purple an orange crab here do you know what kind of crab this is based on the description of a crab with a vibrant purple claw and an orange body it could be a Halloween crab also known known as a gearus quadratus these crabs are known for their distinct and striking coloration commonly found in Central America yeah I think it does but just to confirm this let's do uh open up a Google Search google.com with the name of the crab in the URL uh query it says here that the Halloween crab is also known as blackback land crab is that correct yes that's correct the Halloween crab scientifically known as garus quadratus is also referred to as the blackback land crab due to the dark coloration on its carpes it is known for its striking coloration resembling the colors of Halloween in the same video I can see this guy he has these plastic bottles that is kind of filled up with some water inside I think it's salt water it's out in the sand here do you know why this why he does this in survival situations using plastic bottles filled with salt water and placing them in the sand might be an attempt to create a solar still this is a method to desalinate salt water turning it into drinkable fresh water here's how it generally works 100% a hole is dug in the sand and a container is placed in the center to collect fresh water 200% salt water is is added around the container not inside it alternatively damp sand can be used I found this video here from Lex fredman do you know if he has a homepage yes Lex Freedman has a homepage you can find it at Lex Freedman docomo to that web page scroll down UPF is there anything else you'd like to on this web page go to Lex freed man.com podcast I can see he has a podcast here uh with cursor could you do a search on google.com with the search query cursor AI okay go to cursor. comom scroll down a bit up again go to cursor. comom Features I selected all the text here could you copy this tell me on kind of high level what is the cursor features cursor offers features to help you build software faster powerful auto complete cursor predicts your your next edits suggesting code changes across multiple lines based on your recent modifications multi-line edits and smart rewrites IT suggests multiple edits at once and fixes mistakes in your code cursor prediction predicts your next cursor position for smooth code navigation seven AI chat with an AI that understands your codebase helping with questions and bug identification six codebase answers\n"