**NVIDIA's NDI HX: A New Era for Streamers**

In recent times, streamers have been looking for ways to improve their streaming setup without sacrificing too much performance on their devices. NVIDIA has recently released its NDI HX technology, which aims to alleviate the CPU overhead associated with screen capture and encoding. This technology allows streamers to use a separate computer as a capture device, reducing the load on their primary machine.

The NDI HX solution uses NVIDIA's Invinc encoder to offload the heavy lifting of encoding from the GPU, resulting in a significant reduction in performance impact. According to NVIDIA, this results in a theoretical 5-6% hit on gaming performance while streaming with NDI versus previous methods and against streaming on the same computer.

**Testing the NDI HX Technology**

To put the NDI HX technology to the test, I set up a separate capture device using an NVIDIA graphics card. The goal was to see how well the new technology would hold up in real-world scenarios, particularly when it came to 4K 120 FPS streaming.

I started by testing the technology with Rainbow Six Siege, playing normally and then running it with NDI HX enabled. In this scenario, I saw a 4% hit on frame rate compared to normal gameplay. However, when playing at 60 Hz in Modern Warfare 2019, the performance hit was more significant, with only around 2-3% impact on average frame rates.

In contrast, streaming everything on my primary computer using OBS and a webcam, with overlays and other visual effects, resulted in a full 16% performance hit. This demonstrates just how much of an improvement NDI HX can offer for streamers looking to reduce their performance impact.

**Implications for Streamers**

The implications of this technology are significant for streamers who want to improve their streaming setup without sacrificing too much performance on their devices. By using a separate capture device, streamers can significantly reduce the load on their primary machine, allowing them to maintain high frame rates and minimize lag.

Furthermore, NDI HX offers an attractive alternative to traditional capture cards, which often come with significant performance overhead. This is particularly true for those who use powerful hardware, such as high-end graphics cards, to power their stream.

**The Future of NDI HX**

While the technology is still in its early stages, it has already shown promising results in several tests. However, there are some potential issues that need to be addressed before it can be fully released to the public.

One area where I encountered some difficulties was with performance during high-intensity games, such as Modern Warfare 2019 at 4K resolution. In these scenarios, the technology still resulted in a slight performance hit, although it was still smoother than streaming everything on my primary computer.

I also encountered an issue with OBS running as administrator, which is required to take full advantage of the Invinc encoder's performance benefits. However, I was told that this is likely due to a GPU priority issue that NVIDIA is working to resolve.

**Conclusion**

The NDI HX technology has shown significant promise for streamers looking to improve their streaming setup without sacrificing too much performance on their devices. By reducing CPU overhead and offloading encoding from the GPU, streamers can significantly reduce the load on their primary machine.

While there are still some potential issues that need to be addressed before it can be fully released, the benefits of NDI HX make it an attractive option for those looking to improve their streaming setup. As NVIDIA continues to develop and refine this technology, we can expect to see even more exciting features and capabilities in the future.

**Future Features and Developments**

One area where I'm particularly excited about is the potential for NVIDIA's Video Effects SDK (VESD). This SDK allows developers to create custom video effects that can be used in streamers' software. While it's still in its early stages, VESD has already shown some incredible capabilities, including face tracking and other advanced features.

As OBS and other streamer software start to integrate with the VESD API, we can expect to see even more impressive graphics and visual effects in streams. This will require some development work from the OBS team, but it's an exciting prospect for those who want to take their streaming setup to the next level.

**Stay Tuned**

I'll be keeping a close eye on the NDI HX technology as it continues to develop, and I'll have more videos and updates in the future. If you're interested in staying up-to-date with the latest developments, be sure to hit the like button, subscribe to my channel, and check out our sponsor links below.

**Sponsor Links**

[Insert sponsor links here]

**Stay Connected**

To stay connected with me on social media, be sure to follow me on Twitter, Instagram, and Facebook. I'll be sharing more updates, behind-the-scenes peeks, and general tech-related goodness in the coming weeks and months.

**The Future of Streaming**

The future of streaming is an exciting one, with new technologies and innovations emerging all the time. As a streamer myself, I'm passionate about exploring these developments and bringing them to my audience.

Whether you're a seasoned pro or just starting out, there's never been a better time to get involved in the world of streaming. With tools like NDI HX and VESD on the horizon, we can expect to see even more impressive graphics, visual effects, and overall streaming experiences.

Stay tuned for more updates from me in the coming weeks and months. I'll be sharing my thoughts on the latest developments, as well as providing tips, tricks, and general advice for streamers looking to improve their setup.

"WEBVTTKind: captionsLanguage: eni'm recording this video clip into my gh5s directly with no computer involved no rtx graphics card in during the recording process and yet i'm able to cut out the server fan noise from my server right here just like this and it's gone how am i doing that i'm gonna show you in today's video talking about a new update of source of sorts a new technology release from nvidia at gtc today or at least at the time of recording it's pretty cool i'm eposvox your stream professor and in this video we're covering a couple new technologies and previewing them that are coming to streamers from nvidia that they just announced this morning slash in five hours i'm recording this at 4am that nvidia's working on that they just announced at gtc they've got some cool stuff coming down the pipeline and i get a chance to preview it here for you guys uh however all of this is early access it is still very much a work in progress some of this is not coming out for months but i got the opportunity to share it with you and share the exciting things that are going on and so i want to work through that with you the things that we are looking at are rtx voice is coming as a vst filter to apply in real time in other software other than just the pass-through audio device option which means you can do it in post as well as i just showed you i'll show you how to do that we've got ndi getting invinc support to reduce the cpu overhead and make it a lot easier for streamers to actually stream 4k 60 4k 120 or just in general from pc to pc without the need of a capture card reducing the streaming overhead compared to streaming on the same computer pretty cool and then they also have a couple new technologies coming in the new video effects sdk and we'll talk about what that means as we progress through this but since i opened with it i want to go ahead and show you the audio effects sdk so what this is is basically the tools that nvidia has already released to us or have teased at twitchcon 2019 with regards to rtx voice the rtx green screen and if you remember at twitchcon they actually tease some augmented reality stuff and things like that those are part of their new streaming effects suites and there's audio effects and then there is video effects and what comes from that will of course be the nvidia broadcast app that i already showed you i already walked through it if you missed that check my video link in the video description but along with that they are releasing sdks that provide access to all of these tools for other programs to implement which means we'll see programs like obs studio streamlabs obs xsplit potentially video editors like adobe premiere pro or davinci resolve ideally all of these will eventually implement these sdks to allow you access so theoretically in the future this is not coming right now but theoretically in the future i could do the rtx green screen in post in my video editor of choice assuming they implement it both adobe and davinci at this point are very slow to implement certain things so who knows but i am hopeful and i'll keep pushing for it and we immediately get to demo here rtx voice as from the audio effects sdk here in a video editor and an audio editor now you require two things and i have zamar's blog post linked in the video description below that explains all this you will need the audio effects sdk for your graphics card architecture which will require either touring or ampere so rtx 20 series or 30 series sorry gtx users you're being left out here it was never built for that technology anyway no need to install the sdk for your graphics card and then you will need the specific audio fx plug-in from zamar himself now this is the developer who built the stream fx plug-ins for obs studio which added a lot of custom encoders a lot of cool shader effects stuff i still want to dive in he's actually taking on the mantle of developing this and he's doing it all on himself so i will recommend you go check out his patreon because you know he's not really getting paid for this by anybody and we need to be paying him i believe i'm a patron if not i will be signing back up because i was at one point um and i definitely recommend supporting him because he one person doing all this work is pretty crazy now currently this is only available as a vst 3 plugin which means that you are limited in the software that supports it unfortunately for me that includes davinci resolve i saw when i was researching this i saw a ton of forum posts asking why the heck davinci resolve doesn't support vst3 plugins but it just doesn't as of october 2020 hopefully in 17 it might get support but i don't know neither does obs studio at the moment so you can't apply it in obs which is unfortunate but zamar is working on developing a vst2.x version of the plugin as well so that eventually you'll be able to use it in your the rest of your software of choice however adobe software and most audio software worth a darn will actually support it as well so in adobe premiere pro once you have installed the plugins and installed the uh sdk you'll need to reboot your machine and then open up adobe premiere pro go to edit preferences audio this is going to take a minute because premiere freezes at everything i do anymore i really don't like using premiere anymore all right once your audio preference is open 10 minutes later click audio plugins manager and go ahead and click scan for plugins and you shouldn't have to do anything else it should automatically detect and you see at the bottom here xamar voice fx click okay if this doesn't show up for you you either didn't install the sdk or you forgot to reboot after you did it and that was the necessary step for me now click ok import your footage as i have done here and go ahead and identify the part you wish to edit i've already applied the effect so i will remove it here go ahead and go to audio effects vst3 and then i believe it is under restoration xamar here and then nvidia voice removal now currently there are no options so if you click edit or whatever their tiny little box there's no parameters to change however those will come in time as development continues but at the moment it's just on or off and honestly it's magic like you saw it at the intro clip it is pretty freaking cool however i am personally running into an issue with premiere pro where it crashes upon export if i play it back and it's gone how am i doing that i'm gonna show you today totally fine no issues however the second i export it crashes once it finishes the export and the audio in the export is all staticky and messed up just like this and it's gone how am i doing that i'm gonna show you in today's video talking about a new this could 100 be an issue isolated to my rokin premiere pro config because i have the worst luck with premiere these days or something else but again full note all of this is very beta work in progress there is a lot more development to be done on all the tools i'll show you here today this is just the first round so they could show what they've been working on however you will have much better results in adobe audition for all i know premiere pro doesn't even have proper support for vst3 plugins they just kind of throw them in my air conditioner is kicking on along with that loud server but i will be editing all of my video all of my audio for this video through rtx voice through audition in this way so the second way is with adobe audition or your audio editor of choice i'm showing it you it with audition again drag in your footage audition has a little mpeg importer so it's fine i'm going to export so i only have the channel i want to edit you go to effects and then audio plugin manager scan for plugins it'll find it you're good to go go to effects vst3 restorations amr nvidia voice removal and just click apply give it a second and wham bam look at all that background noise gone heck yeah then you can save it out sync it up with your video because it'll be the same length so you just block out your old audio and you're good to go and that is it like that that's all that's required for rtx voice in other programs i'm pretty stoked like i said i really hope the vst2 version comes soon because i would love to use it in resolve instead of having to drag my audio into audition but i've had to use that workflow through audition for a long time anyway so it's something i'm kind of used to i cover a lot of tech topics on my channel and i can't always go super in depth on all of them as some are just too far out of my wheelhouse for me to have expertise on them but as an educator i'm always learning i get asked in videos on more hardcore topics like my automation scripting to provide more resources for learning for those that want to get into coding and scripting and things like that for themselves and for that you should check out brilliant brilliant is math and science enrichment learning taking a more active approach to education as many of these skills you really learn by doing rather than listening to someone like me all day they have daily challenges pulled from your ongoing courses that help you you know get a little refresh and get into specific projects each day and provide you with the context and framework to tackle each specific challenge and learn concepts through application you know actually doing the thing if you like a specific problem and want to you know dive deeper they have more they have quizzes and more ways to get more detail about that specific problem and if you get stuck or are having trouble with it there's a community of thousands of learners talking about each problem and providing solutions and ways to help you figure it out rather than just giving you the answers this has been super key to me learning to pick up python to further enhance my projects and my scripts where i usually just put them out there and be like if someone else wants to finish it you can i'm now learning to actually finish my own projects and provide better tools and allows me to engage on what was originally a passing interest of oh that was that would be cool one day to actually learning and developing a new skill to get started mastering your own dream skills head on over to brilliant.org eposvox and sign up for free the first 200 people who sign up with my link will get a 20 discount off their annual premium subscription as well so happy learning now secondly we're getting a video effects sdk as well now a lot of the technology for this is not currently implemented in a way that i can really show you however there are a couple cool things i want to talk about i mentioned the uh ar augmented reality sdk that's for some of the face tracking and kind of you know vtuber stuff that they showed at twitchcon that stuff will be coming it just requires developers to implement it in your software of choice you do however get two cool technologies that i can show you here one is what they're calling super resolution and this is using their ai upscaling tools kind of like what's in the nvidia shield to upscale video playback either in a video player ideally in a video editor however that's not currently present or just what you're watching in a live stream theoretically through nvidia control panel in that it will take and upscale your video with some ai upscaling magic that nvidia uses uh i believe valenis has a video talking about the nvidia shields ai upscaling if so i'll have it linked below um but it ends up making it look a lot cleaner they actually have provided a sample video i don't have a way of testing it manually unfortunately but they did provide a sample video here that shows a 720p two megabit per second stream being super rezzed up to 1440p now all of the original artifacts well not all of them but many of the original artifacts of being limited to two megabits per second for 720p will still be present but they highlight some areas where you can notice some of the added blocking in what should be solid colors and things like that is cleared up there's some chroma artifacting from the process that is cleared up and generally speaking you're getting a now native display 1440p image that looks better than the original 720p upscale this will be useful for upscaling bad video in your video editors uh playing it in like vlc or something and getting it to look a little bit nicely and theoretically depending on how they implement it because some of these features can kind of be thrown in the nvidia control panel and apply to all the video playback theoretically you can enjoy better looking twitch screen streams as a result of it now it's not magic you can still see there's plenty of artifacts based on the limitation but it's that little extra bit of fine-tuning that can kind of make things just look a little bit nicer and depending on the implementation could go a step further the second cool technology i can show you is not video effects related it is ndi related i mentioned this at the beginning ndi has had a lot of updates recently and if you haven't been paying attention to them they released the ndi tools 4.5 update recently and then they're releasing a new update to that with ideally it should be released at the time of uh recording it should already be up but uh implementing the capture hx so there's two types of ndi there's ndi which is just all eye you know losslessly compressed very high quality but uses a lot of bandwidth and then there's ndi hx which uses h.264 encoding to theoretically reduce the bandwidth load or at least give you more bandwidth options but it does use more cpu overhead on your devices this can impact your game streams and things like that they have used screen capture hx on nvidia graphics cards to then use nvidia invinc encoding to take that load off the gpu and what it results in is a theoretical less than six percent or around five to six percent hit on your gaming performance while streaming with ndi versus previous methods and versus streaming on the same computer and i have sort of validated those results now one of the big things that nvidia is hoping to push and test with this is 4k 120 fps streaming where you stream that full 4k 120 experience over your streaming pc and then you can do slow-mo replays and all of this which you can currently which you can't currently do with capture cards tutu there being no hdmi 2.1 capture cards however i did not buy a 4k 120 monitor i thought anyone who bought it before hdmi 2.1 was standardized and before capture cards got it if you're intending on streaming i thought most of you were insane i still believe that and everybody i question about screen tearing when it comes to it because they're forcing the you know scale onto another capture card everyone who says they don't have it i've checked your screen streams you do have it once they come out with hdmi 2.1 and once we get a capture card that can do that i'm actually going to pick up a 4k 120 monitor in the meantime if you don't have a capture card that can do it of course you can now use ndi for it it is pretty cool now again i don't have that monitor so i tested at 4k 60 and the hit from rainbow six siege from just playing normally to running with ndi hx using invinc was only like a four percent hit in frame rate which is still much above even in the lows uh my monitor's refresh rate in this instance um obviously 60 hertz in modern warfare 2019 however we saw only about a two to three percent performance hit on your average frame rate just playing the game versus playing with the ndi stream available whereas streaming everything on that computer using obs you know the webcam the overlays and then streaming that straight to twitch with obs was a full like 16 performance hit so if you're looking for an easy way to implement a second pc to reduce your performance impact the impact of just using this new ndi method versus uh you know actually streaming on a single pc is a significant improvement it's almost negligent and it was already almost negligent before but some people on certain cpus had issues where the cpu encoder would cause a cpu performance problem this is no longer the case um i did however run into some issues again this is kind of work in progress i wasn't too happy with the quality they're supposedly working out and it doesn't seem to have the obs run as admin fix which back when i was originally covering that you know there was a whole gpu priority issue obs had to be unable to run its administrator to then claw back that gpu performance this plagued us for a couple years i announced it last year i'll have a whole video explaining it below one of the ndi engineers actually reached out to me in the comment section to point out that ndi scan converter which was the old ndi capture app at the time still used gpu compositing and thus was still susceptible to the same issue as far as i can tell this is still the case even with the updated ndi capture apps uh in a future video once this is fully released and developed i will cover that more in depth and get clarification on that but from what i can tell the performance still gets a little bit choppy running which is a really intense game model warfare 2019 fully maxed out at 4k you can still drop some frames but overall it's still a very smooth experience and in many cases would be smoother than actually streaming it on that same pc so again everything shown in this video is a work in progress but very very exciting tech for streamers coming soon and i really even though i can't show any of it here at the moment because none of it's ready the stuff that they're doing with the video effects sdk is really freaking cool and so i can't wait for obs and streamlabs obs and zamar and whoever to start implementing some of those crazy features like i am so ready to have rtx optimized like face tracking and things like that because i have had a hell of a time getting snap camera to work with my capture cards and all sorts of things so i am excited i just wanted to share this update with you guys today hope you enjoyed go check out our sponsor hit the like button subscribe for more tech education and stream guides i'm eposvox i'll see you next timei'm recording this video clip into my gh5s directly with no computer involved no rtx graphics card in during the recording process and yet i'm able to cut out the server fan noise from my server right here just like this and it's gone how am i doing that i'm gonna show you in today's video talking about a new update of source of sorts a new technology release from nvidia at gtc today or at least at the time of recording it's pretty cool i'm eposvox your stream professor and in this video we're covering a couple new technologies and previewing them that are coming to streamers from nvidia that they just announced this morning slash in five hours i'm recording this at 4am that nvidia's working on that they just announced at gtc they've got some cool stuff coming down the pipeline and i get a chance to preview it here for you guys uh however all of this is early access it is still very much a work in progress some of this is not coming out for months but i got the opportunity to share it with you and share the exciting things that are going on and so i want to work through that with you the things that we are looking at are rtx voice is coming as a vst filter to apply in real time in other software other than just the pass-through audio device option which means you can do it in post as well as i just showed you i'll show you how to do that we've got ndi getting invinc support to reduce the cpu overhead and make it a lot easier for streamers to actually stream 4k 60 4k 120 or just in general from pc to pc without the need of a capture card reducing the streaming overhead compared to streaming on the same computer pretty cool and then they also have a couple new technologies coming in the new video effects sdk and we'll talk about what that means as we progress through this but since i opened with it i want to go ahead and show you the audio effects sdk so what this is is basically the tools that nvidia has already released to us or have teased at twitchcon 2019 with regards to rtx voice the rtx green screen and if you remember at twitchcon they actually tease some augmented reality stuff and things like that those are part of their new streaming effects suites and there's audio effects and then there is video effects and what comes from that will of course be the nvidia broadcast app that i already showed you i already walked through it if you missed that check my video link in the video description but along with that they are releasing sdks that provide access to all of these tools for other programs to implement which means we'll see programs like obs studio streamlabs obs xsplit potentially video editors like adobe premiere pro or davinci resolve ideally all of these will eventually implement these sdks to allow you access so theoretically in the future this is not coming right now but theoretically in the future i could do the rtx green screen in post in my video editor of choice assuming they implement it both adobe and davinci at this point are very slow to implement certain things so who knows but i am hopeful and i'll keep pushing for it and we immediately get to demo here rtx voice as from the audio effects sdk here in a video editor and an audio editor now you require two things and i have zamar's blog post linked in the video description below that explains all this you will need the audio effects sdk for your graphics card architecture which will require either touring or ampere so rtx 20 series or 30 series sorry gtx users you're being left out here it was never built for that technology anyway no need to install the sdk for your graphics card and then you will need the specific audio fx plug-in from zamar himself now this is the developer who built the stream fx plug-ins for obs studio which added a lot of custom encoders a lot of cool shader effects stuff i still want to dive in he's actually taking on the mantle of developing this and he's doing it all on himself so i will recommend you go check out his patreon because you know he's not really getting paid for this by anybody and we need to be paying him i believe i'm a patron if not i will be signing back up because i was at one point um and i definitely recommend supporting him because he one person doing all this work is pretty crazy now currently this is only available as a vst 3 plugin which means that you are limited in the software that supports it unfortunately for me that includes davinci resolve i saw when i was researching this i saw a ton of forum posts asking why the heck davinci resolve doesn't support vst3 plugins but it just doesn't as of october 2020 hopefully in 17 it might get support but i don't know neither does obs studio at the moment so you can't apply it in obs which is unfortunate but zamar is working on developing a vst2.x version of the plugin as well so that eventually you'll be able to use it in your the rest of your software of choice however adobe software and most audio software worth a darn will actually support it as well so in adobe premiere pro once you have installed the plugins and installed the uh sdk you'll need to reboot your machine and then open up adobe premiere pro go to edit preferences audio this is going to take a minute because premiere freezes at everything i do anymore i really don't like using premiere anymore all right once your audio preference is open 10 minutes later click audio plugins manager and go ahead and click scan for plugins and you shouldn't have to do anything else it should automatically detect and you see at the bottom here xamar voice fx click okay if this doesn't show up for you you either didn't install the sdk or you forgot to reboot after you did it and that was the necessary step for me now click ok import your footage as i have done here and go ahead and identify the part you wish to edit i've already applied the effect so i will remove it here go ahead and go to audio effects vst3 and then i believe it is under restoration xamar here and then nvidia voice removal now currently there are no options so if you click edit or whatever their tiny little box there's no parameters to change however those will come in time as development continues but at the moment it's just on or off and honestly it's magic like you saw it at the intro clip it is pretty freaking cool however i am personally running into an issue with premiere pro where it crashes upon export if i play it back and it's gone how am i doing that i'm gonna show you today totally fine no issues however the second i export it crashes once it finishes the export and the audio in the export is all staticky and messed up just like this and it's gone how am i doing that i'm gonna show you in today's video talking about a new this could 100 be an issue isolated to my rokin premiere pro config because i have the worst luck with premiere these days or something else but again full note all of this is very beta work in progress there is a lot more development to be done on all the tools i'll show you here today this is just the first round so they could show what they've been working on however you will have much better results in adobe audition for all i know premiere pro doesn't even have proper support for vst3 plugins they just kind of throw them in my air conditioner is kicking on along with that loud server but i will be editing all of my video all of my audio for this video through rtx voice through audition in this way so the second way is with adobe audition or your audio editor of choice i'm showing it you it with audition again drag in your footage audition has a little mpeg importer so it's fine i'm going to export so i only have the channel i want to edit you go to effects and then audio plugin manager scan for plugins it'll find it you're good to go go to effects vst3 restorations amr nvidia voice removal and just click apply give it a second and wham bam look at all that background noise gone heck yeah then you can save it out sync it up with your video because it'll be the same length so you just block out your old audio and you're good to go and that is it like that that's all that's required for rtx voice in other programs i'm pretty stoked like i said i really hope the vst2 version comes soon because i would love to use it in resolve instead of having to drag my audio into audition but i've had to use that workflow through audition for a long time anyway so it's something i'm kind of used to i cover a lot of tech topics on my channel and i can't always go super in depth on all of them as some are just too far out of my wheelhouse for me to have expertise on them but as an educator i'm always learning i get asked in videos on more hardcore topics like my automation scripting to provide more resources for learning for those that want to get into coding and scripting and things like that for themselves and for that you should check out brilliant brilliant is math and science enrichment learning taking a more active approach to education as many of these skills you really learn by doing rather than listening to someone like me all day they have daily challenges pulled from your ongoing courses that help you you know get a little refresh and get into specific projects each day and provide you with the context and framework to tackle each specific challenge and learn concepts through application you know actually doing the thing if you like a specific problem and want to you know dive deeper they have more they have quizzes and more ways to get more detail about that specific problem and if you get stuck or are having trouble with it there's a community of thousands of learners talking about each problem and providing solutions and ways to help you figure it out rather than just giving you the answers this has been super key to me learning to pick up python to further enhance my projects and my scripts where i usually just put them out there and be like if someone else wants to finish it you can i'm now learning to actually finish my own projects and provide better tools and allows me to engage on what was originally a passing interest of oh that was that would be cool one day to actually learning and developing a new skill to get started mastering your own dream skills head on over to brilliant.org eposvox and sign up for free the first 200 people who sign up with my link will get a 20 discount off their annual premium subscription as well so happy learning now secondly we're getting a video effects sdk as well now a lot of the technology for this is not currently implemented in a way that i can really show you however there are a couple cool things i want to talk about i mentioned the uh ar augmented reality sdk that's for some of the face tracking and kind of you know vtuber stuff that they showed at twitchcon that stuff will be coming it just requires developers to implement it in your software of choice you do however get two cool technologies that i can show you here one is what they're calling super resolution and this is using their ai upscaling tools kind of like what's in the nvidia shield to upscale video playback either in a video player ideally in a video editor however that's not currently present or just what you're watching in a live stream theoretically through nvidia control panel in that it will take and upscale your video with some ai upscaling magic that nvidia uses uh i believe valenis has a video talking about the nvidia shields ai upscaling if so i'll have it linked below um but it ends up making it look a lot cleaner they actually have provided a sample video i don't have a way of testing it manually unfortunately but they did provide a sample video here that shows a 720p two megabit per second stream being super rezzed up to 1440p now all of the original artifacts well not all of them but many of the original artifacts of being limited to two megabits per second for 720p will still be present but they highlight some areas where you can notice some of the added blocking in what should be solid colors and things like that is cleared up there's some chroma artifacting from the process that is cleared up and generally speaking you're getting a now native display 1440p image that looks better than the original 720p upscale this will be useful for upscaling bad video in your video editors uh playing it in like vlc or something and getting it to look a little bit nicely and theoretically depending on how they implement it because some of these features can kind of be thrown in the nvidia control panel and apply to all the video playback theoretically you can enjoy better looking twitch screen streams as a result of it now it's not magic you can still see there's plenty of artifacts based on the limitation but it's that little extra bit of fine-tuning that can kind of make things just look a little bit nicer and depending on the implementation could go a step further the second cool technology i can show you is not video effects related it is ndi related i mentioned this at the beginning ndi has had a lot of updates recently and if you haven't been paying attention to them they released the ndi tools 4.5 update recently and then they're releasing a new update to that with ideally it should be released at the time of uh recording it should already be up but uh implementing the capture hx so there's two types of ndi there's ndi which is just all eye you know losslessly compressed very high quality but uses a lot of bandwidth and then there's ndi hx which uses h.264 encoding to theoretically reduce the bandwidth load or at least give you more bandwidth options but it does use more cpu overhead on your devices this can impact your game streams and things like that they have used screen capture hx on nvidia graphics cards to then use nvidia invinc encoding to take that load off the gpu and what it results in is a theoretical less than six percent or around five to six percent hit on your gaming performance while streaming with ndi versus previous methods and versus streaming on the same computer and i have sort of validated those results now one of the big things that nvidia is hoping to push and test with this is 4k 120 fps streaming where you stream that full 4k 120 experience over your streaming pc and then you can do slow-mo replays and all of this which you can currently which you can't currently do with capture cards tutu there being no hdmi 2.1 capture cards however i did not buy a 4k 120 monitor i thought anyone who bought it before hdmi 2.1 was standardized and before capture cards got it if you're intending on streaming i thought most of you were insane i still believe that and everybody i question about screen tearing when it comes to it because they're forcing the you know scale onto another capture card everyone who says they don't have it i've checked your screen streams you do have it once they come out with hdmi 2.1 and once we get a capture card that can do that i'm actually going to pick up a 4k 120 monitor in the meantime if you don't have a capture card that can do it of course you can now use ndi for it it is pretty cool now again i don't have that monitor so i tested at 4k 60 and the hit from rainbow six siege from just playing normally to running with ndi hx using invinc was only like a four percent hit in frame rate which is still much above even in the lows uh my monitor's refresh rate in this instance um obviously 60 hertz in modern warfare 2019 however we saw only about a two to three percent performance hit on your average frame rate just playing the game versus playing with the ndi stream available whereas streaming everything on that computer using obs you know the webcam the overlays and then streaming that straight to twitch with obs was a full like 16 performance hit so if you're looking for an easy way to implement a second pc to reduce your performance impact the impact of just using this new ndi method versus uh you know actually streaming on a single pc is a significant improvement it's almost negligent and it was already almost negligent before but some people on certain cpus had issues where the cpu encoder would cause a cpu performance problem this is no longer the case um i did however run into some issues again this is kind of work in progress i wasn't too happy with the quality they're supposedly working out and it doesn't seem to have the obs run as admin fix which back when i was originally covering that you know there was a whole gpu priority issue obs had to be unable to run its administrator to then claw back that gpu performance this plagued us for a couple years i announced it last year i'll have a whole video explaining it below one of the ndi engineers actually reached out to me in the comment section to point out that ndi scan converter which was the old ndi capture app at the time still used gpu compositing and thus was still susceptible to the same issue as far as i can tell this is still the case even with the updated ndi capture apps uh in a future video once this is fully released and developed i will cover that more in depth and get clarification on that but from what i can tell the performance still gets a little bit choppy running which is a really intense game model warfare 2019 fully maxed out at 4k you can still drop some frames but overall it's still a very smooth experience and in many cases would be smoother than actually streaming it on that same pc so again everything shown in this video is a work in progress but very very exciting tech for streamers coming soon and i really even though i can't show any of it here at the moment because none of it's ready the stuff that they're doing with the video effects sdk is really freaking cool and so i can't wait for obs and streamlabs obs and zamar and whoever to start implementing some of those crazy features like i am so ready to have rtx optimized like face tracking and things like that because i have had a hell of a time getting snap camera to work with my capture cards and all sorts of things so i am excited i just wanted to share this update with you guys today hope you enjoyed go check out our sponsor hit the like button subscribe for more tech education and stream guides i'm eposvox i'll see you next timei'm recording this video clip into my gh5s directly with no computer involved no rtx graphics card in during the recording process and yet i'm able to cut out the server fan noise from my server right here just like this and it's gone how am i doing that i'm gonna show you in today's video talking about a new update of source of sorts a new technology release from nvidia at gtc today or at least at the time of recording it's pretty cool i'm eposvox your stream professor and in this video we're covering a couple new technologies and previewing them that are coming to streamers from nvidia that they just announced this morning slash in five hours i'm recording this at 4am that nvidia's working on that they just announced at gtc they've got some cool stuff coming down the pipeline and i get a chance to preview it here for you guys uh however all of this is early access it is still very much a work in progress some of this is not coming out for months but i got the opportunity to share it with you and share the exciting things that are going on and so i want to work through that with you the things that we are looking at are rtx voice is coming as a vst filter to apply in real time in other software other than just the pass-through audio device option which means you can do it in post as well as i just showed you i'll show you how to do that we've got ndi getting invinc support to reduce the cpu overhead and make it a lot easier for streamers to actually stream 4k 60 4k 120 or just in general from pc to pc without the need of a capture card reducing the streaming overhead compared to streaming on the same computer pretty cool and then they also have a couple new technologies coming in the new video effects sdk and we'll talk about what that means as we progress through this but since i opened with it i want to go ahead and show you the audio effects sdk so what this is is basically the tools that nvidia has already released to us or have teased at twitchcon 2019 with regards to rtx voice the rtx green screen and if you remember at twitchcon they actually tease some augmented reality stuff and things like that those are part of their new streaming effects suites and there's audio effects and then there is video effects and what comes from that will of course be the nvidia broadcast app that i already showed you i already walked through it if you missed that check my video link in the video description but along with that they are releasing sdks that provide access to all of these tools for other programs to implement which means we'll see programs like obs studio streamlabs obs xsplit potentially video editors like adobe premiere pro or davinci resolve ideally all of these will eventually implement these sdks to allow you access so theoretically in the future this is not coming right now but theoretically in the future i could do the rtx green screen in post in my video editor of choice assuming they implement it both adobe and davinci at this point are very slow to implement certain things so who knows but i am hopeful and i'll keep pushing for it and we immediately get to demo here rtx voice as from the audio effects sdk here in a video editor and an audio editor now you require two things and i have zamar's blog post linked in the video description below that explains all this you will need the audio effects sdk for your graphics card architecture which will require either touring or ampere so rtx 20 series or 30 series sorry gtx users you're being left out here it was never built for that technology anyway no need to install the sdk for your graphics card and then you will need the specific audio fx plug-in from zamar himself now this is the developer who built the stream fx plug-ins for obs studio which added a lot of custom encoders a lot of cool shader effects stuff i still want to dive in he's actually taking on the mantle of developing this and he's doing it all on himself so i will recommend you go check out his patreon because you know he's not really getting paid for this by anybody and we need to be paying him i believe i'm a patron if not i will be signing back up because i was at one point um and i definitely recommend supporting him because he one person doing all this work is pretty crazy now currently this is only available as a vst 3 plugin which means that you are limited in the software that supports it unfortunately for me that includes davinci resolve i saw when i was researching this i saw a ton of forum posts asking why the heck davinci resolve doesn't support vst3 plugins but it just doesn't as of october 2020 hopefully in 17 it might get support but i don't know neither does obs studio at the moment so you can't apply it in obs which is unfortunate but zamar is working on developing a vst2.x version of the plugin as well so that eventually you'll be able to use it in your the rest of your software of choice however adobe software and most audio software worth a darn will actually support it as well so in adobe premiere pro once you have installed the plugins and installed the uh sdk you'll need to reboot your machine and then open up adobe premiere pro go to edit preferences audio this is going to take a minute because premiere freezes at everything i do anymore i really don't like using premiere anymore all right once your audio preference is open 10 minutes later click audio plugins manager and go ahead and click scan for plugins and you shouldn't have to do anything else it should automatically detect and you see at the bottom here xamar voice fx click okay if this doesn't show up for you you either didn't install the sdk or you forgot to reboot after you did it and that was the necessary step for me now click ok import your footage as i have done here and go ahead and identify the part you wish to edit i've already applied the effect so i will remove it here go ahead and go to audio effects vst3 and then i believe it is under restoration xamar here and then nvidia voice removal now currently there are no options so if you click edit or whatever their tiny little box there's no parameters to change however those will come in time as development continues but at the moment it's just on or off and honestly it's magic like you saw it at the intro clip it is pretty freaking cool however i am personally running into an issue with premiere pro where it crashes upon export if i play it back and it's gone how am i doing that i'm gonna show you today totally fine no issues however the second i export it crashes once it finishes the export and the audio in the export is all staticky and messed up just like this and it's gone how am i doing that i'm gonna show you in today's video talking about a new this could 100 be an issue isolated to my rokin premiere pro config because i have the worst luck with premiere these days or something else but again full note all of this is very beta work in progress there is a lot more development to be done on all the tools i'll show you here today this is just the first round so they could show what they've been working on however you will have much better results in adobe audition for all i know premiere pro doesn't even have proper support for vst3 plugins they just kind of throw them in my air conditioner is kicking on along with that loud server but i will be editing all of my video all of my audio for this video through rtx voice through audition in this way so the second way is with adobe audition or your audio editor of choice i'm showing it you it with audition again drag in your footage audition has a little mpeg importer so it's fine i'm going to export so i only have the channel i want to edit you go to effects and then audio plugin manager scan for plugins it'll find it you're good to go go to effects vst3 restorations amr nvidia voice removal and just click apply give it a second and wham bam look at all that background noise gone heck yeah then you can save it out sync it up with your video because it'll be the same length so you just block out your old audio and you're good to go and that is it like that that's all that's required for rtx voice in other programs i'm pretty stoked like i said i really hope the vst2 version comes soon because i would love to use it in resolve instead of having to drag my audio into audition but i've had to use that workflow through audition for a long time anyway so it's something i'm kind of used to i cover a lot of tech topics on my channel and i can't always go super in depth on all of them as some are just too far out of my wheelhouse for me to have expertise on them but as an educator i'm always learning i get asked in videos on more hardcore topics like my automation scripting to provide more resources for learning for those that want to get into coding and scripting and things like that for themselves and for that you should check out brilliant brilliant is math and science enrichment learning taking a more active approach to education as many of these skills you really learn by doing rather than listening to someone like me all day they have daily challenges pulled from your ongoing courses that help you you know get a little refresh and get into specific projects each day and provide you with the context and framework to tackle each specific challenge and learn concepts through application you know actually doing the thing if you like a specific problem and want to you know dive deeper they have more they have quizzes and more ways to get more detail about that specific problem and if you get stuck or are having trouble with it there's a community of thousands of learners talking about each problem and providing solutions and ways to help you figure it out rather than just giving you the answers this has been super key to me learning to pick up python to further enhance my projects and my scripts where i usually just put them out there and be like if someone else wants to finish it you can i'm now learning to actually finish my own projects and provide better tools and allows me to engage on what was originally a passing interest of oh that was that would be cool one day to actually learning and developing a new skill to get started mastering your own dream skills head on over to brilliant.org eposvox and sign up for free the first 200 people who sign up with my link will get a 20 discount off their annual premium subscription as well so happy learning now secondly we're getting a video effects sdk as well now a lot of the technology for this is not currently implemented in a way that i can really show you however there are a couple cool things i want to talk about i mentioned the uh ar augmented reality sdk that's for some of the face tracking and kind of you know vtuber stuff that they showed at twitchcon that stuff will be coming it just requires developers to implement it in your software of choice you do however get two cool technologies that i can show you here one is what they're calling super resolution and this is using their ai upscaling tools kind of like what's in the nvidia shield to upscale video playback either in a video player ideally in a video editor however that's not currently present or just what you're watching in a live stream theoretically through nvidia control panel in that it will take and upscale your video with some ai upscaling magic that nvidia uses uh i believe valenis has a video talking about the nvidia shields ai upscaling if so i'll have it linked below um but it ends up making it look a lot cleaner they actually have provided a sample video i don't have a way of testing it manually unfortunately but they did provide a sample video here that shows a 720p two megabit per second stream being super rezzed up to 1440p now all of the original artifacts well not all of them but many of the original artifacts of being limited to two megabits per second for 720p will still be present but they highlight some areas where you can notice some of the added blocking in what should be solid colors and things like that is cleared up there's some chroma artifacting from the process that is cleared up and generally speaking you're getting a now native display 1440p image that looks better than the original 720p upscale this will be useful for upscaling bad video in your video editors uh playing it in like vlc or something and getting it to look a little bit nicely and theoretically depending on how they implement it because some of these features can kind of be thrown in the nvidia control panel and apply to all the video playback theoretically you can enjoy better looking twitch screen streams as a result of it now it's not magic you can still see there's plenty of artifacts based on the limitation but it's that little extra bit of fine-tuning that can kind of make things just look a little bit nicer and depending on the implementation could go a step further the second cool technology i can show you is not video effects related it is ndi related i mentioned this at the beginning ndi has had a lot of updates recently and if you haven't been paying attention to them they released the ndi tools 4.5 update recently and then they're releasing a new update to that with ideally it should be released at the time of uh recording it should already be up but uh implementing the capture hx so there's two types of ndi there's ndi which is just all eye you know losslessly compressed very high quality but uses a lot of bandwidth and then there's ndi hx which uses h.264 encoding to theoretically reduce the bandwidth load or at least give you more bandwidth options but it does use more cpu overhead on your devices this can impact your game streams and things like that they have used screen capture hx on nvidia graphics cards to then use nvidia invinc encoding to take that load off the gpu and what it results in is a theoretical less than six percent or around five to six percent hit on your gaming performance while streaming with ndi versus previous methods and versus streaming on the same computer and i have sort of validated those results now one of the big things that nvidia is hoping to push and test with this is 4k 120 fps streaming where you stream that full 4k 120 experience over your streaming pc and then you can do slow-mo replays and all of this which you can currently which you can't currently do with capture cards tutu there being no hdmi 2.1 capture cards however i did not buy a 4k 120 monitor i thought anyone who bought it before hdmi 2.1 was standardized and before capture cards got it if you're intending on streaming i thought most of you were insane i still believe that and everybody i question about screen tearing when it comes to it because they're forcing the you know scale onto another capture card everyone who says they don't have it i've checked your screen streams you do have it once they come out with hdmi 2.1 and once we get a capture card that can do that i'm actually going to pick up a 4k 120 monitor in the meantime if you don't have a capture card that can do it of course you can now use ndi for it it is pretty cool now again i don't have that monitor so i tested at 4k 60 and the hit from rainbow six siege from just playing normally to running with ndi hx using invinc was only like a four percent hit in frame rate which is still much above even in the lows uh my monitor's refresh rate in this instance um obviously 60 hertz in modern warfare 2019 however we saw only about a two to three percent performance hit on your average frame rate just playing the game versus playing with the ndi stream available whereas streaming everything on that computer using obs you know the webcam the overlays and then streaming that straight to twitch with obs was a full like 16 performance hit so if you're looking for an easy way to implement a second pc to reduce your performance impact the impact of just using this new ndi method versus uh you know actually streaming on a single pc is a significant improvement it's almost negligent and it was already almost negligent before but some people on certain cpus had issues where the cpu encoder would cause a cpu performance problem this is no longer the case um i did however run into some issues again this is kind of work in progress i wasn't too happy with the quality they're supposedly working out and it doesn't seem to have the obs run as admin fix which back when i was originally covering that you know there was a whole gpu priority issue obs had to be unable to run its administrator to then claw back that gpu performance this plagued us for a couple years i announced it last year i'll have a whole video explaining it below one of the ndi engineers actually reached out to me in the comment section to point out that ndi scan converter which was the old ndi capture app at the time still used gpu compositing and thus was still susceptible to the same issue as far as i can tell this is still the case even with the updated ndi capture apps uh in a future video once this is fully released and developed i will cover that more in depth and get clarification on that but from what i can tell the performance still gets a little bit choppy running which is a really intense game model warfare 2019 fully maxed out at 4k you can still drop some frames but overall it's still a very smooth experience and in many cases would be smoother than actually streaming it on that same pc so again everything shown in this video is a work in progress but very very exciting tech for streamers coming soon and i really even though i can't show any of it here at the moment because none of it's ready the stuff that they're doing with the video effects sdk is really freaking cool and so i can't wait for obs and streamlabs obs and zamar and whoever to start implementing some of those crazy features like i am so ready to have rtx optimized like face tracking and things like that because i have had a hell of a time getting snap camera to work with my capture cards and all sorts of things so i am excited i just wanted to share this update with you guys today hope you enjoyed go check out our sponsor hit the like button subscribe for more tech education and stream guides i'm eposvox i'll see you next time\n"