PCIe-based Drives: A Theoretical and Real-World Exploration

As we embark on this journey, it's clear that one of the three expansion slots running off of the second CPU is occupied by a PCIe x16 quad U.2 cart. This setup allows us to harness the full potential of our system, with four native ports utilizing different connectors on the motherboard itself, all running off the first CPU. These ports then feed into the back planes behind the banks of drives, providing a robust infrastructure for our storage needs.

A Quad 10 Gigabit Network Card: Upgrading in the Future

The quad 10 gigabit network card that we showcased earlier will undoubtedly play a pivotal role in this system's performance. While it may seem like an excessive upgrade at present, having such capabilities in the future is always a consideration. For now, though, our primary focus lies with optimizing and configuring our storage solutions.

Assembly Time: Installing the Drives

With all the drives installed, we're left to marvel at their sheer number. Each drive is secured with four screws, ensuring they remain firmly in place. As we move the system to the test bench, it becomes clear that this behemoth of a machine is not for the faint of heart.

Network Connections and Performance

The test bench setup allows us to fully immerse ourselves in the performance capabilities of our storage solutions. With 16x PCIe Gen 3 connections, we're theoretically capable of achieving incredible speeds – a staggering 2,800 megabytes per second on our RAID 0 configuration. This figure far surpasses our expectations and serves as a testament to the raw power of this system.

Real-World Results: Disk Management and Read/Write Speeds

Within the realm of reality, we find ourselves faced with the daunting task of configuring our storage solutions. We've opted for a RAID 0 setup on our Z drive, leveraging an AddO configuration with a Q-depth of 10 to unlock its full potential.

AddO, a software solution designed to optimize storage performance, has proven itself to be an invaluable tool in this endeavor. As we push the limits of our system's capabilities, we're able to achieve unprecedented read and write speeds – exceeding 9,000 megabytes per second on our Z drive alone. This figure is nothing short of remarkable, with some peaks reaching over 12.7 gigabytes per second.

A New Year and a Fresh Perspective

As the year comes to a close, it's an opportune moment to reflect on the progress made and set new goals for the future. One such resolution involves embracing healthier eating habits and exploring the world of cooking through Blue Apron – a service that delivers fresh ingredients and chef-designed recipes right to your doorstep.

Blue Apron offers two distinct plans – the Two-Person Plan and the Family Plan – with no commitment required. Meals can be prepared in under 40 minutes, making this an ideal solution for busy households. With its focus on quality suppliers and refrigerated delivery boxes, ensuring ingredients remain fresh even when not at home is a top priority.

A Word of Appreciation

As we conclude this video, we'd like to extend our gratitude to those who have supported us throughout this journey. For those who've found this content informative or entertaining, your likes and subscriptions mean the world to us. Don't forget to check out our other channels and explore the links provided in the video description – including our merch store and community forum.

A Glimpse into the Future

As we bid farewell for now, it's impossible not to wonder what the future holds. Perhaps a daring stunt involving fan removal or replacement will be the next step. Whatever lies ahead, one thing is certain: this system has already left an indelible mark on our collective imagination.

"WEBVTTKind: captionsLanguage: enthey're finally here just wait i got my 24 pcie ssds for my new storage server come on let's go build it if you haven't seen nerd sports yet check it out all the episodes are available now for free over at youtube.com channel superfun but before we begin we are going to need some supplies first a bare bones server from supermicro the ssg2028r nr48n i guess we'll just roll it there quad 10 gigabit network card 64 gigs of ram dual 2699 v4 222 core cpus time for boring inventory reconciliation oh i've had that in the wrong field damn it i was scanning the wrong barcodes and time for fun again everybody on board the insane train what better place to build this new machine than our shiny new b-roll set all i'll need is a screwdriver and maybe a table time for my favorite activity shocking drives oh this is gonna take a while 24 nvme pcie ssds each rated at a theoretical up to 250 with another zero 2 500 megabytes per second reads and 1200 megabytes per second right and we are going to take all these bad boys and we're going to put them in a gigantic raid array oh no cut but how on earth do you run nvme drives in raid the answer is this very special bare bones machine from super micro in fact this box can handle not just 24 but 48 nvme drives giving us the capacity to without changing the model of drives that we're using have up to about 50 terabytes of solid-state storage in a single box and did i even mention that it's all in a 2u form factor now that we've got everything we need for assembly it's time to open this sucker up peel off the oh so satisfying protective plastic and take a closer look at the back are expansion slots a 1 000 watt 80 plus titanium power supply with an extra in case the first one dies and a couple regular say the two and a half inch drive bays because you know you're a badass when all of your drives don't fit in the front of your case back at the front we've got 24 nvme slots but this machine supports 48 where do the other 24 go ah that right there is the secret of super micro's simply double enclosures a whole additional bank but how do you feed 48 pci express-based drives here's where the magic happens one of the three expansion slots that runs off of the second cpu is occupied by a pcie x16 quad u.2 cart and there are four native ports that use a different connector on the motherboard itself that run off the first cpu then both of these go to back planes behind the banks of drives since we're in here this seems like a good time to show how the quad 10 gigabit network card that we showed before goes in this can be upgraded in the future though i don't see myself needing anything like that for a while and we can throw in our 22 core cpus and our relatively pedestrian 64 gigs of ddr4 ram i think i'll have to steal some memory from the server this is replacing and that's pretty much it for assembly time to install the drives oh there go all the drives well who didn't see that one coming finally done why is every single one of these attached with four screws anyway let's take it over to the test bench so i have all the ssds plugged into this card right now which means a theoretical gigabytes per second of total bandwidth using 16x pcie gen 3. let's go find out how that theoretically translates into the real world oh it's heavy okay let's get some network connections here let's get some oh yeah vga you know it's performance when it has vga connectivity got this all set up you think i plug in servers here every once in a while right all right let's press the button and listen for the sweet sound of performance that's not bad for a 2u so fast forward half an hour we have got everything set up so disk management we have created a raid zero you're going to device manager disk drives oh look look at them all obviously we would never run a raid zero i am still looking into what will be the best way to configure them all with a good balance of performance and redundancy but this video is all about taking it to the extremes so we're gonna run addo with a q depth of 10 on our z drive here and find out just how fast it can go whoa now we're talking that's like 2 800 megs per second right it's like play by play wow oh it's over 9 000. we did it we cracked 10 gigabytes per second write speeds at 512 k wow of a theoretical 16 or 15 or so look at that over 11 gigabytes per second writes over one gigabyte per second reads for eight megs i can't imagine it getting much higher than that so there you have it folks past four to eight megabytes we're looking at read and write speeds in the neighborhood of 10 gigabytes per second with our highest peak at around 12.7 coming close to the theoretical maximum of our pci express x16 link here pretty freaking bananas if you ask me and we should be able to easily even once we work some parity or redundancy into the equation saturate our four 10 gigabit network connections at the back here once we get all those bonded together oh hey it's another blue apron spot and it's a new year maybe eating healthy and cooking in more instead of eating out is a resolution for you blue apron allows you to create delicious chef designed recipes at home they deliver all the ingredients you need right to your doorstep in exactly the right proportion so you don't have to go to the grocery store and you don't have to waste any food and it's delivered in a refrigerated box so everything stays fresh even if you're not at home when your delivery arrives everything is sourced from quality suppliers they offer two different types of plan the two-person plan and the family plan and there is no commitment you can skip or cancel the service any time you want all meals can be prepared in 40 minutes or less so you'll actually save time compared to going out if your family is anything like mine and they're adding new dishes to their menu every week so try it out and for the first hundred people you'll get three free meals using the link in our video description so thank you guys very much for tuning in to this video if you disliked it well that's what that button's there for isn't it but if you liked it hit that like button get subscribed maybe check out the link to where to buy a cool fast ssd maybe just one if you're not into buying 24 of them at amazon in the link in the video description also down there is our merch store and our community forum and don't forget to check out our other channels which you'll find uh video of up here i'll see you guys again next time what's he gonna do next time nobody knows maybe he's gonna rip out a fan while it's running hot swap fansthey're finally here just wait i got my 24 pcie ssds for my new storage server come on let's go build it if you haven't seen nerd sports yet check it out all the episodes are available now for free over at youtube.com channel superfun but before we begin we are going to need some supplies first a bare bones server from supermicro the ssg2028r nr48n i guess we'll just roll it there quad 10 gigabit network card 64 gigs of ram dual 2699 v4 222 core cpus time for boring inventory reconciliation oh i've had that in the wrong field damn it i was scanning the wrong barcodes and time for fun again everybody on board the insane train what better place to build this new machine than our shiny new b-roll set all i'll need is a screwdriver and maybe a table time for my favorite activity shocking drives oh this is gonna take a while 24 nvme pcie ssds each rated at a theoretical up to 250 with another zero 2 500 megabytes per second reads and 1200 megabytes per second right and we are going to take all these bad boys and we're going to put them in a gigantic raid array oh no cut but how on earth do you run nvme drives in raid the answer is this very special bare bones machine from super micro in fact this box can handle not just 24 but 48 nvme drives giving us the capacity to without changing the model of drives that we're using have up to about 50 terabytes of solid-state storage in a single box and did i even mention that it's all in a 2u form factor now that we've got everything we need for assembly it's time to open this sucker up peel off the oh so satisfying protective plastic and take a closer look at the back are expansion slots a 1 000 watt 80 plus titanium power supply with an extra in case the first one dies and a couple regular say the two and a half inch drive bays because you know you're a badass when all of your drives don't fit in the front of your case back at the front we've got 24 nvme slots but this machine supports 48 where do the other 24 go ah that right there is the secret of super micro's simply double enclosures a whole additional bank but how do you feed 48 pci express-based drives here's where the magic happens one of the three expansion slots that runs off of the second cpu is occupied by a pcie x16 quad u.2 cart and there are four native ports that use a different connector on the motherboard itself that run off the first cpu then both of these go to back planes behind the banks of drives since we're in here this seems like a good time to show how the quad 10 gigabit network card that we showed before goes in this can be upgraded in the future though i don't see myself needing anything like that for a while and we can throw in our 22 core cpus and our relatively pedestrian 64 gigs of ddr4 ram i think i'll have to steal some memory from the server this is replacing and that's pretty much it for assembly time to install the drives oh there go all the drives well who didn't see that one coming finally done why is every single one of these attached with four screws anyway let's take it over to the test bench so i have all the ssds plugged into this card right now which means a theoretical gigabytes per second of total bandwidth using 16x pcie gen 3. let's go find out how that theoretically translates into the real world oh it's heavy okay let's get some network connections here let's get some oh yeah vga you know it's performance when it has vga connectivity got this all set up you think i plug in servers here every once in a while right all right let's press the button and listen for the sweet sound of performance that's not bad for a 2u so fast forward half an hour we have got everything set up so disk management we have created a raid zero you're going to device manager disk drives oh look look at them all obviously we would never run a raid zero i am still looking into what will be the best way to configure them all with a good balance of performance and redundancy but this video is all about taking it to the extremes so we're gonna run addo with a q depth of 10 on our z drive here and find out just how fast it can go whoa now we're talking that's like 2 800 megs per second right it's like play by play wow oh it's over 9 000. we did it we cracked 10 gigabytes per second write speeds at 512 k wow of a theoretical 16 or 15 or so look at that over 11 gigabytes per second writes over one gigabyte per second reads for eight megs i can't imagine it getting much higher than that so there you have it folks past four to eight megabytes we're looking at read and write speeds in the neighborhood of 10 gigabytes per second with our highest peak at around 12.7 coming close to the theoretical maximum of our pci express x16 link here pretty freaking bananas if you ask me and we should be able to easily even once we work some parity or redundancy into the equation saturate our four 10 gigabit network connections at the back here once we get all those bonded together oh hey it's another blue apron spot and it's a new year maybe eating healthy and cooking in more instead of eating out is a resolution for you blue apron allows you to create delicious chef designed recipes at home they deliver all the ingredients you need right to your doorstep in exactly the right proportion so you don't have to go to the grocery store and you don't have to waste any food and it's delivered in a refrigerated box so everything stays fresh even if you're not at home when your delivery arrives everything is sourced from quality suppliers they offer two different types of plan the two-person plan and the family plan and there is no commitment you can skip or cancel the service any time you want all meals can be prepared in 40 minutes or less so you'll actually save time compared to going out if your family is anything like mine and they're adding new dishes to their menu every week so try it out and for the first hundred people you'll get three free meals using the link in our video description so thank you guys very much for tuning in to this video if you disliked it well that's what that button's there for isn't it but if you liked it hit that like button get subscribed maybe check out the link to where to buy a cool fast ssd maybe just one if you're not into buying 24 of them at amazon in the link in the video description also down there is our merch store and our community forum and don't forget to check out our other channels which you'll find uh video of up here i'll see you guys again next time what's he gonna do next time nobody knows maybe he's gonna rip out a fan while it's running hot swap fans\n"