Python Tutorial - Cloud providers

Hello Again: Excellent Work on Exercises in Last Video Chapter

Excellence is something that we strive for, and it's great to see that you've put in excellent work on the exercises in your last video. Now, let's move on to cloud computing. You may have heard of this term before, but it's time to understand what it means and how it can benefit your business.

Cloud Computing: A Game-Changer for Data Engineers

Data engineers are heavy users of the cloud, and it's no wonder why. Cloud computing has revolutionized the way we process data, making it more efficient and cost-effective. Let's take data processing as an example. You may have seen in a previous video that data processing often runs on clusters of machines. In the past, companies that relied on data processing on their own data center had to deal with the electrical bill and maintenance costs, not to mention the logistical challenges of providing enough processing power for peak moments.

The Challenges of Traditional Data Centers

In traditional data centers, most of the processing power remained idle during quiet times, leading to wasted resources. This is where cloud computing comes in – a game-changer for businesses looking to optimize their costs and improve reliability. With cloud computing, you only pay for the resources you need, when you need them. No more idle servers taking up space and consuming energy.

Why Companies Move to Cloud Computing

So, why do companies move to cloud computing? Apart from the cost optimization, another significant reason is database reliability. If you run a data critical company, you have to prepare for the worst-case scenario – disaster strikes. Will your data be safe? Can you replicate it at a different geographical location? These are the kinds of questions that keep cloud service providers up at night.

The Birth of Cloud Service Providers

These needs led to the creation of companies specializing in these issues – cloud service providers. They specialize in replicating data, ensuring high availability and reliability. These companies have become essential for businesses looking to ensure their data is safe and accessible.

Big Players in the Cloud Provider Market

Now, let's talk about the big players in the cloud provider market. First off, there's Amazon Web Services (AWS). You may wonder how many websites you visited lately – chances are a few of them hosted on AWS! In 2017, AWS had an outage that reportedly broke the internet. Talk about making headlines!

Market Share and Statistics

In 2018, AWS took up 32% of the market share, followed by Microsoft Azure with 70%, and Google Cloud with 10%. These statistics are a testament to the popularity and reliability of these cloud providers.

Types of Services Offered by Cloud Providers

Now that we've discussed the big players, let's talk about the types of services they offer. There are three main categories: storage, computation, and databases.

Storage Services

Storage services allow you to upload files of all types to the cloud. For example, you could upload product images to a start-up service. Search services are typically very cheap since they don't provide much functionality other than storing files reliably. AWS hosts S3 as a storage service, which is also known as blob storage. Google has Cloud Storage.

Computation Services

Computation services allow you to perform computations on the cloud. You can start up a virtual machine and use it as you wish. It's often used to host web servers for example. Computation services are usually flexible – you can start or stop virtual machines as needed. AWS has EC2 as a computation service, which offers virtual machines. Google has Compute Engine.

Databases

Cloud providers also host databases. We've discussed databases in a previous video, so you know what they're all about. Sequel databases, like RDS on AWS, are popular choices for businesses looking to store and manage their data. Cloud providers ensure that these databases are highly available, reliable, and secure.

That's it for today's article. We hope you now have a better understanding of cloud computing, its benefits, and the services offered by major cloud providers.

"WEBVTTKind: captionsLanguage: enhello again excellent work on the exercises in the last video of this chapter we're going to talk about cloud computing you've probably already heard people use this term before data engineers are heavy users of the cloud in this video we'll explain why let's take data processing as an example you've seen in a previous video that data processing often runs on clusters of machines in the past companies that relied on data processing on their own data center you can imagine racks of servers ready to be used the electrical bill and maintenance were also at the company's cost moreover companies needed to be able to provide enough processing power for peak moments that also meant that has quieter times much of the processing power remained on use it's this race of resources that made cloud computing so appealing in a cloud you use the resources you need at the time you need them you can see that once these cloud services came to be many companies move to the cloud as a way of cost optimization apart from the cost of maintaining data centers another reason for using cloud computing its database reliability if you run a data critical company you have to prepare for the worst don't ask yourself the question will disaster strike but rather ask yourself when will disaster strike for example the fire can break out in your data center to be safe you need to replicate your data at a different geographical location that brings along a bunch of logistical problems of its own out of these needs companies specialising in these kind of issues were born we call these companies cloud service providers now in this slide we'll talk about three big players in the cloud provider market first and foremost there's Amazon Web Services or AWS think about the last few websites you visited chances are a double yes hosts at least a few of them back in 2017 AWS had an outage it reportedly broke the internet that's how big a double uses while AWS took up 32% of the market share in 2018 Microsoft Azure is a second big player and took 70% of the market the third big player is Google cloud and held 10% of the market in 2018 so we talked about the big players however what today I provide will discuss three types of services these companies offer storage computation and databases first storage services allow you to upload files of all types to the cloud in an online store for example you could upload product images to a start service search services are typically very cheap since they don't provide much functionality other than storing the files reliably AWS hosts s3 as a storage service as your as blob storage and Google has cloud storage second computation services allow you to perform computations on the cloud usually you can start up a virtual machine and use it as you wish it's often used to host web servers for example computation services are usually flexible you can start or stop virtual machines as needed AWS has ec2 as a computation service measure has virtual machines and Google has compute engine last but not least cloud providers host databases we already talked about databases in a previous video so you know what they are for sequel databases AWS has RDS Ezzor has sequel database and Google has cloud sequel that's it forhello again excellent work on the exercises in the last video of this chapter we're going to talk about cloud computing you've probably already heard people use this term before data engineers are heavy users of the cloud in this video we'll explain why let's take data processing as an example you've seen in a previous video that data processing often runs on clusters of machines in the past companies that relied on data processing on their own data center you can imagine racks of servers ready to be used the electrical bill and maintenance were also at the company's cost moreover companies needed to be able to provide enough processing power for peak moments that also meant that has quieter times much of the processing power remained on use it's this race of resources that made cloud computing so appealing in a cloud you use the resources you need at the time you need them you can see that once these cloud services came to be many companies move to the cloud as a way of cost optimization apart from the cost of maintaining data centers another reason for using cloud computing its database reliability if you run a data critical company you have to prepare for the worst don't ask yourself the question will disaster strike but rather ask yourself when will disaster strike for example the fire can break out in your data center to be safe you need to replicate your data at a different geographical location that brings along a bunch of logistical problems of its own out of these needs companies specialising in these kind of issues were born we call these companies cloud service providers now in this slide we'll talk about three big players in the cloud provider market first and foremost there's Amazon Web Services or AWS think about the last few websites you visited chances are a double yes hosts at least a few of them back in 2017 AWS had an outage it reportedly broke the internet that's how big a double uses while AWS took up 32% of the market share in 2018 Microsoft Azure is a second big player and took 70% of the market the third big player is Google cloud and held 10% of the market in 2018 so we talked about the big players however what today I provide will discuss three types of services these companies offer storage computation and databases first storage services allow you to upload files of all types to the cloud in an online store for example you could upload product images to a start service search services are typically very cheap since they don't provide much functionality other than storing the files reliably AWS hosts s3 as a storage service as your as blob storage and Google has cloud storage second computation services allow you to perform computations on the cloud usually you can start up a virtual machine and use it as you wish it's often used to host web servers for example computation services are usually flexible you can start or stop virtual machines as needed AWS has ec2 as a computation service measure has virtual machines and Google has compute engine last but not least cloud providers host databases we already talked about databases in a previous video so you know what they are for sequel databases AWS has RDS Ezzor has sequel database and Google has cloud sequel that's it for\n"