Hello Again: Excellent Work on Exercises in Last Video Chapter
Excellence is something that we strive for, and it's great to see that you've put in excellent work on the exercises in your last video. Now, let's move on to cloud computing. You may have heard of this term before, but it's time to understand what it means and how it can benefit your business.
Cloud Computing: A Game-Changer for Data Engineers
Data engineers are heavy users of the cloud, and it's no wonder why. Cloud computing has revolutionized the way we process data, making it more efficient and cost-effective. Let's take data processing as an example. You may have seen in a previous video that data processing often runs on clusters of machines. In the past, companies that relied on data processing on their own data center had to deal with the electrical bill and maintenance costs, not to mention the logistical challenges of providing enough processing power for peak moments.
The Challenges of Traditional Data Centers
In traditional data centers, most of the processing power remained idle during quiet times, leading to wasted resources. This is where cloud computing comes in – a game-changer for businesses looking to optimize their costs and improve reliability. With cloud computing, you only pay for the resources you need, when you need them. No more idle servers taking up space and consuming energy.
Why Companies Move to Cloud Computing
So, why do companies move to cloud computing? Apart from the cost optimization, another significant reason is database reliability. If you run a data critical company, you have to prepare for the worst-case scenario – disaster strikes. Will your data be safe? Can you replicate it at a different geographical location? These are the kinds of questions that keep cloud service providers up at night.
The Birth of Cloud Service Providers
These needs led to the creation of companies specializing in these issues – cloud service providers. They specialize in replicating data, ensuring high availability and reliability. These companies have become essential for businesses looking to ensure their data is safe and accessible.
Big Players in the Cloud Provider Market
Now, let's talk about the big players in the cloud provider market. First off, there's Amazon Web Services (AWS). You may wonder how many websites you visited lately – chances are a few of them hosted on AWS! In 2017, AWS had an outage that reportedly broke the internet. Talk about making headlines!
Market Share and Statistics
In 2018, AWS took up 32% of the market share, followed by Microsoft Azure with 70%, and Google Cloud with 10%. These statistics are a testament to the popularity and reliability of these cloud providers.
Types of Services Offered by Cloud Providers
Now that we've discussed the big players, let's talk about the types of services they offer. There are three main categories: storage, computation, and databases.
Storage Services
Storage services allow you to upload files of all types to the cloud. For example, you could upload product images to a start-up service. Search services are typically very cheap since they don't provide much functionality other than storing files reliably. AWS hosts S3 as a storage service, which is also known as blob storage. Google has Cloud Storage.
Computation Services
Computation services allow you to perform computations on the cloud. You can start up a virtual machine and use it as you wish. It's often used to host web servers for example. Computation services are usually flexible – you can start or stop virtual machines as needed. AWS has EC2 as a computation service, which offers virtual machines. Google has Compute Engine.
Databases
Cloud providers also host databases. We've discussed databases in a previous video, so you know what they're all about. Sequel databases, like RDS on AWS, are popular choices for businesses looking to store and manage their data. Cloud providers ensure that these databases are highly available, reliable, and secure.
That's it for today's article. We hope you now have a better understanding of cloud computing, its benefits, and the services offered by major cloud providers.