Understanding Data Acquisition: A Task of Real-World Data

Our work involves real-world data acquisition, and initially, we mentioned that we actually obtained this data from Amazon.com itself. However, we wanted to obtain this data in a policy-compliant manner, rather than simply going to Amazon.com and doing web scraping. Web scraping is a task that involves downloading one page after another webpage, which is against Amazon's policies of obtaining data.

Using Amazon's Product Advertising API

To overcome these restrictions, we used Amazon's own product advertising API as a programmatic interface for obtaining data in a policy-compliant manner. This API allows us to access data from Amazon.com using any programming language of our choice, making it an essential tool for those who want to obtain data from the platform without breaking any policies. The product advertising API explains how to obtain data from Amazon.com using this API, which is crucial for ensuring that we comply with their terms and conditions.

Acquiring Data on Women's Tops

We primarily focused on acquiring data related to women's tops and shirts, and for this purpose, we used the item search feature of the Amazon product advertising API. This feature allows us to easily obtain data by searching for specific keywords and categories. In our case, we searched for "women's tops" and acquired data for approximately 183,000 products. For each of these products, we obtained interesting data such as URLs to images, product titles, prices, and descriptions.

The Power of Amazon's Product Advertising API

Using the product advertising API has been a game-changer for us in obtaining real-world data from Amazon.com. The API is designed to be user-friendly, even for those who are new to using APIs or programming languages like AWS. For those who know how to use these tools, it provides an easy way to obtain data that can be used for various purposes. In our next video, we will explain how to obtain this data from the source and how to use it effectively.

Tips for Using Amazon's Product Advertising API

For those who want to explore using the product advertising API for themselves, here are some tips:

* To get started, you need an AWS access key and an associate key.

* You can search for specific keywords or categories using the item search feature.

* The API is designed to be policy-compliant, making it essential for obtaining data from Amazon.com without breaking any policies.

Conclusion

In conclusion, acquiring real-world data from Amazon.com requires a thoughtful approach. By using the product advertising API and following the tips provided in this article, you can easily obtain data that meets your needs while complying with Amazon's policies. Whether you are an experienced user of APIs or programming languages like AWS, or if you are new to these tools, the product advertising API provides a simple and effective way to obtain valuable data from Amazon.com.

"WEBVTTKind: captionsLanguage: ennow let's understand how we acquired this data which is a task of data acquisition so initially I mentioned that we actually work on real world data right so we actually got data from amazon.com itself but we wanted to obtain this data in a policy complaint manner we didn't just want to go to amazon.com and do web scraping web scraping is web scraping is a task of basically downloading one page one web page after other webpage which is which is against amazon's amazon.com policies of obtaining data so we actually used Amazon's own product advertising API right this is this is a programmatic interface for us to actually so you can good you can land on this page witness Google search Amazon product advertising API and you land on this page this page explains how to actually obtain data from amazon.com using any programming language of your choice in a policy compliant manner which is very important in a policy compliant manner right we just didn't want to break amazon's policies when we were getting this data right so what we did was we used product advertising api to to get to get data for women stops right so for women's tops and shirts right we just searched for women's tops and we acquired data for 100 roughly around 183 thousand products so for those of you who prefer the indian system it's one lakh 83,000 products roughly for each of these products we obtained all the interesting data like like we obtained a URL to an image of the product so we obtained image URL we obtained things like product title product price product description etcetera etcetera anyway we'll see the data set in a while right but we primarily focused on the category of women stops right so those of you who are interested in obtaining their own data in addition to this workshop you can actually use amazon's product advertising api in a policy complaint manner to obtain the data so we actually we actually used something called an item search for those of you who want to explore this path it's actually very very simple you just have to get an AWS access key and an associate key and all I just said was I said search indexes fashion women and we search for keywords like women stops right it's very very easy if you if you know if you know rest protocol or if you know how to use api is on AWS it's very very easy if you don't know this please don't worry because we've already downloaded this data and in my next video I will explain you how to obtain this data from our from from from us and how to use it so if you don't know how to use AWS or Amazon's product advertising API please don't worry I just for those of you who know how to use Amazon's pretend rising API or who know how to how to use API is in general we thought they could benefit from this video on understanding how we update this data ourselvesnow let's understand how we acquired this data which is a task of data acquisition so initially I mentioned that we actually work on real world data right so we actually got data from amazon.com itself but we wanted to obtain this data in a policy complaint manner we didn't just want to go to amazon.com and do web scraping web scraping is web scraping is a task of basically downloading one page one web page after other webpage which is which is against amazon's amazon.com policies of obtaining data so we actually used Amazon's own product advertising API right this is this is a programmatic interface for us to actually so you can good you can land on this page witness Google search Amazon product advertising API and you land on this page this page explains how to actually obtain data from amazon.com using any programming language of your choice in a policy compliant manner which is very important in a policy compliant manner right we just didn't want to break amazon's policies when we were getting this data right so what we did was we used product advertising api to to get to get data for women stops right so for women's tops and shirts right we just searched for women's tops and we acquired data for 100 roughly around 183 thousand products so for those of you who prefer the indian system it's one lakh 83,000 products roughly for each of these products we obtained all the interesting data like like we obtained a URL to an image of the product so we obtained image URL we obtained things like product title product price product description etcetera etcetera anyway we'll see the data set in a while right but we primarily focused on the category of women stops right so those of you who are interested in obtaining their own data in addition to this workshop you can actually use amazon's product advertising api in a policy complaint manner to obtain the data so we actually we actually used something called an item search for those of you who want to explore this path it's actually very very simple you just have to get an AWS access key and an associate key and all I just said was I said search indexes fashion women and we search for keywords like women stops right it's very very easy if you if you know if you know rest protocol or if you know how to use api is on AWS it's very very easy if you don't know this please don't worry because we've already downloaded this data and in my next video I will explain you how to obtain this data from our from from from us and how to use it so if you don't know how to use AWS or Amazon's product advertising API please don't worry I just for those of you who know how to use Amazon's pretend rising API or who know how to how to use API is in general we thought they could benefit from this video on understanding how we update this data ourselves\n"