What you'll learn:
- web scraping
- data extraction
- data mining
- create your own dataset
- output data in Excel
- output your dataframe in PostgreSQL
- run SQL commands on your dataframe
In this course the students will get to know how to scrape data from the API of a website (if available). We start with the fundamentals and the beginner level project. After that, two different projects will be covered, followed by the advanced project. After scraping data of wach project, the results will be stored inside an Excel file. Within the advanced level project we will create two dofferent datasets with 5000 results each. The goal is to merge both dataframes (total: 10000 results), save it in Excel and output the data in the PostgreSQL database and run SQL commands on our own data.
The requirement for this course is basic knowledge of Python Programming. Since we will not cover very difficult Python topics you do not have to be a professional. The most important characteristic is that you are curious about Web Scraping and Data Mining. You should be ready to invest time in gaining the knowledge which is taught in this course.
After this course you will have the knowledge and the experience to scrape your own data and create your own dataset. With the help of the course resources you will always have documents you can refer to. If you have a question or if a concept just does not make sense to you, you can ask your questions anytime inside the Q&A - Forum. Either the instructor or other students will answer your question. Thanks to the community you will never have the feeling to learn alone by yourself.
Disclaimer : I teach web scraping as a tutor for educational purposes. That's it.
The first rule of scraping the web is: do not harm a certain website. The second rule of web crawling is: do NOT harm a certain website.
