WebScraping

Prerequisites

• Python 3
• BeautifulSoup4
• lxml parser
• A website to scrape(Wikipedia and dictionary)

Running

1. Clone this repository.
2. Install the prerequisites.

Working

• Wikipedia MainPage scrapper, Here we are scrapping articles from main page namely,

  • Today's featured article.
  • Do You Know?
  • In the news.
  • On this day.
  • https://en.wikipedia.org/wiki/Main_Page

• Dictionary Scrapper,

  • Here we are scrapping the first noun meaning of the word.
  • https://www.dictionary.com/browse/

Note

This project uses id to uniquely identify web elements, which may change.