Skip to content

Commit

Permalink
v1.2.2
Browse files Browse the repository at this point in the history
HTTPS + Cookies
Works perfectly,
Tested on 31/03/2019
  • Loading branch information
vintol committed Mar 31, 2019
1 parent eabb509 commit 2b060cd
Show file tree
Hide file tree
Showing 3 changed files with 73 additions and 35 deletions.
96 changes: 66 additions & 30 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,59 +1,95 @@
# Change Log

All notable changes to this project will be documented in this file.

The format is based on [Keep a Changelog](http://keepachangelog.com/)
and this project adheres to [Semantic Versioning](http://semver.org/).

------------
* * *

## [Version] - Release Date

> Added for new features.
> Changed for changes in existing functionality.
> Deprecated for soon-to-be removed features.
> Removed for now removed features.
> Fixed for any bug fixes.
> Security in case of vulnerabilities.
-------

## [1.2.2] - 2019-03-31

### Added

- Cookie Support.

* * *

## [1.2.1] - 2018-01-27

### Added
- Capability for handling https protocol.
### Deprecated
- Forcing usage of http protocol because ssl certificate issues
### Security
- HTTPS certificate is not verified.

- Capability for handling https protocol.
### Deprecated
- Forcing usage of http protocol because ssl certificate issues
### Security
- HTTPS certificate is not verified.

* * *

---------
## [1.2.0] - 2018-11-21

### Added
- Stop scraping at a perticular image
- Start from or finish at a perticular page no.
### Changed
- Report Broken links.
### Fixed
- Error handling exception when http timeout

-------
- Stop scraping at a perticular image
- Start from or finish at a perticular page no.
### Changed
- Report Broken links.
### Fixed
- Error handling exception when http timeout

* * *

## [1.1.0] - 2017-03-29

### Added
- Downloader always checks if files are already downloaded and skips them.
- Errors are categorized for better understanding of bugs.
- Checks for broken links.

----
- Downloader always checks if files are already downloaded and skips them.
- Errors are categorized for better understanding of bugs.
- Checks for broken links.

* * *

## [1.0.0] - 2016-11-10

First Stable release.

### Added
- Can now get images from `image` lists.
- Support for command-line Arguments.
- Added a progress bar.
- Download resume capability.

- Can now get images from `image` lists.
- Support for command-line Arguments.
- Added a progress bar.
- Download resume capability.

### Changed
- Instead of entering the name of the person you enter the profile url.
- Downloader is now a seperate script rather then an option.
- Links are placed in a file in working dir; Instead of creating a seperate directory inside the working directory.
- No interactive input; instead command line args are accepted.

- Instead of entering the name of the person you enter the profile url.
- Downloader is now a seperate script rather then an option.
- Links are placed in a file in working dir; Instead of creating a seperate directory inside the working directory.
- No interactive input; instead command line args are accepted.

### Removed
- Option to download images is removed from main file.

------
- Option to download images is removed from main file.

* * *

## [0.1.0] - 2016-04-20

This is the first public release. **Pre Release**

### Added
- Retrives the links of of all photos from any `person` profile on `listal.com`.
- Also, can download the photos from the retrived links using mulitple threads.

- Retrives the links of of all photos from any `person` profile on `listal.com`.
- Also, can download the photos from the retrived links using mulitple threads.
3 changes: 1 addition & 2 deletions L-dl.py
Original file line number Diff line number Diff line change
@@ -1,15 +1,14 @@
#
# Listal Downloader
# vintol.github.io/listal
# v1.2
#

import urllib.request,ssl
import argparse
import time
import queue
import threading
import os,sys
import better_exceptions
#

# Very Important.
Expand Down
9 changes: 6 additions & 3 deletions Listal.py
Original file line number Diff line number Diff line change
@@ -1,8 +1,9 @@
# Listal.py
# 27/01/2018
# 08/11/2016 - 31/03/2019
# v 1.2.2

import urllib.request, urllib.parse, ssl
import urllib.request, urllib.parse
import http.cookiejar, ssl
import bs4
import queue
import threading
Expand All @@ -11,7 +12,6 @@
import sys
import argparse
import time
import better_exceptions

# Scrapers

Expand Down Expand Up @@ -169,6 +169,9 @@ def write():
print ("Check the Entered URL.")
quit()

#CookieJar Initiation
urllib.request.HTTPCookieProcessor(http.cookiejar.CookieJar())

if urls.path.startswith("/list/"):
if args.first_page is not None:print("Entered URL is of a list. The '--from' option is ignored.")
if args.last_page is not None:print("Entered URL is of a list. The '--upto' option is ignored.")
Expand Down

0 comments on commit 2b060cd

Please sign in to comment.