b7eb6cecbb
[pixiv] handle tags at the end of new bookmark URLs
5 years ago
109f6c8685
[patreon] filter duplicate files per post ( #590 )
5 years ago
b38cf59711
[sexcom] fix image URLs & parse 'date' fields
5 years ago
1f4c9c5f9d
[8kun] add thread and board extractors ( closes #582 )
5 years ago
facc5daa6d
[twitter] force old login page layout ( fixes #584 , fixes #598 )
5 years ago
d1de7dc296
[hitomi] implement workaround for "broken" redirects
...
Some galleries redirect to a new "version" with different gallery id.
This new version might not be available any more, but the /reader/
page for the original gallery id can still work.
5 years ago
40fe062851
[pixiv] fix user id for bookmarks API calls ( closes #596 )
5 years ago
91aaaf1a9e
[pixiv] add 'rating' metadata field ( #595 )
...
A human-friendlier representation of 'x_restrict'
5 years ago
dff33b260c
[reddit] add 'videos' option
5 years ago
2ad43618cc
[piczel] fix extraction
5 years ago
cf7a67d67f
[yaplog] remove module
...
Yaplog! ended its service on 2020-01-31
5 years ago
e0dd073ce0
[twitter] replace embedded tweet test
...
the old one was deleted
5 years ago
ec36df4851
[deviantart] fix video extraction from 'extended_fetch' results
...
DeviantArt is now serving videos from wixmp servers (1), instead of
the former film00.deviantart.com (2), even though those URLS are still
functional.
They seem to also have re-encoded those videos. The 10 MB 1080p video
from (2) is now only available in 720p at ~20 MB (with a higher
bitrate, but still …). Other videos are still available in 1080p, but
not this one for some reason.
(Changing the '720p' in (1) to '1080p' doesn't work.)
(1) https://wixmp-ed30a86b8c4ca887773594c2.wixmp.com/v/mp4/9feaa2c9-1baf-4fc2-84f7-f3384b34cefe/d5gxnb5-282a2e9a-b552-40ff-8542-b3c5eed823f5.720p.a837d7cec12c41be8ca2ee53152cea3a.mp4
(2) https://film00.deviantart.net/4c1d/v/mp4/2012/279/d/1/_video____brushes_i_use_in_paint_tool_sai_by_chi_u-d5gxnb5.mp4
5 years ago
48be2266ed
[deviantart] better error message for 'extended_fetch' ( #585 )
5 years ago
383795b550
prevent superfluous calls to Logger.makeRecord()
...
… by setting an appropriate minimal logging level for the root Logger.
5 years ago
71851a6241
[pixiv] update URLs of followed users to the new format
5 years ago
d086f30b42
[reddit] restore archive keys for i.redd.it images
5 years ago
56f1c96168
implement 'parent-directory' option ( #551 )
5 years ago
ae07f92f7e
[reddit] rewrite extractor logic ( closes #551 )
...
Handle images and videos hosted on Reddit "natively",
allowing them to use reddit-specific metadata to build directory
and file names.
5 years ago
2852691d78
[paheal] replace test URL
...
searching for 'k-on' doesn't yield any results anymore
5 years ago
2a9be48511
improve util.load/save_cookiestxt() and add tests
...
- take a file object as argument instead of an filename
- accept whitespace before comments (" # comment")
- map expiration "0" to None and not the number 0
5 years ago
e35c2ea1a6
[weibo] use youtube-dl to download from m3u8 manifests
5 years ago
6703b8a86b
[blogger] implement video extraction ( closes #587 )
5 years ago
b3b5754f2d
update test_cookies.py
5 years ago
c1a6862863
implement functions to load/save cookies.txt files ( closes #586 )
...
The methods of the standard libraries' MozillaCookieJar have
several shortcomings (#HttpOnly_ cookies, 0 expiration timestamps, etc.)
and require construction of an ultimately pointless CookieJar object.
5 years ago
5d73b7f29c
release version 1.12.3
5 years ago
37247dbaff
miscellaneous fixes
5 years ago
0e9dc5c88e
fix AttributeError when accessing 'temppath'
...
[ci skip]
5 years ago
25d5ec4ff3
[twitter] add option to extract TwitPic embeds ( #579 )
5 years ago
254f7c3999
implement a post-processor module to compare file versions
...
(#530 )
5 years ago
32d7195d08
[pinterest] improve detection of invalid pin.it links
5 years ago
0b84068d84
remove temp files before downloading from fallback URLs
...
otherwise the next call to download() with a fallback URL could see
the partially downloaded "remains" from the previous, failed download
attempt and "continue" it, writing the second half of a potentially
different version of that file.
5 years ago
760b9b4db4
add remove_file() and remove_directory() helpers
...
these functions call os.unlink() or os.rmdir()
while catching and suppressing potential OSErrors
5 years ago
b2d542ad40
improve PathFormat._enum_file()
...
open only one try-except block for the whole loop,
instead of one for each iteration in os.path.exists()
5 years ago
174117f827
allow multiple hashes for content tests
5 years ago
f498a9057f
[twitter] Fix stop before real end ( #573 )
...
* [twitter] Fix stop before real end
Fix for https://github.com/mikf/gallery-dl/issues/544 . Makes sure that it really reached the end by checking that both "min_position" is null and "has_more_items" is false before stopping.
* [twitter] Fix stop before real end (update)
5 years ago
8bb32ee188
[hitomi] fix image URLs
5 years ago
bd5ce9855c
allow GalleryExtractors to set URL-independent extensions
5 years ago
60a43f0264
fix downloader tests
5 years ago
af42c75152
[mangadex] revert domain to 'mangadex.org'
5 years ago
a6b98d3bec
fix auto-generation of supportedsites.rst
5 years ago
3c534d8c2c
remove pyOpenSSL from README and setup.py
5 years ago
200aea308a
[downloader:common] enable 'job'/'extractor' for logging messages
...
(#574 )
5 years ago
e89413da22
update test results
5 years ago
88ccfe984d
update mentioned Python version for standalone executables
5 years ago
33a6e0ac6e
[hentaifoundry] extract more metadata ( closes #565 )
5 years ago
5cac79c3d9
[erolord] remove extractor
5 years ago
b9cbf932b4
[pixiv] update URL patterns ( fixes #568 )
...
Pixiv now uses new URLs for
- user profiles and illustration listings:
- https://www.pixiv.net/en/users/ <ID>
- https://www.pixiv.net/en/users/ <ID>/artworks
- bookmarks:
- https://www.pixiv.net/en/users/ <ID>/bookmarks/artworks
5 years ago
9d369de592
release version 1.12.2
5 years ago
988cc2ec23
[mangadex] change domain to mangadex.cc ( closes #559 )
5 years ago
Mike Fährmann