7cd383c0f9
update extractor test results
4 years ago
65744a7a31
use alternative for all falsey values in format strings
...
… and not just None (#525 )
It would be better to consistently use None for all non-existent
fields and/or fields without a valid value, but this is a good
enough workaround for now.
4 years ago
f5b7ae01c1
update extractor test results
4 years ago
392d022b04
implement 'config.accumulate()' ( #994 )
4 years ago
3108e85b89
[worldthree] remove extractors
...
http://www.slide.world-three.org/ hasn't been accessible for a long time.
4 years ago
3918b69677
remove 'extractor.blacklist' context manager
4 years ago
ac3036ef56
add 'filesize-min' and 'filesize-max' options ( closes #780 )
4 years ago
fd0685d9b5
[postprocessor:zip] defer zip file creation ( fixes #968 )
...
don't try to create zip files on postprocessor construction,
wait until directory creation during file download,
4 years ago
d50f3b333a
update extractor test results
4 years ago
e33293fdd8
[hentaihand] update to new site layout
4 years ago
69e4871005
update extractor test results
...
- sensescans: replace 404d chapters
- mangapark: replace 404d chapters
- subscribestar: update test for attached files
4 years ago
688bd046fc
release version 1.14.4
4 years ago
422e69f187
skip external OAuth tests ( closes #908 )
4 years ago
8dbf827649
[bobx] remove module
4 years ago
87202b8d74
[inkbunny] add 'user' and 'post' extractors ( #283 )
4 years ago
2ecf1efb16
update extractor test results
...
- tumblr: remove deleted post
- jaiminisbox: replace removed manga/chapters
- smugmug: one inconsequential field got removed
4 years ago
e62ebb4643
update CHANGELOG before building sdist and wheel packages
4 years ago
0cac14c3bd
update extractor test results
4 years ago
53cc498d9c
improve config lookup when there are multiple possible locations
...
This specifically applies to all Mastodon extractors and all
extractors with a 'basecategory', i.e. 'booru', 'foolslide', etc.
Values inside those general config locations wouldn't be recognized
when a value with the same was set on the 'extractor' level.
For example 'extractor.mastodon.directory' should be used over
'extractor.directory' when both are set, but this was impossible
with the previous implementation.
(fixes #843 )
4 years ago
d81a8e6544
[twitter] update tests
4 years ago
37d71f6e09
strip microseconds in text.parse_datetime()
4 years ago
6db7ed90cb
release version 1.14.1
4 years ago
087e3184dc
use a non-twitter URL when testing snap creation
4 years ago
7daef6ee70
update extractor test results
...
- certain posts on Instagram now return
https://static.cdninstagram.com/rsrc.php/null.jpg
for public users
- MangaDex is deploying its new MangaDex@Home network similar to
exhentai's Hentai@Home
- realbooru has a new site layout, but the underlying booru API still
works like before
4 years ago
3bad1579ee
update extractor test results
4 years ago
45baa13615
update extractor test results
...
- don't run Instagram tests on Travis anymore
- replace Twitter test because timeline was made private
- update Hiperdex domain to '.com' (again ...)
4 years ago
dfcf2a2c91
write OAuth token to cache by default ( #616 )
4 years ago
6294e2c540
add 'text.ensure_http_scheme()'
4 years ago
ece73b5b2a
make 'path' and 'keywords' available in logging messages
...
Wrap all loggers used by job, extractor, downloader, and postprocessor
objects into a (custom) LoggerAdapter that provides access to the
underlying job, extractor, pathfmt, and kwdict objects and their
properties.
__init__() signatures for all downloader and postprocessor classes have
been changed to take the current Job object as their first argument,
instead of the current extractor or pathfmt.
(#574 , #575 )
4 years ago
4b606b68e4
skip OAuth tests when server is unreachable
4 years ago
8b60bd6a91
mock 'time()' in cache tests
...
instead of calling 'sleep()' to let time advance.
This shortens the time needed to run those tests,
and ensures consistent results.
(Tests would randomly fail when using 'sleep()')
4 years ago
8f2c1da041
skip example config tests if files are not available ( #730 )
4 years ago
5df8f2959b
insert local directory into PYTHONPATH when running tests
4 years ago
ff47641b13
test whether default/example config files contain valid JSON
4 years ago
d6facdee7b
[mastodon] add tests ( #701 )
4 years ago
fd438f0d78
update extractor test results
5 years ago
a0f4c295c0
add optional 'utcoffset' argument to 'parse_datetime()'
5 years ago
406449b0d6
ensure keys for mastodon instances are available during tests
...
Calls to config.clear() from other tests are removing the API
credentials set when importing mastodon.py for the first time.
5 years ago
9e7dfc0cfc
[myportfolio] fix extraction of galleries without title
5 years ago
3b50c4f49d
add tests for "Extractors" in oauth.py ( #670 )
5 years ago
04bd0472de
add tests for Extractor.wait()
5 years ago
7499d71d02
[simplyhentai] ignore certificate errors in video test
5 years ago
4203dc0bdc
[mangapark] fix metadata extraction
5 years ago
77fda8190c
[35photo] simplify/remove tests for the 'genre' extractor
...
There is still a nice genre overview page (https://35photo.pro/genre/ )
but the individual sub-pages don't list photos anymore
5 years ago
32e36d8f02
[sexcom] replace tests
5 years ago
e0b0e8d62a
release version 1.13.2
5 years ago
a63a376ad2
[mangoxo] fix login
5 years ago
ebc70e87ce
[e621] update to new interface / API endpoints ( closes #635 )
5 years ago
72122eb9b3
release version 1.13.1
5 years ago
ce5e2a58fe
[imgbb] update test results
...
Image server domain changed from
https://image.ibb.co/ to https://i.ibb.co/
5 years ago
Mike Fährmann
