82f7f4172a
update test results
5 years ago
4325695d74
[luscious] expand GraphQL queries
5 years ago
4409d00141
embed error messages in StopExtraction exceptions
5 years ago
6e08ada4fe
[luscious] simplify some metadata entries
5 years ago
b23c822b23
[luscious] use GraphQL
5 years ago
d92802fd37
[luscious] fix detection of unavailable galleries
5 years ago
c50d60a53d
[reactor] fix image URLs
5 years ago
4a0c98bfc9
miscellaneous fixes and adjustments
5 years ago
40637556fa
[ngomik] fix extraction
5 years ago
7a14aaed7d
[luscious] fix extraction
5 years ago
aa8e366b90
[luscious] fix tag extraction
5 years ago
f2cf1c1d73
use 'text.extract_from()' in a few places
5 years ago
e25ebc4bff
don't disable certificate checks anymore
...
Executables generated with PyInstaller auto-include the root certificate
file and certificate checks now work out-of-the-box.
6 years ago
2ff043edfa
[yaplog] add user- and post-extractors ( #190 )
6 years ago
00d604cafb
[luscious] fix SearchExtractor URL-pattern
6 years ago
1384ebf907
[luscious] fix metadata extraction
...
- remove 'artist', 'language', and 'lang' fields
- replace 'section' with 'genre'
- provide 'tags' as list
- use GalleryExtractor as base class
6 years ago
d0f88c35be
[komikcast] fix extraction
6 years ago
a2af2d2965
adjust cache maxage values
6 years ago
e687a6095e
[luscious] raise exception if album is not available
6 years ago
61741d7333
provide type information for Queue messages
...
Child extractors are now directly constructed with Extractor.from_url()
if the extractor class is known beforehand, instead of using
extractor.find() and searching through all possible extractor classes.
6 years ago
4b1880fa5e
propagate 'match' to base extractor constructor
6 years ago
6284731107
simplify extractor constants
...
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
6 years ago
00dc37ccbf
replace AsynchronousMixin Extractor with a Mixin
6 years ago
dd358b4564
improve cookie handling during logins
6 years ago
0c32dc5858
[hentaifox] add extractor for search results ( #160 )
6 years ago
e4171d6baf
[luscious] add login capabilities ( closes #159 )
6 years ago
c9ef5ed364
[luscious] ensure URLs have a scheme
6 years ago
a4263fb253
[luscious] add extractor for search results ( closes #127 )
6 years ago
e1d306cc48
update unit test results
6 years ago
38d4f43cc0
[komikcast] skip ads
6 years ago
df7e18399e
[luscious] fix image order
7 years ago
759ba26fb0
[luscious] proper image order for picture albums
...
... and (try) to start with the first image instead of somewhere
in the middle of an album.
7 years ago
557cb94f81
[deviantart] use proper exponential backoff on API errors
...
... and use separate API credentials for unit tests.
7 years ago
3cec533c28
Merge branch 'archive'
7 years ago
34873dbd90
set 'archive_fmt' values
...
These are going to be used to create an unique id for each image.
7 years ago
a34cebc253
[luscious] jump to first image if cover does not link to it
7 years ago
263741d243
[luscious] update URL pattern ( closes #55 )
7 years ago
31cd5b1c1d
[luscious] detect high-load responses
7 years ago
6f30cf4c64
change keyword names to valid Python identifiers
...
This commit mostly replaces all minus-signs ('-') in keyword names with
underscores ('_') to allow them to be used in filter-expressions. For
example 'gallery-id' got renamed to 'gallery_id'.
(It is theoretically possible to access any variable, regardless of its
name, with 'locals()["NAME"]', but that seems a bit too convoluted if
just 'NAME' could be enough)
7 years ago
f98e3e8002
[luscious] fix tag extraction
7 years ago
7e936e9c06
[luscious] simplify and remove dead code
7 years ago
dcd573806e
chg: dev: fix error ( #32 )
...
* fix: dev: error
* fix: dev: AttributeError when getting artist
* fix: dev: typo on luscious parser
7 years ago
d443822fdb
[luacious] get correct image URLs ( fixes #33 )
...
Instead of using thumbnail URLs and modifying them the extractor now
goes through every single image-page and gets its download URL from
there.
7 years ago
841fd50242
move code into util.py
8 years ago
94e10f249a
code adjustments according to pep8 nr2
8 years ago
efaba5f398
[luscious] support new album URLs + small fixes
8 years ago
79ea457e24
[luscious] use new 'html' attribute in API responses
8 years ago
effdf9c3be
[luscious] adapt to API changes
8 years ago
0211ec4114
update some tests
8 years ago
91dff9827f
[luscious] always provide URLs to the original images
8 years ago
Mike Fährmann