Mike Fährmann
db9833c28a
merge #5870 : [aryion] add 'favorite' extractor ( #4511 )
2 months ago
Mike Fährmann
156a70bec0
[aryion] update favorite extractor
...
- add test case
- add docs/supportedsites entry
- add custom directory_fmt and archive_fmt
- remove constructor
- appease flake8
2 months ago
Mike Fährmann
36a64a3aa7
[behance] fix image extraction ( #5873 )
2 months ago
Mike Fährmann
727e53f513
[bunkr] support 'bunkr.fi' URLs ( #5872 )
2 months ago
walkenjoyer
19e98ef8e9
[aryion] Add favorite extractor ( #4511 )
2 months ago
Mike Fährmann
a595949840
[8chan] update 'TOS' cookie name ( #5868 )
2 months ago
Mike Fährmann
fef80a2f55
[zerochan] fetch metadata for each post separately ( #5869 )
...
instead of processing all posts at once before returning any of them
2 months ago
Mike Fährmann
84a634fc14
[job] add 'resolve' argument to DataJob ( #5864 )
2 months ago
Mike Fährmann
287a7d13cf
[sankaku] implement 'notes' extraction ( #5865 )
2 months ago
Mike Fährmann
7d5415c201
[workflow:executables] restrict 'setuptools' to <71
...
setuptools 71 together with secretstorage dependencies
causees an ImportErrorWhenRunningHook exception in PyInstaller
for whatever reason
2 months ago
Mike Fährmann
026e0b97db
merge #5824 : [furaffinity] add 'folders' and 'thumbnail' ( #1284 )
2 months ago
Mike Fährmann
9a8ec95398
[furaffinity] improve
2 months ago
Mike Fährmann
60a2fefedd
[tests] restrict 'test_unique_pattern_matches' to internal extractors
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2231649983
2 months ago
Mike Fährmann
3fa74ca4d7
[tests] enable test results for external extractors ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2231649983
2 months ago
Mike Fährmann
6940ad0e72
[booru] allow multiple 'url' keys ( #5859 )
2 months ago
Mike Fährmann
bf44add132
[booru] prevent crash when file URL is empty ( #5859 )
...
- catch all exceptions, including IndexError, and not just a select few
- change logging message level to warning
2 months ago
Mike Fährmann
39b9c8d4b0
[workflows:pages] add repo check to 'deploy' job as well
...
of course I forgot one
a434fc7cb1
2 months ago
Mike Fährmann
51fd14f87d
[gelbooru_v02] use total number of posts as end marker ( #5830 )
...
… and potentially retry on empty responses
2 months ago
Mike Fährmann
6110e3f940
[common] fix Logger names of BaseCategory extractors
...
update of d11ec009
fixes regressions introduced in 0c178846
2 months ago
Mike Fährmann
668219b36e
[exhentai] improve error message when temporarily banned ( #5845 )
2 months ago
Mike Fährmann
f7383a56f8
wrap filters/conditionals in a try-except block
...
allows accessing undefined fields without exception or locals().get(…)
but hides mistakes/typos/etc by evaluating to False without feedback
performance loss compared to the previous version without try-except
is negligible (~20ns for me)
2 months ago
Mike Fährmann
c83c812a1e
[instagram][twitter] rename 'profile' to 'info' ( #5262 , #3623 )
2 months ago
Mike Fährmann
21831eba1e
[tests] completely ignore '#auth' for 'only_matching' tests
2 months ago
Mike Fährmann
16e276fca4
[nijie] fix image URLs for single image posts ( #5842 )
...
fixes regression introduced in 2e11b6e7
2 months ago
Mike Fährmann
eb3ef13d28
include 'zstd' in Accept-Encoding header when supported
...
… and slightly update optional dependency list
2 months ago
Mike Fährmann
8aca0e6970
update default User-Agent header to Firefox 128 ESR
2 months ago
Mike Fährmann
8e747b6dee
[twitter] send initial 'cursor' only when given via option
2 months ago
Mike Fährmann
ff39d28ef4
[twitter] fix 'user' when providing 'cursor' ( #5833 )
2 months ago
Mike Fährmann
65385e09cb
[twitter] remove break ( #5831 )
3 months ago
Mike Fährmann
1656c9287d
[pp:metadata] fix 'directory' when file directory has conditions ( #5728 )
3 months ago
Mike Fährmann
1527ad79e2
[tests] fix syntax for Python < 3.6
...
no f-strings
3 months ago
Mike Fährmann
da9916c01f
[pp:metadata] implement format strings for 'directory' ( #5728 )
3 months ago
Mike Fährmann
8f3f061daf
[hentainexus] fix error for spread pages ( #5827 )
3 months ago
Mike Fährmann
b3aded1939
add '--print-traffic'
3 months ago
Mike Fährmann
b376fa814e
[zerochan] handle "KeyError - 'items'" ( #5826 )
...
Zerochan sometimes sends an empty response when there are no more
accessible posts to be had.
3 months ago
Mike Fährmann
a434fc7cb1
[workflows] only run in 'mikf/gallery-dl' repo
...
The actual code was included in the previous
97a50a23d2
by accident …
This commit only wraps the slightly more complex docker.yml condition
in GitHub's special ${{ … }} braces.
3 months ago
Mike Fährmann
97a50a23d2
[twitter] implement 'cursor' support ( #5753 )
3 months ago
Nicholas Bishop
4f3be2f571
Remove leftover split() statement
...
Forgot to remove this from a previous implementation attempt
3 months ago
Mike Fährmann
162756b684
[toyhouse] fix Content Warning bypass ( #5820 )
3 months ago
Nicholas Bishop
f43bccb5be
[furaffinity] Add 'thumbnail' ( #1284 ) and 'folders' properties
...
Retrieve 'thumbnail' and 'folders' properties for each post.
'thumbnail' (#1284 ):
- Preview image used for search results, writing posts, music, etc.
- Filename format: <post_id>@600-<directory_containing_full_image>.jpg
'Folders' (related to #1817 ):
- A list of all gallery folders containing this post
- Folder name format: [<folder_category> - ]<folder_name>
- Only works on new layout; old layout does not show folders, so list will be empty
A test is included for each property.
3 months ago
Luca Russo
f7833a8be4
removed cookie "safeguard" + fixed for private profiles
...
I have removed the cookie "safeguard" (not using cookies until they are necessary) as I've come to the conclusion that it does more harm than good. There is no way to detect whether the extractor has skipped private images, that could have been possibly extracted otherwise. Also, doing this provides little to no advantages.
3 months ago
Luca Russo
a86a70fe9b
fixed description metadata bug
3 months ago
Mike Fährmann
e03b99ba0e
[actions] emit logging messages before waiting/exiting/etc
...
distinguish between actions that should run before or after
a logging message gets emitted
3 months ago
Mike Fährmann
f7a6401031
[actions] move LoggerAdapter from 'output' to 'actions'
3 months ago
Mike Fährmann
f41a5065b2
[actions] support multiple actions per pattern
3 months ago
Mike Fährmann
8219a78b8d
[actions] extend 'wait'
...
allow specifying a duration like for --sleep
3 months ago
Mike Fährmann
84b3da54aa
[actions] add 'exec' action ( #5619 )
3 months ago
Mike Fährmann
c9860002ba
[actions] add 'abort' and 'terminate' actions ( #5778 )
3 months ago
Mike Fährmann
d80f4fbc10
[actions] optimize empty patterns
3 months ago
Mike Fährmann
d10bfa9065
[vipergirls] improve 'thread' URL pattern
...
allow for query parameters and fragments at tne end of URLs
3 months ago