Mike Fährmann
d65fc2435c
[cien] extract 'gallery' images ( #2885 )
2 months ago
Mike Fährmann
1bdb0f7a49
[path] leave '..' segments as is ( #5728 )
2 months ago
Mike Fährmann
0432e05783
[hotleak] fix faulty image URLs ( #5915 )
2 months ago
Mike Fährmann
7d15ea6274
[instagram] fix 'AttributeError' in GraphQL pagination ( #5920 )
2 months ago
Mike Fährmann
c372242a06
[koharu] add 'favorite' extractor ( #5893 )
2 months ago
Mike Fährmann
2bf76461ce
[deviantart:following] use OAuth API endpoint ( #2511 )
2 months ago
Mike Fährmann
095f278d6f
[vsco] add 'include' option ( #5911 )
2 months ago
Mike Fährmann
ff58683b76
[koharu] send necessary headers for image downloads ( #5893 )
2 months ago
Mike Fährmann
399ba85841
[fallenangels] remove module
2 months ago
Mike Fährmann
84eefeebd6
[sankaku] match URLs with 'www' subdomain ( #5907 )
2 months ago
Mike Fährmann
279854cd9e
[agnph] implement 'tags' option ( #5284 )
2 months ago
Mike Fährmann
d2dda2bc00
[paheal] implement fast '--range' support ( #5905 )
2 months ago
Mike Fährmann
ca3e7a5e5a
[koharu] add 'date', simplify 'tags' ( #5893 )
2 months ago
Mike Fährmann
9c91935fe4
merge #5904 : [dynastyscans] extract chapter 'tags'
2 months ago
enduser420
5a36da2968
[dynastyscans] extract chapter 'tags'
2 months ago
Mike Fährmann
8a6e208605
[zerochan] fix 'Invalid control character' errors ( #5892 )
2 months ago
Mike Fährmann
aa6d00613f
[cien] initial support ( #2885 , #4103 , #5240 )
2 months ago
Mike Fährmann
65d7cccaf9
merge #5899 : [redgifs] support URLs with numeric IDs ( #5898 )
2 months ago
Mike Fährmann
c9aeedeafd
[koharu] add 'gallery' and 'search' extractors ( #5893 , #4707 )
2 months ago
reasonabledoubt
f8a7a61f67
Update redgifs.py to include 0-9 regex
2 months ago
Mike Fährmann
226ead728e
[agnph] add 'tag' and 'post' extractors ( #5284 , #5890 )
2 months ago
Mike Fährmann
304bb4bbb8
merge #5887 : [imagefap] add '{num}' to default filenames ( #1746 )
2 months ago
ShruggZoltan
20f670c3b6
Reduce default numbering to 4 digits of zero-padding.
2 months ago
Mike Fährmann
0fcd603498
[warosu] fix extraction
2 months ago
Mike Fährmann
d7a2c73274
[util] let a CustomNone instance be equal to itself
2 months ago
Mike Fährmann
8ecd408f53
add '-J/--resolve-json' command-line option ( #5864 )
2 months ago
Mike Fährmann
70f18b7a78
[zerochan] fix tag redirections ( #5891 )
2 months ago
Mike Fährmann
b5e141ed6e
[sankakucomplex] update domain to 'news.sankakucomplex.com'
2 months ago
ShruggZoltan
db2a61ba08
Numbers images obtained from imagefap by default.
2 months ago
Mike Fährmann
f321272b7c
[ytdl] fix --cookies-from-browser option parsing
2 months ago
Mike Fährmann
540eaa5add
[tumblr] implement 'pagination' option ( #5880 )
...
restore pagination behavior from before
de670bd7de
2 months ago
Mike Fährmann
7b445ec255
[readcomiconline] update ( #5866 )
2 months ago
Mike Fährmann
5207a0c2e0
[zerochan] implement 'tags' option ( #5874 )
...
allow splitting tags into separate lists by category
2 months ago
Mike Fährmann
1aadc29c5b
[zerochan] fix 'source' extraction
2 months ago
Mike Fährmann
ae40c61c21
[zerochan] fix tag category extraction ( #5874 )
2 months ago
Mike Fährmann
3b26748264
[inkbunny:following] fix infinite loop
...
happens when number of watched users is a multiple of 20
2 months ago
Mike Fährmann
db9833c28a
merge #5870 : [aryion] add 'favorite' extractor ( #4511 )
2 months ago
Mike Fährmann
156a70bec0
[aryion] update favorite extractor
...
- add test case
- add docs/supportedsites entry
- add custom directory_fmt and archive_fmt
- remove constructor
- appease flake8
2 months ago
Mike Fährmann
36a64a3aa7
[behance] fix image extraction ( #5873 )
2 months ago
Mike Fährmann
727e53f513
[bunkr] support 'bunkr.fi' URLs ( #5872 )
2 months ago
walkenjoyer
19e98ef8e9
[aryion] Add favorite extractor ( #4511 )
2 months ago
Mike Fährmann
a595949840
[8chan] update 'TOS' cookie name ( #5868 )
2 months ago
Mike Fährmann
fef80a2f55
[zerochan] fetch metadata for each post separately ( #5869 )
...
instead of processing all posts at once before returning any of them
2 months ago
Mike Fährmann
84a634fc14
[job] add 'resolve' argument to DataJob ( #5864 )
2 months ago
Mike Fährmann
287a7d13cf
[sankaku] implement 'notes' extraction ( #5865 )
2 months ago
Mike Fährmann
026e0b97db
merge #5824 : [furaffinity] add 'folders' and 'thumbnail' ( #1284 )
2 months ago
Mike Fährmann
9a8ec95398
[furaffinity] improve
2 months ago
Mike Fährmann
6940ad0e72
[booru] allow multiple 'url' keys ( #5859 )
2 months ago
Mike Fährmann
bf44add132
[booru] prevent crash when file URL is empty ( #5859 )
...
- catch all exceptions, including IndexError, and not just a select few
- change logging message level to warning
2 months ago
Mike Fährmann
51fd14f87d
[gelbooru_v02] use total number of posts as end marker ( #5830 )
...
… and potentially retry on empty responses
2 months ago
Mike Fährmann
6110e3f940
[common] fix Logger names of BaseCategory extractors
...
update of d11ec009
fixes regressions introduced in 0c178846
2 months ago
Mike Fährmann
668219b36e
[exhentai] improve error message when temporarily banned ( #5845 )
2 months ago
Mike Fährmann
f7383a56f8
wrap filters/conditionals in a try-except block
...
allows accessing undefined fields without exception or locals().get(…)
but hides mistakes/typos/etc by evaluating to False without feedback
performance loss compared to the previous version without try-except
is negligible (~20ns for me)
2 months ago
Mike Fährmann
c83c812a1e
[instagram][twitter] rename 'profile' to 'info' ( #5262 , #3623 )
2 months ago
Mike Fährmann
16e276fca4
[nijie] fix image URLs for single image posts ( #5842 )
...
fixes regression introduced in 2e11b6e7
2 months ago
Mike Fährmann
eb3ef13d28
include 'zstd' in Accept-Encoding header when supported
...
… and slightly update optional dependency list
2 months ago
Mike Fährmann
8aca0e6970
update default User-Agent header to Firefox 128 ESR
2 months ago
Mike Fährmann
8e747b6dee
[twitter] send initial 'cursor' only when given via option
2 months ago
Mike Fährmann
ff39d28ef4
[twitter] fix 'user' when providing 'cursor' ( #5833 )
2 months ago
Mike Fährmann
65385e09cb
[twitter] remove break ( #5831 )
3 months ago
Mike Fährmann
1656c9287d
[pp:metadata] fix 'directory' when file directory has conditions ( #5728 )
3 months ago
Mike Fährmann
da9916c01f
[pp:metadata] implement format strings for 'directory' ( #5728 )
3 months ago
Mike Fährmann
8f3f061daf
[hentainexus] fix error for spread pages ( #5827 )
3 months ago
Mike Fährmann
b3aded1939
add '--print-traffic'
3 months ago
Mike Fährmann
b376fa814e
[zerochan] handle "KeyError - 'items'" ( #5826 )
...
Zerochan sometimes sends an empty response when there are no more
accessible posts to be had.
3 months ago
Mike Fährmann
97a50a23d2
[twitter] implement 'cursor' support ( #5753 )
3 months ago
Nicholas Bishop
4f3be2f571
Remove leftover split() statement
...
Forgot to remove this from a previous implementation attempt
3 months ago
Mike Fährmann
162756b684
[toyhouse] fix Content Warning bypass ( #5820 )
3 months ago
Nicholas Bishop
f43bccb5be
[furaffinity] Add 'thumbnail' ( #1284 ) and 'folders' properties
...
Retrieve 'thumbnail' and 'folders' properties for each post.
'thumbnail' (#1284 ):
- Preview image used for search results, writing posts, music, etc.
- Filename format: <post_id>@600-<directory_containing_full_image>.jpg
'Folders' (related to #1817 ):
- A list of all gallery folders containing this post
- Folder name format: [<folder_category> - ]<folder_name>
- Only works on new layout; old layout does not show folders, so list will be empty
A test is included for each property.
3 months ago
Mike Fährmann
e03b99ba0e
[actions] emit logging messages before waiting/exiting/etc
...
distinguish between actions that should run before or after
a logging message gets emitted
3 months ago
Mike Fährmann
f7a6401031
[actions] move LoggerAdapter from 'output' to 'actions'
3 months ago
Mike Fährmann
f41a5065b2
[actions] support multiple actions per pattern
3 months ago
Mike Fährmann
8219a78b8d
[actions] extend 'wait'
...
allow specifying a duration like for --sleep
3 months ago
Mike Fährmann
84b3da54aa
[actions] add 'exec' action ( #5619 )
3 months ago
Mike Fährmann
c9860002ba
[actions] add 'abort' and 'terminate' actions ( #5778 )
3 months ago
Mike Fährmann
d80f4fbc10
[actions] optimize empty patterns
3 months ago
Mike Fährmann
d10bfa9065
[vipergirls] improve 'thread' URL pattern
...
allow for query parameters and fragments at tne end of URLs
3 months ago
Mike Fährmann
ba51c1a8e4
[path] fix 1ca2cf51
3 months ago
Mike Fährmann
1ca2cf51a2
merge #5807 : [path] fix moving files across drives on Windows
3 months ago
AyluinReymaer
de61b3b546
Update path.py
3 months ago
AyluinReymaer
91a989a172
path.py - fix system cannot move file to different drive
...
This fixes the below error message:
OSError(18, 'The system cannot move the file to a different disk drive')
3 months ago
Mike Fährmann
29eb535e18
merge #5802 : [twitter] extract 'bookmark_count' and 'view_count'
3 months ago
rameerez
ee93dfeb8d
Add `bookmark_count` and `view_count` to the X / Twitter extractor
...
- Parse `view_count` as integer in Twitter extractor
- Style fix
- optimize 'view_count' extraction
3 months ago
Mike Fährmann
c2bf4ff99c
[twitter] add 'profile' extractor ( #3623 )
3 months ago
Mike Fährmann
44896b0296
[instagram] add 'profile' extractor ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
3 months ago
Mike Fährmann
ea81fa985f
[archive] implement 'archive-event' option ( #5784 )
...
With this, IDs of skipped files will no longer be written to an archive
by default. Use "archive-event": "file,skip" to restore the previous
behavior.
3 months ago
Mike Fährmann
51fdfbe6fc
[erome] extract 'date' metadata ( #5796 )
3 months ago
Mike Fährmann
9329c30b41
merge #5783 : [subscribestar] fix 'date' parsing in updated posts
3 months ago
Mike Fährmann
ea7ccb55a1
merge #5781 : [cookies] add 'thorium' support
3 months ago
joskezelensky
b2a40a5b93
add thorium cookies support
...
- Update cookies.py
- preserve lexicographical order
3 months ago
Arased
03486599af
Fix subscribestar date parsing in udated posts
3 months ago
Mike Fährmann
0bb8831853
[twitter] fix 'username-alt' option name ( #5715 )
3 months ago
Mike Fährmann
8bb793e21b
release version 1.27.1
3 months ago
Mike Fährmann
606202fb04
[fanbox] remove debug code ( #5759 )
3 months ago
Mike Fährmann
8f50c04af2
[formatter] implement 'X' format specifier ( #5770 )
3 months ago
Mike Fährmann
b707b31264
merge #5774 : [tcbscans] support other domains
3 months ago
Mike Fährmann
ad25be3420
[fanbox] fix 8452d04a
( #5759 )
...
The previous code would raise an exception when there are no or
more than 1 plans with a fee higher than 'feeRequired'.
3 months ago
enduser420
5adbfe526d
[tcbscans] support other domains
3 months ago
Mike Fährmann
f58b0e6fc7
[twitter] ignore 'Unavailable' media ( #5736 )
...
… including geo-restricted content.
add 'unavailable' option to allow re-enabling them again
3 months ago
Mike Fährmann
8452d04a33
[fanbox] handle KeyError for no longer existing plans ( #5759 )
...
return the plan of the next higher tier instead
3 months ago
Mike Fährmann
11421cf940
[skeb] fix '429 Too Many Requests' errors ( #5766 )
...
Introduce '_handle_429' method to make it easier for Extractors to react
to 429 errors regardless of 'sleep-429' settings.
3 months ago
Mike Fährmann
60b4541199
improve a1bb3279
, fix oauth:pixiv ( #5757 )
...
Check 'input' option only when required.
This also fixes an exception in oauth:pixiv caused by using the same
'_input' name as a method defined there.
3 months ago
Mike Fährmann
9671bd6d40
[actions] fix exception when 'msg' is not a string ( #5683 )
3 months ago
Mike Fährmann
4727ad6f57
[pp:ugoira] include traceback in exception debug log ( #5683 )
3 months ago
Mike Fährmann
a1bb32792b
do not try to read from stdin when it is non-interactive ( #5733 )
...
add '--no-input' command-line option and 'input' config file option
to allow users to manually configure this
3 months ago
Mike Fährmann
76385f5f18
re-categorize some command-line options in --help
3 months ago
Mike Fährmann
ae3706286a
[speakerdeck] inherit from GalleryExtractor
3 months ago
Mike Fährmann
9c65db2a92
consistent 'with open(…) as fp:' syntax
3 months ago
Mike Fährmann
3fc2e61818
add '--config-open' and '--config-status' ( #5713 )
...
adapted from 119a25a59c
3 months ago
Mike Fährmann
a92c0bef96
merge #5730 : [speakerdeck] fix extraction
3 months ago
Yuta Hayashibe
f272b5d2ac
fix: extractor for speakerdeck.com
3 months ago
Mike Fährmann
c699ce8ebb
[twitter] add 'username-alt' option ( #5715 )
3 months ago
Mike Fährmann
c6fc0281e8
[newgrounds] extend 'format' option ( #5709 )
...
- check more extensions for original formats (mp4, webm, m4v, mov, mkv)
- allow specifying which extensions and recoded formats to check
3 months ago
Mike Fährmann
86f0c3baaf
[szurubooru] support empty tag searches ( #5711 )
3 months ago
Mike Fährmann
40c685dc43
merge #5712 : [hentainexus] update key
3 months ago
KageNiHisomu
87859ff200
fix: static method defines hostname, update url link
3 months ago
KageNiHisomu
68540aef2a
update nexus key
3 months ago
Mike Fährmann
2e11b6e756
[nijie] support downloading videos ( #5707 , #5617 )
3 months ago
Mike Fährmann
e17b1d5073
[deviantart] fix 2c8aa9b2
( #5696 )
3 months ago
Mike Fährmann
f160859c5c
[hitomi] extract 'title_jpn' metadata ( #5706 )
3 months ago
Mike Fährmann
722b4b513d
merge #5609 : [instagram] extract 'liked' metadata
4 months ago
Mike Fährmann
7b0c07ee69
[instagram] rename to 'liked', enable for GraphQL results
4 months ago
Mike Fährmann
aa9be75d44
[twitter] fix duplicate ArkoseLogin check
...
forgot to replace this in 9e5d65fbf3
4 months ago
Mike Fährmann
2c8aa9b2de
[deviantart] fix watching module ID extraction ( #5696 )
4 months ago
Mike Fährmann
9abeab5ecf
[shimmie2] support 'vidya.pics' ( #5632 )
4 months ago
Mike Fährmann
162d4269ec
[twitter] extend 'ratelimit' option ( #5532 )
...
allow waiting for a set amount of seconds
4 months ago
Mike Fährmann
2cab87c5b6
[kemonoparty:favorite] fix exception when sorting None ( #5692 )
4 months ago
Mike Fährmann
7614bc458e
[util] extend CustomNone with comparison operators
4 months ago
Mike Fährmann
1ce5de0290
[formatter] implement 'C' format specifier ( #5647 )
...
to apply a conversion after ':' or
to apply multiple conversions
for example {tags:CSl} or {tags:J - /Cl}
to convert list to string and lowercase it
4 months ago
Mike Fährmann
9b99d2c886
[philomena] support downloading SVG files ( #5643 )
4 months ago
Mike Fährmann
8fce9ea6d5
[hentainexus] restore module ( #5275 )
...
revert 97641cd151
4 months ago
Mike Fährmann
3ec7ee6baa
[downloader:ytdl] fix exception due to missing 'ext' ( #5675 )
4 months ago
Mike Fährmann
5d3d03a1f1
fix 6cfbc107
...
the former condition would return True for 2.31.*
6cfbc1071f (commitcomment-142642913)
4 months ago
Mike Fährmann
4d11cd9ffb
[vichan] remove 'wikieat.club'
...
redirects to some non-vichan site
4 months ago
Mike Fährmann
31133b97fb
[nitter] remove instances
4 months ago
Mike Fährmann
ce228ee163
[photobucket] remove module
...
had been broken for years and the new site is payed access only
4 months ago
Mike Fährmann
612435480a
[workflows:tests] restore Python 3.5 usage
...
https://github.com/actions/setup-python/issues/866
4 months ago
Mike Fährmann
31bdb288ef
release version 1.27.0
4 months ago
Mike Fährmann
6cfbc1071f
workaround for requests 2.32.3 ( #5665 )
...
manually call 'load_default_certs()' for SSLContexts
in custom HTTPAdapter instances
4 months ago
Mike Fährmann
807e2f7094
[realbooru] fix videos and provide fallback URLs ( #2530 )
...
revert acc94ac187
.
4 months ago
Mike Fährmann
deacbcbfdf
[tbscans] remove excess whitespace in 'manga'
4 months ago
Mike Fährmann
00440b8fb1
[slideshare] fix extraction
4 months ago
Mike Fährmann
281ab33f87
[4archive] fix extraction
4 months ago
Mike Fährmann
a53db09ca0
[artstation] disable TLS 1.2 ciphers by default ( #5564 , #5658 )
4 months ago
Mike Fährmann
7ba2b209f1
fix exit status of --clear-cache/--list-modules/--list-extractors
...
All three would always cause gallery-dl to exit with status 1,
regardless of error or success.
4 months ago
Mike Fährmann
3d033a48ea
[workflows:executables] change dev/linux binary name to …_linux
...
This reverts commit 05f8435e09
.
4 months ago
Mike Fährmann
53aadb0c44
[update] implement '--update-to'
...
to switch between update channels (stable or dev (alias nightly & master))
or to install a specific version
Examples:
--update-to dev
--update-to dev@2024.05.25
--update-to v1.25.2
4 months ago
Mike Fährmann
5018bd42f8
[update] implement '--update-check'
...
to check if a new update is available without downloading it
4 months ago
Mike Fährmann
2e323ef0a2
[update] implement '-U/--update'
...
to auto-update executable files in-place
4 months ago
Mike Fährmann
601f5becc8
[version] add __variant__
...
Specifies origin and OS of executable files.
For example 'stable/windows'.
4 months ago