89a67c45e0
[nitter] support nitter.it ( #3819 )
2 years ago
197882cf12
[twitter] add 'hashtag' extractor ( #3783 )
2 years ago
46fdf46f21
[formatter] support loading an f-string from a template file
...
"\fTF ~/path/to/file.txt"
2 years ago
1a4d4a799b
[formatter] support filesystem paths for \fM
2 years ago
00f0233b28
[postprocessor:metadata] add 'skip' option ( #3786 )
2 years ago
a1ca2404f9
add 'globals' instead of overwriting the default ( #3773 )
2 years ago
17bd053d94
[hiperdex] fix extraction ( #3768 )
2 years ago
fcaeaf539c
[downloader:http] handle exceptions while consuming content
2 years ago
817fc0fbd1
[nitter] remove nitter.pussthecat.org
...
"Shutdown"
2 years ago
df77271438
[downloader:http] add 'consume-content' option
...
* fix connection not being released when the response is neither
successful nor retried
* add the ability to consume the HTTP response body instead of closing
the connection
reference:
https://docs.python-requests.org/en/latest/user/advanced/#body-content-workflow
2 years ago
da9840a39d
[reddit] update 'videos' option ( #3712 )
...
- add 'dash' to directly extract DASH manifest URLs
(was default behavior since a7c79531a7c79531
2 years ago
baf41d7437
[misskey] update ( #3717 )
...
- add module docstring
- add options to docs/gallery-dl.conf
2 years ago
e1867cf5eb
[misskey] add 'renotes' and 'replies' options
2 years ago
a95b5e0d8e
[misskey] add misskey extractors
2 years ago
0d142e403c
[szurubooru] add 'tag' and 'post' extractors ( #3583 , #3713 )
2 years ago
075c965512
add '--config-create' command-line option
...
(#2333 )
2 years ago
632d5d7745
allow loading config files in TOML format with --config-toml
2 years ago
d788e6c60c
implement 'globals' option
2 years ago
b14f8d5817
[gelbooru] add 'favorite' extractor ( #3704 )
...
requires logged in cookies to work
2 years ago
e480a93337
add 'output.stdout', '.stdin', and '.stderr' options
...
(#1621 , #2152 , #2529 )
Allow setting custom input/output encodings and options
without having to rely on Python's defaults.
2 years ago
6ed4309aba
[deviantart] add 'gallery-search' extractor ( #1695 )
2 years ago
e1df7f73b1
[deviantart] add 'search' extractor
...
(#538 , #1264 , #2954 , #2970 , #3577 )
Requires login to fetch any results, since the API endpoint raises an
error for not logged in requests.
TODO: parse HTML search results
2 years ago
bb11c2a576
merge #3662 : [redgifs] add 'collection' extractors
2 years ago
884f1848d6
[redgifs] fix syntax for older Python versions
...
and update docs/supportedsites
2 years ago
2bd8f2f4bd
[pornpics] add 'search' and 'tag' extractors
...
(#263 , #3544 , #3654 )
2 years ago
79bc82884c
[pornpics] add 'gallery' extractor ( #263 , #3544 , #3654 )
2 years ago
bd5d08abbc
[catbox] add 'file' extractor ( #3570 )
2 years ago
2a53e6445c
[bunkr] update domain ( #3636 )
2 years ago
b7337d810e
[postprocessor:metadata] add 'sort' and 'separators' options
2 years ago
762a68996b
implement 'archive-pragma' option
2 years ago
bbf0911a46
[e621] implement 'notes' and 'pools' metadata extraction
...
(#3425 )
2 years ago
925b467496
split e621 from danbooru module ( #3425 )
2 years ago
1ae48a54f8
[twitter] add 'transform' option
2 years ago
78d3960a31
[postprocessor:exec] implement archive options ( #3584 )
2 years ago
0f7e6c422a
merge #3596 : [shopify] support ohpolly.com
2 years ago
fcf7030b85
[shopify] support ohpolly.com
2 years ago
4572c122d8
document 'extractor.module-sources'
2 years ago
c2bc70593e
implement ability to load external extractor classes
...
- -X/--extractors
- extractor.module-sources
2 years ago
13a90969c7
merge #3575 : [nudecollect] add 'image' and 'album' extractors
2 years ago
abc3619feb
[lexica] add 'search' extractor ( #3567 )
2 years ago
f58215705a
add '-O/--postprocessor-option' command-line option ( #3565 )
2 years ago
2a5903dc16
[nudecollect] add 'image' and 'album' extractors
2 years ago
58c008e30a
[hiperdex] update domain ( #3572 )
2 years ago
caae8fefe1
merge #3541 : [deviantart] add extractor for status updates
2 years ago
3b32671fbd
[deviantart] add extractor for status updates
...
extract user status updates using the '/user/statuses/' endpoint
2 years ago
5cb263fdd2
[wikifeet/wikifeetx] add 'gallery' extractor
2 years ago
4e86aaa4db
document 'extractor.headers' and 'extractor.ciphers'
2 years ago
c881548a27
add 'extractor.retry-codes' option ( #3313 )
...
do not retry 429 and 430 by default
2 years ago
512abeb4ae
[booru] add 'url' option
2 years ago
c87bd1a752
[danbooru] extend 'metadata' option
...
make it possible to specify a custom list of metadata includes
2 years ago
c0d7d2be35
[downloader:http] add 'validate' option
2 years ago
4833ec323e
[imagefap] add 'folder' extractor ( #3504 )
2 years ago
cb9d100bac
update Authentication support in docs
...
https://github.com/mikf/gallery-dl/pull/3075#issuecomment-1374723412
2 years ago
362cd6991b
[pixiv] implement 'metadata-bookmark' option ( #3417 )
2 years ago
0895e6afee
merge #3462 : [docs] Update links and fix field typo
2 years ago
4b9bb632f2
[docs] update links
2 years ago
d1dd52349a
merge #3189 : [tcbscans] add 'chapter' and 'manga' extractors
2 years ago
ac78712618
merge #3496 : [docs] update OAuth guide in README.rst
2 years ago
2f31d21509
merge #3455 : [twitter] apply tweet type checks before uniqueness check
2 years ago
64435cc37e
[twitter] update docs
2 years ago
b125fcafc5
update docs/configuration.rst
...
- document metadata.indent
- add concrete mappings to object types
- fix lists for code examples
- fix typos
2 years ago
e8541a131d
[tcbscans] add 'chapter' and 'manga' extractors
2 years ago
3c03928d75
simplify 'docs/options.md' generation
...
use the plain text output from '--help'
instead of trying to generate 'fancy' HTML with Markdown restrictions
2 years ago
c94692f39b
[docs] document 'access-token' for Mastodon instances
2 years ago
4fd6da474f
merge #3473 : [twitter] fix crash when using 'expand' and 'syndication'
2 years ago
818f6fa71f
merge #3453 : [twitter] document #1396 and #2712
2 years ago
455481ad76
[twitter] improve documentation
...
This includes:
- The automatic expansion of conversations (#2712 )
- How to retrieve age-restricted content from search results (#1396 )
2 years ago
f29ba089ff
merge #3474 : [fanleaks] add 'post' and 'model' extractors
2 years ago
6933727b45
merge #3483 : [twitter] implement 'syndication=extended'
2 years ago
9116398c1c
[pinterest] add 'domain' option ( #3484 )
...
use input URL domain by default
2 years ago
f1a715dbcd
improve docs/options.md
...
- use non-breaking hyphens
- don't replace '…' in examples
- don't force width for long option column
2 years ago
294108c90a
[pinterest] support 'All Pins' boards ( #2855 , #3484 )
2 years ago
13c16490bd
handle subcategory names ending with 'y'
2 years ago
50d89d4acb
docs/options.md: use a separate table for each option group
2 years ago
7de6b7f489
add list of command-line options as docs/options.md ( #3464 )
2 years ago
6853b14be3
[twitter] apply suggestions from code review
...
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2 years ago
4611237f8c
merge #3457 : [danbooru] extract uploader metadata (if option is set)
2 years ago
e7522482bb
merge #3463 : [lynxchan] support 'bbw-chan.nl'
2 years ago
0ed5986062
document custom 'output.mode' ( #2529 )
2 years ago
5a740ef78b
[fanleaks] add 'post' and 'model' extractors
2 years ago
7c8eab8d52
[twitter] implement 'syndication=extended'
...
to be able to fetch extended user metadata
2 years ago
be3286206a
[twitter] assume 'conversation_id' when using syndication
...
not possible to expand replies at the momemt
2 years ago
ce8dbb1ccc
[twitter] fix crash when using 'expand' and 'syndication'
...
caused by KeyError: 'conversation_id_str'
2 years ago
d651d45239
implement specifying ranges in slice notation ( #918 , #2865 )
...
e.g.
- '1:101' or ':101' or ':101:' for files 1 to 100
- '1::2' or '::2' for every second file
- '1:101:5' or ':101:5' for files 1, 6, 11, ..., 91, 96
(the second argument specifies the first index NOT included)
2 years ago
527bb2c4ab
[lynxchan/bbw-chan] add 'thread' and 'board' extractors
2 years ago
64902f518e
[docs] Update links and fix field typo
2 years ago
5d5ea58887
[twitter] update docs for 'quoted' & 'unique'
2 years ago
f82ee93676
[danbooru] extract uploader metadata (if metadata is set)
2 years ago
1800bd7d14
allow '*-filter' options to be a list of expressions
2 years ago
73ab5d84c0
update docs/configuration.rst
2 years ago
bee354c264
Merge pull request #3415 from enduser420/extractor/fapello
...
[fapello] add 'post', 'user' and 'path' extractors
2 years ago
dd4a4a3fa6
[e621] softcode the pagination threshold
2 years ago
e5076ba056
[fapello] add 'post', 'user' and 'path' extractors
2 years ago
d0ad6d0e67
[e621] implement manual pagination mode
2 years ago
1317625ec4
[webmshare] add 'video' extractor ( #2410 )
2 years ago
41bf236d36
[lynxchan] add generic extractors for lynxchan imageboards ( #3394 )
...
* [lynxchan] add generic extractors for lynxchan imageboards
includes kohlchan.net, endchan.org:wq
* [lynxchan] set pop default to empty tuple
* Apply suggestions from code review
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2 years ago
3c75c3bbc4
[soundgasm] add 'user' extractor ( #3384 )
...
based on code from PR #3388 by @enduser420
2 years ago
2952add4a8
[reddit] increase 'id-max' default value ( #3397 )
...
to float("inf")
2 years ago
6b6f886dcf
[bunkr] update domain ( #3391 )
...
and improve bunkr/app.bunkr handling
2 years ago
eb94568e1f
[soundgasm] add 'audio' extractor ( #3384 )
2 years ago
Mike Fährmann