c2bc70593e
implement ability to load external extractor classes
...
- -X/--extractors
- extractor.module-sources
2 years ago
f58215705a
add '-O/--postprocessor-option' command-line option ( #3565 )
2 years ago
dfe7b23579
support Firefox containers for --cookies-from-browser ( #3346 )
2 years ago
46d811bac0
add loaded config files to debug output
2 years ago
597b63d922
move git head functionality to function in util.py
2 years ago
b337e51e91
run flake8 on all .py files
2 years ago
e140b85342
reword error text for unsupported URLs
2 years ago
a6e2d96dde
fix bug when processing input file comments ( #2808 )
...
and move 'parse_inputfile()' to util.py
2 years ago
bdad9c40dd
remove whitespace before comments in input file URLs ( #2808 )
2 years ago
764906e1af
allow tabstops as whitespace before input file comments ( #2808 )
2 years ago
d0adc13e23
allow comments after input file URLs ( #2808 )
...
everything after the first " #" (space + hash) gets ignored
2 years ago
74865adae5
implement 'format-separator' option ( #2737 )
...
a global option, that servers as a workaround for shortcomings due to
lack of a proper format string parser
2 years ago
603af48265
implement 'output.ansi' option ( #2628 )
2 years ago
688d6553b4
replace calls to print() with stdout_write() ( #2529 )
2 years ago
6742f3bc1e
implement --cookies-from-browser ( #1606 )
...
most of the code is adapted from yt-dlp's implementation
and *should* work the same.
2 years ago
9e6c981388
replace '\f' in --filename arguments with form feed character
...
to make it easier to use special type format strings on command-line
(#2396 )
2 years ago
f5b2a9fcc6
add 'signals-ignore' option ( #2296 )
3 years ago
4edf43891c
add -d/--directory and -f/--filename command-line arguments
3 years ago
45ca1693d8
add indicator to debug output when using a standalone executable
3 years ago
4048eabeab
allow 'extractor.modules' to be a string
...
with comma-separated module names
3 years ago
e9993451c3
remove Python version checks
3 years ago
dfe1e09df0
add '-T/--terminate' command-line option ( #1399 )
3 years ago
c693db5b1a
add '"skip": "terminate"' option
...
Stops not only the current extractor/job,
but all parent extractors/jobs as well.
3 years ago
755164b36a
improve --clear-cache ( #1230 )
...
Allow for an optional argument to only delete cached entries from
a specific module.
delete all cache entries
$ gallery-dl --clear-cache
or
$ gallery-dl --clear-cache all
only delete entries for instagram
$ gallery-dl --clear-cache instagram
3 years ago
a86ffb04bb
add 'output.fallback' option
...
to enable/disable fallback URLs for -g/--get-urls
3 years ago
2e8061091a
Adding handling of several input files ( #1353 )
...
* Adding handling of several input files
* Fixed flake8 error due to bad indenting
4 years ago
5bcf28de93
add a 'extractor.modules' option
4 years ago
6ecb0a19cf
handle sys.stdin being None when using '-' as input file ( #653 )
5 years ago
4bc161ca0f
prevent crash when sys.stdout and co. are None ( #653 )
5 years ago
383795b550
prevent superfluous calls to Logger.makeRecord()
...
… by setting an appropriate minimal logging level for the root Logger.
5 years ago
f5604492c3
update interface of config functions
5 years ago
5af291ba5c
include failed downloads and child extractors in exit status
5 years ago
03e0cec715
return with non-zero exit status on error
5 years ago
5ac9732adc
call 'sys.exit()' on Ctrl+c
5 years ago
6393b47db2
add '-A/--abort'; deprecate '--abort-on-skip'
5 years ago
bd9cb3d191
improve job class selection code
...
+ consistent argument order for add_argument() calls
5 years ago
e64773ffdd
allow multiple post-processor command-line options ( #253 )
...
... without overwriting any previous ones
5 years ago
bc26fc2439
implement '--clear-cache'
...
Effectively clears all cached values from the cache database by
executing "DELETE FROM data" without any further user input.
5 years ago
176b7253a1
update function signature for config.load()
6 years ago
ae353ed3b0
provide "extractor" and "job" keys for logging output
...
This allows for stuff like "{extractor.url}" and "{extractor.category}"
in logging format strings.
Accessing 'extractor' and 'job' in any way will return "None" if those
fields aren't defined, i.e. in general logging messages.
6 years ago
bc0951d974
allow for simplified test data structures
...
Instead of a strict list of (URL, RESULTS)-tuples, extractor result
tests can now be a single (URL, RESULTS)-tuple, if it's just one test,
and "only matching" tests can now be a simple string.
6 years ago
344bbaa71a
remove useless line
...
A remnant from when `filter` and `range` were global and only
available as command line options.
6 years ago
e26ba682a2
enforce utf-8 encoding for input files ( #120 )
6 years ago
a36259d8f1
update setup.py
...
- add Python version check
- add classifiers
- simplify sys.exit() usage
6 years ago
0514d6a0ae
make --filter and --range config-file options
...
The functionality of --(chapter-)filter and --(chapter-)range are now
also exposed as the following config-file options:
- extractor.*.image-filter
- extractor.*.image-range
- extractor.*.chapter-filter
- extractor.*.chapter-range
TODO: update configuration.rst
6 years ago
39f609b4c6
include current Git HEAD in debug output
6 years ago
e8311eb1ed
drop Python 3.3 support
6 years ago
12797e3b1f
update configuration.rst
...
... again
- some more 'Path' references
- fixed some inconsistencies and errors
- added note about logging config for files
6 years ago
b08d95ebe4
add an 'encoding' option for logging files (default 'utf-8')
6 years ago
2df1a15fb8
add '-s/--simulate' to run data extraction without download
...
Useful for quick testing (even though -g and -j kind of do the same)
and to fill a download archive without actually downloading the files.
-s does the same as the default behaviour, except downloading stuff.
Maybe it should get a more fitting name, as it does actually write to
disk (cache, archive)?
6 years ago
Mike Fährmann