76581c13f7
handle URLs without '/' after their TLD ( #5252 )
7 months ago
ba062712ad
[tests] '__main__' -> "__main__"
7 months ago
05255f5be0
add 'default' argument to 'text.extr()'
2 years ago
eb33e6cf2d
add 'text.extr()'
...
a stripped-down version of text.extract() that
- always returns a string (like 'extract_from')
- only returns a string
- does not deal with 'pos' arguments
- is ~20% faster
2 years ago
67bad04dda
[formatter] add 'g' conversion to sluGify a string ( #2410 )
2 years ago
bddcec49f1
implement 'text.root_from_url()'
...
use domain from input URL for kemono
3 years ago
bc868e7bb8
consider apparently long extensions as part of the filename
...
(#1516 )
3 years ago
387fe415d5
unescape items in text.split_html()
4 years ago
78fd63b8f0
remove 'text.clean_xml()'
...
was not used anywhere
4 years ago
8553b218d9
replace calls to 'os.path.splitext()' with 'str.rpartition()'
...
Makes functions who used it more than twice as fast
and we can get rid of an import as well.
4 years ago
37d71f6e09
strip microseconds in text.parse_datetime()
4 years ago
6294e2c540
add 'text.ensure_http_scheme()'
4 years ago
5df8f2959b
insert local directory into PYTHONPATH when running tests
4 years ago
a0f4c295c0
add optional 'utcoffset' argument to 'parse_datetime()'
5 years ago
b1bea8aaeb
add 'restrict-filenames' option ( #348 )
5 years ago
b171befa87
implement 'parse_unicode_escapes()'
5 years ago
2b1999476e
implement 'text.rextract()'
5 years ago
2316e0ed3d
fix strptime workaround from b0e85a4
...
Don't return a modified version of 'date_time' if strptime fails.
5 years ago
b0e85a42e3
apply workaround from 4736912 in parse_datetime() itself
5 years ago
4736912d4e
[pixiv] work around strptime limitations in Python < 3.7
...
"%z" doesn't allow a colon separator in older Python versions:
- "+0900" is OK
- "+09:00" raises an exception
5 years ago
d09864b581
implement text.parse_datetime()
5 years ago
6264a46212
use 'utcfromtimestamp()'
...
'fromtimestamp()' converts its results to the local timezone and causes
problems when running tests on a different machine.
5 years ago
d670de0344
implement 'text.parse_timestamp()'
5 years ago
21a7e395a7
implement convenience wrapper for text.extract functionality
6 years ago
5530871b5a
change results of text.nameext_from_url()
...
Instead of getting a complete 'filename' from an URL and splitting that
into 'name' and 'extension', the new approach gets rid of the complete
version and renames 'name' to 'filename'. (Using anything other than
{extension} for a filename extension doesn't really work anyway)
Example: "https://example.org/path/filename.ext "
before:
- filename : filename.ext
- name : filename
- extension: ext
now:
- filename : filename
- extension: ext
6 years ago
e1d3e9a926
add 'ext_from_url' to text.py
6 years ago
2d2953a5bf
add 'text.parse_float()' + cleanup in text.py
6 years ago
ae9a37a528
implement text.split_html()
6 years ago
cc36f88586
rename safe_int to parse_int; move parse_* to text module
7 years ago
4ffa94f634
remove 'shorten_path()' and 'shorten_filename()'
7 years ago
27eab4e467
rewrite text tests and improve functions
...
- test more edge cases
- consistently return an empty string for invalid arguments
- remove the ungreedy-flag in 'remove_html()'
7 years ago
e3f2bd4087
add tests for 'text.clean_xml()' and improve it
7 years ago
6d8b191ea7
improve 'parse_query()' and add tests
...
- another irrelevant micro-optimization !
- use urllib.parse.parse_qsl directly instead of parse_qs, which
just packs the results of parse_qsl in a different data structure
- reduced memory requirements since no additional dict and lists are
created
7 years ago
4f123b8513
code adjustments according to pep8
8 years ago
eeae580781
more tests
9 years ago
ca523b9f64
add helper method to text module
9 years ago
cba4b91b14
add tests
9 years ago
2962bf36f6
add tests for text-module
9 years ago
Mike Fährmann