a453335a9f
remove test results in extractor modules
...
and add generic example URLs
1 year ago
a383eca7f6
decouple extractor initialization
...
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().
This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
1 year ago
d97b8c2fba
consistent cookie-related names
...
- rename every cookie variable or method to 'cookies_*'
- simplify '.session.cookies' to just '.cookies'
- more consistent 'login()' structure
1 year ago
b6c959744d
[furaffinity] improve 'description' HTML ( #4224 )
...
- ignore header
- include footer and closing <div> if present
1 year ago
5e3a1749c8
[furaffinity] simplify 'favorite_id' assignment
1 year ago
952c03bc9e
Add fav_id data to FuraffinityFavoriteExtractor
...
An extra field is collected when paginating favorites, and saved to
a temporary cache variable. This field is identical for both the old
and the new page layouts for FurAffinity, but can only be collected
during pagination, hence the cache variable. Other FurAffinity
extractors should be unaffected by this change.
1 year ago
b0cb4a1b9c
replace 'text.extract()' with 'text.extr()' where possible
2 years ago
c4cc387f7d
[furaffinity] fix search result pagination ( fixes #2402 )
3 years ago
f1c853c6ef
[furaffinity] add 'layout' option ( #2277 )
...
to be able to force gallery-dl to parse according to a specific layout
in case its auto-detect fails
3 years ago
4efe56f419
[furaffinity] improve new/old layout detection ( fixes #2277 )
3 years ago
87ce3fa669
[furaffinity] warn when no session cookies were found
3 years ago
975e0a4fe0
[furaffinity] unquote search queries ( #1958 )
...
instead of unescape
(unquote -> url params, unescape -> html entities)
3 years ago
6b229ac829
[furaffinity] expand URL pattern for searches ( closes #1780 )
3 years ago
a5de2244d4
[furaffinity] fix using 'category-tranfer' ( #1274 )
3 years ago
5b1c62bfa9
[furaffinity] add 'external' option ( closes #1492 )
3 years ago
4adc44df69
[furaffinity] improve metadata extraction ( fixes #1630 )
...
Fetch 'title' and 'artist' metadata from a different location,
since for posts with an empty title the <title> element is
completely empty and does not contain the artist's name.
3 years ago
2919d78bfc
update extractor test results
4 years ago
89a2bcbb2d
[furaffinity] add 'descriptions' option ( #1231 )
4 years ago
968d3e8465
remove '&' from URL patterns
...
'/?&#' -> '/?#' and '?&#' -> '?#'
According to https://www.ietf.org/rfc/rfc3986.txt , URLs are
"organized hierarchically" by using "the slash ("/"), question
mark ("?"), and number sign ("#") characters to delimit components"
4 years ago
844502cad5
update extractor test results
4 years ago
dcf3ad7eef
[furaffinity] update download URL extraction ( fixes #988 )
...
support the new 'd2.facdn.net' subdomain
4 years ago
063c71cd84
[furaffinity] add 'search' extractor ( closes #915 )
4 years ago
ffb6c5277a
[furaffinity] add 'artist_url' metadata field ( closes #821 )
4 years ago
fa2952ac55
[furaffinity] add 'following' extractor ( #515 )
4 years ago
d3482ace7f
[furaffinity] extract more metadata
...
- views
- favorites
- comments
- rating
- fa_category (since 'category' is already in use)
- theme
- species
- gender
- width
- height
5 years ago
4e361b3008
add tests for specific datetime values
5 years ago
650f2b6d58
[furaffinity] accept sfw.furaffinity.net URLs ( closes #608 )
...
Just as an alias for regular URLs with no extra content filtering.
5 years ago
c7cf9dd111
[furaffinity] support classic layout ( #284 )
5 years ago
138135c190
[furaffinity] add extractors ( #284 )
5 years ago
Mike Fährmann