780b6adb91
rename 'generate_csrf_token()' to just 'generate_token()'
...
and add a 'size' argument
4 years ago
8a88025dc4
[pinterest] support generic user URLs ( #1205 )
...
i.e. https://www.pinterest.com/USERNAME
also renames 'BoardsExtractor' to 'UserExtractor'
4 years ago
6cdbab07b5
[pinterest] add support for getting all boards of a user
...
(#1205 )
4 years ago
371e9ca6df
[pinterest] implement video support ( closes #1189 )
4 years ago
b8daabc3ca
[pinterest] implement login support ( closes #1055 )
...
being logged allows access to secret/protected boards
4 years ago
26a967cbd4
[pinterest] match 'pinterest.co.uk' URLs ( fixes #914 )
4 years ago
0e714b9a0e
[pinterest] add 'section' extractor ( #835 )
4 years ago
5ba90f72ca
[pinterest] add support for sections ( closes #835 )
4 years ago
32d7195d08
[pinterest] improve detection of invalid pin.it links
5 years ago
1f2a69f3c5
add '_extractor' information to redirect results
5 years ago
c4702ec9b6
simplify some logging calls
5 years ago
da6789b2b0
disable unique archive id checks for some tests
...
- same image twice in a livedoor blog post
- unreliable results for related pinterest items
5 years ago
4409d00141
embed error messages in StopExtraction exceptions
5 years ago
fdec59f8e2
replace extractor.request() 'expect' argument
...
with
- 'fatal': allow 4xx status codes
- 'notfound': raise NotFoundError on 404
5 years ago
4b1880fa5e
propagate 'match' to base extractor constructor
6 years ago
6284731107
simplify extractor constants
...
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
6 years ago
6126615698
update URLs for supportedsites.rst
6 years ago
98c6520384
[pinterest] update root URL of API calls
6 years ago
40e30694f3
[pinterest] fix pin.it redirects
6 years ago
7f6a0be982
adjust some tests
6 years ago
3bdfc15be1
[pinterest] don't crash on pins without image info
6 years ago
1532d1b690
fix 'range' tests and update a few test results
6 years ago
d3f1eed2a6
[pinterest] improvements
...
- add stop condition for pin-related pins
- improve URL patterns
- make Pylint happy
6 years ago
63fa0b2006
[pinterest] add extractors for related pins
...
Related pins can not be accessed by adding a "#related" fragment
to the end of a Pinterest URL, for example:
- https://www.pinterest.com/pin/858146903966145189/#related
- https://www.pinterest.com/g1952849/test-/#related
There are no explicit real URLs for related pins,
using an option to enable them results in "clunky" code,
and a custom "related:<URL>" scheme doesn't feel right either.
6 years ago
a86f2bfc80
[pinterest] update not-found redirects
6 years ago
b8c97d2295
use 'extractor.request()' for more HTTP requests
6 years ago
017188d268
improve extractor.request()
...
Replace the 'fatal' parameter with 'expect', which is a list/range
of HTTP status codes >= 400 that should also be accepted.
6 years ago
e1e23165a0
[pinterest] catch JSON decode errors
6 years ago
2ea0d1da42
[smugmug] improve API code; use data expansions
6 years ago
2395d870dd
[pinterest] unquote board and user names, better errors
6 years ago
0f1e07f627
[pinterest] scrap OAuth implementation; code improvements
...
OAuth authentication isn't needed anymore and other tools
like Postman are better suited for this job anyway.
6 years ago
55d4d23860
[pinterest] use Pinterest's "Web" API ( #83 )
...
no access tokens, no user credentials of any kind ...
7 years ago
d10579edb5
[pinterest] improve PinterestAPI code; remove OAuth mentions
...
on another note: access_tokens have been set to only allow for
10 requests per hour (from 200 yesterday)
7 years ago
4bd182c107
[pinterest] implement `oauth:pinterest` ( #83 )
...
Pinterest access tokens are rate limited at 200 requests per
hour (or maybe per 2 or 3 hours?) so having just one access token
for all users isn't going to work in the long run.
7 years ago
9651f3fce0
[pinterest] improve error messages ( #83 )
7 years ago
dbe250f7e5
[pinterest] update access_token ( #83 )
7 years ago
e32fe1cdf1
[pinterest] cast IDs to int
...
... and update test results.
Image URLs changed from
https://s-media-cache-ak0.pinimg.com/ ... to
https://i.pinimg.com/ ...
7 years ago
34873dbd90
set 'archive_fmt' values
...
These are going to be used to create an unique id for each image.
7 years ago
421a9740a3
[tumblr] add 'tumblr:' to force Tumblr extractor ( #71 )
7 years ago
0dedbe759c
enable '--chapter-filter'
...
The same filter infrastructure that can be applied to image URLS now
also works for manga chapters and other delegated URLs.
TODO: actually provide any metadata (currently supported is only
deviantart and imagefap).
7 years ago
6f30cf4c64
change keyword names to valid Python identifiers
...
This commit mostly replaces all minus-signs ('-') in keyword names with
underscores ('_') to allow them to be used in filter-expressions. For
example 'gallery-id' got renamed to 'gallery_id'.
(It is theoretically possible to access any variable, regardless of its
name, with 'locals()["NAME"]', but that seems a bit too convoluted if
just 'NAME' could be enough)
7 years ago
54c0715135
allow users to set their own API access_tokens/client_ids
7 years ago
c45770331a
use 'str.partition()'
...
The (r)partition method is always faster then split() or any other
method that has been replaced in this commit.
7 years ago
c184e47ee3
put common directory- and filename formats in base classes
7 years ago
9f1c83297f
[pinterest] allow URLs with any TLD
7 years ago
94e10f249a
code adjustments according to pep8 nr2
8 years ago
d82508f245
fix tests for turboimagehost and pinterest
8 years ago
3434c5a026
[pinterest] add support for pin.it URLs
8 years ago
a8d716c043
[pinterest] tests + fix error message
8 years ago
02a441503a
[pinterest] adjust regex pattern
8 years ago
Mike Fährmann