Mike Fährmann
|
231bcad614
|
[shopify] use BaseExtractor
|
4 years ago |
|
Mike Fährmann
|
1e3dd7330e
|
merge SharedConfigMixin functionality into Extractor
|
4 years ago |
|
Mike Fährmann
|
d06ad148c7
|
[shopify] use alternate regex for products on collection pages
when the first on doesn't yield any results
|
4 years ago |
|
Mike Fährmann
|
e89413da22
|
update test results
|
5 years ago |
|
Mike Fährmann
|
feb98cf196
|
[twitter] improve 'content' formatting; add option (#338)
- include emoticons
- leave newlines intact
- remove pic.twitter.com/ links at the end
|
5 years ago |
|
Mike Fährmann
|
fdec59f8e2
|
replace extractor.request() 'expect' argument
with
- 'fatal': allow 4xx status codes
- 'notfound': raise NotFoundError on 404
|
5 years ago |
|
Mike Fährmann
|
bc6b0cfddc
|
[shopify] skip consecutive duplicate products
Not filtering duplicate URLs anymore caused the archive ID uniqueness
test to fail.
|
5 years ago |
|
Mike Fährmann
|
aa1ca4ed35
|
[shopify] skip deleted products (#175)
Product pages which return a 4xx status code will now be skipped instead
of raising an exception.
|
5 years ago |
|
Mike Fährmann
|
591a07f20c
|
small code changes and cleanups
|
6 years ago |
|
Mike Fährmann
|
09d872a2b1
|
generalize extractor creation code
|
6 years ago |
|
Mike Fährmann
|
8dc6be246b
|
[shopify] add custom retry logic for 430 status codes (#175)
|
6 years ago |
|
HRXN
|
56e0e92e0d
|
[shopify] cosmetic changes in shopify.py (#181)
Glanced over the commits, randomly spotted some minor things.
|
6 years ago |
|
Mike Fährmann
|
9c0e2f294b
|
[shopify] add generic collection and product extractors (#175)
with fashionnova.com as a default domain
|
6 years ago |
