Mike Fährmann
|
a453335a9f
|
remove test results in extractor modules
and add generic example URLs
|
1 year ago |
|
enduser420
|
96e3dd2128
|
[shopify] fix 'collection' extractor
|
1 year ago |
|
enduser420
|
fcf7030b85
|
[shopify] support ohpolly.com
|
2 years ago |
|
Mike Fährmann
|
feb470d19a
|
[shopifx] natively support a few more sites (closes #2089)
- chelseacrew.com
- michaels.com.au
- modcloth.com
- pinupgirlclothing.com
- raidlondon.com (loveraid.com)
- unique-vintage.com
|
2 years ago |
|
Mike Fährmann
|
d26da3b9e5
|
add pre-generated 'pattern' for supported BaseExtractor sites
|
2 years ago |
|
Mike Fährmann
|
f4ea216c95
|
[shopify] support loungeunderwear.com (closes #2053)
|
3 years ago |
|
Mike Fährmann
|
4e9f8fe395
|
[shopify] support windsorstore.com (#1793)
|
3 years ago |
|
Mike Fährmann
|
95157e0f4b
|
[shopify] use API for product listings (#1793)
|
3 years ago |
|
Mike Fährmann
|
086925e685
|
[shopify] support omgmiamiswimwear.com (closes #1280)
|
3 years ago |
|
Mike Fährmann
|
231bcad614
|
[shopify] use BaseExtractor
|
4 years ago |
|
Mike Fährmann
|
1e3dd7330e
|
merge SharedConfigMixin functionality into Extractor
|
4 years ago |
|
Mike Fährmann
|
d06ad148c7
|
[shopify] use alternate regex for products on collection pages
when the first on doesn't yield any results
|
4 years ago |
|
Mike Fährmann
|
e89413da22
|
update test results
|
5 years ago |
|
Mike Fährmann
|
feb98cf196
|
[twitter] improve 'content' formatting; add option (#338)
- include emoticons
- leave newlines intact
- remove pic.twitter.com/ links at the end
|
5 years ago |
|
Mike Fährmann
|
fdec59f8e2
|
replace extractor.request() 'expect' argument
with
- 'fatal': allow 4xx status codes
- 'notfound': raise NotFoundError on 404
|
5 years ago |
|
Mike Fährmann
|
bc6b0cfddc
|
[shopify] skip consecutive duplicate products
Not filtering duplicate URLs anymore caused the archive ID uniqueness
test to fail.
|
5 years ago |
|
Mike Fährmann
|
aa1ca4ed35
|
[shopify] skip deleted products (#175)
Product pages which return a 4xx status code will now be skipped instead
of raising an exception.
|
5 years ago |
|
Mike Fährmann
|
591a07f20c
|
small code changes and cleanups
|
6 years ago |
|
Mike Fährmann
|
09d872a2b1
|
generalize extractor creation code
|
6 years ago |
|
Mike Fährmann
|
8dc6be246b
|
[shopify] add custom retry logic for 430 status codes (#175)
|
6 years ago |
|
HRXN
|
56e0e92e0d
|
[shopify] cosmetic changes in shopify.py (#181)
Glanced over the commits, randomly spotted some minor things.
|
6 years ago |
|
Mike Fährmann
|
9c0e2f294b
|
[shopify] add generic collection and product extractors (#175)
with fashionnova.com as a default domain
|
6 years ago |
