Late last year mskeggs shared on the forum [here] that somebody had forked a grocery price tracker and adapted it for Coles/Woolies. Personally I have found it extremely useful.
Unfortunately it hasn't worked for the past few weeks. The dev stated last night that it is due to Coles bot detection, and needs some help working it out.
Is there some Python devs here that could lend a hand?
thank you. i didnt know that existed. i'll have to update my bom json retrieving and data recording script. rn i'm using 3 different user agents and only querying 3 times a week and with a pause of 5 to 20 seconds between each of the 3 requests i make.
i like to record the weather
I have been using this: https://chromewebstore.google.com/detail/coles-trend/ehgelge…
It works ok, not sure how it works under the hood
It works ok, not sure how it works under the hood
And that's why I don't use chrome extensions.
you give them absolute control to everything you do on your screen.
Hope you don't do any banking with those extensions enabled.
I checked this app
https://www.ozbargain.com.au/node/865331
Then I compared it with Coles app. The prices are not the same …
That is likely because they prices change by location. From what I gleamed on the GitHub issue tracker for hotprices, Coles serves up a generic price until you login, then it changes.
Although I didn't know about this app, thanks
Looks like it's already using Scrapling for Coles. Coles uses Incapsula and doing a quick googling there seems to be quite a few "tips" on how a scraper can beat it.