Comment on Pearson complaining about using Linux to access my course material
Irelephant@lemm.ee 2 days agoA small publisher’s ebook platform recently started blocking firefox for me, did a bit of digging and found that if pages aren’t requested with the right headers (which work in chrome and msedge) it will respond with a 302, suggesting you go to another page which takes a few minutes and then times out.
This is probably to stop scraping, and could be because I started testing some scraping scripts on it.
Anyway, this hasn’t even stopped me scraping, I just copied the headers and use those in my script.
Evotech@lemmy.world 2 days ago
I use this extension by a Firefox dev
addons.mozilla.org/en-US/firefox/…/chrome-mask/
Irelephant@lemm.ee 2 days ago
I also use it, but it doesn’t work in this case. Thats why I said headers instead of just user agent.