Comment on Chad scraper

bill_1992@lemmy.world ⁨2⁩ ⁨years⁩ ago

• DigitalPaperTrail@kbin.social ⁨2⁩ ⁨years⁩ ago

  spite can be a great motivator, though

  source

  • Anonymousllama@lemmy.world ⁨2⁩ ⁨years⁩ ago

    This one. One of the best motivators. Sense of satisfaction when you get it working and you feel unstoppable (until the next subtle changes happens anyway)

    source
  • archomrade@midwest.social ⁨2⁩ ⁨years⁩ ago

    I feel this

    source
• camr_on@lemmy.world ⁨2⁩ ⁨years⁩ ago

  I loved scraping until my ip was blocked for botting lol. I know there’s ways around it it’s just work though

  source

  • pennomi@lemmy.world ⁨2⁩ ⁨years⁩ ago

    I successfully scraped millions of Amazon product listings simply by routing through TOR and cycling the exit node every 10 seconds.

    source

    • camr_on@lemmy.world ⁨2⁩ ⁨years⁩ ago

      That’s a good idea right there, I like that

      source
    • AlecStewart1st@lemmy.world ⁨2⁩ ⁨years⁩ ago

      This guy scrapes

      source
    • aBundleOfFerrets@sh.itjust.works ⁨2⁩ ⁨years⁩ ago

      lmao, yeah, get all the exit nodes banned from amazon.

      source

      • pennomi@lemmy.world ⁨2⁩ ⁨years⁩ ago

        That’s the neat thing, it wouldn’t because traffic only spikes for 10s on any particular node. It perfectly blends into the background noise.

        source

        • -> View More Comments
  • Touching_Grass@lemmy.world ⁨2⁩ ⁨years⁩ ago

    You guys use IP’S?

    source

    • camr_on@lemmy.world ⁨2⁩ ⁨years⁩ ago

      I’m coding baby’s first bot over here lol, I could probably do better

      source
    • synae@lemmy.sdf.org ⁨2⁩ ⁨years⁩ ago

      Token ring for me baybeee

      source
• dangblingus@lemmy.world ⁨2⁩ ⁨years⁩ ago

  Or in the case of wikipedia, every table on successive pages for sequential data is formatted differently.

  source
• Matriks404@lemmy.world ⁨2⁩ ⁨years⁩ ago

  Just use AI to make changes ¯_(ツ)_/¯

  source

  • anarchy79@lemmy.world ⁨2⁩ ⁨years⁩ ago

    Here take these: \\

    source

    • Matriks404@lemmy.world ⁨2⁩ ⁨years⁩ ago

      ¯_(ツ)_/¯\\ Thanks

      source