lakemalcom

@lakemalcom@sh.itjust.works

• ⁨Comment⁩ on ⁨Chatbots can be manipulated through flattery and peer pressure⁩ ⁨⁨2⁩ ⁨minutes⁩ ago⁩:

  A couple of things:

  • we are talking about chat bots talking to people in this post, and how you can steer the simulated conversation towards whatever you want
  • it did not debug anything, a human debugged something and wrote about it. Then that human input and a ton of others were mapped into a huge probability map, and some computer simulated what people talking about this would most likely say. Is it useful? Sure, maybe. Why didn’t you debug it yourself?
• ⁨Comment⁩ on ⁨Chatbots can be manipulated through flattery and peer pressure⁩ ⁨⁨4⁩ ⁨hours⁩ ago⁩:

  I will 100% admit to not reading papers and keeping up to date. I went ahead and spent about 30m looking up various explanations and summaries of LRMs. Ok, so you take an LLM and tell it to break the problem down first. It’s still not reasoning. It’s running a simulation of a natural language conversation, and giving you the center of mass of the statistical distribution for the intermediate steps. Does this kinda sorta replicate the sounds a human makes? Absolutely. But it’s irresponsible and unethical to make any claims that this is a human like entity you can chat with, or that it is doing any reasoning.

  When I get some time I’ll check this paper out: …cdn-apple.com/…/the-illusion-of-thinking.pdf

• ⁨Comment⁩ on ⁨Chatbots can be manipulated through flattery and peer pressure⁩ ⁨⁨13⁩ ⁨hours⁩ ago⁩:

  No, just because they say they want it to reason, does not mean it does

• ⁨Comment⁩ on ⁨Chatbots can be manipulated through flattery and peer pressure⁩ ⁨⁨21⁩ ⁨hours⁩ ago⁩:

  This is the problem with things that don’t reason. You’re just giving it hints towards the simulation you want, and then it ultimately simulates the conversation you are building towards.