Right, but the whitespace between instructions wasn’t whitespace at all but white text on white background instructions to poison the copy-paste.
Also the people who are using chatGPT to write the whole paper are probably not double-checking the pasted prompt. Some will, sure, but this isnt supposed to find all of them its supposed to catch some with a basically-0% false positive rate.
Yeah knocking out 99% of cheaters honestly is a pretty good strategy.
And for student super, if you’re reading through the prompt that carefully to see if it was poisoned, why not just put that same effort into actually doing the assignment?
Maybe I’m misunderstanding your point, so forgive me, but I expect carefully reading the prompt is still orders of magnitude less effort than actually writing a paper?
For the same reasons, really. People who already intend to thoroughly go over the input and output to use AI as a tool to help them write a paper would always have had a chance to spot this. People who are in a rush or don’t care about the assignment, it’s easier to overlook.
Also, given the plagiarism punishments out there that also apply to AI, knowing there’s traps at all is a deterrent. Plenty of people would rather get a 0 rather than get expelled in the worst case.
If this went viral enough that it could be considered common knowledge, it would reduce the effectiveness of the trap a bit, sure, but most of these techniques are talked about intentionally, anyway. A teacher would much rather scare would-be cheaters into honesty than get their students expelled for some petty thing. Less paperwork, even if they truly didn’t care about the students.
No, because they think nothing of a request to cite Frankie Hawkes. Without doing a search themselves, the name is innocuous enough as to be credible. Given such a request, an LLM, even if it has some actual citation capability, currently will fabricate a reasonable sounding citation to meet the requirement rather than ‘understanding’ it can’t just make stuff up.
BanjoShepard@lemmy.world 1 month ago
I think most students are copying/pasting instructions to GPT, not uploading documents.
Khanzarate@lemmy.world 1 month ago
Right, but the whitespace between instructions wasn’t whitespace at all but white text on white background instructions to poison the copy-paste.
Also the people who are using chatGPT to write the whole paper are probably not double-checking the pasted prompt. Some will, sure, but this isnt supposed to find all of them its supposed to catch some with a basically-0% false positive rate.
scrubbles@poptalk.scrubbles.tech 1 month ago
Yeah knocking out 99% of cheaters honestly is a pretty good strategy.
And for student super, if you’re reading through the prompt that carefully to see if it was poisoned, why not just put that same effort into actually doing the assignment?
Windex007@lemmy.world 1 month ago
Maybe I’m misunderstanding your point, so forgive me, but I expect carefully reading the prompt is still orders of magnitude less effort than actually writing a paper?
rudyharrelson@lemmy.radio 1 month ago
Image
Aurenkin@sh.itjust.works 1 month ago
Or if they don’t bother to read the instructions they uploaded
technocrit@lemmy.dbzer0.com 1 month ago
It just takes one person to notice and tell everybody else that the teacher is setting a trap.
Once the word goes out about this kind of thing, everybody will be double checking the prompt.
Khanzarate@lemmy.world 1 month ago
I doubt it.
For the same reasons, really. People who already intend to thoroughly go over the input and output to use AI as a tool to help them write a paper would always have had a chance to spot this. People who are in a rush or don’t care about the assignment, it’s easier to overlook.
Also, given the plagiarism punishments out there that also apply to AI, knowing there’s traps at all is a deterrent. Plenty of people would rather get a 0 rather than get expelled in the worst case.
If this went viral enough that it could be considered common knowledge, it would reduce the effectiveness of the trap a bit, sure, but most of these techniques are talked about intentionally, anyway. A teacher would much rather scare would-be cheaters into honesty than get their students expelled for some petty thing. Less paperwork, even if they truly didn’t care about the students.
FundMECFSResearch@lemmy.blahaj.zone 1 month ago
yes but copy paste includes the highlighted part
frostysauce@lemmy.world 1 month ago
Then it will catch people that don’t proofread the copy/pasted prompt.
jj4211@lemmy.world 1 month ago
No, because they think nothing of a request to cite Frankie Hawkes. Without doing a search themselves, the name is innocuous enough as to be credible. Given such a request, an LLM, even if it has some actual citation capability, currently will fabricate a reasonable sounding citation to meet the requirement rather than ‘understanding’ it can’t just make stuff up.