Comment on Probably helps that I'm happy to listen to whatever genre
m0darn@lemmy.ca 3 weeks agoIVQJHOUPLGCFDNERTSMBKA
Great work. A few thoughts re: methodology.
- I despair for society’s musical inclinations.
- Not being able to understand the lyrics was a big impediment.
- Not being familiar with/fond of the genres was a big impediment.
- given those two limitations I think I may have inadvertently selected for intra-song diversity and that may favour AI generation since it’s a lot more work for musicians to change sounds in the middle of a song.
I’m very curious to see the results. Sorry I didn’t get to it sooner.
drath@lemmy.world 3 weeks ago
Nice. Let me dig up which was what.
I is AI
V is Real
Q is Real
J is AI
H is Real
O is AI
U is Real
P is Real
L is Real
G is AI
C is AI
F is Real
D is AI
N is Real
E is Real
R is AI
T is AI
S is AI
M is Real
B is AI
K is Real
A is AI
I’m not exactly sure how to fairly rate this, so let’s try this - for every place in the rating give +11 to -11 score, if it’s AI at the top half flip the sign, same for real tracks at the bottom half, for a possible scores of -132 to +132, and random shuffle expected to average at 0, and giving most value to those at the ends and less to those in-between. Which gives the result of -11+10+9-8+7-6+5+4+3-2-1-1+2-3-4+5+6+7-8+9-10+11 = +24, which equates to 156/264, or 59.1% AI-detection™ score
Some sidenotes: I’m surprised P ended up that high, the amount of autotune in it sounds like AI speech synthesizer with articulation cranked all the way 11 where it just makes random weird sounds. D in the middle is also unexpected, given that it’s one of the few English songs and the lyrics are about AI supremacy. I’ve considered removing it and B from the set though, just because they sound way too different from the rest, but at that point I already skipped tons of AI tracks and had to stop and settle on something. N was my favorite of human songs. Despite it’s relative simplicity, it’s probably the only one that I found pleasant to listen to.
Can’t agree more. Don’t get me wrong, AI music sucks big time, but it sets the bar high enough that most human musicians can’t even pass, and those that do are unlikely to be in mainstream since success in the industry is mostly unrelated to actual talent.
No worries, thanks for participating! Would be interesting to hear your thoughts on the results
m0darn@lemmy.ca 3 weeks ago
A small note: that I wasn’t trying to decide whether something was AI, I was trying to evaluate its creativity. So I actually thought A was real, but that it was extremely generic…
Also I only listened to each track once, then decided where to put it in the list. Like “top”, “bottom”, “near bottom but not worst”. And I placed them as I went. If I went through the list again I’d probably swap some but that would have taken way longer and I decided it was more important to be done.