BlackEco@lemmy.blackeco.com to Technology@lemmy.worldEnglish · 2 months agoLLMs have a strong bias against use of African American Englisharstechnica.comexternal-linkmessage-square29fedilinkarrow-up12arrow-down10cross-posted to: ghazi@lemmy.blahaj.zonetechnology@beehaw.org
arrow-up12arrow-down1external-linkLLMs have a strong bias against use of African American Englisharstechnica.comBlackEco@lemmy.blackeco.com to Technology@lemmy.worldEnglish · 2 months agomessage-square29fedilinkcross-posted to: ghazi@lemmy.blahaj.zonetechnology@beehaw.org
minus-squarebionicjoey@lemmy.calinkfedilinkEnglisharrow-up2·2 months agoMakes sense. AAVE is mostly a spoken thing, LLMs are mostly trained on the corpus of written text on the internet and in books. It’s pretty rare for people to write in an AAVE style in those contexts.
minus-squaregivesomefucks@lemmy.worldlinkfedilinkEnglisharrow-up0·2 months agoExcept it has no difficulty reading and understanding AAVE, because people use it online frequently… Like, the article makes that abundantly clear, but everyone commenting just read the headline and assumed what it meant was it couldn’t understand it…
minus-squarebionicjoey@lemmy.calinkfedilinkEnglisharrow-up1·2 months agoI never said it can’t understand it. I am agreeing with the notion that it has a bias against using it.
Makes sense. AAVE is mostly a spoken thing, LLMs are mostly trained on the corpus of written text on the internet and in books. It’s pretty rare for people to write in an AAVE style in those contexts.
Except it has no difficulty reading and understanding AAVE, because people use it online frequently…
Like, the article makes that abundantly clear, but everyone commenting just read the headline and assumed what it meant was it couldn’t understand it…
I never said it can’t understand it. I am agreeing with the notion that it has a bias against using it.