EPFL researchers have discovered key “units” in large AI models that seem to be important for language, mirroring the brain’s language system. When these specific units were turned off, the models got much worse at language tasks.
Key units in AI models mirror human brain’s language system
Reader’s Picks
-
Myanmar’s history of prolonged conflict has led to the forced displacement and resettlement of generations of refugees to the U.S., [...]
-
During fieldwork in cities in China, I came across a new marital practice, locally described as liang-tou-dun, literally “two places [...]
-
Every year, around 90,000 young people make the transition from school to work. A large number of them start to [...]