Researchers Are Translating Brain Activity Into Speech
Credit: UCSFTo train the system, the researchers asked people without speech disabilities to carefully read sentences while the researchers recorded their neural activity. Mesgarani’s team focused on neural activity in the sensory cortex, the part of the brain where speech perception happens, while the UCSF team focused on the motor cortex, the part of the brain where the muscular movements behind speech production occurs. By modeling the vocal tract movements, “the authors tap into existing neural processes for speech production that are likely generative as they demonstrated in their mimed-speech condition, and somewhat more intuitive for individuals to use in future clinical applications to restore speech for individuals with severe speech and physical impairments,” says Jonathan Brumberg of the University of Kansas who was not involved with the study.
Source: onezero.medium.com