Deep Natural Image Reconstruction from Human Brain Activity Based on Conditional Progressively Growi

来源 :神经科学通报(英文版) | 被引量 : 0次 | 上传用户:w66827552
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Brain decoding based on functional magnetic resonance imaging has recently enabled the identification of visual perception and mental states.However,due to the limitations of sample size and the lack of an effective reconstruction model,accurate reconstruction of natural images is still a major challenge.The current,rapid development of deep learning models provides the possibility of overcoming these obstacles.Here,we propose a deep learning-based framework that includes a latent feature extractor,a latent feature decoder,and a natural image generator,to achieve the accurate reconstruction of natural images from brain activity.The latent feature extractor is used to extract the latent features of natural images.The latent feature decoder predicts the latent features of natural images based on the response signals from the higher visual cortex.The natural image generator is applied to generate reconstructed images from the predicted latent features of natural images and the response signals from the visual cortex.Quantitative and qualitative evaluations were conducted with test images.The results showed that the reconstructed image achieved comparable,accurate reproduction of the presented image in both high-level semantic category information and low-level pixel information.The framework we propose shows promise for decoding the brain activity.
其他文献
Spontaneous activity in the brain maintains an internal structured pattern that reflects the external environment,which is essential for processing information
Chemokines and receptors have been implicated in the pathogenesis of chronic pain.Here,we report that spinal nerve ligation (SNL) increased CXCR3 expression in
Ferroptosis is a form of iron-dependent regulated cell death.Evidence of its existence and the effects of its inhibitors on subarachnoid hemorrhage (SAH) is sti
As the most common symptomatic reason to seek medical consultation,pain is a complex experience that has been classified into different categories and stages.In
The nucleus accumbens shell(NAcSh)plays an important role in reward and aversion.Traditionally,NAc dopamine receptor 2-expressing(D2)neurons are assumed to func
Sensory modalities are important for survival but the molecular mechanisms remain challenging due to the polymodal functionality of sensory neurons.Here,we repo
Exploring neural markers that predict trust behavior may help us to identify the cognitive process underlying trust decisions and to develop a new approach to p
Dear Editor,rnApproximately 500 million individuals suffer from hearing loss worldwide.The number of hearing-impaired individ-uals is estimated to increase to 9
期刊
Tweety-homolog 1 (Ttyh1) is expressed in neural tissue and has been implicated in the generation of several brain diseases.However,its functional significance i
Dear Editor,rnAnesthetic-induced unconsciousness is accompanied by decreased information exchange among relevant cortical functional modular areas that support
期刊