SJTU OPTICompt Lab 光电与光子智能计算实验室

📄 Neural mechanisms of visual quality perception and adaptability in the visual pathway

已打开 9 次

作者: Yiming Zhang, Yitong Chen, Ying Hu, Xu Han, Zhenhui Xie, Xingrui Wang, Yan Zhou, Xiongkuo Min, Guangtao Zhai

发表于: Patterns, 2025

最近更新: 2026-05-06 07:04:06

Neural mechanisms of visual quality perception and adaptability in the visual pathway

Visual quality assessment (VQA) is indispensable in multimedia for evaluating algorithm effectiveness and optimizing systems, yet its neurobiological mechanisms remain poorly understood. Using functional magnetic resonance imaging (fMRI), we investigate how the brain processes varying image qualities, revealing specialized mechanisms for handling low-quality stimuli. Results show that low quality significantly impacts semantic encoding along the visual pathway: low-level regions exhibit only 35.20% of the semantic information seen in high-quality condition, while higher-level regions compensate adaptively to maintain understanding. Visual quality is not locally encoded but emerges from inter-regional information gaps, with perception arising from this hierarchical discrepancy. Leveraging this compensatory mechanism, we decode quality from fMRI and propose a neural network feature fusion strategy, boosting ResNet’s VQA performance by 14.29% on the BID dataset (586 instances). Our findings provide neurobiological evidence for degraded visual processing, addressing a gap in perception neuroscience and offering theoretical foundations for improving VQA models.

资源链接

包含: Dataset