Beyond Skip Connections -- TDM 特征融合模块设计思想

Gallant Hu

于 2020-12-31 22:09:34 发布

阅读量408

点赞数

分类专栏：目标检测从基础到实践--系列论文讲解

本文链接：https://blog.youkuaiyun.com/weixin_42108090/article/details/112047789

版权

目标检测从基础到实践--系列论文讲解专栏收录该内容

53 篇文章 ¥59.90 ¥99.00

订阅专栏

超级会员免费看

本文探讨了自顶向下调制在神经网络中的作用，通过VGG16和ResNet101网络的实验，展示了TDM模块如何增强小目标检测能力。在消融实验中发现，自顶向下路径对于传递上下文特征和选择相关细节至关重要，而侧向模块也对性能提升有显著影响。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Top-down 的神经生物学基础

In the human visual pathway, once receptive field properties are tuned using feedforward processing,
top-down modulations are evoked by feedback and horizontal connections.

These connections modulate representations at multiple levels and are responsible for their selective combination.

We argue that the use of skip connections is a special case of this process, where the modulation is relegated to the final classifier, which directly tries to influence lower layer features and/or learn how to combine them.

[1] A. Gazzaley and A. C. Nobre. Top-down modulation: bridging selective attention and working memory. Trends in cognitive sciences, 2012.
[2] C. D. Gilbert and M. Sigman. Brain st