READING NOTE: Beyond Skip Connections: Top-Down Modulation for Object Detection

本文提出了一种名为顶向下的调节(TDM)的方法,该方法通过侧向连接将标准的底向上的卷积神经网络与TDM网络相结合。TDM负责调整底层过滤器,并处理上下文特征的选择与融合。这种方法类似于特征金字塔网络的工作原理,旨在将更精细的细节纳入到目标检测框架中。

TITLE: Beyond Skip Connections: Top-Down Modulation for Object Detection

AUTHOR: Abhinav Shrivastava, Rahul Sukthankar, Jitendra Malik, Abhinav Gupta

ASSOCIATION: CMU, UC Berkeley, Google Research

FROM: arXiv:1612.06851

CONTRIBUTIONS

In this paper top-down modulations is proposed as a way to incorporate fine details into the detection framework. The standard bottom-up, feedforward ConvNet is supplemented with a top-down modulation (TDM) network, connected using lateral connections. These connections are responsible for the modulation of lower layer filters, and the top-down network handles the selection and integration of features.

METHOD

The idea of this work is very similar with the work of Feature Pyramid Networks for Object Detection. An example of Top-Down Modulation (TDM) Network is illustrated as the following figure

TDM is integrated with the bottom-up network with lateral connections. Ci are bottom-up, feedforward feature blocks, Li are the lateral modules which transform low level features for the top-down contextual pathway. Finally, Tj,i , which represent flow of top-down information from index j to i.

In this paper, the T blocks are implemented using single convolutional layer (with non-linear activation) optionally with upsampling operation. The features from C (processed by L ) and T are concated then sent to a convolutional layer for combination, as the following figure shows

At training stage, one new pair of lateral and top-down modules is added at a time and trained repeatedly from a pre-trained model.

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值