一、为什么要做，为什么现在做
1.1 为什么做：
以图搜图功能，特别是移动端的以图搜图，成为日益增长的流量入口和用户需求。有机构表明：未来5年，用户使用语音和图像进行意图表达的比例将超过50%。手机淘宝每个月的用户反馈中，有相当的比例都是用户对以图搜图的需求和渴望。
1.2 为什么现在：
1. 移动设备的普及：带有摄像头的移动设备的日益普及。
2. 深度学习时代：从2013开始，深度学习在图像、语音、NLP等领域的工业界取得了巨大成功。
3. 大规模的计算平台的普及：如ODPS，亚马逊云。
4. 电商：移动电商的发展，使得通过手机进行所拍即所买成为用户的自然诉求。同时活跃的用户留下的数据使得相关性等能不断提升。
二、算法框架
拍立淘首次上线是在2014年手机淘宝，很小的入口，功能也比较少。经过了多个版本的迭代和探索，形成了比较稳定的算法框架。如下图：
上面的框架，有5个算法模块，分别是类目预测，主体检测，图像特征提取，检索索引和排序。其中，与相关性有关的是类目预测，主体检测，特征和排序。而检索索引更多的与scalability相关。
2.1 类目预测
由于特征对于类目的区分能力有限，同时如果不分类目在全量中搜索性能无法满足。因此，我们通过类目预测来判断商品数据哪个类目。目前拍立淘有10多个大类，涵盖上万个叶子类目。
2.2 主体检测
因为商品的背景复杂，主体常常较小，所以为了减少大量背景干扰和多主体的影响，因此需要将搜索目标从图像中提取出来。下面两幅图反应了对于用户的query，进行主体检测和不进行主体检测的搜索结果差异。
2.3 图像特征
图像特征包括深度特征（CNN深度卷积神经网络）和局部特征。CNN从高层提取特征，突破语义鸿沟。局部特征关注图像的局部特征，可以作为CNN特征的辅助和补充。
2.4 检索索引
搜索的过程可以分成离线和在线。离线过程进行商品图像特征的提取，建立索引。而在线的过程，对query提取特征，到分布式的引擎里面去进行快速的查询。
2.5 排序
针对多种图像特征，和非图像的特征，根据不同的优化函数，我们会对结果进行重新的排序。
三、拍立淘接口测试
item_search_img-按图搜索淘宝商品（拍立淘）
请求参数
请求参数：imgid=http://g-search3.alicdn.com/img/bao/uploaded/i4/O1CN01IDpcD81zHbpHs1YgT_!!2200811456689.jpg&img_type=
参数说明：imgid:图片地址(仅支持图片链接.jpg/png)
如:https://img.alicdn.com/imgextra/i3/15353738/TB2HDHAqN9YBuNjy0FfXXXIsVXa_!!15353738-0-beehive-scenes.jpg
img_type:图片类型(默认为0，如果正常图片没数据，可传1试试)
响应参数
Version: Date:
| 名称 | 类型 | 必须 | 示例值 | 描述 |
|---|---|---|---|---|
| items | items[] | 0 | 按图搜索淘宝商品（拍立淘） | |
| pagecount | Int | 0 | 3 | 总页数 |
| total_results | Int | 0 | 60 | 商品总数量 |
| real_total_results | Int | 0 | 60 | 商品总数量 |
| item | item[] | 0 | 商品详情数据 | |
| page_size | Int | 0 | 20 | 接口返回数量 |
| page | Int | 0 | 1 | 页码 |
请求示例
-- 请求示例 url 默认请求参数已经URL编码处理
curl -i "https://api-服务器.cn/taobao/item_search_img/?key=<您自己的apiKey>&secret=<您自己的apiSecret>&imgid=http://g-search3.alicdn.com/img/bao/uploaded/i4/O1CN01IDpcD81zHbpHs1YgT_!!2200811456689.jpg&img_type="
响应示例
{
"items": {
"pagecount": 3,
"total_results": 60,
"real_total_results": 60,
"item": [
{
"title": "李宁篮球袜男款专业实战短筒运动袜子女夏跑步中长精英美式毛巾底",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01i8iOpV1rZSiOwyUYE_!!2068455645.jpg",
"promotion_price": "25.00",
"price": "25.00",
"num_iid": "785697155584",
"is_tmall": "false",
"area": "淄博",
"detail_url": "//item.taobao.com/item.htm?id=785697155584"
},
{
"title": "likeid篮球袜美式中长筒袜男夏季专业实战精英袜训练防滑运动袜子",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01tzf4lC1RMTNN4FCVw_!!623082097.jpg",
"promotion_price": "19.90",
"price": "19.90",
"num_iid": "706255675043",
"is_tmall": "false",
"area": "佛山",
"detail_url": "//item.taobao.com/item.htm?id=706255675043"
},
{
"title": "黑人月精英专业篮球袜加厚毛巾底中筒高筒运动袜子男",
"pic_url": "https://img.alicdn.com/imgextra/TB2luFSbTIlyKJjSZFMXXXvVXXa_!!546743164.jpg",
"promotion_price": "12.90",
"price": "12.90",
"num_iid": "543839578944",
"is_tmall": "false",
"area": "深圳",
"detail_url": "//item.taobao.com/item.htm?id=543839578944"
},
{
"title": "李宁运动袜子男短筒专业跑步篮球羽毛球女款棉透气防臭毛巾底秋冬",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01i8iOpV1rZSiOwyUYE_!!2068455645.jpg",
"promotion_price": "29.00",
"price": "29.00",
"num_iid": "751100232040",
"is_tmall": "false",
"area": "淄博",
"detail_url": "//item.taobao.com/item.htm?id=751100232040"
},
{
"title": "实战篮球袜精英款训练斯坦斯stance篮球袜子高筒559中筒359毛巾底",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01GJGJlc1fwZNLhfdEe_!!2215130674071.jpg",
"promotion_price": "43.90",
"price": "43.90",
"num_iid": "835954755321",
"is_tmall": "false",
"area": "石家庄",
"detail_url": "//item.taobao.com/item.htm?id=835954755321"
},
{
"title": "袜子男防臭防脚气夏季薄款运动抑菌中筒袜吸汗毛巾底篮球袜四季fm",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01Y89HYb2KdErlFuBmQ_!!4059759579.jpg",
"promotion_price": "20.71",
"price": "20.71",
"num_iid": "787279891547",
"is_tmall": "false",
"area": "金华",
"detail_url": "//item.taobao.com/item.htm?id=787279891547"
},
{
"title": "斗牛篮球精英袜男款高帮加厚毛巾底专业实战长筒防滑透气运动袜子",
"pic_url": "https://img.alicdn.com/imgextra/O1CN011VQ3pa1nRthROBUCP_!!2212944505087.jpg",
"promotion_price": "19.80",
"price": "19.80",
"num_iid": "751809323321",
"is_tmall": "true",
"area": "金华",
"detail_url": "//item.taobao.com/item.htm?id=751809323321"
},
{
"title": "包邮皇马主客场足球袜灰色白色紫色球袜毛巾底长筒过膝足球袜",
"pic_url": "https://img.alicdn.com/imgextra/TB2kc0RbwJlpuFjSspjXXcT.pXa_!!85536437.jpg",
"promotion_price": "16.00",
"price": "16.00",
"num_iid": "528042874974",
"is_tmall": "false",
"area": "郑州",
"detail_url": "//item.taobao.com/item.htm?id=528042874974"
},
{
"title": "科比欧文加厚专业篮球袜男中筒精英袜高帮毛巾底防滑透气吸汗防臭",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01YjiY1A1eHyLEsYqae_!!2908813847.png",
"promotion_price": "29.90",
"price": "29.90",
"num_iid": "636638770741",
"is_tmall": "true",
"area": "广州",
"detail_url": "//item.taobao.com/item.htm?id=636638770741"
},
{
"title": "情缘 袜子男士 足球袜 运动袜 提花袜 定制袜 长筒袜男定制",
"pic_url": "https://img.alicdn.com/imgextra/O1CN0130nTa524Rl8JXBJqz_!!0-item_pic.jpg",
"promotion_price": "12.80",
"price": "12.80",
"num_iid": "845255066462",
"is_tmall": "false",
"area": "鹤壁",
"detail_url": "//item.taobao.com/item.htm?id=845255066462"
},
{
"title": "儿童专用篮球袜男童女童专业秋冬加厚中筒纯棉袜实战训练运动袜子",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01wduMDu21IeIqyyIKI_!!6000000006962-0-yinhe.jpg",
"promotion_price": "13.90",
"price": "13.90",
"num_iid": "710555714441",
"is_tmall": "false",
"area": "佛山",
"detail_url": "//item.taobao.com/item.htm?id=710555714441"
},
{
"title": "春秋款透气中筒篮球袜纯棉男女儿童大码彩色黄绿蓝色运动训练",
"pic_url": "https://img.alicdn.com/imgextra/O1CN011FkxCc1gCb4jaQfos_!!3418834106.jpg",
"promotion_price": "26.80",
"price": "26.80",
"num_iid": "675462541686",
"is_tmall": "false",
"area": "重庆",
"detail_url": "//item.taobao.com/item.htm?id=675462541686"
},
{
"title": "3双岩也中筒长袜子男生运动篮球实战透气速干健身白色毛巾底潮ins",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01F2kqlI24WnU7roHZk_!!2912737399.jpg",
"promotion_price": "39.90",
"price": "39.90",
"num_iid": "839482989746",
"is_tmall": "false",
"area": "佛山",
"detail_url": "//item.taobao.com/item.htm?id=839482989746"
},
{
"title": "Uponey篮球袜男美式毛巾底透气精英中筒防滑训练长筒实战运动袜子",
"pic_url": "https://img.alicdn.com/imgextra/O1CN015m6htf1pYt3Jt5mkM_!!552855373.jpg",
"promotion_price": "29.00",
"price": "29.00",
"num_iid": "750145478658",
"is_tmall": "false",
"area": "青岛",
"detail_url": "//item.taobao.com/item.htm?id=750145478658"
},
{
"title": "HG篮球袜男高帮中筒毛巾底实战长筒精袜专业运动袜子闪袭系列",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01r1zqmE1pYskTiE3jM_!!552855373.jpg",
"promotion_price": "21.00",
"price": "21.00",
"num_iid": "653241419632",
"is_tmall": "false",
"area": "青岛",
"detail_url": "//item.taobao.com/item.htm?id=653241419632"
},
{
"title": "李宁运动袜子男士吸汗透气跑步篮球袜防嗅抗菌女短中筒精硫棉夏季",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01kkCB3k1erF6BlXQTK_!!3851683924.jpg",
"promotion_price": "29.00",
"price": "29.00",
"num_iid": "775037189585",
"is_tmall": "false",
"area": "南京",
"detail_url": "//item.taobao.com/item.htm?id=775037189585"
},
{
"title": "跨境篮球袜男款专业加厚毛巾底防滑吸汗中筒袜精英袜高帮运动袜子",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01ACnac92NPRpb7Fo48_!!0-item_pic.jpg",
"promotion_price": "52.32",
"price": "52.32",
"num_iid": "845586474670",
"is_tmall": "false",
"area": "石家庄",
"detail_url": "//item.taobao.com/item.htm?id=845586474670"
},
{
"title": "实战专业篮球毛巾加厚运动精英袜中筒男中筒防滑高帮训练透气长筒",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01GwZNBO229Ju9OFIRW_!!2341307077.jpg",
"promotion_price": "10.80",
"price": "10.80",
"num_iid": "783158595757",
"is_tmall": "false",
"area": "广州",
"detail_url": "//item.taobao.com/item.htm?id=783158595757"
},
{
"title": "袜子女春夏秋季女士毛巾底中筒袜吸湿透气纯棉运动篮球袜短袜女袜",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01RS0usy1KaUArb2hZI_!!1674221180.jpg",
"promotion_price": "2.88",
"price": "2.88",
"num_iid": "705555992925",
"is_tmall": "false",
"area": "石家庄",
"detail_url": "//item.taobao.com/item.htm?id=705555992925"
},
{
"title": "有志者UZIS实战训练篮球袜男专业防滑中长筒网眼透气运动袜斗牛士",
"pic_url": "https://img.alicdn.com/imgextra/O1CN01aqkEh524wu0B8wfWN_!!2207237977456.jpg",
"promotion_price": "23.00",
"price": "23.00",
"num_iid": "773859448281",
"is_tmall": "false",
"area": "长沙",
"detail_url": "//item.taobao.com/item.htm?id=773859448281"
}
],
"page_size": 20,
"page": 1,
"_ddf": "cdy"
},
}
943
扫一扫
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
