信息检索领域相关资料 (A Guide to Information Retrieval)

视觉特征-自监督-同源不同crop视图一致性【2023-04】:DINOv2(无监督学习鲁棒视觉特征)【12 亿张互不重复的图像】【判别式自监督方法】【交叉熵损失+iBOT损失】 近期,自然语言处理领域在大量数据上进行模型 Pretraining 取得的突破,为计算机视觉中类似Foundation Model 的发展开辟了道路。这些模型能够生成通用视觉特征,即无需微调即可跨图像分布和任务发挥作用的特征,从而大幅简化图像在任何系统中的使用。本研究表明,现有的 Pretraining 方法,尤其是自监督方法,如果在来自多样化来源的充足精选数据上进行训练,便能够产生此类特征。我们重新审视了现有方法,并结合不同技术,从数据规模和模型规模两方面扩展我们的 Pretraining。 阅读详情
信息检索领域相关资料 (A Guide to Information Retrieval) Organized by Hongfei Yan Last updated on July 27, 2007 --------------------- Contents Books + Finding Out About: Search Engine Technology from a cognitive Perspective (Belew, R.K., 2000) http://www-cse.ucsd.edu/~rik/foa/ + Foundations of Statistical Natural (C. Manning and H. Schutze, 1999) + Information Retrieval, 2nd edition (C.J. van Rijsbergen, 1979) (full text) http://www.dcs.gla.ac.uk/Keith/Preface.html + Information Retrieval: A Survey (Ed Greengrass, 2000) http://www.csee.umbc.edu/cadip/readings/IR.report.120600.book.pdf + Information Retrieval: Data Structures & Algorithms (Frakes, W. and Baeza-Yates, R., 1992) http://www.dcc.uchile.cl/~rbaeza/iradsbook/irbook.html + Information Retrieval Interaction (Ingwersen, P., Taylor Graham, 1992) http://www.db.dk/pi/iri/ + Introduction to Information Retrieval (Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schuetze, 2007) http://www-csli.stanford.edu/~schuetze/information-retrieval-book.html + Managing Gigabytes:compressing and indexing documents and images, 2nd edition, (Ian H. Witten, Alistair Moffat,and Timothy Bell,1999) + Mining the Web: Discovering Knowledge from Hypertext Data (Soumen Chakrabarti, 2003) + Modeling the Internet and the Web: probabilistic Methods and Algorithms (Pierre Baldi, Paolo Frasconi and Padhraic Smyth, 2003) + Modern Information Retrieval (Ricardo Baeza-Yates and Berthier Ribeiro-Neto, 2000) + Readings in Information Retrieval. (Sparck-Jones, K. and Willett, P., 1997) + Search Engine: Principle,Technology and Systems 搜索引擎-原理、技术与系统 (Xiaoming Li,et al., 2005 ), (full text) http://sewm.pku.edu.cn/book/dlbook.html + The Geometry of Information Retrieval (C.J. van Rijsbergen, 2004) http://ir.dcs.gla.ac.uk/GeometryOfIR/ + The Turn: Integration of Information Seeking and Retrieval in Context (Ingwersen, P., and Jarvelin, K., 2005) + TREC: Experiment and Evaluation in Information Retrieval (Voorhees, E.M., and Harman, D.K., 2005) http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&tid=10667 Conferences and Workshops + CIKM: Conference on Information and Knowledge Management http://www.csee.umbc.edu/cikm/ + SIGIR: Special Interest Group on Information Retrieval http://www.sigir.org/ + SIGKDD: Knowledge Discovery and Data Mining http://www.kdd.org/ + World Wide Web http://www.iw3c2.org/ + SEWM: Symposium of Search Engine and WebMining 全国搜索引擎和网上信息挖掘学术研讨会 http://net.pku.edu.cn/~sewm/ Courses + CMU Information Retrieval http://nyc.lti.cs.cmu.edu/classes/11-741/ (Spring 2006) Instructors: Jamie Callan and Yiming Yang + Cornell University The Structure of Information Networks (Spring 2006) http://www.cs.cornell.edu/courses/cs685/2006sp/ Instructor: Jon Kleinberg + Peking University Web Based Information Architectures (Fall 2006) http://net.pku.edu.cn/~wbia/ Instructor: Xiaoming Li, Jimin Wang and Bo Peng + Stanford Univ. Text Information Retrieval and Web Mining (Autumn 2005) http://www.stanford.edu/class/cs276/ Instructor: Christopher Manning and Prabhakar Raghavan + UIUC Introduction to Text Information Systems (Spring 2007) http://sifaka.cs.uiuc.edu/course/410s07/ Instructor: ChengXiang Zhai + UMass Univ. Information retrieval course (Spring 2005) http://ciir.cs.umass.edu/cmpsci646/ Instructors: James Allan + Washington Univ. Search Engines course http://courses.washington.edu/lis544/ Evaluation Resources + CLEF: Cross-Language Evaluation Forum http://clef.iei.pi.cnr.it/ + CWIRF: Chinese Web Information Retrieval Forum http://www.cwirf.org/ + DUC: Document Understanding Conferences http://duc.nist.gov/ + INEX: INitiative for the Evaluation of XML Retrieval http://inex.is.informatik.uni-duisburg.de/ + NTCIR: NII-NACSIS Test Collection for IR Systems http://research.nii.ac.jp/ntcir/ + TREC: Text REtrieval Conference http://trec.nist.gov/ Journals + Briefings in Bioinformatics (full text) http://bib.oxfordjournals.org/archive/ + Computational Linguistics, The MIT Press http://mitpress.mit.edu/catalog/item/default.asp?ttype=4&tid=10 + Data & Knowledge Engineering (DKE), Elsevier http://www.elsevier.com/wps/find/journaldescription.cws_home/505608/description?navopenmenu=-2 + D-Lib Magazine http://www.dlib.org/ + Information Processing Letters, Elsevier http://www.elsevier.com/locate/issn/00200190 + Information Processing and Management (IP&M), Elsevier http://www.elsevier.com/locate/infoproman + Information Retrieval, Springer http://www.springer.com/sgw/cda/frontpage/0,11855,3-0-70-35744790-detailsPage%253Djournal%257Cdescription%257Cdescription,00.html + Information Research http://informationr.net/ir + International Journal on Digital Libraries, Springer http://link.springer.de/link/service/journals/00799/index.htm + International Journal of Cooperative Information Systems (IJCIS), World Scientific http://ejournals.wspc.com.sg/ijcis/ijcis.shtml + International Journal on Document Analysis and Recognition, Springer http://link.springer.de/link/service/journals/10032/index.htm + International Journal of Intelligent Systems, Wiley http://www3.interscience.wiley.com/cgi-bin/jhome/36062 + International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems (IJUFKS), World Scientific http://ejournals.wspc.com.sg/ijufks/ijufks.shtml + Journal of the American Society for Information Science and Technology (JASIST), Wiley http://www3.interscience.wiley.com/cgi-bin/jhome/76501873 + Journal of Documentation (JDoc). Emerald http://www.emeraldinsight.com/0022-0418.htm + Journal of Intelligent Information Systems (JIIS), Springer http://www.wkap.nl/journalhome.htm/0925-9902 + Knowledge and Information Systems (KAIS), Springer http://link.springer.de/link/service/journals/10115/index.htm + Natural Language Engineering, Cambridge University Press http://www.cambridge.org/journals/journal_catalogue.asp?mnemonic=NLE + Transactions On Information Systems (TOIS), ACM http://www.acm.org/tois/ + Transactions on Knowledge and Data Engineering (TKDE), IEEE http://www.computer.org/tkde/ List Archives + SIG-IRList, http://www.sigir.org/sigirlist/index.html Organizations and Special Interest Groups + Cambridge NLIP, http://www.cl.cam.ac.uk/Research/NL/ + CMU LTI, http://www.lti.cs.cmu.edu/ + DEC laboratories in Palo Alto, Calif. + Glasgow Information Retrieval Group, http://www.dcs.gla.ac.uk/ir/ + Google Labs, http://labs.google.com/ + LTI, http://www.lti.cs.cmu.edu/ + Massachusetts CIIR, http://ciir.cs.umass.edu/ + MSR Asia, Web Search & Data Mining Group http://research.microsoft.com/wsm/ + Standford InfoLab, http://infolab.stanford.edu/ + UIUC Information Retrieval Group, http://sifaka.cs.uiuc.edu/ir/ + 北大天网组, http://sewm.pku.edu.cn/ + 北京大学计算语言学研究所, http://icl.pku.edu.cn/ + 复旦大学信息检索和自然语言处理组, http://www.cs.fudan.edu.cn/mcwil/irnlp/ + 哈工大信息检索组, http://ir.hit.edu.cn/ + 清华大学智能技术与系统国家重点实验室 http://www.csai.tsinghua.edu.cn/ #+ 中科院大规模内容计算组, http://159.226.40.18/ (fail to visit) Researchers + Andrew McCallum, http://www.cs.umass.edu/~mccallum/ + ChengXiang Zhai, developing Lemur http://www-faculty.cs.uiuc.edu/~czhai/ + Gerard Salton http://www.cs.cornell.edu/Info/Department/Annual95/Faculty/Salton.html + Karen Sparck, developing IDF http://www.cl.cam.ac.uk/users/ksj/ + Keith van Rijsbergen http://www.dcs.gla.ac.uk/~keith/ + Jamie Callan, http://www.cs.cmu.edu/~callan/ + Jon Kleinberg, developing HIT http://www.cs.cornell.edu/home/kleinber/ + Li Xiaoming, developing Tianwang & Infomall + Nick Craswell, developing Terabyte Track http://research.microsoft.com/~nickcr + Susan Dumais, developing LSI http://research.microsoft.com/~sdumais/ + Yiming Yang, developing text categorization http://www.cs.cmu.edu/~yiming/ + Stephen Robertson, http://research.microsoft.com/users/robertson/ + Tefko Saracevic http://www.scils.rutgers.edu/~tefko/ + W. Bruce Croft http://ciir.cs.umass.edu/personnel/croft.html Research-related Resources + http://www-faculty.cs.uiuc.edu/~czhai/research.html Software + Apache Lucene: a full-featured text search engine library http://lucene.apache.org/java/docs/index.html + Gate: a general architecture for text engineering http://gate.ac.uk/ + Lemur: A full-text search engine http://www.lemurproject.org/ + MG: A full-text search engine http://www.math.utah.edu/pub/mg/ + Porter Stemmer: English stemming algorithm http://www.tartarus.org/martin/PorterStemmer/ + Nutch: an open source web search engine http://sourceforge.net/projects/nutch/ + TSE: A Tiny Search Engine http://sewm.pku.edu.cn/src/TSE/ --------------------- References: [1] Information Retrieval Resources, http://www.sigir.org/resources.html [2] http://ir.dcs.gla.ac.uk/resources.html [3] http://www.cs.cmu.edu/~callan/Teaching/Resources.html [4] Diekemar, Information Retrieval Links, Jan. 28, 1999. http://web.syr.edu/~diekemar/ir.html [5] 陈鸿标,网上研习信息检索,1999年11月. http://159.226.40.18/freshman/resources/网上研习信息检索.doc [6] 数据挖掘研究院, http://www.dmresearch.net/ [7] 语音自然语言在线, http://www.snlpinfo.com/index.php [8] PKU SEWM Group, http://sewm.pku.edu.cn/ [9] http://www.cs.cmu.edu/~callan/Teaching/Resources.html [10] http://icl.pku.edu.cn/member/lisujian/maincontent.htm [11] http://www.cs.fudan.edu.cn/mcwil/irnlp/link.htm [12] Robert Krovetz, A Guide to the Literature of Information Retrieval, http://159.226.40.18/freshman/resources/guide-to-ir-lit.ps [13] ACM Digital Library, http://portal.acm.org/portal.cfm http://acm.lib.tsinghua.edu.cn/acm/ [14] http://www.sigir.org/proceedings/Proc-Browse.html [15] SIGIR, http://portal.acm.org/browse_dl.cfm?linked=1&part=series&idx=SERIES278&coll=portal&dl=ACM&CFID=72474811&CFTOKEN=69288563 [16] WWW, International World Wide Web Conference http://portal.acm.org/browse_dl.cfm?linked=1&part=series&idx=SERIES968&coll=portal&dl=ACM&CFID=72474811&CFTOKEN=69288563 [17] China Digital Journal Community, http://wanfang.calis.edu.cn/wf/szhqk/index.html --------------------- More details are listed as follows ==================== CIIR (The Center for Intelligent Information Retrieval, 美国Massachusetts大学的智能信息检索中心) http://ciir.cs.umass.edu/ The Center for Intelligent Information Retrieval, a National Science Foundation-created S/IUCRC Center, is one of the leading information retrieval research labs in the world. The CIIR develops tools that provide effective and efficient access to large, heterogeneous, distributed, text and multimedia databases. CIIR accomplishments include significant research advances in the areas of distributed information retrieval, information filtering, topic detection, multimedia indexing and retrieval, document image processing, terabyte collections, data mining, summarization, resource discovery, interfaces and visualization, and cross-lingual information retrieval. The Center for Intelligent Information Retrieval continues to support the emerging information infrastructure, both through research and technology transfer. The goal of the CIIR is to develop tools that provide effective and efficient access to large, heterogeneous, distributed, text and multimedia databases. ==================== Glasgow Information Retrieval Group http://www.dcs.gla.ac.uk/ir/ 由Keith van Rijsbergen率领的英国Glasgow大学信息检索研究小组。 这个小组理论和实践并重,旨在建造一个高效、新颖、成功的多媒体信息检索系统, 为终极用户服务。 The Information Retrieval Group led by Professor Keith van Rijsbergen has a vigorous programme of research, based on both theory and experiment, aimed at giving end-users novel, effective, and efficient access to the world of multi-media information. The group, part of the Department of Computing Science, University of Glasgow, has a strong research history in a wide area of information retrieval research from theoretical modelling of the retrieval process to advanced system building and to the user-oriented evaluation of information retrieval systems. The group's interests also include many areas of Web information retrieval such as link analysis, summarisation and the development of novel interaction techniques (e.g., ostension, implicit feedback and graphical visualisation). Our research preserves a strong emphasis on the evaluation of interactive IR systems, and the group maintains strong links with researchers in Human-Computer Interaction and Psychology. ------ Keith van Rijsbergen, http://www.dcs.gla.ac.uk/~keith/ 英国格拉斯哥大学。概率IR的逻辑推理学派代表人,出版了著名的IR经典教材 INFORMATION RETRIEVAL, 重点介绍用概率研究信息检的方法。 ===================== Cambridge NLIP Group (Natural Language and Information Processing Group) http://www.cl.cam.ac.uk/Research/NL/ Research in NLIP has been done in the Computer Laboratory for nearly fifty years. The earliest work, by Roger Needham and Karen Sparck Jones, was on automatic thesaurus construction, in the context of document retrieval and machine translation. Subsequent research by Karen Sparck Jones during the 1960s and 70s focused on statistical approaches to retrieval and included innovative work on term weighting. From the later 1970s research in language processing developed, with work on syntax, semantics and discourse processing, ------ Karen Sparck Jones, http://www.cl.cam.ac.uk/users/ksj/ Karen Sparck Jones has been one of the most influential figures in Computing since the 1950’s. Her work on Information Retrieval and Natural Language Processing has never been so central as it is are today, with its implications for search engine technology, the semantic web and even bioinformatics. In 1972, Karen Sparck Jones published in the Journal of Documentation the paper which defined the term weighting scheme now known as inverse document frequency (IDF). Karen Sparck Jones is emeritus Professor of Computers and Information at the Computer Laboratory, University of Cambridge. She has worked in automatic language and information processing research since the late fifties, and has many publications including several books, most recently `Evaluating Natural Language Processing Systems' with Julia Galliers, and `Readings in Information Retrieval', edited with Peter Willett. 1988年度Salton奖得主。现代概率IR模型的另一创始人。在NLP、IR等领域都颇有建树, 而且做了大量的组织性工作。现在供职于英国剑桥大学计算机学院。 ==================== LTI CMU (Carnegie Mellon Universit) Language Technologies Institute, http://www.lti.cs.cmu.edu/ The Language Technologies Institute (LTI) of the School of Computer Science at Carnegie Mellon University conducts research and provides graduate education in all aspects of language technology and information management. The LTI was established in 1996, as an expansion of the Center for Machine Translation (CMT). The Center for Machine Translation (CMT) was a research branch of the School of Computer Science devoted to basic and applied research in all aspects of natural language processing, with a primary focus on machine translation, speech processing, and information retrieval. Containing a unique mix of academic and industrial researchers specializing in various aspects of computer science, artificial intelligence, computational linguistics and theoretical linguistics, the CMT provided a rich and diverse environment for collaboration among faculty, staff, visiting scholars, and qualified students. ------ Lemur Toolkit Lemur is a collection of search engine algorithms and information retrieval applications used for IR research, development and education. Lemur provides a rich query language that supports search against simple texts, structured (XML) texts, and texts annotated with part-of-speech, named-entity, and other annotations used in NLP and text-mining applications. Lemur's search engines comfortably support collections ranging from a few gigabytes to a few terabytes of text. The software is distributed under open-source license, and is used widely in the IR research community. ==================== Standford InfoLab http://infolab.stanford.edu/ The Stanford WebBase Project http://dbpubs.stanford.edu:8091/~testbed/doc2/WebBase/ The Stanford WebBase project is investigating various issues in crawling, storage, indexing, and querying of large collections of Web pages. The project builds on the previous Google activity that was part of the DLI1 initiative. The DLI2 WebBase project aims to build the necessary infrastructure to facilitate the development and testing of new algorithms for clustering, searching, mining, and classification of Web content. ==================== 北大天网组, http://sewm.pku.edu.cn/ 北京大学网络实验室自1997年开始从事搜索引擎方面的研究与系统开发, 技术积累深厚,综合实力和学术影响在国内一直处于领先地位。我们研发的 “天网”搜索引擎系统是全国最有影响的出自校园的搜索引擎,从1997年10月 开始一直运行至今。“天网”在增量搜索技术、快速检索技术,海量信息存储 技术等方面都具有较强的优势,她的不断发展培育了一批批在海量网络文本 信息处理方面有实战经验的学生,受到中外IT企业的普遍欢迎。 从2001年开始,本研究组在搜索引擎技术的基础上,展开了中国互联网 信息历史的收集与存档工作,形成了“中国互联网信息博物馆”,至今已 收藏20亿在不同时期出现过的中文网页,是目前全国规模最大的历史网页收藏 与回放系统。同时,我们还尝试了在其基础上进行多学科交叉的研究。 ==================== 中科院大规模内容计算组 http://159.226.40.18/ 信息检索小组主要针对文本信息的检索开展研究,多次参加TREC会议, 取得了很好的研究成果。小组开发的天罗检索系统在很多国家重要的信息部门 得到了广泛的应用,目前主要的研究方向包括WEB信息的获取,WEB信息检索等。 信息分析小组的研究主要集中在大规模多源异构信息的分析与挖掘方面, 主要包括文本分类与聚类、信息过滤、个性化服务、自然语言问答和浅层 自然语言处理等。小组研制了一系列文本信息加工处理的实验平台,目前实验 平台可以通过主页中“成果演示”进行演示。值得一提的是小组开展的公开源码 计划,其中的高性能分词系统ICTCLAS得到了研究人员的广泛认同与使用。 ==================== 复旦大学信息检索和自然语言处理组, http://www.cs.fudan.edu.cn/mcwil/irnlp/ 大规模文本处理主要研究自然语言(特别是中文信息)的处理技术和方法, 包括二个方面内容:首先是基础性工作,主要是基础性的理论和算法, 包括 自动分词、未登录词识别、词性和概念标注、句法分析和语义分析等,也包括 语料库的搜集整理等;其次是中文信息处理的应用技术,包括自动索引、 文本检索、文本摘要、文本分类和文本过滤,特别是上述技术在网络环境下 的应用。这部分工作是文本方向的研究重点。 ==================== HIT-IRLab, http://ir.hit.edu.cn/ 哈工大信息检索研究室 (HIT-IRLab) 成立于 2001 年 3月。研究方向 包括文本检索、问答系统、自动文摘、文本挖掘和语言分析等, 研究室以 语言分析为基础研究,以文本过滤为应用研究,以信息抽取为语言分析从 句子理解向 篇章理解的延伸,以句子检索为在语言分析和篇章理解的支持 下的智能化精准检索技术。 ==================== SIGIR(美国计算机学会信息检索特别兴趣小组)、 TREC(文本检索学术年会) MUC(消息理解学术年会) TIPSTER(美国国防部高级研究计划署的IR实践基地) ==================== 北京大学计算语言学研究所 http://icl.pku.edu.cn/ 北京大学计算语言学研究所成立于1986年。致力于计算语言学理论、语言 信息处理的基础资源和应用技术三方面的研究。 围绕计算语言学和自然语言处理,包括如下三个主要的方向:首先基础资源 的研究与建设:计算词典学与机器词典,综合型语言知识库,语料库语言学与 语料库加工技术,术语学、术语自动提取、术语标准化研究等。其次是基础理论、 NLP的模型和方法:计算语言学基础,自然语言处理核心技术,现代汉语语法, 汉语的词/句法/语义分析,NLP统计模型,语言处理的信息论方法等。另外是 应用技术:机器翻译的方法、技术与系统实现,信息检索与提取,自然语言 信息处理系统的评价方法和技术,受限汉语及其辅助写作系统,中国古诗词计算机 辅助研究等。 ==================== 清华大学智能技术与系统国家重点实验室 http://www.csai.tsinghua.edu.cn/ 智能技术与系统国家重点实验室依托于清华大学。实验室于1990年2月 对外开放运行。主要从事人工智能基本原理、基本方法的基础与应用基础研究, 包括智能信息处理、机器学习、智能控制,以及神经网络理论等,还从事与 人工智能有关的应用技术与系统集成技术的研究,主要有智能机器人、声音、 图形、图像、文字及语言处理等。 ================ Susan Dumais, http://research.microsoft.com/~sdumais/ I am interested in algorithms and interfaces for improved information retrieval, as well as general issues in and human-computer interaction. I joined Microsoft Research in July 1997. I work on a wide variety of information access and management issues, including: personal information management, web search, question answering, information retrieval, text categorization, collaborative filtering, interfaces for improved search and navigation, and user/task modeling. Prior to coming to Microsoft, I worked on a statistical method for concept-based retrieval known as Latent Semantic Indexing. You can find pointers to this work on the Bellcore (now Telcordia) LSI page. =============== UIUC Information Retrieval Group http://sifaka.cs.uiuc.edu/ir/ The Information Retrieval (IR) group is part of the Database and Information Systems (DAIS) Lab of the Computer Science Department at University of Illinois at Urbana-Champaign. We work on a wide spectrum of problems in the general area of text information management, including retrieval, organization, filtering , and mining of textual information, aiming at developing advanced text information management techniques and systems that help people make better use of text information. ------ ChengXiang Zhai, http://www-faculty.cs.uiuc.edu/~czhai/ Research Interests: Information Retrieval, Text Mining, Natural Language Processing, Bioinformatics University of Illinois at Urbana-Champaign, is recognized for his work on user-centered, adaptive intelligent information access. His techniques expect to improve search-engine performance, support better information organization and enable understanding of large volumes of information. Zhai's work in information retrieval is expected to enhance curricula and provide new educational tools for the growing information technology workforce. =============== Stephen Robertson, http://research.microsoft.com/users/robertson/ Stephen Robertson joined Microsoft Research Cambridge in April 1998. In 1998, he was awarded the Tony Kent STRIX award by the Institute of Information Scientists. In 2000, he was awarded the Salton Award by ACM SIGIR. He is a Fellow of Girton College, Cambridge. At Microsoft, he runs a group called Information Retrieval and Analysis, which is concerned with core search processes such as term weighting, document scoring and ranking algorithms, and combination of evidence from different sources. These are studied theoretically through the use of formal models, mainly statistical, and statistical methods including machine learning methods, and experimentally, through activities such as the Text Retrieval Conference (TREC) and with internally generated evaluation sets. The group (with its Keenbow evaluation environment) has had some excellent results at TREC. The group works closely with product groups to transfer ideas and techniques. His main research interests are in the design and evaluation of retrieval systems. He is the author, jointly with Karen Sparck Jones, of a probabilistic theory of information retrieval, which has been moderately influential. A further development of that model, with Stephen Walker, led to the term weighting and document ranking function known as Okapi BM25, which is used in many experimental text retrieval systems. Prior to joining Microsoft, he was at City University London, where he retains a part-time position as Professor of Information Systems in the Department of Information Science (homepage). He was Head of Department for eight years, during which time it achieved the highest possible rating in two successive research assessment exercises. He also started the Centre for Interactive Systems Research, the main research vehicle of which is the Okapi text retrieval system, which has also done well at TREC. Before joining City, he was a research fellow at University College London, where he took his PhD in the School of Library Archive and Information Studies. Before that he was in the research department at Aslib. He has an MSc in Information Science from City and a first degree in mathematics from Cambridge. =================== Nick Craswell http://research.microsoft.com/~nickcr I am an associate researcher at Microsoft Research Cambridge, in the Information Retrieval and Analysis Group. Research Overview I am interested in Web search evaluation, mostly on enterprise-scale webs but also the World Wide Web. I built the VLC, VLC2, WT2g and .GOV test collections, which have been made available to research groups around the world. David Hawking and I coordinated the TREC Web Track experiments. I am currently involved in the TREC Terabyte Track and Enterprise Track. Some publications: Book chapter preprint (pdf), IR'01 (citeseer) and CSIRO'01 (pdf). I also work on effective Web search, which means making use of information in pages, link structure and URL structure to generate more useful Web search results. Some papers: SIGIR'05 (pdf), SIGIR'01 (pdf), TOIS'03 (pdf) (copying is by permission of ACM, Inc.) and ADCS'03 (pdf). My PhD was in distributed information retrieval (thesis pdf) which means building a system on top of multiple engines/databases that already exist. My recent work in the area has considered whether (or when) DIR is really practical. Some papers: ADC'99 (ps), DL'00 (pdf), ADC'03 (pdf) and ADC'04 (pdf). =============== Web Search & Data Mining Group of MSR Asia http://research.microsoft.com/wsm/ The goal of the Web Search & Data Mining Group of MSR Asia is to drive the next generation of Web search by leveraging data mining, machine learning, and knowledge discovery techniques for information analysis, organization, retrieval, and visualization. In addition, in contrast with current Web search methods, which essentially do document-level ranking and retrieval, the Web Search & Data Mining Group has created search at the object level to bring increased knowledge and intelligence to users. A Glimpse at Several Core Innovations: Large-scale Experimental Web Search Platform The Web Search & Data Mining Group is creating a large scale search platform to efficiently store, parse, index and search billions of Web pages and other types of documents. The search platform is flexible enough to allow for testing of various state-of-the-art search techniques that have been created at the lab using new technologies. Structuralizing the Web The biggest challenge facing both users and search engines over the next several decades is the continued unstructured growth of the Internet. As such, search functions that can effectively and efficiently dig out machine-understandable information and knowledge layers from unorganized and unstructured Web data will be the key to supporting relevant search results. To meet this challenge, the group is exploring technologies, namely Web information extraction, deep Web mining, and Web structure mining that can automatically classify structures and extract objects from the Web. The information and knowledge gathered using these new techniques greatly improves the performance of current Web search and even facilitates the creation of more sophisticated next generation search technologies. Vertical Search Today's conventional search engines can be described as page-level search engines whose main function is to rank web pages according to their relevance to a given query. Driving the future of the search industry are functions that delve deeper into vertical domains to provide knowledge and intelligence to query results. At MSR Asia, the Web Search & Data Mining Group is addressing the greatest challenges faced by vertical search including large scale web classification, object-level information extraction, object identification and integration, and object relationship mining and ranking. The results of these efforts are leading to more advanced search engines that deliver intelligence and insight to search results. Mobile Search The explosive growth of new computing devices such as handheld computers, Windows Mobile-based PocketPCs, and SmartPhones is driving demand for greater and more efficient information access. These devices, which leverage the power of the Web and allow greater access to information than ever before, are still not capable of performing at the level of a desktop PC. At MSR Asia, the Web Search & Data Mining Group is inventing new technologies to improve the mobile search and browsing experience and deliver the capabilities of a PC to users of these new devices. Project initiatives include developing innovative presentation schemes and user interfaces to facilitate search and browsing tasks on mobile devices and developing context aware search technologies to address the special information needs of mobile users. Multimedia Search The Web Search & Data Mining Group is conducting research into new technologies that index multimedia content such as images, videos, and audio. Through content analysis and advanced visualization techniques, the group is transforming today's conventional text based search engines to include multimedia content thus delivering more intelligent search results to users. For example, the group recently developed a new multimedia news reader which mines large archival news databases presenting text, map information, images, and background music within a unique user interface providing readers with a more efficient news search engine and a more enjoyable reading experience. ------ Wei-Ying Ma http://research.microsoft.com/users/wyma/ Senior Researcher, Research Manager, Microsoft Research Asia Dr. Wei-Ying Ma received the B.S. degree in electrical engineering from the National Tsing Hua University in Taiwan in 1990, and the M.S. and Ph.D. degrees in electrical and computer engineering from the University of California at Santa Barbara in 1994 and 1997, respectively. From 1994 to 1997 he was engaged in the Alexandria Digital Library (ADL) project in UCSB while completing his Ph.D. He developed a web-based image retrieval system called Netra which has been frequently cited by other researchers and is regarded as one of the most representative image retrieval systems. From 1997 to 2001, he was with HP Labs where he worked in the field of multimedia adaptation and distributed media services infrastructure. He joined Microsoft Research Asia in 2001. Since then, he has been leading a research group to conduct research in the areas of information retrieval, web search, data mining, mobile browsing, and multimedia management. He currently serves as an Editor for the ACM/Springer Multimedia Systems Journal and Associate Editor for ACM Transactions on Information System (TOIS). He has served on the organizing and program committees of many international conferences including ACM Multimedia, ACM SIGIR, ACM CIKM, WWW, ICME, CVPR, SPIE Multimedia Storage and Archiving Systems, SPIE Multimedia Communication and Networking, etc. He is also the general co-chair of International Multimedia Modeling (MMM) Conference 2005 and International Conference on Image and Video Retrieval (CIVR) 2005. He has published 5 book chapters and over 100 international journal and conference papers. ==================== Google Labs http://labs.google.com/ Google Labs is a playground for Google engineers and adventurous Google users. Google staffers with wild and crazy ideas post their prototypes on Google Labs and solicit feedback on how the technology could be used or improved. None of these experiments are guaranteed to make it onto Google.com, as this is really the first phase in the development process. Google users with a desire to jump over the cutting edge are invited to check out any or all of the posted prototypes and send their comments directly to the Googlers who developed them. Please, remember to wear your safety goggles while using this site. Labs.google.com, Google's technology playground. Google labs showcases a few of our favorite ideas that aren't quite ready for prime time. Your feedback can help us improve them. Please play with these prototypes and send your comments directly to the Googlers who developed them. Want to learn more about Google technology? Here are some papers. http://labs.google.com/papers/index.html Passionate about these topics? You should work at Google. algorithms, artificial intelligence, compiler optimization, computer architecture, computer graphics, data compression, data mining, file system design, genetic algorithms, information retrieval, machine learning, natural language processing, operating systems, profiling, robotics, text processing, user interface design, web information retrieval, and more! http://www.google.com/press/podium.html Google Press Center: The Google Podium Here you'll find a selection of public presentations made by Google executives. From time to time, we will continue to add transcripts, audio or video clips and links to presentations hosted elsewhere. ==================== Jon Kleinberg http://www.cs.cornell.edu/home/kleinber/ Professor of Computer Science, Cornell University My research is concerned with algorithms that exploit the combinatorial structure of networks and information. My recent work has included * link analysis and modeling of the World Wide Web and related information networks; * discrete optimization and network algorithms; and * algorithmic approaches to clustering, indexing, and data mining. ====================
Sparsh:用于基于视觉的触觉感知的自监督触觉表征【传感器:带标记点的 GelSight 2017、无标记点的 DIGIT】 t​⊕It−5​→x∈Rh×w×6tt−2t−4t−6∈R4×h×w×3t​∈Rh×w×3t​∈SE3). Tt​tt−1​≜ΔxΔy˙​Δθ∈SE2ˉ2∘0.5∘1.0∘to1.0∘2.0∘zt−1​zt​qt−1​qt​≜Δqt​Δqt1​...;Δq∈R7。 阅读详情

相关推荐

视觉特征-自监督-同源不同crop视图一致性【2021-04】:DINOv1【全局裁剪(覆盖原图较大区域)➜教师;全局&局部(覆盖原图较小区域)裁剪➜学生】【EMA学生来构建教师】【中心化&锐化】

在本文中,我们探讨 自 监督学习是否为 Vision Transformer (ViT) [19] 提供了区别于卷积 网 络(convnets)的新特性。除了将自监督方法适配到该架构后效果尤为出色这一事实之外,我们还提出以下观察:首先,自监督ViT特征包含有关图像语义分割的显式信息,而这种信息在有监督ViT和convnets中均不会如此清晰地出现。其次,这些特征也是出色的 k-NN 分类器,使用小型 ViT 在 ImageNet 上达到78.3%的top-1准确率。

u013250861的博客 305

信息检索领域的基本了解

简单介绍相关检索领域的概念

qq_37977007的博客 3103

大模型安全-生成检测-事实核查-攻击-防御-思考-记忆-融合-语音相关研究 2025年版

本文整理了关于大模型安全领域的综合性资源,包括7篇综述论文、9个安全数据集以及5篇强化学习相关的安全研究论文。主要涉及大模型的对抗攻击、隐私保护、安全评估等方向,涵盖TruthfulQA、ToxiGen等知名数据集和TrustLLM、HarmBench等关键研究。资源包括知乎博主分享、arXiv预印本和顶会论文,并附有详细的中文讲解链接,为研究者提供了系统性的安全研究参考。

CSPhD-winston的博客 3590

信息检索领域的四个方向

这是我在中科院实习时,从带我实习的程老师那了解到的,他在信息检索领域打拼了十余年的。1. 第三,四代搜索引擎,即所谓的结构化,人性的搜索。2. 协同式搜索,类P2P搜索。(自己上网搜)3. 深度搜索和挖掘4. 信息检索基础理论

Akerlis的专栏 3517

wt2g_inlinks

真实网络语料库WT2g的链接关系图,用于做PageRank等实验

Dify 从入门到熟悉100 天的学习大纲

理解 Dify 的核心概念,熟悉操作界面,并能创建简单的 AI 应用。祝你在这 100 天的旅程中学有所成,成为一名优秀的 AI 应用开发者!掌握生产环境部署、监控、调优,并关注 Dify 生态和前沿动态。探索多模态、Agent、API 集成、性能优化等高级主题。掌握工作流编排、高级提示词技巧、知识库优化等核心功能。

IT深耕十余载,大道之简 1735

大语言模型在研究领域的应用——信息检索中的大语言模型

大语言模型对于传统信息检索技术与应用范式带来了重要影响。这两者在技术路径上具有紧密的互补性。大语言模型拥有强大的语言理解、推理与生成能力,能够助力构建更为智能的信息检索系统;而信息检索技术能够高效地从外界获取所需要的相关信息,可以为大语言模型提供更为精确、可靠的上下文信息。本部分将概要介绍如何利用大语言模型提升信息检索效果,以及检索增强的大语言模型。

weixin_43915730的博客 2996

Zemax实战:手把手教你设计一个40倍、NA0.65的显微物镜(附初始结构文件)

本文详细介绍了使用Zemax设计40倍、NA0.65显微物镜的完整流程,从初始结构搭建到优化验证,涵盖光学设计的关键技巧和实战经验。通过分阶段优化策略和公差分析,帮助工程师快速掌握高倍显微物镜的设计方法,提升光学系统性能。

weixin_42525369的博客 344

信息检索领域相关资料

zz from http://net.pku.edu.cn/~webg/IR-Guide.txt信息检索领域相关资料 (A Guide to Information Retrieval)Organized by Hongfei YanLast updated on April 19, 2006---------------------Contents        Books          

tattarrattat的专栏 5220

【ISP图像处理】Demosaic去马赛克技术演进与边缘优化策略

本文深入解析了ISP图像处理中的Demosaic(去马赛克)技术。从Bayer阵列原理出发,梳理了从双线性插值、Hamilton-Adams边缘导向算法到利用通道相关性与自相似性的技术演进历程,并重点探讨了针对边缘与纹理伪影的优化策略,为工程实践中的算法选型与硬件协同设计提供了专业指导。

weixin_29091445的博客 388

Understand-Anything:AI驱动的代码知识图谱,实现项目全局洞察与高效导航

在软件开发中,理解复杂代码库的结构和依赖关系是提升开发效率的关键。传统代码阅读方式往往陷入局部视角,难以快速把握系统全貌。知识图谱技术通过将代码实体(如文件、类、函数)及其关系(调用、继承、依赖)可视化,为代码理解提供了全局视角。这项技术的核心价值在于将静态代码转化为动态、可交互的认知地图,极大降低了系统学习与维护成本。在实际工程中,它广泛应用于新成员快速入职、遗留系统梳理、架构影响分析等场景。本文介绍的Understand-Anything工具,正是基于这一理念,通过多智能体分析管道,自动构建代码的结构图

weixin_42615290的博客 883

TfIdf for Information Retrieval: The Ultimate Guide

1.背景介绍 信息检索(Information Retrieval, IR)是一种在计算机科学、人工智能和库管理领域广泛应用的技术,它的目的是在一组文档中查找与给定查询相关的信息。信息检索系统通常包括一个查询接口,用户可以通过这个接口输入自己的查询,以及一个检索引擎,用于查找与查询相关的文档。信息检索系统的主要挑战之一是如何有效地处理和比较大量的文本数据,以便在短时间内找到与查询相关的文档。 ...

AI天才研究院 467

【我的Android进阶之旅】Android自定义View实现一个游戏摇杆,来实现监听遥动的方向或者监听摇动的角度的功能

一、需求描述 去年有个需求,需要使用自定义View实现一个游戏摇杆,来识别上下左右摇动的方向。 有点类似下面这样的王者荣耀游戏摇杆的效果 二、业界已有的参考资料 在下面这篇博客介绍了如何自定义游戏摇杆 2.1 博客介绍 Android自定义摇杆 2.1.1 功能 支持自适应大小 支持2个方向、4个方向、8个方向的摇动监听 支持摇动角度获取 可选回调模式 支持可摇动区域自定义 支持摇杆自定义 支持设置图片、色值、Shape图形 2.1.2 效果图 2.1.3 设置回调方式 setCallBac

字节卷动 1409

信息检索领域相关资料 zz

信息检索领域相关资料 zz zzfrom http://net.pku.edu.cn/~webg/IR-Guide.txt 信息检索领域相关资料 (A Guide to Information Retrieval)Organized by Hongfei YanLast updated on April 19, 2006---------------------Content...

weixin_30470857的博客 85

多摄像头场景下 ISP 的同步与调度机制实战解析

在智能手机多摄系统中,主摄、广角、长焦、微距等摄像头的协同工作能力直接决定了影像系统的体验上限。而支撑这一能力的核心之一,正是 ISP 的同步与调度机制。ISP 需要处理多个 Sensor 的输入流、统一时序、资源仲裁、并发调度,并支持在不同模式间快速切换(如预览 → 拍照 → 视频)。本文将基于 Qualcomm、MTK、HiSilicon 平台的实际架构,系统性剖析 ISP 在多摄场景下的时序控制、Pipeline 配置、Buffer 管理与故障恢复机制,并分享实战中的典型问题与调试方案。

努力分享一些人工智能、计算机视觉、影像等相关的知识干货! 2347

【光斑定位】空间激光通信、光斑定位、CCD、光斑定位——13000字

0.完整源码获得方式 订阅MATLAB/FPGA教程,免费获得教程案例以及任意2份完整源码 ----------------------------------------------------------------- 空间激光通信是指以光波作为载波进行数据传输的一种通信方式。目前,空间激光通信己成为人们关注的焦点。在空间激光通信系统中,光斑定位是是一项关键技术。 本论文首先对国内外空间激光通信系统的研究现状进行了阐述,论述了空间激光通信的理论只是,并对CCD成像原理,...

FPGA/MATLAB学习教程/源码/项目合作开发 1291

IR领域资料

信息检索领域相关资料

yfw418的专栏 2625

【Basis】Lumerical licence center 无法连接的问题

端口,我们需要确认该端口是否被其他程序占用。这里我们将介绍如何处理这一问题。后,今天电脑更新后我无法打开。终结占用该端口的程序后再次打开。

u011699626的博客 314

RAG信息检索实战:混合检索、智能切分与PDF结构化解析

信息检索(IR)是RAG系统的核心能力,本质是将用户自然语言查询精准映射到非结构化文档中的语义相关片段。其原理不仅依赖向量相似度计算,更需结合关键词匹配、元数据过滤与文档结构理解,以克服语义鸿沟、结构失焦和上下文割裂三大瓶颈。技术价值在于显著提升答案准确率与可解释性,支撑金融财报分析、医疗临床路径问答、制造业维修手册检索等强合规、高精度场景。本文聚焦LangChain生态下的工业级IR落地,详解PDF结构化解析、HeaderAware智能切分、BM25+向量混合检索等关键实践。

cunfuteng7334的博客 494

LinePhone3.2.7(android端最新版本) sip客户端

SIP客户端For android:LinePhone3.2.7(最新版本),官网地址:http://www.linphone.org/

TMS_WebGMaps_1.9.8.0_Full_Source

TMS_WebGMaps_1.9.8.0_Full_Source 全源码 delphi cbuilder

人工智能 | ShowMeAI资讯日报 #2022.06.09

ShowMeAI资讯日报 2022-06-09 期,AI领域【工具&框架】【项目&代码】【博文&分享】【数据&资源】【研究&论文】最新动态关键词:AI写作助手工具库、数据可视化、3D医学图像分割、算法学习、Go语言、学习路线图…点击阅读全文......

ShowMeAI研究中心 1万+

迈瑞BS系列全自动生化分析仪LIS协议接口手册(内含HL7和ASTM)

迈瑞BS系列全自动生化分析仪LIS协议接口手册,内含HL7和ASTM)

基于大模型的idea提炼:从ResearchAgent,到斯坦福的AI-Researcher、上海AI实验室的VIRSCI

对本博客比较熟悉的朋友知道,我司论文项目组正在基于大模型做论文的审稿(含CS英文论文审稿、和金融中文论文审稿)、翻译,且除了审稿翻译之外,我们还将继续做润色/修订、idea提炼(包含论文检索),是一个大的系统,包含完整的链路 由于论文项目组已壮大到18人,故目前在并行多个事,且我也针对idea提炼做一下技术探索

结构之法 算法之道 8766

ssm框架搭建

这个是一个在idea上成功跑起来的ssm框架项目,保存在这里方便以后使用直接下载

AI系列3:什么是Token

模型的定义在spring AI上是这么描述的:AI 模型是用于处理和生成信息的算法,通常模拟人类的认知功能。通过学习海量数据集中的模式和规律,这些模型能够进行预测,生成文本、图像或其他输出,从而赋能各行各业的应用程序。向量模型这里不去纠结定义是否准确,要重点注意上表中最后一行——接受文本输入并输出数字——通常被称为文本嵌入(Embedding),它表示 AI 模型内部的数据结构。Spring AI 支持嵌入功能,以支持更高级的使用场景。这句话该怎么理解呢?嵌入就是“把文字转化成坐标”。

weigeshikebi的博客 292

学习进程里停滞区间的生成 | 电报语言研究 —— 习惯层级的习得

……

u013669912的博客 373

论文速递 | European Journal of Operational Research 6月文章精选

编者按在本系列文章中,我们对顶级期刊《European Journal of Operational Research》上 2026 年 6 月份在线发布的文章进行了精选(共 10 篇),并总结其基本信息,旨在帮助读者快速洞察领域最新动态。● 题目:Chance-constrained battery management for electric bus scheduling电动公交车调度的机会约束电池管理● 主题:Production, Manufacturing, Transportation and

weixin_53463894的博客 264

2026 流行 AI 数据框架深度研究报告:LlamaIndex 架构演进、核心机制与企业级智能体生态剖析

报告深入剖析了 LlamaIndex 从早期的“RAG 优先”索引库向生产级、事件驱动型智能体工作流(Agentic Workflows)框架的全面范式转移。其核心变革在于摒弃了传统链式有向无环图(DAG)的刚性局限,全面引入基于发布-订阅模式的事件驱动架构(Workflows API),使系统能够天然支持反思、重试与自纠错等复杂自治智能体逻辑,并实现控制流与全局状态管理的解耦。

greenspan的专栏 877
上一篇: Machine Learning Softwares
下一篇: Introduction to Information Retrieval
candj
博客等级 码龄19年 5粉丝 39原创
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付:10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值