搜索引擎早期重要论文推荐系列【8】《Implementation of a Modern Web Search Engine Cluster》...

最新推荐文章于 2025-12-11 18:11:26 发布
最新推荐文章于 2025-12-11 18:11:26 发布 · 122 阅读 · 0
文章标签：

#搜索引擎 #Web #Hadoop

本文介绍了一个名为Yuntis的搜索引擎原型，该项目由纽约石溪大学的Tzi-cker Chiueh教授领导，历时三年完成。Yuntis采用了自行研发的集群通信机制InformationService(IS)，并在此基础上产生了一些重要的研究论文。尽管Yuntis最终未能在市场上取得成功，但它为现代搜索引擎技术的发展提供了一定的参考价值。

本文发表于2003年，在纽约石溪大学Tzi-cker Chiueh教授负责下，耗时3年完成的一个搜索引擎原型，以此原型诞生了一些重要论文，本文是其中最重要的一篇概述论文，其中对方方面面都有阐述和介绍，包括流水线，自行开发的集群通信机制Information Service（IS）等等。其中给出的一些参考数据非常有价值。

Yuntis的源代码可以在【1】中找到，但目前已经无法下载，有兴趣的朋友可以和作者Maxim Lifantsev联系索要。

可惜的是Yuntis并没有掀起什么风浪，虽然自称是现代搜索引擎，但由于靠经费资助，而没有实际收入来源，没有坚持多久就被搁置了，除了贡献这些论文以外，并没有实际的价值。IS的基本想法和2005年诞生的Hadoop基本一致，但无论从先进性还是商业性都差距很大，Yuntis在搜索引擎行业的知名度也非常有限，滚入了历史的洪流之中。

论文下载：http://www.ecsl.cs.sunysb.edu/tr/TR136.pdf

【1】http://www.ecsl.cs.sunysb.edu/yuntis/

iteye_12448
关注
什么是In-Memory计算？ Mastering In Memory Computing:A Comprehensive Guide
AI天才研究院
07-20 3379
作者：禅与计算机程序设计艺术 什么是In-Memory计算？ In-memory computing refers to the process of executing computational tasks by storing input and output data i
搜索引擎早期重要论文推荐系列【8】《Implementation of a Modern Web Search Engine Cluster》
pennyliang的专栏
07-21 1351
本文发表于2003年，在纽约石溪大学Tzi-cker Chiueh教授负责下，耗时3年完成的一个搜索引擎原型，以此原型诞生了一些重要论文，本文是其中最重要的一篇概述论文，其中对方方面面都有阐述和介绍，包括流水线，自行开发的集群通信机制Information Service（IS）等等。其中给出的一些参考数据非常有价值。
基于es 搜索引擎_CoronaXiv：用于Covid-19研究论文的基于AI的基于ElasticSearch的搜索引擎...
weixin_26752075的博客
09-09 538
基于es 搜索引擎CoronaXiv, a product that we built in HackJaipur 2020, won the title of “Best ElasticSearch-based Product” from a pool of 350+ teams across the country. We explain our methodology in this blo...
Impala: A Modern, Open-Source SQL Engine for Hadoop （Impala：适用于Hadoop的现代开源SQL引擎）
Yore - Home
06-22 3047
Cloudera Impala 是一个现代化的开源 MPP SQL引擎，专为Hadoop数据处理环境而设计。 Impala 为 Hadoop上 的 BI或者以主要以读为主的分析提供低延迟和高并发性，而不是由Apache Hive等批处理框架提供。本文从用户的角度介绍了Impala，概述了其体系结构和主要组件，并简要论述了与其他流行的 SQL-on-Hadoop 系统相比的优越性能。
This is the Manual for Quagga 1.2.0. Quagga is a fork of GNU Zebra
张同光 (Tongguang Zhang)：Hello everyone !
06-04 3409
This is the Manual for Quagga 1.2.0. Quagga is a fork of GNU Zebra
渲染书籍目录汇总（不断更新中...）
游戏开发、游戏引擎开发、逆向破解爱好者
05-08 7135
渲染是一个令人着迷的方向，可学习渲染着实有不小的难度。 渲染技术不断在发展，各种技术层出不穷，相关英文资料（中文相对少了很多）更是多如牛毛。 那么如何快速找到自己需要的资料呢？ 为了帮助自己和广大渲染爱好者更方便的找到自己需要的资料，特意写了这篇文章。 这篇文章（不知道知乎是否有字数限制，若有将分多篇文章）将不断更新渲染相关的书籍，并且列出书籍目录。 列出书籍目录有什么用呢？（个人英语水平有限，目录翻译不对还望指正。） 比如，我要学习毛发渲染，那么，可以直接浏览器里面Ctrl+F快捷键搜索毛发或hair，就
What’s the difference between Taxonomies and Ontologies? - Ask Dr. Search
an_2015的博客
02-10 305
转载自：http://www.ideaeng.com/taxonomies-ontologies-0602 What’s the difference between Taxonomies and Ontologies? - Ask Dr. Search Last Updated Jun 2009 A Reader Asks: What’s t...
Awesome Go精选的Go框架，库和软件的精选清单.A curated list of awesome Go frameworks, libraries and software...
浩秦的博客
10-22 2837
Awesome Go financial support to Awesome Go A curated list of awesome Go frameworks, libraries and software. Inspired byawesome-python. Contributing Please take a quick gander at th...
sysspeedup.dll文件免费下载，系统软件文件丢失补回方法
2508_91420188的博客
03-28 1212
在使用电脑时经常会出现丢失找不到某些文件的情况，由于很多常用软件都是采用 Microsoft Visual Studio 编写的，所以这类软件的运行需要依赖微软Visual C++运行库，比如像 QQ、迅雷、Adobe 软件等等，如果没有安装VC++运行库或者安装的版本不完整，就可能会导致这些软件启动时报错，提示缺少库文件。文件下载完成后，下方列表会有很多个不同版本的文件，这里我们根据自己所需要的版本文件，点击右边的“打开”，这样就找到了下载的文件。下面我们通过使用一款DLL修复工具免费下载需要的文件。
MySQL vs. MongoDB: Choosing a Data Management Solution
weixin_34177064的博客
10-08 455
原文地址：http://www.javacodegeeks.com/2015/07/mysql-vs-mongodb.html 1. Introduction It would be fair to say that as IT professionals we are living in the golden age of data management era. As our softwa...
帮我看看问题是什么？ 2025-08-28 11:27:37.819 INFO 14596 --- [ main] c.t.n.d.b.BasicSpringBootApplication : Starting BasicSpringBootApplication on 18088172-BG with PID 14596 (E:\code\java\basic-spring-boot\target\classes started by admin in E:\code\java\basic-spring-boot) 2025-08-28 11:27:37.820 INFO 14596 --- [ main] c.t.n.d.b.BasicSpringBootApplication : The following profiles are active: mysql 2025-08-28 11:27:38.262 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode! 2025-08-28 11:27:38.263 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data Reactive Cassandra repositories in DEFAULT mode. 2025-08-28 11:27:38.286 INFO 14596 --- [ main] .RepositoryConfigurationExtensionSupport : Spring Data Reactive Cassandra - Could not safely identify store assignment for repository candidate interface com.tplink.nbu.demo.basicspringboot.repository.MysqlUserRepository. If you want this repository to be a Reactive Cassandra repository, consider annotating your entities with one of these annotations: org.springframework.data.cassandra.core.mapping.Table (preferred), or consider extending one of the following types with your repository: org.springframework.data.cassandra.repository.ReactiveCassandraRepository. 2025-08-28 11:27:38.286 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 22ms. Found 0 Reactive Cassandra repository interfaces. 2025-08-28 11:27:38.288 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode! 2025-08-28 11:27:38.288 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data Cassandra repositories in DEFAULT mode. 2025-08-28 11:27:38.291 INFO 14596 --- [ main] .RepositoryConfigurationExtensionSupport : Spring Data Cassandra - Could not safely identify store assignment for repository candidate interface com.tplink.nbu.demo.basicspringboot.repository.MysqlUserRepository. If you want this repository to be a Cassandra repository, consider annotating your entities with one of these annotations: org.springframework.data.cassandra.core.mapping.Table (preferred), or consider extending one of the following types with your repository: org.springframework.data.cassandra.repository.CassandraRepository. 2025-08-28 11:27:38.299 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 11ms. Found 1 Cassandra repository interfaces. 2025-08-28 11:27:38.302 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode! 2025-08-28 11:27:38.302 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2025-08-28 11:27:38.307 INFO 14596 --- [ main] .RepositoryConfigurationExtensionSupport : Spring Data JPA - Could not safely identify store assignment for repository candidate interface com.tplink.nbu.demo.basicspringboot.repository.CassandraUserRepository. If you want this repository to be a JPA repository, consider annotating your entities with one of these annotations: javax.persistence.Entity, javax.persistence.MappedSuperclass (preferred), or consider extending one of the following types with your repository: org.springframework.data.jpa.repository.JpaRepository. 2025-08-28 11:27:38.311 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 7ms. Found 1 JPA repository interfaces. 2025-08-28 11:27:38.313 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode! 2025-08-28 11:27:38.313 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data MongoDB repositories in DEFAULT mode. 2025-08-28 11:27:38.316 INFO 14596 --- [ main] .RepositoryConfigurationExtensionSupport : Spring Data MongoDB - Could not safely identify store assignment for repository candidate interface com.tplink.nbu.demo.basicspringboot.repository.CassandraUserRepository. If you want this repository to be a MongoDB repository, consider annotating your entities with one of these annotations: org.springframework.data.mongodb.core.mapping.Document (preferred), or consider extending one of the following types with your repository: org.springframework.data.mongodb.repository.MongoRepository. 2025-08-28 11:27:38.316 INFO 14596 --- [ main] .RepositoryConfigurationExtensionSupport : Spring Data MongoDB - Could not safely identify store assignment for repository candidate interface com.tplink.nbu.demo.basicspringboot.repository.MysqlUserRepository. If you want this repository to be a MongoDB repository, consider annotating your entities with one of these annotations: org.springframework.data.mongodb.core.mapping.Document (preferred), or consider extending one of the following types with your repository: org.springframework.data.mongodb.repository.MongoRepository. 2025-08-28 11:27:38.316 INFO 14596 --- [ main] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 3ms. Found 0 MongoDB repository interfaces. 2025-08-28 11:27:38.721 INFO 14596 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8080 (http) 2025-08-28 11:27:38.731 INFO 14596 --- [ main] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2025-08-28 11:27:38.731 INFO 14596 --- [ main] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.34] 2025-08-28 11:27:38.858 INFO 14596 --- [ main] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2025-08-28 11:27:38.859 INFO 14596 --- [ main] o.s.web.context.ContextLoader : Root WebApplicationContext: initialization completed in 1023 ms 2025-08-28 11:27:39.129 INFO 14596 --- [ main] org.mongodb.driver.cluster : Cluster created with settings {hosts=[localhost:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500} 2025-08-28 11:27:39.158 INFO 14596 --- [localhost:27017] org.mongodb.driver.connection : Opened connection [connectionId{localValue:1}] to localhost:27017 2025-08-28 11:27:39.160 INFO 14596 --- [localhost:27017] org.mongodb.driver.cluster : Monitor thread successfully connected to server with description ServerDescription{address=localhost:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[8, 0, 13]}, minWireVersion=0, maxWireVersion=25, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=1022300} 2025-08-28 11:27:39.183 WARN 14596 --- [ main] o.s.data.convert.CustomConversions : Registering converter from class java.time.LocalDateTime to class java.time.Instant as reading converter although it doesn't convert from a store-supported type! You might want to check your annotation setup at the converter implementation. 2025-08-28 11:27:39.183 WARN 14596 --- [ main] o.s.data.convert.CustomConversions : Registering converter from class java.time.Instant to class java.time.LocalDateTime as reading converter although it doesn't convert from a store-supported type! You might want to check your annotation setup at the converter implementation. 2025-08-28 11:27:39.220 WARN 14596 --- [ main] o.s.data.convert.CustomConversions : Registering converter from class java.time.LocalDateTime to class java.time.Instant as reading converter although it doesn't convert from a store-supported type! You might want to check your annotation setup at the converter implementation. 2025-08-28 11:27:39.220 WARN 14596 --- [ main] o.s.data.convert.CustomConversions : Registering converter from class java.time.Instant to class java.time.LocalDateTime as reading converter although it doesn't convert from a store-supported type! You might want to check your annotation setup at the converter implementation. 2025-08-28 11:27:39.300 INFO 14596 --- [ main] com.datastax.driver.core : DataStax Java driver 3.6.0 for Apache Cassandra 2025-08-28 11:27:39.303 INFO 14596 --- [ main] c.d.driver.core.GuavaCompatibility : Detected Guava >= 19 in the classpath, using modern compatibility layer 2025-08-28 11:27:39.398 INFO 14596 --- [ main] com.datastax.driver.core.Native : Could not load JNR C Library, native system calls through this library will not be available (set this logger level to DEBUG to see the full stack trace). 2025-08-28 11:27:39.398 INFO 14596 --- [ main] com.datastax.driver.core.ClockFactory : Using java.lang.System clock to generate timestamps. 2025-08-28 11:27:39.509 INFO 14596 --- [ main] com.datastax.driver.core.NettyUtil : Did not find Netty's native epoll transport in the classpath, defaulting to NIO. 2025-08-28 11:27:44.003 ERROR 14596 --- [ main] o.s.b.web.embedded.tomcat.TomcatStarter : Error starting Tomcat context. Exception: org.springframework.beans.factory.BeanCreationException. Message: Error creating bean with name 'servletEndpointRegistrar' defined in class path resource [org/springframework/boot/actuate/autoconfigure/endpoint/web/ServletEndpointManagementContextConfiguration$WebMvcServletEndpointManagementContextConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.boot.actuate.endpoint.web.ServletEndpointRegistrar]: Factory method 'servletEndpointRegistrar' threw exception; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'healthEndpoint' defined in class path resource [org/springframework/boot/actuate/autoconfigure/health/HealthEndpointConfiguration.class]: Unsatisfied dependency expressed through method 'healthEndpoint' parameter 1; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'healthIndicatorRegistry' defined in class path resource [org/springframework/boot/actuate/autoconfigure/health/HealthIndicatorAutoConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.boot.actuate.health.HealthIndicatorRegistry]: Factory method 'healthIndicatorRegistry' threw exception; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'org.springframework.boot.actuate.autoconfigure.cassandra.CassandraHealthIndicatorAutoConfiguration': Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'cassandraTemplate' defined in class path resource [org/springframework/boot/autoconfigure/data/cassandra/CassandraDataAutoConfiguration.class]: Unsatisfied dependency expressed through method 'cassandraTemplate' parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cassandraSession' defined in class path resource [org/springframework/boot/autoconfigure/data/cassandra/CassandraDataAutoConfiguration.class]: Invocation of init method failed; nested exception is com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: localhost/0:0:0:0:0:0:0:1:9042 (com.datastax.driver.core.exceptions.TransportException: [localhost/0:0:0:0:0:0:0:1:9042] Cannot connect), localhost/127.0.0.1:9042 (com.datastax.driver.core.exceptions.TransportException: [localhost/127.0.0.1:9042] Cannot connect)) 2025-08-28 11:27:44.019 INFO 14596 --- [ main] o.apache.catalina.core.StandardService : Stopping service [Tomcat] 2025-08-28 11:27:44.020 WARN 14596 --- [ main] o.a.c.loader.WebappClassLoaderBase : The web application [ROOT] appears to have started a thread named [cluster-ClusterId{value='68afccabd741243904de974b', description='null'}-localhost:27017] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:
08-29
从日志来看，你的Spring Boot应用启动失败，核心问题链如下： --- ### **根本原因** **Cassandra数据库连接失败** 引发了一连串依赖问题： ```log NoHostAvailableException: All host(s) tried for query failed ...
Networked Graphics: Building Networked Games and Virtual Environments (Anthony Steed / Manuel Fradin...
weixin_34221276的博客
03-16 7791
PART I GROUNDWORK CHAPTER 1 Introduction CHAPTER 2 One on One (101) CHAPTER 3 Overview of the Internet CHAPTER 4 More Than Two PART II FOUNDATIONS CHAPTER 5 Issues in Networking Graphics CHAPTE...
TLS/SSL在Node.js中的关键部分，包括模块导入、服务器和客户端创建、密码套件配置、证书生成以及相关API的使用
BLOG域名:programb.blog.youkuaiyun.com
04-16 1082
正式环境建议使用可信CA机构颁发的证书（如阿里云免费SSL证书申请流程参考引用[1]）。Node.js 内置。（类似服务器步骤）。
【Yandex 俄罗斯搜索引擎】第4课：Yandex生态系统概览：不止于搜索
weiliang_Handan的博客
12-10 679
Yandex是俄罗斯领先的数字生态系统，提供从搜索、邮件到出行、购物等全方位服务。其核心产品包括Yandex搜索、Yandex 360办公套件、Yandex Go超级应用（整合打车、外卖等服务）、Yandex.Market电商平台，以及AI语音助手Alice和云服务Yandex Cloud。通过统一账户体系和AI技术，Yandex实现了各服务间的深度整合，为俄罗斯用户提供无缝的数字生活体验。尽管母公司正在进行业务重组，Yandex在俄罗斯本土的生态系统仍保持完整运营。
【Yandex 俄罗斯搜索引擎】第9课：Yandex Webmaster工具：网站站长指南
weiliang_Handan的博客
12-11 28
摘要 Yandex Webmaster工具是俄罗斯搜索引擎Yandex提供的免费站长平台，用于监测和优化网站在Yandex中的表现。主要功能包括： 网站验证（通过HTML文件、Meta标签、DNS记录等方式） 索引监测（查看站点地图、抓取统计和索引状态） 健康诊断（检查技术错误、移动适配和安全性问题） 排名分析（追踪关键词表现、地域数据和设备分布） 通过该工具，站长可以全面了解网站在Yandex中的表现，及时发现并解决问题，从而提升在俄罗斯市场的搜索可见性。
【Yandex 俄罗斯搜索引擎】第1课：初识Yandex与俄罗斯搜索市场
weiliang_Handan的博客
12-10 9340
《Yandex：俄罗斯搜索市场的霸主》摘要 Yandex是俄罗斯本土搜索引擎巨头，创立于1993年，现已成为涵盖搜索、地图、打车、电商等多元服务的数字生态系统。其在俄搜索市场份额超60%，远超Google的21.9%。Yandex的核心优势在于：1）卓越的俄语处理能力，能精准理解复杂俄语形态；2）深度本地化策略，重视用户行为信号；3）技术创新，如MatrixNet机器学习算法。通过深耕本土市场，Yandex成为全球少数能与Google抗衡的搜索引擎，展现了技术本地化的成功范例。
【每日一读Day7】搜索引擎DataFlow
最新发布
m0_54984588的博客
12-11 227
因为一种召回无法覆盖所有用户意图。🟩 1. Multi-Retriever 为什么是“多路”？所有召回结果会合并 → Rank1 → Rank2。
ElasticSearch 是什么，ES 是什么？ES 属于搜索引擎型数据库
Rockandrollman的博客
12-07 241
ElasticSearch 是什么，ES 是什么？ES 是一个开源的可扩展的分布式全文搜索引擎，ES 属于搜索引擎型数据库，ES 可以提高根据文档内容查询数据的效率。
【Yandex 俄罗斯搜索引擎】第6课：创建您的第一个Yandex.Direct广告活动
weiliang_Handan的博客
12-11 17
本文介绍了如何创建首个Yandex.Direct广告活动，包括账户注册、广告系列设置、关键词选择和广告文案撰写。Yandex作为俄罗斯主流搜索引擎，其广告平台Yandex.Direct是开拓俄语市场的重要工具。文章详细讲解了从Yandex ID注册到广告投放的全流程，重点介绍了Yandex Wordstat关键词工具的使用技巧，以及如何优化广告文案提高点击率。通过本指南，初学者可以系统掌握Yandex.Direct的基本操作，为俄罗斯市场数字营销奠定基础。
implementation of version 4.0 of porject facet jst.web could not be found.Functionality will be limited
06-08
具体来说，它可能是由于缺少 JST Web Facet 4.0 实现所需的相关库文件，或者您的项目配置中缺少必需的 Facet。 为了解决这个问题，您可以尝试执行以下步骤： 1. 确认您的项目中已经包含了 JST Web Facet 4.0 实现...
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
表情包 代码片
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值