这一篇紧接着上面继续了。
方案二
基于redis的消息回执。主要流程分为下面几个步骤:
1)将消息暂存储与redis中,设置好消息的过期时间
2)客户端回执消息id来消灭暂存的消息
3)开通单独线程论坛在第1)步中的消息。根据消息的时间重新发送消息。如果消息第一次存放的时间大雨有效期(自定义10秒),解析消息中的to查找用户是否还在线。如果在则T掉(因为它长时间不理会服务的重要命令),如果不在线则将消息放置离线表。
OK,先来看看消息的存储格式吧。
1.MESSAGE消息 用户集合
SADD SOGU:[username] [VALUE(messageID)] [VALUE(messageID)] ...
2.已读消息设备集合
SADD RT:[terminalid] [VALUE(messageID)] [VALUE(messageID)] ...
3.消息内容
HMSET OGM:[messageID] CREATIONDATE [VALUE] UPDATEDATE [VALUE] STANZA [VALUE]
4.用户、设备关联
SADD URT:[USERNAME] [VALUE(terminalid)] .......
(先根据消息id查找时间,在java中排序后 查找stanza)
MESSAGE
--离线表
ZADD OFOFFLINE:[username] [INDEX(时间戳)] [VALUE(messageID)] 、[VALUE]、[VALUE]...... [VALUE]
HMSET OFOFFLINE:[messageID] STANZA[VALUE]
CREATIONDATE [VALUE] MESSAGESIZ[VALUE]
将消息暂时消息存储:
- public void storeMessage(String username, Packet packet) {
- edis jedis = XMPPServer.getInstance().getGroupRedisManager().getJedis();
- String packetID = "";
- if (packet instanceof Message)
- packetID = ((Message)packet).getID();
- else if (packet instanceof IQ)
- packetID = ((IQ)packet).getID();
- else
- return;
- try {
- jedis.sadd("SOGU:" + username, packetID);
- Map<String, String> hash = new HashMap<String, String>();
- hash.put("STANZA", packet.toXML());
- hash.put("CREATIONDATE", StringUtils.dateToMillis(new Date()));
- jedis.hmset("OGM:" + packetID, hash);
- finally {
- XMPPServer.getInstance().getGroupRedisManager().returnRes(jedis);
- htp.execute(addMessagesToDB(packet));
- }
- private Runnable addMessagesToDB(final Packet packet) {
- return new Runnable() {
- @Override
- public void run() {
- MyDBopt.insertMessage(packet);
- }
客户端收到消息来回执服务端的操作
- private void handle(IQ packet) {
- JID recipientJID = packet.getTo();
- if (IQ.Type.crs != packet.getType()) {
- // Check if the packet was sent to the server hostname
- if (recipientJID != null && recipientJID.getNode() == null &&
- recipientJID.getResource() == null && serverName.equals(recipientJID.getDomain())) {
- Element childElement = packet.getChildElement();
- if (childElement != null && childElement.element("addresses") != null) {
- // to route this packet
- multicastRouter.route(packet);
- return;
- }
- }
- }
- if (IQ.Type.crs == packet.getType()) {
- String username = packet.getFrom().getNode();
- String terminal = packet.getFrom().getTerminal();
- String msgId = packet.getID();
- if (username == null || msgId == null || "".equals(msgId)) {
- return ;
- }
- if (terminal == null) {terminal = username + "_" + System.currentTimeMillis()%1000000; }
- Jedis jedis = XMPPServer.getInstance().getGroupRedisManager().getJedis();
- try {
- jedis.sadd("URT:" + username, terminal);
- jedis.sadd("RT:" + terminal, packet.getID());
- } finally {
- XMPPServer.getInstance().getGroupRedisManager().returnRes(jedis);
- }
- threadPool.execute(createTask(msgId, username, terminal));
- return;
- }
- if (packet.getID() != null && (IQ.Type.result == packet.getType() || IQ.Type.error == packet.getType())) {
- // The server got an answer to an IQ packet that was sent from the server
- IQResultListener iqResultListener = resultListeners.remove(packet.getID());
- if (iqResultListener != null) {
- resultTimeout.remove(packet.getID());
- if (iqResultListener != null) {
- try {
- iqResultListener.receivedAnswer(packet);
- }
- catch (Exception e) {
- Log.error(
- "Error processing answer of remote entity. Answer: "
- + packet.toXML(), e);
- }
- return;
- }
- }
- }
- try {
- // Check for registered components, services or remote servers
- if (recipientJID != null &&
- (routingTable.hasComponentRoute(recipientJID) || routingTable.hasServerRoute(recipientJID))) {
- // A component/service/remote server was found that can handle the Packet
- routingTable.routePacket(recipientJID, packet, false);
- return;
- }
- if (isLocalServer(recipientJID)) {
- // Let the server handle the Packet
- Element childElement = packet.getChildElement();
- String namespace = null;
- if (childElement != null) {
- namespace = childElement.getNamespaceURI();
- }
- if (namespace == null) {
- if (packet.getType() != IQ.Type.result && packet.getType() != IQ.Type.error) {
- // Do nothing. We can't handle queries outside of a valid namespace
- Log.warn("Unknown packet " + packet.toXML());
- }
- }
- else {
- // Check if communication to local users is allowed
- if (recipientJID != null && userManager.isRegisteredUser(recipientJID.getNode())) {
- PrivacyList list =
- PrivacyListManager.getInstance().getDefaultPrivacyList(recipientJID.getNode());
- if (list != null && list.shouldBlockPacket(packet)) {
- // Communication is blocked
- if (IQ.Type.set == packet.getType() || IQ.Type.get == packet.getType()) {
- // Answer that the service is unavailable
- sendErrorPacket(packet, PacketError.Condition.service_unavailable);
- }
- return;
- }
- }
- IQHandler handler = getHandler(namespace);
- if (handler == null) {
- if (recipientJID == null) {
- // Answer an error since the server can't handle the requested namespace
- sendErrorPacket(packet, PacketError.Condition.service_unavailable);
- }
- else if (recipientJID.getNode() == null ||
- "".equals(recipientJID.getNode())) {
- // Answer an error if JID is of the form <domain>
- sendErrorPacket(packet, PacketError.Condition.feature_not_implemented);
- }
- else {
- // JID is of the form <node@domain>
- // Answer an error since the server can't handle packets sent to a node
- sendErrorPacket(packet, PacketError.Condition.service_unavailable);
- }
- }
- else {
- handler.process(packet);
- }
- }
- }
- else {
- // JID is of the form <node@domain/resource> or belongs to a remote server
- // or to an uninstalled component
- routingTable.routePacket(recipientJID, packet, false);
- }
- }
- catch (Exception e) {
- ......
- }
- }
离线消息
离线消息的优化。
同样可以拓展XMPP。比如
客户端获取离线消息,可以这么通讯。
1)先向服务器询问,我总的离线消息的基本状况(有多大,有多少条)
- <iq id="BfI3V-47" to="8ntmorv1ep4wgcy" type="get" from="test@8ntmorv1ep4wgcy">
- <query xmlns="http://jabber.org/protocol/offmsg#bif"/>
- </iq>
2)服务端返回
- <iq type="result" id="BfI3V-47" from="8ntmorv1ep4wgcy" to="test@8ntmorv1ep4wgcy">
- <query xmlns="http://jabber.org/protocol/offmsg#bifs">
- <size>1024b</>
- <count>128</>
- <idset>1001,1002...</>
- </query>
- </iq>
3)客户端发送分批获取命令,一次给我发10条发完为止。
- <iq id="BfI3V-47" to="8ntmorv1ep4wgcy" type="get" from="test@8ntmorv1ep4wgcy">
- <query xmlns="http://jabber.org/protocol/offmsg#start"/>
- <pagesize>10</>
- </iq>
4)服务端开始发送消息
- <iq type="result" id="BfI3V-47" from="8ntmorv1ep4wgcy" to="test@8ntmorv1ep4wgcy">
- ......
- </iq>
- <iq type="result" id="BfI3V-47" from="8ntmorv1ep4wgcy" to="test@8ntmorv1ep4wgcy">
- ......
- </iq>
- .....
5)告诉客户端我都发完了
- <iq type="result" id="BfI3V-47" from="8ntmorv1ep4wgcy" to="test@8ntmorv1ep4wgcy">
- <query xmlns="http://jabber.org/protocol/offmsg#end"/>
- </iq>
6)客户端本地校验,回执已经接收到的消息
- <message id="BfI3V-47" to="8ntmorv1ep4wgcy"
- from="test1@8ntmorv1ep4wgcy/Spark 2.6.3" type="crs"/>
这里本人只是做了一个简单的示意想法。如果需要更加精准的不妨在仔细想想消息处理与格式。
离线消息存储。
将消息存储到redis中:
- public void addMessageToRedis(Message message) {
- if (message == null) {
- return;
- }
- JID recipient = message.getTo();
- String username = recipient.getNode();
- // If the username is null (such as when an anonymous user), don't store.
- if (username == null || !UserManager.getInstance().isRegisteredUser(recipient)) {
- return;
- }
- else
- if (!XMPPServer.getInstance().getServerInfo().getXMPPDomain().equals(recipient.getDomain())) {
- // Do not store messages sent to users of remote servers
- return;
- }
- String msgXML = message.getElement().asXML();
- Jedis jedis = XMPPServer.getInstance().getChatMessageJedisPoolManager().getJedis();
- try {
- String newDate = StringUtils.dateToMillis(new java.util.Date());
- String id = MessageIdTactics.mid(username);
- jedis.zadd("OFOFFLINE:" + username, Long.valueOf(newDate), id
- Map<String, String> hash = new HashMap<String, String>();
- hash.put("STANZA", msgXML);
- hash.put("MESSAGESIZ", String.valueOf(msgXML.length()));
- hash.put("CREATIONDATE", newDate);
- jedis.hmset("OFOFFLINE:" + id, hash);
- } finally {
- XMPPServer.getInstance().getChatMessageJedisPoolManager().returnRes(jedis);
- }
- if (sizeCache.containsKey(username)) {
- int size = sizeCache.get(username);
- size += msgXML.length();
- sizeCache.put(username, size);
- }
- htp.execute(addMessageToDB(message));
- }
Redis优化这块就到这啦。主要要做的就是:
第一:存储用户或者MUC、Group等这些都需要设置消息存储的生命周期。当用户不处于活跃状态或者长时间不登陆的。要从redis中提出。免得浪费资源。当用户重新加载的时候再将他放置redis中
第二:将需要回执消息和离线消息分开。需要回执的消息需要设置他的生命周期。离线表最好做个定时器。轮询消息。将超时出现范围内的消息(比如周期为一周)的消息同步至关系表中。这里的离线消息需要将用户的设备分开来。
这里要考虑不同的设备终端等很多不同场景,问题会比较绕口。欢迎大家和我邮件交流