Group message video viewing method and device, equipment and medium

Abstract

The invention discloses a group message video viewing method and device, equipment and a medium. The method comprises the following steps: receiving a message viewing capability parameter and target group identification information sent by a client; sending the target group identification information to a group message server, and receiving a target group session message sent by the group message server according to the target group identification information; and performing video processing on the target group session message according to the message viewing capability parameter to obtain a target group session video, so that the client views the target group session message from the target group session video. According to the method and the device, the efficiency of acquiring effective information in the group message by the group members is improved in a form of automatically playing the group session message by the video, and the problem that the efficiency of checking a large number of group messages by the group members is low is solved; and extra consumption of space resources of the client is avoided.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a method, device, equipment and medium for viewing group messages in a video format. Background Art

[0002] With the development of computer technology, information transmission through the Internet is becoming more and more common, such as conversations through instant messaging applications, and multi-person online communication can be achieved by establishing groups and adding multiple group members.

[0003] When communicating with multiple parties through groups, the number of group members is large, resulting in a huge amount of group messages. If you want to obtain valuable messages from the numerous group messages, you need to check them one by one from the last unchecked position, resulting in low efficiency in checking group messages. For example, now the communication between schools and parents basically relies on groups of communication tools. The notification messages sent by teachers in the group can easily be hidden in the large number of reply messages from other parents, resulting in parents who have not checked the messages in time needing to manually check each message carefully from the beginning, resulting in low efficiency in obtaining valid messages. Summary of the invention

[0004] The present invention provides a method, device, equipment and medium for viewing group messages in a video format, so as to solve the problem that group members have low viewing efficiency for a large number of group messages.

[0005] According to one aspect of the present invention, a method for viewing a group message in video format is provided, which is performed by an intermediate server, wherein the intermediate server is connected to a client and a group message server respectively, and comprises:

[0006] Receive message viewing capability parameters and target group identification information sent by the client;

[0007] Sending the target group identification information to a group message server, and receiving a target group conversation message sent by the group message server according to the target group identification information;

[0008] The target group conversation message is processed into a video according to the message viewing capability parameter to obtain a target group conversation video, so that the client can view the target group conversation message from the target group conversation video.

[0009] According to another aspect of the present invention, a video viewing device for group messages is provided, which is deployed in an intermediate server, and the intermediate server is connected to a client and a group message server respectively, and includes:

[0010] The client information receiving module is used to receive the message viewing capability parameters and target group identification information sent by the client;

[0011] A group server information receiving module, configured to send the target group identification information to a group message server, and receive a target group conversation message sent by the group message server according to the target group identification information;

[0012] The session video generation module is used to perform video processing on the target group session message according to the message viewing capability parameter to obtain a target group session video, so that the client can view the target group session message from the target group session video.

[0013] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the video viewing method for group messages described in any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the video viewing method of a group message according to any embodiment of the present invention when executed.

[0018] The technical solution of the embodiment of the present invention obtains the target group conversation message of the client's interest sent by the group message server on the intermediate server, and processes the target group conversation message into a video, so that the client can view the group conversation message in the form of a video. The group conversation message is automatically played by video, which improves the efficiency of group members in obtaining effective information in the group message, solves the problem of low efficiency of group members in viewing a large number of group messages, and because the target group conversation video is stored in the intermediate server, it will not cause additional consumption of client space resources.

[0019] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1 is a flowchart of a method for viewing a group message in video format provided according to Embodiment 1 of the present invention;

[0022] Figure 2 This is an interactive diagram of a method for viewing group messages in video format provided according to Embodiment 2 of the present invention;

[0023] Figure 3 is a schematic diagram of the structure of a video viewing device for group messages provided according to Embodiment 3 of the present invention;

[0024] Figure 4 It is a structural schematic diagram of an electronic device for implementing the method for viewing group messages in video format according to an embodiment of the present invention. DETAILED DESCRIPTION

[0025] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "candidate", "target", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0027] Embodiment 1

[0028] Figure 1A flowchart of a method for viewing group messages by video is provided for the first embodiment of the present invention. This embodiment is applicable to the situation where group members view a large number of messages generated in the group. The method can be executed by a video viewing device for group messages. The video viewing device for group messages can be implemented in the form of hardware and / or software. The video viewing device for group messages can be configured in an intermediate server, and the intermediate server is connected to the client and the group message server respectively. Figure 1 As shown, the method includes:

[0029] S110: Receive message viewing capability parameters and target group identification information sent by the client.

[0030] Among them, the client refers to the terminal used by the user who has the need to view group messages. The user can be a group member or a non-group member. For example, the group is a home-school communication group formed by school teachers. The client can be the terminal used by a parent who is already a group member. However, in order to ensure the number of members in the home-school communication group, schools generally require that a school only support one parent to join the group. Therefore, the client can be a terminal used by a parent who is not added to the group but also pays attention to the group messages.

[0031] The message viewing capability parameter is used to characterize the user's ability to view group messages on the client. In a feasible embodiment, the message viewing capability parameter includes the client message viewing speed, the client resolution, and the client screen display parameters. Among them, the client message viewing speed is determined according to the user's reading speed of the content displayed on the terminal display screen. For example, if the user's reading time for the message content displayed on a single screen on the client display screen is 10 seconds, then the client viewing speed is 0.1 screen / second. The client message viewing speed can be adjusted according to the user's actual ability and is not limited here. The client resolution is used to characterize the video display clarity. The client resolution is determined based on the client screen display effect, that is, the maximum screen display resolution, traffic consumption, and the user's viewing clarity requirements. Exemplarily, considering the display effects of different client models and screen sizes, generally, a picture with 1 / 2 of the actual pixel can be displayed normally. Considering the clarity and traffic consumption (resolution is proportional to bandwidth / traffic), the best resolution is selected to adapt to all terminal displays, then the resolution I R∈[maximum resolution / 2, maximum resolution]. The client screen display parameters are used to determine the message content displayed on a single screen on the client screen. For example, the client screen display parameters include the client screen font display parameters and the client screen size parameters. The number of messages that can be displayed simultaneously on a single screen of the client can be determined based on the client screen font display parameters and the client screen size parameters. The client sends the message viewing capability parameters to the intermediate server so that the video generated by the intermediate server according to the parameters is adapted to be displayed on the client, thereby improving the user's viewing experience of the video.

[0032] The target group identification information is used to indicate the group that the client is following. For example, the target group identification information includes the group name and the group unique code.

[0033] Specifically, when the client sends a keep-alive message to the intermediate server, the message viewing capability parameter and the target group identification information are extended in the keep-alive message. Exemplarily, they can be combined into the keep-alive message and sent to the intermediate server, or sent separately to the intermediate server, and the message viewing capability parameter and the target group identification information can also be sent separately to the intermediate server. For example, after the client sends the message viewing capability parameter and successfully registers on the intermediate server, it sends the target group identification information to the intermediate server. For example, the message type of the message viewing capability parameter can be sip.register, and the message type of the target group identification information can be sip.subscribe.

[0034] S120: Send the target group identification information to the group message server, and receive the target group conversation message sent by the group message server according to the target group identification information.

[0035] The group message server refers to a server that directly stores messages sent between group members. The intermediate server refers to a private cloud server or a personal cloud storage server that can be used by multiple users to register and use, so that users who have successfully registered can obtain data stored on the private cloud server. For example, the intermediate server can be NAS (Network Attached Storage).

[0036] Specifically, the intermediate server sends the target group identification information of the user to the group message server, and the group server selects the target group from the candidate groups according to the target group identification information, and sends the unprocessed messages in the target group to the intermediate server. Exemplarily, the group server sends all the conversation messages in the target group from the last pushed end point to the current one to the intermediate server.

[0037] In a feasible embodiment, before receiving the target group conversation message sent by the group message server according to the target group identification information, the method further includes:

[0038] The preset session push strategy is sent to the group message server; wherein the preset session push strategy is used to instruct the group message server to determine a single push target group session message from the to-be-pushed target group session messages associated with the target group identification message.

[0039] Since the number of unprocessed messages in the target group in the group message server may be large or the fragmented messages may be large, if all unprocessed messages are sent to the intermediate server at one time, it will also make it difficult for the intermediate server to efficiently extract valid information, affecting the message processing efficiency of the intermediate server. Therefore, in this embodiment, the intermediate server sends the preset session push strategy to the group message server, so that the group message server extracts the target group session message pushed once from all unprocessed messages according to the preset session push strategy, so as to improve the efficiency and accuracy of the intermediate server in extracting valid messages from the target group session message.

[0040] Among them, the preset conversation push strategy can be determined according to the positioning results of the preset format content. For example, in the home-school communication group, the messages notified by the administrator are generally valid messages, and the administrator will @ everyone when notifying different messages, and only the administrator has this ability. Therefore, the target group conversation message pushed once can start with "spokesperson @ all members" as a conversation until the next "spokesperson @ all members" message, indicating the end of this conversation, and determine the target group conversation message pushed once based on the messages in between.

[0041] Specifically, the intermediate server sends the target group identification information to the group server to subscribe to the group message associated with the target group identification information. The group message server divides the unprocessed messages into sessions according to the preset session push strategy, extracts the messages of a single session as the target group session messages for a single push, and pushes the target group session messages to the intermediate server to improve the push efficiency.

[0042] S130: Perform video processing on the target group conversation message according to the message viewing capability parameter to obtain the target group conversation video, so that the client can view the target group conversation message from the target group conversation video.

[0043] Since the message viewing capability parameter includes the ability of the user to view group messages on the client, the target group conversation message is video processed according to the capability parameter, the target group conversation message is converted into at least one video frame, and multiple video frames are combined to obtain the target group conversation video.

[0044] Exemplarily, a message length threshold included in each conversation video is predetermined, for example, expressed in terms of message length threshold duration, that is, conversation messages in each conversation video are limited to be saved for a preset duration. It is determined whether the time interval between the current time and the saving time of the previous conversation video reaches the preset duration. If not, the generated video frames are added to the current conversation video; if reached, the current conversation video is saved, and a new video file is regenerated according to the preset video saving path to save the next video frame generated within the preset duration.

[0045] Specifically, after the intermediate server generates a target group conversation video, it saves the target group conversation video in a preset directory. For example, / share / videoed is a shared folder where the target group conversation video is stored on the NAS side. / share / videoed serves as the root directory for video storage of information. The user can configure the space occupancy mode of the target to manage the target group conversation video, where the space occupancy mode includes a shared mode or an exclusive mode. In the shared mode, the upper limit of the capacity usage of the videos stored in the directory is the capacity of the storage pool to which the shared folder belongs, usually the capacity of the entire NAS device; in the exclusive mode, the upper limit of the capacity usage of the videos stored in the directory is configured by the user to avoid storing too many video files in the database of the intermediate server and to achieve timely cleanup of video files.

[0046] At the same time, when the target group conversation video file is saved in the intermediate server, the index information corresponding to the video is also saved in the intermediate server synchronously, so that the client can search according to the index information, thereby improving the viewing efficiency of the user. Among them, the index information includes the group identifier and the message sending time corresponding to the video.

[0047] In a feasible embodiment, S130 includes:

[0048] If the target group conversation message is text, determine the text display parameter according to the message viewing capability parameter, and convert the text into a video based on the text display parameter;

[0049] If the target group conversation message is voice, the voice is recognized to obtain corresponding converted text, the converted text display parameters are determined according to the message viewing capability parameters, the converted text is processed into a video based on the converted text display parameters, and the audio file corresponding to the voice is added to the target group conversation video, and a link relationship between the converted text and the audio file is established, so that the audio file can be obtained through the link relationship during the playback of the target group conversation video;

[0050] If the target group conversation message is an image, a corresponding preview image is determined based on the image, preview image display parameters are determined based on the message viewing capability parameters, the preview image is converted into a video based on the preview image display parameters, and the original image file corresponding to the preview image is added to the target group conversation video, and a link relationship between the preview image and the original image file is established so that the original image file can be obtained through the link relationship during the playback of the target group conversation video.

[0051] Specifically, if the group conversation message sent by the group member is a text message, the text display parameter is determined according to the message viewing capability parameter, so as to determine the display effect of the text message in the corresponding conversation message video frame according to the text display parameter. For example, the message viewing capability parameter includes the client screen font display parameter and the client screen size parameter, and the text display parameter includes the text display size and the text display color. The text display size is determined according to the client screen font display parameter and the client screen size parameter, or the text display color is determined according to different group member identities, for example, the text display color corresponding to the text message sent by the administrator is different from the text display color corresponding to the text message sent by the non-administrator.

[0052] If the group conversation message sent by the group member is a voice message, in order to improve the efficiency of the client to view the group conversation message, the voice message is converted into a corresponding converted text message, and then the converted text message is processed according to the video processing method of the text message to display the converted text message in the corresponding conversation message video frame. However, due to certain inaccuracies in the voice-to-text conversion, in order to improve the accuracy of the client to view the message, the audio file corresponding to the voice message is added to the target group conversation video at the same time. For example, according to the position information of the conversation message video frame corresponding to the voice message in the target group conversation video, the audio file is also stored in the folder where the target group conversation video is stored using the position information as an index link. When the user plays and views the target group conversation video on the client, if there is any doubt about the converted text content, the original audio file can be played by pausing the video and clicking the converted text message, and the index link relationship between the converted text and the audio file is used to play the original audio file.

[0053] If the group conversation message sent by the group member is an image message, the image message includes a picture message and a video message, and the preview image corresponding to the image message is determined, wherein the preview image of the picture message can be a thumbnail of the picture; the preview image of the video message can be a thumbnail of the first frame of the video. The preview image display parameters are determined according to the message viewing capability parameters, so as to determine the display effect of the preview image in the corresponding conversation message video frame according to the preview image display parameters. For example, the message viewing capability parameters include the client screen font display parameters and the client screen size parameters, and the preview image display parameters include the preview image display size and the preview image display identifier. The preview image display size is determined according to the client screen font display parameters and the client screen size parameters, and the preview image display identifier is determined according to the type of the image message. For example, the preview image display identifiers corresponding to the picture message and the video message are different, so that the user can distinguish them.

[0054] Since the preview image only includes part of the information of the image message, in order to ensure the integrity of the group conversation message obtained by the user when playing the target group conversation video from the client, according to the position information of the conversation message video frame corresponding to the image message in the target group conversation video, the original image file is also stored in the folder where the target group conversation video is stored using the position information as an index link. When the user plays and views the target group conversation video on the client, if he is interested in the content of the preview image, he can click the preview image by pausing the video, and display the original image file through the index link relationship between the preview image and the original image file, such as displaying the original image of the picture message or playing the complete video information of the video message. When the user views the target group conversation message by playing the target group conversation video in the client, he can choose to play it in horizontal screen or vertical screen. For example, when viewing a text message, he can choose to play it in vertical screen, and when viewing an image message, he can choose to play it in horizontal screen. It can be set according to the content of the message, and there is no restriction here.

[0055] In a feasible embodiment, S130 includes:

[0056] Segment the target group conversation message according to the client screen display parameter to obtain at least one set of target group conversation message sets;

[0057] Generate corresponding conversation message video frames for each target group conversation message set according to the client resolution and the client screen display parameters;

[0058] Determine the frame number parameters of the session message video frame according to the client message viewing speed and the preset video frame rate;

[0059] The conversation message video frames are processed according to the frame number parameter to obtain the target group conversation video.

[0060] The client screen display parameters are used to determine the message content displayed on a single screen of the client screen. For example, the client screen display parameters include client screen font display parameters and client screen size parameters. The number of messages that can be displayed simultaneously on a single screen of the client can be determined according to the client screen font display parameters and the client screen size parameters. Specifically, the number of messages that can be displayed simultaneously on a single screen of the client display screen is determined according to the client screen display parameters, and the target group conversation messages are segmented according to the number of single-screen messages to obtain a target group conversation message set of at least one screen, and each target group conversation message set is a group.

[0061] The client resolution is used to characterize the video display clarity, and the client resolution is determined according to the client screen display effect, that is, the maximum screen display resolution, traffic consumption, and the user's viewing clarity requirements. Specifically, each group of target group conversation message sets is converted into corresponding conversation message video frames according to the client picture display clarity requirements and the client screen font display parameters, so that the content displayed on the conversation message video frame includes all messages in the target group conversation message set.

[0062] The client message viewing speed is determined based on the user's reading speed of the content displayed on the terminal display screen. For example, if the user takes 10 seconds to read the message content displayed on a single screen on the client display screen, the client viewing speed is 0.1 screen / second. The preset video frame rate is used to characterize the playback effect of the conversation video. For example, the preset video frame rate can be determined based on the frame rate required by the human eye for continuous video. For example, the preset video frame rate can be set to be greater than or equal to 25fps, which is the minimum frame rate required by the human eye for continuous video. The formula for determining the frame number parameter of the conversation message video frame is preset video frame rate / client message viewing speed.

[0063] Specifically, after determining the frame number parameter, the generated session message video frames corresponding to each set of target group session message sets are extended to reach the frame number parameter, and the session message video frames corresponding to all the extended target group session message sets are combined to obtain the target group session video. Exemplarily, a video file is limited to keep 2 hours of session messages. After the target group session video is generated, it is determined whether the time interval between the session message time corresponding to the target group session video and the start session message time of the current video file reaches 2 hours. If not, the target group session video is inserted into the current video file. If so, the current video file is saved, a new video file path is generated, and the target group session video is added to the video file corresponding to the new video file path.

[0064] In a feasible embodiment, before performing video processing on the target group conversation message according to the message viewing capability parameter, the method further includes:

[0065] Determine the conversation topic according to the message content of the target group conversation message;

[0066] Determine the matching result between each message in the target group conversation message and the conversation topic, and determine the message with the matching result of failed matching as the remaining message;

[0067] The remaining messages are removed from the target group conversation message at the current moment, and according to the matching result of the remaining messages and the conversation topics of the target group conversation messages at other moments, the remaining messages are added to the target group conversation messages at other moments that have been matched successfully.

[0068] The conversation topic is used to characterize the effective message content of the target group conversation message. Specifically, the conversation topic is determined according to the semantic recognition result of the target group conversation message. Exemplarily, based on the above example, the group message server sends the target group conversation message to the intermediate server according to the preset conversation push strategy, and then determines the key speaker information according to the preset conversation push strategy, and determines the conversation topic according to the semantic recognition result of the message sent by the key speaker.

[0069] For example, in a home-school communication group, only messages notified by the administrator are valid messages, and when the administrator notifies different messages, he will @ everyone, and only the administrator has this ability. Therefore, a single push of the target group conversation message can start with "spokesperson @ all members" as a conversation until the next "spokesperson @ all members" message, indicating the end of this conversation, and determine the single push of the target group conversation message based on the messages in between. The key speaker is the first speaker of the target group conversation message, and the conversation topic is determined based on the content of the message sent by the first speaker.

[0070] Since there may be messages in the target group conversation message that are not related to the current conversation topic and are sent by group members, for example, based on the above example, due to the delay in group members viewing messages, the content of the previous "spokesperson @ all members" will be replied to under the current "spokesperson @ all members" conversation, that is, there may be messages in the current target group conversation message that are not consistent with the current conversation topic. In order to improve the accuracy of the message content in the target group conversation message, the messages that are not consistent with the current conversation topic are removed from the current target group conversation message, and matched with the conversation topics of the aforementioned other target group conversation messages, and the remaining messages are added to the other target group conversation messages with the highest matching degree. Among them, the other target group conversation messages are determined from the aforementioned preset number of target group conversation messages of the current target group conversation message, and the number of preset numbers is determined according to the actual scenario and is not limited here.

[0071] Exemplarily, a matching result of a matching failure indicates that the semantic similarity between the remaining messages and the conversation topic is less than a preset similarity threshold, and the specific value of the preset similarity threshold can be determined according to the actual scenario and is not limited here.

[0072] Optionally, the conversation topic is displayed on the target group conversation video corresponding to the target group conversation message, so as to enhance the user's preliminary understanding of the message content included in the target group conversation video.

[0073] This embodiment realizes that the message subjects of the messages associated in a target group conversation message are the same, which is more conducive to the user to filter valid messages from the target group conversation message and avoids missing valid messages of other subjects mixed therein.

[0074] In a feasible embodiment, before performing video processing on the target group conversation message according to the message viewing capability parameter, the method further includes:

[0075] De-duplicate the target group conversation messages.

[0076] Since there may be a large amount of repeated content sent by different group members in the group message, such as "received" and "OK", the existence of these repeated messages will occupy a large amount of video frame content, affecting the efficiency of users obtaining valid messages from the video frames. Therefore, before the target group conversation message is processed as a video, the target group conversation message is deduplicated. The deduplication process can delete completely repeated messages, or semantically identify the messages sent by different members in the target group conversation message, and regard the messages with semantic similarity greater than the preset similarity threshold as repeated messages, and delete the repeated messages.

[0077] In a feasible embodiment, after obtaining the target group conversation video, the method further includes:

[0078] Receive a video viewing request from a client;

[0079] Determining client permissions based on client identification information included in the video viewing request;

[0080] Push the target group session video operation information to the client according to the client's permissions.

[0081] After the target group conversation video is completed, it will be kept in the database of the intermediate server, waiting for the user to view it. The user sends a video viewing request to the intermediate server through the client, and the video viewing request includes at least client identification information, so that the intermediate server determines the client authority based on the client identification information and a pre-established client authority model, wherein the client authority includes read authority and modify authority, and the client authority model is the client authority associated with different client identification information established in advance according to the client's registration message.

[0082] After determining the client authority, the operation information of the target group conversation video is pushed to the client according to the client authority, and the operation information may include prohibiting access, playing, and deleting operations, etc. Specifically, if the client authority is no access authority, the operation information pushed to the client is a prohibiting access mark; if the client authority is read authority, the operation information pushed to the client is a play mark of the target group conversation video; if the client authority is read authority and modification authority, the operation information pushed to the client is a play mark and a delete mark of the target group conversation video, so that the user can select the corresponding operation.

[0083] Exemplarily, the video viewing request may also include video retrieval information, so that the intermediate server can select the target group conversation video from all group conversation videos stored in the database according to the video retrieval information. The client displays the video play list through the video file index, and the user selects the corresponding video to play. When playing, the NAS client can obtain the video file from the NAS end through a sharing protocol such as smb, and call the player of the client's home terminal to play the video, and display the conversation name corresponding to the video in the OSD (on screen display) according to the conversation subject of the target group conversation message, such as displaying "currently playing the speech of the head teacher Mr. Niu".

[0084] This embodiment implements operation management of target group conversation videos by different clients through client permissions, improves the management efficiency of target group conversation videos, and implements privacy management of target group conversation videos, thereby preventing non-group members and unauthorized persons from viewing target group conversation videos and causing message content leakage.

[0085] In a feasible embodiment, after obtaining the target group conversation video, the method further includes:

[0086] Get the playback speed of the target group session video played by the client;

[0087] The client message viewing speed in the message viewing capability parameters is updated according to the playback speed.

[0088] When the client plays the target group conversation video, since different users obtain information at different speeds, the video will be paused or played at a double speed according to the message content in the video. In order to improve the playback speed of the target group conversation video generated later to be more in line with the user's actual playback speed, the user's historical playback speed of the target group conversation video is obtained, and the client message viewing speed in the message viewing capability parameter is updated according to the historical playback speed, so that the video generated according to the updated client message viewing speed is more in line with the user's actual playback speed, avoiding the user from missing valid content when playing the video. For example, the client message viewing speed is updated according to the average or median of the historical number of playback speeds.

[0089] Exemplarily, based on the above example, the target client is determined according to the client authority in the authority model, and the client message viewing speed is updated according to the playback speed of the target group conversation video played by the target client. For example, a client corresponding to the client authority with the changed authority is determined as the target client. If the number of target clients with the changed authority is at least two, the client message viewing speed is updated according to the average playback speed of the target group conversation video played by at least two target clients, so as to improve the accuracy of the client message viewing speed update.

[0090] The technical solution of the embodiment of the present invention obtains the target group conversation message of the client's interest sent by the group message server on the intermediate server, and processes the target group conversation message into a video, so that the client can view the group conversation message in the form of a video. The group conversation message is automatically played by video, which improves the efficiency of group members in obtaining effective information in the group message, solves the problem of low efficiency of group members in viewing a large number of group messages, and because the target group conversation video is stored in the intermediate server, it will not cause additional consumption of client space resources.

[0091] Embodiment 2

[0092] Figure 2 This is an interactive diagram of a video viewing method for group messages provided in Embodiment 2 of the present invention. This embodiment is a preferred implementation of the above embodiment. Figure 2 As shown, the interaction process includes:

[0093] The client first uses the sip.register message type to carry the client message viewing speed, client resolution and client screen display parameters in the keep-alive message sent to the intermediate server. After receiving the keep-alive message, the intermediate server feeds back sip.register.ok to the client.

[0094] After receiving the feedback message of the intermediate server for the keep-alive message, the client uses the sip.subscribe message type to send the target group identification information and the preset session push policy to the intermediate server. The intermediate server forwards the message to the group message server. After receiving the target group identification information and the preset session push policy, the group message server feeds back sip.subscribe.ok to the intermediate server. After receiving it, the intermediate server also feeds back sip.subscribe.ok to the client.

[0095] The group message server uses the sip.Notify message type to send a target group conversation message of the target group pushed according to the preset conversation push policy to the intermediate server. After receiving the target group conversation message, the intermediate server extracts and organizes the group conversation message, wherein the extraction and organization operations include conversation topic matching operations and deduplication operations. The organized target group conversation message is processed into a video according to the client message viewing speed, client resolution, and client screen display parameters to obtain the target group conversation video, which is saved in the database of the intermediate server. Wait for the client to read the target group conversation video from the database according to the sharing protocol, and view the target group conversation message from the target group conversation video.

[0096] This embodiment can quickly extract data that users are concerned about from a large number of group messages, so that users can quickly obtain valuable group information without having to perform a large number of repetitive and tedious reading operations, and convert group messages into videos for reading, thereby improving user experience and reading efficiency. At the same time, the videos are stored in the intermediate server without causing additional space consumption for the client.

[0097] Embodiment 3

[0098] Figure 3 This is a schematic diagram of the structure of a video viewing device for group messages provided by Embodiment 3 of the present invention. Figure 3 As shown, the device is deployed in an intermediate server, and the intermediate server is connected to the client and the group message server respectively, including:

[0099] The client information receiving module 310 is used to receive the message viewing capability parameter and target group identification information sent by the client;

[0100] The group server information receiving module 320 is used to send the target group identification information to the group message server, and receive the target group conversation message sent by the group message server according to the target group identification information;

[0101] The conversation video generation module 330 is used to perform video processing on the target group conversation message according to the message viewing capability parameter to obtain a target group conversation video, so that the client can view the target group conversation message from the target group conversation video.

[0102] The technical solution of the embodiment of the present invention obtains the target group conversation message of the client's interest sent by the group message server on the intermediate server, and processes the target group conversation message into a video, so that the client can view the group conversation message in the form of a video. The group conversation message is automatically played by video, which improves the efficiency of group members in obtaining effective information in the group message, solves the problem of low efficiency of group members in viewing a large number of group messages, and because the target group conversation video is stored in the intermediate server, it will not cause additional consumption of client space resources.

[0103] Optionally, the message viewing capability parameters include client message viewing speed, client resolution and client screen display parameters;

[0104] Correspondingly, the conversation video generation module is specifically used for:

[0105] Segmenting the target group conversation message according to the client screen display parameter to obtain at least one set of target group conversation message sets;

[0106] Generating corresponding conversation message video frames for each target group conversation message set according to the client resolution and the client screen display parameters;

[0107] Determine the frame number parameter of the session message video frame according to the client message viewing speed and the preset video frame rate;

[0108] The conversation message video frame is processed according to the frame number parameter to obtain the target group conversation video.

[0109] Optionally, the device further includes a capability parameter updating module, which is used for, after obtaining the target group conversation video:

[0110] Obtaining a playback speed at which the client plays the target group conversation video;

[0111] The client message viewing speed in the message viewing capability parameter is updated according to the playing speed.

[0112] Optionally, the device further includes a session pushing module, which is configured to: before receiving the target group session message sent by the group message server according to the target group identification information:

[0113] Sending a preset session push strategy to a group message server; wherein the preset session push strategy is used to instruct the group message server to determine a single-pushed target group session message from the to-be-pushed target group session messages associated with the target group identification message.

[0114] Optionally, the device further includes a message matching module, which is used for, before performing video processing on the target group conversation message according to the message viewing capability parameter:

[0115] Determining a conversation topic according to the message content of the target group conversation message;

[0116] Determine a matching result between each message in the target group conversation message and the conversation topic, and determine messages with a matching result of failed matching as remaining messages;

[0117] The remaining messages are removed from the target group conversation message at the current moment, and according to the matching result of the remaining messages and the conversation topics of the target group conversation messages at other moments, the remaining messages are added to the target group conversation messages at other moments that have successfully matched.

[0118] Optionally, the device further includes a message deduplication module, which is used for, before performing video processing on the target group conversation message according to the message viewing capability parameter:

[0119] Deduplication processing is performed on the target group conversation message.

[0120] Optionally, the device further includes a client authority determination module, which is used to, after obtaining the target group conversation video:

[0121] Receiving a video viewing request from the client;

[0122] Determining the client authority according to the client identification information included in the video viewing request;

[0123] The operation information of the target group conversation video is pushed to the client according to the client authority.

[0124] The video viewing device for group messages provided in the embodiment of the present invention can execute the video viewing method for group messages provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0125] The acquisition, storage, use, and processing of data in the technical solution of this application comply with the relevant provisions of national laws and regulations and do not violate public order and good morals.

[0126] Embodiment 4

[0127] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0128] Figure 4 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0129] like Figure 4 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0130] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0131] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a video viewing method for group messages.

[0132] In some embodiments, the video viewing method of the group message can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the video viewing method of the group message described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to execute the video viewing method of the group message by any other appropriate means (for example, by means of firmware).

[0133] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific reference products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0134] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0135] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0136] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0137] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0138] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0139] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0140] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for viewing group messages in video format, characterized in that: The process is performed by an intermediate server, which is connected to the client and the group message server respectively, and includes: Receive message viewing capability parameters and target group identification information sent by the client; Sending the target group identification information to a group message server, and receiving a target group conversation message sent by the group message server according to the target group identification information; The target group conversation message is processed into a video according to the message viewing capability parameter to obtain a target group conversation video, so that the client can view the target group conversation message from the target group conversation video.

2. The method according to claim 1, characterized in that The message viewing capability parameters include client message viewing speed, client resolution and client screen display parameters; Correspondingly, the target group conversation message is processed into a video according to the message viewing capability parameter to obtain the target group conversation video, including: Segmenting the target group conversation message according to the client screen display parameter to obtain at least one set of target group conversation message sets; Generating corresponding conversation message video frames for each target group conversation message set according to the client resolution and the client screen display parameters; Determine the frame number parameter of the session message video frame according to the client message viewing speed and the preset video frame rate; The conversation message video frame is processed according to the frame number parameter to obtain the target group conversation video.

3. The method according to claim 1 or 2, characterized in that: After obtaining the target group conversation video, the method further includes: Obtaining a playback speed at which the client plays the target group conversation video; The client message viewing speed in the message viewing capability parameter is updated according to the playing speed.

4. The method according to claim 1, characterized in that: Before receiving the target group conversation message sent by the group message server according to the target group identification information, the method further includes: Sending a preset session push strategy to a group message server; wherein the preset session push strategy is used to instruct the group message server to determine a single-pushed target group session message from the to-be-pushed target group session messages associated with the target group identification message.

5. The method according to claim 1, characterized in that Before performing video processing on the target group conversation message according to the message viewing capability parameter, the method further includes: Determining a conversation topic according to the message content of the target group conversation message; Determine a matching result between each message in the target group conversation message and the conversation topic, and determine messages with a matching result of failed matching as remaining messages; The remaining messages are removed from the target group conversation message at the current moment, and according to the matching result of the remaining messages and the conversation topics of the target group conversation messages at other moments, the remaining messages are added to the target group conversation messages at other moments that have successfully matched.

6. The method according to claim 1, characterized in that The target group conversation message is processed into a video according to the message viewing capability parameter to obtain the target group conversation video, including: If the target group conversation message is text, determining text display parameters according to the message viewing capability parameters, and converting the text into a video based on the text display parameters; If the target group conversation message is voice, the voice is recognized to obtain corresponding converted text, the converted text display parameters are determined according to the message viewing capability parameters, the converted text is processed into a video based on the converted text display parameters, and an audio file corresponding to the voice is added to the target group conversation video, and a link relationship between the converted text and the audio file is established, so that the audio file is obtained through the link relationship during the playback of the target group conversation video; If the target group conversation message is an image, a corresponding preview image is determined based on the image, preview image display parameters are determined based on message viewing capability parameters, the preview image is converted into a video based on the preview image display parameters, and the original image file corresponding to the preview image is added to the target group conversation video, and a link relationship is established between the preview image and the original image file, so that the original image file can be obtained through the link relationship during the playback of the target group conversation video.

7. The method according to claim 1, characterized in that After obtaining the target group conversation video, the method further includes: Receiving a video viewing request from the client; Determining the client authority according to the client identification information included in the video viewing request; The operation information of the target group conversation video is pushed to the client according to the client authority.

8. A video viewing device for group messages, characterized in that: Deployed in an intermediate server, the intermediate server is connected to the client and the group message server respectively, including: The client information receiving module is used to receive the message viewing capability parameters and target group identification information sent by the client; A group server information receiving module, configured to send the target group identification information to a group message server, and receive a target group conversation message sent by the group message server according to the target group identification information; The session video generation module is used to perform video processing on the target group session message according to the message viewing capability parameter to obtain a target group session video, so that the client can view the target group session message from the target group session video.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the method for viewing a group message in a video format according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the video viewing method for group messages according to any one of claims 1 to 7 when executed.

Images