Group intercom message management method, device, computer equipment and storage medium
By obtaining and processing session requests and subscription information of intercom devices, determining the receiving object and establishing a session channel, the problems of redundancy in information and instability in group intercoms are solved, and the stability and user experience of message management are improved .
Patent Information
- Application Number
- CN202111299254.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-04
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-11-04
AI Technical Summary
When group intercom devices acquire and release their voice, they will cause redundancy in information, resulting in high frequency of message prompts from the intercom, and poor network signals may lead to delay or loss of information, resulting in confusion and interference in message notifications.
By obtaining the session request information, group subscription information and personal subscription information of the intercom sending end, the session receiving object is determined, and a session channel is established when the conditions are met, a prompt sound is issued, and a session information is sent based on the channel is reduced, and the number of message notifications is increased, and the number of messages is increased. Message management stability.
It effectively reduces the number of message notifications, improves the stability and user experience of message management, and ensures reliable transmission of session messages.
Smart Images

Figure CN114039803B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of Internet of Things, and in particular to a group intercom message management method, device, computer equipment and storage medium. Background Art
[0002] Group intercom is the most commonly used function of intercom equipment, primarily used in command and dispatch centers. The command and dispatch platform is not only a remote command and dispatch tool for on-site property management to handle emergencies, but also serves as an operational tool for property management and a supervisory and inspection tool for property service quality management. The command and dispatch platform is a backend service, while group intercom primarily consists of multiple terminal devices, most commonly walkie-talkies.
[0003] Group intercoms are mainly used for group management, event reporting, and joint event processing. Each intercom device can participate in multiple groups at the same time, and there is no theoretical limit on the number of group members and groups. Group intercom calls are characterized by short duration and intensive switching (intercom participants, i.e., members). Before speaking, you need to obtain the right to speak, and after speaking, you need to release the right to speak. However, both obtaining and releasing the right to speak are broadcast, which results in a lot of redundant information. As a result, the frequency of message prompts from the intercom is very high, causing great trouble to users. In addition, the intercom is a portable device, so there may be situations where the network signal is weak, which may cause information delays or even loss. In this case, the message notification may be confused, causing greater interference. Summary of the Invention
[0004] Embodiments of the present invention provide a group intercom message management method, apparatus, computer equipment, and storage medium, aiming to reduce the number of message notifications and improve the stability of message management.
[0005] In a first aspect, an embodiment of the present invention provides a group intercom message management method, comprising:
[0006] Get the session request information sent by the intercom sender;
[0007] Obtaining group subscription information of the group to which the intercom transmitter belongs and personal subscription information of the intercom transmitter; wherein the group subscription information includes all intercom receiving terminals that have subscribed to the group to which the intercom transmitter belongs, and the personal subscription information includes all intercom receiving terminals within the group to which the intercom transmitter belongs that have subscribed to the intercom transmitter;
[0008] Determine a session receiving object according to the group subscription information and the personal subscription information;
[0009] Determine whether the session receiving object meets the session receiving conditions;
[0010] When it is determined that the conversation receiving object meets the conversation receiving condition, a conversation channel is established for the intercom sending end and the conversation receiving object, so that the intercom sending end and the conversation receiving object emit a prompt tone;
[0011] Based on the conversation channel, the conversation information sent by the intercom sending end is sent to the conversation receiving object, so that the intercom sending end and the conversation receiving object send a prompt tone.
[0012] In a second aspect, an embodiment of the present invention provides a group intercom message management device, comprising:
[0013] A first acquiring unit, configured to acquire session request information sent by the intercom sending terminal;
[0014] A second acquiring unit is configured to acquire group subscription information of the group to which the intercom transmitting terminal belongs and personal subscription information of the intercom transmitting terminal; wherein the group subscription information includes all intercom receiving terminals that have subscribed to the group to which the intercom transmitting terminal belongs, and the personal subscription information includes all intercom receiving terminals within the group to which the intercom transmitting terminal belongs that have subscribed to the intercom transmitting terminal;
[0015] an object determining unit, configured to determine a session receiving object according to the group subscription information and the personal subscription information;
[0016] A first judging unit, configured to judge whether a session receiving object satisfies a session receiving condition;
[0017] a first channel establishing unit, configured to establish a session channel between the intercom transmitter and the session receiver when it is determined that the session receiver satisfies a session reception condition, so that the intercom transmitter and the session receiver emit a prompt tone;
[0018] The conversation sending unit is used to send the conversation information sent by the intercom sending end to the conversation receiving object based on the conversation channel, so that the intercom sending end and the conversation receiving object send a prompt tone.
[0019] In a third aspect, an embodiment of the present invention provides a computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the group intercom message management method as described in the first aspect when executing the computer program.
[0020] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the group intercom message management method as described in the first aspect is implemented.
[0021] An embodiment of the present invention provides a group intercom message management method, apparatus, computer device, and storage medium. The method includes: obtaining session request information sent by an intercom sender; obtaining group subscription information of a group to which the intercom sender belongs and personal subscription information of the intercom sender; wherein the group subscription information includes all intercom receiving terminals that have subscribed to the group to which the intercom sender belongs, and the personal subscription information includes all intercom receiving terminals within the group to which the intercom sender belongs that have subscribed to the intercom sender; determining a session receiving object based on the group subscription information and the personal subscription information; determining whether the session receiving object meets a session receiving condition; when it is determined that the session receiving object meets the session receiving condition, establishing a session channel for the intercom sender and the session receiving object, causing the intercom sender and the session receiving object to emit a prompt tone; and sending the session information sent by the intercom sender to the session receiving object based on the session channel, causing the intercom sender and the session receiving object to emit a prompt tone. The embodiment of the present invention determines the session receiving object of the receiving session through the group subscription information and personal subscription information of the group to which the intercom sender belongs, and establishes a session channel for the intercom sender and the session receiving object, so that the intercom sender and the session receiving object emit prompt sounds accordingly, thereby greatly reducing the number of message notifications, making the sending of session messages more secure, and improving the stability of message management. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0023] Figure 1 A flow chart of a group intercom message management method provided by an embodiment of the present invention;
[0024] Figure 2 A schematic diagram of a sub-process of a group intercom message management method provided by an embodiment of the present invention;
[0025] Figure 3 A schematic diagram of another sub-process of a group intercom message management method provided by an embodiment of the present invention;
[0026] Figure 4 A schematic diagram of another sub-process of a group intercom message management method provided by an embodiment of the present invention;
[0027] Figure 5 A schematic block diagram of a group intercom message management device provided by an embodiment of the present invention;
[0028] Figure 6 A schematic block diagram of a group intercom message management device provided by an embodiment of the present invention;
[0029] Figure 7 Another schematic block diagram of a group intercom message management device provided by an embodiment of the present invention;
[0030] Figure 8 Another sub-schematic block diagram of a group intercom message management device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0031] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.
[0032] It will be understood that when used in this specification and the appended claims, the terms “comprises” and “comprising” indicate the presence of described features, integers, steps, operations, elements and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.
[0033] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the present invention. As used in the specification and appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms unless the context clearly indicates otherwise.
[0034] It should be further understood that the term "and / or" used in the present description and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
[0035] See below Figure 1 , Figure 1 A flow chart of a group intercom message management method provided by an embodiment of the present invention specifically includes steps S101 to S106.
[0036] S101, obtaining session request information sent by the intercom sending terminal;
[0037] S102. Acquire group subscription information of the group to which the intercom transmitter belongs and individual subscription information of the intercom transmitter; wherein the group subscription information includes all intercom receivers that have subscribed to the group to which the intercom transmitter belongs, and the individual subscription information includes all intercom receivers within the group to which the intercom transmitter belongs that have subscribed to the intercom transmitter;
[0038] S103, determining a session receiving object according to the group subscription information and the personal subscription information;
[0039] S104, determining whether the session receiving object meets the session receiving condition;
[0040] S105: When it is determined that the conversation receiving object meets the conversation receiving condition, establish a conversation channel for the intercom sending end and the conversation receiving object, so that the intercom sending end and the conversation receiving object emit a prompt tone;
[0041] S106: Based on the conversation channel, send the conversation information sent by the intercom sending end to the conversation receiving object, so that the intercom sending end and the conversation receiving object send a prompt tone.
[0042] In this embodiment, before an intercom transmitter needs to initiate a conversation, it first sends a conversation request message. Upon receiving this conversation request message, the intercom transmitter obtains the group subscription information for the group to which the intercom transmitter belongs, as well as the intercom transmitter's personal subscription information. Here, the group subscription information refers to the intercom receivers that are subscribed to the group. That is, when a message is sent from the group, the subscribed intercom receivers will emit a corresponding prompt to alert them to receive and view the group message. The personal subscription information refers to the intercom receivers that are subscribed to the intercom transmitter. That is, when the intercom transmitter sends a conversation message, the subscribed intercom receivers will emit a corresponding prompt to alert them to receive and view the conversation message. Furthermore, based on the group subscription information and personal subscription information, the corresponding conversation recipient is identified. A conversation channel is then established between the intercom transmitter and the conversation recipient, with the corresponding prompt tones emitted between the two parties to indicate the start of the conversation. Then, according to the conversation channel, the conversation message sent by the intercom transmitter is transmitted to the conversation receiver. Of course, the conversation receiver can also reply the conversation message to the intercom transmitter accordingly, and there will be a corresponding prompt tone during the speaking process.
[0043] This embodiment uses the group subscription information and personal subscription information of the intercom sender's group to determine the recipient of the conversation. This ensures that only the intercom sender and the recipient of the conversation will emit the corresponding notification tone. Intercom recipients not included in group or personal subscription messages will not receive the message notification tone associated with the intercom sender, significantly reducing the number of message notifications and improving the user experience. Furthermore, this embodiment effectively ensures the stability of the conversation between the intercom sender and the recipient by establishing a conversation channel between them.
[0044] In one specific embodiment, upon receiving a session request message from the intercom transmitter, a session confirmation feedback is sent to the intercom transmitter, and the next step is executed upon receiving confirmation information from the intercom transmitter regarding the session confirmation feedback. Furthermore, if the intercom transmitter does not perform a corresponding confirmation operation on the session confirmation feedback within a preset confirmation time (e.g., 300ms), the session confirmation feedback is continued to be sent to the intercom transmitter. If the intercom transmitter fails to perform a confirmation operation three times in a row, the intercom transmitter's session request is rejected.
[0045] In one embodiment, step S104 includes:
[0046] Determining whether the conversation receiving object is within the conversation object range of the intercom sending end;
[0047] If it is determined that the session receiving object is within the session object range of the intercom sending end, determining whether the session receiving object is in an idle state;
[0048] When it is determined that the session receiving object is in an idle state, it is determined that the session receiving object meets the session receiving condition.
[0049] In this embodiment, after determining the session recipient based on the group subscription message and the individual subscription message, the next step is to determine whether the session recipient is eligible to receive the session. Specifically, the first step is to determine whether the session recipient is within the session recipient range of the intercom sender. For example, this involves determining whether the session recipient's level is the same as that of the intercom sender. If the session recipient's level is higher than that of the intercom sender, then it is necessary to determine whether the intercom sender has the right to bypass the level limit. After confirming that the session recipient is within the session recipient range of the intercom sender, the next step is to determine whether the session recipient is idle, for example, whether the session recipient is currently speaking. After confirming that the session recipient is idle, the final determination is made as to whether the session recipient meets the session reception conditions. It will be appreciated that while this embodiment determines the idle state of the session recipient, it is actually determining the state of the intercom terminal held by the session recipient. Of course, in other embodiments, the session recipient's ability to receive the session may be determined based on other session reception conditions, such as verifying the identity of the current owner of the intercom terminal held by the session recipient to determine whether the owner is the original owner, thereby determining whether the session reception conditions are met.
[0050] In one embodiment, if Figure 2 As shown, the group intercom management method further includes: steps S201 to S204.
[0051] S201, when it is determined that the conversation receiving object is not in an idle state, feeding back the determination result to the intercom sending terminal, so that the intercom sending terminal confirms whether to initiate a conversation;
[0052] S202, after the intercom sending terminal confirms to initiate the session, obtaining the session message of the intercom sending terminal;
[0053] S203: Based on the intercom sending end and the conversation receiving object, set an identifier for the conversation message and store the conversation message in a preset message queue;
[0054] S204: Perform a second judgment on whether the session receiving object is in an idle state at every preset time interval, and extract the session message from the message queue based on the identifier and send it to the session receiving object when it is determined that the session receiving object is in an idle state.
[0055] In this embodiment, if the session receiving object is confirmed to be not idle, meaning that the session receiving object is unable to receive the session, the determination result is fed back to the intercom sending end, which then determines whether to unilaterally initiate the session. If the intercom sending end confirms unilateral session initiation, after sending the session message, the intercom sending end saves the session message and sets corresponding identifiers for the session message, indicating the sender and receiver of the session message. This allows the session receiving object to be sent the session message when it is idle, indicating the identity of the intercom sending end.
[0056] Of course, since the session receiving object is not idle when the intercom sender sends a session message, it is necessary to query the session receiving object's status before sending subsequent session messages to the session receiving object. In other words, it is necessary to determine whether the session receiving object has changed from a non-idle state to an idle state. During this query process, the query can be performed at intervals, for example, once every 5 minutes.
[0057] In one embodiment, step S105 includes:
[0058] Generate corresponding session response information based on the session request information sent by the intercom sending terminal, and register the sending terminal SIP signaling information for the intercom sending terminal;
[0059] And send the session response information to the session receiving object, and register the receiving end SIP signaling information for the session receiving object;
[0060] The session channel is established based on the sending end SIP signaling information and the receiving end SIP signaling information.
[0061] In this embodiment, when establishing a session channel between the intercom sender and the session receiver, a corresponding session response message is first generated based on the session request message. Subsequently, corresponding SIP signaling information is registered for the intercom sender and the session receiver, thereby establishing the session channel and enabling the intercom sender and the session receiver to transmit session messages based on the SIP protocol. In a specific embodiment, the legitimacy of the intercom sender and the session receiver is determined based on HTTP digest authentication. Only if the intercom sender and the session receiver are determined to be legitimate, a key is generated for each of the intercom sender and the session receiver using encryption technology based on the digest. The physical addresses of the intercom sender and the session receiver are then combined with the key, and the resultant combination is used as the SIP registration signaling information for the intercom sender and the session receiver.
[0062] In one embodiment, if Figure 3As shown, the group intercom management method further includes: steps S301 to S304.
[0063] S301, obtaining first speech training data containing noise and second speech training data not containing noise;
[0064] S302: Using a convolutional neural network to perform classification training on the first speech training data and the second speech training data, respectively, and obtain corresponding first classification features and second classification features;
[0065] S303: Calculate a weighted minimum absolute distance between the first classification feature and the second classification feature, and use the calculation result as a loss value of the first classification feature and the second classification feature;
[0066] S304: Using the loss value to perform back-propagation update on the convolutional neural network to construct a speech processing model.
[0067] In this embodiment, considering that the environment in which the intercom transmitter or the conversation receiver is located may be relatively noisy, thereby interfering with the conversation information sent or received by the intercom transmitter or the conversation receiver, this embodiment constructs a speech processing model to perform speech processing on the conversation information sent by the intercom transmitter (or the conversation information sent by the conversation receiver) to improve the clarity of the conversation information. In the process of constructing the speech processing model, first speech training data containing noise and second speech training data not containing noise are first obtained. The first and second speech training data are then respectively input into a convolutional neural network, and the convolutional neural network outputs corresponding first and second classification features. Furthermore, the weighted minimum absolute distance (i.e., the L1 norm) between the first and second classification features is calculated to obtain a loss value that can be used for backpropagation updates of the convolutional neural network. Here, the specific steps of using a convolutional neural network to perform classification training on the first speech training data and the second speech training data respectively, and obtaining the corresponding first classification features and second classification features include: inputting the first speech training data and the second speech training data into the first convolution layer, the second convolution layer, the first pooling layer, the third convolution layer, the fourth convolution layer, the second pooling layer and the fifth convolution layer respectively, and then inputting the output result of the fifth convolution layer into the fully connected layer and the activation function layer in sequence, so that the first classification features corresponding to the first speech training data and the second classification features corresponding to the second speech training data can be extracted.
[0068] Furthermore, in one embodiment, step S106 includes:
[0069] The speech processing model is used to perform denoising processing on the conversation information, and the processed conversation information is sent to the conversation receiving object.
[0070] In this embodiment, the voice processing model constructed through the aforementioned steps can denoise voice information, making it easier to answer calls. Therefore, the voice processing model is used to denoise the conversation information sent by the intercom sender, allowing the conversation recipient to receive clearer and more specific conversation messages. Of course, if the conversation recipient returns a conversation message to the intercom sender via the conversation channel, the voice processing model can also be used to denoise the returned conversation message.
[0071] In other embodiments, the voice signal corresponding to the conversation information may also be preprocessed to emphasize the high-frequency portion of the voice, remove the influence of lip radiation, and increase the high-frequency resolution of the voice. The preprocessing steps for the voice signal specifically include: sampling the voice signal s(t) with a sampling period T and discretizing it into s(n). The selection of the sampling period should be determined based on the bandwidth of the voice signal (according to the Nyquist sampling theorem) to avoid frequency domain aliasing distortion of the voice signal. The voice signal is then pre-emphasized and pre-windowed, that is, pre-emphasized using a high-pass digital filter and pre-windowed using a movable finite-length window for weighting.
[0072] In one embodiment, if Figure 4 As shown, the group intercom management method further includes: steps S401 to S405.
[0073] S401: When there are multiple session receiving objects, determine whether each session receiving object is in an idle state;
[0074] S402: If all the conversation receiving objects are in an idle state, directly establish a conversation channel between the intercom sending end and all the conversation receiving objects;
[0075] S403: If at least one conversation receiving object is not in an idle state, the judgment result is fed back to the intercom sending end, so that the intercom sending end confirms whether to initiate a conversation;
[0076] S404: After the intercom sending terminal confirms the initiation of the session, a session channel is established between the intercom sending terminal and the session receiving object in an idle state, and real-time session information and a corresponding timestamp transmitted in the session channel are obtained;
[0077] S405: Set an identifier for the real-time session information and store it in a preset message queue. After the session receiving object that is not in an idle state becomes idle, send the real-time session information to the session receiving object according to the timestamp.
[0078] In this embodiment, if there is only one session receiving object, a session channel only needs to be established when the session receiving object meets the session acceptance conditions. However, if there are multiple session receiving objects, it is necessary to determine whether each session receiving object meets the session acceptance conditions. When all session receiving objects are within the session object range of the intercom transmitter, the status of each session receiving object is determined. In this case, all session receiving objects may be idle, in which case the session channel can be established. However, it is also possible that at least one session receiving object is not idle. In this case, the determination result needs to be fed back to the intercom transmitter, which then confirms whether to initiate the session immediately or wait until all session receiving objects are idle before initiating the session.
[0079] If the intercom sender confirms to initiate a conversation immediately, a conversation channel is established between the intercom sender and the idle conversation receiver, allowing them to immediately engage in the conversation. During the conversation, the intercom sender retrieves the real-time conversation messages and their corresponding timestamps. These messages are then stored in the message queue in timestamp order. When the conversation receiver not participating in the conversation becomes idle, the real-time conversation messages in the message queue are retrieved and sent to the idle conversation receiver.
[0080] In one embodiment, when multiple intercom senders in the same group simultaneously send session request messages, corresponding group subscription information and personal subscription information are obtained for each intercom sender. The session recipient object of each intercom sender is determined based on the group subscription information and personal subscription information, and it is determined whether the session recipient objects of each intercom sender are the same. If the session recipient objects of each intercom sender are different, a session channel is established between each intercom sender and the corresponding session recipient object. If the intercom senders have the same session recipient object, a priority is set for the intercom senders with the same session recipient object, and a session channel is established between the intercom senders and the session recipient object based on the priority. For intercom senders with lower priorities that cannot establish a session channel with the session recipient object, their session messages can be stored in a message queue. In specific application scenarios, the priority can be set according to the identity level of the intercom sender, for example, an intercom sender with a higher level has a higher priority. Alternatively, the priority can be set according to the urgency of the intercom sender sending the session message, for example, an intercom sender with the most urgent session message has the highest priority.
[0081] Figure 5 A schematic block diagram of a group intercom message management device 500 provided in an embodiment of the present invention, the device 500 includes:
[0082] The first acquiring unit 501 is configured to acquire session request information sent by the intercom sending terminal;
[0083] A second acquiring unit 502 is configured to acquire group subscription information of the group to which the intercom transmitter belongs and individual subscription information of the intercom transmitter; wherein the group subscription information includes all intercom receivers that have subscribed to the group to which the intercom transmitter belongs, and the individual subscription information includes all intercom receivers that have subscribed to the intercom transmitter within the group to which the intercom transmitter belongs;
[0084] An object determining unit 503 is configured to determine a session receiving object based on the group subscription information and the personal subscription information;
[0085] The first judging unit 504 is configured to judge whether the session receiving object satisfies the session receiving condition;
[0086] A first channel establishing unit 505 is configured to establish a session channel between the intercom transmitter and the session receiver when it is determined that the session receiver satisfies a session reception condition, so that the intercom transmitter and the session receiver emit a prompt tone;
[0087] The conversation sending unit 506 is configured to send the conversation information sent by the intercom sending terminal to the conversation receiving object based on the conversation channel, so that the intercom sending terminal and the conversation receiving object send a prompt tone.
[0088] In one embodiment, the first determining unit 504 includes:
[0089] A range determination unit, configured to determine whether the conversation receiving object is within the conversation object range of the intercom sending end;
[0090] a state determination unit, configured to determine whether the session receiving object is in an idle state if it is determined that the session receiving object is within the session object range of the intercom sending end;
[0091] The determining unit is configured to determine whether the session receiving object satisfies the session receiving condition when determining that the session receiving object is in an idle state.
[0092] In one embodiment, if Figure 6 As shown, the group intercom message management device 500 also includes:
[0093] A result feedback unit 601 is configured to, when determining that the conversation receiving object is not in an idle state, feed back the determination result to the intercom sending terminal, so that the intercom sending terminal confirms whether to initiate a conversation;
[0094] A message acquiring unit 602 is configured to acquire a session message of the intercom sending terminal after the intercom sending terminal confirms initiation of the session;
[0095] The identifier setting unit 603 is used to set an identifier for the conversation message based on the intercom sending end and the conversation receiving object, and store the conversation message in a preset message queue;
[0096] The secondary judgment unit 604 is configured to perform a secondary judgment on whether the session receiving object is in an idle state at every preset time interval, and when it is determined that the session receiving object is in an idle state, extract the session message from the message queue based on the identifier and send it to the session receiving object.
[0097] In one embodiment, the first channel establishing unit 505 includes:
[0098] A response generating unit, configured to generate corresponding session response information based on the session request information sent by the intercom sending terminal, and register the sending terminal SIP signaling information for the intercom sending terminal;
[0099] An information registration unit, configured to send the session response information to a session receiving object and register receiving end SIP signaling information for the session receiving object;
[0100] The second channel establishing unit is used to establish the session channel based on the sending end SIP signaling information and the receiving end SIP signaling information.
[0101] In one embodiment, if Figure 7 As shown, the group intercom message management device 500 also includes:
[0102] The training data acquisition unit 701 is configured to acquire first speech training data containing noise and second speech training data not containing noise;
[0103] A classification training unit 702 is configured to perform classification training on the first speech training data and the second speech training data using a convolutional neural network, and obtain corresponding first classification features and second classification features;
[0104] a loss value calculation unit 703, configured to calculate a weighted minimum absolute distance between the first classification feature and the second classification feature, and use the calculation result as a loss value of the first classification feature and the second classification feature;
[0105] The model construction unit 704 is used to use the loss value to perform back-propagation update on the convolutional neural network to construct a speech processing model.
[0106] In one embodiment, the session sending unit 506 includes:
[0107] The denoising processing unit is configured to perform denoising processing on the conversation information using the speech processing model, and send the processed conversation information to a conversation receiving object.
[0108] In one embodiment, if Figure 8 As shown, the group intercom message management device 500 also includes:
[0109] The second judging unit 801 is configured to judge whether each of the session receiving objects is in an idle state when there are multiple session receiving objects;
[0110] The third channel establishing unit 802 is configured to directly establish a session channel between the intercom sending terminal and all the session receiving objects if all the session receiving objects are in an idle state;
[0111] The feedback sending unit 803 is configured to feed back the judgment result to the intercom sending terminal if at least one session receiving object is not in an idle state, so that the intercom sending terminal confirms whether to initiate a session;
[0112] The timestamp obtaining unit 804 is configured to establish a session channel between the intercom sending terminal and the idle session receiving object after the intercom sending terminal confirms the initiation of the session, and obtain the real-time session information and the corresponding timestamp transmitted in the session channel;
[0113] The information sending unit 805 is configured to set an identifier for the real-time session information and store it in a preset message queue, and send the real-time session information to the session receiving object according to the timestamp after the session receiving object that is not in the idle state becomes idle.
[0114] Since the embodiments of the apparatus part correspond to the embodiments of the method part, please refer to the description of the embodiments of the method part for the embodiments of the apparatus part, and they will not be repeated here.
[0115] The present invention also provides a computer-readable storage medium having a computer program stored thereon. When executed, the computer program can implement the steps provided in the above embodiments. The storage medium can include a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, among other media capable of storing program code.
[0116] The present invention also provides a computer device that may include a memory and a processor. The memory stores a computer program, and when the processor calls the computer program in the memory, the steps provided in the above embodiment can be implemented. Of course, the computer device may also include various network interfaces, a power supply, and other components.
[0117] The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the various embodiments can be referred to each other. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of this application, several improvements and modifications can be made to this application, and these improvements and modifications also fall within the scope of protection of the claims of this application.
[0118] It should also be noted that, in this specification, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.
Claims
1. A group intercom message management method, characterized in that: include: Get the session request information sent by the intercom sender; Acquire group subscription information of the group where the intercom transmitter is located and personal subscription information of the intercom transmitter; wherein the group subscription information includes all intercom receivers that have subscribed to the group where the intercom transmitter is located, and the personal subscription information includes all intercom receivers that have subscribed to the intercom transmitter in the group where the intercom transmitter is located; Determine a session receiving object according to the group subscription information and the personal subscription information; Determine whether the session receiving object meets the session receiving condition; When it is determined that the conversation receiving object meets the conversation receiving condition, a conversation channel is established for the intercom sending end and the conversation receiving object, so that the intercom sending end and the conversation receiving object send a prompt tone; Based on the conversation channel, the conversation information sent by the intercom sending end is sent to the conversation receiving object, so that the intercom sending end and the conversation receiving object send a prompt tone; The determining whether the session receiving object satisfies the session receiving condition includes: Determine whether the conversation receiving object is within the conversation object range of the intercom sending end; If it is determined that the session receiving object is within the session object range of the intercom sending end, determining whether the session receiving object is in an idle state; When it is determined that the session receiving object is in an idle state, it is determined that the session receiving object meets the session receiving condition; When it is determined that the conversation receiving object is not in an idle state, feeding back the determination result to the intercom sending end, so that the intercom sending end confirms whether to initiate the conversation; After the intercom sending end confirms to initiate the session, obtaining the session message of the intercom sending end; Based on the intercom sending end and the conversation receiving object, setting an identifier for the conversation message, and storing the conversation message in a preset message queue; At every preset time interval, a second judgment is made as to whether the session receiving object is in an idle state, and when it is determined that the session receiving object is in an idle state, a session message is extracted from the message queue based on the identifier and sent to the session receiving object; Also includes: Acquire first speech training data containing noise and second speech training data not containing noise; Using a convolutional neural network to perform classification training on the first speech training data and the second speech training data respectively, and obtain corresponding first classification features and second classification features; Calculating a weighted minimum absolute distance between the first classification feature and the second classification feature, and using the calculation result as a loss value of the first classification feature and the second classification feature; Back-propagation update of the convolutional neural network is performed using the loss value to construct a speech processing model; Based on the session channel, the session information sent by the intercom sending end is sent to the session receiving object, including: The speech processing model is used to perform denoising on the conversation information, and the processed conversation information is sent to the conversation receiving object.
2. The group intercom message management method according to claim 1, characterized in that: When it is determined that the conversation receiving object meets the conversation receiving condition, establishing a conversation channel for the intercom sending end and the conversation receiving object includes: Generate corresponding session response information based on the session request information sent by the intercom sending end, and register the sending end SIP signaling information for the intercom sending end; And send the session response information to the session receiving object, and register the receiving end SIP signaling information for the session receiving object; The session channel is established based on the sending end SIP signaling information and the receiving end SIP signaling information.
3. The group intercom message management method according to claim 1, characterized in that: Also includes: When there are multiple session receiving objects, determining whether each session receiving object is in an idle state; If all the session receiving objects are in idle state, a session channel is directly established between the intercom sender and all the session receiving objects; If at least one of the conversation receiving objects is not in an idle state, the judgment result is fed back to the intercom sending end, so that the intercom sending end confirms whether to initiate the conversation; After the intercom sending end confirms to initiate the session, a session channel is established for the intercom sending end and the session receiving object in an idle state, and real-time session information and a corresponding timestamp transmitted in the session channel are obtained; An identifier is set for the real-time session information and the information is stored in a preset message queue. After the session receiving object that is not in an idle state is in an idle state, the real-time session information is sent to the session receiving object according to the timestamp.
4. A group intercom message management device, characterized in that: include: A first acquisition unit, used to acquire session request information sent by the intercom sending terminal; A second acquisition unit is used to acquire group subscription information of the group where the intercom transmitter is located and personal subscription information of the intercom transmitter; wherein the group subscription information includes all intercom receiving terminals that have subscribed to the group where the intercom transmitter is located, and the personal subscription information includes all intercom receiving terminals in the group where the intercom transmitter is located that have subscribed to the intercom transmitter; An object determination unit, configured to determine a session receiving object according to the group subscription information and the personal subscription information; A first judging unit, configured to judge whether a session receiving object satisfies a session receiving condition; A first channel establishing unit, configured to establish a session channel for the intercom sending end and the session receiving end when it is determined that the session receiving end meets the session receiving condition, so that the intercom sending end and the session receiving end send a prompt tone; A conversation sending unit, configured to send the conversation information sent by the intercom sending end to the conversation receiving object based on the conversation channel, so that the intercom sending end and the conversation receiving object send a prompt tone; The first judging unit comprises: A range determination unit, used to determine whether the conversation receiving object is within the conversation object range of the intercom sending end; A state determination unit, configured to determine whether the session receiving object is in an idle state if it is determined that the session receiving object is within the session object range of the intercom sending end; A determination unit, configured to determine that the session receiving object satisfies the session receiving condition when determining that the session receiving object is in an idle state; The group intercom message management device also includes: A result feedback unit is used to feed back the determination result to the intercom sending end when it is determined that the conversation receiving object is not in an idle state, so that the intercom sending end confirms whether to initiate a conversation; A message acquisition unit, configured to acquire a session message of the intercom sending terminal after the intercom sending terminal confirms the initiation of the session; An identification setting unit, used to set an identification for the conversation message based on the intercom sending end and the conversation receiving object, and store the conversation message in a preset message queue; a secondary judgment unit, configured to perform a secondary judgment on whether the session receiving object is in an idle state at a preset time interval, and extract the session message from the message queue based on the identifier and send the message to the session receiving object when it is determined that the session receiving object is in an idle state; The group intercom message management device also includes: A training data acquisition unit, used to acquire first speech training data containing noise and second speech training data not containing noise; A classification training unit, used to perform classification training on the first speech training data and the second speech training data respectively using a convolutional neural network, and obtain corresponding first classification features and second classification features; a loss value calculation unit, configured to calculate a weighted minimum absolute distance between the first classification feature and the second classification feature, and use the calculation result as a loss value of the first classification feature and the second classification feature; A model building unit, used to perform back-propagation update on the convolutional neural network using the loss value, so as to build a speech processing model; The session sending unit comprises: The denoising processing unit is used to perform denoising processing on the conversation information by using the speech processing model, and send the processed conversation information to the conversation receiving object.
5. A computer device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the group intercom message management method as claimed in any one of claims 1 to 3 when executing the computer program.
6. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the group intercom message management method according to any one of claims 1 to 3 is implemented.
