Monitoring content sharing method and device based on 5G new call, equipment, medium and product

Abstract

The invention discloses a monitoring content sharing method and device based on a 5G new call, equipment, a medium and a product, and the method comprises the steps: obtaining an audio and video data stream of monitoring content from a monitoring platform in response to a monitoring sharing request of a first terminal based on a basic session established between the first terminal and a second terminal; transmitting the audio and video data stream to the first terminal and the second terminal through a first data channel, so as to display the monitoring content on a first image layer of a display image of the first terminal and the second terminal; and receiving an auxiliary operation of the first terminal or the second terminal on the monitoring content, and transmitting the auxiliary operation to the first terminal and the second terminal through the second data channel so as to display the auxiliary operation on a second layer of a display picture of the first terminal and the second terminal. According to the method, the monitoring content can be synchronously checked while voice communication is carried out in the native call APP of the 5G terminal, switching among multiple APPs is not needed, the communication efficiency is effectively improved, and the risk of privacy leakage is avoided only for content sharing of the monitoring equipment.

Description

Technical Field

[0001] The present invention relates to the technical field of 5G new call, and particularly to a monitoring content sharing method, device, equipment, medium and product based on 5G new call. Background Art

[0002] 5G new call is based on 5G network and IMS network. On the basis of audio and video channels, a new data channel (abbreviation: DC channel) is established. This data channel can transmit diverse data such as pictures, audio, video, files, web pages, menus, expressions, locations, doodles, AR / VR, etc. 5G new call is new not only in network foundation and technical architecture, but also in providing new solutions for new application scenarios. In addition to high-definition audio and video calls, 5G new call also provides rich application services for users. Exploration of new applications based on existing audio / video calls will take the lead in opening up the situation for 5G new call; new call applications based on the new data channel greatly enhance the interactivity of calls and will also reserve new kinetic energy for the future of calls.

[0003] Currently, 5G new call uses the screen sharing function to achieve the sharing of monitoring content. When the terminal is in a call state, the user who needs to share the monitoring content enables the screen sharing function, then exits the native call APP interface and opens the monitoring APP, so that other call participants can also view the monitoring content through the screen sharing function. However, in this way, the user's privacy information may be leaked when using the screen sharing function. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to provide a monitoring content sharing method, device, equipment, medium and product based on 5G new call, which can synchronously view the monitoring content while having a voice communication within the native call APP of the 5G terminal, without the need to switch between multiple APPs, effectively improving the communication efficiency, and only targeting the sharing of monitoring device content without involving the leakage of other information content, thus avoiding the risk of privacy leakage.

[0005] To achieve the above object, an embodiment of the present invention provides a monitoring content sharing method based on 5G new call, including:

[0006] Based on a basic session established between a first terminal and a second terminal, in response to a monitoring sharing request of the first terminal, obtain an audio and video data stream of monitoring content from a monitoring platform according to the monitoring sharing request; wherein, the number of the second terminals is at least one;

[0007] Transmit the audio and video data stream to the first terminal and the second terminal through a first data channel, so as to display the monitoring content on a first layer of a display screen of the first terminal and the second terminal;

[0008] Receiving an auxiliary operation on the monitored content by the first terminal or the second terminal;

[0009] Transmitting the auxiliary operation to the first terminal and the second terminal through a second data channel, so as to display the auxiliary operation on a second layer of the display screens of the first terminal and the second terminal.

[0010] As an improvement of the above solution, the basic session is a voice call or a video call.

[0011] As an improvement of the above solution, the monitoring sharing request carries a unique identifier of the monitoring device, and the obtaining the audio-visual data stream of the monitored content from the monitoring platform according to the monitoring sharing request includes:

[0012] Determining the monitoring platform corresponding to the monitoring device according to the unique identifier of the monitoring device in the monitoring sharing request;

[0013] Obtaining the audio-visual data stream of the monitored content of the monitoring device from the monitoring platform according to a preset control protocol.

[0014] As an improvement of the above solution, before transmitting the audio-visual data stream to the first terminal and the second terminal through a first data channel, the method further includes:

[0015] Establishing a first data channel and a second data channel according to the monitoring sharing request.

[0016] As an improvement of the above solution, the auxiliary operation includes writing, drawing, person tracking, and deletion.

[0017] As an improvement of the above solution, when the auxiliary operation is person tracking, the auxiliary operation on the monitored content by the first terminal or the second terminal includes:

[0018] Determining a target person to be tracked in the monitored content, and generating a person locking graphic and a globally unique encoding ID of the person locking graphic;

[0019] Synchronizing the person locking graphic and the globally unique encoding ID of the person locking graphic to each terminal;

[0020] When the target person leaves the monitored content, the person locking graphic is deleted on each terminal.

[0021] An embodiment of the present invention further provides a monitoring content sharing device based on 5G new call, including:

[0022] An acquisition module, configured to, based on a basic session established between a first terminal and at least one second terminal, in response to a monitoring sharing request of the first terminal, obtain an audio-video data stream of monitoring content from a monitoring platform according to the monitoring sharing request; wherein, the number of the second terminals is at least one;

[0023] A first transmission module, configured to transmit the audio-video data stream to the first terminal and the second terminal through a first data channel, so as to display the monitoring content on a first layer of a display screen of the first terminal and the second terminal;

[0024] A receiving module, configured to receive an auxiliary operation on the monitoring content by the first terminal or the second terminal;

[0025] A second transmission module, configured to transmit the auxiliary operation to the first terminal and the second terminal through a second data channel, so as to display the auxiliary operation on a second layer of a display screen of the first terminal and the second terminal.

[0026] An embodiment of the present invention further provides a terminal device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein when the processor executes the computer program, the monitoring content sharing method based on 5G new call described in any one of the above is implemented.

[0027] An embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, and wherein when the computer program runs, it controls a device where the computer-readable storage medium is located to execute the monitoring content sharing method based on 5G new call described in any one of the above.

[0028] An embodiment of the present invention further provides a computer program product, where the computer program product includes a computer program or computer instructions, and when the computer program or the computer instructions are executed by a processor, the monitoring content sharing method based on 5G new call described in any one of the above is implemented.

[0029] Compared with the prior art, the beneficial effects of a monitoring content sharing method, device, equipment, medium and product based on 5G new call provided by the embodiments of the present invention are as follows: Through a basic session established between a first terminal and a second terminal, in response to a monitoring sharing request of the first terminal, an audio-visual data stream of monitoring content is obtained from a monitoring platform according to the monitoring sharing request; wherein, the number of the second terminals is at least one; the audio-visual data stream is transmitted to the first terminal and the second terminal through a first data channel, so as to display the monitoring content on a first layer of a display screen of the first terminal and the second terminal; an auxiliary operation on the monitoring content is received from the first terminal or the second terminal; the auxiliary operation is transmitted to the first terminal and the second terminal through a second data channel, so as to display the auxiliary operation on a second layer of the display screen of the first terminal and the second terminal. The embodiments of the present invention can synchronously view monitoring content while having a voice communication within a 5G terminal native call APP, without the need to switch between multiple APPs, effectively improving the communication efficiency, and only sharing the content of the monitoring device, without involving the leakage of other information content, avoiding the risk of privacy leakage. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 FIG. is a schematic flowchart of a preferred embodiment of a monitoring content sharing method based on 5G new call provided by the present invention;

[0031] Figure 2 FIG. is a schematic diagram of a system architecture in a monitoring content sharing method based on 5G new call provided by the present invention;

[0032] Figure 3 FIG. is an interaction schematic diagram of a monitoring content sharing method based on 5G new call provided by the present invention;

[0033] Figure 4 FIG. is a first schematic flowchart of a monitoring content sharing method based on 5G new call provided by the present invention;

[0034] Figure 5 FIG. is a second schematic flowchart of a monitoring content sharing method based on 5G new call provided by the present invention;

[0035] Figure 6 FIG. is a third schematic flowchart of a monitoring content sharing method based on 5G new call provided by the present invention;

[0036] Figure 7 FIG. is a schematic structural diagram of a preferred embodiment of a monitoring content sharing device based on 5G new call provided by the present invention;

[0037] Figure 8It is a schematic structural diagram of a preferred embodiment of a terminal device provided by the present invention. Detailed implementation manners

[0038] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0039] Please refer to Figure 1 , Figure 1 It is a schematic flowchart of a preferred embodiment of a monitoring content sharing method based on 5G new call provided by the present invention. The monitoring content sharing method based on 5G new call includes:

[0040] S1, based on the basic session established between the first terminal and the second terminal, in response to the monitoring sharing request of the first terminal, obtain the audio-visual data stream of the monitoring content from the monitoring platform according to the monitoring sharing request; wherein, the number of the second terminals is at least one;

[0041] S2, transmit the audio-visual data stream to the first terminal and the second terminal through the first data channel, so as to display the monitoring content on the first layer of the display screens of the first terminal and the second terminal;

[0042] S3, receive the auxiliary operation of the first terminal or the second terminal on the monitoring content;

[0043] S4, transmit the auxiliary operation to the first terminal and the second terminal through the second data channel, so as to display the auxiliary operation on the second layer of the display screens of the first terminal and the second terminal.

[0044] It should be noted that IMS (IP Multimedia Subsystem) is a multimedia service architecture based on IP network, aiming to meet the more novel and diverse multimedia service requirements of terminal customers. It was initially designed by 3GPP (Third Generation Partnership Project) as part of the future mobile network vision goal, mainly used to realize the triple convergence services of voice, data and video. The core advantage of IMS is that it can effectively manage network resources, user resources and application resources, improve the intelligent level of the network, enable users to cross various networks and use multiple terminals, and enjoy the converged communication experience.

[0045] The DataChannel of WebRTC is an API that allows arbitrary data to be directly transmitted between browsers, providing a data transmission channel with low latency and high reliability. In 5G New Call, the IMS data channel mentioned uses the DataChannel technology of WebRTC.

[0046] 5G New Call involves the DCMF (Data Channel Media Function) network element: It provides new media network element for IMS data channel resource management through SBI externally. It is a standard network element in the IMS data channel service and provides the function of forwarding media data of the data channel.

[0047] Specifically, the embodiment of the present invention provides a method for sharing monitoring content based on 5G New Call, which is applied to a monitoring content sharing system. Please refer to Figure 2 , Figure 2 It is a schematic diagram of the system architecture in a method for sharing monitoring content based on 5G New Call provided by the present invention. In the embodiment of the present invention, the monitoring content sharing system includes a 5G terminal, an IMS session control server, an IMS data channel monitoring sharing application module, an IMS data channel media function DCMF network element, and a monitoring platform. The 5G New Call terminal 1 and the 5G New Call terminal 2 establish a basic session through the IMS session control server. If the 5G New Call terminal 1 hopes to share monitoring content with the 5G New Call terminal 2 during the call, the 5G New Call terminal 1 sends a monitoring sharing request. Exemplarily, on the floating window of the native APP of the 5G New Call terminal 1, the user clicks the monitoring sharing button, and then in the list of enumerated monitoring devices, selects the monitoring device for which the monitoring content needs to be shared. The IMS data channel monitoring sharing application module uses the monitoring platform control protocol provided by the monitoring manufacturer to obtain the audio and video data stream of the monitoring content from the monitoring platform, converts the audio and video data stream into an audio and video format recognizable by the 5G terminal, and uses the first data channel to transmit the audio and video data containing the monitoring content to each 5G New Call terminal in the call. At this time, all members participating in the call can synchronously display the video content of the monitoring device selected by the service initiator on the 5G terminal screen. During the process of sharing the monitoring content between the 5G New Call terminal 1 and the 5G New Call terminal 2, any party can perform auxiliary operations such as writing, drawing, and person tracking on the basis of the monitoring content, and other members in the call can see the content of its writing, drawing, and person tracking, improving the communication efficiency of the monitoring situation. It should be noted that the transmission of auxiliary information is carried out using the second data channel, which is independent of the first data channel for the monitoring content. In the embodiment of the present invention, the number of call participating terminals is not limited to 2, and can be 3 or more. For calls with multiple terminals participating, their functions and principles are the same. The members participating in the monitoring sharing during the call can belong to different local points and different operators.

[0048] It should be noted that the IMS data channel monitoring sharing application module is an important component for realizing shared monitoring content. Its internal functional units include the function unit for the correspondence between monitoring devices and monitoring platforms, the function unit for retrieving monitoring content from the monitoring platform, the function unit for audio and video transcoding of monitoring content, and the IMS data channel signaling interface function unit.

[0049] Function unit for the correspondence between monitoring devices and monitoring platforms: Manage and record the correspondence between monitoring devices and monitoring platforms. When the unique identifier of a monitoring device is input, the monitoring platform responsible for this monitoring device can be found out.

[0050] Function unit for retrieving monitoring content from the monitoring platform: Manage and record the control protocols provided by the monitoring platform manufacturers. For example, the control protocol provided by the manufacturer is the monitoring national standard protocol 28181 or the private protocol SDK, etc. This function unit uses the corresponding control protocol to obtain the monitoring audio and video code streams of the corresponding devices from the monitoring platform.

[0051] Function unit for audio and video transcoding of monitoring content: The audio and video data of the monitoring obtained from the monitoring platform cannot be directly forwarded to the 5G new call terminal. It is necessary to repackage the audio and video data according to the protocol requirements of the DataChannel of WebRTC and then forward it to each 5G new call terminal in the call.

[0052] IMS data channel signaling interface function unit: Receive service requests from the IMS session control server and check the validity of the service requests. Such as whether the user has the permission to use the service, and whether the unique identifier of the monitoring device provided by it has a corresponding monitoring platform registered in the system. If both requirements can be met, services will be provided for its application.

[0053] In the embodiment of the present invention, when a user uses a terminal with 5G new call function to have audio and video communication with other members, the user can share the monitoring content with other members participating in the call within the native phone APP, and view the monitoring content while communicating. Any member in the call can perform operations such as writing, drawing, and person tracking on the basis of displaying the monitoring content, and other members in the call can see the content of its writing, drawing, person tracking, etc., greatly improving the communication efficiency of the monitoring situation. Moreover, in the embodiment of the present invention, with the support of the IMS data channel, the communication auxiliary graphic information and the monitoring video stream are transmitted independently using different data channels. Each 5G terminal displays the information on different display layers for the communication auxiliary graphic information and the monitoring video information received on different data channels, and the step of synthesizing the monitoring video and the graphics can be omitted.

[0054] In another preferred embodiment, the basic session is a voice call or a video call.

[0055] Specifically, in the embodiments of the present invention, the basic session established between the 5G New Call Terminal 1 and the 5G New Call Terminal 2 through the IMS session control server can be a voice call or a video call, not limited to video calls only, effectively expanding the application scenarios.

[0056] In yet another preferred embodiment, the monitoring sharing request carries the unique identifier of the monitoring device, and the obtaining of the audio and video data stream of the monitoring content from the monitoring platform according to the monitoring sharing request includes:

[0057] Determining the monitoring platform corresponding to the monitoring device according to the unique identifier of the monitoring device in the monitoring sharing request;

[0058] Obtaining the audio and video data stream of the monitoring content of the monitoring device from the monitoring platform according to a preset control protocol.

[0059] Specifically, in the embodiments of the present invention, the monitoring sharing request sent by the 5G New Call Terminal 1 carries the unique identifier of the monitoring device. The IMS data channel monitoring sharing application module determines the monitoring platform corresponding to the monitoring device according to the unique identifier of the monitoring device in the monitoring sharing request, and obtains the audio and video data stream of the monitoring content of the monitoring device from the monitoring platform according to a preset control protocol.

[0060] In yet another preferred embodiment, before transmitting the audio and video data stream to the first terminal and the second terminal through the first data channel, the method further includes:

[0061] Establishing a first data channel and a second data channel according to the monitoring sharing request.

[0062] Specifically, in the embodiments of the present invention, before data transmission, the IMS session control server, the IMS data channel monitoring sharing application module, and the IMS data channel media function DCMF network element first establish the required monitoring content application data channel and auxiliary information application data channel, that is, the first data channel and the second data channel, according to the request of the 5G terminal 1 to share the monitoring content.

[0063] In the embodiments of the present invention, with the support of the IMS data channel, the communication auxiliary graphic information and the monitoring video stream are communicated and independently transmitted using different data channels. Each 5G terminal displays the information on different display layers for the communication auxiliary graphic information and the monitoring video information received on different data channels, and the step of synthesizing the monitoring video and the graphics can be omitted.

[0064] Exemplarily, please refer to Figure 3 , Figure 3It is an interaction schematic diagram of a monitoring content sharing method based on 5G New Call provided by the present invention to enhance the understanding of the functions of each network element in the system:

[0065] The first step: During the call between the 5G New Call terminal 1 and the remote 5G New Call terminal 2, it registers the "monitoring sharing" service in the IMS network and clicks the "monitoring sharing" button on the floating window of the native phone APP. This triggers a monitoring device sharing request, which uses the SIP (Session Initiation Protocol). After receiving this message, the IMS session control server sends the monitoring device sharing request to the IMS data channel monitoring sharing application module, and this request will carry the unique identifier of the monitoring device.

[0066] The second step: After receiving the request, the IMS data channel monitoring sharing application module obtains the unique identifier of the monitoring device, retrieves the monitoring platform responsible for this monitoring device, and then uses the control protocol provided by the manufacturer of this monitoring platform to obtain the audio and video data stream of the monitoring device from the monitoring platform.

[0067] The third step: After successfully obtaining the monitored audio and video data, the IMS data channel monitoring sharing application module sends a request to create a monitoring shared data channel media resource to the IMS session control server.

[0068] The fourth step: After receiving the request to create a monitoring shared data channel media resource, the IMS session control server sends a media resource application for the monitoring content application data channel and the auxiliary information application data channel to the IMS data channel media function DCMF network element.

[0069] The fifth step: After successfully receiving the data channel media resource application from the IMS data channel media function DCMF network element, the IMS session control server notifies the IMS data channel monitoring sharing application module that the media resources of the monitoring content application data channel and the auxiliary information application data channel it applied for have been successfully applied for.

[0070] The sixth step: The IMS data channel monitoring sharing application module receives the message that the media resource applications for the monitoring content application data channel and the auxiliary information application data channel are successful. At this time, the resources required for the monitoring sharing service are ready. It sends a message to agree to the monitoring device sharing request of the IMS session control server. (For the request in the first step)

[0071] The seventh step: After receiving the message agreeing to the monitoring device sharing, the IMS session control server uses the SIP (Session Initiation Protocol), carries the media information (IP address, port number, etc.) required to establish the IMS data channel, and sends a request to the remote 5G New Call terminal 2. To enable the 5G New Call terminal 2 to connect to the monitoring device sharing data channel.

[0072] Step 8: After the IMS session control server receives the consent from the 5G New Call terminal 2 to enter the monitoring device sharing data channel, it obtains the channel docking information of the 5G New Call terminal 2 from the message and updates this information to the IMS Data Channel Media Function (DCMF) network element.

[0073] Step 9: After the IMS session control server receives the successful update of the IMS data channel media information, it sends a consent to monitor device sharing request to the 5G New Call terminal 1.

[0074] Step 10: At this time, the monitoring content application data channel and the auxiliary information application data channel required for the entire monitoring sharing service have been established.

[0075] Step 11: After the IMS data channel monitoring sharing application module obtains the monitored audio and video data from the monitoring platform, it packages the data according to the protocol requirements of the WebRTC DataChannel and sends it to each 5G New Call terminal in the call using the monitoring content application data channel.

[0076] Step 12: The IMS Data Channel Media Function (DCMF) network element is responsible for forwarding the data of the data channel between the 5G New Call terminal and the IMS data channel monitoring sharing application module.

[0077] Step 13: During the use of the monitoring sharing service, communication auxiliary information such as writing, drawing, and person tracking by the participants based on the monitoring content is forwarded by the IMS Data Channel Media Function (DCMF) network element through the auxiliary information application data channel.

[0078] Exemplarily, please refer to Figure 4 and Figure 5 , Figure 4 which is the first process schematic diagram of a monitoring content sharing method based on 5G New Call provided by the present invention, Figure 5 and Figure 4 is the second process schematic diagram of a monitoring content sharing method based on 5G New Call provided by the present invention. Figure 3 In , the "monitoring sharing" service is initiated by the local 5G terminal. When initiating a basic session, the IMS network determines that all terminals participating in the session support the 5G New Call feature, and the local 5G terminal has registered the monitoring sharing service. A download channel is established for the local 5G terminal to download the applet list and the monitoring sharing applet. The local 5G terminal successfully establishes a basic session and conducts an audio or audio-video call, and there is a "monitoring sharing" button in the display interface. For subsequent details, please refer to Figure 5 In , the "monitoring sharing" service is received by the remote 5G terminal. After the remote 5G terminal accepts the service requirements, it obtains the monitoring video stream from the monitoring content application data channel and displays the content at the bottom layer of the local display layer.

[0079] In yet another preferred embodiment, the auxiliary operations include writing, drawing, person tracking, and deletion.

[0080] In yet another preferred embodiment, when the auxiliary operation is person tracking, the auxiliary operations of the first terminal or the second terminal on the monitored content include:

[0081] Determine the target person to be tracked in the monitored content, and generate a person locking graphic and a globally unique encoding ID of the person locking graphic;

[0082] Synchronize the person locking graphic and the globally unique encoding ID of the person locking graphic to each terminal;

[0083] When the target person leaves the monitored content, the person locking graphic is deleted on each terminal.

[0084] Specifically, in the embodiments of the present invention, for the 5G new call terminal 1 and the 5G new call terminal 2, during the process of sharing the monitored content, either party can perform auxiliary operations such as writing, drawing, and person tracking on the basis of the monitored content, and other members in the call can see the content of their writing, drawing, person tracking, etc., improving the communication efficiency of the monitored situation. Moreover, the transmission of auxiliary information uses a second data channel for transmission, which is independent of the first data channel of the monitored content. In the embodiments of the present invention, the communication auxiliary information and the monitored video stream are transmitted independently. The communication auxiliary information is transmitted using an independent IMS application data channel, that is, the auxiliary information application data channel. It is independent of the SIP signaling channel for managing the call session and independent of the monitored content application data channel for transmitting the monitored video stream. The independent auxiliary information application data channel can synchronize information to other terminals more quickly and effectively.

[0085] Exemplarily, please refer to Figure 6 , Figure 6 is the third process schematic diagram of a method for sharing monitored content based on 5G new call provided by the present invention. In the embodiments of the present invention, on the 5G new call terminal, using the applet feature, a monitored content sharing applet module is created. This monitored content sharing applet module presents a "monitored content sharing" button on the call interface. After clicking the "monitored content sharing" button, a list of monitored devices pops up, and selecting the corresponding monitored device can trigger the monitored content sharing service. After the monitored content sharing service is successfully established, "person tracking", "writing", "drawing", and "eraser" buttons are presented on the monitored video to improve communication efficiency.

[0086] Function description of the "person tracking" auxiliary information. In the monitoring content sharing service, each 5G terminal can select the person to be tracked on the monitoring video interface and generate a person-locking graphic. The implementation principle is: whoever generates the person-locking graphic is responsible for generating a globally unique encoding ID for the graphic (used when deleting the graphic), responsible for tracking the movement of the person in the monitoring video stream, and synchronizing the graphic data (including the globally unique encoding ID of the graphic) of the locking graphic that follows the person's movement in real time to other 5G terminals. After receiving the locking graphic data, other terminals present the content on another layer different from the monitoring video display layer (the bottom layer), and save the globally unique encoding ID of the graphic (used when deleting the graphic). When the tracked person leaves the monitoring video, the person-locking graphic will be deleted on each 5G terminal.

[0087] Among them, the generation rule of the globally unique encoding ID is: ID = "IMEI serial number of the local 5G terminal" + "1 to 65535", the minimum value of ID = "IMEI serial number of the local 5G terminal" + "1", and the maximum value of ID = "IMEI serial number of the local 5G terminal" + "65535". This rule ensures that the globally unique encoding IDs generated by each 5G terminal for the auxiliary information graphics are globally non-repetitive.

[0088] In the embodiments of the present invention, a globally unique encoding ID is assigned to each graphic of the auxiliary information. This ID can be associated with all graphic pixel information included in each auxiliary information graphic. When using the "eraser", the selected graphic of the auxiliary information can be deleted entirely.

[0089] Function description of the "writing" and "drawing" auxiliary information. In the monitoring content sharing service, each 5G terminal can perform actions such as "writing" and "drawing" on the monitoring video interface to improve communication efficiency. The implementation principle is: whoever generates the graphic information of "writing" and "drawing" is responsible for generating a globally unique encoding ID for this information (used when deleting the graphic), and responsible for synchronizing the graphic information data (including the globally unique encoding ID of the graphic) to other 5G terminals in real time. After receiving the graphic information data, other terminals present the content on another layer different from the monitoring video display layer (the bottom layer), and save the globally unique encoding ID of the graphic (used when deleting the graphic).

[0090] Function description of the "eraser" button. In the monitored content sharing service, each 5G terminal can use the "eraser" button on the monitored video interface to delete auxiliary information such as "person tracking", "writing", and "drawing". The implementation logic is as follows: for "person tracking", "writing", and "drawing", each graphic has a globally unique coding ID generated by the graphic producer. After the 5G terminal using the "eraser" function deletes its own selected graphic information, it sends the globally unique coding ID of the auxiliary graphic to be deleted to other 5G terminals. After receiving the globally unique coding ID of the graphic to be deleted, other 5G terminals delete the graphic corresponding to this globally unique coding ID in the display layer.

[0091] In the embodiments of the present invention, 5G new call and IMS data channel call technologies are used. Based on the presentation of monitored video sharing within the native phone APP of a 5G terminal, information such as writing, drawing, and person tracking on the terminal screen can be synchronized to the screens of other call participants in real time, which is beneficial for everyone to communicate monitored police information. Above the monitored video display layer, users can use means of person tracking communication auxiliary information to lock the selected person object with a graphic. If the person object moves within the monitored video source, the locking graphic follows the movement; if the person object disappears from the monitored video source, the locking graphic follows and disappears. Moreover, the embodiments of the present invention only target the sharing of monitored device content and do not involve the leakage of other information content, avoiding the risk of user privacy leakage.

[0092] Correspondingly, the present invention also provides a monitored content sharing device based on 5G new call, which can implement all the processes of the monitored content sharing method based on 5G new call in the above embodiments.

[0093] Please refer to Figure 7 , Figure 7 FIG. is a schematic structural diagram of a preferred embodiment of a monitored content sharing device based on 5G new call provided by the present invention. The monitored content sharing device based on 5G new call includes:

[0094] An acquisition module 701, configured to, based on a basic session established between a first terminal and a second terminal, in response to a monitored sharing request of the first terminal, obtain an audio-video data stream of monitored content from a monitoring platform according to the monitored sharing request; wherein, the number of the second terminals is at least one;

[0095] A first transmission module 702, configured to transmit the audio-video data stream to the first terminal and the second terminal through a first data channel, so as to display the monitored content in a first layer of the display screens of the first terminal and the second terminal;

[0096] A receiving module 703, configured to receive an auxiliary operation on the monitored content by the first terminal or the second terminal;

[0097] A second transmission module 704, configured to transmit the auxiliary operation to the first terminal and the second terminal through a second data channel, so as to display the auxiliary operation on a second layer of a display screen of the first terminal and the second terminal.

[0098] Preferably, the basic session is a voice call or a video call.

[0099] Preferably, the monitoring sharing request carries a unique identifier of a monitoring device, and obtaining an audio-visual data stream of the monitored content from a monitoring platform according to the monitoring sharing request includes:

[0100] Determining a monitoring platform corresponding to the monitoring device according to the unique identifier of the monitoring device in the monitoring sharing request;

[0101] Obtaining an audio-visual data stream of the monitored content of the monitoring device from the monitoring platform according to a preset control protocol.

[0102] Preferably, the device further includes a channel establishment module, configured to:

[0103] Before transmitting the audio-visual data stream to the first terminal and the second terminal through a first data channel, establish a first data channel and a second data channel according to the monitoring sharing request.

[0104] Preferably, the auxiliary operation includes writing, drawing, person tracking, and deletion.

[0105] Preferably, when the auxiliary operation is person tracking, the auxiliary operation on the monitored content by the first terminal or the second terminal includes:

[0106] Determining a target person to be tracked in the monitored content, and generating a person locking graphic and a globally unique encoding ID of the person locking graphic;

[0107] Synchronizing the person locking graphic and the globally unique encoding ID of the person locking graphic to each terminal;

[0108] When the target person leaves the monitored content, the person locking graphic is deleted on each terminal.

[0109] In specific implementation, the working principle, control process, and achieved technical effects of the monitoring content sharing device based on 5G new call provided in the embodiments of the present invention are the same as those of the monitoring content sharing method based on 5G new call in the above embodiments, and will not be elaborated herein.

[0110] Please refer to Figure 8 , Figure 8 which is a schematic structural diagram of a preferred embodiment of a terminal device provided by the present invention. The terminal device includes a processor 801, a memory 802, and a computer program stored in the memory 802 and configured to be executed by the processor 801. When the processor 801 executes the computer program, the method for sharing monitoring content based on 5G new call described in any of the above embodiments is implemented.

[0111] Preferably, the computer program can be divided into one or more modules / units (such as computer program 1, computer program 2,...). The one or more modules / units are stored in the memory 802 and executed by the processor 801 to complete the present invention. The one or more modules / units can be a series of computer program instruction segments capable of performing specific functions, and these instruction segments are used to describe the execution process of the computer program in the terminal device.

[0112] The processor 801 can be a central processing unit (CPU), or can also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor, or the processor 801 can also be any conventional processor. The processor 801 is the control center of the terminal device and connects various parts of the terminal device through various interfaces and lines.

[0113] The memory 802 mainly includes a program storage area and a data storage area. Among them, the program storage area can store an operating system, application programs required for at least one function, etc., and the data storage area can store relevant data, etc. In addition, the memory 802 can be a high-speed random access memory, or can also be a non-volatile memory, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc., or the memory 802 can also be other volatile solid-state storage devices.

[0114] It should be noted that the above terminal device may include, but is not limited to, a processor and a memory. Those skilled in the art can understand that Figure 8The structural schematic diagram is only an example of the above terminal device and does not limit the above terminal device. It may include more or fewer components than those shown in the figure, or combine some components, or different components.

[0115] An embodiment of the present invention also provides a computer-readable storage medium. The computer-readable storage medium includes a stored computer program. When the computer program runs, it controls the device where the computer-readable storage medium is located to execute the method for monitoring content sharing based on 5G new call described in any of the above embodiments.

[0116] An embodiment of the present invention also provides a computer program product. The computer program product includes a computer program or computer instructions. When the computer program or the computer instructions are executed by a processor, they implement the method for monitoring content sharing based on 5G new call described in any of the above embodiments.

[0117] An embodiment of the present invention provides a method, device, equipment, medium and product for monitoring content sharing based on 5G new call. Through a basic session established between a first terminal and a second terminal, in response to a monitoring sharing request from the first terminal, an audio-visual data stream of monitoring content is obtained from a monitoring platform according to the monitoring sharing request; wherein, the number of the second terminals is at least one; the audio-visual data stream is transmitted to the first terminal and the second terminal through a first data channel to display the monitoring content on a first layer of the display screens of the first terminal and the second terminal; an auxiliary operation on the monitoring content is received from the first terminal or the second terminal; the auxiliary operation is transmitted to the first terminal and the second terminal through a second data channel to display the auxiliary operation on a second layer of the display screens of the first terminal and the second terminal. The embodiment of the present invention can synchronously view monitoring content while having a voice communication in the 5G terminal native call APP, without the need to switch between multiple APPs, effectively improving the communication efficiency, and only sharing the content of the monitoring device without involving the leakage of other information content, avoiding the risk of privacy leakage.

[0118] It should be noted that the system embodiments described above are only illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the attached drawings of the system embodiment provided by the present invention, the connection relationship between the modules indicates that they have a communication connection, which can be specifically implemented as one or more communication buses or signal lines. Those of ordinary skill in the art can understand and implement it without creative efforts.

[0119] The above are the preferred embodiments of the present invention. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present invention, several improvements and modifications can be made, and these improvements and modifications are also regarded as the protection scope of the present invention.

Claims

1. A monitoring content sharing method based on 5G new call, characterized in that: include: Based on a basic session established between a first terminal and a second terminal, in response to a monitoring sharing request of the first terminal, obtaining an audio and video data stream of the monitoring content from a monitoring platform according to the monitoring sharing request; wherein the number of the second terminal is at least one; Transmitting the audio and video data stream to the first terminal and the second terminal through a first data channel, so as to display the monitoring content on a first layer of a display screen of the first terminal and the second terminal; receiving an auxiliary operation of the first terminal or the second terminal on the monitored content; The auxiliary operation is transmitted to the first terminal and the second terminal through a second data channel, so that the auxiliary operation is displayed on a second layer of a display screen of the first terminal and the second terminal.

2. The monitoring content sharing method based on 5G new call according to claim 1, characterized in that: The basic conversation is a voice call or a video call.

3. The monitoring content sharing method based on 5G new call according to claim 2 is characterized in that: The monitoring sharing request carries a unique identifier of the monitoring device, and the step of obtaining the audio and video data stream of the monitoring content from the monitoring platform according to the monitoring sharing request includes: Determining a monitoring platform corresponding to the monitoring device according to the unique identifier of the monitoring device in the monitoring sharing request; The audio and video data stream of the monitoring content of the monitoring device is obtained from the monitoring platform according to a preset control protocol.

4. The monitoring content sharing method based on 5G new call according to claim 3 is characterized in that: Before transmitting the audio and video data stream to the first terminal and the second terminal through the first data channel, the method further includes: A first data channel and a second data channel are established according to the monitoring sharing request.

5. The monitoring content sharing method based on 5G new call according to claim 4 is characterized in that: The auxiliary operations include writing, drawing, character tracking and deleting.

6. The monitoring content sharing method based on 5G new call according to claim 5, characterized in that: The auxiliary operation is person tracking, and the auxiliary operation of the first terminal or the second terminal on the monitoring content includes: Determine a target person to be tracked in the monitoring content, and generate a person locking pattern and a globally unique coding ID of the person locking pattern; Synchronize the character locking pattern and the globally unique coding ID of the character locking pattern to each terminal; When the target person leaves the monitoring content, the person locking pattern is deleted on each terminal.

7. A monitoring content sharing device based on 5G new calls, characterized in that: include: an acquisition module, configured to obtain an audio and video data stream of the monitoring content from the monitoring platform in response to a monitoring sharing request of the first terminal based on a basic session established between the first terminal and the second terminal according to the monitoring sharing request; wherein the number of the second terminal is at least one; A first transmission module, used for transmitting the audio and video data stream to the first terminal and the second terminal through a first data channel, so as to display the monitoring content on a first layer of a display screen of the first terminal and the second terminal; A receiving module, used for receiving an auxiliary operation of the first terminal or the second terminal on the monitored content; The second transmission module is used to transmit the auxiliary operation to the first terminal and the second terminal through the second data channel, so as to display the auxiliary operation on the second layer of the display screen of the first terminal and the second terminal.

8. A terminal device, characterized in that: It includes a processor and a memory, wherein a computer program is stored in the memory, and the computer program is configured to be executed by the processor, and when the processor executes the computer program, the monitoring content sharing method based on the 5G new call as described in any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein when the device where the computer-readable storage medium is located executes the computer program, the monitoring content sharing method based on the 5G new call as described in any one of claims 1 to 6 is implemented.

10. A computer program product, characterized in that The computer program product includes a computer program or a computer instruction, and when the computer program or the computer instruction is executed by a processor, the monitoring content sharing method based on the 5G new call as described in any one of claims 1 to 6 is implemented.

Images