Intermediate number-based interactive video evidence obtaining method, storage medium and device

Abstract

The invention discloses an interactive video evidence obtaining method based on an intermediate number, a storage medium and equipment. The interactive video evidence obtaining method comprises the steps that a customer service fixed-line phone and a field personnel mobile phone establish voice communication through a signaling media processing server; the customer service staff controls the customer service desktop to initiate a video evidence obtaining request to the signaling media processing server; the signaling media processing server sends a corresponding reinvite video call request to the mobile phone of the field personnel according to the video evidence obtaining request, the mobile phone of the field personnel receives the video evidence obtaining request, and the signaling media processing server establishes a video call with the mobile phone of the field personnel; and the signaling media processing server initiates a reinvite video call request to the WebRTC client of the customer service desktop, and the WebRTC client automatically receives the video request and performs a video call so as to realize video evidence collection. According to the invention, the customer service staff controls the customer service desktop to pull up the mobile phone video of the field staff to return the field video picture, the operation is simple and convenient, and meanwhile, the privacy of both parties is protected.

Description

Technical Field

[0001] This invention relates to the field of audio and video call technology, and more specifically, to an interactive video forensics method, storage medium, and device based on an intermediate number. Background Technology

[0002] Intermediate number service is a service that protects the privacy of enterprise and customer numbers. It utilizes the IMS network contract capabilities of operators to achieve a call mode with privacy protection for AXB calls. That is, when A calls X, the call is routed to the intermediate number platform, which then displays X's number and continues paging to B. Neither A nor B can see the other's number; they can only see the call setup of X's number. In business scenarios such as food delivery, ride-hailing, and express delivery, this service maximizes the protection of the privacy of enterprises and customers.

[0003] The widespread use of intermediate numbers has brought great convenience and security to enterprises and customers, but it is limited to voice-based business operations. With the arrival of the 5G era, bandwidth is no longer a bottleneck for business development. Enterprises and customers have an increasing demand for voice overlay video capabilities. For example, in certain service scenarios that require video evidence collection, such as on-site law enforcement, insurance claims assessment, and identity verification, it is necessary to upload on-site video to the desktop of back-end customer service personnel in real time so that customer service personnel can interact and collaborate with on-site personnel in real time. This requires the introduction of an unconventional video call business model.

[0004] To enhance video calling capabilities, enterprises first need to upgrade their call centers and Session Border Controllers (SBCs), a costly undertaking that requires extensive software and hardware development and upgrades, presenting numerous challenges such as lengthy cycles, slow progress, and operational instability. Furthermore, during video calls, the other party's video is typically displayed in the upper right corner of the screen in a small window. However, in video evidence scenarios, on-site personnel do not need to see the other party's video but require a clearer view of their own video, such as the content of captured documents. While some mobile phones allow switching between video windows by clicking, most lack this capability, resulting in a fixed layout for both the calling and called party's video windows. Summary of the Invention

[0005] To address the problems existing in the prior art, this invention provides an interactive video evidence collection method, storage medium, and device based on an intermediate number. Customer service personnel can control the customer service desktop to retrieve on-site video footage from the personnel's mobile phones, making the operation simple and convenient. Simultaneously, the signaling media processing server on the intermediate number platform actively echoes the uploaded video, allowing on-site personnel to view a clearer version of the video on their mobile phone screens.

[0006] To achieve the above technical objectives, the present invention adopts the following technical solution: an interactive video forensics method based on intermediate numbers, comprising the following steps: Step S1: The customer service landline and the on-site personnel's mobile phone establish a voice call through the signaling media processing server on the intermediate number platform; Step S2: The customer service personnel control the customer service desktop to initiate a video evidence collection request to the signaling media processing server on the intermediate number platform; Step S3: The signaling media processing server on the intermediate number platform sends the corresponding reinvite video call request to the mobile phone of the on-site personnel according to the video evidence collection request. The mobile phone of the on-site personnel accepts the video evidence collection request, and the signaling media processing server establishes a video call with the mobile phone of the on-site personnel. Step S4: The signaling media processing server on the intermediate number platform initiates a reinvite video call request to the WebRTC client on the customer service desktop. The WebRTC client automatically receives the video request, conducts a video call, and achieves video evidence collection.

[0007] Furthermore, the video evidence collection request uses an HTTP request message.

[0008] Furthermore, the video evidence request includes control information for the video echo switch.

[0009] Furthermore, the reinvite video call request must carry a Session Description Protocol (SDP), including audio parameters and video parameters.

[0010] Furthermore, the audio parameters include setting the audio encoding type; the video parameters include setting the video encoding type, TMMBR parameters, and NACK parameters.

[0011] Furthermore, the specific process by which the signaling media processing server on the intermediate number platform initiates a reinvite video call request to the WebRTC client on the customer service desktop in step S4 is as follows: The signaling media processing server on the intermediate number platform initiates a reinvite video call request to the SIP WebRTC gateway and obtains the corresponding SIP signaling. The SIP WebRTC gateway converts the SIP signaling into a WS format video request and forwards it to the WebRTC client on the client's desktop.

[0012] Furthermore, the process of conducting a video call in step S4 is as follows: The WebRTC client on the customer service desktop and the SIP WebRTC gateway conduct video calls by combining signaling media encrypted with WS format and Secure Real-Time Transport Protocol (SRTP) media. The SIP WebRTC gateway and the signaling media processing server on the intermediate number platform conduct video calls by combining signaling media of SIP and RTP protocols. The signaling media processing server on the intermediate number platform displays the received video from the on-site personnel's mobile phone back to the on-site personnel's mobile phone based on the control information of the video echo switch in the video evidence request.

[0013] Furthermore, the present invention also provides a computer-readable storage medium storing a computer program that causes a computer to execute the described intermediate number-based interactive video forensics method.

[0014] Furthermore, the present invention also provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the aforementioned interactive video forensics method based on intermediate number.

[0015] Compared with the prior art, the present invention has the following beneficial effects: (1) The interactive video evidence collection method based on intermediate number of the present invention introduces customer service desktop on the basis of VoLTE audio call, integrates HTTP interaction protocol, sends video evidence collection request to signaling media processing server on intermediate number platform through customer service desktop, and switches audio call mode to video call mode. After video is connected, it calls and transfers to customer service desktop side to realize video call between customer service desktop and mobile phone side. On the basis of making full use of the existing equipment and environment of customer service center and meeting compliance management, it provides video evidence collection function and further expands the service scenarios of customer service center. (2) The interactive video evidence collection method based on the intermediate number of the present invention actively echoes the video on the mobile phone of the on-site personnel to the mobile phone of the on-site personnel through the signaling media processing server on the intermediate number platform, realizing clear video display on its own side during video evidence collection. Compared with the usual two-way video call where only the screen of the user is displayed in the upper right corner, it is more suitable for video evidence collection scenarios. Attached Figure Description

[0016] Figure 1 This is a flowchart of the interactive video forensics method based on intermediate numbers according to the present invention; Figure 2 This is an interactive timing diagram of the interactive video forensics method based on intermediate numbers according to the present invention. Detailed Implementation

[0017] The technical solution of the present invention will be further explained and described below with reference to the accompanying drawings.

[0018] like Figure 1-2 This invention provides an interactive video forensics method based on an intermediate number, comprising the following steps: Step S1: The customer service landline and the on-site personnel's mobile phone establish a voice call through the signaling media processing server on the intermediate number platform; specifically: the customer service personnel pick up the phone and initiate a call, which is then made to the signaling media processing server through the customer service landline to establish a call. The signaling media processing server on the intermediate number platform establishes a voice call with the on-site personnel's mobile phone, and then establishes a voice channel with the customer service landline through the signaling media processing server on the intermediate number platform to transmit the voice RTP stream.

[0019] In this invention, the signaling media processing server on the intermediate number platform adopts a B2BUA architecture. When it receives a user request, it reformatts the request and sends it out as a new request.

[0020] Step S2: The customer service personnel control the customer service desktop to initiate a video evidence collection request to the signaling media processing server on the intermediate number platform; in this invention, the video evidence collection request adopts an HTTP request message, and the video evidence collection request includes control information for the video echo switch.

[0021] Step S3: The signaling media processing server on the intermediate number platform sends the corresponding reinvite video call request to the mobile phone of the on-site personnel according to the video evidence collection request. The mobile phone of the on-site personnel accepts the video evidence collection request, and the signaling media processing server establishes a video call with the mobile phone of the on-site personnel.

[0022] In this invention, the reinvite video call request must carry a Session Description Protocol (SDP), including audio parameters and video parameters. The audio parameters include setting the audio encoding type, such as PCMA, PCMU, AMR, or AMR-WB. The video parameters include setting the video encoding type, such as H.264, TMMBR parameters, and NACK parameters. The TMMBR parameter is a protocol parameter for negotiating the maximum transmission bitrate between the sender and receiver, which can dynamically adjust the media stream bandwidth according to network conditions to avoid stuttering or packet loss caused by congestion. The NACK parameter is a parameter for the receiver to actively request the sender to retransmit lost data packets, used to repair media stream interruptions or quality degradation caused by network packet loss. Setting the TMMBR and NACK parameters helps solve problems such as video frame loss.

[0023] Step S4: The signaling media processing server on the intermediate number platform initiates a reinvite video call request to the WebRTC client on the customer service desktop. The WebRTC client automatically receives the video request, conducts a video call, and achieves video evidence collection.

[0024] This invention provides an interactive video evidence collection method based on intermediate numbers. On the intermediate number business platform, it helps enterprises achieve the goal of enabling customer service personnel to view on-site video through the customer service desktop and interact and collaborate with on-site personnel without extensive modification to the original voice system. The method is simple to operate, can improve the remote video evidence collection capability, and can protect the privacy of both parties in the call, especially the sensitive privacy of the video.

[0025] In one technical solution of the present invention, the specific process by which the signaling media processing server on the intermediate number platform initiates a reinvite video call request to the WebRTC client on the customer service desktop is as follows: The signaling media processing server on the intermediate number platform initiates a reinvite video call request to the SIP WebRTC gateway and obtains the corresponding SIP signaling. The SIP WebRTC gateway converts the SIP signaling into a WS format video request and forwards it to the WebRTC client on the client's desktop, thereby transmitting the signaling information from the IMS side to the Internet side.

[0026] In one technical solution of the present invention, the video call process is as follows: The WebRTC client on the customer service desktop and the SIP WebRTC gateway conduct video calls by combining signaling media encrypted with WS format and Secure Real-Time Transport Protocol (SRTP) media. The SIP WebRTC gateway and the signaling media processing server on the intermediate number platform conduct video calls by combining signaling media of SIP and RTP protocols. Based on the control information of the video echo switch in the video evidence request, the signaling media processing server on the intermediate number platform actively echoes the received on-site personnel's mobile phone video back to the on-site personnel's mobile phone, realizing a clear video display on its own side during video evidence collection. This is more suitable for video evidence collection scenarios than the usual two-way video call where only the image of the user is displayed in the upper right corner.

[0027] In one technical solution of the present invention, the on-site video data can be recorded in a signaling media server or on the customer service desktop.

[0028] In one technical solution of the present invention, a Session Description Protocol (SDP) for establishing interactive video call is also provided, including: basic session information, audio media description and video media description; in: Basic session information includes: SDP version number; Session initiator information, including: the session initiator's identifier, session ID, session version number, and the session initiator's IP address and IP address type; Session name; Session media transport address; Session time information; The audio media description includes: Media description, including: media type is audio, audio stream port number, RTP, AVP, and a list of audio encoding formats; Detailed parameters of the audio encoding format; Video media descriptions include: Media description, including: media type is video, video stream port number, RTP, AVP, and video encoding format; Detailed parameters of the video encoding format.

[0029] This invention, based on an intermediate number, introduces a customer service desktop and integrates the HTTP interaction protocol into the VoLTE audio call. The customer service desktop sends a video evidence request to the signaling media processing server and switches the audio call mode to video call mode. After the video call is connected, it calls and transfers the call to the customer service desktop, enabling video communication between the customer service desktop and the mobile phone. This provides video evidence collection functionality while fully utilizing existing equipment and environment in the customer service center and meeting compliance control requirements, further expanding the service scenarios of the customer service center.

[0030] In one embodiment of the present invention, a computer-readable storage medium is also provided, storing a computer program that enables a computer to execute the interactive video forensics method based on intermediate numbers of the present invention.

[0031] In one technical solution of the present invention, an electronic device is also provided, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the interactive video forensics method based on intermediate number of the present invention.

[0032] In the embodiments disclosed in this application, a computer storage medium may be a tangible medium that may contain or store programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of computer storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0033] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0034] The above are merely preferred embodiments of the present invention. The scope of protection of the present invention is not limited to the above embodiments. All technical solutions falling within the scope of the present invention's concept are within the scope of protection of the present invention. It should be noted that for those skilled in the art, any improvements and modifications made without departing from the principles of the present invention should be considered within the scope of protection of the present invention.

Claims

1. An interactive video forensics method based on intermediate numbers, characterized in that, Includes the following steps: Step S1: The customer service landline and the on-site personnel's mobile phone establish a voice call through the signaling media processing server on the intermediate number platform; Step S2: The customer service personnel control the customer service desktop to initiate a video evidence collection request to the signaling media processing server on the intermediate number platform; Step S3: The signaling media processing server on the intermediate number platform sends the corresponding reinvite video call request to the mobile phone of the on-site personnel according to the video evidence collection request. The mobile phone of the on-site personnel accepts the video evidence collection request, and the signaling media processing server establishes a video call with the mobile phone of the on-site personnel. Step S4: The signaling media processing server on the intermediate number platform initiates a reinvite video call request to the WebRTC client on the customer service desktop. The WebRTC client automatically receives the video request, conducts a video call, and achieves video evidence collection.

2. The interactive video forensics method based on intermediate numbers according to claim 1, characterized in that, The video evidence collection request uses an HTTP request message.

3. The interactive video forensics method based on intermediate numbers according to claim 1, characterized in that, The video evidence request includes control information for the video echo switch.

4. The interactive video forensics method based on intermediate numbers according to claim 1, characterized in that, The reinvite video call request must carry Session Description Protocol (SDP), including audio parameters and video parameters.

5. The interactive video forensics method based on intermediate numbers according to claim 4, characterized in that, The audio parameters include setting the audio encoding type; the video parameters include setting the video encoding type, TMMBR parameter, and NACK parameter.

6. The interactive video forensics method based on intermediate numbers according to claim 1, characterized in that, The specific process of the signaling media processing server on the intermediate number platform initiating a reinvite video call request to the WebRTC client on the customer service desktop in step S4 is as follows: The signaling media processing server on the intermediate number platform initiates a reinvite video call request to the SIP WebRTC gateway and obtains the corresponding SIP signaling. The SIP WebRTC gateway converts the SIP signaling into a WS format video request and forwards it to the WebRTC client on the client's desktop.

7. The interactive video forensics method based on intermediate numbers according to claim 1, characterized in that, The process of making a video call in step S4 is as follows: The WebRTC client on the customer service desktop and the SIP WebRTC gateway conduct video calls by combining signaling media encrypted with WS format and Secure Real-Time Transport Protocol (SRTP) media. The SIP WebRTC gateway and the signaling media processing server on the intermediate number platform conduct video calls by combining signaling media of SIP and RTP protocols. The signaling media processing server on the intermediate number platform displays the received video from the on-site personnel's mobile phone back to the on-site personnel's mobile phone based on the control information of the video echo switch in the video evidence request.

8. A computer-readable storage medium storing a computer program, characterized in that, The computer program causes the computer to perform the intermediate number-based interactive video forensics method as described in any one of claims 1-7.

9. An electronic device, characterized in that, include: The memory, the processor, and the computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the intermediate number-based interactive video forensics method as described in any one of claims 1-7.

Images