A video processing method, device and storage medium

CN115967786BActive Publication Date: 2026-08-28CHINA MOBILEHANGZHOUINFORMATION TECH CO LTD +1
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202111171896.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-10-08
Publication Date
2026-08-28
Estimated Expiration
2041-10-08

AI Technical Summary

Technical Problem

但是,传统的家庭安防实时视频处理方案存在一些问题,首先,采用传统组网架构,需要完全通过互联网来传输控制信令和音视频数据,传统组网架构很少对控制信令及音视频数据做加密处理,个人信息安全无法保障;其次,传统的家庭安防实时视频处理方案视频画面传输延迟比较大;最后,不同的厂家查看软件、摄像机和处理服务器不能相互兼容,通用性差

Benefits of technology

[0069]本发明实施例提供了一种视频处理方法、装置和存储介质,其中,方法包括和家固话能力平台响应于移动终端下发的视频拨号请求,发送对应的语音提示信息至移动终端;接收移动终端发送的目标DTMF音频信号,解析目标DTMF音频信号得到目标DTMF按键信息;根据预设的采集设备和DTMF按键信息的对应关系,以及目标DTMF按键信息,确定目标DTMF按键信息对应的目标采集设备;基于自定义会话初始化协议向目标采集设备发起实时视频查看会话,其中,自定义会话初始化协议是基于Protobuf实现的;接收目标采集设备基于实时视频查看会话采集的实时视频画面后,发送实时视频画面至移动终端。采用上述方法实现方案,移动终端只需要视频拨号请求即可查看实时视频画面,在此过程中,避免使用第三方应用程序(APP,application),因此,上述方法实现方案具有较强的通用性。和家固话能力平台采用基于Protobuf协议实现的自定义会话初始化协议(PbSIP:Custom SessionInitialization protocol based on the Protobuf protocol)与目标采集设备进行实时视频查看会话,而基于Protobuf协议实现的自定义会话初始化协议具有加密功能,因此,提高了安全性。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115967786B_ABST
    Figure CN115967786B_ABST
Patent Text Reader

Abstract

Embodiments of the present application disclose a video processing method, device and storage medium, and a home fixed phone capability platform responds to a video dialing request issued by a mobile terminal, sends corresponding voice prompt information to the mobile terminal, receives a target dual-tone multi-frequency (DTMF) audio signal sent by the mobile terminal, analyzes the target DTMF audio signal to obtain target DTMF key information, determines a target collection device corresponding to the target DTMF key information according to a preset correspondence between collection devices and DTMF key information and the target DTMF key information, initiates a real-time video viewing session to the target collection device based on a custom session initiation protocol, wherein the custom session initiation protocol is implemented based on a protocol buffer (Protobuf), and sends a real-time video picture to the mobile terminal after receiving the real-time video picture collected by the target collection device based on the real-time video viewing session. The present application can view the real-time video picture through the video dialing request, has strong universality, and improves security.
Need to check novelty before this filing date? Find Prior Art

Claims

1. A video processing method, characterized in that, Applications to the Hejia fixed-line capability platform include: The system receives a virtual account registration request sent by the data acquisition device based on a custom session initialization protocol; wherein the virtual account registration request carries a target virtual account; wherein the custom session initialization protocol is implemented based on the protocol buffer Protobuf and has encryption functionality for encrypting transmitted signaling. In response to the virtual account registration request, a virtual account registration success message is sent to the data acquisition device; Send a second relationship query request to the Hejia fixed-line service platform; Receive the preset correspondence between virtual accounts and Internet Protocol Multimedia Subsystem (IMS) accounts sent by the home-based fixed-line service platform; Based on the preset correspondence between virtual accounts and IMS accounts, and the target virtual account, determine the target IMS account corresponding to the target virtual account; The target IMS account is sent to the core network based on the Session Initiation Protocol (SIP); Receive the IMS account registration success message issued by the core network based on the target IMS account; Receive a VoLTE-based video dialing request sent by a mobile terminal via the core network; wherein the video dialing request carries a target IMS account; In response to the video dialing request, a corresponding voice prompt message is sent to the core network based on the target IMS account, and then forwarded to the mobile terminal via the core network; Receive the target dual-tone multi-frequency (DTMF) audio signal sent by the mobile terminal, and parse the target DTMF audio signal to obtain the target DTMF key information; Based on the preset correspondence between acquisition devices and dual-tone multi-frequency (DTMF) key information, and the target DTMF key information, determine the target acquisition device corresponding to the target DTMF key information; A real-time video viewing session is initiated to the target acquisition device based on a custom session initialization protocol; Receive the real-time video footage captured by the target acquisition device based on the real-time video viewing session; The real-time video feed is sent to the mobile terminal.

2. The method according to claim 1, characterized in that, Before determining the target acquisition device corresponding to the target DTMF key information based on the preset correspondence between acquisition devices and DTMF key information, and the target DTMF key information, the method further includes: Send the first relationship query request to the Hejia fixed-line service platform; The system receives the preset correspondence between the acquisition device and the DTMF key information sent by the home landline service platform.

3. The method according to claim 1, characterized in that, Receiving the target dual-tone multi-frequency (DTMF) audio signal sent by the mobile terminal includes: The system receives an information stream sent by the mobile terminal via a core network; the information stream encapsulates the target dual-tone multi-frequency (DTMF) audio signal.

4. A video processing method, characterized in that, Applied to data acquisition devices, including: A virtual account query request is sent to the Hejia fixed-line service platform; the virtual account query request carries information about the data collection device. Receive the target virtual account corresponding to the collection device sent by the Hejia fixed-line service platform based on the information of the collection device; A virtual account registration request is sent to the Hejia fixed-line capability platform based on a custom session initialization protocol; wherein, the virtual account registration request carries the target virtual account corresponding to the acquisition device; the custom session initialization protocol is implemented based on the protocol buffer Protobuf, and the custom session initialization protocol has encryption function to encrypt the transmitted signaling; Receive a virtual account registration success message sent by the Hejia fixed-line capability platform; The system receives a real-time video viewing session initiated by the Hejia Fixed-line Capability Platform based on a custom session initialization protocol. This real-time video viewing session is initiated by the Hejia Fixed-line Capability Platform after receiving a VoLTE-based video dialing request from a mobile terminal forwarded via the core network, and identifying the acquisition device as the target acquisition device based on the target dual-tone multi-frequency (DTMF) key information returned by the mobile terminal. The video dialing request carries a target IMS account, which is used to bind the acquisition device. In response to a real-time video viewing session initiated by the Hejia Fixed-line Capability Platform based on a custom session initialization protocol, the system acquires the real-time video frame and sends the real-time video frame to the Hejia Fixed-line Capability Platform.

5. The method according to claim 4, characterized in that, The method further includes: When the acquisition device supports PTZ control function and has acquired and sent the real-time video image to the Hejia fixed-line capability platform, it receives the target dual-tone multi-frequency (DTMF) audio signal sent by the mobile terminal. The target dual-tone multi-frequency (DTMF) audio signal is analyzed to obtain the target DTMF key information; Based on the preset correspondence between DTMF key information and the operation performed by the acquisition device, and the target DTMF key information, the operation performed by the target acquisition device corresponding to the target DTMF key information is determined.

6. The method according to claim 5, characterized in that, The method further includes: Receive a video hang-up request sent by the mobile terminal based on the custom session initialization protocol and the session initiation protocol SIP; In response to the video hang-up request sent by the mobile terminal based on the custom session initialization protocol and the session initiation protocol SIP, the live video viewing function is turned off and a live video off message is sent to the mobile terminal.

7. A video processing method, characterized in that, Applied to mobile terminals, including: Obtain the pre-defined correspondence between communication accounts and data collection devices; wherein, the communication account has home landline service and is used to identify the mobile terminal; Send the preset correspondence between the communication account and the data collection device to the Hejia fixed-line service platform; According to the user's instructions, the VoLTE-based video dialing request is forwarded to the Home Fixed-line Capability Platform via the core network; wherein, the video dialing request carries the target IMS account; Receive the corresponding voice prompt information sent by the Hejia fixed-line capability platform through the core network; the corresponding voice prompt information is obtained based on the target IMS account carried in the video dialing request; Receive target DTMF key information determined by the user based on the voice prompt information; the target DTMF key information is used to determine the corresponding acquisition device. The target dual-tone multi-frequency (DTMF) audio signal corresponding to the target DTMF key information is sent to the Hejia fixed-line capability platform; the Hejia fixed-line capability platform is used to parse the target DTMF key information based on the target DTMF audio signal. The system receives real-time video footage collected by the corresponding acquisition device from the Hejia fixed-line capability platform based on the target dual-tone multi-frequency (DTMF) key information. The real-time video footage is initiated by the Hejia fixed-line capability platform to the target acquisition device based on a custom session initialization protocol. The custom session initialization protocol is implemented based on the protocol buffer Protobuf and has encryption functionality for encrypting the transmitted signaling.

8. The method according to claim 7, wherein sending the target dual-tone multi-frequency (DTMF) audio signal corresponding to the target DTMF key information to the Hejia fixed-line capability platform comprises: The target dual-tone multi-frequency (DTMF) audio signal corresponding to the target DTMF key information is encapsulated in an information stream, and the information stream is sent to the core network via RTP, and then forwarded to the home-based fixed-line capability platform via the core network.

9. The method according to claim 8, characterized in that, The receiving of real-time video footage captured by the corresponding acquisition device based on the target dual-tone multi-frequency (DTMF) key information sent by the home-based fixed-line capability platform includes: The system receives real-time video footage collected by the corresponding acquisition device based on the target dual-tone multi-frequency (DTMF) key information sent by the home-based fixed-line capability platform. The audio in the real-time video footage is unidirectional, meaning that the acquisition device cannot hear the sound from the mobile terminal, but the mobile terminal can hear the sound from the acquisition device.

10. The method according to claim 9, characterized in that, The method further includes: After receiving the real-time video footage collected by the acquisition device from the Hejia fixed-line capability platform, the system sends the target dual-tone multi-frequency (DTMF) audio signal corresponding to the target DTMF key information to the acquisition device.

11. The method according to claim 10, characterized in that, The method further includes: A video hang-up request is sent to the acquisition device according to the custom session initialization protocol and the session initiation protocol SIP; Receive the real-time video shutdown message sent by the acquisition device based on the video hang-up request.

12. A video processing method, characterized in that, Applied to the core network, including: Send the preset correspondence between communication accounts and IMS accounts to the Hejia fixed-line service platform; wherein, the communication account has Hejia fixed-line service; The target IMS account is sent by the Hejia Fixed-line Capability Platform based on the Session Initiation Protocol (SIP). The target IMS account is determined by the Hejia Fixed-line Capability Platform from the preset virtual account and IMS account correspondence obtained from the Hejia Fixed-line Service Platform based on the target virtual account. The target virtual account is the identifier used by the acquisition device when registering with the Hejia Fixed-line Capability Platform. The target IMS account is used to bind the acquisition device. After successfully registering the target IMS account, an IMS account registration success message is sent to the Hejia fixed-line capability platform; Send a video dialing request based on VoLTE issued by the mobile terminal; wherein the video dialing request carries the target IMS account; In response to the video dialing request, the Home Fixed-line Capability Platform sends voice prompt information corresponding to the target IMS account to the mobile terminal.

13. A video processing method, characterized in that, Applied to the Hejia fixed-line service platform, including: Receive and save the preset correspondence between communication accounts and IMS accounts issued by the core network; wherein, the communication account has home landline service; Receive the preset correspondence between the communication account and the data collection device sent by the mobile terminal; A virtual account corresponding to the acquisition device is created and saved according to the preset correspondence between communication accounts and acquisition devices; Based on the preset correspondence between communication accounts and IMS accounts, the preset correspondence between communication accounts and acquisition devices, and the virtual account corresponding to the acquisition device, the preset correspondence between virtual accounts and IMS accounts is determined. Receive the first relationship query request sent by the home-based fixed-line capability platform; In response to the first relationship query request sent by the Hejia fixed-line capability platform, a preset correspondence between the acquisition device and the dual-tone multi-frequency (DTMF) key information is sent to the Hejia fixed-line capability platform. Receive the second relationship query request sent by the home-based fixed-line capability platform; In response to the second relationship query request sent by the Hejia Fixed-line Capability Platform, a preset correspondence between virtual accounts and IMS accounts is sent to the Hejia Fixed-line Capability Platform.

14. The method according to claim 13, characterized in that, The method further includes: Receive a virtual account query request sent by the data acquisition device; the virtual account query request carries information about the data acquisition device; In response to a virtual account query request sent by the data acquisition device, the target virtual account corresponding to the data acquisition device is sent to the data acquisition device based on the information of the data acquisition device.

15. The method according to claim 14, characterized in that, The step of creating and saving a virtual account corresponding to the acquisition device based on the preset correspondence between communication accounts and acquisition devices includes: For each acquisition device in the preset correspondence between communication accounts and acquisition devices, a virtual account is created and saved for each acquisition device; the number of acquisition devices is at least one, and the number of virtual accounts is at least one.

16. A video processing apparatus, characterized in that, include: The system comprises a first receiving unit, a first parsing unit, a first determining unit, a first session unit, and a first sending unit; wherein, The first receiving unit is configured to receive a virtual account registration request sent by the acquisition device based on a custom session initialization protocol; wherein the virtual account registration request carries a target virtual account; wherein the custom session initialization protocol is implemented based on the Protocol Buffer (Protobuf) and has encryption functionality for encrypting transmitted signaling; configured to receive a preset correspondence between virtual accounts and Internet Protocol Multimedia Subsystem (IMS) accounts sent by the home fixed-line service platform; and configured to receive an IMS account registration success message issued by the core network based on the target IMS account. The first sending unit is configured to, in response to the virtual account registration request, send a virtual account registration success message to the acquisition device; send a second relationship query request to the Hejia fixed-line service platform; and send the target IMS account to the core network based on the Session Initiation Protocol (SIP). The first determining unit is used to determine the target IMS account corresponding to the target virtual account based on the preset correspondence between virtual accounts and IMS accounts, and the target virtual account; The first receiving unit is configured to receive a VoLTE-based video dialing request sent by a mobile terminal via the core network; wherein the video dialing request carries the target IMS account. The first sending unit is configured to respond to a video dialing request sent by the mobile terminal, send corresponding voice prompt information to the core network based on the target IMS account, and forward it to the mobile terminal via the core network; The first receiving unit is used to receive the target dual-tone multi-frequency (DTMF) audio signal sent by the mobile terminal; and to receive the real-time video footage captured by the target acquisition device based on the real-time video viewing session. The first parsing unit is used to parse the target dual-tone multi-frequency (DTMF) audio signal to obtain the target DTMF key information; The first determining unit is used to determine the target acquisition device corresponding to the target dual-tone multi-frequency DTMF key information based on the preset correspondence between the acquisition device and the dual-tone multi-frequency DTMF key information, and the target dual-tone multi-frequency DTMF key information. The first session unit is used to initiate the real-time video viewing session to the target acquisition device based on a custom session initialization protocol; The first sending unit is configured to respond to a video dialing request sent by the mobile terminal by sending corresponding voice prompt information to the mobile terminal; and to send the real-time video image to the mobile terminal.

17. A video processing apparatus, characterized in that, include: The system comprises a second receiving unit, a first acquiring unit, and a second transmitting unit; wherein... The second sending unit is used to send a virtual account query request to the Hejia fixed-line service platform; the virtual account query request carries information about the collection device; it is also used to send a virtual account registration request to the Hejia fixed-line capability platform based on a custom session initialization protocol; wherein the virtual account registration request carries the target virtual account corresponding to the collection device; the custom session initialization protocol is implemented based on the protocol buffer Protobuf, and the custom session initialization protocol has encryption function for encrypting the transmitted signaling; The second receiving unit is configured to receive the target virtual account corresponding to the collection device sent by the Hejia fixed-line service platform based on the information of the collection device; and to receive a virtual account registration success message sent by the Hejia fixed-line capability platform. The second receiving unit is used to receive a real-time video viewing session initiated by the Hejia Fixed-line Capability Platform based on a custom session initialization protocol; wherein, the real-time video viewing session is initiated by the Hejia Fixed-line Capability Platform after receiving a VoLTE-based video dialing request sent by a mobile terminal via the core network, and determining the acquisition device as the target acquisition device based on the target dual-tone multi-frequency (DTMF) key information returned by the mobile terminal; the video dialing request carries a target IMS account, and the target IMS account is used to bind the acquisition device; The first acquisition unit is used to acquire real-time video footage in response to a real-time video viewing session initiated by the home-based fixed-line capability platform based on a custom session initialization protocol. The second sending unit is used to send the real-time video image to the home-based fixed-line capability platform.

18. A video processing apparatus, characterized in that, include: The system comprises a second acquisition unit, a third transmission unit, and a third receiving unit; wherein... The second acquisition unit is used to acquire the correspondence between a preset communication account and a collection device; wherein the communication account has home landline service and is used to identify the mobile terminal; The third sending unit is used to send the preset correspondence between the communication account and the acquisition device to the Hejia fixed-line service platform; to forward the VoLTE-based video dialing request to the Hejia fixed-line capability platform via the core network according to the user's instruction; wherein the video dialing request carries the target IMS account; and to send the target dual-tone multi-frequency DTMF audio signal corresponding to the target dual-tone multi-frequency DTMF key information to the Hejia fixed-line capability platform. The third receiving unit is configured to receive corresponding voice prompt information sent by the Hejia fixed-line capability platform via the core network; the corresponding voice prompt information is obtained based on the target IMS account carried in the video dialing request; the corresponding voice prompt information is obtained based on the target IMS account carried in the video dialing request; it is configured to receive target DTMF key information determined by the user based on the voice prompt information; it is configured to receive real-time video footage of the corresponding acquisition device sent by the Hejia fixed-line capability platform based on the target DTMF key information; the real-time video footage is initiated by the Hejia fixed-line capability platform to the target acquisition device based on a custom session initialization protocol, wherein the custom session initialization protocol is implemented based on the protocol buffer Protobuf, and the custom session initialization protocol has encryption function for encrypting the transmitted signaling.

19. A video processing apparatus, characterized in that, include: The system comprises a fourth transmitting unit, a fourth receiving unit, a registration unit, and a fourth transmitting unit; wherein, The fourth sending unit is used to send the preset correspondence between communication accounts and IMS accounts to the Hejia fixed-line service platform; wherein, the communication account has Hejia fixed-line service; The fourth receiving unit is used to receive the target IMS account sent by the Hejia Fixed-line Capability Platform based on the Session Initiation Protocol (SIP). The target IMS account is determined by the Hejia Fixed-line Capability Platform from the preset virtual account and IMS account correspondence obtained from the Hejia Fixed-line Service Platform based on the target virtual account. The target virtual account is the identifier used by the acquisition device when registering with the Hejia Fixed-line Capability Platform. The target IMS account is used to bind the acquisition device. The registration unit is used to register the target IMS account; The fourth sending unit is used to send a video dialing request based on VoLTE issued by the mobile terminal; wherein the video dialing request carries a target IMS account; and the sending and home fixed-line capability platform responds to the video dialing request by sending voice prompt information corresponding to the target IMS account to the mobile terminal.

20. A video processing apparatus, characterized in that, include: The system comprises a fifth receiving unit, a storage unit, a creation unit, a third determining unit, and a fifth transmitting unit; wherein, The fifth receiving unit is used to receive the preset correspondence between communication accounts and IMS accounts issued by the core network; wherein the communication account has the home fixed-line service; receive the preset correspondence between communication accounts and collection devices issued by the mobile terminal; and receive the first relationship query request sent by the home fixed-line capability platform. The storage unit is used to store the pre-defined correspondence between communication accounts and IMS accounts issued by the core network; and to store the virtual account corresponding to the acquisition device. The creation unit creates a virtual account corresponding to the acquisition device based on the preset correspondence between communication accounts and acquisition devices; The third determining unit is used to determine the correspondence between the preset virtual account and the IMS account based on the preset correspondence between the communication account and the IMS account, the preset correspondence between the communication account and the acquisition device, and the virtual account corresponding to the acquisition device. The fifth sending unit is used to respond to the first relationship query request sent by the Hejia fixed-line capability platform and send the preset correspondence between the acquisition device and the dual-tone multi-frequency DTMF key information to the Hejia fixed-line capability platform. The fifth receiving unit is used to receive the second relationship query request sent by the Hejia fixed-line capability platform; The fifth sending unit is also used to respond to the second relationship query request sent by the Hejia fixed-line capability platform and send the preset correspondence between the virtual account and the IMS account to the Hejia fixed-line capability platform.

21. A home-based fixed-line telephone capability platform, characterized in that, The home-based fixed-line capability platform includes: The first memory is used to store executable instructions; A first communication bus is used to enable communication between the first memory and the first processor; The first processor is configured to execute executable instructions stored in the first memory to implement the video processing method as described in any one of claims 1-3.

22. A data acquisition device, characterized in that, The data acquisition device includes: The second memory is used to store executable instructions; The second communication bus is used to enable communication between the second memory and the second processor; The second processor is configured to execute executable instructions stored in the second memory to implement the video processing method as described in any one of claims 4-6.

23. A mobile terminal, characterized in that, The mobile terminal includes: The third memory is used to store executable instructions; The third communication bus is used to enable communication between the third memory and the third processor; The third processor is configured to execute executable instructions stored in the third memory to implement the video processing method as described in any one of claims 7-11.

24. A core network, characterized in that, The core network includes: The fourth memory is used to store executable instructions; The fourth communication bus is used to enable communication between the fourth memory and the fourth processor; The fourth processor is configured to execute executable instructions stored in the fourth memory to implement the video processing method as described in claim 12.

25. A home-based fixed-line telephone service platform, characterized in that, The Hejia fixed-line service platform includes: The fifth memory is used to store executable instructions; The fifth communication bus is used to enable communication between the fifth memory and the fifth processor; The fifth processor is configured to execute executable instructions stored in the fifth memory to implement the video processing method as described in any one of claims 13-15.

26. A computer-readable storage medium, characterized in that, The storage medium stores executable instructions, which, when executed, cause a first processor to perform the video processing method as described in any one of claims 1-3; or cause a second processor to perform the video processing method as described in any one of claims 4-6; or cause a third processor to perform the video processing method as described in any one of claims 7-11; or cause a fourth processor to perform the video processing method as described in claim 12; or cause a fifth processor to perform the video processing method as described in any one of claims 13-15.

Citation Information

Patent Citations

  • Video monitoring method and system based on interactive voice response (IVR) technology

    CN102170559A