Device control method, device, electronic device and storage medium

Abstract

The present application provides a device control method, apparatus, electronic device and storage medium. The method includes: receiving a remote control signal sent by a remote control; determining the source type of the remote control signal and the signal content corresponding to the remote control signal; encapsulating the signal content according to a protocol matching the source type to obtain a first device control signaling; sending the first device control signaling to the visual network terminal through a visual network protocol conversion server, so that the visual network terminal adjusts the angle of the camera according to the first device control signaling. Through this method, the user can control the camera of the visual network terminal through the remote control of the Internet terminal. Secondly, for the remote control signals of various source types generated by the user on the remote control, the Internet terminal can convert them into the first device control signaling to realize the operation of the camera of the visual network terminal, which further improves the flexibility of controlling the camera of the visual network terminal on the Internet.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a secure video communication method, device, equipment and medium based on a management plane protocol. Background Art

[0002] At present, with the popularization and development of visual networking services across the country, the visual networking high-definition video interaction technology plays a pivotal role in government departments and other industries. The visual networking adopts the world's most advanced VisionVera real-time high-definition video switching technology, realizing the real-time transmission of high-definition video across the entire network, which is currently impossible to achieve on the Internet.

[0003] In the process of point-to-point calls between the visual networking terminal and the Internet terminal, the related art can allow the protocol conversion server to identify the signaling sent by the visual networking terminal for controlling the rotation of the camera of the Internet terminal, and then convert it into the control signaling of the Internet protocol to remotely control the rotation of the camera. However, the related art cannot realize the control of the camera in the visual networking on the Internet. Summary of the invention

[0004] In view of the above problems, the present application provides a device control method, apparatus, electronic device and storage medium, which realize the control of the camera of a visual networking terminal on the Internet.

[0005] In a first aspect, the present application provides a device control method, which is applied to an Internet terminal, and the method includes:

[0006] Receive remote control signals sent by the remote control;

[0007] Determining the source type of the remote control signal and the signal content corresponding to the remote control signal;

[0008] Encapsulating the signal content according to a protocol matching the source type to obtain a first device control signaling;

[0009] The first device control signaling is sent to the visual networking terminal through the visual networking protocol conversion server, so that the visual networking terminal adjusts the angle of the camera according to the first device control signaling.

[0010] A second aspect of the present application provides another device control method, which is applied to a visual network protocol conversion server, and the method includes:

[0011] receiving a first device control signaling sent by an Internet terminal, wherein the first device control signaling is generated by the Internet terminal according to a remote control signal sent by a remote controller, wherein the first device control signaling generated according to the remote control signal from different types of buttons corresponds to different protocol types;

[0012] Determining a protocol type of control signaling of the first device;

[0013] Processing the first device control signaling according to a conversion strategy matching the protocol type to obtain a second device control signaling;

[0014] The second device control signaling is sent to the visual networking terminal, so that the visual networking terminal adjusts the angle of the camera according to the second device control signaling.

[0015] A third aspect of the present application provides a device control apparatus, applied to an Internet terminal, the device comprising:

[0016] A first receiving module, used for receiving a remote control signal sent by a remote controller;

[0017] A first determination module, used to determine the source type of the remote control signal and the signal content corresponding to the remote control signal;

[0018] An encapsulation module, used to encapsulate the signal content according to a protocol matching the source type to obtain a first device control signaling;

[0019] The first sending module is used to send the first device control signaling to the visual networking terminal through the visual networking protocol conversion server, so that the visual networking terminal adjusts the angle of the camera according to the first device control signaling.

[0020] A fourth aspect of the present application provides another device control device, which is applied to a visual network protocol conversion server, and the device includes:

[0021] a second receiving module, configured to receive a first device control signaling sent by an Internet terminal, wherein the first device control signaling is generated by the Internet terminal according to a remote control signal sent by a remote controller, wherein the first device control signaling generated according to remote control signals from different types of buttons corresponds to different protocol types;

[0022] A second determination module, configured to determine a protocol type of the control signaling of the first device;

[0023] A processing module, configured to process the first device control signaling according to a conversion strategy matching the protocol type to obtain a second device control signaling;

[0024] The second sending module is used to send the second device control signaling to the visual networking terminal, so that the visual networking terminal adjusts the angle of the camera according to the second device control signaling.

[0025] The fifth aspect of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executed, implements the steps of the device control method described in the first aspect or the second aspect of the present application.

[0026] The sixth aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps in the device control method as described in the first aspect or the second aspect of the present application.

[0027] Through the device control method of the present application, the Internet terminal first receives the remote control signal sent by the remote control, then determines the source type of the remote control signal and the signal content corresponding to the remote control signal, then encapsulates the signal content according to the protocol matching the source type, obtains the first device control signaling, and finally sends the first device control signaling to the visual network terminal through the visual network protocol conversion server, so that the visual network terminal adjusts the angle of the camera according to the first device control signaling. Through this method, the user can control the camera of the visual network terminal through the remote control of the Internet terminal, which solves the problem that the camera of the visual network terminal cannot be controlled on the Internet in the related technology. Secondly, for the remote control signals of various source types generated by the user on the remote control, the Internet terminal can convert them into the first device control signaling to realize the operation of the camera of the visual network terminal, which further improves the flexibility of controlling the camera of the visual network terminal on the Internet. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the technical solution of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application are briefly introduced below.

[0029] Figure 1 It is a schematic diagram of an implementation environment shown in an embodiment of the present application;

[0030] Figure 2 is a flow chart of a device control method shown in an embodiment of the present application;

[0031] Figure 3 It is a schematic diagram of a communication structure of the H.224 protocol shown in an embodiment of the present application;

[0032] Figure 4 is a flow chart of another device control method shown in an embodiment of the present application;

[0033] Figure 5 It is an overall schematic diagram of a device control shown in an embodiment of the present application;

[0034] Figure 6 It is another overall schematic diagram of device control shown in one embodiment of the present application; Figure 7is a structural block diagram of a device control device shown in an embodiment of the present application;

[0035] Figure 8 is a structural block diagram of another device control device shown in an embodiment of the present application;

[0036] Fig. 9 This is a schematic diagram of a visual network shown in an embodiment of the present application;

[0037] Fig.10 It is a schematic diagram of the hardware structure of a node server shown in an embodiment of the present application;

[0038] Fig.11 It is a schematic diagram of the hardware structure of an access switch shown in an embodiment of the present application;

[0039] Fig.12 It is a schematic diagram of the hardware structure of an Ethernet protocol conversion gateway shown in an embodiment of the present application. DETAILED DESCRIPTION

[0040] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0041] Figure 1 This is a schematic diagram of an implementation environment shown in an embodiment of the present application. Figure 1 In the process, the visual network protocol conversion server is connected to the Internet terminal based on the Internet protocol communication, and is connected to the visual network terminal based on the visual network protocol communication. The Internet terminal is equipped with a remote control, and the visual network terminal is equipped with a camera.

[0042] The device control method provided in this application is applied to Figure 1 Internet terminal in. Figure 2 1 is a flow chart of a device control method shown in an embodiment of the present application. Figure 2 The device control method of the present application may specifically include the following steps:

[0043] Step S21: receiving a remote control signal sent by a remote controller.

[0044] In this embodiment, the user can operate each button on the remote control. After the user presses a button, the control circuit of the remote control first detects the pressed button, then encodes the electrical signal generated after the button is pressed, obtains a coded sequence signal corresponding to the button, amplifies and modulates the coded sequence signal, and then sends it to the light emitting diode, which finally converts it into an infrared signal to radiate outward.

[0045] Step S22: Determine the source type of the remote control signal and the signal content corresponding to the remote control signal.

[0046] In this embodiment, after the signal receiver of the Internet terminal receives the infrared signal (i.e., the remote control signal), it performs demodulation and decoding processing to obtain an electrical signal (i.e., the signal content), and transmits it to the processor of the Internet terminal. The processor determines the source type of the remote control signal based on the electrical signal. Different buttons on the remote control generate different electrical signals when they are pressed.

[0047] Among them, the source type of the remote control signal refers to the type of button that triggers the remote control signal. The buttons of the remote control can be divided into multiple types in advance, such as direction keys, number keys, channel keys, volume keys, etc. This embodiment does not impose specific restrictions on this.

[0048] Step S23: encapsulate the signal content according to a protocol matching the source type to obtain the first device control signaling.

[0049] In this embodiment, different source types correspond to different Internet protocols. A source type-Internet protocol comparison table is pre-stored in the Internet terminal. After determining the source type of the remote control signal, the corresponding protocol is obtained by querying the source type-protocol comparison table, and then the signal content is encapsulated using the protocol to obtain the first device control signaling of the Internet protocol.

[0050] Step S24: Send the first device control signaling to the visual networking terminal through the visual networking protocol conversion server, so that the visual networking terminal adjusts the angle of the camera according to the first device control signaling.

[0051] In this embodiment, the Internet terminal can send the encapsulated first device control signaling to the visual network protocol conversion server, and then the visual network protocol conversion server converts the first device control signaling of the Internet protocol into the first device control signaling of the visual network protocol and sends it to the visual network terminal. After parsing the first device control signaling, the visual network terminal obtains the signal content corresponding to the remote control signal, and then adjusts the angle of the camera according to the signal content. Among them, the adjustment operation of the camera may include: up, down, left, and right adjustment.

[0052] For example, if the user presses the "up" direction key on the remote control, the visual networking terminal will parse and obtain the signal content corresponding to the "up" direction key and control the camera to rotate upward by a preset angle. For another example, if the user presses the "down" direction key on the remote control, the visual networking terminal will parse and obtain the signal content corresponding to the "down" direction key and control the camera to rotate downward by a preset angle.

[0053] Through the device control method of this embodiment, the Internet terminal first receives the remote control signal sent by the remote control, then determines the source type of the remote control signal and the signal content corresponding to the remote control signal, then encapsulates the signal content according to the protocol matching the source type, obtains the first device control signaling, and finally sends the first device control signaling to the visual network terminal through the visual network protocol conversion server, so that the visual network terminal adjusts the angle of the camera according to the first device control signaling. Through this method, the user can control the camera of the visual network terminal through the remote control of the Internet terminal, which solves the problem that the camera of the visual network terminal cannot be controlled on the Internet in the related technology. Secondly, for the remote control signals of various source types generated by the user on the remote control, the Internet terminal can convert them into the first device control signaling to realize the operation of the camera of the visual network terminal, which further improves the flexibility of controlling the camera of the visual network terminal on the Internet.

[0054] In combination with the above embodiments, in one implementation, the source type of the remote control signal may include: direction keys and numeric keys. On this basis, encapsulating the signal content according to a protocol matching the source type to obtain the first device control signaling may include:

[0055] When the source type is a direction key, the signal content is encapsulated as a first type of device control signaling based on the H224 protocol.

[0056] When the source type is a digital key, the signal content is encapsulated as a first-class device control signaling based on the RTP event protocol.

[0057] In this embodiment, the user is supported to operate the direction keys and number keys on the remote control to realize the control of the camera of the video networking terminal. When the user operates the direction keys, the signal content is encapsulated using the H224 protocol, and when the user operates the number keys, the signal content is encapsulated using the RTP event protocol.

[0058] Among them, the H224 protocol uses the H.221LSD (low-speed data) / HSD (high-speed data) channel, or the H.243 broadcast capability of the H221 MLP (an H.221 channel that runs H.224 and / or T.120 series protocols) data channel. Data is transmitted in the form of Q.922UI frames, which are assigned a fixed DLCI (data link connection identifier). Figure 3 The location of the data link protocol in the H.221 communication structure is shown in FIG. Figure 3 This is a schematic diagram of a communication structure of the H.224 protocol shown in an embodiment of the present application. The H.224 protocol mainly has the following characteristics:

[0059] The data link protocol is encapsulated in a Q.922UI frame using a reserved DLCI address.

[0060] The identification code of the H.243 MCU / terminal or the user ID of the MCS is included in each H.224 packet header.

[0061] There is a Customer Management Entity (CME) which sends a complete list of registered data customers, along with the additional capabilities that each of them supports.

[0062] A broadcast value of the terminal identification code that can address the entire conference.

[0063] The RTP event protocol is a standard specified by the Internet Engineering Task Force (IETF) for transmitting DTMF digits and other telephone tones and signals. The content of the RTP event protocol is shown in Table 1 below:

[0064] 0-7 8 9 10-15 16-31 event E R volume duration

[0065] Table 1

[0066] In Table 1, event represents the event number, which is 8 bits in total and is used to describe the event of this data packet.

[0067] E represents the end bit, which is 1 bit in total. If it is set to 1, it indicates that the data packet contains the end of the event.

[0068] R stands for reserved. If the sender sets it to 0, the receiver can ignore it.

[0069] Volume indicates the volume, a total of 6 bits, used to describe the audio power level of the dual-tone multi-frequency signal.

[0070] Duration represents the width of the digital signal, a total of 16 bits, expressed in timestamp units, so that the event starts from the moment represented by the RTP timestamp and continues to the length represented by this parameter.

[0071] The event may include multiple types as shown in Table 2 below:

[0072] event Encoding(decimal) 0-9 0--9 * 10 # 11 AD 12-15 Flash 16

[0073] Table 2

[0074] Dual-tone multi-frequency refers to the synthesis of two sine waves of high-frequency and low-frequency sounds to represent the digital keys 0 to 9, *, #, AD, and Flash. Table 2 shows 5 event types. For a detailed explanation of Table 2, please refer to the meaning of dual-tone multi-frequency in the related art. This embodiment will not be repeated here.

[0075] In this embodiment, the Internet terminal supports users to control the camera of the visual networking terminal through the direction buttons of the remote control, and also supports users to control the camera of the visual networking terminal through the numeric buttons of the remote control, thereby improving the flexibility of users to control the camera in the visual networking terminal on the Internet.

[0076] In combination with the above embodiments, in one implementation, when the Internet terminal supports users to control the camera of the visual networking terminal through the digital buttons of the remote control, the visual networking protocol conversion server needs to have the ability to recognize user input. Therefore, when the source type is a digital button, the signal content is encapsulated as the first type of device control signaling based on the RTP event protocol, which may include:

[0077] When the source type is a digital key and it is determined that the visual network protocol conversion server has the ability to recognize user input, the signal content is encapsulated as the first type of device control signaling based on the RTP event protocol.

[0078] In this embodiment, the Internet terminal can detect whether the visual network protocol conversion server has the ability to identify user input before encapsulating the first type of device control signaling, and if it has the ability to identify user input, it can encapsulate the signal content into the first type of device control signaling based on the RTP event protocol. There are many ways to detect whether the visual network protocol conversion server has the ability to identify user input, and this embodiment does not specifically limit this.

[0079] In combination with the above embodiments, in one implementation, the present application also provides a method for detecting whether a visual network protocol conversion server has the ability to recognize user input. Specifically, determining whether a visual network protocol conversion server has the ability to recognize user input may include:

[0080] Sending a user input capability query signaling to a video networking protocol conversion server;

[0081] According to the message returned by the visual network protocol conversion server in response to the user input capability query signaling, it is determined that the visual network protocol conversion server has the ability to recognize user input.

[0082] In this implementation, the Internet terminal can actively send a user input capability query signaling to the visual network protocol conversion server, and then receive a message returned by the visual network protocol conversion server in response to the user input capability query signaling. If the message indicates that the visual network protocol conversion server has the ability to identify user input, the Internet terminal will then encapsulate the signal content into a first-class device control signaling based on the RTP event protocol. If the message indicates that the visual network protocol conversion server does not have the ability to identify user input, the Internet terminal will not process the signal content.

[0083] This embodiment provides a method for detecting whether a visual networking protocol conversion server has the ability to recognize user input, so that the Internet terminal can encapsulate the signal content as a first-class device control signaling when the visual networking protocol conversion server has the ability to recognize user input, thereby realizing the control of the angle of the camera in the visual networking terminal through the digital buttons of the remote control on the Internet.

[0084] In combination with the above embodiments, in one implementation, the present application further provides a method for determining the signal content corresponding to the remote control signal. Specifically, determining the signal content corresponding to the remote control signal may include:

[0085] When the source type is a direction key, the remote control signal is received and decoded by the signal receiver, and the decoded electrical signal is determined as the corresponding signal content.

[0086] When the source type is a digital key, the remote control signal is received and decoded by the signal receiver to obtain a decoded electrical signal, which is converted into a dual-tone multi-frequency digital signal, and the dual-tone multi-frequency digital signal is determined as the corresponding signal content.

[0087] In this embodiment, if the user presses a direction button on the remote control, the signal receiver decodes the remote control signal after receiving the remote control signal, and determines the decoded electrical signal as the corresponding signal content.

[0088] If the user presses a number button on the remote control, the signal receiver decodes the remote control signal after receiving it to obtain a decoded electrical signal, and then converts the decoded electrical signal into a dual-tone multi-frequency digital signal (dual-tone multi-frequency is a technology for achieving fast and reliable transmission of telephone numbers. It has strong anti-interference ability and high transmission speed. It can be widely used in telephone communication systems and can also be widely used in data communication systems to achieve remote transmission of various data streams, voice and other information), and then determines the dual-tone multi-frequency digital signal as the corresponding signal content.

[0089] This embodiment provides a method for determining the signal content corresponding to the remote control signal, so that the Internet terminal can encapsulate the signal content into a first device control signal after determining the signal content corresponding to the remote control signal, thereby realizing control of the camera of the visual networking terminal.

[0090] The present application also provides another device control method, which is applied to Figure 1 The visual network protocol conversion server in . Figure 4 is a flow chart of another device control method shown in an embodiment of the present application. Figure 4 , another device control method of the present application may include:

[0091] Step S41: receiving a first device control signaling sent by an Internet terminal, wherein the first device control signaling is generated by the Internet terminal according to a remote control signal sent by a remote controller, wherein the first device control signaling generated according to remote control signals from different types of buttons corresponds to different protocol types.

[0092] Among them, the generation process of the first device control signaling can refer to the previous embodiment, and this embodiment will not be repeated here.

[0093] Step S42: Determine the protocol type of the first device control signaling.

[0094] In this embodiment, after receiving the first device control signaling sent by the Internet terminal, the visual network protocol conversion server can determine the protocol type of the first device control signaling, that is, determine which Internet protocol the first device control signaling uses.

[0095] Step S43: Process the first device control signaling according to the conversion strategy matching the protocol type to obtain the second device control signaling.

[0096] In this embodiment, different Internet protocols correspond to different conversion strategies. An Internet protocol-conversion strategy comparison table can be pre-set in the visual network protocol conversion server. After obtaining the first device control signaling, the visual network protocol conversion server can query the Internet protocol-conversion strategy comparison table to obtain a matching conversion strategy, and then use the conversion strategy to convert the first device control signaling of the Internet protocol into the second device control signaling of the visual network protocol.

[0097] Step S44: Send the second device control signaling to the visual networking terminal, so that the visual networking terminal adjusts the angle of the camera according to the second device control signaling.

[0098] In a specific implementation, the visual networking protocol conversion server can send the converted second device control signaling to the visual networking terminal, so that the visual networking terminal adjusts the angle of the camera according to the second device control signaling. The visual networking protocol conversion server can send the converted second device control signaling to the visual networking terminal through the visual networking server.

[0099] Through the device control method of this embodiment, the visual network protocol conversion server receives the first device control signaling sent by the Internet terminal, and the first device control signaling is generated by the Internet terminal according to the remote control signal sent by the remote control, wherein the first device control signaling generated according to the remote control signal from different types of buttons corresponds to different protocol types; then the protocol type of the first device control signaling is determined; the first device control signaling is processed according to the conversion strategy matching the protocol type to obtain the second device control signaling; finally, the second device control signaling is sent to the visual network terminal, so that the visual network terminal adjusts the angle of the camera according to the second device control signaling. Through this method, the user can control the camera of the visual network terminal through the remote control of the Internet terminal, which solves the problem that the camera of the visual network terminal cannot be controlled on the Internet in the related technology. Secondly, for the remote control signals of various sources generated by the user on the remote control, the Internet terminal can convert them into the first device control signaling to realize the operation of the camera of the visual network terminal, which further improves the flexibility of controlling the camera of the visual network terminal on the Internet.

[0100] In combination with the above embodiments, in one implementation, the protocol types include H224 protocol and RTP event protocol; the H224 protocol is used to encapsulate the signal content corresponding to the remote control signal from the direction keys, and the RTP event protocol is used to encapsulate the signal content corresponding to the remote control signal from the digital keys.

[0101] On this basis, processing the first device control signaling according to a conversion strategy matching the protocol type to obtain the second device control signaling may include:

[0102] When the protocol type is the H224 protocol, the first device control signaling is parsed based on the H224 protocol to obtain the signal content, and the signal content is encapsulated according to the visual networking protocol to obtain the second device control signaling.

[0103] When the protocol type is the RTP event protocol, the first device control signaling is parsed based on the RTP event protocol to obtain the signal content, and the signal content is encapsulated according to the visual networking protocol to obtain the second device control signaling.

[0104] In this embodiment, when the protocol type is the H224 protocol, the conversion strategy is: parse the first device control signaling based on the H224 protocol to obtain the signal content; then encapsulate the signal content according to the visual networking protocol to obtain the second device control signaling.

[0105] In this embodiment, when the protocol type is the RTP event protocol, the conversion strategy is: parse the first device control signaling based on the RTP event protocol to obtain the signal content; then encapsulate the signal content according to the visual networking protocol to obtain the second device control signaling.

[0106] In this embodiment, the visual networking protocol conversion server realizes the conversion of the device control signaling of the Internet protocol into the device control signaling of the visual networking protocol, thereby realizing the control of the camera of the visual networking terminal in the visual networking on the Internet. Secondly, the visual networking protocol conversion server can support the conversion of device control signaling of the H224 protocol type and the RTP event protocol type, further improving the flexibility of controlling the camera of the visual networking terminal in the visual networking on the Internet.

[0107] The device control method of the present application will be described in detail below with a specific embodiment. Figure 5 It is an overall schematic diagram of device control shown in an embodiment of the present application.

[0108] exist Figure 5 In the protocol conversion, the Internet terminal adopts the H323 terminal, and the visual network protocol conversion server adopts the XMCU protocol conversion server. At least the H323 protocol conversion module, the RTP protocol analysis module and the visual network module are deployed in the XMCU protocol conversion server. Among them, the H323 terminal refers to the terminal that supports the H323 protocol. The H323 protocol is a general term for a protocol cluster, including: H224 protocol, H225 protocol, H245 protocol, etc. The XMCU protocol conversion server is responsible for functions such as communication, streaming media protocol conversion, and audio and video data packet encapsulation. The H323 protocol conversion module can be used for the conversion between various sub-protocols under the H323 protocol and the visual network protocol. The RTP protocol analysis module can be used for the conversion between the RTP_EVENT protocol (RTP event protocol) and the visual network protocol. The RTP_EVENT protocol is an extended protocol of the RTP protocol.

[0109] When the user needs to control the camera of the video networking terminal through the direction buttons of the remote control, the following steps can be performed in sequence:

[0110] Step 1: Use the H323 terminal in the Internet to call the video network terminal.

[0111] Step 2: After successfully calling the video network terminal, press the zoom button on the remote control of the H323 terminal to switch to remote control mode.

[0112] Step 3: The user operates the direction button on the remote control of the H323 terminal for controlling the camera to rotate upward, and the remote control sends an infrared signal to the H323 terminal according to the user's operation.

[0113] Step 4: The H323 terminal generates the control signaling of the H224 protocol according to the infrared signal sent by the remote control, and sends the control signaling of the H224 protocol to the XMCU coordination server.

[0114] Step 5: After the XMCU coordination server receives the control signaling of the H224 protocol, it parses the electrical signal through the H323 protocol conversion module and transmits it to the visual networking module. The visual networking module uses the electrical signal obtained by encapsulating the visual networking protocol to obtain the control signaling of the visual networking protocol.

[0115] Step 6: The XMCU coordination server sends the control signaling of the visual networking protocol to the visual networking server.

[0116] Step 7: The visual networking server forwards the control signaling of the visual networking protocol to the visual networking terminal.

[0117] Step 8: After the visual networking terminal obtains the control signaling of the visual networking protocol, it parses the signaling content and controls the camera to rotate upward to a preset angle according to the signaling content (the preset angle can be set in advance by the visual networking terminal).

[0118] When the user needs to control the camera of the video networking terminal through the digital buttons of the remote control, the following steps can be performed in sequence:

[0119] Step 1': Use the H323 terminal in the Internet to call the video network terminal.

[0120] Step 2': After successfully calling the video network terminal, press the zoom button on the remote control of the H323 terminal to switch to remote control mode.

[0121] Step 3': Query whether the XMCU coordination server has the ability to recognize user input, if yes, proceed to step 4'.

[0122] Step 4': The user presses button 2 on the numeric keypad of the remote control (button 2 corresponds to the "up" direction button, button 4 corresponds to the "down" direction button, button 6 corresponds to the "left" direction button, and button 8 corresponds to the "right" direction button), and the remote control sends an infrared signal to the H323 terminal according to the user's operation.

[0123] Step 5': The H323 terminal generates RTP_EVENT protocol data packets containing dual-tone multi-frequency signals according to the infrared signal sent by the remote control, and sends these data packets to the XMCU coordination server.

[0124] Step 6': After receiving the RTP_EVENT protocol data packet, the XMCU coordination server parses the data packet through the RTP protocol analysis module and obtains the dual-tone multi-frequency signal, and transmits it to the visual networking module. The visual networking module uses the dual-tone multi-frequency signal obtained by the visual networking protocol encapsulation to obtain the control signaling of the visual networking protocol.

[0125] Step 7': The XMCU coordination server sends the control signaling of the visual networking protocol to the visual networking server.

[0126] Step 8': The visual networking server forwards the control signaling of the visual networking protocol to the visual networking terminal.

[0127] Step 9': After the visual networking terminal obtains the control signaling of the visual networking protocol, it parses the signaling content and controls the camera to rotate upward to a preset angle according to the signaling content.

[0128] This embodiment can use the H323 protocol conversion module of the XMCU coordination server to convert the control signaling of the H224 protocol sent from the Internet H323 terminal into the control signaling of the video networking protocol, and control the corresponding rotation of the camera of the video networking terminal; it can also use the RTP protocol analysis module of the XMCU protocol conversion server to convert the data packet containing the dual-tone multi-frequency signal sent from the Internet H323 terminal into the control signaling of the video networking protocol, and control the corresponding rotation of the camera of the video networking terminal, thereby enabling users to operate the angle of the camera of the video networking terminal through direction buttons or number buttons on the Internet, thereby optimizing the user's video networking operation experience.

[0129] The device control method of the present application will be described in detail below with reference to another specific embodiment. Figure 6 It is another overall schematic diagram of device control shown in an embodiment of the present application.

[0130] exist Figure 6 In the system, the Internet terminal uses Te30 terminal, the visual network protocol conversion server uses XMCU protocol conversion server, and the visual network terminal uses Jiguang terminal. The XMCU protocol conversion server is internally equipped with H323chan protocol conversion module, RTPchan module, and vmschan visual network module. Among them, Te30 terminal refers to the terminal that supports H323 protocol.

[0131] When the user needs to control the camera of the video networking terminal through the direction buttons of the remote control, the following steps can be performed in sequence:

[0132] Step 1: Use the Te30 terminal in the Internet to call the Aurora terminal in the visual network.

[0133] Step 2: After successfully calling the Aurora terminal, press the zoom button on the remote control of the Te30 terminal to switch to remote control mode.

[0134] Step 3: The user operates the direction button on the remote control of the Te30 terminal to control the camera to rotate upward. The remote control sends an infrared signal to the Aurora terminal according to the user's operation.

[0135] Step 4: The Aurora terminal generates the control signal h224_mvup of the H224 protocol according to the infrared signal sent by the remote control, and sends the h224_mvup signal of the H224 protocol to the XMCU coordination server.

[0136] Step 5: After the XMCU coordination server receives the h224_mvup signaling of the H224 protocol, it parses the electrical signal through the H323chan coordination module, uses the electrical signal to construct the inter-module communication message camera.up, and transmits it to the vmschan visual networking module. The vmschan visual networking module uses the visual networking protocol to encapsulate the obtained signaling content and obtains the control signaling 8e01up of the visual networking protocol.

[0137] Step 6: The XMCU coordination server sends the control signaling 8e01up of the visual networking protocol to the visual networking server.

[0138] Step 7: The visual networking server converts the visual networking protocol control signaling 8e01up into 8e02up and forwards 8e02up to the Aurora terminal.

[0139] Step 8: After the Aurora terminal obtains the control signaling 8e02up of the visual networking protocol, it parses the signaling content and controls the camera to rotate upward to a preset angle according to the signaling content.

[0140] Step 9: After the Jiguang terminal controls the camera adjustment, it sends the visual network signaling of 8e01_upAck to the visual network server, indicating that the camera adjustment is completed. The visual network server converts 8e01_upAck into 8e02_upAck and then forwards it to the XMCU coordination server. After receiving 8e02_upAck, the MCU coordination server constructs the inter-module communication message camera.upAck and sends it to the H323chan coordination module. The H323chan coordination module replies the h224_mvupAck signaling to the Te30 terminal in the message processing function.

[0141] When the user needs to control the camera of the video networking terminal through the digital buttons of the remote control, the following steps can be performed in sequence:

[0142] Step 1': Use the Te30 terminal in the Internet to call the Aurora terminal in the visual network.

[0143] Step 2': During the call, the Te30 terminal sends H245_UserInputCapability signaling to the XMCU coordination server to query whether the XMCU coordination server has the ability to recognize user input. The XMCU coordination server replies to the Te30 terminal with H245_UserInputCapabilityAck signaling, indicating that it has the ability to recognize user input.

[0144] Step 3': After successfully calling the Jiguang terminal, press the zoom button on the remote control of the Te30 terminal to switch to remote control mode.

[0145] Step 4': The user presses button 2 on the numeric keypad of the remote control (button 2 corresponds to the "up" direction button, button 4 corresponds to the "down" direction button, button 6 corresponds to the "left" direction button, and button 8 corresponds to the "right" direction button). The remote control sends an infrared signal to the Te30 terminal according to the user's operation.

[0146] Step 5': Te30 terminal generates RTP_EVENT protocol data packets containing dual-tone multi-frequency signals according to the infrared signal sent by the remote control, and sends these data packets to the XMCU coordination server.

[0147] Step 6': After receiving the data packet of the RTP_EVENT protocol, the XMCU coordination server parses the data packet through the RTPchan module and obtains the dual-tone multi-frequency signal, constructs the inter-module communication message chan.rtp and sends it to the vmschan visual networking module. The vmschan visual networking module uses the visual networking protocol to encapsulate the obtained signaling content and obtains the control signaling 8e01up of the visual networking protocol.

[0148] Step 7': The XMCU coordination server sends the control signaling 8e01up of the visual networking protocol to the visual networking server.

[0149] Step 8': The visual networking server converts the control signaling 8e01up of the visual networking protocol into 8e02up and forwards 8e02up to the Aurora terminal.

[0150] Step 9': After the Aurora terminal obtains the control signaling 8e02up of the visual networking protocol, it parses the signaling content and controls the camera to rotate upward to a preset angle according to the signaling content.

[0151] Step 10': After the Aurora terminal controls the camera adjustment, it sends the visual network signaling 8e01_upAck to the visual network server, indicating that the camera adjustment is completed. The visual network server converts 8e01_upAck into 8e02_upAck and then forwards it to the XMCU coordination server.

[0152] Through the device control method of the present application, the user can control the camera of the visual networking terminal through the remote control of the Internet terminal, which solves the problem that the camera of the visual networking terminal cannot be controlled on the Internet in the related technology. Secondly, for the remote control signals of various sources generated by the user on the remote control, the Internet terminal can convert them into the first device control signaling to realize the operation of the camera of the visual networking terminal, which further improves the flexibility of controlling the camera of the visual networking terminal on the Internet.

[0153] Based on the same inventive concept, the present application provides a device control apparatus 700, which is applied to an Internet terminal. Figure 7 1 is a structural block diagram of a device control device shown in an embodiment of the present application. Figure 7 , the device 700 of the present application may include:

[0154] The first receiving module 701 is used to receive a remote control signal sent by a remote controller;

[0155] A first determination module 702, configured to determine a source type of the remote control signal and a signal content corresponding to the remote control signal;

[0156] An encapsulation module 703 is used to encapsulate the signal content according to a protocol matching the source type to obtain a first device control signaling;

[0157] The first sending module 704 is used to send the first device control signaling to the visual networking terminal through the visual networking protocol conversion server, so that the visual networking terminal adjusts the angle of the camera according to the first device control signaling.

[0158] Optionally, the source types of the remote control signal include: direction keys and number keys;

[0159] The encapsulation module 703 includes:

[0160] A first encapsulation submodule, used for encapsulating the signal content into a first type of device control signaling based on the H224 protocol when the source type is a direction key;

[0161] The second encapsulation submodule is used to encapsulate the signal content into the first type of device control signaling based on the RTP event protocol when the source type is a digital key.

[0162] Optionally, the second encapsulation submodule includes:

[0163] The third encapsulation submodule is used to encapsulate the signal content into the first type of device control signaling based on the RTP event protocol when the source type is a digital key and it is determined that the visual network protocol conversion server has the ability to recognize user input.

[0164] Optionally, the first determining module 702 includes:

[0165] A sending submodule, used for sending a user input capability query signaling to the visual network protocol conversion server;

[0166] The first determination submodule is used to determine whether the visual network protocol conversion server has the ability to recognize user input based on the message returned by the visual network protocol conversion server in response to the user input capability query signaling.

[0167] Optionally, the first determining module 702 includes:

[0168] A second determination submodule is used to receive and decode the remote control signal through a signal receiver when the source type is a direction key, and determine the decoded electrical signal as the corresponding signal content;

[0169] The third determination submodule is used to receive and decode the remote control signal through a signal receiver when the source type is a digital key, obtain a decoded electrical signal, convert the decoded electrical signal into a dual-tone multi-frequency digital signal, and determine the dual-tone multi-frequency digital signal as the corresponding signal content.

[0170] Based on the same inventive concept, the present application provides another device control apparatus 800, which is applied to a visual network protocol conversion server. Figure 8 1 is a structural block diagram of another device control device according to an embodiment of the present application. Figure 8 , the device 800 of the present application may include:

[0171] The second receiving module 801 is used to receive a first device control signaling sent by an Internet terminal, where the first device control signaling is generated by the Internet terminal according to a remote control signal sent by a remote controller, wherein the first device control signaling generated according to the remote control signal from different types of buttons corresponds to different protocol types;

[0172] A second determination module 802, configured to determine a protocol type of the control signaling of the first device;

[0173] A processing module 803 is used to process the first device control signaling according to a conversion strategy matching the protocol type to obtain a second device control signaling;

[0174] The second sending module 804 is used to send the second device control signaling to the visual networking terminal, so that the visual networking terminal adjusts the angle of the camera according to the second device control signaling.

[0175] Optionally, the protocol type includes an H224 protocol and an RTP event protocol; the H224 protocol is used to encapsulate signal content corresponding to a remote control signal from a direction key, and the RTP event protocol is used to encapsulate signal content corresponding to a remote control signal from a numeric key;

[0176] The processing module 803 includes:

[0177] A first parsing submodule is used for parsing the first device control signaling based on the H224 protocol to obtain signal content when the protocol type is the H224 protocol, and encapsulating the signal content according to the visual networking protocol to obtain the second device control signaling;

[0178] The second parsing submodule is used to parse the first device control signaling based on the RTP event protocol to obtain signal content when the protocol type is the RTP event protocol, encapsulate the signal content according to the visual networking protocol, and obtain the second device control signaling.

[0179] Based on the same inventive concept, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, which, when executed by the processor, implements the steps in the device control method described in any of the above embodiments of the present application.

[0180] Based on the same inventive concept, the present application provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps in the device control method described in any of the above embodiments of the present application are implemented.

[0181] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0182] The visual Internet is an important milestone in the development of the Internet. It is a real-time network that can realize real-time transmission of high-definition video and push many Internet applications towards high-definition video and high-definition face-to-face communication.

[0183] The visual network adopts real-time high-definition video exchange technology. It can integrate the required services such as high-definition video conferencing, video monitoring, intelligent monitoring analysis, emergency command, digital radio and television, delayed TV, online teaching, live broadcast, VOD on demand, TV mail, personalized recording (PVR), intranet (self-operated) channels, intelligent video broadcast control, information release and dozens of other video, voice, picture, text, communication, data and other services on a single system platform, and realize high-definition quality video playback through TV or computer.

[0184] In order to enable those skilled in the art to better understand the embodiments of the present invention, the visual network is introduced as follows:

[0185] Some of the technologies used in the visual Internet of Things are as follows:

[0186] Network Technology

[0187] The network technology innovation of visual networking improves the traditional Ethernet to cope with the huge potential video traffic on the network. Different from simple network packet switching or network circuit switching, visual networking technology uses packet switching to meet streaming needs. Visual networking technology has the flexibility, simplicity and low price of packet switching, and the quality and security guarantee of circuit switching, realizing the seamless connection of the whole network switching virtual circuit and data format.

[0188] Switching Technology

[0189] Visual networking uses the two advantages of Ethernet: asynchronism and packet switching. It eliminates Ethernet defects under the premise of full compatibility, and has seamless end-to-end connection across the entire network, directly connects to user terminals, and directly carries IP data packets. User data does not require any format conversion within the entire network. Visual networking is a more advanced form of Ethernet and a real-time switching platform that can achieve large-scale real-time transmission of high-definition video across the entire network, which is currently unattainable on the Internet, and pushes many network video applications towards high definition and unification.

[0190] Server Technology

[0191] The server technology on the visual network and unified video platform is different from the traditional server. Its streaming media transmission is based on connection-oriented. Its data processing capability is independent of traffic and communication time. A single network layer can include signaling and data transmission. For voice and video services, the complexity of streaming media processing on the visual network and unified video platform is much simpler than data processing, and its efficiency is more than 100 times higher than that of traditional servers.

[0192] Storage Technology

[0193] The ultra-high-speed storage technology of the unified video platform adopts the most advanced real-time operating system to adapt to the media content with ultra-large capacity and ultra-large flow, mapping the program information in the server command to the specific hard disk space. The media content no longer passes through the server, but is directly delivered to the user terminal in an instant. The user generally waits for less than 0.2 seconds. The optimized sector distribution greatly reduces the mechanical movement of the hard disk head seeking, and the resource consumption accounts for only 20% of the same level of IP Internet, but it generates 3 times more concurrent traffic than the traditional hard disk array, and the overall efficiency is improved by more than 10 times.

[0194] Network Security Technology

[0195] The structural design of the visual network completely eradicates the network security issues that plague the Internet through separate licensing for each service and complete isolation of equipment and user data. Generally, anti-virus programs and firewalls are not required, and attacks by hackers and viruses are eliminated, providing users with a structurally worry-free and secure network.

[0196] Service Innovation Technology

[0197] The unified video platform integrates services and transmission. Whether it is a single user, a private network user or a network, it is just an automatic connection. User terminals, set-top boxes or PCs are directly connected to the unified video platform to obtain rich and colorful multimedia video services in various forms. The unified video platform uses a "recipe-style" table configuration mode to replace traditional complex application programming. Complex applications can be implemented with very little code, realizing "unlimited" new business innovation.

[0198] The networking of the visual network is as follows:

[0199] Visual networking is a centrally controlled network structure. The network can be a tree network, star network, ring network, etc., but on this basis, there needs to be a centralized control node in the network to control the entire network.

[0200] Fig. 9 FIG. 1 is a schematic diagram of a visual network shown in an embodiment of the present application. Fig. 9 As shown in the figure, the visual network is divided into two parts: access network and metropolitan area network.

[0201] The equipment in the access network can be divided into three categories: node server, access switch, and terminal (including various set-top boxes, encoding boards, storage, etc.). The node server is connected to the access switch, and the access switch can be connected to multiple terminals and can be connected to Ethernet.

[0202] The node server is a node in the access network that performs centralized control functions and can control access switches and terminals. The node server can be directly connected to the access switch or directly connected to the terminal.

[0203] Similarly, the devices in the metropolitan area network can also be divided into three categories: metropolitan area servers, node switches, and node servers. The metropolitan area servers are connected to the node switches, and the node switches can be connected to multiple node servers.

[0204] The node server is a node server of the access network part, that is, the node server belongs to both the access network part and the metropolitan area network part.

[0205] The metropolitan area server is a node with centralized control function in the metropolitan area network, which can control the node switch and node server. The metropolitan area server can be directly connected to the node switch or the node server.

[0206] It can be seen from this that the entire visual network is a hierarchical and centrally controlled network structure, and the network controlled by the node server and the metropolitan area server can be various structures such as tree, star, and ring.

[0207] Figuratively speaking, the access network part can form a unified video platform (the part in the dotted circle), and multiple unified video platforms can form a visual network; each unified video platform can be interconnected through the metropolitan area and wide area visual networks.

[0208] Visual networking equipment classification

[0209] 1.1 The devices in the visual network of the embodiment of the present invention can be mainly divided into three categories: servers, switches (including Ethernet gateways), terminals (including various set-top boxes, encoding boards, storage devices, etc.). The visual network as a whole can be divided into a metropolitan area network (or a national network, a global network, etc.) and an access network.

[0210] 1.2 The equipment in the access network can be mainly divided into three categories: node server, access switch (including Ethernet gateway), terminal (including various set-top boxes, encoding boards, storage, etc.).

[0211] The specific hardware structure of each access network device is as follows:

[0212] Node server:

[0213] Fig.10 FIG. 1 is a schematic diagram of the hardware structure of a node server shown in an embodiment of the present application. Fig.10 As shown, it mainly includes a network interface module 1001, a switching engine module 1002, a CPU module 1003, and a disk array module 1004;

[0214] Among them, the packets coming from the network interface module 1001, the CPU module 1003, and the disk array module 1004 all enter the switching engine module 1002; the switching engine module 1002 performs an operation of checking the address table 1005 on the incoming packets, thereby obtaining the packet's guidance information; and according to the packet's guidance information, the packet is stored in the queue of the corresponding packet buffer 1006; if the queue of the packet buffer 1006 is close to full, it is discarded; the switching engine module 1002 polls all packet buffer queues, and forwards if the following conditions are met: 1) the port sending buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 1004 mainly implements the control of the hard disk, including the initialization, reading and writing of the hard disk; the CPU module 1003 is mainly responsible for the protocol processing between the access switch and the terminal (not shown in the figure), the configuration of the address table 1005 (including the downstream protocol packet address table, the upstream protocol packet address table, and the data packet address table), and the configuration of the disk array module 1004.

[0215] Access switch:

[0216] Fig.11 FIG. 1 is a schematic diagram of the hardware structure of an access switch shown in an embodiment of the present application. Fig.11 As shown, it mainly includes a network interface module (a downlink network interface module 1101, an uplink network interface module 1102), a switching engine module 1103 and a CPU module 1104;

[0217] Among them, the packet (uplink data) coming from the downlink network interface module 1101 enters the packet detection module 1105; the packet detection module 1105 detects whether the destination address (DA), source address (SA), data packet type and packet length of the packet meet the requirements. If they meet the requirements, the corresponding stream identifier (stream-id) is allocated and enters the switching engine module 1103, otherwise it is discarded; the packet (downlink data) coming from the uplink network interface module 1102 enters the switching engine module 1103; the data packet coming from the CPU module 1104 enters the switching engine module 1103; the switching engine module 1103 processes the incoming The packet performs an operation of looking up the address table 1106 to obtain the packet's guidance information; if the packet entering the switching engine module 1103 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 1107 in combination with the stream identifier (stream-id); if the queue of the packet buffer 1107 is nearly full, it is discarded; if the packet entering the switching engine module 1103 is not from the downstream network interface to the upstream network interface, then according to the packet's guidance information, the data packet is stored in the queue of the corresponding packet buffer 1107; if the queue of the packet buffer 1107 is nearly full, it is discarded.

[0218] The switching engine module 1103 polls all packet buffer queues. In the embodiment of the present invention, there are two situations:

[0219] If the queue is from the downlink network interface to the uplink network interface, it is forwarded if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero; 3) a token generated by the bit rate control module is obtained;

[0220] If the queue is not going from the downstream network interface to the upstream network interface, it is forwarded if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

[0221] The code rate control module 1108 is configured by the CPU module 1104 to generate tokens for all packet buffer queues from the downstream network interface to the upstream network interface within a programmable interval to control the code rate of the upstream forwarding.

[0222] The CPU module 1104 is mainly responsible for protocol processing with the node server, configuration of the address table 1106 , and configuration of the bit rate control module 1108 .

[0223] Ethernet protocol conversion gateway :

[0224] Fig.12 FIG. 1 is a schematic diagram of the hardware structure of an Ethernet protocol conversion gateway shown in an embodiment of the present application. Fig.12As shown, it mainly includes a network interface module (a downlink network interface module 1201, an uplink network interface module 1202), a switching engine module 1203, a CPU module 1204, a packet detection module 1205, a bit rate control module 1208, an address table 1206, a packet buffer 1207, a MAC adding module 1209, and a MAC deleting module 1210.

[0225] The data packet from the downlink network interface module 1201 enters the packet detection module 1205; the packet detection module 1205 detects whether the Ethernet MAC DA, Ethernet MAC SA, Ethernet length or frame type, visual network destination address DA, visual network source address SA, visual network data packet type and packet length of the data packet meet the requirements, and if they meet the requirements, the corresponding stream identifier (stream-id) is assigned; then, the MAC deletion module 1210 subtracts the MAC DA, MAC SA, length or frame type (2 bytes) and enters the corresponding receiving buffer, otherwise it is discarded;

[0226] The downstream network interface module 1201 detects the sending buffer of the port. If there is a packet, it obtains the Ethernet MAC DA of the corresponding terminal based on the visual network destination address DA of the packet, adds the Ethernet MAC DA of the terminal, the MACSA of the Ethernet protocol conversion gateway, and the Ethernet length or frame type, and sends it.

[0227] The functions of other modules in the Ethernet protocol conversion gateway are similar to those of the access switch.

[0228] terminal:

[0229] It mainly includes network interface module, business processing module and CPU module; for example, the set-top box mainly includes network interface module, audio and video encoding and decoding engine module, CPU module; the encoding board mainly includes network interface module, audio and video encoding engine module, CPU module; the memory mainly includes network interface module, CPU module and disk array module.

[0230] 1.3 The equipment in the metropolitan area network can be divided into two categories: node server, node switch, and metropolitan area server. Among them, the node switch mainly includes network interface module, switching engine module and CPU module; the metropolitan area server mainly includes network interface module, switching engine module and CPU module.

[0231] 2. Definition of Visual Network Data Packet

[0232] 2.1 Access Network Data Packet Definition

[0233] The data packet of the access network mainly includes the following parts: destination address (DA), source address (SA), reserved bytes, payload (PDU), and CRC.

[0234] As shown in the following table, the data packet of the access network mainly includes the following parts:

[0235] DA SA Reserved Payload CRC

[0236] in:

[0237] The destination address (DA) consists of 8 bytes. The first byte indicates the type of data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), with a maximum of 256 possibilities. The second to sixth bytes are the metropolitan area network address, and the seventh and eighth bytes are the access network address.

[0238] The source address (SA) is also composed of 8 bytes and has the same definition as the destination address (DA).

[0239] The reserved bytes consist of 2 bytes;

[0240] The payload part has different lengths depending on the type of datagram. If it is a protocol packet, it is 64 bytes. If it is a single multicast data packet, it is 32+1024=1056 bytes. Of course, it is not limited to the above two types.

[0241] CRC consists of 4 bytes and its calculation method follows the standard Ethernet CRC algorithm.

[0242] 2.2 Definition of Metropolitan Area Network Data Packet

[0243] The topology of the metropolitan area network is a graph. There may be two or more connections between two devices, that is, there may be more than two connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metropolitan area network address of a metropolitan area network device is unique. In order to accurately describe the connection relationship between metropolitan area network devices, a parameter: a label is introduced in the embodiment of the present invention to uniquely describe a metropolitan area network device.

[0244] The definition of labels in this manual is similar to the definition of labels in MPLS (Multi-Protocol Label Switch). Assuming that there are two connections between device A and device B, there are two labels for the data packet from device A to device B, and there are two labels for the data packet from device B to device A. Labels are divided into input labels and output labels. Assuming that the label of the data packet entering device A (input label) is 0x0000, the label of the data packet when leaving device A (output label) may become 0x0001. The access process of the metropolitan area network is a centralized access process, which means that the address allocation and label allocation of the metropolitan area network are dominated by the metropolitan area server, and the node switch and node server are only passively executed. This is different from the label allocation of MPLS, which is the result of mutual negotiation between the switch and the server.

[0245] As shown in the following table, the data packets of the metropolitan area network mainly include the following parts:

[0246] DA SA Reserved Label Payload CRC

[0247] That is, destination address (DA), source address (SA), reserved byte (Reserved), label, payload (PDU), CRC. The label format can refer to the following definition: the label is 32 bits, of which the upper 16 bits are reserved and only the lower 16 bits are used. It is located between the reserved bytes and payload of the data packet.

[0248] Based on the above characteristics of the visual network, one of the core concepts of the embodiment of the present invention is proposed. Following the protocol of the visual network, the Internet terminal first receives the remote control signal sent by the remote control, then determines the source type of the remote control signal and the signal content corresponding to the remote control signal, then encapsulates the signal content according to the protocol matching the source type, obtains the first device control signaling, and finally sends the first device control signaling to the visual network terminal through the visual network protocol conversion server, so that the visual network terminal adjusts the angle of the camera according to the first device control signaling. Through this method, the user can control the camera of the visual network terminal through the remote control of the Internet terminal.

[0249] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0250] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0251] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0252] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0253] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0254] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0255] The above is a detailed introduction to a device control method, apparatus, electronic device and storage medium provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in the field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A device control method, characterized in that: Applied to an Internet terminal, the method comprises: Receive remote control signals sent by the remote control; Determining the source type of the remote control signal and the signal content corresponding to the remote control signal; Encapsulating the signal content according to a protocol matching the source type to obtain a first device control signaling; Sending the first device control signaling to the visual networking terminal through the visual networking protocol conversion server, so that the visual networking terminal adjusts the angle of the camera according to the first device control signaling; The source types of the remote control signal include: direction keys and number keys; Encapsulating the signal content according to a protocol matching the source type to obtain a first device control signaling includes: When the source type is a direction key, encapsulating the signal content as a first type of device control signaling based on the H224 protocol; When the source type is a digital key, encapsulating the signal content as a first type of device control signaling based on the RTP event protocol; Among them, the Internet terminal is an H323 terminal, the H323 terminal is a terminal that supports the H323 protocol, the visual networking protocol conversion server is an XMCU coordination server, and the XMCU coordination server includes: an H323 protocol conversion module, an RTP protocol analysis module and a visual networking module; the H323 protocol conversion module is used for the conversion of various sub-protocols under the H323 protocol and the visual networking protocol; the RTP protocol analysis module is used for the conversion of the RTP event protocol and the visual networking protocol.

2. The method according to claim 1, characterized in that When the source type is a digital key, the signal content is encapsulated as a first type of device control signaling based on the RTP event protocol, including: When the source type is a digital key and it is determined that the visual network protocol conversion server has the ability to recognize user input, the signal content is encapsulated as a first type of device control signaling based on the RTP event protocol.

3. The method according to claim 2, characterized in that Determining that the visual network protocol conversion server has the ability to recognize user input includes: Sending a user input capability query signaling to the visual networking protocol conversion server; It is determined that the visual network protocol conversion server has the ability to recognize user input based on the message returned by the visual network protocol conversion server in response to the user input capability query signaling.

4. The method according to claim 1, characterized in that: Determining the signal content corresponding to the remote control signal includes: When the source type is a direction key, the remote control signal is received and decoded by a signal receiver, and the decoded electrical signal is determined as the corresponding signal content; When the source type is a digital key, the remote control signal is received and decoded by a signal receiver to obtain a decoded electrical signal, the decoded electrical signal is converted into a dual-tone multi-frequency digital signal, and the dual-tone multi-frequency digital signal is determined as the corresponding signal content.

5. A device control method, characterized in that: Applied to a visual network protocol conversion server, the method comprises: receiving a first device control signaling sent by an Internet terminal, wherein the first device control signaling is generated by the Internet terminal according to a remote control signal sent by a remote controller, wherein the first device control signaling generated according to the remote control signal from different types of buttons corresponds to different protocol types; Determining a protocol type of control signaling of the first device; Processing the first device control signaling according to a conversion strategy matching the protocol type to obtain a second device control signaling; Sending the second device control signaling to the visual networking terminal, so that the visual networking terminal adjusts the angle of the camera according to the second device control signaling; The protocol types include H224 protocol and RTP event protocol; the H224 protocol is used to encapsulate the signal content corresponding to the remote control signal from the direction key, and the RTP event protocol is used to encapsulate the signal content corresponding to the remote control signal from the numeric key; Processing the first device control signaling according to a conversion strategy matching the protocol type to obtain a second device control signaling includes: When the protocol type is the H224 protocol, the first device control signaling is parsed based on the H224 protocol to obtain signal content, and the signal content is encapsulated according to the visual networking protocol to obtain the second device control signaling; When the protocol type is the RTP event protocol, parsing the first device control signaling based on the RTP event protocol to obtain signal content, encapsulating the signal content according to the visual networking protocol to obtain the second device control signaling; Among them, the Internet terminal is an H323 terminal, the H323 terminal is a terminal that supports the H323 protocol, the visual networking protocol conversion server is an XMCU coordination server, and the XMCU coordination server includes: an H323 protocol conversion module, an RTP protocol analysis module and a visual networking module; the H323 protocol conversion module is used for the conversion of various sub-protocols under the H323 protocol and the visual networking protocol; the RTP protocol analysis module is used for the conversion of the RTP event protocol and the visual networking protocol.

6. A device control device, characterized in that: Applied to an Internet terminal, the device comprises: A first receiving module, used for receiving a remote control signal sent by a remote controller; A first determination module, used to determine the source type of the remote control signal and the signal content corresponding to the remote control signal; An encapsulation module, used to encapsulate the signal content according to a protocol matching the source type to obtain a first device control signaling; A first sending module, used for sending the first device control signaling to the visual network terminal through the visual network protocol conversion server, so that the visual network terminal adjusts the angle of the camera according to the first device control signaling; The source types of the remote control signal include: direction keys and number keys; The packaging module comprises: A first encapsulation submodule, used for encapsulating the signal content into a first type of device control signaling based on the H224 protocol when the source type is a direction key; A second encapsulation submodule, configured to encapsulate the signal content into a first type of device control signaling based on an RTP event protocol when the source type is a digital key; Among them, the Internet terminal is an H323 terminal, the H323 terminal is a terminal that supports the H323 protocol, the visual networking protocol conversion server is an XMCU coordination server, and the XMCU coordination server includes: an H323 protocol conversion module, an RTP protocol analysis module and a visual networking module; the H323 protocol conversion module is used for the conversion of various sub-protocols under the H323 protocol and the visual networking protocol; the RTP protocol analysis module is used for the conversion of the RTP event protocol and the visual networking protocol.

7. A device control device, characterized in that: Applied to a visual network protocol conversion server, the device comprises: a second receiving module, configured to receive a first device control signaling sent by an Internet terminal, wherein the first device control signaling is generated by the Internet terminal according to a remote control signal sent by a remote controller, wherein the first device control signaling generated according to remote control signals from different types of buttons corresponds to different protocol types; A second determination module, configured to determine a protocol type of the control signaling of the first device; A processing module, configured to process the first device control signaling according to a conversion strategy matching the protocol type to obtain a second device control signaling; A second sending module, used to send the second device control signaling to the visual networking terminal, so that the visual networking terminal adjusts the angle of the camera according to the second device control signaling; The protocol types include H224 protocol and RTP event protocol; the H224 protocol is used to encapsulate the signal content corresponding to the remote control signal from the direction key, and the RTP event protocol is used to encapsulate the signal content corresponding to the remote control signal from the numeric key; The processing module comprises: A first parsing submodule is used for parsing the first device control signaling based on the H224 protocol to obtain signal content when the protocol type is the H224 protocol, and encapsulating the signal content according to the visual networking protocol to obtain the second device control signaling; A second parsing submodule is used for parsing the first device control signaling based on the RTP event protocol to obtain signal content when the protocol type is the RTP event protocol, encapsulating the signal content according to the visual networking protocol, and obtaining the second device control signaling; Among them, the Internet terminal is an H323 terminal, the H323 terminal is a terminal that supports the H323 protocol, the visual networking protocol conversion server is an XMCU coordination server, and the XMCU coordination server includes: an H323 protocol conversion module, an RTP protocol analysis module and a visual networking module; the H323 protocol conversion module is used for the conversion of various sub-protocols under the H323 protocol and the visual networking protocol; the RTP protocol analysis module is used for the conversion of the RTP event protocol and the visual networking protocol.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps in the device control method according to any one of claims 1 to 4 or claim 5 are implemented.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When executed, the processor implements the steps in the device control method according to any one of claims 1 to 4 or claim 5.

Images