Method and device for controlling NVR (Network Video Recorder) equipment, electronic equipment and storage medium

Abstract

The invention provides a method and device for controlling NVR equipment, electronic equipment and a storage medium, and relates to the technical field of computers, an interface operation instruction is determined according to a received text instruction and first operation interface information, and the interface operation instruction is sent to the NVR equipment through a control terminal, so that the NVR equipment executes the interface operation instruction. In this way, a user can input the text or voice corresponding to the service function into the control terminal, so that the NVR equipment is controlled in a cooperative interaction mode of the control terminal, the cloud server and the NVR equipment. Therefore, a user does not need to manually control the NVR equipment, and various service functions of the NVR equipment can be realized more conveniently and quickly.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, apparatus, electronic device, and storage medium for controlling an NVR device. Background Art

[0002] NVR (network video recorder) is a network video storage device whose core function is to record and store video signals from surveillance cameras through the network.

[0003] In the related art, manual input is usually used to control the NVR device to implement various service functions of the NVR device.

[0004] However, with the rapid development of technology, the business functions of NVR devices have become increasingly complex, and there are more and more operating interfaces. Controlling NVR devices by manual input is cumbersome and inefficient. Summary of the Invention

[0005] In order to solve the above-mentioned problems in the prior art, the embodiments of the present application provide a method, apparatus, electronic device and storage medium for controlling NVR devices, which are used to solve the problem that controlling NVR devices by manual input is cumbersome and inefficient.

[0006] In a first aspect, an embodiment of the present application provides a method for controlling an NVR device, which is applied to a cloud server, and the method includes:

[0007] Receiving a text instruction and first operation interface information sent by a control terminal, wherein the text instruction is a text instruction input by a user in the control terminal, or the text instruction is a text instruction generated after conversion of a voice instruction input by the user in the control terminal, and the first operation interface information is obtained by the control terminal from the NVR device;

[0008] Determine, according to the text instruction and the first operation interface information, an interface operation instruction, wherein the interface operation instruction is used to instruct the NVR device to complete the service function corresponding to the text instruction;

[0009] The interface operation instruction is sent to the NVR device through the control terminal, so that the NVR device executes the interface operation instruction.

[0010] In a possible implementation, determining the interface operation instruction according to the text instruction and the first operation interface information includes:

[0011] Parsing the text instruction to obtain keyword information;

[0012] Performing feature extraction on the keyword information and the first operation interface information respectively to obtain a keyword feature vector and an operation interface feature vector;

[0013] Performing feature fusion on the keyword feature vector and the operation interface feature vector to obtain a target feature vector;

[0014] According to the target feature vector and the pre-stored operation instructions corresponding to each feature vector, a target operation instruction corresponding to the target feature vector is determined, and the target operation instruction is used as the interface operation instruction.

[0015] In a possible implementation, the first operation interface information is an operation interface image of the NVR device and / or element information of the operation interface image.

[0016] In a possible implementation manner, after sending the interface operation instruction to the NVR device through the control terminal, the method further includes:

[0017] Sending a second operation interface information acquisition request to the control terminal;

[0018] receiving second operation interface information sent by the control terminal, where the second operation interface information is an operation interface image of the NVR device and / or element information of the operation interface image;

[0019] updating the reward value of the interface operation instruction according to the second operation interface information;

[0020] Determine whether the NVR device jumps to the target operation interface corresponding to the text instruction. If not, adjust the interface operation instruction according to the updated reward value to obtain a reference operation instruction, and repeat the step of updating the reward value based on the reference operation instruction; if so, determine that the current interface operation instruction is the interface operation instruction corresponding to the text instruction.

[0021] In a second aspect, an embodiment of the present application provides a method for controlling an NVR device, which is applied to a control terminal, and the method includes:

[0022] Receive text commands or voice commands input by the user and send NVR device control requests to the NVR device;

[0023] Receiving first operation interface information sent by the NVR device;

[0024] Sending a text instruction and the first operation interface information to a cloud server, so that the cloud server determines an interface operation instruction based on the text instruction and the first operation interface information, wherein the text instruction is a text instruction input by the user in the control terminal, or the text instruction is a text instruction generated after conversion of a voice instruction input by the user in the control terminal, and the interface operation instruction is used to instruct the NVR device to complete the service function corresponding to the text instruction;

[0025] Receive the interface operation instruction sent by the cloud server, and send the interface operation instruction to the NVR device, so that the NVR device executes the interface operation instruction.

[0026] In a third aspect, an embodiment of the present application provides a method for controlling an NVR device, which is applied to an NVR device, and the method includes:

[0027] Receiving an NVR device control request sent by a control terminal, wherein the NVR device control request is sent by the control terminal after receiving a text instruction or a voice instruction input by a user;

[0028] Acquire current first operation interface information, and send the first operation interface information to the control terminal;

[0029] Receiving an interface operation instruction sent by the control terminal, where the interface operation instruction is sent by the cloud server to the control terminal, the interface operation instruction is determined by the cloud server based on a text instruction and the first operation interface information, and the text instruction is a text instruction input by the user in the control terminal, or the text instruction is a text instruction generated after converting a voice instruction input by the user in the control terminal;

[0030] Execute the interface operation instruction.

[0031] In a fourth aspect, an embodiment of the present application provides an apparatus for controlling an NVR device, the apparatus comprising:

[0032] A first receiving unit is configured to receive a text instruction and first operation interface information sent by a control terminal, wherein the text instruction is a text instruction input by a user in the control terminal, or the text instruction is a text instruction generated after conversion of a voice instruction input by the user in the control terminal, and the first operation interface information is obtained by the control terminal from an NVR device;

[0033] a determining unit, configured to determine an interface operation instruction according to the text instruction and the first operation interface information, wherein the interface operation instruction is used to instruct the NVR device to complete a service function corresponding to the text instruction;

[0034] The first sending unit is configured to send the interface operation instruction to the NVR device through the control terminal, so that the NVR device executes the interface operation instruction.

[0035] In a fifth aspect, an embodiment of the present application provides an apparatus for controlling an NVR device, the apparatus comprising:

[0036] The second receiving unit is configured to receive a text instruction or a voice instruction input by a user; receive the first operation interface information sent by the NVR device; and receive the interface operation instruction sent by the cloud server;

[0037] The second sending unit is used to send an NVR device control request to the NVR device; send a text instruction and the first operation interface information to the cloud server, so that the cloud server determines the interface operation instruction based on the text instruction and the first operation interface information, the text instruction is a text instruction input by the user in the control terminal, or the text instruction is a text instruction generated after conversion of a voice instruction input by the user in the control terminal, and the interface operation instruction is used to instruct the NVR device to complete the business function corresponding to the text instruction; send the interface operation instruction to the NVR device, so that the NVR device executes the interface operation instruction.

[0038] In a sixth aspect, an embodiment of the present application provides an apparatus for controlling an NVR device, the apparatus comprising:

[0039] a third receiving unit, configured to receive an NVR device control request sent by a control terminal, the NVR device control request being sent by the control terminal after the control terminal receives a text instruction or a voice instruction input by a user; and receive an interface operation instruction sent by the control terminal, the interface operation instruction being sent by a cloud server to the control terminal, the interface operation instruction being determined by the cloud server based on the text instruction and the first operation interface information, the text instruction being a text instruction input by the user in the control terminal, or being a text instruction generated after converting a voice instruction input by the user in the control terminal;

[0040] An information acquisition unit, configured to acquire current first operation interface information;

[0041] A third sending unit, configured to send the first operation interface information to the control terminal;

[0042] An instruction execution unit is used to execute the interface operation instruction.

[0043] In the seventh aspect, an embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the computer program is executed by the processor, the method described in any one of the first aspect, the second aspect and the third aspect is implemented.

[0044] In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the method described in any one of the first aspect, the second aspect, and the third aspect is implemented.

[0045] The embodiments of the present application provide a method, apparatus, electronic device, and storage medium for controlling an NVR device. These methods determine interface operation instructions based on received text instructions and first operation interface information, and transmit the interface operation instructions to the NVR device via a control terminal, causing the NVR device to execute the interface operation instructions. This allows users to input text or voice input corresponding to service functions into the control terminal, thereby enabling collaborative interaction between the control terminal, cloud server, and NVR device to control the NVR device. This eliminates the need for manual user control of the NVR device, making it more convenient and efficient to implement various NVR device functions. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0047] Figure 1 An application scenario diagram of a method for controlling an NVR device provided in an embodiment of the present application;

[0048] Figure 2 A flowchart of a method for controlling an NVR device provided in an embodiment of the present application;

[0049] Figure 3 A flowchart of another method for controlling an NVR device provided in an embodiment of the present application;

[0050] Figure 4 A flowchart of another method for controlling an NVR device provided in an embodiment of the present application;

[0051] Figure 5 An interactive flow chart of a method for controlling an NVR device provided in an embodiment of the present application;

[0052] Figure 6A schematic diagram of the structure of an apparatus for controlling an NVR device provided in an embodiment of the present application;

[0053] Figure 7 A schematic diagram of the structure of another apparatus for controlling an NVR device provided in an embodiment of the present application;

[0054] Figure 8 A schematic diagram of the structure of another apparatus for controlling an NVR device provided in an embodiment of the present application;

[0055] Figure 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] To make the objectives, technical solutions, and advantages of this application more clear, this application will be further described in detail below with reference to the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of this application.

[0057] It should be noted that the terms "including" and "having" and their variations involved in the documents of this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or are inherent to these processes, methods, products or devices.

[0058] The following first briefly introduces the application scenarios to which the technical solutions of the embodiments of the present application can be applied. It should be noted that the application scenarios introduced below are only used to illustrate the embodiments of the present application and are not limiting. In specific implementation, the technical solutions provided by the embodiments of the present application can be flexibly applied according to actual needs.

[0059] Figure 1 Schematic diagram of an application scenario of a method for controlling an NVR device provided in an embodiment of the present application. Figure 1 As shown, the application scenario includes a control terminal 10, a cloud server 20, and an NVR device 30. The control terminal 10, the cloud server 20, and the NVR device 30 are connected via a communication network. The control terminal 10 can be a terminal device such as a smartphone, a tablet computer, or a smartwatch, and this application does not limit this.

[0060] like Figure 1As shown, the user can send an NVR device control request through the control terminal 10. After receiving the NVR device control request, the NVR device 30 can send the current first operation interface information to the control terminal 10. After receiving the first operation interface information of the NVR device 30, the control terminal 10 can send the first operation interface information and the text instruction input by the user (or, it can be a text instruction generated by converting the voice instruction input by the user into text) to the cloud server 20. After receiving the text instruction and the first operation interface information of the NVR device 30, the cloud server 20 can determine the interface operation instruction based on the text instruction and the first operation interface information of the NVR device 30. Then, the cloud server 20 can send the interface operation instruction to the NVR device 30 through the control terminal 10, so that the NVR device 30 executes the interface operation instruction after receiving the interface operation instruction.

[0061] To further illustrate the technical solutions provided by the embodiments of the present application, this is described in detail below with reference to the accompanying drawings and specific implementation methods. Although the embodiments of the present application provide the method operation steps as shown in the following embodiments or drawings, more or fewer operation steps may be included in the method based on routine or no creative labor. In the steps where there is no necessary causal relationship logically, the execution order of these steps is not limited to the execution order provided by the embodiments of the present application. The method may be executed or executed in parallel in the order of the methods shown in the embodiments or drawings during the actual processing process or when the device is executed.

[0062] Figure 2 The flowchart of a method for controlling an NVR device provided by an embodiment of the present application is shown, and the method can be completed by a cloud server. Figure 2 As shown, the method for controlling the NVR device may include the following steps:

[0063] Step S201: receiving a text instruction and first operation interface information sent by a control terminal.

[0064] The text instruction may be a text instruction input by the user in the control terminal. In another embodiment, the user may also input a voice instruction in the control terminal. After receiving the voice instruction, the control terminal may perform text conversion on the voice instruction to obtain a text instruction corresponding to the voice instruction.

[0065] After receiving the text or voice command input by the user, the control terminal can send an NVR device control request to the NVR device. Upon receiving the NVR device control request, the NVR device can take a screenshot of the current operation interface to obtain an operation interface image.

[0066] In an optional implementation, the NVR device may use the operation interface image as the first operation interface information, and send the first operation interface information to the control terminal.

[0067] In another optional embodiment, the NVR device takes a screenshot of the current operation interface. After obtaining the operation interface image, it can identify elements in the operation interface image to obtain element information of the operation interface image. The element information of the operation interface image can then be used as the first operation interface information and sent to the control terminal. The element information of the operation interface image can include the size, position, relative position relationship, color, etc. of the application icons in the operation interface image, which is not limited in this application.

[0068] In another optional embodiment, the NVR device takes a screenshot of the current operation interface to obtain an operation interface image. The NVR device can then identify elements on the operation interface image to obtain element information of the operation interface image. The operation interface image and the element information of the operation interface image can then be used as first operation interface information and sent to the control terminal.

[0069] After the control terminal receives the first operation interface information, it can send the text instruction and the first operation interface information together to the cloud server, so that the cloud server determines the interface operation instruction for implementing the business function corresponding to the text instruction based on the text instruction and the first operation interface information.

[0070] Step S202: Determine the interface operation instruction according to the text instruction and the first operation interface information.

[0071] Among them, the cloud server can use the AI ​​agent and the knowledge base of the AI ​​agent to determine the interface operation instructions used to instruct the NVR device to complete business functions.

[0072] It should be noted that the AI ​​agent in the cloud server can learn and record during the process of user interaction with the NVR device, use different operating instructions to try different interface operation processes, and thus vectorize and store each operating instruction and the feature vector corresponding to each operating instruction to form a knowledge base.

[0073] In a specific implementation, after receiving the text instruction and the first operation interface information, the text instruction can be parsed to obtain keyword information. For example, assuming that the received text instruction is "Please save the surveillance video to a USB flash drive", keyword information such as "video", "save", and "U disk" can be extracted. Then, feature extraction can be performed on the keyword information and the first operation interface information respectively to obtain a keyword feature vector and an operation interface feature vector. Furthermore, the keyword feature vector and the operation interface feature vector can be feature fused to obtain a target feature vector. Then, based on the target feature vector and the operation instructions corresponding to each feature vector pre-stored in the knowledge base, the target operation instruction corresponding to the target feature vector can be determined, and the target operation instruction can be used as the interface operation instruction.

[0074] Step S203: Sending an interface operation instruction to the NVR device via the control terminal, so that the NVR device executes the interface operation instruction.

[0075] After the cloud server determines the interface operation instruction, it can send the interface operation instruction to the control terminal. After receiving the interface operation instruction, the control terminal can send the interface operation instruction to the NVR device. After receiving the interface operation instruction, the NVR device can execute the interface operation instruction on the operation interface, thereby realizing the business function corresponding to the text instruction.

[0076] The method for controlling an NVR device provided in an embodiment of the present application can determine an interface operation instruction based on a received text instruction and first operation interface information, and transmit the interface operation instruction to the NVR device via a control terminal, causing the NVR device to execute the interface operation instruction. In this way, a user can input text or voice describing a service function into the control terminal, thereby achieving collaborative interaction between the control terminal, cloud server, and NVR device to control the NVR device. This eliminates the need for the user to manually control the local or web interface of the NVR device, reducing the user's learning curve and speed of adoption, and facilitating the promotion of various service functions in the NVR device.

[0077] In an optional embodiment, after the cloud server sends an interface operation instruction to the NVR device via the control terminal, it may send a request to the control terminal to obtain second operation interface information, which the control terminal then sends to the NVR device. The control terminal then obtains the second operation interface information sent by the NVR device. The second operation interface information may include an operation interface image of the NVR device and / or element information of the operation interface image. The reward value for the interface operation instruction may then be updated based on the second operation interface information.

[0078] In some embodiments, assuming that after performing a first operation on the current operation interface of the NVR device based on the interface operation instruction, the user successfully jumps to the first sub-operation interface corresponding to the text instruction, the reward value corresponding to the interface operation instruction can be increased. Then, after performing a second operation on the first sub-operation interface based on the interface operation instruction, the user successfully jumps to the second sub-operation interface corresponding to the text instruction, and the reward value of the interface operation instruction can be further increased. Then, after performing a third operation on the second sub-operation interface based on the interface operation instruction, if it is determined that the NVR device has not jumped to the target operation interface corresponding to the text instruction, the current reward value of the interface operation instruction can be maintained, thereby adjusting the interface operation instruction to obtain a reference operation instruction.

[0079] In this way, the continuously updated reward value can be used to influence the adjustment decision of the interface operation instruction through reinforcement learning. Therefore, the reference operation instruction obtained after adjusting the interface operation instruction can be used to continue to execute the operation corresponding to the reference operation instruction on each sub-operation interface except the target operation interface until jumping to the target operation interface corresponding to the text instruction. The reinforcement learning is stopped and it is determined that the reference operation instruction at this time is the interface operation instruction corresponding to the text instruction.

[0080] In other embodiments, assuming that after performing the first operation on the NVR device's operating interface based on the interface operation instruction, the user successfully jumps to the first sub-operation interface corresponding to the text instruction. In this case, the reward value corresponding to the interface operation instruction can be increased. Then, after performing the second operation on the first sub-operation interface corresponding to the text instruction based on the interface operation instruction, the user successfully jumps to the second sub-operation interface corresponding to the text instruction, and the reward value for the interface operation instruction can be further increased. Then, after performing the third operation on the second sub-operation interface based on the interface operation instruction, if it is determined that the NVR device jumps to the target operation interface corresponding to the text instruction, the current interface operation instruction can be directly determined to be the interface operation instruction corresponding to the text instruction.

[0081] In an optional embodiment, whether the NVR device jumps to the target operation interface corresponding to the text instruction can be determined by judging whether the current operation interface of the NVR device contains element information of the target operation interface.

[0082] In a specific implementation, if it is determined that the current operation interface of the NVR device includes element information of the target operation interface, it is determined that the NVR device has jumped to the target operation interface; otherwise, it is determined that the NVR device has not jumped to the target operation interface.

[0083] In another optional embodiment, whether the NVR device jumps to the target operation interface corresponding to the text instruction can be determined by judging whether the similarity between the current operation interface of the NVR device and the target operation interface is higher than a set threshold.

[0084] In a specific implementation, the pixel information of the current operation interface of the NVR device can be calculated, and then the pixel information of the current operation interface can be compared with the pixel information of the pre-stored target operation interface to obtain a comparison result. If the comparison result shows that the similarity between the current operation interface and the target operation interface is higher than a set threshold, it can be determined that the NVR device has jumped to the target operation interface; otherwise, it is considered that the NVR device has not jumped to the target operation interface.

[0085] Figure 3 The flowchart of a method for controlling an NVR device provided by an embodiment of the present application is shown, and the method can be completed by a control terminal. Figure 3 As shown, the method for controlling the NVR device may include the following steps:

[0086] Step S301: receiving a text instruction or voice instruction input by a user, and sending an NVR device control request to the NVR device.

[0087] After receiving the text command or voice command input by the user, the control terminal may send an NVR device control request to the NVR device.

[0088] Step S302: Receive first operation interface information sent by the NVR device.

[0089] When the NVR device receives the NVR device control request, it can take a screenshot of the current operation interface to obtain an operation interface image.

[0090] In an optional implementation, the NVR device may use the operation interface image as the first operation interface information, and send the first operation interface information to the control terminal.

[0091] In another optional embodiment, the NVR device takes a screenshot of the current operation interface to obtain an operation interface image, and then identifies elements on the operation interface image to obtain element information of the operation interface image. The element information of the operation interface image can then be used as the first operation interface information, and the first operation interface information can be sent to the control terminal.

[0092] In another optional embodiment, the NVR device takes a screenshot of the current operation interface to obtain an operation interface image. The NVR device can then identify elements on the operation interface image to obtain element information of the operation interface image. The operation interface image and the element information of the operation interface image can then be used as first operation interface information and sent to the control terminal.

[0093] Thus, the control terminal can obtain the first operation interface information sent by the NVR device.

[0094] Step S303: Send the text instruction and the first operation interface information to the cloud server.

[0095] In an optional embodiment, if the control terminal determines that the user input is a text instruction, the control terminal may directly send the text instruction and the first operation interface information to the cloud server. In another optional embodiment, if the control terminal determines that the user input is a voice instruction, the control terminal may convert the voice instruction into text, obtain the converted text instruction, and then send the text instruction and the first operation interface information to the cloud server.

[0096] After receiving the text instruction and the first operation interface information, the cloud server can use the AI ​​agent and the knowledge base of the AI ​​agent to determine the interface operation instruction used to instruct the NVR device to complete the business function.

[0097] Step S304: Receive the interface operation instruction sent by the cloud server, and send the interface operation instruction to the NVR device.

[0098] After the cloud server determines the interface operation instruction, it can send it to the control terminal. After receiving the interface operation instruction, the control terminal can send it to the NVR device. After receiving the interface operation instruction, the NVR device can execute the interface operation instruction on the operation interface, thereby realizing the service function corresponding to the text instruction.

[0099] Step S305: Receive a request for obtaining second operation interface information sent by the cloud server.

[0100] After the cloud server sends an interface operation instruction to the NVR device via the control terminal, it can send a request to the control terminal to obtain the second operation interface information. After receiving the request, the control terminal can send the request to the NVR device. After receiving the request, the NVR device can take a screenshot of the current operation interface. After obtaining the operation interface image, it can identify the elements in the operation interface image to obtain element information of the operation interface image. The operation interface image and / or the element information of the operation interface image can then be used as the second operation interface information.

[0101] Step S306: Send the second operation interface information to the cloud server.

[0102] After the control terminal receives the second operation interface information sent by the NVR device, it can send the second operation interface information to the cloud server, so that the cloud server completes the step of determining the interface operation instructions by reinforcement learning according to the second operation interface information.

[0103] Figure 4The flowchart of a method for controlling an NVR device provided by an embodiment of the present application is shown. The method can be performed by the NVR device. Figure 4 As shown, the method for controlling the NVR device may include the following steps:

[0104] Step S401: Receive an NVR device control request sent by a control terminal.

[0105] After receiving the text command or voice command input by the user, the control terminal may send an NVR device control request to the NVR device.

[0106] Step S402: Acquire current first operation interface information and send the first operation interface information to the control terminal.

[0107] After receiving the NVR device control request, the NVR device may take a screenshot of the current operation interface to obtain an operation interface image.

[0108] In an optional implementation, the NVR device may use the operation interface image as the first operation interface information, and send the first operation interface information to the control terminal.

[0109] In another optional embodiment, the NVR device takes a screenshot of the current operation interface to obtain an operation interface image, and then identifies elements on the operation interface image to obtain element information of the operation interface image. The element information of the operation interface image can then be used as the first operation interface information, and the first operation interface information can be sent to the control terminal.

[0110] In another optional embodiment, the NVR device takes a screenshot of the current operation interface to obtain an operation interface image. The NVR device can then identify elements on the operation interface image to obtain element information of the operation interface image. The operation interface image and the element information of the operation interface image can then be used as first operation interface information and sent to the control terminal.

[0111] Step S403: receiving the interface operation instruction sent by the control terminal.

[0112] After receiving the first operation interface information, the control terminal can send the text instruction and the first operation interface information together to the cloud server, so that the cloud server can determine the interface operation instruction for implementing the business function corresponding to the text instruction based on the text instruction and the first operation interface information. Furthermore, the cloud server can send the interface operation instruction to the NVR device via the control terminal.

[0113] Step S404: executing the interface operation instruction.

[0114] After receiving the interface operation instruction sent by the control terminal, the NVR device can execute the interface operation instruction on the operation interface, thereby realizing the business function corresponding to the text instruction.

[0115] Step S405: receiving a second operation interface information acquisition request sent by the control terminal, and sending the second operation interface information to the control terminal.

[0116] After the NVR device receives the second operation interface information acquisition request sent by the control terminal, it can take a screenshot of the current operation interface. After obtaining the operation interface image, it can identify the elements on the operation interface image to obtain the element information of the operation interface image. Then, the operation interface image and / or the element information of the operation interface image can be used as the second operation interface information, and the second operation interface information can be sent to the control terminal. In this way, after the control terminal receives the second operation interface information sent by the NVR device, it can send the second operation interface information to the cloud server, so that the cloud server completes the above step of determining the interface operation instructions through reinforcement learning based on the second operation interface information.

[0117] Figure 5 The interactive flow chart of a method for controlling an NVR device provided by an embodiment of the present application is shown. The method can be completed by collaborative interaction between a cloud server, a control terminal and an NVR device. Figure 5 As shown, the method for controlling the NVR device may include the following steps:

[0118] Step S501: The control terminal receives a text instruction or a voice instruction input by a user, and sends an NVR device control request to the NVR device.

[0119] Step S502: The NVR device receives the NVR device control request sent by the control terminal, and obtains current first operation interface information.

[0120] Step S503: The NVR device sends first operation interface information to the control terminal.

[0121] Step S504: The control terminal sends a text instruction and first operation interface information to the cloud server.

[0122] In step S505 , the cloud server determines the interface operation instruction according to the text instruction and the first operation interface information.

[0123] Step S506: The cloud server sends an interface operation instruction to the control terminal.

[0124] Step S507: The control terminal sends an interface operation instruction to the NVR device.

[0125] Step S508: The NVR device receives the interface operation instruction sent by the control terminal and executes the interface operation instruction.

[0126] In step S509, the cloud server sends a request for obtaining the second operation interface information to the control terminal.

[0127] Step S510: The control terminal sends a request for obtaining second operation interface information to the NVR device.

[0128] In step S511, the NVR device receives a second operation interface information acquisition request sent by the control terminal, and acquires current second operation interface information.

[0129] Step S512: The NVR device sends second operation interface information to the control terminal.

[0130] Step S513: The control terminal sends the second operation interface information to the cloud server.

[0131] In step S514, the cloud server determines the interface operation instruction corresponding to the text instruction based on the second operation interface information.

[0132] Based on the same inventive concept, an embodiment of the present invention further provides a structural diagram of an apparatus for controlling an NVR device, such as Figure 6 As shown, the device for controlling the NVR device includes:

[0133] The first receiving unit 601 is used to receive text instructions and first operation interface information sent by the control terminal. The text instructions are text instructions input by the user in the control terminal, or the text instructions are text instructions generated after conversion of voice instructions input by the user in the control terminal. The first operation interface information is obtained by the control terminal from the NVR device.

[0134] The determining unit 602 is configured to determine an interface operation instruction according to the text instruction and the first operation interface information, where the interface operation instruction is used to instruct the NVR device to complete the service function corresponding to the text instruction.

[0135] The first sending unit 603 is configured to send an interface operation instruction to the NVR device via the control terminal, so that the NVR device executes the interface operation instruction.

[0136] Based on the same inventive concept, the present invention also provides a structural diagram of another device for controlling NVR equipment, such as Figure 7 As shown, the device for controlling the NVR device includes:

[0137] The second receiving unit 701 is used to receive text instructions or voice instructions input by the user; receive first operation interface information sent by the NVR device; and receive interface operation instructions sent by the cloud server.

[0138] The second sending unit 702 is used to send an NVR device control request to the NVR device; send a text instruction and the first operation interface information to the cloud server, so that the cloud server determines the interface operation instruction based on the text instruction and the first operation interface information. The text instruction is a text instruction input by the user in the control terminal, or the text instruction is a text instruction generated after the voice instruction input by the user in the control terminal is converted. The interface operation instruction is used to instruct the NVR device to complete the business function corresponding to the text instruction; send the interface operation instruction to the NVR device, so that the NVR device executes the interface operation instruction.

[0139] Based on the same inventive concept, the present invention also provides a structural diagram of another device for controlling NVR equipment, such as Figure 8 As shown, the device for controlling the NVR device includes:

[0140] The third receiving unit 801 is used to receive an NVR device control request sent by the control terminal. The NVR device control request is sent by the control terminal after receiving a text instruction or voice instruction input by the user; receive an interface operation instruction sent by the control terminal. The interface operation instruction is sent by the cloud server to the control terminal. The interface operation instruction is determined by the cloud server based on the text instruction and the first operation interface information. The text instruction is a text instruction input by the user in the control terminal, or the text instruction is a text instruction generated after the voice instruction input by the user in the control terminal is converted.

[0141] The information acquisition unit 802 is used to acquire the current first operation interface information.

[0142] The third sending unit 803 is configured to send the first operation interface information to the control terminal.

[0143] The instruction execution unit 804 is used to execute the interface operation instruction.

[0144] Based on the same inventive concept, an embodiment of the present application further provides an electronic device comprising at least a memory for storing data and a processor. The processor for processing data can be implemented using a microprocessor, a CPU, a GPU (Graphics Processing Unit), a DSP, or an FPGA. The memory stores operating instructions, which can be computer-executable code, that implement the various steps in the process of the method for controlling an NVR device according to the embodiment of the present application.

[0145] Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 9 As shown, electronic device 900 includes memory 901, processor 902, data acquisition module 903 and bus 904. The memory 901, processor 902 and data acquisition module 903 are connected via bus 904, which is used to transmit data between the memory 901, processor 902 and data acquisition module 903.

[0146] Memory 901 can be used to store software programs and modules. Processor 902 executes the software programs and modules stored in memory 901 to execute various functional applications and data processing of electronic device 900, such as the method for controlling an NVR device provided in the embodiments of the present application. Memory 901 may primarily include a program storage area and a data storage area. The program storage area may store an operating system, at least one application program, and the like; the data storage area may store data generated based on the use of electronic device 900. Furthermore, memory 901 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0147] The processor 902 is the control center of the electronic device 900. It connects the various components of the entire electronic device 900 using the bus 904 and various interfaces and lines. It executes or runs software programs and / or modules stored in the memory 901 and calls data stored in the memory 901 to perform various functions of the electronic device 900 and process data. Optionally, the processor 902 may include one or more processing units, such as a CPU, a GPU (Graphics Processing Unit), a digital processing unit, etc.

[0148] An embodiment of the present application further provides a computer-readable storage medium, which stores computer-executable instructions. When the computer program is executed by a processor, it can be used to implement the method for controlling the NVR device described in any embodiment of the present application.

[0149] In some possible implementations, various aspects of the method for controlling an NVR device provided in the present application may also be implemented in the form of a program product, which includes program code. When the program product is run on a computer device, the program code is used to enable the computer device to execute the steps of the method for controlling an NVR device according to various exemplary embodiments of the present application described above in this specification. For example, the computer device may execute the following steps: Figure 2 The flowchart of the method for controlling the NVR device is shown.

[0150] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0151] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0152] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0153] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0154] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A method for controlling an NVR device, characterized in that: Applied to a cloud server, the method includes: Receiving a text instruction and first operation interface information sent by a control terminal, wherein the text instruction is a text instruction input by a user in the control terminal, or the text instruction is a text instruction generated after conversion of a voice instruction input by the user in the control terminal, and the first operation interface information is obtained by the control terminal from the NVR device; Determine, according to the text instruction and the first operation interface information, an interface operation instruction, wherein the interface operation instruction is used to instruct the NVR device to complete the service function corresponding to the text instruction; The interface operation instruction is sent to the NVR device through the control terminal, so that the NVR device executes the interface operation instruction.

2. The method according to claim 1, characterized in that The determining, according to the text instruction and the first operation interface information, an interface operation instruction includes: Parsing the text instruction to obtain keyword information; Performing feature extraction on the keyword information and the first operation interface information respectively to obtain a keyword feature vector and an operation interface feature vector; Performing feature fusion on the keyword feature vector and the operation interface feature vector to obtain a target feature vector; According to the target feature vector and the pre-stored operation instructions corresponding to each feature vector, a target operation instruction corresponding to the target feature vector is determined, and the target operation instruction is used as the interface operation instruction.

3. The method according to claim 1 or 2, characterized in that The first operation interface information is an operation interface image of the NVR device and / or element information of the operation interface image.

4. The method according to claim 1, wherein After the interface operation instruction is sent to the NVR device through the control terminal, the method further includes: Sending a second operation interface information acquisition request to the control terminal; receiving second operation interface information sent by the control terminal, where the second operation interface information is an operation interface image of the NVR device and / or element information of the operation interface image; updating the reward value of the interface operation instruction according to the second operation interface information; Determine whether the NVR device jumps to the target operation interface corresponding to the text instruction. If not, adjust the interface operation instruction according to the updated reward value to obtain a reference operation instruction, and repeat the step of updating the reward value based on the reference operation instruction; if so, determine that the current interface operation instruction is the interface operation instruction corresponding to the text instruction.

5. A method for controlling an NVR device, characterized in that: Applied to a control terminal, the method includes: Receive text commands or voice commands input by the user and send NVR device control requests to the NVR device; Receiving first operation interface information sent by the NVR device; Sending a text instruction and the first operation interface information to a cloud server, so that the cloud server determines an interface operation instruction based on the text instruction and the first operation interface information, wherein the text instruction is a text instruction input by the user in the control terminal, or the text instruction is a text instruction generated after conversion of a voice instruction input by the user in the control terminal, and the interface operation instruction is used to instruct the NVR device to complete the service function corresponding to the text instruction; Receive the interface operation instruction sent by the cloud server, and send the interface operation instruction to the NVR device, so that the NVR device executes the interface operation instruction.

6. A method for controlling an NVR device, characterized in that: Applied to an NVR device, the method includes: Receiving an NVR device control request sent by a control terminal, wherein the NVR device control request is sent by the control terminal after receiving a text instruction or a voice instruction input by a user; Acquire current first operation interface information, and send the first operation interface information to the control terminal; Receiving an interface operation instruction sent by the control terminal, where the interface operation instruction is sent by the cloud server to the control terminal, the interface operation instruction is determined by the cloud server based on a text instruction and the first operation interface information, and the text instruction is a text instruction input by the user in the control terminal, or the text instruction is a text instruction generated after converting a voice instruction input by the user in the control terminal; Execute the interface operation instruction.

7. A device for controlling an NVR device, characterized in that: The device comprises: A first receiving unit is configured to receive a text instruction and first operation interface information sent by a control terminal, wherein the text instruction is a text instruction input by a user in the control terminal, or the text instruction is a text instruction generated after conversion of a voice instruction input by the user in the control terminal, and the first operation interface information is obtained by the control terminal from an NVR device; a determining unit, configured to determine an interface operation instruction according to the text instruction and the first operation interface information, wherein the interface operation instruction is used to instruct the NVR device to complete a service function corresponding to the text instruction; The first sending unit is configured to send the interface operation instruction to the NVR device through the control terminal, so that the NVR device executes the interface operation instruction.

8. A device for controlling an NVR device, characterized in that: The device comprises: The second receiving unit is configured to receive a text instruction or a voice instruction input by a user; receive the first operation interface information sent by the NVR device; and receive the interface operation instruction sent by the cloud server; The second sending unit is used to send an NVR device control request to the NVR device; send a text instruction and the first operation interface information to the cloud server, so that the cloud server determines the interface operation instruction based on the text instruction and the first operation interface information, the text instruction is a text instruction input by the user in the control terminal, or the text instruction is a text instruction generated after conversion of a voice instruction input by the user in the control terminal, and the interface operation instruction is used to instruct the NVR device to complete the business function corresponding to the text instruction; send the interface operation instruction to the NVR device, so that the NVR device executes the interface operation instruction.

9. A device for controlling an NVR device, characterized in that: The device comprises: a third receiving unit, configured to receive an NVR device control request sent by a control terminal, the NVR device control request being sent by the control terminal after the control terminal receives a text instruction or a voice instruction input by a user; and receive an interface operation instruction sent by the control terminal, the interface operation instruction being sent by a cloud server to the control terminal, the interface operation instruction being determined by the cloud server based on the text instruction and the first operation interface information, the text instruction being a text instruction input by the user in the control terminal, or being a text instruction generated after converting a voice instruction input by the user in the control terminal; An information acquisition unit, configured to acquire current first operation interface information; A third sending unit, configured to send the first operation interface information to the control terminal; An instruction execution unit is used to execute the interface operation instruction.

10. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the computer program is executed by the processor, the method according to any one of claims 1 to 6 is implemented.

11. A computer-readable storage medium storing a computer program, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images