Device login method, device, equipment and medium

Abstract

The present application discloses a device login method, apparatus, device and medium, which are used to make the access, configuration and other operations of the target device more convenient. The device login method provided by the present application includes: when receiving a selection operation instruction of a target device that a user needs to log in through the added device list of the user interface of the local device, generating an access uniform resource locator URL of the target device based on the address information of the preset target device; wherein the added device list includes at least one target device that is pre-connected to the local device; sending a web page access request to the target device through the URL of the target device, and receiving the web page response content replied by the target device; after rendering the web page response content replied by the target device, outputting and displaying it through the preset browser area on the user interface of the local device for the user to log in to the target device.

Description

Technical Field

[0001] The present application relates to the field of browser technology, and in particular to a device login method, apparatus, device and medium. Background Art

[0002] In miniaturized monitoring systems, network video recorders (NVR) and IP cameras (IPC) are used, and most of them are aimed at end users. Therefore, high requirements are placed on the ease of use and convenience of equipment operation in miniaturized monitoring systems. Summary of the invention

[0003] The embodiments of the present application provide a device login method, apparatus, device and medium for logging into the web page of a target device through a preset browser area on the user interface of a local device, thereby making access to, configuration of, and other operations on the target device more convenient.

[0004] An embodiment of the present application provides a device login method, including:

[0005] When receiving a selection operation instruction of a target device to be logged in by the user through the list of added devices on the user interface of the local device, generating an access uniform resource locator URL of the target device based on the preset address information of the target device; wherein the list of added devices includes at least one target device that has been pre-connected to the local device;

[0006] Sending a web page access request to the target device via the URL of the target device, and receiving the web page response content replied by the target device;

[0007] After rendering is completed, the web page response content replied by the target device is output and displayed in a preset browser area on the user interface of the local device for the user to log in to the target device.

[0008] According to the device login method provided by the embodiment of the present application, when a selection operation indication of a target device that a user needs to log in is received through the list of added devices on the user interface of the local device, an access uniform resource locator URL of the target device is generated based on the pre-set address information of the target device; wherein the list of added devices includes at least one target device that has been pre-connected to the local device; thereby, the user can select the target device that needs to be logged in through the list of added devices on the user interface of the local device; further, a web page access request is sent to the target device through the URL of the target device, and the web page response content replied by the target device is received; and the web page response content replied by the target device is sent to the target device. After the rendering is completed, the output display is output through the preset browser area on the user interface of the local device for the user to log in to the target device, so that the user can log in to the web page of the target device in the preset browser area on the user interface of the local device, thereby making it more convenient for the user to access and configure the target device. For example, the user can access the front-end IPC function in the NVR without connecting to the development interface on the NVR or using additional computer operations. The front-end IPC web page can be directly logged in to the NVR local user interface to complete the configuration operation, and there is no destructive impact on the existing user interface business functions of the NVR itself, and there is no need to migrate historical business to the browser, which improves the convenience and economy of the entire system deployment.

[0009] In some embodiments, the method further comprises:

[0010] Receiving user operation instructions through a preset browser area on the user interface;

[0011] Based on the user operation instruction received through the preset browser area on the user interface, sending a request corresponding to the user operation instruction to the target device;

[0012] Receive the latest web page response content replied by the target device;

[0013] After rendering is completed, the latest web page response content replied by the target device is output and displayed in a preset browser area on the user interface of the local device.

[0014] In some embodiments, after rendering the latest web page response content replied by the target device, outputting and displaying it in a preset browser area on the user interface of the local device includes:

[0015] A main rendering process is established through a preset browser main process module to render the latest web page response content replied by the target device, wherein each time a complete frame of rendering data of the browser page is generated, a preset adaptation module is notified to obtain the rendering data of the frame of the browser page from the browser rendering buffer;

[0016] When the adaptation module obtains the rendering data of the frame browser page, the rendering data of the frame browser page is sent to a preset user interface module;

[0017] The user interface module writes the rendering data of the frame browser page into the display buffer based on the preset browser area on the user interface.

[0018] In some embodiments, the adaptation module includes a server module and a client module;

[0019] The notifying a preset adaptation module to obtain rendering data of the frame browser page from the browser rendering buffer includes:

[0020] Notify the server module of the adapter module to obtain rendering data of the frame browser page from the browser rendering buffer;

[0021] When the adaptation module obtains the rendering data of the frame browser page, the rendering data of the frame browser page is sent to a preset user interface module, including:

[0022] When the server module of the adapter module obtains the rendering data of the frame browser page, the server module of the adapter module sends the rendering data of the frame browser page to the client module of the adapter module through the shared memory;

[0023] When the client module of the adaptation module obtains the rendering data of the frame browser page, the client module of the adaptation module sends the rendering data of the frame browser page to a preset user interface module.

[0024] In some embodiments, before sending a web page access request to the target device through the URL of the target device, the method further includes:

[0025] Sending a temporary login token acquisition request to the target device;

[0026] Receive a token replied by the target device, wherein the token is a one-time valid token with a usage duration of a preset duration;

[0027] Use the token replied by the target device to log in to the target device through the http protocol;

[0028] Receive a login success notification replied by the target device.

[0029] An embodiment of the present application provides a device login apparatus, comprising:

[0030] A user interface module, configured to generate an access uniform resource locator URL of a target device based on pre-set address information of the target device when receiving a selection operation instruction of a target device to be logged in by a user on an added device list of a user interface of a local device; wherein the added device list includes at least one target device that is pre-connected to the local device;

[0031] The browser main process module is used to send a web page access request to the target device through the URL of the target device, and receive the web page response content replied by the target device; after rendering the web page response content replied by the target device, notify the user interface module to output and display it in the preset browser area on the user interface of the local device for the user to log in to the target device.

[0032] In some embodiments, the user interface module is further used to: receive a user operation instruction through a preset browser area on the user interface; based on the user operation instruction received through the preset browser area on the user interface, send a request corresponding to the user operation instruction to the target device;

[0033] The browser main process module is also used to: receive the latest web page response content replied by the target device; after rendering the latest web page response content replied by the target device, notify the user interface module to output and display it in the preset browser area on the user interface of the local device.

[0034] In some embodiments, the apparatus further comprises: an adaptation module;

[0035] The browser main process module renders the latest web page response content replied by the target device by establishing a main rendering process, wherein each time a complete frame of rendering data of the browser page is generated, the adaptation module is notified to obtain the rendering data of the frame of the browser page from the browser rendering buffer;

[0036] The adaptation module is used to send the rendering data of the frame browser page to the user interface module when the rendering data of the frame browser page is acquired;

[0037] The user interface module writes the rendering data of the frame browser page into the display buffer based on the preset browser area on the user interface.

[0038] In some embodiments, the adaptation module includes a server module and a client module;

[0039] The notifying the adaptation module to obtain rendering data of the frame browser page from the browser rendering buffer includes:

[0040] Notify the server module of the adapter module to obtain rendering data of the frame browser page from the browser rendering buffer;

[0041] The server module of the adapter module is used to send the rendering data of the frame browser page to the client module of the adapter module through the shared memory when the rendering data of the frame browser page is obtained;

[0042] The client module of the adaptation module is used for sending the rendering data of the frame browser page to a preset user interface module when the rendering data of the frame browser page is acquired.

[0043] Another embodiment of the present application provides an electronic device, which includes a memory and a processor, wherein the memory is used to store program instructions, and the processor is used to call the program instructions stored in the memory and execute any of the above methods according to the obtained program.

[0044] Another embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable the computer to execute any of the above methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0046] Figure 1 A schematic diagram of the overall process of a device login method provided in an embodiment of the present application;

[0047] Figure 2 A schematic diagram of a monitoring system architecture provided in an embodiment of the present application;

[0048] Figure 3 A schematic diagram of another monitoring system architecture provided in an embodiment of the present application;

[0049] Figure 4 A schematic diagram of a user interface provided in an embodiment of the present application;

[0050] Figure 5 A schematic diagram of a device login principle provided in an embodiment of the present application;

[0051] Figure 6 A schematic diagram of a specific process of starting a browser provided in an embodiment of the present application;

[0052] Figure 7 A schematic diagram of a specific process of web page rendering provided in an embodiment of the present application;

[0053] Figure 8 A schematic diagram of a specific process of logging into an IPC web page through an NVR without a password provided in an embodiment of the present application;

[0054] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0055] Fig.10 A schematic diagram of the structure of a device login device provided in an embodiment of the present application;

[0056] Fig.11 A schematic diagram of the structure of another device login device provided in an embodiment of the present application;

[0057] Fig.12 A schematic diagram of the structure of the third device login apparatus provided in an embodiment of the present application. DETAILED DESCRIPTION

[0058] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0059] The embodiments of the present application provide a device login method, apparatus, device and medium for logging into the web page of a target device through a preset browser area on the user interface of a local device, thereby making access to, configuration of, and other operations on the target device more convenient.

[0060] Among them, the method and the device, equipment, and medium are based on the same application concept. Since the principles of solving problems by the method and the device, equipment, and medium are similar, the implementation of the device, equipment, medium, and method can refer to each other, and the repeated parts will not be repeated.

[0061] The terms "first", "second", etc. (if any) in the specification and claims of the embodiments of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described herein can be implemented in a sequence other than the content illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0062] The following examples and embodiments are to be understood as illustrative examples only. Although this specification may refer to "one", "an" or "some" examples or embodiments in several places, this does not mean that each such reference relates to the same example or embodiment, nor does it mean that the feature applies only to a single example or embodiment. Individual features of different embodiments may also be combined to provide other embodiments. In addition, terms such as "including" and "comprising" should be understood as not limiting the described embodiments to consist only of those features that have been mentioned; such examples and embodiments may also include features, structures, units, modules, etc. that are not specifically mentioned.

[0063] The following is a detailed description of each embodiment of the present application in conjunction with the accompanying drawings. It should be noted that the display order of the embodiments of the present application only represents the order of the embodiments, and does not represent the advantages and disadvantages of the technical solutions provided by the embodiments.

[0064] See also Figure 1 , a device login method provided in an embodiment of the present application includes:

[0065] S101, when receiving a selection operation instruction of a target device to be logged in by a user through a list of added devices on a user interface of a local device, generating an access uniform resource locator (URL) of the target device based on pre-set address information of the target device; wherein the list of added devices includes at least one target device that is pre-connected to the local device;

[0066] In some embodiments, the local device may include, for example, an NVR, and may also include other types of devices;

[0067] In some embodiments, the target device may include, for example, an IPC or other device.

[0068] For example, the network diagram of a miniaturized monitoring system is as follows: Figure 2 As shown in the figure, when users need to deploy and adjust parameters of the front-end IP Camera, they can do so through the NVR's GUI (Graphical User Interface) and an additional computer login to the front-end web (browser) page. First, search and add the IPC through the NVR's user interface, and then log in to the front-end web to configure the parameters before they can use it normally. In addition, if the NVR's user interface needs to support some front-end IPC configuration functions, additional user interface function development is required, which is a large workload.

[0069] Therefore, the embodiment of the present application further provides an embedded browser solution based on the browser engine kernel (webKit), the NVR supports a local user interface, and is connected to a display through an external high-definition multimedia interface (HDMI) or video graphics array (VGA) interface to display the user interface. Through the browser embedded in the user interface, it is possible to directly jump to the web page of the front-end IPC, so that the user can perform corresponding configuration operations. In other words, the browser is integrated in the NVR with limited resources, see Figure 3 , users can log in directly through the browser to access the web page of the front-end IPC to configure the device, while other NVR functions and services still reuse the existing user interface. This can not only adapt to historical product functions, but also simplify the workload of connecting to the front-end IPC functions, effectively reducing the workload of NVR local user interface function development. All user operations can be completed on the NVR without the need for an additional computer, thereby improving the convenience of users using the monitoring system and the convenience of deploying the monitoring system.

[0070] S102, sending a web page access request to the target device through the URL of the target device, and receiving the web page response content replied by the target device;

[0071] S103: After rendering the web page response content replied by the target device, the web page response content is output and displayed in a preset browser area on the user interface of the local device so that the user can log in to the target device.

[0072] The user interface provided by the embodiment of the present application, for example Figure 4 As shown, the embedded browser can be integrated into the local user interface of the NVR, and the user's operations on the user interface of the NVR include, for example:

[0073] Step 1: Add IPC (i.e., target device) to NVR (i.e., local device), that is, establish a connection between NVR and at least one IPC, set the corresponding login user and password information, and then go online normally; wherein, the login user and password information can be set one by one for IPC, that is, different IPCs can correspond to different login user and password information.

[0074] Step 2: In the local user interface of the NVR, after the user clicks to enter the "Remote Configuration" interface, the available front-end IPC list (list of added devices) is displayed on the left, that is, the list of IPCs that have established a connection with the local NVR in advance;

[0075] Step 3: When the user clicks on an IPC, the embedded browser corresponding to the IPC is started, and the web page for logging into the IPC is jumped to realize the remote configuration operation of the IPC.

[0076] For example Figure 4 As shown, in the NVR local user interface, the user clicks on the IPC Camera 02, and then an embedded browser interface pops up in the local user interface, namely, the web operation page of Camera 02 (that is, the preset browser area on the user interface of the local device outputs and displays the web page of Camera 02), and the user can further perform operations related to the remote configuration of the IPC on the web operation page of Camera 02.

[0077] In some embodiments, Figure 5 As shown, cross-process interaction between the browser process and the application process can be provided to implement operation and response to the browser.

[0078] In some embodiments, the functional modules for implementing the browser process include:

[0079] Server-side modules and browser frameworks of the adapter modules;

[0080] In some embodiments, the browser frame includes:

[0081] General encapsulation framework library, browser main process module, browser network process module, etc.

[0082] In some embodiments, the functional modules for implementing the application process include:

[0083] The adaptation module includes the client module, user interface module, audio and video decoding module, etc.

[0084] Among them, the browser main process module is used to execute the browser core engine process, and is responsible for core functions such as browser startup, web page rendering, and mouse and keyboard message response.

[0085] The general encapsulation framework library is a general interface implementation library of WPE (web Platform for Embedded), which supports integration between browsers and different platforms by adapting the backend (i.e., adapting modules, including server modules and client modules).

[0086] The adaptation module is used to decouple the browser and platform correlation, and can perform self-adaptation according to the platform characteristics, so that the application can integrate the webkit (browser engine kernel) browser as needed.

[0087] like Figure 5 As shown, the adaptation module may include a server module for interacting with the browser side, and a client module for interacting with the application side. In an embedded platform, the user can set the specific functions of the adaptation module according to the platform characteristics, for example:

[0088] The server module of the adapter module is mainly used to adapt and implement the acquisition of browser rendering data, the processing mechanism for mouse, keyboard and other messages, etc. It mainly interacts with the core browser engine (i.e. the browser main process module) by calling the interface of the general encapsulation framework library provided by the WPEwebkit framework.

[0089] The client module of the adaptation module is mainly used to adapt the existing user interface module of the NVR. Through inter-process communication (communication between the browser process and the application process), it receives the rendering frame data of the server module of the adaptation module, and sends it to the audio and video decoding module for decoding and display after processing, as well as sending mouse, keyboard and other messages to the server module of the adaptation module for user operation control of the user interface.

[0090] In summary, the functions of the user interface implemented by the above modules as a whole include:

[0091] Log in to the target device through the user interface and start the browser of the target device, including browser initialization, etc.

[0092] Output the rendered frame data of the browser callback through the browser area on the user interface;

[0093] Mouse and keyboard messages of the user interface are sent;

[0094] Browser destroy exit etc on UI.

[0095] In some embodiments, the browser starts the process, on the NVR device side, see Figure 6 ,include:

[0096] S601, the user interface module initializes the display buffer of the user interface;

[0097] S602, the user interface module loads the URL interface call;

[0098] That is, when the user needs to open the web page of a certain IPC channel, double-click the corresponding channel in the "Added Device List". The user interface module assembles the access URL according to the channel IP address and port configured by the NVR device, and calls the URL loading interface of the browser main process module.

[0099] S603, the browser main process module replies that the call is successful to the user interface module;

[0100] S604, the browser main process module sends a web page access request to the web service module of the target IPC device end;

[0101] S605, the browser main process module receives the web page response content replied by the web service module of the target IPC device end;

[0102] S606, the browser main process module performs web page rendering based on the web page response content replied by the web service module of the target IPC device end;

[0103] S607: After the web page rendering is completed, the browser main process module notifies the user interface module to refresh the web page.

[0104] Specifically, after step S602, the main rendering process is started inside the browser main process module and screen rendering is prepared. At the same time, a web page access request is initiated to the front-end IPC through the browser network process module. After receiving the web page response content, the response content is sent to the main rendering process. After rendering is completed, it can be sent to the user interface module to refresh the browser screen display.

[0105] In some embodiments, the method further includes the following processing flow after the browser is successfully started:

[0106] Receiving a user's operation instruction (such as a configuration operation instruction for a target device, etc.) through a preset browser area on the user interface;

[0107] Based on the user operation instruction received through the preset browser area on the user interface, sending a request corresponding to the user operation instruction to the target device;

[0108] Receive the latest web page response content replied by the target device;

[0109] After rendering is completed, the latest web page response content replied by the target device is output and displayed in a preset browser area on the user interface of the local device.

[0110] In some embodiments, after rendering the latest web page response content replied by the target device, outputting and displaying it in a preset browser area on the user interface of the local device includes:

[0111] A main rendering process is established through a preset browser main process module to render the latest web page response content replied by the target device, wherein each time a complete frame of rendering data of the browser page is generated, a preset adaptation module is notified to obtain the rendering data of the frame of the browser page from the browser rendering buffer;

[0112] When the adaptation module obtains the rendering data of the frame browser page, the rendering data of the frame browser page is sent to a preset user interface module;

[0113] The user interface module writes the rendering data of the frame browser page into the display buffer based on the preset browser area on the user interface.

[0114] In some embodiments, the adaptation module includes a server module and a client module;

[0115] The notifying a preset adaptation module to obtain rendering data of the frame browser page from the browser rendering buffer includes:

[0116] Notify the server module of the adapter module to obtain rendering data of the frame browser page from the browser rendering buffer;

[0117] When the adaptation module obtains the rendering data of the frame browser page, the rendering data of the frame browser page is sent to a preset user interface module, including:

[0118] When the server module of the adapter module obtains the rendering data of the frame browser page, the server module of the adapter module sends the rendering data of the frame browser page to the client module of the adapter module through the shared memory;

[0119] When the client module of the adaptation module obtains the rendering data of the frame browser page, the client module of the adaptation module sends the rendering data of the frame browser page to a preset user interface module.

[0120] For example, in some embodiments, when the browser is started normally, a main rendering process will be started to generate rendering data for the page's screen content. When a frame of screen rendering is completed, the server module of the adapter module will be notified to obtain rendering data from the browser rendering buffer. After the server module of the adapter module obtains a frame of data, it will send it to the client module of the adapter module through shared memory. The client module of the adapter module will then send it to the user interface module. The user interface module will write the frame data into the display buffer according to the pre-set browser area, so that the display output can be realized on the NVR device. Specifically, for the browser screen rendering and user interface display process, see Figure 7 ,include:

[0121] S701, the browser main process module sends a preparation rendering notification to the server module of the adapter module;

[0122] S702, the browser main process module starts screen rendering;

[0123] S703, the browser main process module notifies the adapter module that the server module rendering is complete;

[0124] S704, the server module of the adaptation module obtains a frame of rendering buffer data;

[0125] S705, the server module of the adaptation module sends a frame of rendering buffer data to the client module of the adaptation module through the shared memory;

[0126] S706: The client module of the adaptation module notifies the user interface module to refresh a frame of the picture.

[0127] In some embodiments, when the NVR local user interface logs in to the web page of the front-end IPC, it can jump to the login interface for login authentication, but this makes it inconvenient for users to use, because the front-end IPC connected to the NVR is added and online in advance. Therefore, when the browser is started on the user interface and the web page of the IPC is opened, the NVR has actually established a connection with it. Therefore, the embodiment of the present application provides a token-free password login method, which enables users to jump to the web page of the target device with one click, which will be more convenient for users to use.

[0128] Therefore, in some embodiments, before sending a web page access request to the target device through the URL of the target device, the method further includes:

[0129] Sending a temporary login token acquisition request to the target device;

[0130] Receive a token replied by the target device, wherein the token is a one-time valid token with a usage duration of a preset duration;

[0131] Use the token replied by the target device to log in to the target device through the http protocol;

[0132] Receive a login success notification replied by the target device.

[0133] For example, see Figure 8 , the implementation process of password-free login to the target device includes:

[0134] S800, NVR add the front-end IPC in advance, and use the correct username and password to log in and connect to the IPC successfully;

[0135] S801, NVR sends a message to IPC requesting to obtain a temporary login token;

[0136] S802, NVR obtains the temporary login token returned by IPC;

[0137] To ensure security, the token needs to be set with a validity period and can only be used once. For example, the validity period is set to 90 seconds, which means that the process from token generation to login must be completed within 90 seconds. If the timeout expires, the token will become invalid, thereby preventing the token from being leaked and used by others.

[0138] S803, NVR uses the temporary token obtained in step S802 to log in to the IPC web based on the http protocol, without the user having to enter an additional username and password to log in;

[0139] S804, NVR receives the login success message replied by IPC;

[0140] After that, the user can log in to the IPC web to configure and use the IPC functions, that is, the NVR executes the corresponding function request.

[0141] In summary, the method for embedding a browser in a network hard disk video recorder provided by the embodiment of the present application realizes browser integration based on WPEwebKit in a network hard disk video recorder with relatively tight resources, so that the device's own GUI has the ability to access the web of the opposite device; and, decouples the excessive dependence of the webKit core browser engine (browser main process) on the display GUI framework, realizes off-screen rendering of browser screen data, and can adapt to various GUI frameworks through customized development; and, by realizing a customized adaptation backend between the WPEwebKit browser core engine and the application process, that is, by transferring through the adaptation module, the cross-process interaction of the browser rendering frame data and messages is realized, so that the user can directly log in and access the web interface of the front-end device such as IPC through the browser embedded in the user interface of the device such as NVR, and perform configuration operations without the need for additional computer operations, thereby improving the convenience and economy of deployment; and, when the network hard disk video recorder logs in to the web interface of the front-end IPC, by adding a solution for obtaining a temporary token, the user does not need to repeatedly enter the login account password of the web interface of the front-end IPC to access the web of the front-end IPC, further improving the convenience of user use.

[0142] The following is an introduction to the equipment or device provided in the embodiments of the present application, in which the explanations or examples of technical features that are the same or corresponding to those described in the above method will not be repeated later.

[0143] An electronic device provided in an embodiment of the present application may be, for example, an NVR or any other type of device. Fig. 9 , the electronic device includes, for example:

[0144] The processor 900 is used to read the program in the memory 920 and execute the following process:

[0145] When receiving a selection operation instruction of a target device to be logged in by the user through the list of added devices on the user interface of the local device, generating an access uniform resource locator URL of the target device based on the preset address information of the target device; wherein the list of added devices includes at least one target device that has been pre-connected to the local device;

[0146] Sending a web page access request to the target device via the URL of the target device, and receiving the web page response content replied by the target device;

[0147] After rendering is completed, the web page response content replied by the target device is output and displayed in a preset browser area on the user interface of the local device for the user to log in to the target device.

[0148] In some embodiments, the processor 900 is further configured to read a program in the memory 920 and execute the following process:

[0149] Receiving user operation instructions through a preset browser area on the user interface;

[0150] Based on the user operation instruction received through the preset browser area on the user interface, sending a request corresponding to the user operation instruction to the target device;

[0151] Receive the latest web page response content replied by the target device;

[0152] After rendering is completed, the latest web page response content replied by the target device is output and displayed in a preset browser area on the user interface of the local device.

[0153] In some embodiments, after rendering the latest web page response content replied by the target device, outputting and displaying it in a preset browser area on the user interface of the local device includes:

[0154] A main rendering process is established through a preset browser main process module to render the latest web page response content replied by the target device, wherein each time a complete frame of rendering data of the browser page is generated, a preset adaptation module is notified to obtain the rendering data of the frame of the browser page from the browser rendering buffer;

[0155] When the adaptation module obtains the rendering data of the frame browser page, the rendering data of the frame browser page is sent to a preset user interface module;

[0156] The user interface module writes the rendering data of the frame browser page into the display buffer based on the preset browser area on the user interface.

[0157] In some embodiments, the adaptation module includes a server module and a client module;

[0158] The notifying a preset adaptation module to obtain rendering data of the frame browser page from the browser rendering buffer includes:

[0159] Notify the server module of the adapter module to obtain rendering data of the frame browser page from the browser rendering buffer;

[0160] When the adaptation module obtains the rendering data of the frame browser page, the rendering data of the frame browser page is sent to a preset user interface module, including:

[0161] When the server module of the adapter module obtains the rendering data of the frame browser page, the server module of the adapter module sends the rendering data of the frame browser page to the client module of the adapter module through the shared memory;

[0162] When the client module of the adaptation module obtains the rendering data of the frame browser page, the client module of the adaptation module sends the rendering data of the frame browser page to a preset user interface module.

[0163] In some embodiments, before sending a web page access request to the target device through the URL of the target device, the processor 900 is further configured to read a program in the memory 920 and perform the following process:

[0164] Sending a temporary login token acquisition request to the target device;

[0165] Receive a token replied by the target device, wherein the token is a one-time valid token with a usage duration of a preset duration;

[0166] Use the token replied by the target device to log in to the target device through the http protocol;

[0167] Receive a login success notification replied by the target device.

[0168] The transceiver 910 is configured to receive and send data under the control of the processor 900 .

[0169] Among them, Fig. 9 In the embodiment, the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by processor 900 and various circuits of memory represented by memory 920 are linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface. The transceiver 910 may be a plurality of components, namely, a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium, including transmission media such as wireless channels, wired channels, and optical cables. For different user devices, the user interface 930 may also be an interface capable of externally and internally connecting required devices, and the connected devices include but are not limited to a keypad, a display, a speaker, a microphone, a joystick, and the like.

[0170] The processor 900 is responsible for managing the bus architecture and general processing, and the memory 920 can store data used by the processor 900 when performing operations.

[0171] In some embodiments, the processor 900 may be a CPU (central processing unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array) or a CPLD (Complex Programmable Logic Device), and the processor may also adopt a multi-core architecture.

[0172] The processor calls the computer program stored in the memory to execute any of the methods provided in the embodiments of the present application according to the obtained executable instructions. The processor and the memory can also be arranged physically separately.

[0173] It should be noted here that the above-mentioned device provided in the embodiment of the present application can implement all the method steps implemented in the above-mentioned method embodiment, and can achieve the same technical effect. The parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.

[0174] See also Fig.10 , a device login device provided in an embodiment of the present application, for example, is an NVR device itself, or may be a device applied to an NVR device, the device comprising:

[0175] The user interface module 11 is configured to generate an access uniform resource locator URL of the target device based on the preset address information of the target device when receiving a selection operation instruction of the target device that the user needs to log in through the added device list of the user interface of the local device; wherein the added device list includes at least one target device that has been pre-connected to the local device;

[0176] The browser main process module 12 is used to send a web page access request to the target device through the URL of the target device, and receive the web page response content replied by the target device; after rendering the web page response content replied by the target device, notify the user interface module to output and display it in the preset browser area on the user interface of the local device for the user to log in to the target device.

[0177] In some embodiments, the user interface module 11 is further used to: receive a user operation instruction through a preset browser area on the user interface; based on the user operation instruction received through the preset browser area on the user interface, send a request corresponding to the user operation instruction to the target device;

[0178] The browser main process module 12 is also used to: receive the latest web page response content replied by the target device; after rendering the latest web page response content replied by the target device, notify the user interface module to output and display it in the preset browser area on the user interface of the local device.

[0179] In some embodiments, see Fig.11 , the device further comprises: an adaptation module 13;

[0180] The browser main process module 12 renders the latest web page response content replied by the target device by establishing a main rendering process, wherein each time a complete frame of rendering data of the browser page is generated, the adaptation module is notified to obtain the rendering data of the frame of the browser page from the browser rendering buffer;

[0181] The adapting module 13 is used to send the rendering data of the frame browser page to the user interface module when the rendering data of the frame browser page is acquired;

[0182] The user interface module 11 writes the rendering data of the frame browser page into the display buffer based on the preset browser area on the user interface.

[0183] In some embodiments, see Fig.12 , the adaptation module includes a client module 131 and a server module 132;

[0184] The notifying the adaptation module to obtain rendering data of the frame browser page from the browser rendering buffer includes:

[0185] Notify the server module 132 of the adapter module to obtain rendering data of the frame browser page from the browser rendering buffer;

[0186] The server module 132 of the adapter module is used to send the rendering data of the frame browser page to the client module 131 of the adapter module through the shared memory when the rendering data of the frame browser page is obtained;

[0187] The client module 131 of the adaptation module is used for sending the rendering data of the frame browser page to the preset user interface module 11 when the rendering data of the frame browser page is acquired.

[0188] In some embodiments, before sending a web page access request to the target device through the URL of the target device, the browser main process module 12 is further used to:

[0189] Sending a temporary login token acquisition request to the target device;

[0190] Receive a token replied by the target device, wherein the token is a one-time valid token with a usage duration of a preset duration;

[0191] Use the token replied by the target device to log in to the target device through the http protocol;

[0192] Receive a login success notification replied by the target device.

[0193] It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional module in each embodiment of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated modules may be implemented in the form of hardware or in the form of software functional modules.

[0194] If the integrated module is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0195] Any of the devices or apparatuses provided in the embodiments of the present application may specifically be a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (PDA), etc. It may include a central processing unit (CPU), a memory, an input / output device, etc. The input device may include a keyboard, a mouse, a touch screen, etc. The output device may include a display device, such as a liquid crystal display (LCD), a cathode ray tube (CRT), etc.

[0196] The memory may include a read-only memory (ROM) and a random access memory (RAM), and provides the processor with program instructions and data stored in the memory. In the embodiment of the present application, the memory may be used to store the program of any of the methods provided in the embodiment of the present application.

[0197] The processor calls the program instructions stored in the memory, and the processor is used to execute any of the methods provided in the embodiments of the present application according to the obtained program instructions.

[0198] The present application embodiment also provides a computer program product or computer program, which includes a computer instruction, which is stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction so that the computer device performs any of the methods described in the above embodiments. The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0199] The embodiment of the present application provides a computer-readable storage medium for storing computer program instructions used by the apparatus provided in the embodiment of the present application, which includes a program for executing any of the methods provided in the embodiment of the present application. The computer-readable storage medium may be a non-transitory computer-readable medium.

[0200] The computer-readable storage medium can be any available medium or data storage device that can be accessed by a computer, including but not limited to magnetic storage (such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc.), optical storage (such as CD, DVD, BD, HVD, etc.), and semiconductor storage (such as ROM, EPROM, EEPROM, non-volatile memory (NANDFLASH), solid-state drive (SSD)), etc.

[0201] It should be understood that:

[0202] The access technology through which entities in the communication network transmit traffic can be any suitable current or future technology, such as WLAN (Wireless Local Access Network), WiMAX (Worldwide Interoperability for Microwave Access), LTE, LTE-A, 5G, Bluetooth, infrared, etc.; in addition, the embodiments can also apply wired technology, for example, IP-based access technology, such as a wired network or a fixed line.

[0203] Embodiments suitable for being implemented as software code or a portion thereof and running using a processor or processing functionality are independent of the software code and may be specified using any known or future developed programming language, such as a high-level programming language such as objective-C, C, C++, C#, Java, Python, Javascript, other scripting languages, etc., or a low-level programming language such as machine language or assembler.

[0204] The implementation of the embodiments is hardware independent and may be implemented using any known or future developed hardware technology or any mixture thereof, such as a microprocessor or CPU (central processing unit), MOS (metal oxide semiconductor), CMOS (complementary MOS), BiMOS (bipolar MOS), BiCMOS (bipolar CMOS), ECL (emitter coupled logic) and / or TTL (transistor-transistor logic).

[0205] Embodiments may be implemented as separate devices, apparatuses, units, components, or functions, or in a distributed manner, for example, one or more processors or processing functions may be used or shared in a process, or one or more processing segments or processing portions may be used and shared in a process, wherein one physical processor or more than one physical processor may be used to implement one or more processing portions dedicated to a specific process as described.

[0206] The device may be implemented by a semiconductor chip, a chipset, or a (hardware) module including such a chip or chipset.

[0207] The embodiments may also be implemented as any combination of hardware and software, such as ASIC (Application Specific IC (Integrated Circuit)) components, FPGA (Field Programmable Gate Array) or CPLD (Complex Programmable Logic Device) components or DSP (Digital Signal Processor) components.

[0208] The embodiments may also be implemented as a computer program product including a computer usable medium having computer readable program code embodied therein, the computer readable program code being adapted to perform the processes as described in the embodiments, wherein the computer usable medium may be a non-transitory medium.

[0209] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program codes.

[0210] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0211] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0212] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0213] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A device login method, characterized in that: The method comprises: Cross-process interaction between browser process and application process; Among them, the functional modules used to implement the browser process include: Server-side modules and browser frameworks of the adapter modules; The functional modules used to implement the application process include: Client module, user interface module, audio and video decoding module of the adaptation module; Wherein, the browser framework includes: General encapsulation framework library, browser main process module, browser network process module; The general encapsulation framework library is a general interface implementation library of the embedded web platform WPE; The server module of the adapter module interacts with the browser main process module by calling the interface of the general encapsulation framework library; The client module of the adaptation module is used to adapt the user interface module, receive the rendering frame data of the server module of the adaptation module through the communication between the browser process and the application process, and send it to the audio and video decoding module for decoding and display after processing; and send mouse and keyboard messages to the server module of the adaptation module for user operation control of the user interface; The cross-process interaction between the browser process and the application process includes: When the user interface module receives a selection operation instruction of a target device that the user needs to log in to through the list of added devices in the user interface of the local device, the user interface module generates an access uniform resource locator URL of the target device based on the preset address information of the target device, and calls the URL loading interface of the browser main process module; wherein the list of added devices includes at least one target device that has established a connection with the local device in advance; The browser main process module sends a web page access request to the target device through the URL of the target device, and receives the web page response content replied by the target device; After the browser main process module completes rendering of the web page response content replied by the target device, it notifies the user interface module to refresh the web page; The user interface module outputs and displays through a preset browser area on the user interface of the local device for the user to log in to the target device; The user interface module receives the user's operation instruction through the preset browser area on the user interface; The browser main process module sends a request corresponding to the user operation instruction to the target device based on the user operation instruction received through the preset browser area on the user interface; The browser main process module receives the latest web page response content replied by the target device; The browser main process module establishes a main rendering process to render the latest web page response content replied by the target device, wherein each time a complete frame of rendering data of the browser page is generated, the server module of the adapter module is notified to obtain the rendering data of the frame of the browser page from the browser rendering buffer; The server module of the adapter module, when acquiring the rendering data of the frame browser page from the browser rendering buffer, sends the rendering data of the frame browser page to the client module of the adapter module through the shared memory; The client module of the adapter module sends the rendering data of the frame browser page sent by the server module of the adapter module through the shared memory to the user interface module; The user interface module writes the rendering data of the frame browser page into the display buffer according to the preset browser area.

2. The method according to claim 1, characterized in that Before sending a web page access request to the target device through the URL of the target device, the method further includes: Sending a temporary login token acquisition request to the target device; Receive a token replied by the target device, wherein the token is a one-time valid token with a usage duration of a preset duration; Use the token replied by the target device to log in to the target device through the http protocol; Receive a login success notification replied by the target device.

3. A device login device, characterized in that: Used to implement cross-process interaction between a browser process and an application process, the device includes: a functional module for implementing the browser process and a functional module for implementing the application process, and is used to implement cross-process interaction between the browser process and the application process; Among them, the functional modules used to implement the browser process include: Server-side modules and browser frameworks of the adapter modules; The functional modules used to implement the application process include: Client module, user interface module, audio and video decoding module of the adaptation module; Wherein, the browser framework includes: General encapsulation framework library, browser main process module, browser network process module; The general encapsulation framework library is a general interface implementation library of the embedded web platform WPE; The server module of the adapter module interacts with the browser main process module by calling the interface of the general encapsulation framework library; The client module of the adaptation module is used to adapt the user interface module, receive the rendering frame data of the server module of the adaptation module through the communication between the browser process and the application process, and send it to the audio and video decoding module for decoding and display after processing; and send mouse and keyboard messages to the server module of the adaptation module for user operation control of the user interface; The cross-process interaction between the browser process and the application process includes: The user interface module, when receiving a selection operation instruction of a target device that the user needs to log in to through the added device list of the user interface of the local device, generates an access uniform resource locator URL of the target device based on the preset address information of the target device, and calls the URL loading interface of the browser main process module; wherein the added device list includes at least one target device that has established a connection with the local device in advance; The browser main process module sends a web page access request to the target device through the URL of the target device, and receives the web page response content replied by the target device; After the browser main process module completes rendering of the web page response content replied by the target device, it notifies the user interface module to refresh the web page; The user interface module outputs and displays through a preset browser area on the user interface of the local device for the user to log in to the target device; The user interface module receives the user's operation instruction through the preset browser area on the user interface; The browser main process module sends a request corresponding to the user operation instruction to the target device based on the user operation instruction received through the preset browser area on the user interface; The browser main process module receives the latest web page response content replied by the target device; The browser main process module renders the latest web page response content replied by the target device by establishing a main rendering process, wherein each time a complete frame of rendering data of the browser page is generated, the server module of the adapter module is notified to obtain the rendering data of the frame of the browser page from the browser rendering buffer; The server module of the adapter module, when acquiring the rendering data of the frame browser page from the browser rendering buffer, sends the rendering data of the frame browser page to the client module of the adapter module through the shared memory; The client module of the adapter module sends the rendering data of the frame browser page sent by the server module of the adapter module through the shared memory to the user interface module; The user interface module writes the rendering data of the frame browser page into the display buffer according to the preset browser area.

4. An electronic device, characterized in that: include: A memory for storing program instructions; A processor is used to call the program instructions stored in the memory and execute the method according to claim 1 or 2 according to the obtained program.

5. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable the computer to execute the method of claim 1 or 2.

Images