A method, system, device and medium for generating graphic report based on video screenshot

Abstract

The present invention proposes a method, system, device and medium for generating graphic reports based on video screenshots, the method comprising: determining graphic report generation rules and one or more target devices to be video inspected in response to user execution operations on a management page, associating the graphic report generation rules with the target devices; retrieving the target video generated by the target device, intercepting the target video to obtain one or more video frame images; generating a graphic report for the one or more video frame images corresponding to the same target video according to the graphic report generation rules, and pushing the graphic report to a designated recipient for access. The present invention allows users to understand the status of multiple videos at one time through graphic reports, simplifies the user's video inspection method, meets the user's needs for multiple inspections of multiple videos a day, saves user time and energy, and supports users to view graphic reports anytime and anywhere.

Description

Technical Field

[0001] The present invention relates to the field of video application technology, and in particular to a method, system, device and medium for generating a graphic report based on video screenshots. Background Art

[0002] In the government affairs, logistics, and property management industries, users are usually required to continuously view real-time videos on the terminal to achieve the purpose of video inspection. For example, in the government affairs industry, the monitoring content of video inspection mainly includes live on-demand viewing of all cameras to confirm whether they are normal. At present, video inspection is mainly carried out through traditional manual viewing of videos and manual switching of videos. However, traditional manual video inspection often requires users to view the screen for a long time. Viewing continuous videos takes a long time and it is difficult to meet the needs of users to quickly confirm the on-site situation. In addition, when there are hundreds of videos, it is difficult to meet the needs of multiple video inspections per day. Summary of the invention

[0003] The embodiment of the present invention provides a method, system, device and medium for generating graphic reports based on video screenshots to solve the problems existing in the related technologies. The technical solution is as follows:

[0004] In a first aspect, an embodiment of the present invention provides a method for generating a graphic report based on a video screenshot, comprising:

[0005] In response to an execution operation of a user on a management page, determining a graphic report generation rule and one or more target devices to be video inspected, and associating the graphic report generation rule with the target device;

[0006] Retrieving a target video generated by a target device, and intercepting the target video to obtain one or more video frame images;

[0007] According to the graphic report generation rules, one or more video frame images corresponding to the same target video are used to generate a graphic report, and the graphic report is pushed to a designated recipient for access.

[0008] In one embodiment, it further includes:

[0009] Obtain the location information and device information of each monitoring device, display the device map location based on the location information and device information on the management page, create a selection control on the management page to allow the user to select the target device, and create an input control on the management page to allow the user to enter the graphic report name and graphic report content summary in the input control, where the graphic report name and graphic report content summary are used to determine the graphic report generation rules.

[0010] In one embodiment, intercepting a target video to obtain one or more video frame images includes:

[0011] Get the scheduled screenshot time set by the user. When the time difference between the current time and the scheduled screenshot time is less than a preset value, execute the graphic report generation rule to capture a video frame image of the target video at the scheduled screenshot time.

[0012] In one implementation, pushing the graphic report to a designated recipient for access includes:

[0013] Generate a unique URL link based on the graphic report, and push the URL link to the designated recipient via the designated platform for the designated recipient to access and view.

[0014] In one embodiment, it further includes:

[0015] The receiver information is obtained and the identity is authenticated. After the identity authentication is passed, the access permission of the URL link on the receiver terminal is opened, so that when the designated receiver clicks the URL link on the receiver terminal, the page automatically jumps to the report details page of the graphic report for the designated receiver to view.

[0016] In one embodiment, it further includes:

[0017] After identity authentication is passed, watermark parameters are generated according to the recipient information, and the watermark parameters are sent to the recipient terminal, so that the recipient terminal displays the watermark parameters on the report details page; the watermark parameters include name and mobile phone number.

[0018] In one embodiment, it further includes:

[0019] Receive an image click event, and determine a target image that needs to be viewed in real-time video according to the image click event;

[0020] Relevant video information is searched according to the target image, and a video stream address is generated according to the video information and returned to the receiving terminal, so that the receiving terminal loads the video stream address and plays the target video corresponding to the target image.

[0021] In a second aspect, an embodiment of the present invention provides a system for generating graphic reports based on video screenshots, which executes the above-mentioned method for generating graphic reports based on video screenshots.

[0022] In a third aspect, an embodiment of the present invention provides an electronic device, the device comprising: a memory and a processor. The memory and the processor communicate with each other through an internal connection path, the memory is used to store instructions, the processor is used to execute the instructions stored in the memory, and when the processor executes the instructions stored in the memory, the processor executes the method in any one of the above-mentioned embodiments.

[0023] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the method in any one of the above-mentioned embodiments is executed.

[0024] The advantages or beneficial effects of the above technical solution include at least:

[0025] The present invention uses key technologies such as video frame capture and image and text generation to realize video and image report instead of viewing real-time video, so that users can understand the status of multiple videos at one time through image and text reports, simplify the user's video inspection method, meet the user's needs for multiple inspections of multiple videos a day, save user time and energy, and support users to view image and text reports anytime and anywhere.

[0026] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present invention will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the multiple drawings represent the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings only depict some embodiments disclosed in the present invention and should not be regarded as limiting the scope of the present invention.

[0028] Figure 1 It is a schematic diagram of the process of the method for generating a graphic report based on video screenshots of the present invention;

[0029] Figure 2 This is a business process diagram of viewing a video in real time corresponding to a picture of the present invention;

[0030] Figure 3 The structure block diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0031] In the following, only some exemplary embodiments are briefly described. As those skilled in the art will appreciate, the described embodiments may be modified in various ways without departing from the spirit or scope of the present invention. Therefore, the drawings and descriptions are considered to be exemplary and non-restrictive in nature.

[0032] In the current technological context, the demand for video inspection is growing, especially in the government, logistics and property management industries. Traditional manual video inspection methods have problems such as low efficiency and high time cost. Therefore, a new method that can effectively improve the efficiency of video inspection is needed.

[0033] The embodiment of the present invention provides a method for generating a graphic report based on video screenshots. The usage scenario is mainly in various video inspection scenarios, and is suitable for government affairs, logistics, and property management industries. Through the video frame capture capability and graphic generation, the problem of long video inspection time is solved.

[0034] like Figure 1 As shown, the method for generating a graphic report based on video screenshots according to an embodiment of the present invention specifically includes the following steps:

[0035] Step S1: In response to the user's execution operation on the management page, a graphic report generation rule and one or more target devices to be video inspected are determined, and the graphic report generation rule is associated with the target device.

[0036] This embodiment provides a management page, which queries various video data through a video query interface, displays the various video data on the management page, and obtains information such as the video name and online status of each video data and displays it on the management page for users to view.

[0037] Each video data is captured in real time by different monitoring devices, and the location information and device information of each monitoring device are obtained. The device information includes the monitoring device name, device code, etc. Create a device map in the management page, and locate and display each monitoring device in the device map according to the location information and device information, so that users can view and search for target devices.

[0038] At the same time, a selection control is created on the management page. Each monitoring device is configured with a corresponding selection control. The user selects the selection control corresponding to the monitoring device that requires video inspection to select the target device; an input control is created on the management page to allow the user to enter the name of the graphic report and the summary of the graphic report content in the input control, where the name of the graphic report and the summary of the graphic report content are used to determine the graphic report generation rules.

[0039] Users can view, search and select target devices that need video inspection on the management page. Users can search by entering keywords such as device name, device location, and device real-time image features on the management page to quickly filter out qualified monitoring devices from all devices, so that users can quickly determine the target device.

[0040] At the same time, the user inputs information such as the graphic report name and graphic report content summary through the input controls on the management page, and generates graphic report generation rules based on the information. The graphic report generation rules are associated with the target device selected by the user, so that the target video generated by the target device can generate a corresponding graphic report according to the graphic report generation rules.

[0041] It should be noted that the user can enter the graphic report content summary to introduce the purpose, background, update frequency, etc. of the report. When the graphic report is generated, the graphic report content summary entered by the user will be organized and appear in the graphic report.

[0042] Step S2: Retrieve the target video generated by the target device, and capture the target video to obtain one or more video frame images.

[0043] Associating the graphic report generation rule with the target device is equivalent to associating the graphic report generation rule with the target video generated by the target device, and taking a screenshot of the target video to obtain one or more video frame images.

[0044] The screenshot frequency of the target video can be captured according to the default frequency. Assume that the default frequency is one hour. Figure 1 times, the target video is captured at this frequency to obtain multiple video frame images.

[0045] In some embodiments, it is also possible to customize the screenshot rule or set the scheduled screenshot time. The customized screenshot frequency can be input through the input control in the management page, that is, when the user inputs the summary of the graphic report content through the input control, the screenshot rule can be input in the specified format; the input screenshot rule can be written into the graphic report for display, and the screenshot rule in the specified format can be identified through text recognition technology, and the screenshot frequency, screenshot time, and number of screenshots of the target device can be changed according to the screenshot rule, so as to screenshot the target video according to the customized screenshot rule, thereby obtaining a burst or multiple frames of video frame images.

[0046] Similarly, users can also set the scheduled screenshot time through the input control and obtain the scheduled screenshot time set by the user. When the time difference between the current time and the scheduled screenshot time is less than the preset value (for example, one minute), a frame of video frame images of the target video at the scheduled screenshot time is captured, and this frame of video frame images is presented in the graphic report according to the graphic report generation rules.

[0047] It should be noted that other controls can also be set in the management page to provide users with more customized settings, and the screenshot rules and scheduled screenshot times can also be set separately with corresponding controls for users to customize, so as to improve the success rate of customized configuration.

[0048] At the same time, when the user selects multiple target devices, the screenshot rules and scheduled screenshot times can be configured for different target devices separately according to actual needs, so that the target videos of different target devices can be screenshoted according to their matching screenshot rules and scheduled screenshot times, thereby improving flexibility.

[0049] This embodiment provides a method for regularly capturing video screenshots and generating graphic reports. Compared with real-time video, it has a high degree of automation and does not require continuous manual intervention. It can be automatically executed at a specific time point to ensure the consistency and accuracy of the data. It is suitable for scenarios that require regular inspections. It also supports multi-camera operation to improve overall inspection efficiency.

[0050] Step S3: Generate a graphic report for one or more video frame images corresponding to the same target video according to the graphic report generation rule, and push the graphic report to a designated recipient for access.

[0051] In this embodiment, the user can select multiple target devices at the same time in step S1, and can set all target devices to use a unified graphic report generation rule to generate corresponding graphic reports; the graphic report generation rules of local target devices can also be set separately, so that different target devices can have different graphic report generation rules, thereby improving flexibility.

[0052] In this way, users can select dozens or hundreds of cameras at a time and obtain video and text reports at regular intervals. The report contains one or more video frames captured in the target video according to the screenshot rules or scheduled screenshot time, as well as the name of the report, a summary of the report content, the device information of the target device, basic video information, etc. The device information includes the name and number of the target device, and the basic video information includes the name of the video, the owner of the video, etc. The report can provide a preliminary understanding of the video details, so as to facilitate the preliminary video situation judgment of the video cruise.

[0053] In this embodiment, the graphic report is pushed to the designated recipient, and the designated recipient may be a user of a third-party platform, and the third-party platform may be the WeChat platform. Specifically, the system user query interface is called to display the user list of the WeChat platform, and the user can select the designated recipient to be sent in the user list, so that the generated graphic report can be directly pushed to the WeChat user. The graphic report can also be pushed to the designated recipient (system user) through the WeChat public account message service through the binding relationship between the system user and the WeChat public account.

[0054] In order to improve information security in this embodiment, the push of graphic reports can be achieved through URL links, that is, a unique URL link is generated according to each graphic report, and the URL link is pushed to the designated recipient during push, so that the designated recipient can access and view it.

[0055] When the designated recipient receives a notification with a URL link on its own recipient terminal, the designated recipient can click the URL link, and then jump to the identity authentication page. The designated recipient can enter the recipient information such as password, account number, verification code, etc. on the identity authentication page and click to log in; at this time, the recipient information is encrypted and transmitted to the database for storage via https, and the recipient information is authenticated at the same time. After the identity authentication is passed, the access rights of the URL link on the recipient terminal are opened. At this time, when the designated recipient clicks the URL link on the recipient terminal, it automatically jumps to the report details page of the graphic report for viewing.

[0056] If the identity verification fails, the page will prompt error messages such as user does not exist / password error, etc.

[0057] In this embodiment, after identity authentication is passed, the user information query interface can be called to obtain the recipient information, which includes name, mobile phone number, etc.; watermark parameters are generated based on the recipient information, and the watermark parameters are sent to the recipient terminal, so that the recipient terminal displays the watermark parameters on the report details page; the watermark parameters include name and mobile phone number.

[0058] This embodiment provides a method for real-time video capture and generating graphic reports. Compared with real-time video viewing, it improves the efficiency of video inspection, reduces the time cost of manual inspection, and provides intuitive graphic reports for quick understanding of video conditions. It supports batch processing of multiple cameras, which improves work efficiency. Multiple notification methods ensure that information is conveyed to relevant personnel in a timely manner, and through identity authentication and watermarking, it reduces the risk of information leakage and facilitates tracing after information leakage occurs.

[0059] In one embodiment, a method for viewing a video frame image corresponding to a video in real time is also provided, such as Figure 2 As shown, including:

[0060] Step 1: The user clicks the URL link of the graphic report to jump to the graphic report.

[0061] Step 2: Select the video frame image that needs to be viewed in real time, and click to enter the video viewing interface; at this time, it is equivalent to feedback of the image click event through the receiving terminal, and the target image that needs to be viewed in real time is determined according to the image click event.

[0062] Step 3: According to the correspondence between the target video and the video frame image, query and obtain the video encoding information (eg, video ID) corresponding to the video frame image.

[0063] Step 4: Initiate a request to obtain the real-time video stream address.

[0064] Step 5: Return the video stream address request result and return the real-time video stream address that supports multiple formats (such as flv, HLS, RTMP, etc.).

[0065] Step 6: The front end uses a suitable video player component to load the stream address obtained above and starts playing the corresponding real-time video content.

[0066] This mechanism allows users to quickly preview related videos without leaving the current page, greatly facilitating the immediate confirmation and subsequent processing of abnormal situations. In addition to basic video inspections, it can also be applied to remote monitoring, event backtracking, and other aspects, enhancing the functionality of the overall solution.

[0067] This embodiment provides a method for viewing a video corresponding to a picture in real time, realizing seamless switching from static pictures to dynamic videos, and enhancing user experience. It supports multiple video stream formats and has good compatibility. It allows users to preview related videos without leaving the current page, which is convenient and fast. It is suitable for various application scenarios such as remote monitoring and event backtracking, and improves the functionality and flexibility of the system.

[0068] Another embodiment of the present invention provides a system for generating graphic reports based on video screenshots, which executes the graphic report generation method based on video screenshots as described above. This system reduces the degree of manual participation through automated means, significantly shortening the time required for video inspections. An intuitive operating interface and a variety of notification methods are provided, allowing non-professionals to easily get started. It is not only limited to video inspections, but can also be applied to remote monitoring, event backtracking and other fields, and has a high application value. Supports real-time video viewing, which helps users respond quickly, especially when abnormal situations occur. These technical points and the advantages they bring demonstrate the innovation of the present invention in improving the efficiency of video inspections, and can meet the needs of different industries for efficient, convenient and reliable video surveillance solutions.

[0069] The functions of each module in the system of the embodiment of the present invention can refer to the corresponding description in the above method, which will not be repeated here.

[0070] Another embodiment of the present invention further provides an electronic device, Figure 3 FIG. 2 shows a structural block diagram of an electronic device according to an embodiment of the present invention. Figure 3 As shown, the electronic device includes: a memory 100 and a processor 200, wherein the memory 100 stores a computer program that can be run on the processor 200. When the processor 200 executes the computer program, the method for generating a graphic report based on video screenshots in the above embodiment is implemented. The number of the memory 100 and the processor 200 can be one or more.

[0071] The electronic device also includes:

[0072] The communication interface 300 is used to communicate with external devices and perform data exchange transmission.

[0073] If the memory 100, the processor 200 and the communication interface 300 are implemented independently, the memory 100, the processor 200 and the communication interface 300 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc.

[0074] Optionally, in a specific implementation, if the memory 100, the processor 200 and the communication interface 300 are integrated on a chip, the memory 100, the processor 200 and the communication interface 300 can communicate with each other through an internal interface.

[0075] An embodiment of the present invention provides a computer-readable storage medium storing a computer program, which implements the method provided in the embodiment of the present invention when executed by a processor.

[0076] An embodiment of the present invention further provides a chip, which includes a processor for calling and executing instructions stored in the memory from the memory, so that a communication device equipped with the chip executes the method provided by the embodiment of the present invention.

[0077] An embodiment of the present invention also provides a chip, including: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute the method provided by the embodiment of the invention.

[0078] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. It is worth noting that the processor may be a processor supporting the advanced RISC machines (ARM) architecture.

[0079] Further, optionally, the above-mentioned memory may include a read-only memory and a random access memory, and may also include a non-volatile random access memory. The memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may include a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may include a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available. For example, static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct rambus RAM (DR RAM).

[0080] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.

[0081] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments or examples described in this specification and the features of different embodiments or examples, unless they are contradictory.

[0082] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0083] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of various changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A method for generating a graphic report based on video screenshots, characterized in that: include: Determine, in response to an execution operation of a user on a management page, a graphic report generation rule and one or more target devices to be video inspected, and associate the graphic report generation rule with the target devices; Retrieving a target video generated by the target device, and intercepting the target video to obtain one or more video frame images; Generate a graphic report for the one or more video frame images corresponding to the same target video according to the graphic report generation rule, and push the graphic report to a designated recipient for access.

2. The method for generating a graphic report based on video screenshots according to claim 1, characterized in that: Also includes: Acquire the location information and device information of each monitoring device, display the device map location in the management page according to the location information and the device information, create a selection control on the management page to allow the user to select the target device, create an input control on the management page to allow the user to enter a graphic report name and a graphic report content summary in the input control, wherein the graphic report name and the graphic report content summary are used to determine the graphic report generation rules.

3. The method for generating a graphic report based on video screenshots according to claim 1, characterized in that: The intercepting the target video to obtain one or more video frame images comprises: The scheduled screenshot time set by the user is obtained, and when the time difference between the current time and the scheduled screenshot time is less than a preset value, the graphic report generation rule is executed to capture a video frame image of the target video at the scheduled screenshot time.

4. The method for generating a graphic report based on video screenshots according to claim 1, characterized in that: The pushing of the graphic report to a designated recipient for access includes: A unique URL link is generated based on the graphic report, and the URL link is pushed to the designated recipient via a designated platform for the designated recipient to access and view.

5. The method for generating a graphic report based on video screenshots according to claim 4, characterized in that: Also includes: The recipient information is obtained and the identity of the recipient information is authenticated. After the identity authentication is passed, the access rights of the URL link on the recipient terminal are opened, so that when the designated recipient clicks the URL link on the recipient terminal, it automatically jumps to the report details page of the graphic report for viewing.

6. The method for generating a graphic report based on video screenshots according to claim 5, characterized in that: Also includes: After identity authentication is passed, watermark parameters are generated according to the recipient information, and the watermark parameters are sent to the recipient terminal, so that the recipient terminal displays the watermark parameters on the report details page; the watermark parameters include name and mobile phone number.

7. The method for generating a graphic report based on video screenshots according to claim 1, characterized in that: Also includes: Receive an image click event, and determine a target image that needs to be viewed in real-time video according to the image click event; Relevant video information is searched according to the target image, and a video stream address is generated according to the video information and returned to the receiving terminal, so that the receiving terminal loads the video stream address and plays the target video corresponding to the target image.

8. A system for generating graphic reports based on video screenshots, characterized in that: Execute the method for generating a graphic report based on video screenshots as described in any one of claims 1 to 7.

9. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores instructions, and the instructions are loaded and executed by the processor to implement the method for generating a graphic report based on video screenshots as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for generating a graphic report based on video screenshots according to any one of claims 1 to 7 is implemented.

Images