Scene information processing method, device, storage medium and electronic device

Abstract

An embodiment of the present invention provides a method for processing scene information, the method comprising: obtaining a first group of images collected within a first time period, performing a first processing on the first group of images to obtain a group of scene information, obtaining the first scene information in the target image, determining whether there is information missing in the first scene information based on the group of scene information, and when there is information missing in the first scene information, repairing the first scene information based on the group of scene information to obtain second scene information. The problem of difficulty in completely reproducing scene information in image information existing in related technologies can be solved, thereby lowering the threshold for using image data, expanding the scope of application, and achieving the technical effect that information in a good scene environment can complete the missing scene information.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of communications, and in particular, to a method, device, storage medium and electronic device for processing scene information. Background Art

[0002] In the current related technologies, video surveillance equipment is becoming more and more popular, so more and more surveillance image scene data needs to be processed. Among them, scene information is the structured information of the scene obtained after processing segmentation and detection information, but the existing processing method is more limited to the processing of a single image, so there will be a relatively large randomness. When processing image surveillance data, there is an excessive reliance on video data. When the acquired image data is picture information, the application occasions are limited. At the same time, obtaining video data has higher requirements on the equipment, and it is not widely compatible with the current acquisition equipment and picture information flow.

[0003] In the process of image information processing, factors such as light and occlusion may cause the scene information of the image to be lost.

[0004] With respect to the technical problem existing in the related technologies that it is difficult to completely reproduce the scene information in the image information, no effective solution has been proposed so far. Summary of the invention

[0005] The embodiments of the present invention provide a method, device, storage medium and electronic device for processing scene information, so as to at least solve the problem existing in the related art that it is difficult to completely reproduce the scene information in the picture information.

[0006] According to an embodiment of the present invention, a method for processing scene information is provided, comprising: acquiring a first group of pictures collected within a first time period; performing a first processing on the first group of pictures to obtain a group of scene information, wherein each of the scene information is used to represent a scene in a picture in the first group of pictures; acquiring first scene information in a target picture, wherein the collection time of the target picture is a target time; determining whether there is information missing in the first scene information based on the group of scene information; and in the case that there is information missing in the first scene information, repairing the first scene information based on the group of scene information to obtain second scene information.

[0007] According to another embodiment of the present invention, a scene information processing device is provided, including: a first acquisition module, used to acquire a first group of pictures collected within a first time period; a processing module, used to perform a first process on the first group of pictures to obtain a group of scene information, wherein each of the scene information is used to represent a scene in a picture in the first group of pictures; a second acquisition module, used to acquire the first scene information in a target picture, wherein the acquisition time of the target picture is a target time; a determination module, used to determine whether there is any missing information in the first scene information based on the group of scene information; and a repair module, used to repair the first scene information based on the group of scene information to obtain second scene information when there is any missing information in the first scene information.

[0008] According to yet another embodiment of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the steps of any one of the above method embodiments when run.

[0009] According to yet another embodiment of the present invention, there is provided an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0010] Through the present invention, a first group of pictures collected within a first time period is obtained, a first processing is performed on the first group of pictures to obtain a group of scene information, the first scene information in the target picture is obtained, and based on the group of scene information, it is determined whether there is information missing in the first scene information; when there is information missing in the first scene information, the first scene information is repaired based on the group of scene information to obtain the second scene information, which can solve the problem of difficulty in completely reproducing the scene information in the picture information in the related technology, thereby achieving the goal of lowering the threshold for the use of image data, expanding the scope of application, and achieving the technical effect that information in a good scene environment can supplement the missing scene information. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0012] Figure 1 It is a hardware structure block diagram of a mobile terminal of a scene information processing method according to an embodiment of the present invention;

[0013] Figure 2 is a flow chart of a method for processing scene information according to an embodiment of the present invention;

[0014] Figure 3 is a flow chart of another method for processing scene information according to an embodiment of the present invention;

[0015] Figure 4 It is a structural schematic diagram of a scene information processing device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0016] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and in combination with the embodiments.

[0017] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0018] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, Figure 1 FIG. 1 is a hardware structure block diagram of a mobile terminal of a scene information processing method according to an embodiment of the present invention. Figure 1 As shown, the mobile terminal may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the mobile terminal may also include a transmission device 106 and an input / output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the mobile terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations shown.

[0019] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the method for processing scene information in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the mobile terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0020] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0021] In this embodiment, a method for processing scene information running on the above-mentioned mobile terminal, computer terminal or similar computing device is provided. Figure 2 is a schematic diagram of a process of processing scene information according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:

[0022] S202, obtaining a first group of images collected within a first time period;

[0023] S204, performing a first process on the first group of pictures to obtain a set of scene information, wherein each piece of scene information is used to represent a scene in one of the first group of pictures;

[0024] S206, obtaining first scene information in the target image, wherein the acquisition time of the target image is the target time;

[0025] S208, determining whether the first scene information has information missing according to a set of scene information;

[0026] S210: When there is information missing in the first scene information, repair the first scene information according to a group of scene information to obtain second scene information.

[0027] Optionally, in this embodiment, the first group of pictures may include but is not limited to a group of pictures acquired in advance, for example, a group of pictures taken in advance by a traffic violation monitoring camera on the road, or a group of pictures taken in advance by a door access control camera.

[0028] Optionally, in this embodiment, the above-mentioned first processing may include but is not limited to preheating cache processing of the above-mentioned first group of pictures, and specifically may include but is not limited to statistics of scene structured data in the above-mentioned first group of pictures. The above-mentioned first scene information may include but is not limited to the position coordinates of each scene information in the scene structured data and the corresponding number of occurrences, and the above-mentioned position coordinates and the number of occurrences are stored in a preset cache correspondingly, wherein the scene information may include but is not limited to line information, arrow information, etc. on the road in traffic scenes.

[0029] Optionally, in this embodiment, the target time may be, but is not limited to, within the first time period. Preferably, the target time may be, but is not limited to, set to be after a preset time interval of the first time period.

[0030] Through the above steps, a first group of pictures collected within a first time period is obtained, a first processing is performed on the first group of pictures to obtain a group of scene information, the first scene information in the target picture is obtained, and based on the group of scene information, it is determined whether there is information missing in the first scene information; when there is information missing in the first scene information, the first scene information is repaired based on the group of scene information to obtain the second scene information, which can solve the problem of difficulty in completely reproducing the scene information in the picture information in the related technology, thereby lowering the threshold for the use of image data, expanding the scope of application, and achieving the technical effect that information in a good scene environment can complete the missing scene information.

[0031] In an optional embodiment, when there is missing information in the first scene information, the first scene information is repaired according to the set of scene information, including: when there is missing line information in the first scene information, the line information in the first scene information is repaired according to the line information in the set of scene information; and / or when there is missing arrow information in the first scene information, the arrow information in the first scene information is repaired according to the arrow information in the set of scene information.

[0032] Optionally, in this embodiment, the above-mentioned line information may include but is not limited to line information on the road used to indicate traffic in traffic monitoring, such as double yellow lines, single yellow lines, etc.

[0033] Optionally, in this embodiment, the arrow information may include but is not limited to arrow information on the road used to indicate traffic during traffic monitoring, such as a left turn arrow, a no left turn arrow, and the like.

[0034] The above is only an example, and the embodiment does not impose any specific limitation on the type of specific line information or arrow information.

[0035] In an optional embodiment, the line information in the first scene information is repaired according to the line information in the group of scene information, including: obtaining a first acquisition device identifier corresponding to the first line information, wherein the first acquisition device identifier is used to indicate that the first line information is acquired by the first acquisition device, and the line information in the first scene information includes the first line information; obtaining a group of second line information having the first acquisition device identifier in the group of scene information; determining first target information missing from the group of second line information compared with the first line information, wherein the first target information is the information that appears the most times in the group of second line information; and repairing the first scene information to the second scene information based on the first target information.

[0036] Optionally, in this embodiment, the first acquisition device identifier may include but is not limited to the number of the acquisition device, the location of the acquisition device, the model of the acquisition device, etc. The first line information and the second line information are of the same type, and the first target information may include but is not limited to information that is different from the first line information and the second line information. For example, in the case of insufficient illumination, the first line information indicates a double solid line, the second line information indicates a double solid line, and the first target information indicates that the line color is yellow. In other words, in the case where the first line information indicates that the scene information is a double solid line and the second line information indicates that the scene information is a double yellow line, the color of the solid line in the first line information is restored to yellow to achieve restoration of the first scene information to the second scene information.

[0037] In an optional embodiment, the method further includes: obtaining a first time interval between the first time period and the target time; when the first time interval is less than a first predetermined threshold, determining a group of third line information from the group of second line information; determining second target information that is missing compared with the first line information from the group of third line information; and repairing the first scene information to the second scene information based on the second target information.

[0038] Optionally, in this embodiment, the first predetermined threshold may be pre-configured by a server or a terminal, or may be dynamically configured according to different line information.

[0039] Through this embodiment, a pre-configured or dynamically configured first predetermined threshold, for example, 3 days, is used to ensure that the scene information has not changed much, and the third line information can provide a good basis for repairing part of the missing data in the first scene information.

[0040] In an optional embodiment, the arrow information in the first scene information is repaired according to the arrow information in the group of scene information, including: obtaining a second acquisition device identifier corresponding to the first line information, wherein the second acquisition device identifier is used to indicate that the first line information is acquired by the second acquisition device, and the line information in the first scene information includes the first line information; obtaining a group of second arrow information with the second acquisition device identifier in the group of scene information; determining third target information missing from the group of second arrow information compared with the first arrow information, wherein the third target information is the information that appears the most times in the group of second arrow information; and repairing the first scene information to the second scene information based on the third target information.

[0041] Optionally, in this embodiment, the second acquisition device identifier may include but is not limited to the number of the acquisition device, the location of the acquisition device, the model of the acquisition device, etc. The first line information and the second line information are of the same type, and the third target information may include but is not limited to information that is different from the first arrow information and the second arrow information. For example, when the first arrow information indicates a left turn and the second arrow information indicates that a left turn is prohibited, the third target information is a prohibition symbol. In other words, the first scene information is restored to the second scene information by restoring the arrow used to indicate a left turn in the first arrow information to an arrow used to indicate that a left turn is prohibited.

[0042] In an optional embodiment, it includes: obtaining a second time interval between the first time period and the target time; when the second time interval is less than a second predetermined threshold, determining a group of third arrow information from the group of second arrow information; determining fourth target information that is missing compared with the first arrow information from the group of third arrow information; and repairing the first scene information to the second scene information based on the fourth target information.

[0043] Optionally, in this embodiment, the second predetermined threshold may be pre-configured by the server or the terminal, or may be dynamically configured according to different line information.

[0044] Through this embodiment, a pre-configured or dynamically configured second predetermined threshold, for example, 4 days, is used to ensure that the scene information has not changed much, and the above-mentioned third line information can provide a good basis for repairing part of the missing data in the first scene information.

[0045] In an optional embodiment, determining whether there is any missing information in the first scene information based on the set of scene information includes: obtaining a first comparison result between the first scene information and the set of scene information, wherein the first comparison result is used to indicate whether there is any missing information in the line information in the first scene information; when the first comparison result indicates that the line information is missing, determining that there is any missing information in the first scene information; and / or obtaining a second comparison result between the first scene information and the set of scene information, wherein the second comparison result is used to indicate whether there is any missing information in the arrow information in the first scene information; when the second comparison result indicates that the arrow information is missing, determining that there is any missing information in the first scene information.

[0046] Optionally, in this embodiment, the first comparison result may include but is not limited to determining whether the first scene information is consistent with an attribute of the same type in a group of scene information, which may include but is not limited to arrow information or line information.

[0047] Through this embodiment, it is possible to effectively obtain whether there is any missing information in the target image, and then perform a repair operation on the target image with missing information to achieve repair of the missing information.

[0048] In an optional embodiment, performing a first processing on the first group of pictures to obtain a group of scene information includes: performing the first processing on the first group of pictures to obtain the group of scene information and a group of acquisition times, wherein the group of scene information corresponds one-to-one to the group of acquisition times, and each acquisition time in the group of acquisition times is the acquisition time of a corresponding picture in the first group of pictures; determining whether there is any information missing in the first scene information based on the group of scene information includes: determining whether there is any information missing in the first scene information based on a target scene information set in the group of scene information, wherein the time interval between the acquisition time corresponding to each scene information in the target scene information set and the target time is less than a predetermined threshold.

[0049] Optionally, in this embodiment, the one-to-one correspondence between the above-mentioned set of acquisition time and the above-mentioned set of scene information may include but is not limited to the one-to-one correspondence between the above-mentioned set of acquisition time and each scene information in the above-mentioned set of scene information, and may also include but is not limited to the one-to-one correspondence between the above-mentioned set of acquisition time and each set of scene information in the above-mentioned set of scene information. The time interval between the acquisition time corresponding to each scene information in the above-mentioned target scene information set and the target time is less than a predetermined threshold, which may include but is not limited to pre-configuring a predetermined threshold before acquiring the target scene information set, and acquiring the scene information set acquired by the acquisition time whose time interval with the target time is less than the predetermined threshold based on the above-mentioned predetermined threshold.

[0050] The present invention is further described below by taking traffic monitoring as an example:

[0051] Figure 3 FIG. 1 is a flow chart of another method for processing scene information according to an embodiment of the present invention. Figure 3 As shown in the figure, the process is as follows:

[0052] S302, start;

[0053] S304, inputting a single picture sequence (corresponding to the aforementioned first group of pictures);

[0054] S306, image scene structuring (corresponding to the aforementioned first process);

[0055] S308, recording scene information and time information, counting the positions and numbers of lines and arrows in the scene, and recording them into the scene cache;

[0056] S310, determining whether a round of image preprocessing is completed, if completed, jumping to S312, otherwise returning to S306;

[0057] S312, comparing the scene structuring result (corresponding to the aforementioned first scene information) with the scene cache;

[0058] S314, comparing the cache to determine whether there is a missing line, if the determination result is yes, jump to S316, otherwise jump to S318;

[0059] S316, adopting the line information in the cache information and supplementing the missing line information;

[0060] S318, comparing the cache to determine whether an arrow is missing, if the determination result is yes, jump to S320, otherwise jump to S322;

[0061] S320, adopting the arrow information in the cache information and supplementing the missing arrow information;

[0062] S322, output complete scene structured information (corresponding to the aforementioned second scene information).

[0063] Among them, the completion of the entire scene information relies on the cooperation of two parts. First, a certain number of pictures need to be classified as preheating data for preheating cache processing. In this step, the scene structured data needs to be counted, the position coordinates of the line and arrow information, and the corresponding number of occurrences need to be recorded, and the corresponding data is stored in the cache according to the structured statistical table. After completing the processing of all preheating data of a batch, the data processing of the preheating cache stage is completed.

[0064] The second stage is to compare the current scene information with the scene data cache of the first stage. First, by comparing the device identification information of the current picture frame, the scene cache information of the corresponding camera device is matched in the cache record. Then, the time span is also considered in the comparison process. That is, the data within a certain range from the current time span is extracted and compared, so as to filter out the matching failure caused by the lens deflection caused by the large time span. In the limited time span, such as the records of several days, the changes of the equipment are generally very small. At this time, the cache records can provide a good repair for the missing data in the scene. Since the violation scene covers low-brightness night scenes and congested time scenes, various factors will cause the scene lines and arrows in the scene structured information of the current frame to be missing. When comparing with the cache, these missing information will be found. When completing the information, refer to the number of occurrences of the information recorded in the cache table, and select the attribute with the largest number of occurrences as the type attribute of the current information item to be supplemented.

[0065] This embodiment can better repair the missing scene information in vehicle occlusion and dark environment, and output the final scene structured information after completing the scene lines and scene arrows.

[0066] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0067] In this embodiment, a scene information processing device is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0068] Figure 4 is a schematic diagram of the structure of a scene information processing device according to an embodiment of the present invention. Figure 4 As shown, the device comprises:

[0069] A first acquisition module 402 is used to acquire a first group of pictures collected within a first time period;

[0070] A processing module 404 is used to perform a first process on the first group of pictures to obtain a set of scene information, wherein each scene information is used to represent a scene in a picture in the first group of pictures;

[0071] A second acquisition module 406 is used to acquire first scene information in a target picture, wherein the acquisition time of the target picture is a target time;

[0072] A determination module 408, configured to determine whether the first scene information has any missing information according to a set of scene information;

[0073] The repair module 410 is used to repair the first scene information according to a group of scene information to obtain second scene information when there is information missing in the first scene information.

[0074] In an optional embodiment, the repair module 410 includes:

[0075] A first repairing unit is configured to repair the line information in the first scene information according to the line information in a group of scene information when the line information in the first scene information is missing; and / or

[0076] The second repairing unit is used to repair the arrow information in the first scene information according to the arrow information in a group of scene information when the arrow information in the first scene information is missing.

[0077] In an optional embodiment, the first repair unit is used to repair the line information in the first scene information according to the line information in a group of scene information in the following manner: obtain a first acquisition device identifier corresponding to the first line information, wherein the first acquisition device identifier is used to indicate that the first line information is acquired by the first acquisition device, and the line information in the first scene information includes the first line information; obtain a group of second line information with the first acquisition device identifier in a group of scene information; determine the first target information missing from the group of second line information compared with the first line information, wherein the first target information is the information that appears the most times in the group of second line information; and repair the first scene information to the second scene information based on the first target information.

[0078] In an optional embodiment, the above-mentioned device is also used to: obtain a first time interval between a first time period and a target time; when the first time interval is less than a first predetermined threshold, determine a group of third line information from a group of second line information; determine the second target information missing from the group of third line information compared with the first line information; and repair the first scene information to the second scene information based on the second target information.

[0079] In an optional embodiment, the second repairing unit is used to repair the arrow information in the first scene information according to the arrow information in a set of scene information in the following manner:

[0080] Obtain a second acquisition device identifier corresponding to the first line information, wherein the second acquisition device identifier is used to indicate that the first line information is acquired by the second acquisition device, and the line information in the first scene information includes the first line information; obtain a group of second arrow information with the second acquisition device identifier in a group of scene information; determine from a group of second arrow information the third target information that is missing compared with the first arrow information, wherein the third target information is the information that appears the most times in the group of second arrow information; and repair the first scene information to the second scene information based on the third target information.

[0081] In an optional embodiment, the device is also used to: obtain a second time interval between the first time period and the target time; when the second time interval is less than a second predetermined threshold, determine a set of third arrow information from a set of second arrow information; determine fourth target information that is missing compared to the first arrow information from a set of third arrow information; and repair the first scene information to the second scene information based on the fourth target information.

[0082] In an optional embodiment, the above-mentioned determination module 408 is used to determine whether there is information missing in the first scene information based on a set of scene information in the following manner: obtaining a first comparison result between the first scene information and a set of scene information, wherein the first comparison result is used to indicate whether there is information missing in the line information in the first scene information; when the first comparison result indicates that the line information is missing, determining that there is information missing in the first scene information; and / or obtaining a second comparison result between the first scene information and a set of scene information, wherein the second comparison result is used to indicate whether there is information missing in the arrow information in the first scene information; when the second comparison result indicates that the arrow information is missing, determining that there is information missing in the first scene information.

[0083] In an optional embodiment, the processing module 404 is used to perform a first processing on the first group of pictures to obtain a group of scene information in the following manner: perform a first processing on the first group of pictures to obtain a group of scene information and a group of acquisition times, wherein a group of scene information corresponds to a group of acquisition times one by one, and each acquisition time in the group of acquisition times is an acquisition time of a corresponding picture in the first group of pictures;

[0084] The above-mentioned determination module 408 is used to determine whether there is any information missing in the first scene information based on a set of scene information in the following manner: determine whether there is any information missing in the first scene information based on a target scene information set in a set of scene information, wherein the time interval between the acquisition time corresponding to each scene information in the target scene information set and the target time is less than a predetermined threshold.

[0085] It should be noted that the above modules can be implemented by software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.

[0086] An embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.

[0087] In this embodiment, the computer-readable storage medium may be configured to store a computer program for performing the following steps:

[0088] S1, obtaining a first group of images collected in a first time period;

[0089] S2, performing a first process on the first group of pictures to obtain a set of scene information, wherein each piece of scene information is used to represent a scene in one of the first group of pictures;

[0090] S3, obtaining first scene information in a target image, wherein the acquisition time of the target image is a target time;

[0091] S4, determining whether the first scene information has information missing according to a set of scene information;

[0092] S5, when there is information missing in the first scene information, repair the first scene information according to a group of scene information to obtain second scene information.

[0093] The computer readable storage medium is further configured to store a computer program for performing the following steps:

[0094] S1, obtaining a first group of images collected in a first time period;

[0095] S2, performing a first process on the first group of pictures to obtain a set of scene information, wherein each piece of scene information is used to represent a scene in one of the first group of pictures;

[0096] S3, obtaining first scene information in a target image, wherein the acquisition time of the target image is a target time;

[0097] S4, determining whether the first scene information has information missing according to a set of scene information;

[0098] S5, when there is information missing in the first scene information, repair the first scene information according to a group of scene information to obtain second scene information.

[0099] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.

[0100] An embodiment of the present invention further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0101] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0102] In an exemplary embodiment, the processor may be configured to perform the following steps via a computer program:

[0103] S1, obtaining a first group of images collected in a first time period;

[0104] S2, performing a first process on the first group of pictures to obtain a set of scene information, wherein each piece of scene information is used to represent a scene in one of the first group of pictures;

[0105] S3, obtaining first scene information in a target image, wherein the acquisition time of the target image is a target time;

[0106] S4, determining whether the first scene information has information missing according to a set of scene information;

[0107] S5, when there is information missing in the first scene information, repair the first scene information according to a group of scene information to obtain second scene information.

[0108] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail herein.

[0109] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order than here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0110] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for processing scene information, characterized in that: include: Obtain a first set of images collected within a first time period; Performing a first process on the first group of pictures to obtain a set of scene information, wherein each piece of scene information is used to represent a scene in a picture in the first group of pictures; Acquire first scene information in a target image, wherein the acquisition time of the target image is a target time; Determining whether the first scene information has any missing information according to the set of scene information; In the case where the first scene information is missing, repairing the first scene information according to the set of scene information to obtain second scene information; The determining whether there is missing information in the first scene information based on the set of scene information includes: obtaining a first comparison result between the first scene information and the set of scene information, wherein the first comparison result is used to indicate whether there is missing information in line information in the first scene information, and the first comparison result is used to indicate whether the first scene information is consistent with the attributes of the same type of scene information in the set of scene information; when the first comparison result indicates missing line information, determining that there is missing information in the first scene information; and / or obtaining a second comparison result between the first scene information and the set of scene information, wherein the second comparison result is used to indicate whether there is missing information in arrow information in the first scene information; when the first comparison result indicates missing arrow information, determining that there is missing information in the first scene information.

2. The method according to claim 1, characterized in that When the first scene information is missing, repairing the first scene information according to the set of scene information includes: In the case where line information is missing from the first scene information, repairing the line information in the first scene information according to the line information in the set of scene information; and / or In the case where arrow information is missing in the first scene information, the arrow information in the first scene information is repaired according to the arrow information in the group of scene information.

3. The method according to claim 2, characterized in that Repairing the line information in the first scene information according to the line information in the set of scene information includes: Acquire a first acquisition device identifier corresponding to the first line information, wherein the first acquisition device identifier is used to indicate that the first line information is acquired by a first acquisition device, and the line information in the first scene information includes the first line information; Acquire a set of second line information having the first acquisition device identifier from the set of scene information; Determine, from the set of second line information, first target information that is missing compared with the first line information, wherein the first target information is the information that appears the most times in the set of second line information; The first scene information is restored to the second scene information based on the first target information.

4. The method according to claim 3, characterized in that The method further comprises: Acquire a first time interval between the first time period and the target time; When the first time interval is less than a first predetermined threshold, determining a group of third line information from the group of second line information; Determine, from the set of third line information, second target information missing compared with the first line information; The first scene information is restored to the second scene information based on the second target information.

5. The method according to claim 2, characterized in that: Repairing the arrow information in the first scene information according to the arrow information in the set of scene information includes: Acquire a second acquisition device identifier corresponding to the first line information, wherein the second acquisition device identifier is used to indicate that the first line information is acquired by the second acquisition device, and the line information in the first scene information includes the first line information; Acquire a set of second arrow information having the second acquisition device identifier from the set of scene information; Determine from the set of second arrow information the third target information that is missing compared to the first arrow information, wherein the third target information is the information that appears the most times in the set of second arrow information; The first scene information is restored to the second scene information based on the third target information.

6. The method according to claim 5, characterized in that include: Acquire a second time interval between the first time period and the target time; When the second time interval is less than a second predetermined threshold, determining a group of third arrow information from the group of second arrow information; Determining, from the set of third arrow information, fourth target information that is missing compared to the first arrow information; The first scene information is restored to the second scene information based on the fourth target information.

7. The method according to claim 1, characterized in that The performing the first processing on the first group of pictures to obtain a group of scene information includes: performing the first processing on the first group of pictures to obtain the group of scene information and a group of acquisition times, wherein the group of scene information corresponds to the group of acquisition times in a one-to-one manner, and each acquisition time in the group of acquisition times is an acquisition time of a corresponding picture in the first group of pictures; Determining whether there is information missing in the first scene information based on the set of scene information includes: determining whether there is information missing in the first scene information based on a target scene information set in the set of scene information, wherein the time interval between the acquisition time corresponding to each scene information in the target scene information set and the target time is less than a predetermined threshold.

8. A scene information processing device, characterized in that: include: A first acquisition module, used to acquire a first group of images collected within a first time period; a processing module, configured to perform a first processing on the first group of pictures to obtain a set of scene information, wherein each of the scene information is used to represent a scene in a picture in the first group of pictures; A second acquisition module is used to acquire first scene information in a target image, wherein the acquisition time of the target image is a target time; A determination module, configured to determine whether the first scene information has any missing information according to the set of scene information; a repairing module, configured to repair the first scene information according to the set of scene information to obtain second scene information when there is information missing in the first scene information; The device is used to determine whether there is information missing in the first scene information based on the set of scene information in the following manner: obtaining a first comparison result between the first scene information and the set of scene information, wherein the first comparison result is used to indicate whether there is information missing in line information in the first scene information, and the first comparison result is used to indicate whether the attributes of the first scene information and the same type of scene information in the set of scene information are consistent; when the first comparison result indicates that line information is missing, determining that there is information missing in the first scene information; and / or obtaining a second comparison result between the first scene information and the set of scene information, wherein the second comparison result is used to indicate whether there is information missing in arrow information in the first scene information; when the first comparison result indicates that arrow information is missing, determining that there is information missing in the first scene information.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program is configured to execute the method according to any one of claims 1 to 7 when executed.

10. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 7.

Images