Image simulation method and device
By generating simulation images that match the original image parameter information as a reference image, the problem of the debuggling person waiting for the specific environment is solved, and the efficiency of the image debugging and the efficiency of the tested personnel are improved.
Patent Information
- Application Number
- CN202210784925.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-29
- Publication Date
- 2025-01-28
- Estimated Expiration
- 2042-06-29
AI Technical Summary
In the prior art, debuggers need to wait for a specific environment to appear before taking reproduced images, resulting in low image debugging efficiency.
By obtaining the original images and its environmental labels waiting to be simulated, determine the matching simulation environment information, generate analog image and obtain its parameter information. Reap a reference image.
Provide multiple reference images for debuggers to improve the efficiency of image debugging, liberate manpower and energy, and cover a lot of camera scenes to improve the work efficiency of testers.
Smart Images

Figure CN115174893B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of software technology, and in particular to an image simulation method and device. Background Art
[0002] The imaging effect of terminal devices (such as mobile phones) is a prominent selling point of major brands. How to optimize the photo-taking effect more efficiently is particularly important for improving the overall value of terminal devices.
[0003] In the related art, the images captured by the terminal device are debugged by the debugging personnel to improve the display effect of the image. In the specific debugging process, the tester takes the original image of a scene in a specific environment, and then sends the original image to the debugger for debugging. The debugger needs to take the reproduced image corresponding to the original image in the same specific environment and obtain the 3A parameter information in the reproduced image. In this case, the debugger needs to wait for the specific environment to appear before taking the reproduced image and obtaining the 3A parameter information, which leads to low efficiency. Summary of the invention
[0004] The embodiments of the present application provide a method and device for image simulation, which are used to improve the efficiency of image debugging.
[0005] In a first aspect, an embodiment of the present application provides an image simulation method, comprising:
[0006] Acquire an original image corresponding to the scene to be simulated, and multiple original environment labels corresponding to the original image;
[0007] Taking at least one of the multiple original environment tags as a matching condition, determining multiple simulated environment information matching the scene to be simulated, each simulated environment information including multiple simulated environment tags;
[0008] For each piece of simulation environment information, based on a plurality of simulation environment tags corresponding to the simulation environment information, a simulation image under the simulation environment information is generated, and simulation parameter information corresponding to the simulation image is obtained;
[0009] If the association relationship between the original parameter information of the original image and the simulation parameter information corresponding to the simulation image meets a preset condition, the simulation image is used as a reproduction reference image of the original image.
[0010] The above image simulation method can provide debuggers with multiple reproduction reference images for shooting reproduction images of original images, giving debuggers more choices, thereby improving the efficiency of image debugging and freeing up a lot of manpower and energy for debuggers. Secondly, the above method can cover a large number of required photo shooting scenes, providing effective references for testers to shoot original images in the information library, effectively improving the work efficiency of testers and reducing labor costs.
[0011] Optionally, the simulation environment information of the reproduced reference image is sent to an image debugging end to instruct the image debugging end to capture the reproduced image corresponding to the original image based on the simulation environment information and perform image debugging on the reproduced image.
[0012] Optionally, generating a simulated image under the simulated environment information based on a plurality of simulated environment tags corresponding to the simulated environment information includes:
[0013] Based on a plurality of simulation environment tags corresponding to the simulation environment information, a simulation image of the scene to be simulated under the simulation environment information is generated; or,
[0014] Based on a plurality of simulation environment tags corresponding to the simulation environment information, simulation images of other preset scenes different from the scene to be simulated under the simulation environment information are generated.
[0015] Optionally, if the association relationship between the original parameter information of the original image and the simulation parameter information corresponding to the simulation image meets a preset condition, taking the simulation image as a reproduction reference image includes:
[0016] If the difference between the original parameter information and the simulated parameter information is smaller than a preset threshold, the simulated image is used as a reproduced reference image.
[0017] Optionally, obtaining an original image corresponding to the scene to be simulated includes:
[0018] An original image corresponding to the scene to be simulated is obtained from an information database, and the information database is updated in a closed-loop manner.
[0019] Optionally, the information database is updated in a closed-loop manner, including:
[0020] For each scene in the information library, multiple original images corresponding to the scene are used to simulate and obtain multiple reference simulated images of the scene under reference environment information;
[0021] Determining a weight of the scene based on a difference between reference parameter information of the plurality of reference simulated images and original parameter information of the plurality of original images;
[0022] If the weight of the scene is less than a preset threshold, a plurality of original images corresponding to the scene are re-photographed, and the information library is updated using the re-photographed plurality of original images.
[0023] Optionally, the original environment tag includes: a weather tag, a time tag and a light tag.
[0024] In a second aspect, an embodiment of the present application provides an image simulation device, including:
[0025] An acquisition module, used to acquire an original image corresponding to the scene to be simulated, and a plurality of original environment labels corresponding to the original image;
[0026] A matching module, configured to determine a plurality of simulated environment information matching the scene to be simulated, using at least one of the plurality of original environment tags as a matching condition, wherein each piece of simulated environment information includes a plurality of simulated environment tags;
[0027] A simulation module, for generating, for each piece of simulation environment information, a simulation image under the simulation environment information based on a plurality of simulation environment tags corresponding to the simulation environment information, and obtaining simulation parameter information corresponding to the simulation image;
[0028] The processing module is used to use the simulated image as a reproducing reference image of the original image if the association relationship between the original parameter information of the original image and the simulation parameter information corresponding to the simulated image meets a preset condition.
[0029] Optionally, the processing module is further used for:
[0030] The simulation environment information of the reproduced reference image is sent to the image debugging end to instruct the image debugging end to capture the reproduced image corresponding to the original image based on the simulation environment information and perform image debugging on the reproduced image.
[0031] Optionally, the simulation module is specifically used for:
[0032] Based on a plurality of simulation environment tags corresponding to the simulation environment information, a simulation image of the scene to be simulated under the simulation environment information is generated; or,
[0033] Based on a plurality of simulation environment tags corresponding to the simulation environment information, simulation images of other preset scenes different from the scene to be simulated under the simulation environment information are generated.
[0034] Optionally, the processing module is specifically used for:
[0035] If the difference between the original parameter information and the simulated parameter information is smaller than a preset threshold, the simulated image is used as a reproduced reference image.
[0036] Optionally, the acquisition module is specifically used for:
[0037] An original image corresponding to the scene to be simulated is obtained from an information database, and the information database is updated in a closed-loop manner.
[0038] Optionally, the processing module is further configured to:
[0039] For each scene in the information library, multiple original images corresponding to the scene are used to simulate and obtain multiple reference simulated images of the scene under reference environment information;
[0040] Determining a weight of the scene based on a difference between reference parameter information of the plurality of reference simulated images and original parameter information of the plurality of original images;
[0041] If the weight of the scene is less than a preset threshold, a plurality of original images corresponding to the scene are re-photographed, and the information library is updated using the re-photographed plurality of original images.
[0042] Optionally, the original environment tag includes: a weather tag, a time tag and a light tag.
[0043] In a third aspect, an embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, so that the processor executes the image simulation method described in the first aspect above.
[0044] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium storing a computer program executable by a computer device, wherein when the program is run on the computer device, the computer device executes the image simulation method described in the first aspect above.
[0045] In the embodiment of the present application, the environment simulation system uses at least one of the multiple original environment tags corresponding to the original image as a matching condition, determines multiple simulated environment information matching the scene to be simulated, and then generates multiple simulated images corresponding to each of the simulated environment information, and determines a reproduced reference image close to the original parameter information of the original image from the multiple simulated images, so as to provide multiple reproduced reference images for debugging personnel to shoot reproduced images of the original image, giving debugging personnel more choices, thereby improving the efficiency of image debugging, and also liberating a lot of manpower and energy of debugging personnel. At the same time, the information library can be updated in a closed loop, providing effective references for testers to shoot original images in the information library, and also improving the work efficiency of testers. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0047] Figure 1 A schematic diagram of a system architecture provided by an embodiment of the present invention;
[0048] Figure 2 A schematic diagram of a flow chart of an image simulation method provided by an embodiment of the present invention;
[0049] Figure 3 A schematic diagram of a closed-loop method for an information base provided by an embodiment of the present invention;
[0050] Figure 4 A schematic diagram of the structure of an image simulation device provided by an embodiment of the present invention;
[0051] Figure 5 A schematic diagram of the structure of a computing device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0052] In order to make the purpose, technical scheme and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0053] See also Figure 1 , a structural diagram of a system architecture is provided for the present application, the system architecture includes an information library 101 and an environment simulation system 102, wherein the environment simulation system 102 can be a terminal device or a server. The terminal device can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart home appliance, an intelligent voice interaction device, an intelligent vehicle-mounted device, etc., but is not limited thereto. The server 102 can be an independent physical server, or a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms. The information library 101 and the environment simulation system 102 can be directly or indirectly connected via wired or wireless communication, and the present application does not limit this.
[0054] based on Figure 1 The system architecture shown in FIG. 1 is a flow chart of an image simulation method provided in an embodiment of the present application. Figure 2 As shown, the process of the method is executed by a computer device, which may be Figure 1 The environmental simulation system 102 shown includes the following steps:
[0055] Step 201 , obtaining an original image corresponding to a scene to be simulated, and a plurality of original environment labels corresponding to the original image.
[0056] Specifically, the information library includes original images of multiple scenes, wherein the scene may be a scene selected by a customer, a user-defined scene, etc. In some embodiments, the information library is a 3A information library, wherein the 3A information library involves images taken by devices of different platforms and series.
[0057] In the information library, each scene corresponds to at least one original image, and each original image corresponds to multiple original environment tags (tag combinations under multiple hierarchical tags), and the original environment tags include at least two of the following tags: weather tag, time tag, light tag, indoor and outdoor tag. The scene to be simulated is the scene to be simulated selected from the multiple scenes in the information library.
[0058] For each scene in the information library, the scene includes the original images corresponding to all the label combinations under multiple levels of labels. For different original images corresponding to the scene, the corresponding label combinations are also different, and the corresponding image numbers are also different.
[0059] For example, the weather label includes four categories: sunny, rainy, cloudy and overcast; the time label includes four categories: morning 5 to 8, noon 9 to 12, afternoon 1 to 6, evening 7 to 9; the light label includes four categories: front light, natural light, back light and no light. Among them, front and back light can be defined according to the front and back light caused by sunrise and sunset. Some scenes require customized front and back light due to shooting direction. Front and back light caused by lights, and back light with high-brightness light source in the scene are defined as back light, etc.
[0060] For the original images of the same scene A, the image numbering method can be selected to be numbered in an enumeration manner. Under the same weather label (sunny day) and time label (5 o'clock in the morning) and different front and back light labels, the numbers of the four original images corresponding to scene A are: databank ID1 (the corresponding label combination is: sunny day, 5 o'clock in the morning, front light), databank ID2 (the corresponding label combination is: sunny day, 5 o'clock in the morning, natural light), databank ID3 (the corresponding label combination is: sunny day, 5 o'clock in the morning, back light), and databank ID4 (the corresponding label combination is: sunny day, 5 o'clock in the morning, no light).
[0061] Under the same weather label (rainy day) and time label (5 o'clock in the morning) and different front and back light labels, scene A corresponds to the numbers of 4 original images, namely: databank ID6 (the corresponding label combination is: sunny day, 5 o'clock in the morning, front light), databank ID7 (the corresponding label combination is: sunny day, 5 o'clock in the morning, natural light), databank ID8 (the corresponding label combination is: sunny day, 5 o'clock in the morning, back light), databank ID9 (the corresponding label combination is: sunny day, 5 o'clock in the morning, no light).
[0062] By analogy, the image numbers of all original images corresponding to scene A in the information library are obtained.
[0063] The parameter information of each original image in the information library is at least one of the following: light intensity parameter (lux, referred to as Lux), 3A (AE, AF, AWB) parameters, wherein the 3A parameters include automatic exposure (Automatic Exposure, referred to as AE), automatic focus (Automatic Focus, referred to as AF), and automatic white balance (Automatic White Balance, referred to as AWB).
[0064] Step 202: Taking at least one of the multiple original environment tags as a matching condition, determine multiple simulated environment information matching the scene to be simulated, each simulated environment information including multiple simulated environment tags.
[0065] Specifically, the environment simulation system pre-simulates multiple simulated environment information, each of which includes multiple simulated environment tags. For each simulated environment information, when at least one simulated environment tag in the simulated environment information is the same as the original environment tag, it is determined that the simulated environment information matches the scene to be simulated.
[0066] For example, the multiple original environment labels of the original image are set to include: "Sunny, 9 am, natural light", and 5 simulated environment information are pre-simulated, including simulated environment information 1 (the corresponding multiple simulated environment labels are: sunny, 1 pm, backlight), simulated environment information 2 (the corresponding multiple simulated environment labels are: cloudy, 7 am, natural light), simulated environment information 3 (the corresponding multiple simulated environment labels are: sunny, 9 am, direct light), simulated environment information 4 (the corresponding multiple simulated environment labels are: sunny, 9 am, natural light), and environment information 5 (the corresponding multiple simulated environment labels are: cloudy, 5 pm, backlight)".
[0067] The multiple original environment labels of the original image are compared with the multiple simulated environment labels of each simulated environment information, among which the weather label (sunny) in the simulated environment information 1 is the same as the weather label (sunny) of the original image. Therefore, the simulated environment information 1 is the simulated environment information that matches the scene to be simulated.
[0068] The light label (natural light) in the simulated environment information 2 is the same as the weather label (natural light) of the original image. Therefore, the simulated environment information 2 is the simulated environment information that matches the scene to be simulated.
[0069] The light label (sunny) and time label (9 am) in the simulated environment information 3 are the same as the weather label (sunny) and time label (9 am) of the original image. Therefore, the simulated environment information 3 is the simulated environment information that matches the scene to be simulated.
[0070] The light label (sunny), time label (9 a.m.) and light label (natural light) in the simulated environment information 4 are the same as the weather label (sunny), time label (9 a.m.) and light label (natural light) of the original image. Therefore, the simulated environment information 4 is the simulated environment information that matches the scene to be simulated.
[0071] The light label (cloudy), time label (5 pm) and light label (backlight) in the simulated environment information 5 are all different from the weather label light label (sunny), time label (9 am) and light label (natural light) of the original image. Therefore, the simulated environment information 5 does not match the scene to be simulated.
[0072] Step 203 : for each piece of simulation environment information, based on a plurality of simulation environment tags corresponding to the simulation environment information, a simulation image under the simulation environment information is generated, and simulation parameter information corresponding to the simulation image is obtained.
[0073] The simulation parameter information of the simulated image is at least one of the following: light intensity parameter (lux, referred to as Lux), 3A (AE, AF, AWB) parameters, 3A parameters include automatic exposure (Automatic Exposure, referred to as AE), automatic focus (Automatic Focus, referred to as AF), automatic white balance (Automatic white balance, referred to as AWB), and the Lux value is calculated using the following formula (1):
[0074] Lux value = (weather + time * backlight coefficient) / 2…………(1)
[0075] In some embodiments, based on multiple simulation environment tags corresponding to the simulation environment information, a simulation image of the scene to be simulated under the simulation environment information is generated; or, based on multiple simulation environment tags corresponding to the simulation environment information, a simulation image of other preset scenes different from the scene to be simulated under the simulation environment information is generated.
[0076] Specifically, based on the multiple simulated environment tags corresponding to the simulated environment information and the scene to be simulated, a simulated image of the scene to be simulated under the simulated environment information can be generated, and the scene of the simulated image is the same as the scene in the corresponding original image. When the multiple simulated environment tags of the simulated image are the same as the multiple original environment tags of the original image, the simulated image and the original image are substantially the same image. When the multiple simulated environment tags of the simulated image and the multiple original environment tags of the original image are different in at least one environment tag, the simulated image and the original image are images with the same scene but different corresponding environments.
[0077] Of course, in an embodiment of the present application, other preset scenes different from the scene to be simulated may be obtained first, and then, based on multiple simulation environment labels and other preset scenes corresponding to the simulation environment information, simulated images of other preset scenes under the simulation environment information may be generated, and the scene of the simulated image may be different from the scene in the corresponding original image.
[0078] Step 204: If the correlation between the original parameter information of the original image and the simulation parameter information corresponding to the simulation image satisfies a preset condition, the simulation image is used as a reproducing reference image of the original image.
[0079] Specifically, if the difference between the original parameter information and the simulated parameter information is smaller than a preset threshold, the simulated image is used as a reproduced reference image.
[0080] The difference between the original parameter information and the simulated parameter information can be calculated by selecting a relevant algorithm according to the actual situation. For example, the difference between the original parameter information and the simulated parameter information is used as the difference between the original parameter information and the simulated parameter information; the ratio between the original parameter information and the simulated parameter information is used as the difference between the original parameter information and the simulated parameter information; the difference between the original parameter information and the simulated parameter information is first obtained, and then the ratio between the difference and the original parameter information is used as the difference between the original parameter information and the simulated parameter information; of course, other methods can also be used to obtain the difference, and this application does not make specific limitations on this.
[0081] For example, the parameter information is set to use the illumination intensity parameter, and the difference threshold between the original parameter information and the simulated parameter information is set to 150. The multiple original environment labels of the original image 1 are set to "sunny day, 2 pm, backlight", and the scene is scene A. The illumination intensity parameter of the original image 1 is obtained as 1700 using the above formula (1).
[0082] The multiple simulated environment labels of the obtained simulated image 1 are set to "cloudy day, 2 pm, natural light", and the scene is scene A. The illumination intensity parameter of the simulated image 1 obtained by using the above formula (1) is 1000.
[0083] The multiple simulated environment labels of the obtained simulated image 2 are set to "cloudy day, 12 am, backlight", and the scene is scene B. The illumination intensity parameter of the simulated image 2 obtained by using the above formula (1) is 1600.
[0084] The difference in illumination intensity parameters between simulated image 1 and original image A is 700, which is much larger than the set difference threshold; the difference in illumination intensity parameters between simulated image 2 and original image A is 100, which is smaller than the set difference threshold, so simulated image 2 is used as the reproduction reference image.
[0085] Optionally, the simulation environment information of the reproduced reference image is sent to the image debugging end to instruct the image debugging end to capture the reproduced image corresponding to the original image based on the simulation environment information and perform image debugging on the reproduced image.
[0086] Specifically, the personnel at the debugging end use the simulated environment information of the reproduced reference image as a benchmark, shoot the reproduced image and the debugging reference image of the original image under the simulated environment information, and then debug the parameter information (including but not limited to 3A parameters) of the reproduced image to obtain the target debugging image; compare the target debugging image with the debugging reference image to obtain the debugging effect, wherein the target debugging image should be as close as possible to the debugging reference image, so as to obtain a good debugging effect.
[0087] In an embodiment of the present application, the environment simulation system uses at least one of the multiple original environment tags corresponding to the original image as a matching condition, determines multiple simulated environment information that matches the scene to be simulated, and then generates simulated images corresponding to each of the multiple simulated environment information, and determines a reproduced reference image that is close to the original parameter information of the original image from the multiple simulated images. The above method can provide debuggers with multiple reproduced reference images for shooting reproduced images of original images, giving debuggers more choices, thereby improving the efficiency of image debugging, and also liberating a lot of manpower and energy of debuggers. Secondly, the above method can cover a large number of required photo scenes, provide effective references for testers to shoot original images in the information library, effectively improve the workload efficiency of testers, and reduce labor costs.
[0088] In some embodiments, the original image corresponding to the scene to be simulated is obtained from the information library, and the information library is updated in a closed-loop manner, such as Figure 3 As shown, the following steps are included:
[0089] Step 301, for each scene in the information library, using multiple original images corresponding to the scene, simulate and obtain multiple reference simulated images of the scene under reference environment information;
[0090] Step 302, determining the weight of the scene based on the difference between the reference parameter information of the plurality of reference simulated images and the original parameter information of the plurality of original images;
[0091] Step 303: if the weight of the scene is less than a preset threshold, a plurality of original images corresponding to the scene are re-photographed, and the information database is updated using the re-photographed plurality of original images.
[0092] Specifically, the difference between the simulation parameter information of each reference simulation image and the original parameter information of the corresponding original image can be determined first, wherein the calculation method of the difference has been introduced in the previous text and will not be repeated here. Then, the multiple differences obtained for a scene are used to determine the accuracy of the scene when used for image simulation, and then the weight corresponding to the scene is determined based on the accuracy. The larger the weight corresponding to the scene, the more suitable the scene is for image simulation. The smaller the weight corresponding to the scene, the less suitable the scene is for image simulation. Therefore, when the weight of the scene is less than a preset threshold (for example, 75%), in order to ensure the accuracy of subsequent image simulation, it is necessary to re-shoot multiple original images corresponding to the scene, and use the re-shot multiple original images to update the information library.
[0093] For example, when the preset threshold of the weight is set to 75%, for scene 1, corresponding to original image A, original image B and original image C, the Lux value of the original image is 1700, and the Lux value of the reference simulated image a obtained by simulating the original image A is 1500, then the difference between the reference parameter information of the simulated image and the original parameter information of the original image is 88.2%;
[0094] The Lux value of the reference simulated image b obtained by simulating the original image B is 1000, so the difference between the reference parameter information of the simulated image and the original parameter information of the original image is 58.8%;
[0095] The Lux value of the reference simulated image c obtained by simulating the original image C is 1300, so the difference between the reference parameter information of the simulated image and the original parameter information of the original image is 76.5%.
[0096] The three differences obtained above are averaged to obtain an accuracy rate of 74.5% for scene 1, that is, a weight of 74.5% for scene 1. Since the weight of scene 1 is less than a preset threshold, the original image corresponding to scene 1 needs to be re-shot.
[0097] In an embodiment of the present application, the weight of each scene is determined based on the accuracy of the original images of each scene when performing image simulation, and then for scenes with weights less than a preset threshold, multiple original images corresponding to the scene are re-shot, and the information library is updated in a closed loop using the re-shot multiple original images, thereby ensuring the accuracy of the original images in the information library when performing image simulation, thereby improving the accuracy of subsequent image debugging.
[0098] Based on the same technical concept, the present application embodiment provides a schematic diagram of the structure of an image simulation device, such as Figure 4 As shown, the device 400 includes:
[0099] The acquisition module 401 is used to acquire an original image corresponding to the scene to be simulated, and a plurality of original environment labels corresponding to the original image;
[0100] A matching module 402, configured to determine a plurality of simulated environment information matching the scene to be simulated, using at least one of the plurality of original environment tags as a matching condition, wherein each simulated environment information includes a plurality of simulated environment tags;
[0101] The simulation module 403 is used to generate, for each piece of simulation environment information, a simulation image under the simulation environment information based on a plurality of simulation environment tags corresponding to the simulation environment information, and obtain simulation parameter information corresponding to the simulation image;
[0102] The processing module 404 is configured to use the simulated image as a reproducing reference image of the original image if the correlation between the original parameter information of the original image and the simulation parameter information corresponding to the simulated image meets a preset condition.
[0103] Optionally, the processing module 404 is further configured to:
[0104] The simulation environment information of the reproduced reference image is sent to the image debugging end to instruct the image debugging end to capture the reproduced image corresponding to the original image based on the simulation environment information and perform image debugging on the reproduced image.
[0105] Optionally, the simulation module 403 is specifically used for:
[0106] Based on a plurality of simulation environment tags corresponding to the simulation environment information, a simulation image of the scene to be simulated under the simulation environment information is generated; or,
[0107] Based on a plurality of simulation environment tags corresponding to the simulation environment information, simulation images of other preset scenes different from the scene to be simulated under the simulation environment information are generated.
[0108] Optionally, the processing module 404 is specifically configured to:
[0109] If the difference between the original parameter information and the simulated parameter information is smaller than a preset threshold, the simulated image is used as a reproduced reference image.
[0110] Optionally, the acquisition module 401 is specifically used for:
[0111] An original image corresponding to the scene to be simulated is obtained from an information database, and the information database is updated in a closed-loop manner.
[0112] Optionally, the processing module 404 is further configured to:
[0113] For each scene in the information library, multiple original images corresponding to the scene are used to simulate and obtain multiple reference simulated images of the scene under reference environment information;
[0114] Determining a weight of the scene based on a difference between reference parameter information of the plurality of reference simulated images and original parameter information of the plurality of original images;
[0115] If the weight of the scene is less than a preset threshold, a plurality of original images corresponding to the scene are re-photographed, and the information library is updated using the re-photographed plurality of original images.
[0116] Optionally, the original environment tag includes: a weather tag, a time tag and a light tag.
[0117] In the embodiment of the present application, the environment simulation system uses at least one of the multiple original environment tags as a matching condition, determines multiple simulated environment information that matches the scene to be simulated, and then generates multiple simulated images corresponding to each of the simulated environment information, and determines a reproduced reference image close to the original parameter information of the original image from the multiple simulated images. Multiple reproduced reference images can be provided for debugging personnel to shoot reproduced images of original images, giving debugging personnel more choices, thereby improving the efficiency of image debugging, and also liberating a lot of manpower and energy of debugging personnel. Secondly, it can also cover a large number of required photo scenes, provide effective references for test personnel to shoot original images in the information library, effectively improve the work efficiency of test personnel, and reduce labor costs.
[0118] Based on the same technical concept, the embodiment of the present application provides a computer device, which can be Figure 1 The environmental simulation system 102 shown in FIG. Figure 5 As shown, it includes at least one processor 501 and a memory 502 connected to the at least one processor. The specific connection medium between the processor 501 and the memory 502 is not limited in the embodiment of the present application. Figure 5 For example, the processor 501 and the memory 502 are connected via a bus. The bus can be divided into an address bus, a data bus, a control bus, etc.
[0119] In the embodiment of the present application, the memory 502 stores instructions that can be executed by at least one processor 501, and the at least one processor 501 can perform the steps of the above-mentioned image simulation method by executing the instructions stored in the memory 502.
[0120] Among them, the processor 501 is the control center of the computer device, and various interfaces and lines can be used to connect various parts of the computer device. By running or executing instructions stored in the memory 502 and calling data stored in the memory 502, the matching and calling of the simulated environment information are realized, and then the simulation of the simulated environment information and the scene to be simulated is realized. Optionally, the processor 501 may include one or more processing units, and the processor 501 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application program, etc., and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 501. In some embodiments, the processor 501 and the memory 502 may be implemented on the same chip, and in some embodiments, they may also be implemented separately on independent chips.
[0121] The processor 501 may be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit (ASIC), a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and may implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.
[0122] The memory 502 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 502 may include at least one type of storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory, a random access memory (Random Access Memory, RAM), a static random access memory (Static Random Access Memory, SRAM), a programmable read-only memory (Programmable Read Only Memory, PROM), a read-only memory (Read Only Memory, ROM), an electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), a magnetic memory, a disk, an optical disk, etc. The memory 502 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer device, but is not limited thereto. The memory 502 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.
[0123] Based on the same inventive concept, an embodiment of the present application provides a computer-readable storage medium storing a computer program executable by a computer device. When the program runs on the computer device, the computer device executes the steps of the above-mentioned image simulation method.
[0124] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.
[0125] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0126] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0127] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0128] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. An image simulation method, characterized in that: include: Acquire an original image corresponding to a scene to be simulated from an information database, the information database being updated in a closed-loop manner, and a plurality of original environment labels corresponding to the original image; Taking at least one of the multiple original environment tags as a matching condition, determining multiple simulated environment information matching the scene to be simulated, each simulated environment information including multiple simulated environment tags; For each piece of simulation environment information, based on a plurality of simulation environment tags corresponding to the simulation environment information, a simulation image under the simulation environment information is generated, and simulation parameter information corresponding to the simulation image is obtained; If the correlation relationship between the original parameter information of the original image and the simulation parameter information corresponding to the simulation image meets a preset condition, the simulation image is used as a reproduction reference image of the original image; The information library is updated in the following closed-loop manner: for each scene in the information library, multiple original images corresponding to the scene are used to simulate and obtain multiple reference simulated images of the scene under reference environment information; based on the difference between reference parameter information of the multiple reference simulated images and original parameter information of the multiple original images, the weight of the scene is determined; If the weight of the scene is less than a preset threshold, a plurality of original images corresponding to the scene are re-photographed, and the information library is updated using the re-photographed plurality of original images.
2. The method according to claim 1, characterized in that Also includes: The simulation environment information of the reproduced reference image is sent to the image debugging end to instruct the image debugging end to capture the reproduced image corresponding to the original image based on the simulation environment information and perform image debugging on the reproduced image.
3. The method according to claim 1, characterized in that The step of generating a simulated image under the simulated environment information based on a plurality of simulated environment tags corresponding to the simulated environment information includes: Based on a plurality of simulation environment tags corresponding to the simulation environment information, a simulation image of the scene to be simulated under the simulation environment information is generated; or, Based on a plurality of simulation environment tags corresponding to the simulation environment information, simulation images of other preset scenes different from the scene to be simulated under the simulation environment information are generated.
4. The method according to claim 1, characterized in that If the association relationship between the original parameter information of the original image and the simulation parameter information corresponding to the simulation image meets a preset condition, taking the simulation image as a reproduction reference image includes: If the difference between the original parameter information and the simulated parameter information is smaller than a preset threshold, the simulated image is used as a reproduced reference image.
5. The method according to any one of claims 1 to 4, characterized in that: The original environment tags include: weather tags, time tags and light tags.
6. An image simulation device, characterized in that: include: An acquisition module, used to acquire an original image corresponding to a scene to be simulated from an information base, the information base being updated in a closed-loop manner, and a plurality of original environment labels corresponding to the original image; A matching module, configured to determine a plurality of simulated environment information matching the scene to be simulated, using at least one of the plurality of original environment tags as a matching condition, wherein each piece of simulated environment information includes a plurality of simulated environment tags; A simulation module, for generating, for each piece of simulation environment information, a simulation image under the simulation environment information based on a plurality of simulation environment tags corresponding to the simulation environment information, and obtaining simulation parameter information corresponding to the simulation image; a processing module, configured to use the simulated image as a reproducing reference image of the original image if the association relationship between the original parameter information of the original image and the simulation parameter information corresponding to the simulated image meets a preset condition; The acquisition module is further used to simulate, for each scene in the information library, a plurality of original images corresponding to the scene to obtain a plurality of reference simulated images of the scene under reference environment information; and determine the weight of the scene based on the difference between the reference parameter information of the plurality of reference simulated images and the original parameter information of the plurality of original images; If the weight of the scene is less than a preset threshold, a plurality of original images corresponding to the scene are re-photographed, and the information library is updated using the re-photographed plurality of original images.
7. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of any one of the methods of claims 1-5 are implemented.
8. A computer-readable storage medium, characterized in that: It stores a computer program executable by a computer device, and when the program is run on the computer device, the computer device executes the steps of any method described in claims 1-5.
Citation Information
Patent Citations
Image generation method and device and related equipment
CN110009018A
Image processing method and system for automatic driving simulation environment color temperature
CN113989394A