Method, device and recording medium for updating image brightness

Abstract

According to one embodiment, a method, a device for implementing such a method, and a recording medium are disclosed, comprising: a step of acquiring a 2D image of an object; a step of acquiring a 3D image of the object; a step of determining an object region corresponding to the object within the 2D image using the 2D image and the 3D image; a step of acquiring object brightness information indicating brightness for a part or all of the object region; a step of updating at least one of a light amount and an exposure amount used to acquire the 2D image based on the object brightness information; and a step of acquiring a 2D image in which the brightness is updated as at least one of the light amount and the exposure amount is updated.

Description

Technology Field

[0001] The present disclosure relates to a method for updating image brightness. More specifically, it relates to a technique for providing a method for updating brightness for some or all of a 2D image. Background Technology

[0002] Conventional oral scanners scan a wide variety of targets, including plaster tooth models, plastic tooth models, metal prosthetics, and oral teeth and gums. Since the primary targets are oral teeth and gums, hardware settings are optimized to scan them. However, fixed hardware settings often result in the inability to scan the diverse targets mentioned above, or lead to poor quality of the scanned results. Furthermore, because scan data acquisition depends on projector light intensity and camera settings, significant variations in the obtained data occur depending on these factors. Consequently, there is a demand for technology that resolves these issues to ensure consistent scan data quality even when the environment changes. Prior art literature

[0003] Korean Published Patent No. 10-2018-0109412 (October 8, 2018) CT-based 3D tooth data generation system The problem to be solved

[0004] One embodiment of the present disclosure aims to solve the problems of the aforementioned prior art and to provide a method, device, and recording medium that enable scan data of a certain quality to be obtained by updating the brightness of an image.

[0005] The technical problem to be solved is not limited to the technical problem described above, and may include various other technical problems within the scope obvious to a person skilled in the art. means of solving the problem

[0006] A method for updating the brightness of an image according to the first aspect of the present disclosure may include: acquiring a 2D image of an object; acquiring a 3D image of the object; determining an object region corresponding to the object within the 2D image using the 2D image and the 3D image; acquiring object brightness information indicating the brightness of a part or all of the object region; updating at least one of a light amount and an exposure amount used to acquire the 2D image based on the object brightness information; and acquiring a 2D image in which the brightness is updated as at least one of the light amount and the exposure amount is updated.

[0007] In addition, the 2D image includes a plurality of 2D pattern images representing a plurality of patterns for the object, and the step of acquiring the 3D image can be acquired based on the plurality of 2D pattern images for the object.

[0008] Additionally, the step of determining the object area may include: determining a specific object area within the 3D image that includes a specific range of depths based on depth information of the 3D image; and aligning the specific object area with the object area within the 2D image.

[0009] In addition, the step of acquiring the object brightness information may acquire the object brightness information for the object area excluding the background area that does not include the depth of the specific range.

[0010] Additionally, the step of updating at least one of the light quantity and exposure quantity may update at least one of the light quantity and exposure quantity such that the average brightness corresponds to the reference brightness in proportion to the difference between the reference brightness, which serves as a reference for updating the brightness of the object area.

[0011] Additionally, the step of updating at least one of the light quantity and exposure amount may include: a step of obtaining a comparison result between the average brightness and the reference brightness; and a step of updating the light quantity and the exposure amount to decrease based on the comparison result if the average brightness is higher than the reference brightness.

[0012] Additionally, the step of updating at least one of the light amount and exposure amount may include: a step of obtaining a comparison result between the average brightness and the reference brightness; and a step of updating the exposure amount to increase if, based on the comparison result, the average brightness is lower than the reference brightness.

[0013] Additionally, the step of updating at least one of the light amount and exposure amount may further include the step of updating the light amount to increase when the updated average brightness of the object area obtained as the exposure amount is updated to increase is lower than the reference brightness.

[0014] Additionally, the step of updating at least one of the light quantity and exposure amount may include: a step of updating a reference brightness that serves as a reference for updating the brightness of the object area based on the degree of brightness difference between the minimum brightness, maximum brightness, and average brightness; and a step of updating at least one of the light quantity and exposure amount so that the average brightness corresponds to the updated reference brightness.

[0015] Additionally, the step of updating the reference brightness may include: a step of determining an allowable brightness range in which brightness expression is possible in the object area based on the reference brightness; and a step of updating the reference brightness based on whether the minimum brightness and the maximum brightness are included in the allowable brightness range.

[0016] Additionally, the step of updating at least one of the light quantity and exposure quantity may include: determining a minimum allowable brightness and a maximum allowable brightness in the object area based on the brightness allowable range; and updating at least one of the light quantity and exposure quantity based on the brightness difference between the minimum brightness and the minimum allowable brightness, the brightness difference between the maximum brightness and the maximum allowable brightness, the brightness difference between the minimum brightness and the average brightness, the brightness difference between the maximum brightness and the average brightness, and the brightness difference between the reference brightness and the average brightness.

[0017] A device for updating image brightness according to a second aspect of the present disclosure may include: a receiver for acquiring a 2D image of an object; and a processor for acquiring a 3D image of the object, determining an object region corresponding to the object within the 2D image using the 2D image and the 3D image, acquiring object brightness information indicating brightness for a part or all of the object region, updating at least one of a light amount and an exposure amount used to acquire the 2D image based on the object brightness information, and acquiring a 2D image in which brightness is updated as at least one of the light amount and the exposure amount is updated.

[0018] Additionally, the 2D image includes a plurality of 2D pattern images representing a plurality of patterns for the object, and the 3D image can be obtained based on the plurality of 2D pattern images for the object.

[0019] In addition, the processor can determine a specific target area within the 3D image that includes a specific range of depths based on depth information of the 3D image, and correspond the specific target area to the target area within the 2D image.

[0020] A third aspect of the present disclosure may provide a computer-readable recording medium storing a program for executing the method according to the first aspect on a computer. Alternatively, a fourth aspect of the present disclosure may provide a computer program stored on a recording medium for implementing the method according to the first aspect. Effects of the invention

[0021] According to one embodiment, there is an effect that scan targets of various materials can all be scanned with a constant brightness.

[0022] In addition, by using 3D images to utilize brightness for a specific range area, the brightness can be automatically updated, which has the effect of increasing the accuracy of scan data in the required area.

[0023] The effects of the present disclosure are not limited to the effects described above, and should be understood to include all effects that can be inferred from the detailed description of the present disclosure or the configuration of the disclosure as described in the claims. Brief explanation of the drawing

[0024] FIG. 1 is a block diagram showing an example of the configuration of a device according to one embodiment. FIG. 2 is a flowchart illustrating a method for a device according to one embodiment to acquire a 2D image with updated brightness. FIG. 3 is a diagram illustrating an example in which a device according to one embodiment acquires a plurality of 2D pattern images. Figure 4 is a diagram illustrating an example in which the average brightness of an image is obtained according to a conventional average brightness determination method. FIG. 5 is a drawing illustrating an example in which a device according to one embodiment determines an object area and / or a specific target area. FIG. 6 is a diagram for explaining an example of a device according to one embodiment acquiring object brightness information by comparing it with a conventional average brightness update method. FIG. 7 is a diagram showing an example in which a 2D image with updated brightness is obtained from a device according to one embodiment. FIG. 8 is a diagram showing the evaluation results for scan data obtained as the device according to one embodiment updates the brightness of an image. Specific details for implementing the invention

[0025] The terms used in the embodiments have been selected to be as widely used and general as possible, taking into account their functions; however, these may vary depending on the intentions of users in the field, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the relevant description of the invention. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0026] When a part of the specification is described as “comprising” a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as “…part” as used in the specification refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or as a combination of hardware and software.

[0027] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein.

[0028] Throughout the specification, the term “region” may be interpreted as a concept that includes both two-dimensional and three-dimensional dimensions.

[0029] A plurality of embodiments will be described in detail below with reference to the drawings.

[0030] In one embodiment, the computing device may include a device and a server that perform various embodiments. The computing device is not limited to either the device or the server; it may perform operations according to various embodiments through the device, or it may perform operations according to various embodiments through the server. Specifically, the following description will focus on an embodiment in which the device independently updates image brightness, but as mentioned above, it may also be performed through interaction with a server. That is, the device and the server according to one embodiment may be integrated and implemented as a computing device in terms of their functions, the server may be omitted, and it can be seen that they are not limited to any one embodiment. That is, the device and the server may be interconnected, and the configuration for updating image brightness as a computing device may be performed on the server or on the device. For example, the device (100) may operate as a server, and the device (100) will be referred to uniformly in the following description.

[0031] FIG. 1 is a block diagram showing an example of the configuration of a device (100) according to one embodiment.

[0032] Referring to FIG. 1, the device (100) may include a receiver (110), a processor (120), and a display (130). The processor (120) may be one or a plurality of.

[0033] A person skilled in the art will understand that, in addition to the components shown in FIG. 1, other general-purpose components may be further included in the device (100). For example, the device (100) may further include a memory (not shown). Or, according to other embodiments, a person skilled in the art will understand that some of the components shown in FIG. 1 may be omitted.

[0034] A receiving unit (110) according to one embodiment can acquire a 2D image of an object. Specifically, a 2D image can be acquired through scan data. Scan data can be received through a scanner or an external device. Referring to FIG. 1, a wireless terminal (140) or a wired terminal (150) may be an example of an external device, and the receiving unit (110) can receive scan data of a user's oral cavity from an external device or an internal device.

[0035] A processor (120) according to one embodiment can acquire a 3D image of an object. The 3D image may represent a three-dimensional image corresponding to the same image as the 2D image. Additionally, the processor (120) can determine an object region corresponding to the object within the 2D image using the 2D image and the 3D image. Additionally, the processor (120) can acquire object brightness information indicating the brightness of part or all of the object region. Additionally, the processor (120) can update at least one of the light intensity and exposure amount used to acquire the 2D image based on the object brightness information. Additionally, the processor (120) can acquire a 2D image with updated brightness as at least one of the light intensity and exposure amount is updated.

[0036] Additionally, the processor (120) may control the display (130) to provide a 2D image, a 2D image with updated brightness. Here, “providing” may include not only the transmission of information but also an example of displaying information or an image on the display (130).

[0038] The embodiments described above with reference to FIG. 1 will be explained in more detail with reference to FIG. 2 to FIG. 8.

[0039] FIG. 2 is a flowchart illustrating a method for a device (100) according to one embodiment to acquire a 2D image with updated brightness.

[0040] In step S210, the device (100) according to one embodiment acquires a 2D image of an object.

[0041] In one embodiment, the object may represent any one object that is to be scanned. The 2D image may be scan data captured of the object. Specifically, the device (100) may be an example of an oral scanner or a separate device that controls the oral scanner. The device (100) may acquire scan data of the oral cavity. The object may be an object included in the oral cavity, such as teeth or gums.

[0042] In step S220, the device (100) according to one embodiment acquires a 3D image of an object.

[0043] In one embodiment, the object in the 3D image represents the same object as the object in the 2D image acquired in step S210, and the 2D image and the 3D image may be a planar image and a three-dimensional image of the same image taken at the same direction and at the same location for the same object. Specifically, the 3D image may represent a three-dimensional depth map containing depth information for the object. In one embodiment, the 2D image may include a plurality of 2D pattern images representing a plurality of patterns for the object. For example, the device (100) may acquire a plurality of 2D pattern images containing different patterns by irradiating a plurality of pattern lights at the same direction and at the same location for the same object. The device (100) may acquire a 3D image based on the plurality of 2D pattern images for the object. In this regard, the following will be explained with reference to FIG. 3.

[0044] FIG. 3 is a drawing for explaining an example in which a device (100) according to one embodiment acquires a plurality of 2D pattern images.

[0045] Referring to FIG. 3, the device (100) can acquire multiple 2D pattern images by irradiating different pattern lights onto the same object. The device (100) can acquire a 3D image representing a depth map by comparing and analyzing the distance from the camera controlled by the device (100) to the object using the acquired multiple 2D pattern images.

[0046] In step S230, the device (100) according to one embodiment determines an object region corresponding to an object within the 2D image using a 2D image and a 3D image.

[0047] In one embodiment, the device (100) can determine a specific target area within a 3D image that includes a specific range of depths based on depth information of the 3D image. For example, there may be a specific range of depths that is expected to correspond to the depth of each object, such as teeth or gums. The device (100) can determine a specific target area within the 3D image that has a depth included in a specific range for determining the target area. The device (100) can correspond the specific target area to the target area within the 2D image. In one embodiment, the 3D image is an image that corresponds to a depth map for the same image as the 2D image. By corresponding the specific target area determined on the 3D image to the 2D image, the device (100) can determine a target area corresponding to the specific target area on the 2D image.

[0048] In step S240, the device (100) according to one embodiment can obtain object brightness information indicating brightness for part or all of the object area.

[0049] The device (100) can obtain object brightness information for an object area. Specifically, the device (100) can obtain object brightness information for an object area excluding a background area that does not include a specific range of depth. The device (100) can obtain object brightness information representing the brightness of only the object area from which the brightness of the background area is excluded, by determining at least one pixel area on a 3D image where the depth does not fall within a specific range as a background area other than the object area. For example, the object brightness information may include the brightness of at least one pixel area included in the object area. For example, the device (100) may determine at least one of the minimum brightness for a pixel area having a minimum brightness value among at least one pixel area included in the object area, the maximum brightness for a pixel area having a maximum brightness value, and the average brightness for the brightness values ​​of at least one pixel area included in the object area as the object brightness representing the representative brightness of the object area. In this regard, this will be explained with reference to FIGS. 4 and FIGS. 5.

[0050] Figure 4 is a diagram illustrating an example in which the average brightness of an image is obtained according to a conventional average brightness determination method.

[0051] Referring to FIG. 4, A is an image with an average brightness of 40, B and D are images with an average brightness of 125, and C is an image with an average brightness of 100. According to a conventional method for determining average brightness, the average value of the brightness values ​​of the entire pixel area on a 2D image can be determined as the average brightness of the image. In FIG. 4, images A and B represent images in which the subject area (e.g., teeth and / or gums) is magnified compared to images C and D. Although the brightness of the subject area in images A and C appears similar, the average brightness of image A is determined to be 40, while the average brightness of image C is determined to be 100, which is significantly different. Additionally, although the brightness of the subject area in images B and D appears significantly different, the average brightness of images B and D is the same at 125. In other words, conventionally, the average brightness is determined using the entire pixel area included in the 2D image without distinguishing between the object area and the background area. Therefore, there is a characteristic that the average brightness may be determined differently even if the object area actually has the same brightness, as it is influenced by the degree of magnification of the object area in the 2D image and the brightness values ​​of each of the multiple pixel areas included in the background area. Specifically, because the brightness value of the multiple pixel area included in the background area of ​​Image C is darker than the brightness value of the multiple pixel area included in the background area of ​​Image A and the proportion occupied by the object area in the image is different, the average brightness of Image A and Image C may be determined differently as 40 and 100, respectively, even if the brightness values ​​of the multiple pixel areas included in the object area are similar. Depending on the degree of magnification of the 2D image, the number of pixels included in the object area and the background area may differ. The number of multiple pixels included in the object area of ​​Image B is greater than the number of multiple pixels included in the object area of ​​Image D, and the number of multiple pixels included in the background area of ​​Image B is less than the number of multiple pixels included in the background area of ​​Image D.Therefore, in determining the average brightness in Image B, the influence of brightness values ​​in multiple pixel areas included in the target area may be greater than that in Image D. Consequently, although the brightness of the target area in Image D appears darker than the brightness of the target area in Image B, the average brightness in the 2D image may be determined to be the same value. Accordingly, in one embodiment, a 3D image is acquired using multiple 2D pattern images, and the target area is identified using depth information on the 3D image to separately acquire target brightness information for the target area.

[0052] FIG. 5 is a drawing for explaining an example in which a device (100) according to one embodiment determines an object area (501) and / or a specific target area (500).

[0053] Referring to FIG. 5, in one embodiment, the device (100) can determine a specific target area (500) having a specific range of depth using depth information on a 3D image, and can determine a specific target area (500) on a 2D image by superimposing a 3D image in which the determined specific target area (500) is separated onto a 2D image, and can determine part or all of the specific target area (500) as an object area (501) on the 2D image. In one embodiment, the specific target area (500) may correspond to an area having a depth of at least a certain thickness, where the background area is excluded. The specific target area (500) and the object area (501) may represent the same area, or they may represent different areas as in FIG. 5, so that a part of the specific target area (500) is determined as the object area (501). In step S240 and FIG. 4, it is described that the specific target area (500) and the target area (501) are the same area, but this is not limited thereto and they do not necessarily have to be the same area. For example, the device (100) may determine part or all of the specific target area (500) as the target area (501). The specific target area (500) and the target area (501) may represent the same area, or a part of the specific target area (500) may be determined as the target area (501). For example, if the specific target area (500) is an area excluding a background area having a depth greater than a certain thickness that can be distinguished from the background area, then both the tooth area and the gum area having a depth greater than a certain thickness may be determined as the specific target area (500). Additionally, the target area (501) may be identified by distinguishing the tooth area and the gum area based on the difference in depth within the specific target area (500).The target area (501) may be an area that includes only the tooth area among the specific target area (500), an area that includes only the gum area, or an area that includes both the tooth area and the gum area. That is, at least one of the tooth area and / or gum area may be flexibly determined as the target area (501). Although FIG. 5 is illustrated to be distinguished separately to indicate cases where the specific target area (500) and the target area (501) are different, the specific target area (500) and the target area (501) may represent the same area as described above. In one embodiment, the device (100) may determine target brightness information using the brightness of the target area (501) excluding the background area.

[0054] In step S250, the device (100) according to one embodiment may update at least one of the light amount and exposure amount used to acquire a 2D image based on object brightness information. In one embodiment, the light amount and exposure amount are elements for adjusting the brightness of the 2D image, and the device (100) may update the brightness of the 2D image by adjusting the light amount and / or exposure amount used to acquire the 2D image.

[0055] In step S260, the device (100) according to one embodiment can acquire a 2D image with updated brightness as at least one of the light amount and exposure amount is updated.

[0056] Specifically, the device (100) can update at least one of the light amount and the exposure amount by comparing the average brightness with a reference brightness that serves as a standard for updating the brightness of the object area (501), so that the average brightness corresponds to the reference brightness. The reference brightness may be a reference brightness that is preset as an optimized brightness in which the object area (501) can be represented. Additionally, in one embodiment, the average brightness may represent the average brightness value for the brightness values ​​of a plurality of pixel areas included in the object area (501). The device (100) can obtain a comparison result between the average brightness and the reference brightness. Based on the comparison result, if the average brightness is higher than the reference brightness, the device (100) can update the light amount and the exposure amount to decrease. If the light amount and the exposure amount are decreased, the brightness of the 2D image may become darker. Additionally, based on the comparison result, if the average brightness is lower than the reference brightness, the device (100) can update the exposure amount to increase. If the exposure amount is increased, the brightness of the 2D image may become brighter. The device (100) can update the light intensity to increase when the updated average brightness of the object area (501) acquired as the exposure amount is updated is lower than the reference brightness. In one embodiment, an exposure amount allowable range in which the exposure amount can be increased to the maximum may be preset. Since increasing the exposure amount too much may slow down the frame acquisition speed and there is a risk of acquiring a distorted image, the exposure amount can be increased by the maximum value within the exposure amount allowable range. If the average brightness of the object area (501) is lower than the reference brightness even after the exposure amount has been increased to the maximum value, the exposure amount can be maintained at the maximum value and the light intensity can be increased so that the brightness of the 2D image becomes brighter. In one embodiment, the priority of adjusting the exposure amount can be determined to be higher than the priority of adjusting the light intensity.Generally, when scanning highly reflective objects such as the oral cavity or metal, LEDs must be projected strongly, so adjusting the light intensity to be weak during oral cavity scanning may not be very meaningful. Therefore, the average brightness update process can be performed by first adjusting the exposure amount so that the average brightness corresponds to the reference brightness, and then partially adjusting the light intensity. As another example, if the scan target is a plastic (light-reflective material) rather than the oral cavity, the priority of light intensity adjustment may be determined to be higher than the priority of exposure amount adjustment. If the exposure amount is adjusted excessively, the frame acquisition speed may decrease and the probability of acquiring distorted images may increase. Therefore, for materials where light intensity adjustment is significant, the average brightness update process can be performed by first adjusting the light intensity so that the average brightness corresponds to the reference brightness, and then partially adjusting the exposure amount. The example described above is merely one of various embodiments and is not limited thereto.

[0057] In one embodiment, the brightness value of each pixel may be determined according to the number of bits applied to each pixel. For example, if the number of bits applied to each pixel corresponds to 8 bits, the brightness value of each pixel may be determined from 0 to 255, and the device (100) may determine any one of the values ​​from 0 to 255 as the reference brightness. For example, the device (100) may adjust the amount of light and / or exposure so that the average brightness of the object area (501) corresponds to the reference brightness by determining the reference brightness to 125. In one embodiment, determining the reference brightness to 125 is merely one example, and the reference brightness may be determined differently depending on the situation. The device (100) may obtain the average brightness of the object area (501), the minimum brightness which is the lowest brightness in the object area (501), and the maximum brightness which is the highest brightness in the object area (501), respectively. In addition, for convenience in explaining various embodiments using minimum brightness, maximum brightness, reference brightness, etc. in the embodiments described below, the number of bits applied to each pixel in the image corresponds to 8 bits, and the pixel brightness value is described as one of 0 to 255, but is not limited thereto, and various embodiments can be applied according to brightness values ​​corresponding to images having various bit numbers.

[0058] The device (100) may update a reference brightness that serves as a standard for updating the brightness of an object area (501) based on the degree of brightness difference between the minimum brightness, maximum brightness, and average brightness. The device (100) may update at least one of the light amount and the exposure amount so that the average brightness corresponds to the updated reference brightness. For example, the device (100) may obtain the brightness difference between the minimum brightness and the average brightness and the brightness difference between the maximum brightness and the average brightness in the object area (501). Additionally, the device (100) may determine a brightness allowable range in which brightness expression is possible in the object area (501) based on the reference brightness. The brightness allowable range may include a range of brightness that can be updated to the reference brightness. Additionally, the device (100) may update the reference brightness based on whether the minimum brightness and maximum brightness are included in the brightness allowable range. The brightness allowable range may be a brightness range having a certain brightness difference in the plus or minus direction relative to the reference brightness. The reference brightness may be a brightness such that the object area (501) can be represented at an optimized brightness. Generally, the brightness may be 0 or greater, but if it is dark, the representation of the object area (501) may not be clear. However, if the brightness is 0 or greater, scanning is possible, and if the brightness exceeds the reference brightness, scanning may be impossible because it is too bright. Therefore, the device (100) may determine a certain difference in brightness in the positive direction to determine an allowable brightness range based on the reference brightness, which is smaller than a certain difference in brightness in the negative direction. For example, the device (100) may determine the range of a first brightness value minus the reference brightness to a second brightness value plus the reference brightness as the allowable brightness range, and the second brightness value may be smaller than the first brightness value. For example, if the reference brightness is 125, the allowable brightness range may be determined to be 50 to 175. At this time, the first brightness value may be 75 and the second brightness value may be 50.The device (100) may determine the minimum allowable brightness and maximum allowable brightness in the object area (501) based on the brightness allowable range. For example, the minimum allowable brightness may be 50 and the maximum allowable brightness may be 175. The device (100) may update the reference brightness in the direction corresponding to the larger brightness difference by comparing a first brightness difference, which represents the difference in brightness between the minimum brightness and the average brightness among the brightness of a plurality of pixels included in the object area (501), with a second brightness difference, which represents the difference in brightness between the maximum brightness and the average brightness among the brightness of a plurality of pixels. If the first brightness difference and the second brightness difference are, for example, greater than a preset brightness difference of more than twice, the reference brightness may be increased in the direction of the greater difference so that the light amount and / or exposure amount is updated so that the average brightness corresponds to the reference brightness, thereby allowing the first brightness difference and the second brightness difference to be updated to be less than the preset brightness difference. Thus, the brightness may be adjusted uniformly without being biased toward one side.

[0059] As another example, the device (100) may update the reference brightness when at least one of the minimum brightness and maximum brightness among the brightness of a plurality of pixels included in the object area (501) is not included in the brightness allowance range. For example, if the minimum brightness is outside the brightness allowance range, the reference brightness may be updated to increase by the corresponding brightness so that the area can be expressed brighter, and if the maximum brightness is outside the brightness allowance range, the reference brightness may be updated to decrease by the corresponding brightness so that the area can be expressed darker. The average brightness may be updated according to the updated reference brightness. If both the minimum brightness and the maximum brightness are outside the brightness allowance range, the reference brightness may be decreased so that the maximum brightness is preferentially expressed as a brightness included in the brightness allowance range, by giving a higher weight to the maximum brightness than the minimum brightness in that the minimum brightness is scannable for all areas exceeding 0. Additionally, the device (100) can update at least one of the light amount and exposure amount based on the brightness difference between the minimum brightness and the minimum allowable brightness, the brightness difference between the maximum brightness and the maximum allowable brightness, the brightness difference between the minimum brightness and the average brightness, the brightness difference between the maximum brightness and the average brightness, and the brightness difference between the reference brightness and the average brightness.

[0060] In one embodiment, the device (100) may update at least one of the light quantity and exposure quantity based on weights that are gradually reduced in the order of the brightness difference between the reference brightness and the average brightness, the brightness difference between the maximum brightness and the maximum allowable brightness, and the brightness difference between the minimum brightness and the minimum allowable brightness. For example, the brightness difference between the reference brightness and the average brightness may be given the highest weight, as the main objective of one embodiment is to update the target area (501) and the average brightness to correspond to the reference brightness. Additionally, the brightness difference between the maximum brightness and the maximum allowable brightness may be given a second highest weight, as it may be desirable to check whether scanning is impossible because the maximum brightness exceeds the maximum allowable brightness even after the average brightness has been updated to correspond to the reference brightness. Additionally, the brightness difference between the minimum brightness and the minimum allowable brightness may be given a third highest weight, as it may be desirable to check whether scanning is possible but the representation of the area becomes unclear when the minimum brightness exceeds the minimum allowable brightness even after the average brightness has been updated to correspond to the reference brightness. As another example, if the first brightness difference representing the difference in brightness between the minimum brightness and the average brightness, and the second brightness difference representing the difference in brightness between the maximum brightness and the average brightness among multiple pixels differ by more than the preset brightness difference, the update can be performed so that the weight assigned to the brightness difference in the direction with the greater difference is the highest. For example, if the second brightness difference is greater than the preset brightness difference than the first brightness difference, the highest weight may be assigned to the brightness difference between the maximum brightness and the maximum allowable brightness. In cases where the first brightness difference and the second brightness difference differ by more than the preset brightness difference, there may be multiple pixel areas corresponding to brightness in opposite directions on average included in the object area (501).Therefore, it may be desirable to update the reference brightness in the direction where the difference is greater, so that the highest weight is assigned to the difference in brightness between the first brightness difference and the second brightness difference that is greater than the preset brightness difference, and the reference brightness is updated accordingly, so that the difference between the reference brightness and the average brightness is assigned a second-highest weight, and the difference in brightness between the first brightness difference and the second brightness difference that is smaller than the preset brightness difference is assigned a third-highest weight, thereby allowing at least one of the light quantity and / or exposure quantity to be updated. As another example, if both the minimum brightness and the average brightness fall within the brightness allowable range, the reference brightness may be updated to the maximum brightness. Since the brightness allowable range is a preset range that allows the representation of the object area (501) to be clear, the maximum brightness may be updated to the reference brightness, as the maximum brightness does not exceed the brightness allowable range, so that all pixel areas included in the object area (501) can be clearly represented without being too dark. The example described above is merely one of various embodiments and is not limited thereto.

[0061] FIG. 6 is a diagram for explaining an example of a device (100) according to one embodiment acquiring object brightness information by comparing it with a conventional average brightness update method.

[0062] In FIG. 6, images C and D represent an example in which the average brightness of an image is obtained according to the conventional average brightness update method described with reference to FIG. 4. Image C is an image with an average brightness of 100, and image D is an image with an average brightness of 125. This indicates a state in which the brightness of a 2D image is updated from image C to image D according to the conventional average brightness update method. Additionally, images E and F represent a state in which the brightness of a 2D image is updated from image E to image F using the average brightness of an object area (501) corresponding to a specific target area (500) using a 3D image according to an average brightness update process according to an embodiment. FIG. 6 includes an example in which the specific target area (500) and the object area (501) are the same area. In an embodiment, the reference brightness is a reference brightness that is pre-set as an optimized brightness in which the object area (501) can be expressed, and is described as 125. Specifically, if we assume that image E is the same image as image C, the average brightness of image C according to the conventional average brightness update method is 100, and the average brightness of image E determined according to the average brightness update process according to one embodiment is 40. That is, in the conventional method, the average brightness was determined in the entire image without distinguishing between the object area (501) and the background area, whereas in one embodiment, the average brightness is determined in the object area (501), which is the depth area. In addition, it can be seen that although the average brightness of images D and F is the same at 125, the brightness adjustment is applied differently. Referring to FIG. 6, when the brightness is updated from image C to image D according to the conventional average brightness update method, the average brightness for the entire image is increased from 100 to the reference brightness of 125, so it can be seen that the brightness of the entire area within the image becomes brighter on average, resulting in an average brightness of 125.On the other hand, in the average brightness update process according to one embodiment, when the brightness is updated from image E, from which the average brightness was obtained by extracting the target area (501) from the same image as image C, the average brightness for the target area (501) is increased from 40 to the reference brightness of 125, so that it can be confirmed that the brightness of the target area (501) has become brighter to correspond to the reference brightness of 125. That is, in the case of image F, since the brightness of the target area (501) has been adjusted to correspond to the reference brightness, the average brightness for the entire image in image F may be a brightness that exceeds the reference brightness. For example, as the brightness of the target area (501) is adjusted to correspond to the reference brightness of 125, the brightness of the background area is also adjusted by the same amount, so the average brightness for the entire area of ​​the 2D image (image F) may be a brightness value exceeding 125, for example, 220. Since the reference brightness is the optimized brightness at which the object area (501) can be expressed, in one embodiment, the brightness of the object area (501) is updated to the reference brightness. If the average brightness of the entire image is updated to the reference brightness as in the conventional method, an error may occur due to the brightness of the background area included in the average brightness, and there may be limitations in expressing the object area (501). That is, depending on the brightness of the background area, there may be many situations where the brightness of the object area (501) cannot be updated to correspond to the reference brightness. As shown in FIG. 6, both the conventional brightness update method from image C to image D and the average brightness update process according to one embodiment from image E to image F adjusted the brightness so that the reference brightness became 125. However, in one embodiment, the brightness is adjusted centered on the object area (501), so it can be seen that the expression of the object area (501) is clearer in image F than in image D.According to conventional average brightness update methods, the existing reference brightness may be determined to be higher or lower by considering the background area; however, since this can be determined very flexibly depending on the brightness values ​​of each of the multiple pixel areas included in the background area, it may be difficult to clearly determine the reference brightness.

[0063] FIG. 7 is a diagram showing an example in which a 2D image with updated brightness is obtained from a device (100) according to one embodiment.

[0064] Referring to FIG. 7, by adjusting the light intensity and / or exposure amount so that the average brightness in N frames can be updated to a reference brightness, a 2D image having an optimized reference brightness can be acquired in the N+1 frame. That is, according to one embodiment, by adaptively adjusting the light intensity and / or exposure amount according to the difference between the average brightness and the reference brightness, an image having optimal brightness can be acquired automatically and quickly in real time. In addition, frame loss can be minimized by adaptively changing the light intensity and / or exposure amount when acquiring scan data.

[0065] FIG. 8 is a diagram showing the evaluation results for scan data obtained as the device (100) according to one embodiment updates the brightness of the image.

[0066] Referring to FIG. 8, by applying a scan data acquisition process in which brightness is adaptively updated according to one embodiment, scan data from scan targets of various materials is acquired in a clearer state as in Evaluation Method 1, resulting in reduced area loss. Furthermore, by applying a scan data acquisition process in which brightness is adaptively updated according to one embodiment, the amount of light and / or exposure is adaptively adjusted so that scan data can be acquired continuously. Consequently, although there was a limitation in that scanning was impossible for areas with a brightness value of 125 or higher as in Evaluation Method 2, this was overcome, and results were obtained that scanning is possible even for areas with a brightness value of 225. Specifically, the scan data is acquired not by the user manually adjusting the amount of light or the camera's exposure, but by continuously checking the brightness information of the object in N frames according to a preset scan data acquisition process according to one embodiment, the amount of light and exposure are automatically updated adaptively, thereby enabling the acquisition of a 2D image with optimized brightness without interruption.

[0067] According to one embodiment, there is an effect that all scan targets of various materials can be scanned with a constant brightness, and there is an effect that the accuracy of scan data in the required area can be increased in that the brightness can be automatically updated by using a 3D image to use the brightness of a specific range area called the target area (501).

[0069] The embodiments described above are merely examples and are not to be interpreted as being limited thereto.

[0070] The sequence and combination of steps described above are examples of embodiments, and it can be understood that the sequence, combination, branching, functions, and entities performing them may be implemented in various forms with additions, omissions, or modifications, provided that the essential characteristics of each component described in the specification are not deviated from. Furthermore, throughout the specification, "provision" may be interpreted to include the process of a subject acquiring specific information or directly or indirectly transmitting or receiving it to a specific subject, and to comprehensively include the performance of related operations required in such processes.

[0071] Various embodiments of the present disclosure may be implemented as software comprising one or more instructions stored in a storage medium (e.g., memory) readable by a machine (e.g., a display device or a computer). For example, a processor (120) of the machine (e.g., processor (120)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' merely means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0072] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be distributed in the form of a device-readable storage medium, or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0073] Those skilled in the art related to the embodiments described above will understand that they may be implemented in modified forms without departing from the essential characteristics of the description. Therefore, the disclosed methods should be considered in an illustrative rather than a restrictive sense. The scope of the disclosure is defined by the claims, not by the foregoing description, and all variations within the scope of equivalence should be interpreted as being included in the disclosure. Explanation of the symbols

[0074] 100: Device 110: Receiver 120: Processor 130: Display 140: Wireless terminal 150: Wired terminal 500: Specific target area 501: Object area

Claims

Claim 1 A method for updating the brightness of an image, comprising: a step of acquiring a 2D image of an object; a step of acquiring a 3D image of the object; a step of determining an object region corresponding to the object within the 2D image using the 2D image and the 3D image; a step of acquiring object brightness information indicating the brightness of a part or all of the object region; a step of updating at least one of a light amount and an exposure amount used to acquire the 2D image based on the object brightness information; and a step of acquiring a 2D image in which the brightness is updated as at least one of the light amount and the exposure amount is updated. Claim 2 A method according to claim 1, wherein the 2D image includes a plurality of 2D pattern images representing a plurality of patterns for the object, and the step of acquiring the 3D image is acquired based on the plurality of 2D pattern images for the object. Claim 3 A method according to claim 1, wherein the step of determining the object region comprises: determining a specific object region within the 3D image that includes a specific range of depths based on depth information of the 3D image; and aligning the specific object region with the object region within the 2D image. Claim 4 In claim 3, the step of acquiring object brightness information is a method of acquiring object brightness information for an object area excluding a background area that does not include the depth of the specific range. Claim 5 A method according to claim 1, wherein the step of updating at least one of the light quantity and the exposure quantity is to update at least one of the light quantity and the exposure quantity such that the average brightness corresponds to the reference brightness in proportion to the difference between the reference brightness and the average brightness which serves as a reference for updating the brightness of the object area. Claim 6 In claim 5, the step of updating at least one of the light quantity and exposure quantity comprises: a step of obtaining a comparison result between the average brightness and the reference brightness; and a step of updating the light quantity and the exposure quantity to decrease based on the comparison result if the average brightness is higher than the reference brightness. Claim 7 In claim 5, the step of updating at least one of the light quantity and the exposure quantity comprises: a step of obtaining a comparison result between the average brightness and the reference brightness; and a step of updating the exposure quantity to increase based on the comparison result if the average brightness is lower than the reference brightness. Claim 8 In claim 7, the step of updating at least one of the light quantity and exposure quantity further comprises the step of updating the light quantity to increase when the updated average brightness of the object area obtained as the exposure quantity is updated to increase is lower than the reference brightness. Claim 9 The method according to claim 1, wherein the step of updating at least one of the light quantity and exposure quantity comprises: a step of updating a reference brightness that serves as a reference for updating the brightness of the object area based on the degree of brightness difference between the minimum brightness, the maximum brightness, and the average brightness; and a step of updating at least one of the light quantity and exposure quantity such that the average brightness corresponds to the updated reference brightness. Claim 10 In claim 9, the step of updating the reference brightness comprises: determining a brightness allowable range in which brightness expression is possible in the object area based on the reference brightness; and updating the reference brightness based on whether the minimum brightness and the maximum brightness are included in the brightness allowable range. Claim 11 In claim 10, the step of updating at least one of the light quantity and exposure quantity comprises: determining a minimum allowable brightness and a maximum allowable brightness in the object area based on the brightness allowable range; and updating at least one of the light quantity and exposure quantity based on the brightness difference between the minimum brightness and the minimum allowable brightness, the brightness difference between the maximum brightness and the maximum allowable brightness, the brightness difference between the minimum brightness and the average brightness, the brightness difference between the maximum brightness and the average brightness, and the brightness difference between the reference brightness and the average brightness. Claim 12 A device for updating image brightness, comprising: a receiver for acquiring a 2D image of an object; and a processor for acquiring a 3D image of the object, determining an object region corresponding to the object within the 2D image using the 2D image and the 3D image, acquiring object brightness information indicating brightness for a part or all of the object region, updating at least one of a light amount and an exposure amount used to acquire the 2D image based on the object brightness information, and acquiring a 2D image in which brightness is updated as at least one of the light amount and the exposure amount is updated. Claim 13 A device according to claim 12, wherein the 2D image includes a plurality of 2D pattern images representing a plurality of patterns for the object, and the 3D image is obtained based on the plurality of 2D pattern images for the object. Claim 14 A device according to claim 12, wherein the processor determines a specific target area within the 3D image that includes a specific range of depths based on depth information of the 3D image, and corresponds the specific target area to the target area within the 2D image. Claim 15 A computer-readable recording medium having a program stored on it for executing the method of any one of claims 1 to 11 on a computer.

Images