Information processing device, information processing method, and program

Abstract

To provide processing for suppressing deterioration of texture of an object represented using reflection characteristic data while reducing the amount of the reflection characteristic data.SOLUTION: An information processing device is provided, comprising first acquisition means for acquiring specular reflection information pertaining to specularly reflected light on an object, a second acquisition means for acquiring diffuse reflection information pertaining to diffuse reflected light on the object, and compression means for compressing the diffuse reflection information according to the specular reflection information.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a technique for compressing data relating to the texture of an object. [Background technology]

[0002] In order to reproduce the texture of an object's material or paint, measurement data of reflection characteristics according to the lighting direction and observation direction is used. Reflection characteristic data generally includes information on the object's diffuse reflection and specular reflection, as well as information on minute surface irregularities, and is characterized by a larger data volume than still image data. As a data compression technique, Patent Document 1 discloses a technique for compressing depth images using a two-dimensional image compression method. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] WO2018 / 123801 Summary of the Invention [Problem to be solved by the invention]

[0004] Since each piece of information contained in the reflection characteristic data is related to each other and affects how an object appears, if compression processing such as that described in Patent Document 1 is performed separately on each piece, the texture of the object represented using the reflection characteristic data may be significantly degraded.

[0005] Therefore, an object of the present invention is to provide a process for reducing the amount of reflection characteristic data while suppressing deterioration of the texture of an object represented using the reflection characteristic data. [Means for solving the problem]

[0006] In order to solve the above problem, an information processing device according to the present invention is Surface in specular reflection intensitya first acquiring means for acquiring specular reflection information relating to the object; a second acquiring means for acquiring diffuse reflection information relating to the diffuse reflection light on the object; and a second acquiring means for acquiring the diffuse reflection information based on the specular reflection information. The size of the file containing Compress Smaller than a compression means for compressing the wherein the compression means compresses the size of the file containing the diffuse reflection information to a smaller size when the specular reflection intensity is large than when the specular reflection intensity is small. It is characterized by: [Effects of the Invention]

[0007] According to the present invention, it is possible to reduce the amount of reflection characteristic data while suppressing deterioration of the texture of an object represented using the reflection characteristic data. [Brief explanation of the drawings]

[0008] [Figure 1] Schematic diagram for explaining reflection characteristics [Figure 2] Block diagram showing the hardware configuration of an information processing device [Figure 3] Block diagram showing the functional configuration of an information processing device [Figure 4] 1 is a flowchart showing a process executed by an information processing device; [Figure 5] Schematic diagram for explaining normal information [Figure 6] Schematic diagram to explain the change in appearance depending on the normal direction [Figure 7] 1 is a flowchart illustrating a process for evaluating specular reflection information. [Figure 8] Schematic diagram for explaining a process for evaluating specular reflection information [Figure 9] Schematic diagram for explaining evaluation information [Figure 10] 1 is a flowchart showing a process for compressing diffuse reflectance information. [Figure 11] FIG. 1 is a schematic diagram illustrating a process for determining compression parameters; [Figure 12] Schematic diagram to explain the effect [Figure 13] 1 is a flowchart illustrating a process for evaluating specular reflection information. [Figure 14]Schematic diagram for explaining the change in appearance of the diffuse reflection component depending on the specular reflection component [Figure 15] 1 is a flowchart illustrating a process for evaluating specular reflection information. [Figure 16] Block diagram showing the functional configuration of an information processing device [Figure 17] 1 is a flowchart showing a process executed by an information processing device; [Figure 18] Flowchart showing the process of dividing specular reflection information DETAILED DESCRIPTION OF THE INVENTION

[0009] Each embodiment will be described below with reference to the drawings. Note that the following embodiments do not necessarily limit the present invention. Furthermore, not all of the combinations of features described in each embodiment are necessarily essential to the solution of the present invention.

[0010] [First embodiment] In this embodiment, processing is performed to reduce the amount of reflection characteristic data including specular reflection information and diffuse reflection information. Specifically, compression parameters used to compress the diffuse reflection information are determined based on the specular reflection information, and the diffuse reflection information is compressed based on the compression parameters. First, the reflection characteristics of an object will be described using FIG.

[0011] FIG. 1(a) is a schematic diagram illustrating an object 101, and FIG. 1(b) is a development of the surface of the object 101. The object 101 has reflection characteristics at each position on the surface. In this embodiment, for simplicity, the object 101 is described as a cube. Note that the shape of the object 101 may be not only a three-dimensional shape such as a cube, but also a two-dimensional shape such as a flat body. As shown in FIG. 1(b), the surface of the object 101 can be expressed as a development consisting of six faces. FIG. 1(c) is a diagram illustrating the reflection characteristics of a certain position 102 on the object 101. When light is irradiated from a certain direction 103 toward a point 105 on the object surface having a normal 104, reflected light 106 has different intensities depending on the reflection direction. The reflected light 106 can be modeled using a dichromatic reflection model. Specifically, reflected light 106 can be separated into specular reflected light component 107, which is light reflected at the boundary surface between air and the object, and diffuse reflected light component 108, which passes through the boundary surface and diffuses inside the object.

[0012] The specular reflected light component 107 is characterized by being strongly observed near the specular reflection direction. The specular reflected light component 107 is characterized by three things: a specular reflection direction 109, which is the direction in which the intensity of the specular reflected light component 107 is greatest; a specular reflection intensity 110, which is the reflection intensity in the specular reflection direction 109; and a spread width 111 of the specular reflected light component 107 centered on the specular reflection direction 109. Furthermore, the specular reflected light direction 109 changes depending on the direction of the normal 104. The diffuse reflected light component 108 is characterized by being observed with approximately uniform intensity in all directions. The reflection intensity of the diffuse reflected light component 108 is called a diffuse reflection intensity 112.

[0013] The reflectance characteristics at a given position on an object surface can be described by a four-dimensional function called the Bidirectional Reflectance Distribution Function (BRDF). The reflectance characteristics of an object surface can also be described by a six-dimensional function called the Spatially-Varying BRDF (SVBRDF), in which the BRDF changes depending on the position. The Bidirectional Scattering Surface Reflectance Distribution Function (BSSRDF) is also sometimes used. Note that the amount of data increases as the number of dimensions increases.

[0014] One method for measuring reflectance characteristics is to take multiple images while changing the direction of the light source and the direction of the imaging device, and measure the reflectance characteristics of the object using a parametric reflectance model. For example, the Torrance-Sparrow model is a model for specular reflected light. Other models for specular reflected light include the Cook-Torrance model and the Phong model. For example, the Lambert model and the Oren-Nayar model are models for diffuse reflected light. By using these parametric reflectance models, the reflectance characteristics of an object surface can be expressed as parameters.

[0015] In this embodiment, of the parameterized reflection characteristics of an object surface, information relating to the specular reflection light component 107 is called specular reflection information, and information relating to the diffuse reflection light component 108 is called diffuse reflection information. Also, information relating to the normal 104 is called normal information, information relating to the specular reflection intensity 110 is called reflection intensity information, and information relating to the spread width 111 is called spread width information. Also, in this embodiment, information including the reflection intensity information, spread width information, and normal information is called specular reflection information.

[0016] For example, let us consider the case where the diffuse reflected light on the surface of an object is parameterized using the Lambertian model. Lambert Using the Lambertian model, is expressed by equation (1). L Lambert =K d cosθ i ···(1)

[0017] where θ i is the angle of incidence, and K d is the diffuse reflectance. When the diffuse reflected light is modeled using the Lambertian model, the diffuse reflectance K d Two-dimensional distribution of K d (x, y) corresponds to the diffuse reflection information in this embodiment.

[0018] The following explains how to parameterize specular reflected light on an object surface using the Torrance Sparrow model. TS Using the Torrance Sparrow model, is expressed by equation (2).

[0019]

number

[0020] where θ0 is the angle of reflection and K s is the specular reflectance. D is the normal distribution term, G is the geometric attenuation term, and F is the Fresnel term. The normal distribution term D, which expresses the variation in the normal of the object surface, represents the probability density function of the angle α between the normal direction N and the direction (half vector) H that bisects the illumination direction and the observation direction. The normal distribution term D is expressed by equation (3).

[0021]

number

[0022] Here, n is a parameter that represents the roughness of the surface. The geometric attenuation term G, which expresses the self-occlusion and self-shadowing caused by the irregularities of minute surfaces, attenuates more as the lighting direction or observation direction approaches the tangent plane of the object. The geometric attenuation term G is expressed by equation (4).

[0023]

number

[0024] Here, V is the observation direction and L is the illumination direction. The Fresnel term F, which changes reflectance depending on the refractive index and the angle of incidence of light, is expressed by equations (5), (6), and (7).

[0025]

number

[0026] c = V H (6)

[0027]

number

[0028] Here, η is the relative refractive index. When modeling specularly reflected light using the Torrance Sparrow model, the two-dimensional distribution N(x, y) of the normal direction N corresponds to the normal information in this embodiment. Furthermore, the two-dimensional distribution Ks(x, y) of the specular reflectance Ks corresponds to the reflection intensity information in this embodiment, and the two-dimensional distribution n(x, y) of n, a parameter representing the surface roughness, corresponds to the spread width information in this embodiment.

[0029] <Hardware configuration of information processing device> FIG. 2 is a block diagram showing the hardware configuration of the information processing device 1. The information processing device 1 includes a CPU 201, a ROM 202, and a RAM 203. The information processing device 1 also includes a VC (video card) 204, a general-purpose I / F (interface) 205, a SATA (serial ATA) I / F 206, and a NIC (network interface card) 207. The CPU 201 uses the RAM 203 as a work memory to execute an OS (operating system) and various programs stored in the ROM 202, a HDD (hard disk drive) 213, etc. The CPU 201 also controls each component via a system bus 208. Note that, in the processing of the flowcharts described below, program codes stored in the ROM 202, the HDD 213, etc. are loaded into the RAM 203 and executed by the CPU 201. A display device 215 is connected to the VC 204. An input device 210, such as a mouse or keyboard, and an imaging device 211 are connected to the general-purpose I / F 205 via a serial bus 209. A general-purpose drive 214 that reads from and writes to an HDD 213 and various recording media is connected to the SATA I / F 206 via a serial bus 212. The NIC 207 inputs and outputs information to and from external devices. The CPU 201 uses the HDD 213 and various recording media mounted on the general-purpose drive 214 as storage locations for various data. The CPU 201 displays a UI (user interface) provided by a program on a display device 215, and receives inputs such as user instructions received via the input device 210. The display device 215 may be a touch panel display having a touch panel function that detects the position of a touch by a pointer such as a finger.

[0030] <Functional configuration of information processing device> Fig. 3 is a block diagram showing the functional configuration of the information processing device 1. The CPU 201 uses the RAM 203 as a work memory and reads and executes a program stored in the ROM 202 or the HDD 213, thereby functioning as the functional configuration shown in Fig. 3. Note that it is not necessary for all of the processes shown below to be executed by the CPU 201, and the information processing device 1 may be configured so that part or all of the processes are executed by one or more processing circuits other than the CPU 201.

[0031] The information processing device 1 includes a diffuse information acquisition unit 301, a specular information acquisition unit 302, an evaluation unit 303, and a compression unit 304. The diffuse information acquisition unit 301 acquires diffuse reflection information from a storage device such as the HDD 213. The specular information acquisition unit 302 acquires specular reflection information from a storage device such as the HDD 213. The evaluation unit 303 derives evaluation information, which is an evaluation result of the specular reflection information, based on the specular reflection information. The compression unit 304 compresses the diffuse reflection information based on the evaluation information. The compression unit 304 also outputs the diffuse reflection information obtained by the compression process to a rendering unit 305. The rendering unit 305 acquires the compressed diffuse reflection information, specular reflection information, lighting information, imaging information, and shape information, and performs rendering based on the acquired information to generate an image that reproduces the texture of the object. Note that the rendering unit 305 in this embodiment is not included in the information processing device 1, but may be included in the information processing device 1. Furthermore, although the compression unit 304 outputs the compressed diffuse reflection information to the rendering unit 305, the output destination may be another device such as the HDD 213. Furthermore, although the diffusion information acquisition unit 301 and the specular information acquisition unit 302 acquire information from the HDD 213, they may acquire information from another device such as the imaging device 211.

[0032] <Flow of processing executed by information processing device> The flow of processing executed by information processing device 1 in this embodiment will be described with reference to the flowchart in Fig. 4. The processing shown in the flowchart in Fig. 4 starts when a user inputs an instruction via input device 210 and CPU 201 accepts the input instruction. Hereinafter, each step (process) will be represented by adding an S before the reference number.

[0033] In S401, the diffuse reflection information acquisition unit 301 reads diffuse reflection information from the HDD 213. The diffuse reflection information in this embodiment is information about diffusely reflected light on a certain surface of an object, and is in an image format with a size of 128×128 pixels, a resolution of 150 dpi, and pixel values ​​(R, G, B) expressed in 8 bits. In S402, the specular information acquisition unit 302 reads the specular reflection information from the HDD 213. The specular information acquisition unit 302 in this embodiment acquires normal information, which is an element that specifies the direction of specular reflection. The normal information in this embodiment is information about the normal direction on a certain surface of the object, and is in an image format with a size of 128×128 pixels, a resolution of 150 dpi, and pixel values ​​(X, Y, Z) expressed in 8 bits. The pixel values ​​(X, Y, Z) of the normal information are the XYZ components of the normal vector. An example of normal information is shown in FIG. 5. The images shown in FIG. 5 are an image 501 representing the X component corresponding to the R signal, an image 502 representing the Y component corresponding to the G signal, and an image 503 representing the Z component corresponding to the B signal, when the normal information is an RGB image.

[0034] In S403, the evaluation unit 303 evaluates the specularly reflected light on the object surface based on the specular reflection information. In this embodiment, the evaluation unit 303 evaluates the variation in normal information included in the specular reflection information.

[0035] The advantages of compressing diffuse reflection information based on normal information of an object surface are explained below with reference to FIG. 6. FIG. 6 schematically illustrates the surface shape of a region on an object surface and the reflection characteristics of the region, which are composed of the reflection characteristics at each position. FIG. 6(a) schematically illustrates the reflection characteristics when the normal direction of the object surface varies. Because the specular reflection direction changes depending on the normal direction of the object surface, when the normal direction of the object surface varies, the observed reflection characteristics include multiple reflection intensity peaks. Consider the case where a surface having reflection characteristics including a specular reflection light component 601 and a diffuse reflection light component 602 is observed from various directions, such as observation position 603 and observation position 604. In this case, the intensity of the specular reflection light component 601 varies significantly depending on the observation direction, so the observer perceives a sparkling brightness, while the diffuse reflection light component 602 is hardly perceivable even if it has been degraded by compression.

[0036] 6(b) schematically illustrates the reflection characteristics when the normal direction of the object surface is approximately uniform. Consider the case where a surface having reflection characteristics including a specular reflection light component 605 and a diffuse reflection light component 606 is observed from observation positions 607 and 608. Observation position 607 is a position where the object surface is observed from the direction of the peak reflection intensity of the specular reflection light component 605, while observation position 608 is a position where the object surface is observed from a direction shifted from the direction of the peak reflection intensity of the specular reflection light component 605. When the object surface is observed from observation position 608, the specular reflection light component 605 is small, so the observer easily perceives that the diffuse reflection light component 606 is degraded due to compression.

[0037] From the above, when compressing diffuse reflection information, image quality degradation during texture reproduction is less noticeable on surfaces with varying normal directions, but is more noticeable on surfaces with approximately uniform normal directions. Therefore, the evaluation unit 303 in this embodiment evaluates the variation in normal directions by deriving the similarity between the normal direction of the pixel of interest and the normal directions of pixels neighboring the pixel of interest based on the normal information acquired in S402, and outputs the generated evaluation information to the compression unit 304. Based on the evaluation information, the compression unit 304 performs high compression processing on the diffuse reflection information when the variation in normal directions is large, and performs low compression processing on the diffuse reflection information when the variation in normal directions is small.

[0038] Returning to the description of S403, the details of the process of evaluating the normal information in S403 will be described with reference to the flowchart of FIG. 7. In S701, the evaluation unit 303 starts repeated processing for all pixels of the normal information N(x, y). Specifically, the processing of S702 to S704 is performed while sequentially changing the pixel of interest. In S702, the evaluation unit 303 starts repeated processing for neighboring pixels of the pixel of interest. FIG. 8 is a schematic diagram for explaining the pixel of interest and neighboring pixels. In this embodiment, eight pixels adjacent to the pixel of interest 801, namely, the upper left, upper, upper right, left, right, lower left, lower, and lower right, are set as neighboring pixels 802. Note that the neighboring pixels may also be set as four pixels adjacent to the pixel of interest above, left, right, and lower. Alternatively, the pixels included in a 5×5 pixel area centered on the pixel of interest, excluding the pixel of interest, may be set as neighboring pixels.

[0039] In S703, the evaluation unit 303 derives the similarity between the normal direction of the pixel of interest and the normal direction of the neighboring pixel. In this embodiment, the evaluation unit 303 derives the cosine similarity as the similarity between the two directions. The cosine similarity cs is expressed by equation (8).

[0040]

number

[0041] where Nn is the normal direction of the neighboring pixel, and N a is the normal direction of the pixel of interest. If the normal direction of the neighboring pixel and the normal direction of the pixel of interest are facing the same direction, then cs = 1, and the larger the difference in direction, the smaller cs becomes. If the normal direction of the neighboring pixel and the normal direction of the pixel of interest are facing in opposite directions, then cs = -1.

[0042] In S704, the evaluation unit 303 returns the process to S702 until processing using all neighboring pixels for the set pixel of interest is completed. In S705, the evaluation unit 303 returns the process to S701 until deriving the similarity in the normal direction with neighboring pixels for all pixels is completed. After processing all pixels, the evaluation unit 308 generates evaluation information having the similarity in the normal direction for each pixel and outputs the evaluation information to the compression unit 304.

[0043] An example of the evaluation information generated in S403 is shown in Figure 9. The evaluation information generated in this embodiment is in grayscale image format, with a size of 128 x 128 pixels, a resolution of 150 dpi, and pixel values ​​expressed in 8 bits. Cosine similarities ranging from -1 to 1 correspond to pixel values ​​of 0 to 255, with pixel value 0 corresponding to black and pixel value 255 corresponding to white. Note that the evaluation information does not have to be saved in image format, and may be saved, for example, as a CSV file.

[0044] In S404, the compression unit 304 compresses the diffuse reflection information based on the evaluation information. The compression method used in this embodiment is the well-known JPEG compression method. Details of the process of compressing the diffuse reflection information in S404 will be described with reference to the flowchart in FIG. 10. In S1001, the compression unit 304 determines a scalar value compression parameter based on the evaluation information. In this embodiment, the compression parameter is the compression rate of the JPEG compression method. The compression rate of the JPEG compression method is set as an integer value ranging from 12, which indicates low compression, to 0, which indicates high compression. The smaller the compression rate, the smaller the compressed file size, and the larger the compression rate, the larger the compressed file size. The compression unit 304 derives an average value of the evaluation information as a representative value of the evaluation information. The compression unit 304 then converts the derived average value into a compression parameter by referring to a lookup table (LUT). The LUT is assumed to be created in advance and stored in a storage device such as the HDD 213. An example of the LUT is shown in FIG. 11. The LUT is information indicating the correspondence between the average value of the evaluation information and the compression parameter.

[0045] In S1002, the compression unit 304 compresses the diffuse reflection information using the compression parameters determined in S1001. The compression unit 304 uses the well-known JPEG compression for the compression process. Note that, although the compression unit 304 in this embodiment uses the JPEG compression method to compress the diffuse reflection information, compression may be performed using a method of reducing the bit depth of the diffuse reflection information, a method of reducing the number of pixels of the diffuse reflection information, JPEG2000 compression, or the like. The compression unit 304 also outputs the compressed diffuse reflection information to the rendering unit 305.

[0046] <Effects of the first embodiment> As described above, the information processing device of this embodiment acquires specular reflection information related to specularly reflected light from an object, acquires diffuse reflection information related to diffusely reflected light from the object, and compresses the diffuse reflection information based on the specular reflection information. FIG. 12 is a schematic diagram illustrating the effects of this embodiment. FIG. 12(a) shows the compression rate of the diffuse reflection information when simple JPEG compression is performed on each surface of the object 101 shown in FIG. 1. FIG. 12(b) shows the compression rate of the diffuse reflection information when compression processing of this embodiment is performed on each surface of the object 101. When simple JPEG compression is performed, the compression rate is the same regardless of the surface of the object. However, when compression processing of this embodiment is performed, the compression rate is determined based on normal information of the surface of the object, resulting in different compression rates for each surface. As a result, when there is large variation in the normal direction, high compression processing is performed on the diffuse reflection information, and when there is small variation in the normal direction, low compression processing is performed on the diffuse reflection information. Therefore, data is compressed more heavily when degradation of texture is less perceptible than when degradation of texture is easily perceived, thereby reducing the data volume. Therefore, it is possible to reduce the amount of reflection characteristic data while suppressing deterioration in the texture of an object expressed using the reflection characteristic data.

[0047] <Modification> In this embodiment, normal information is evaluated by deriving the similarity between the normal direction of a pixel of interest and the normal directions of neighboring pixels. However, the method for evaluating normal information is not limited to this. For example, the variation in normal information may be evaluated by deriving the similarity between the normal direction of a pixel of interest and a global normal direction. The flow of the process for evaluating normal information will be described with reference to FIG. 13. In S1301, the evaluation unit 303 derives a global normal direction. Here, the global normal direction is the average value of the normal directions N for all pixels in the normal information N(x,y). In S1302, the evaluation unit 303 starts repeated processing for all pixels in the normal information N(x,y). Specifically, the process of S1303 is performed while sequentially changing the pixel of interest. In S1303, the evaluation unit 303 derives the similarity between the normal direction of the pixel of interest and the global normal direction derived in S1301. The evaluation unit 303 derives cosine similarity as the similarity of the normal direction. In S1304, the evaluation unit 303 returns the process to S1302 until the similarity of the normal direction for all pixels has been derived. By deriving the similarity between the normal direction of the pixel of interest and the global normal direction through the above process, it is possible to evaluate the variation in normal information.

[0048] As a method for setting different compression rates for each region of the diffuse reflection information, a region of interest (ROI) may be set in the diffuse reflection information, or an ROI may be set based on the specular reflection information.

[0049] [Second embodiment] In the first embodiment, the diffuse reflection information is compressed based on normal information included in the specular reflection information. In the present embodiment, the diffuse reflection information is compressed based on at least one of reflection intensity information and spread width information included in the specular reflection information. Note that the hardware configuration and functional configuration of the information processing device in this embodiment are the same as those in the first embodiment, so a description thereof will be omitted. The following mainly describes the differences between this embodiment and the first embodiment. Note that the same components as those in the first embodiment will be described using the same reference numerals.

[0050] <Flow of processing executed by information processing device> The flow of processing executed by the information processing device 1 in this embodiment will be described using the flowchart in FIG. 4. S401 is the same as in the first embodiment, and therefore description thereof will be omitted. In S402, the specular information acquisition unit 302 reads specular reflection information from the HDD 213. In this embodiment, the specular information acquisition unit 302 acquires reflection intensity information and spread width information. Note that the specular information acquisition unit 302 does not need to acquire both the reflection intensity information and the spread width information as long as it can acquire at least one of them. In S403, the evaluation unit 303 evaluates the specular reflected light on the object surface.

[0051] The advantages of compressing diffuse reflection information based on specular reflection information from an object surface will now be explained with reference to FIG. 14. FIGS. 14(a), 14(b), and 14(c) are schematic diagrams illustrating cases where the diffuse reflection light component 1401 is the same but the specular reflection intensity 1402 and spread width 1403 are different. FIG. 14(b) illustrates a case where the spread width 1403 is larger than that in FIG. 14(a). FIG. 14(c) illustrates a case where the specular reflection intensity 1402 is larger than that in FIG. 14(a). Observation position 1404 is a position from which observation is made in the direction of the peak reflection intensity of the specular reflection light component, while observation positions 1405 and 1406 are positions from directions shifted from the direction of the peak reflection intensity of the specular reflection light component. When observing from observation position 1404, the specular reflection light component is observed in addition to the diffuse reflection light component 1401. When observed from observation position 1405, only the diffuse reflected light component 1401 is observed. When observed from observation position 1406, the specular reflected light component is observed in addition to the diffuse reflected light component 1401. Because the specular reflected light component is observed when observed from observation positions 1404 and 1406, even if the diffuse reflected light component 1401 has been degraded by compression, it is difficult to perceive it.

[0052] From the above, when the diffuse reflection information is compressed, degradation of image quality during texture reproduction is less perceptible on surfaces where the specular reflection intensity is high and the spread of the specular reflection light component is large. Therefore, in this embodiment, the evaluation unit 303 evaluates the specular reflection light based on the reflection intensity information and spread information acquired in S402, and outputs the generated evaluation information to the compression unit 304.

[0053] Returning to the description of S403, the details of the process of evaluating the reflection intensity information and spread width information in S403 will be described using the flowchart in FIG. 15. In S1501, the evaluation unit 303 acquires the number of data W in the horizontal direction (x direction) of the specular reflection information, and sets "0" to x, which represents the current horizontal reference position. In S1502, the evaluation unit 303 acquires the number of data H in the vertical direction (y direction) of the specular reflection information, and sets "0" to y, which represents the current vertical reference position. In S1503, the evaluation unit 303 sets the upper left corner of the specular reflection information as the origin and derives an evaluation value based on the specular reflection information at position (x, y). Specifically, the evaluation unit 303 derives an evaluation value that reduces the compression rate of the diffuse reflection light information when the specular reflection intensity is high and increases the compression rate of the diffuse reflection information when the specular reflection intensity is low. Furthermore, an evaluation value is derived that reduces the compression rate of the diffuse reflection information when the spread of the specular reflected light is large, and increases the compression rate of the diffuse reflection information when the spread of the specular reflected light is small.

[0054] In S1504, the evaluation unit 303 determines whether y is smaller than the number of data pieces H in the vertical direction. If y is smaller than H, the process returns to S1502, and if y is larger than H, the process proceeds to S1505. In S1505, the evaluation unit 303 determines whether x is smaller than the number of data pieces W in the horizontal direction. If x is smaller than W, the process returns to S1501, and if x is larger than W, the evaluation unit 303 generates evaluation information having an evaluation value of specular reflected light for each pixel and outputs the evaluation information to the compression unit 304. S404 is the same as in the first embodiment, so a description thereof will be omitted.

[0055] <Effects of the second embodiment> As described above, the information processing device in this embodiment compresses the diffuse reflection information based on at least one of the reflection intensity information and the spread width information included in the specular reflection information, thereby reducing the amount of reflection characteristic data while suppressing deterioration of the texture of the object represented using the reflection characteristic data.

[0056] <Modification> In this embodiment, the diffuse reflection information is compressed based on both the reflection intensity information and the spread width information, but the diffuse reflection information may be compressed based on only the reflection intensity information, or only the spread width information. Furthermore, the diffuse reflection information may be compressed by referring to the normal information used in the first embodiment in addition to the reflection intensity information and the spread width information.

[0057] [Third embodiment] In the above-described embodiment, specular reflection information is evaluated for each pixel, and diffuse reflection information is compressed based on the evaluation results. When an object has a complex shape, a region of a certain size may be required to correctly evaluate specular reflection light. Therefore, in this embodiment, the specular reflection information is divided into multiple regions, the specular reflection information is evaluated for each divided region, and the diffuse reflection information is compressed based on the evaluation results. Note that the hardware configuration of the information processing device in this embodiment is the same as that in the first embodiment, so a description thereof will be omitted. The following mainly describes the differences between this embodiment and the first embodiment. Note that the same components as in the first embodiment will be described using the same reference numerals.

[0058] <Functional configuration of information processing device> Fig. 16 is a block diagram showing the functional configuration of the information processing device 1. The CPU 201 uses the RAM 203 as a work memory and reads and executes a program stored in the ROM 202 or the HDD 213, thereby functioning as the functional configuration shown in Fig. 16. Note that it is not necessary for all of the processes shown below to be executed by the CPU 201, and the information processing device 1 may be configured so that part or all of the processes are executed by one or more processing circuits other than the CPU 201.

[0059] The information processing device 1 has a diffuse information acquisition unit 1601, a specular information acquisition unit 1602, a division unit 1603, an evaluation unit 1604, and a compression unit 1605. The diffuse information acquisition unit 1601 acquires diffuse reflection information from a storage device such as the HDD 213. The specular information acquisition unit 1602 acquires specular reflection information from a storage device such as the HDD 213. The division unit 1603 divides the specular reflection information into multiple regions including a predetermined number of pixels or more. The evaluation unit 1604 derives evaluation information, which is an evaluation result of the specular reflection information, for each region based on the specular reflection information. The compression unit 304 compresses the diffuse reflection information for each region based on the evaluation information.

[0060] <Flow of processing executed by information processing device> The flow of processing executed by the information processing device 1 in this embodiment will be described with reference to the flowchart in Fig. 17. The processing shown in the flowchart in Fig. 17 starts when a user inputs an instruction via the input device 210 and the CPU 201 accepts the input instruction.

[0061] In S1701, the diffuse reflection information acquisition unit 1601 reads diffuse reflection information from the HDD 213. While the diffuse reflection information in the above-described embodiment was information about diffusely reflected light from a certain surface of the object, the diffuse reflection information in this embodiment is information about diffusely reflected light from all surfaces of the object. It is assumed that the surfaces are labeled and that the surfaces can be specified by the labels. In S1702, the specular information acquisition unit 1602 reads specular reflection information from the HDD 213. The specular reflection information in this embodiment is information that includes a global normal direction in a world coordinate system for each surface. It is assumed that the surfaces are labeled and that the surfaces can be specified by the labels. Here, the world coordinate system is a coordinate system for expressing the position of an object. For example, if the object is cubic, each surface faces up or down, and the direction in which each surface faces is the normal direction in the world coordinate system.

[0062] In S1703, the dividing unit 1603 divides the specular reflection information into multiple regions each containing a predetermined number of pixels or more. The details of the process of dividing the specular reflection information in S1703 will be described using the flowchart in FIG. 18. In S1801, the dividing unit 1603 reads pixel count information. The pixel count information is the number of pixels in a region required to correctly evaluate the variation in the normal direction. In S1802, the dividing unit 1603 derives the number of pixels for each surface of the object. In S1803, the dividing unit 1603 derives, for each surface of the object, the similarity of the normal direction with other surfaces in the world coordinate system. In S1804, the dividing unit 1603 compares the number of pixels for each surface of the object derived in S1802 with the pixel count information read in S1801, and identifies labels for small surfaces that do not contain more than a predetermined number of pixels.

[0063] In S1805, the dividing unit 1603 starts repeating the process for small faces that do not contain more than a predetermined number of pixels. In S1806, the dividing unit 1603 refers to the similarity calculated in S1803 and combines faces whose normal directions in the world coordinate system are closest to each other. Specifically, the dividing unit 1603 replaces the label of the face of interest with the label of the face whose normal direction in the world coordinate system is closest to the original label. In S1807, the dividing unit 1603 returns the process to S1805 until the label replacement process is completed for all small faces that do not contain more than a predetermined number of pixels. In S1808, the dividing unit 1603 determines whether the number of pixels of all faces is greater than the predetermined number of pixels. If the number of pixels of all faces is greater than or equal to the predetermined number of pixels, the process of S1703 ends. If the number of pixels of all faces is less than the predetermined number of pixels, the process returns to S1804.

[0064] In S1704, the evaluation unit 1604 derives evaluation information for each region based on the specular reflection information. The method for deriving the evaluation information is the same as in the above-mentioned embodiment, so a description thereof will be omitted. In S1705, the compression unit 1605 compresses the diffuse reflection information for each region based on the evaluation information. The method for compressing the diffuse reflection information is the same as in the above-mentioned embodiment, so a description thereof will be omitted.

[0065] <Effects of the third embodiment> As described above, the information processing device in this embodiment divides specular reflection information into multiple regions, derives evaluation information for each region obtained by the division, and compresses the diffuse reflection information based on the evaluation information. This reduces the amount of reflection characteristic data while suppressing deterioration of the texture of an object represented using the reflection characteristic data. Specifically, because the specular reflection information is evaluated for each region containing a predetermined number of pixels or more, the evaluation accuracy of the specular reflection information can be improved and the diffuse reflection information can be efficiently compressed. Furthermore, by dividing the regions based on normal information in the world coordinate system, processing can be performed taking into account the appearance of the rendering image from the same observation direction, allowing for more efficient compression of the diffuse reflection information.

[0066] <Modification> In this embodiment, the specular reflection information is divided into regions by combining small surfaces that do not contain more than a predetermined number of pixels with surfaces whose normal direction in the world coordinate system is closest, but the specular reflection information may also be divided into regions using other methods. Region division may also be performed based on information about the material, such as metal or cloth. For example, the specular reflection information is divided into regions by combining small surfaces that do not contain more than a predetermined number of pixels with surfaces that are considered to be made of the same material. By dividing the specular reflection information into regions based on material information, the diffuse reflection information can be compressed efficiently.

[0067] [Other embodiments] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0068] 1. Information processing equipment 301 Diffusion Information Acquisition Unit 302 Mirror information acquisition unit 304 Compression section

Claims

1. a first acquisition means for acquiring specular reflection information relating to the specular reflection intensity on the surface of the object; a second acquisition means for acquiring diffuse reflection information relating to the diffusely reflected light from the object; a compression means for compressing and reducing the size of a file including the diffuse reflection information based on the specular reflection information, The information processing apparatus is characterized in that the compression means compresses the size of the file containing the diffuse reflection information to a smaller size when the specular reflection intensity is large than when the specular reflection intensity is small.

2. 2. The information processing apparatus according to claim 1, wherein the specular reflection information includes normal information on the surface of the object.

3. 3. The information processing apparatus according to claim 2, wherein the compression means compresses the size of the file containing the diffuse reflection information based on the variation in normal direction represented by the normal information.

4. 4. The information processing apparatus according to claim 3, wherein the compression means compresses the size of the file containing the diffuse reflection information to a smaller size when the variation in the normal direction is large than when the variation in the normal direction is small.

5. 5. The information processing apparatus according to claim 1, wherein the specular reflection information includes a spread width of specularly reflected light on the surface of the object.

6. 6. The information processing apparatus according to claim 5, wherein the compression means compresses the size of the file containing the diffuse reflection information to a smaller size when the spread width is large than when the spread width is small.

7. The image processing device further includes an evaluation unit for evaluating the variation in the normal direction based on a similarity between the normal direction of the pixel of interest and the normal directions of pixels adjacent to the pixel of interest, 5. The information processing apparatus according to claim 4, wherein the compression means compresses the size of the file containing the diffuse reflection information based on the result of the evaluation by the evaluation means.

8. a dividing means for dividing the specular reflection information into a plurality of regions; 8. The information processing apparatus according to claim 1, wherein the compression means compresses the size of a file containing the diffuse reflection information for each of the divided regions.

9. An information processing device described in any one of claims 1 to 8, characterized in that the compression means compresses the size of a file containing the diffuse reflection information using a JPEG compression method based on the specular reflection information.

10. An information processing device described in any one of claims 1 to 9, characterized in that the compression means compresses the size of a file containing the diffuse reflection information using a compression rate obtained by referring to a lookup table based on the specular reflection information.

11. The information processing device according to claim 10, wherein the compression rate is the compression rate of the JPEG compression method.

12. An information processing device described in any one of claims 1 to 8, characterized in that the compression means compresses the size of a file containing the diffuse reflection information by reducing the bit depth of the diffuse reflection information based on the specular reflection information.

13. An information processing device described in any one of claims 1 to 8, characterized in that the compression means compresses the size of the file containing the diffuse reflection information by reducing the number of pixels of the diffuse reflection information based on the specular reflection information.

14. A program for causing a computer to function as each of the means of the information processing apparatus according to any one of claims 1 to 13.

15. a first acquisition step of acquiring specular reflection information relating to the specular reflection intensity on the surface of the object; a second acquisition step of acquiring diffuse reflection information relating to diffusely reflected light on the object; a compression step of compressing a file including the diffuse reflection information to reduce its size based on the specular reflection information, An information processing method characterized in that, in the compression step, the size of the file containing the diffuse reflection information is compressed to be smaller when the specular reflection intensity is large than when the specular reflection intensity is small.

Images