Information processing apparatus, information processing method, and storage medium

Abstract

An information processing apparatus, an information processing method, and a storage medium are disclosed. The information processing apparatus includes a switching unit configured to perform switching from a first mode in which a first image that is a still image of an object is displayed to a second mode in which a second image of the object is displayed, the second image being generated based on line-of-sight information; and a display control unit configured to display, on a display unit, the second image in which virtual illumination is reflected on the object in accordance with the switching performed by the switching unit.

Description

Technical Field

[0001] This disclosure relates to techniques for setting lighting conditions for inspecting the texture appearance of an object. Background Technology

[0002] In recent years, with advancements in printing and computer graphics (CG) technologies, the accuracy of reproducing the texture appearance of objects has significantly improved. Texture appearance refers to the impression of an object's surface caused by its unevenness, gloss, and other characteristics. Since the texture appearance of an object is perceived based on the reflection of light incident on it, it is crucial to determine how lighting conditions are set to represent the texture appearance. Japanese Patent Application Publication No. 2007-18173 discusses a technique for controlling the reflection of virtual light sources and the surrounding environment onto virtual objects in a virtual space to achieve optical consistency between real and virtual spaces.

[0003] However, according to Japanese Patent Application Publication No. 2007-18173, in the absence of illumination reflection on an object, shadows and gloss based on the unevenness of the object's surface are not represented. This causes problems for users in inspecting the texture and appearance of the object. Summary of the Invention

[0004] Various embodiments of this disclosure address the aforementioned problems and aim to provide a process that allows for easy inspection of the texture appearance of objects.

[0005] According to one embodiment of the present disclosure, the information processing apparatus includes: a switching unit configured to perform a switching from a first mode displaying a first image as a still image of an object to a second mode displaying a second image of the object, the second image being generated based on gaze information; and a display control unit configured to display, on a display unit, a second image of virtual lighting reflected on the object, according to the switching performed by the switching unit.

[0006] Other features of this disclosure will become clear from the following description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0007] Figure 1 This is a block diagram illustrating the hardware configuration of an information processing apparatus according to one embodiment.

[0008] Figure 2 This is a block diagram illustrating the logical configuration of an information processing apparatus according to one embodiment.

[0009] Figure 3 This is a flowchart of a process performed by an information processing device according to one embodiment.

[0010] Figure 4This is an illustration of a user interface (UI) for obtaining texture appearance information according to one embodiment.

[0011] Figure 5 This is a diagram illustrating a UI that displays images according to one embodiment.

[0012] Figure 6 This is a block diagram illustrating the logical configuration of an information processing apparatus according to one embodiment.

[0013] Figure 7 This is a flowchart of a process performed by an information processing device according to one embodiment. Detailed Implementation

[0014] Hereinafter, exemplary embodiments will be described with reference to the accompanying drawings. These exemplary embodiments are not intended to limit the invention. Furthermore, not all combinations of the features described for the exemplary embodiments are necessarily necessary for solutions in all embodiments of the invention.

[0015] In a first example embodiment, when a first viewing mode displaying a still image of an object is switched to a second viewing mode displaying an image of the object generated based on line-of-sight information, virtual lighting is reflected on the object.

[0016] <Hardware Configuration of Information Processing Device>

[0017] Figure 1This is a block diagram illustrating the hardware configuration of information processing device 1. Information processing device 1 includes a central processing unit (CPU) 101, a read-only memory (ROM) 102, and a random access memory (RAM) 103. Information processing device 1 also includes a video card (VC) 104, a general purpose interface (I / F) 105, a Serial Advanced Technology Attachment (SATA) I / F 106, and a network interface card (NIC) 107. CPU 101 uses RAM 103 as its working memory to execute an operating system (OS) or various programs stored in ROM 102, a hard disk drive (HDD) 113, etc. CPU 101 is controlled via a system bus 108. The processing in the flowchart described below is executed by CPU 101, which loads program code stored in ROM 102, HDD 113, etc., into RAM 103. VC 104 is connected to a display device 115. A general-purpose I / F 105 is connected via a serial bus 109 to an input device 110, such as a mouse or keyboard, and an imaging device 111. A SATA I / F 106 is connected to a general-purpose drive 114, which performs reading and writing to an HDD 113 or various recording media via a serial bus 112. A NIC 107 inputs information from external devices and outputs information to external devices. A CPU 101 uses the HDD 113 and various recording media installed in the general-purpose drive 114 as storage destinations for various types of data. The CPU 101 displays a user interface (UI) provided by a program on a display device 115 and receives user-indicated input via the input device 110. The display device 115 may be a touch panel display with the ability to detect the touch position of an indicator such as a finger.

[0018] <Logical Configuration of Information Processing Device>

[0019] Figure 2 This is a block diagram illustrating the logical configuration of the information processing device 1. The CPU 101 is used as a working memory to read and execute programs from ROM 102 or HDD 113. Figure 2 The logic components are shown in the diagram. Not all processes described below are necessarily executed by the CPU 101. The information processing device 1 can be configured such that some or all of the processing is executed by one or more processing circuits other than the CPU 101.

[0020] Information processing device 1 includes a texture appearance acquisition unit 201, a first image generation unit 202, an initial viewing angle acquisition unit 203, a setting unit 204, a dynamic viewing angle acquisition unit 205, a second image generation unit 206, and a display control unit 207. The texture appearance acquisition unit 201 acquires the diffuse reflection intensity ρ. d(x, y), specular reflection intensity ρ s The glossiness σ(x, y) and normal N(x, y) are used as texture appearance information. The first image generation unit 202 uses the diffuse reflection intensity ρ obtained by the texture appearance acquisition unit 201 as the basis for the texture appearance information. d The first image data (x, y) is generated for the first image I1(x, y) to be displayed in the first viewing mode. The initial gaze acquisition unit 203 acquires gaze information when the first viewing mode is switched to the second viewing mode. The setting unit 204 sets the illumination direction L and illumination intensity E as illumination information based on the gaze information and texture appearance information. The dynamic gaze acquisition unit 205 acquires gaze information that changes dynamically in the second viewing mode. The second image generation unit 206 uses the gaze information, illumination information, first image data, and texture appearance information to generate second image data for the second image I2(x, y) to be displayed in the second viewing mode. The display control unit 207 controls the display device 115 to display the first image I1(x, y), the second image I2(x, y), etc., on the display device 115.

[0021] <Processing performed by information processing device 1>

[0022] Reference Figure 3 The flowchart shown in the figure illustrates the processing procedure performed by the information processing device 1 in this example embodiment. When the user issues an instruction via the input device 110 and the CPU 101 receives the input instruction, the process begins... Figure 3 The process is illustrated in the flowchart.

[0023] In S301, the texture appearance acquisition unit 201 acquires the diffuse reflection intensity ρ from the storage device indicated in the texture appearance information according to the instruction received from the user via the input device 110. d (x, y), specular reflection intensity ρ s (x, y), gloss σ(x, y), and normal N(x, y). Figure 4 This is an illustration of an example of a UI used to obtain texture appearance information. The texture appearance acquisition unit 201 targets the diffuse reflection intensity ρ. d (x, y), specular reflection intensity ρ s Each of the following parameters—(x, y), glossiness σ(x, y), and normal N(x, y)—is used to set the storage device for texture appearance information specified by the user. In response to a press operation performed on the read button, the texture appearance acquisition unit 201 acquires the diffuse reflection intensity ρ from the corresponding storage device. d (x, y), specular reflection intensity ρ s(x, y), glossiness σ(x, y), and normal N(x, y). In this example embodiment, the texture appearance information is stored in HDD 113. However, the texture appearance information may be stored in another device connected to the information processing device 1, or the information processing device 1 may have a storage unit. The diffuse reflection intensity ρ in this example embodiment d (x, y) and specular reflection intensity ρ s (x, y) is read as a color image with pixel values ​​(R, G, and B) represented by 8 bits. Intensity, represented by values ​​from 0 to 1, is associated with values ​​from 0 to 255. In this example embodiment, the glossiness σ(x, y) is read as a grayscale image with pixel values ​​represented by 8 bits. A higher glossiness value results in a narrower specular reflection, thus exhibiting a strong gloss appearance. In this example embodiment, the normal N(x, y) is read as a color image with pixel values ​​(R, G, and B) represented by 8 bits. The x-component of the normal (values ​​from -1 to 1) is associated with the R-component of the pixel value (values ​​from 0 to 255). The y-component of the normal (values ​​from -1 to 1) is associated with the G-component of the pixel value (values ​​from 0 to 255). The z-component of the normal (values ​​from -1 to 1) is associated with the B-component of the pixel value (values ​​from 0 to 255).

[0024] In step S302, the first image generation unit 202 generates first image data about the first image I1(x, y) displayed in the first viewing mode based on the texture appearance information obtained in step S301. The first image I1(x, y) is a still image of the object displayed in the first viewing mode, and uses diffuse reflection intensity ρ according to the following formula (1). d (x, y) are used to generate:

[0025] I1(x,y)=E d ρ d (x,y) (1).

[0026] In the above formula, E d The illumination intensity is set such that the maximum value of the first image I1(x,y) is, for example, 50% of the maximum pixel value (255) so that the first image is visible.

[0027] In step S303, the display control unit 207 displays the first image I1(x, y) represented by the first image data generated in step S302 on the display device 115. Figure 5The diagram illustrates an example of a UI used to display an image. The display control unit 207 displays a first image I1 (x, y) in the image display area 501. In step S304, the display control unit 207 determines whether an instruction to switch from a first viewing mode to a second viewing mode has been received via the UI. The display control unit 207 continues to display the first image I1 (x, y) in step S303 until a switching instruction is issued from the user. In response to receiving a switching instruction from the user, the display control unit 207 determines that a switching instruction has been received ("Yes" in step S304) and the process proceeds to step S305. For example, by the user pressing... Figure 5 The texture appearance viewing mode button 502 in the UI shown in the figure is used to input a switching instruction. If the display control unit 207 determines that no switching instruction has been received ("No" in step S304), the process returns to step S303.

[0028] In step S305, the initial gaze acquisition unit 203 acquires the initial gaze information received in step S304 when the mode switching instruction was received. The gaze information refers to the gaze vector V = (Vx, Vy, Vz) indicating the direction of the gaze. For example, using... Figure 5 The UI shown in the diagram uses the gaze information input area 503 to input the gaze vector. Specifically, the gaze vector V has Vx and Vy (satisfying Vx...). 2 +Vy 2 The value (<1 to 1) is specified by pointer 504. The initial line-of-sight acquisition unit 203 derives Vz using the following equation (2):

[0029]

[0030] In step S306, the setting unit 204 sets the lighting information based on the gaze vector V, which is the gaze information obtained in step S305, and the texture appearance information obtained in step S301.

[0031] The lighting information includes a lighting vector L = (Lx, Ly, Lz) indicating the lighting direction, and a lighting intensity E, which is configured to allow the user to inspect desired image features. In this example embodiment, the number of pixels whose pixel values ​​are saturated is used to determine whether the desired image features can be inspected. First, the setting unit 204 sets the lighting vector L using a normal indicating the average direction of the object, such that the lighting vector L forms a specular reflection relationship with the viewing vector V. Specifically, the setting unit 204 derives the lighting vector L using the following equation (3):

[0032] L=2dot(N',V)N'-V (3).

[0033] In the above formula, N' is the average vector of the normal N(x, y), which is obtained by averaging the x, y, and z components of the normal and normalizing the average value to make its length 1. In the above formula, dot(·,·) represents the calculation of the dot product of vectors.

[0034] Next, the setting unit 204 sets the illumination intensity E. The setting unit 204 sets the illumination intensity E based on the illumination vector L, the line-of-sight vector V, and the diffuse reflection intensity ρ. d (x, y), specular reflection intensity ρ s The illumination intensity E is set based on the number of pixels whose pixel values ​​are saturated in the image generated by the normal N(x,y) and glossiness σ(x,y). First, the setting unit 204 generates the image I(x,y) using the following equation (4) based on the equations of Lambert's cosine law and the Blinn-Phong model, where Lambert's cosine law corresponds to diffuse reflection and the Blinn-Phong model corresponds to specular reflection: I(x,y)=E(ρ d (x,y)dot'(N(x,y),L)+ρ s (x,y)(dot'(N(x,y),H)) σ(x,y) (4).

[0035] In the above formula, dot'(·,·) represents the calculation of the inner product of vectors. If the inner product is negative, the negative value is replaced with zero. In the above formula, H is the intermediate vector (half vector) between the illumination vector L and the view vector V, and is derived by the expression H=(L+V) / |L+V|. Setting unit 204 calculates the image I(x,y) by increasing the illumination intensity E in formula (4) each time, and sets the illumination intensity E to the threshold of the number of pixels whose pixel values ​​are saturated. The threshold of the number of pixels whose pixel values ​​are saturated is preset to 1% of all pixels.

[0036] In step S307, the second image generation unit 206 begins the repetition processing of steps S308 to S310. In response to a user's instruction to end the repetition processing, the repetition processing ends in step S311. In step S308, the dynamic gaze acquisition unit 205 acquires the gaze vector V = (Vx, Vy, Vz) as the gaze information to be dynamically input in the second viewing mode. Based on... Figure 5 The gaze vector V is obtained by using Vx and Vy specified by pointer 504 and Vz derived from equation (2) on the gaze information input area 503 in the UI shown in the figure.

[0037] In step S309, the second image generation unit 206 uses the illumination vector L, illumination intensity E, gaze vector V, first image I1(x,y), and diffuse reflection intensity ρ d (x, y), specular reflection intensity ρs The second image data indicating the second image I2(x,y) is generated using the normal N(x,y) and glossiness σ(x,y). Specifically, the second image generation unit 206 generates the second image I2(x,y) by superimposing an image I'(x,y) generated using texture appearance information, lighting information, and viewing information onto the first image I1(x,y). The second image generation unit 206 performs the superposition of image I'(x,y) onto the first image I1(x,y) using the following equations (5) and (6):

[0038] I2(x,y)=βI1(x,y)+(1-β)I'(x,y)(5), and

[0039] I'(x,y)=E(ρ d (x,y)dot'(N(x,y),L)+ρ s (x,y)(dot'(N(x,y),H)) σ(x,y) (6).

[0040] In the above formula, β is the composition ratio of the first image I1(x,y) and the image I'(x,y), and is set to, for example, β = 0.5.

[0041] In step S310, the display control unit 207 displays the second image I2(x, y) generated in step S309 on the display device 115. Specifically, the display control unit 207 displays the second image I2(x, y) generated in step S309 on the display device 115. Figure 5 The second image I2(x,y) is displayed in the image display area 501 on the UI shown in the figure.

[0042] As described above, when the information processing apparatus 1 according to this example embodiment switches from a first viewing mode displaying a still image of an object to a second viewing mode displaying an image of an object generated based on viewing information, virtual lighting is reflected on the displayed image. Therefore, after switching to the second viewing mode to check the texture appearance of the object, the user can easily check the texture appearance of the object, such as bumps and gloss, by observing the reflected lighting on the object.

[0043] In a first example embodiment, a first image displayed in a first viewing mode is generated based on texture appearance information. Alternatively, a still image displayed as the first image can be prepared separately. In a second example embodiment, a pre-generated image is obtained as the first image displayed in the first viewing mode, and a second image displayed in the second viewing mode is generated based on texture appearance information. The hardware configuration of the information processing device in this example embodiment is the same as that in the first example embodiment, therefore redundant descriptions will be omitted. Hereinafter, the differences between this example embodiment and the first example embodiment will be mainly described. The same reference numerals will be used to describe components of this example embodiment that are the same as those in the first example embodiment.

[0044] <Logical Configuration of Information Processing Device 1>

[0045] Figure 6 This is a block diagram illustrating the logical configuration of the information processing device 1. The CPU 101 serves as a working memory for reading and executing programs stored in ROM 102 or HDD 113. Figure 6 The logic components are shown in the diagram. Not all processes described below are necessarily executed by the CPU 101. The information processing device 1 can be configured to perform some or all of the processes via one or more processing circuits.

[0046] The information processing device 1 includes a first image acquisition unit 601, a texture appearance acquisition unit 201, an initial viewing angle acquisition unit 203, a setting unit 204, a dynamic viewing angle acquisition unit 205, a second image generation unit 602, and a display control unit 207. The first image acquisition unit 601 acquires first image data relating to a first image I1(x, y) displayed in a first viewing mode. The second image generation unit 602 uses viewing angle information, lighting information, and texture appearance information to generate second image data relating to a second image I2(x, y) displayed in a second viewing mode.

[0047] <Processing performed by information processing device 1>

[0048] Reference Figure 7 The flowchart described above illustrates the processing performed by the information processing device 1 in this example embodiment. When the user inputs an instruction via the input device 110 and the CPU 101 receives the input instruction, the process begins... Figure 7 The process is illustrated in the flowchart.

[0049] Step S301 is similar to the corresponding step in the first example embodiment, therefore redundant descriptions will be omitted. In step S701, in response to an instruction from the user, the first image acquisition unit 601 acquires first image data about the first image I1(x, y) from the data storage device. The first image I1(x, y) is a color image having pixel values ​​(R, G, and B) represented by 8 bits. The first image acquisition unit 601 displays... Figure 4 The UI shown in the diagram is similar to the one that sets up a storage device for the first image data and retrieves the first image data from the storage device in response to a press operation performed on the read button.

[0050] In step S702, the display control unit 207 displays the first image I1(x, y) represented by the first image data obtained in step S701 on the display device 115. The displayed UI is... Figure 5 The UI shown in the diagram is similar, and the display control unit 207 displays the first image I1(x, y) in the image display area 501. Steps S304, S305, and S306 are similar to the corresponding steps in the first example embodiment, so redundant descriptions will be omitted. In step S703, the second image generation unit 602 begins the repetition of steps S308, S704, and S705. In response to an end instruction from the user, the repetition ends in step S706. Step S308 is similar to the corresponding steps in the first example embodiment, so redundant descriptions will be omitted.

[0051] In step S704, the second image generation unit 602 uses the gaze vector V, illumination vector L, illumination intensity E, and diffuse reflection intensity ρ. d (x, y), specular reflection intensity ρ s The second image data for the second image I2(x,y) is generated using the normal N(x,y) and glossiness σ(x,y). Specifically, the second image generation unit 602 generates the second image I2(x,y) using the following equation (7):

[0052] I2(x,y)=E(ρ d (x,y)dot'(N(x,y),L)+ρ s (x,y)(dot'(N(x,y),H)) σ(x,y) (7).

[0053] In step S705, the display control unit 207 displays the second image I2(x, y) generated in step S704 on the display device 115. Specifically, the display control unit 207 displays the second image I2(x, y) generated in step S704 on the display device 115. Figure 5 The second image I2(x,y) is displayed in the image display area 501 on the UI shown in the figure.

[0054] <Effects of this example embodiment>

[0055] As described above, in this example embodiment, the information processing device 1 obtains a pre-generated image as a first image to be displayed in a first viewing mode, and displays the first image until the first viewing mode is switched to a second viewing mode. Since the user can specify the image to be displayed in the first viewing mode, the image presented to the user in the first viewing mode can be set to an image suitable for the user.

[0056] [Variation Example]

[0057] In the above example embodiment, the UI and images are displayed on a display device 115 externally connected to the information processing device 1. Alternatively, the UI and images can be displayed on a hardware configuration such as a tablet computer in which the information processing device and display unit are integrated.

[0058] In the above example embodiment, the initial gaze information when switching to the second viewing mode is obtained via UI input, and the gaze information is used when the second image is generated. When using hardware such as a tablet computer as the information processing device 1, a gyroscope sensor or a built-in camera can be used to obtain the gaze information.

[0059] In the first example embodiment, the maximum value of the illumination intensity when the first image is generated is set such that the maximum value of I1(x,y) is 50% of the maximum pixel value (255). However, the percentage can be set to a different percentage.

[0060] In a first example embodiment, the first image is generated by multiplying the diffuse reflection intensity by a constant. Alternatively, the first image can be obtained by calculation based on a Lambert model using normals.

[0061] In the above example embodiment, the normal indicating the direction of the object's surface is obtained as the object's shape information included in the texture appearance information. Alternatively, a height map indicating the object's height distribution can be obtained.

[0062] In this case, the height map is converted into a normal map by differentiation, and then the above processing is performed.

[0063] In the above example embodiment, diffuse reflection intensity, specular reflection intensity, gloss, and normal are obtained as texture appearance information. Alternatively, other information, such as an anisotropy map indicating the distribution direction of specular reflection, can also be obtained based on the texture appearance to be represented.

[0064] In the example embodiments described above, texture appearance information is used in the format of an image with pixel values ​​represented by 8 bits. Alternatively, different image formats (such as 16-bit image formats) or different formats of information (binary files with data lists, text data, etc.) may be used.

[0065] In the example embodiment described above, the Blinn-Phong model is used as the model for specular reflection light when generating the second image. Alternatively, different model forms, such as the Torrance-Sparrow model or an approximation using a Gaussian function, can be used.

[0066] In the example embodiment described above, the lighting information used when generating the second image is set based on the number of pixels whose pixel values ​​are saturated. Alternatively, the lighting information can be set based on a preset ratio of specular to diffuse reflection or local contrast.

[0067] In the example embodiment described above, the composition ratio of the second image to the first image was set to 0.5 when generating the second image. Alternatively, different ratios can be used.

[0068] In the example embodiment described above, the number of saturated pixels used when setting the illumination intensity is set to 1% of all pixels in the image. Alternatively, a different threshold can be set.

[0069] In the above example embodiment, when new gaze information is obtained, the image displayed on the image display area 501 is updated. Alternatively, multiple images, each with different gaze information, can be displayed together.

[0070] Displaying multiple images allows users to compare them, and users can easily check differences in the appearance of objects by observing changes in gaze information.

[0071] According to example embodiments of this disclosure, the texture appearance of an object can be easily inspected.

[0072] Other embodiments

[0073] Various embodiments of the present invention can also be implemented by a computer that reads and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more fully referred to as a "non-transient computer-readable storage medium") to perform the functions of one or more embodiments described above and / or includes one or more circuits (e.g., application-specific integrated circuits (ASICs)) for performing the functions of one or more embodiments described above, and by a method executed by a computer of a system or device, for example, by reading and executing computer-executable instructions from a storage medium to perform the functions of one or more embodiments described above and / or controlling one or more circuits to perform the functions of one or more embodiments described above. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessor unit (MPU)) and may include a network of individual computers or individual processors to read and execute computer-executable instructions. The computer-executable instructions may be provided to the computer, for example, from a network or storage medium. The storage medium may include, for example, a hard disk, random access memory (RAM), read-only memory (ROM), storage devices for distributed computing systems, optical discs (such as CDs, DVDs, or Blu-ray discs). TM One or more of the following: flash memory devices, memory cards, etc.

[0074] Other embodiments

[0075] The embodiments of the present invention can also be implemented by providing software (programs) that perform the functions of the above embodiments to a system or device via a network or various storage media, and the computer or central processing unit (CPU) or microprocessor unit (MPU) of the system or device reads out and executes the program.

[0076] While exemplary embodiments have been described, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the appended claims should be given the broadest interpretation to include all such modifications and equivalent structures and functions.

Claims

1. An information processing device, characterized in that, include: The switching unit is configured to perform a switching from a first mode displaying a first image as a still image of an object to a second mode displaying a second image of the object, the second image being generated based on gaze information; The display control unit is configured to display a second image of virtual lighting reflected on an object on the display unit according to the switching performed by the switching unit; as well as The setting unit is configured to set information about the virtual lighting to be reflected on the object based on view information, texture appearance information about the object's texture appearance, and the number of pixels whose pixel values ​​are saturated. The second image is generated based on the information set regarding virtual lighting.

2. The information processing apparatus according to claim 1, further comprising: The first acquisition unit is configured to acquire texture appearance information; as well as The generation unit is configured to generate a second image that reflects virtual lighting on an object based on texture appearance information.

3. The information processing apparatus according to claim 2, wherein, The generation unit generates a second image by superimposing a reflection image with virtual lighting onto the first image.

4. The information processing apparatus according to claim 1, wherein, Information about virtual lighting includes the direction and intensity of the virtual lighting.

5. The information processing apparatus according to claim 1, wherein, The setting unit configures information about virtual lighting based on a preset ratio of specular to diffuse reflection.

6. The information processing apparatus according to claim 1, wherein, The settings unit uses local contrast to set information about virtual lighting.

7. The information processing apparatus according to claim 1, wherein, Texture appearance information includes at least diffuse reflection intensity, specular reflection intensity, and normal.

8. The information processing apparatus according to claim 1, further comprising: The second acquisition unit is configured to acquire line-of-sight information. In response to newly acquired gaze information, the display control unit displays an image generated based on the newly acquired gaze information on the display unit.

9. An information processing method, characterized in that, include: Perform a switch from a first mode that displays a first image as a still image of an object to a second mode that displays a second image of an object generated based on gaze information; Information about the virtual lighting to be reflected on the object is set based on view information, texture appearance information about the object's texture appearance, and the number of pixels whose pixel values ​​are saturated. as well as Depending on the switching, a second image reflecting virtual lighting on the object is displayed on the display unit. The second image is generated based on the information set regarding virtual lighting.

10. A non-transient computer-readable storage medium storing instructions, characterized in that, When executed by a computer, the instructions cause the computer to perform an information processing method, which includes: Perform a switch from a first mode that displays a first image as a still image of an object to a second mode that displays a second image of an object generated based on gaze information; Information about the virtual lighting to be reflected on the object is set based on viewpoint information, texture appearance information about the object's texture, and the number of pixels with saturated pixel values; and Depending on the switching, a second image reflecting virtual lighting on the object is displayed on the display unit. The second image is generated based on the information set regarding virtual lighting.

Images