Information processing device, information processing method, and program

Abstract

To provide processing, in a case where data representing texture of an object is searched for, for easily checking whether search results intended by a user have been obtained.SOLUTION: An information processing apparatus includes: setting means configured to set an element to be prioritized in search of texture data representing texture of an object; search means configured to search for the texture data based on the set prioritized element; and display control means configured to display, on display means, an image that corresponds, regarding the texture data obtained by the search of the search means, to an appearance of the object in a case where the object is observed under a plurality of geometric conditions.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a technique for displaying data relating to the texture of an object. [Background technology]

[0002] In recent years, various search techniques have been proposed that search for data including texture information. For example, Patent Document 1 discloses a technique that searches for material information corresponding to linguistic information entered by a user and displays images of products made of the material indicated by the material information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-37455 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when searching for an object that has a different appearance depending on the angle from which it is observed, simply displaying a single still image as a search result, as in Patent Document 1, may not allow the user to determine whether the object has the texture intended.

[0005] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide a process for easily checking whether the user has obtained the search results he or she intended when searching for data representing the texture of an object. [Means for solving the problem]

[0006] In order to solve the above problems, an information processing device according to the present invention comprises: a setting means for setting an element to be prioritized in a search for texture data representing the texture of an object; a search means for searching for texture data based on the set element to be prioritized; and a display control means for displaying, on a display means, an image corresponding to how the object looks when observed under a plurality of geometric conditions, with respect to the texture data obtained by the search means. and when a user's instruction to enlarge the image is received, the setting means sets the surface shape as the element to be prioritized. It is characterized by: [Effects of the Invention]

[0007] According to the present invention, when searching for data representing the texture of an object, the user can easily check whether the search results he or she intended have been obtained. [Brief explanation of the drawings]

[0008] [Figure 1] Block diagram showing the hardware configuration of an information processing device [Figure 2] Diagram to explain the search procedure [Figure 3] 1 is a flowchart showing a process executed by an information processing device; [Figure 4] Flowchart showing a process including display change and priority element update [Figure 5] Flowchart showing search processing [Figure 6] Diagram for explaining feature vectors [Figure 7] A diagram illustrating an example of how search results are displayed [Figure 8] Flowchart showing search processing [Figure 9] Diagram for explaining direction determination items [Figure 10] Block diagram showing the functional configuration of an information processing device DETAILED DESCRIPTION OF THE INVENTION

[0009] Each embodiment will be described below with reference to the drawings. Note that the following embodiments do not necessarily limit the present invention. Furthermore, not all of the combinations of features described in each embodiment are necessarily essential to the solution of the present invention.

[0010] [First embodiment] Texture data representing the texture of an object is used to allow a user to recognize, via a display device, changes in color appearance and glossiness that occur depending on conditions such as the position and brightness of lighting. In this embodiment, a database that stores texture data is used to perform a search corresponding to an input by a user, and the search results are displayed as a video on a display device. Note that, although the search target in this embodiment is an image of a curtain, it may also be an image of another object.

[0011] <Hardware configuration of information processing device> FIG. 1 is a block diagram showing the hardware configuration of an information processing device 1. The information processing device 1 includes a CPU 101, a ROM 102, and a RAM 103. The information processing device 1 also includes a VC (video card) 104, a general-purpose I / F (interface) 105, a SATA (serial ATA) I / F 106, and a NIC (network interface card) 107. The CPU 101 uses the RAM 103 as a work memory to execute an OS (operating system) and various programs stored in the ROM 102, a HDD (hard disk drive) 113, etc. The CPU 101 also controls each component via a system bus 108. Note that, in the processing of the flowcharts described below, program codes stored in the ROM 102, the HDD 113, etc. are loaded into the RAM 103 and executed by the CPU 101. A display device 115 is connected to the VC 104. An input device 110, such as a mouse or a keyboard, and an imaging device 111 are connected to the general-purpose I / F 105 via a serial bus 109. A general-purpose drive 114 that reads from and writes to an HDD 113 and various recording media is connected to the SATA I / F 106 via a serial bus 112. The NIC 107 inputs and outputs information to and from external devices. The CPU 101 uses the HDD 113 and various recording media mounted on the general-purpose drive 114 as storage locations for various data. The CPU 101 displays a UI (user interface) provided by a program on a display device 115, and receives inputs such as user instructions received via the input device 110. The display device 115 may be a touch panel display having a touch panel function that detects the position of a touch by a pointer such as a finger.

[0012] <Image search procedure> The procedure for searching for curtain images in this embodiment will be described with reference to FIG. 2. The user specifies the type of curtain on the display screen shown in FIG. 2(a). In this embodiment, the following curtain types are presented: "drape curtain," "lace," "roll curtain," and "blind." For example, when "drape curtain" is selected in FIG. 2(a), the display screen transitions to FIG. 2(b), displaying a list of thumbnail images corresponding to "drape curtain." In addition, along with the list of thumbnail images, buttons for "search similar," "enlarge fabric," "check gloss," and "display list" are displayed, and the user can use the displayed buttons to input the next command. In FIG. 2(b), the displayed buttons are grayed out and cannot be selected. When the user selects a desired curtain image in FIG. 2(b), the selected image is surrounded by a frame 201, as shown in FIG. 2(c), indicating that it is selected. When an image is selected as shown in Figure 2(c), the grayed-out buttons "Search for Similar Items," "Enlarge Fabric," and "Check Gloss" are cleared, and the user is able to select the buttons, except for the current display state of "List Display." In Figure 2(c), when the selected image surrounded by a frame 201 is double-clicked, the entire selected curtain is enlarged and displayed, similar to an online shopping site.

[0013] When the "Enlarge Fabric" button is selected in FIG. 2(c), the display screen shown in FIG. 2(d) is displayed. In the display screen shown in FIG. 2(d), the curtain fabric enclosed by frame 201 is enlarged, and the image is displayed so that the uneven surface shape can be easily identified. When the "Confirm Gloss" button is selected in FIG. 2(c), the display screen shown in FIG. 2(e) is displayed. In the display screen shown in FIG. 2(e), the image is displayed so that the gloss of the curtain fabric enclosed by frame 201 can be confirmed. In this embodiment, the user can adjust the position of the light source using slider 202 and the brightness of the light source using slider 203. By changing the position and brightness of the light source, the gloss (how light is reflected) of the selected curtain can be confirmed. When the "List Display" button is selected on the enlarged screen showing the entire curtain, or on the display screen shown in FIG. 2(d) or FIG. 2(e), i.e., when only one curtain is displayed on the entire screen, the display screen shown in FIG. 2(c) can be returned to the display screen shown in FIG. 2(c). Furthermore, by selecting the "Search for Similarity" button on the enlarged screen that displays the entire image of the curtain, or on the display screens of Figures 2(c), 2(d), and 2(e), it is possible to search for curtains with similar textures. When a similarity search is performed on the display screen of Figure 2(c), curtains similar to the curtain surrounded by frame 201 are searched for. When a similarity search is performed on the display screen of Figure 2(d), curtains with a surface shape similar to the displayed surface shape are searched for. When a similarity search is performed on the display screen of Figure 2(e), curtains with a gloss similar to the displayed gloss are searched for.

[0014] The search results are displayed on two axes as shown in Figures 2(f), 2(g), and 2(h). The combination of (horizontal axis, vertical axis) in Figure 2(f) is (color variations, texture variations). The combination of (horizontal axis, vertical axis) in Figure 2(g) is (texture variations, color variations). The combination of (horizontal axis, vertical axis) in Figure 2(h) is (gloss variations, color variations). Note that the combination of (horizontal axis, vertical axis) may be (color variations, gloss variations), etc., and is not limited to the above example. The horizontal and vertical axes are assumed to change depending on the user's operation history before the similarity search.

[0015] In this embodiment, it is assumed that the HDD 113 in FIG. 1 stores texture data corresponding to multiple curtains and thumbnail videos that clearly show the texture of each curtain. The texture data consists of three elements: texture data representing color elements, normal map data representing surface shape elements, and specular map data representing gloss elements. The texture data is image data representing an image in which pixel values ​​are expressed using RGB values ​​(R, G, B). The normal map data is one-channel vector data representing the normal direction at each point on the fabric surface of the curtain and is used to reproduce fine uneven shapes. The specular map data contains information about specularly reflected light on the surface of the curtain and represents the direction and intensity of light reflected at each point on the surface. The specular map data is data used to reproduce gloss based on the normal direction. The specular reflected light information includes information defining the normal, as well as more detailed unevenness information than the normal information, and information about the intensity, width, and direction of the specular reflection component determined by physical property values.

[0016] <Functional configuration of information processing device> Fig. 10 is a block diagram showing the functional configuration of the information processing device 1. The CPU 101 uses the RAM 103 as a work memory and reads and executes a program stored in the ROM 102 or the HDD 113, thereby functioning as the functional configuration shown in Fig. 10. Note that it is not necessary for all of the processes described below to be executed by the CPU 101, and the information processing device 1 may be configured so that part or all of the processes are executed by one or more processing circuits other than the CPU 101.

[0017] The information processing device 1 has a setting unit 1001, an acquisition unit 1002, a determination unit 1003, a display control unit 1004, and a search unit 1005. The setting unit 1001 sets elements to be prioritized when searching for texture data. The acquisition unit 1002 acquires instruction information representing a user instruction. The determination unit 1003 determines whether the instruction from the user represents a similarity search based on the acquired instruction information. The display control unit 1004 controls the display by the display device 115. The search unit 1005 searches for texture data.

[0018] <Processing performed by the information processing device> The flow of processing executed by the information processing device 1 in this embodiment will be described with reference to the flowchart in Fig. 3. The processing shown in the flowchart in Fig. 3 starts when a user inputs an instruction via the input device 110 and the CPU 101 accepts the input instruction. Hereinafter, each step (process) will be represented by adding an S before the reference number.

[0019] In S301, the setting unit 1001 initializes two elements to be prioritized when searching for texture data. In this embodiment, the setting unit 1001 sets color as the first priority element and surface shape as the second priority element. In S302, the acquisition unit 1002 acquires instruction information representing a user instruction. The instruction is input by the user via the input device 110. In S303, the determination unit 1003 determines whether the instruction information acquired in S302 indicates the execution of a similarity search. If the instruction information acquired in S302 indicates the execution of a similarity search, the process proceeds to S305; otherwise, the process proceeds to S304. In S305, the search unit 1005 searches for texture data, and the display control unit 1004 displays the search results on the display device 115. Details of the search process in S305 will be described later. In S304, the display control unit 1004 changes the display on the display device 115 in accordance with the instruction represented by the instruction information acquired in S302. The setting unit 1001 also updates the content of the priority element. Details of the display and priority element update process in S304 will be described later. In S306, the determination unit 1003 determines whether to end the series of processes based on whether an end instruction has been received from the user. If the series of processes is not to be ended, the process returns to S302, and the acquisition unit 1002 acquires new instruction information.

[0020] <Display and Priority Element Update Process (S304)> The display and priority element update process in S304 will be described with reference to the flowchart in FIG. 4. In S401, the setting unit 1001 determines whether the instruction information acquired in S302 represents "enlarge fabric." If the instruction information acquired in S302 represents "enlarge fabric," the process proceeds to S405, where the setting unit 1001 sets the target element to the surface shape, and the display control unit 1004 displays the surface shape of the fabric on the display device 115. If the instruction information acquired in S302 does not represent "enlarge fabric," the process proceeds to S402. In S402, the setting unit 1001 determines whether the instruction information acquired in S302 represents "check gloss." If the instruction information acquired in S302 represents "check gloss," the process proceeds to S406. In S406, the setting unit 1001 sets the target element to gloss, and the display control unit 1004 displays a screen on the display device 115 on which the light source can be moved. If the instruction information acquired in S302 does not represent "check gloss," the process proceeds to S403. In S403, the setting unit 1001 determines whether the instruction information acquired in S302 represents an instruction to enlarge and display the entire image of the selected curtain. If the instruction information acquired in S302 represents an instruction to enlarge and display the entire image of the selected curtain, the process proceeds to S407. In S407, the setting unit 1001 sets the focus element to color, and the display control unit 1004 enlarges and displays the entire image of the curtain. If the instruction information acquired in S302 does not represent an instruction to enlarge and display the entire image of the selected curtain, the process proceeds to S404.

[0021] In S404, the display control unit 1004 switches the display to one corresponding to the instruction indicated by the instruction information. In the process of S404, for example, if the "List Display" button is selected, the screen returns to the list display. If another button is selected, the screen transitions to a screen display corresponding to the selected button. In S405, S406, and S407, the setting unit 1001 updates the focus element, and the display control unit 1004 updates the display screen. Then, the process proceeds to S408. In S408, the setting unit 1001 determines whether the first priority element matches the focus element updated in S405, S406, and S407. If the first priority element matches the focus element, the process of S304 ends. If the first priority element does not match the focus element, the process proceeds to S409. In S409, the setting unit 1001 assigns the first priority element to the second priority element, and assigns the focus element set in any of S405, S406, and S407 to the first priority element. The first priority element and the second priority element are parameters used in the search process of S305.

[0022] In the above processing flow, if the last received user instruction is the same as the user instruction received before that, the first priority element and the second priority element are not updated. If the last received user instruction is an instruction related to updating the priority element and is different from the user instruction related to the update of the priority element before that, both the first priority element and the second priority element are updated. When updating, the previous first priority element is demoted to the second priority element, and the first priority element is determined based on the last user instruction.

[0023] <Search process (S305)> The search process in S305 will be described with reference to the flowchart in FIG. 5. In S501, the search unit 1005 acquires texture data corresponding to the selected image, i.e., the image surrounded by the frame 201 in FIG. 2(c). In S502, the search unit 1005 acquires a feature value F1 of the first-priority element. In this embodiment, the first-priority element is color, surface shape, or gloss. In this embodiment, the color feature value is determined by using a representative Luv vector that is the maximum in a histogram in Luv space within texture data corresponding to a predetermined region. That is, as shown in FIG. 6(a), the Luv space is divided into certain unit cubes, and the cubes containing each pixel value in the predetermined image region are counted. The vector to the center coordinates of the cube containing the most pixels is determined as the color feature value. As the surface shape feature value, a Gabor filter is applied to normal map data corresponding to a predetermined region, and the resulting mean and variance vectors are used. As for gloss features, a histogram is created in the same way as for color features, using the gloss intensity and spread in the specular map data corresponding to a predetermined region, and the maximum combination of intensity and spread is used as the feature. That is, as shown in Figure 6(b), a histogram is created based on the vector 604 of the strongest specular reflection component and the spread width 605 of the specular reflection component when light 603 is irradiated from a specified position onto a surface 601 having a normal 602 at each pixel. These feature values ​​are assumed to be derived in advance and saved as material appearance data information.

[0024] In S503, the search unit 1005 divides all texture data into N predetermined data groups Ga(0) to Ga(N-1) in order of proximity to the selected image using the feature F1. In this embodiment, N=4. The proximity of the data is defined by the distance (difference) in the feature F1, and data groups can be generated by dividing the distance into four stages. In S504, the search unit 1005 acquires the feature F2 of the second priority element. In S505, the search unit 1005 initializes a counter K by substituting 0 for K. In S506, the search unit 1005 ranks each data item in the data group Ga(K) by its proximity to the texture data acquired in S501 using the feature F2. The proximity of the feature is defined by the distance of the feature F2. In S507, the search unit 1005 acquires thumbnail videos corresponding to the data items included in the image group Ga(K) in accordance with the ranking in S506. The display control unit 1004 displays the acquired thumbnail video on the display device 115. This thumbnail video is generated in advance for each data set as a video that makes it easy to check changes in appearance when observed while changing geometric conditions, such as by changing the light source position, tilting the object, or changing the user's viewpoint, and is stored as texture data. In S508, the search unit 1005 increments the counter K by 1. In S509, the search unit 1005 compares the counter K with the number of divisions used in S503. If the counter K and the number of divisions are equal, it is assumed that distance calculation and ranking have been performed for all data sets using the feature F2, and this processing flow ends. If the counter K and the number of divisions are not equal, the processing returns to S506 to calculate and display the distance using the feature F2 for the next data set.

[0025] In this embodiment, the search results are displayed in the order of data groups Ga(0), Ga(1), and Ga(2) from left to right. The data groups are also displayed from top to bottom in order of closest distance to the feature value F2. Figure 2(f) shows the search results when the first priority element is color and the second priority element is surface shape. The data in the upper left corner is the data selected by the user, and below it, the data group Ga(0) with the closest color is arranged in order of surface shape similarity to the selected data. The middle column shows the data group with the second closest color, and these data groups are arranged horizontally in order of surface shape similarity. Figure 2(g) shows the search results when the first priority element is surface shape and the second priority element is gloss. Figure 2(h) shows the search results when the first priority element is gloss and the second priority element is color.

[0026] According to this embodiment, the user can check the search results for data similar to the selected data in a video with a clear texture, making it easy to narrow down the search results. Furthermore, in this embodiment, the elements used to determine whether the data are similar or not are displayed in a way that makes it easy for the user to recognize. Furthermore, because the elements used for the determination are determined by the user's instructions, elements that the user is particularly interested in or values ​​are automatically reflected in the search results.

[0027] <Modification> In this embodiment, the case where texture data, normal map data, and specular map data are stored as data corresponding to the three elements (color, surface shape, and gloss) that make up the texture data has been described. However, the texture data is not limited to the above example. For example, the data corresponding to the three elements may be texture data, onomatopoeia related to texture, and onomatopoeia related to gloss. Onomatopoeia related to texture is composed of words describing the surface shape, such as "smooth," "fine," "smooth," "fluffy," "rough," and "gritty," combined with or without words describing the degree of the surface, such as "very," "somewhat," and "slightly." Furthermore, onomatopoeia related to gloss is composed of words describing the degree of light reflection, combined with or without words describing the degree and the coverage. Words describing the degree of light reflection include "matt," "gloss," and "sparkling." Words describing the degree include "very," "somewhat," and "slightly." Words that express coverage include "overall," "partially," "here and there," "dots," etc. These onomatopoeias are converted into one-dimensional numerical values ​​and used as features of surface shape and gloss.

[0028] We will explain how to quantify onomatopoeia related to surface shape. The words that describe the surface shape itself, such as "smooth," "fine," "smooth," "rough," and "coarse," are assigned numerical values ​​of 10, 20, ..., and 60, respectively. Furthermore, the words that describe the degree, such as "very," "to a certain extent," and "slightly," are assigned numerical values ​​of -7, -5, and -3, respectively. When a word that describes the surface shape itself is combined with a word that describes the degree as a surface shape element of a certain piece of data, the sum of the numerical values ​​of both words is used as the feature corresponding to the onomatopoeia of the surface shape. This makes it possible to derive the distance of the feature.

[0029] This section explains how to quantify onomatopoeia related to gloss. Texture data must contain one gloss onomatopoeia combined with "overall," which indicates coverage, and may also contain onomatopoeia combined with other words indicating coverage. For example, there is data containing only gloss onomatopoeia, such as "overall" + "very" + "matte," and data containing two onomatopoeia, such as "overall" + "very" + "matte" and "in places" + "sparkling." The terms "matte," "gloss," and "sparkling," which indicate the degree of light reflection, are assigned numerical values ​​of 10, 30, and 50, respectively. The terms "very," "to some extent," and "slightly," which indicate degree, are assigned values ​​of -5, 5, and 10, respectively. The terms "overall," "in some places," "in places," and "in spots," which indicate coverage, are assigned values ​​of 1.0, 0.5, 0.3, and 0.1, respectively. The numerical value of each onomatopoeia is calculated by (the numerical value of the degree of light reflection) + (the numerical value of the degree) × (the numerical value of the coverage rate). By using this numerical value as the feature of gloss, the distance of the feature can be derived.

[0030] [Second embodiment] In the first embodiment, search results were presented to the user based on the proximity of the feature amounts of each element, as shown in Figures 2(f) to 2(h). That is, with regard to texture data, if the color represented by vector 610 in Figure 6(a) is included in region 611, feature amount vectors equidistant from vector 610 are also set in regions 612 and 613, and the data in both regions are arranged based on distance. In this embodiment, directionality is taken into consideration when deriving the proximity of the feature amounts, and the directionality is also presented to the user when displaying the search results.

[0031] By presenting search results as in this embodiment, it is possible to set an axis for displaying search results from the multiple data that make up each element data, and to arrange the search result information based on the added axis. Fig. 7 shows an example of the display of search results in this embodiment. The image surrounded by frame 701 is an image selected when searching for similar images. Similar images are searched for with the image surrounded by frame 701 as the center, with color as the first priority element and surface shape as the second priority element, and the search results are displayed.

[0032] The difference between this embodiment and the first embodiment is the search process in S305. Note that the hardware configuration and functional configuration of the information processing device in this embodiment are the same as those in the first embodiment, so a description thereof will be omitted. Below, differences between this embodiment and the first embodiment will be mainly described. Note that the same components as those in the first embodiment will be described using the same reference numerals.

[0033] <Search process (S305)> The search process in S305 will be described with reference to the flowchart in FIG. 8. Steps S501 to S505, S508, and S509 are the same as those in the first embodiment, and therefore will not be described here. In S801, the search unit 1005 acquires the direction determination item D1 of the first priority element acquired in S502. The direction determination item D1 in this embodiment is predetermined for each texture data, and for the element "color", * The value is the variance for the "surface shape" element, and the length of the component vector with the strongest specular reflection for the "gloss" element. Various other axes can be defined, but they can be selected appropriately depending on the display method.

[0034] In S802, the search unit 1005 sorts the data group Ga(0) to Ga(N-1) using the direction determination item D1 acquired in S801. * a * b * In the space, the area of ​​the data set Ga(K) (K is any value between 0 and N-1) is defined as a * b* The data set Ga(0) to Ga(N-1) is projected onto the L * a * b * Value data is L * The conceptual diagram of the one-dimensional arrangement of the values ​​of is shown in Figure 9(b). * The distances between point 903 and point 904 and point 902 are almost the same, but the distances between point 903 and point 904 and point 902 are almost the same. * On the axis, they are in opposite directions relative to point 902. Even if they are about the same distance apart, the direction determination item D1 is the criterion for determining which side they are separated from. Similarly, the axis in Figure 9(b) is the variance for surface shape and the length of the vector for gloss.

[0035] In S803, the search unit 1005 acquires the direction determination item D2 of the second priority element. In S804, the search unit 1005 ranks the data group Ga(K) using the feature F2, as in the first embodiment. The search unit 1005 further rearranges the ranked data according to the direction determination item D2. The method of rearranging the data is the same as in S802. However, in this step, the value located at the center of the area is not used, but rather the value of each piece of data is used. In S805, the search unit 1005 acquires a video for confirming the texture in the order of the data rearranged in S804, and the display control unit 1004 displays the acquired video on the display device 115 as shown in FIG. 7.

[0036] <Modification> In this embodiment, as in the modified example of the first embodiment, the surface shape and gloss may be stored as onomatopoeia. In this embodiment, as direction determination items, words expressing the degree of the surface shape and gloss may be used, and words expressing the coverage rate may be used for gloss.

[0037] [Other embodiments] In the above-described embodiment, normal map data is used as data representing the surface shape, but bump map data or height map data may also be used. Also, specular map data is used as data representing gloss, but diffuse map data may also be used.

[0038] Furthermore, in the above-described embodiment, texture data, normal map data, and specular map data are used as the texture data, but the present invention is not limited to the above examples. For example, elements such as transparency and diffuse reflection may be added to use four or more types of texture data. It is possible to select two elements based on the user's operation history, define the similarity, and display the selected elements.

[0039] Furthermore, the processing of the above-described embodiment may be realized by a standalone search device, or by a search system of a server and a client via a network. When the information processing device 1 is a standalone search device, it accepts user instructions via the input device 110 and performs display of search results, etc. using the display device 115. On the other hand, when a server-client search system is used, the information processing device 1, which is the server, accepts user instructions through communication via the NIC 107. Furthermore, the information processing device 1 provides data necessary for display of search results, etc. to the client device through communication via the NIC 107.

[0040] The information processing device 1 may also be a portable device equipped with an acceleration sensor or an image sensor, such as a tablet PC. In this case, the device may sense the tilt of the device body to change the light source position, or may use the image sensor to determine the surrounding light source (for example, fluorescent light, outdoor light, tungsten light, etc.) and change the display image based on the determination result.

[0041] In the above-described modified examples, onomatopoeia for surface shape and gloss have been described as a limited combination of several words, but the present invention is not limited to these examples. For example, other words such as prickly, rough, bumpy, crunchy, shiny, etc. may be used, or other words may be added. Furthermore, while words expressing degree and coverage are used, words expressing impressions (such as smooth, masculine, calm, and soft) may also be used.

[0042] Furthermore, in the above-described embodiment, thumbnail-sized videos that allow easy understanding of texture information were used as search results, but other methods that allow texture confirmation may be used. For example, rendering may be performed using data that allows texture to be displayed, or still images with different geometric conditions may be displayed consecutively. In this case, there is no need to store thumbnail videos in advance, which reduces the required data capacity.

[0043] In addition, in the above-described embodiment, an example of changing the position and brightness of the light source in Figure 2(e) was described as a UI screen for checking gloss, but it may also be possible to change the intensity and color temperature of the light source.

[0044] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0045] 1. Information processing equipment 1001 Setting Department 1004 Display control unit 1005 Search Department

Claims

1. a setting means for setting an element to be prioritized in retrieval of texture data representing the texture of an object; a search means for searching for texture data based on the set priority elements; a display control means for displaying on a display means an image corresponding to how the object looks when observed under a plurality of geometric conditions, with respect to the texture data obtained by the search by the search means; The information processing apparatus is characterized in that the setting means sets the surface shape as the element to be prioritized when a user's instruction to enlarge and display the image is received.

2. 2. The information processing apparatus according to claim 1, wherein the display control means displays a moving image as the image on the display means.

3. 2. The information processing apparatus according to claim 1, wherein said display control means successively displays, as said images, still images corresponding to said plurality of geometric conditions on said display means.

4. further comprising a receiving means for receiving a user instruction specifying texture data to be searched; 4. The information processing apparatus according to claim 1, wherein the search means searches a plurality of texture data for texture data that are similar to the texture data to be searched for in the priority element.

5. the setting means sets a first element and a second element as the element to be prioritized; the search means acquires a first data group by searching for texture data using the first element, and searches for texture data from the first data group using the second element; 5. The information processing apparatus according to claim 4, wherein the display control means displays the image relating to the texture data searched for using the second element on the display means.

6. 6. The information processing device according to claim 5, wherein the display control means displays the image relating to the texture data searched for using the second element on the display means in accordance with the similarity of the first element to the texture data to be searched and the similarity of the second element to the texture data to be searched for.

7. 7. The information processing apparatus according to claim 1, wherein the priority element is at least one of color, gloss, and surface shape.

8. 8. The information processing apparatus according to claim 1, wherein the plurality of geometric conditions differ from each other in at least one of a position of a light source, an intensity of a light source, a color temperature of a light source, and a position of a viewpoint.

9. 9. The information processing apparatus according to claim 1, wherein the setting unit sets a color as the element to be prioritized when a user's instruction to display the entire image of the object is received.

10. 10. The information processing device according to claim 1, wherein the setting means sets glossiness as the element to be prioritized when a user's instruction to display a display for checking the glossiness of the object is received.

11. An information processing device as described in any one of claims 1 to 10, characterized in that the search means, when a screen for observing the surface shape of the object is displayed, searches for an object having a surface shape similar to the surface shape of the object, and, when a screen for observing the gloss of the object is displayed, searches for an object having a gloss similar to the gloss of the object.

12. An information processing device described in any one of claims 1 to 11, characterized in that the display control means displays an image corresponding to the appearance of the object using axes corresponding to any two of color, texture, and gloss.

13. The information processing device according to claim 12, wherein the axis is changed according to a user operation history prior to a search by the search means.

14. A program for causing a computer to function as each of the means of the information processing apparatus according to any one of claims 1 to 13.

15. a setting step of setting elements to be prioritized in retrieval of texture data representing the texture of an object; a search step of searching for texture data based on the set priority elements; a display control step of displaying on a display means an image corresponding to how the object looks when observed under a plurality of geometric conditions, with respect to the texture data obtained by the search in the search step; The information processing method is characterized in that, in the setting step, if a user's instruction to enlarge the image is received, the surface shape is set as the element to be prioritized.

Images