Information processing device and information processing method

By determining the actual product's color and adjusting the avatar's color based on environmental data, the device reduces color discrepancies in virtual fitting systems, improving accuracy and reliability.

JP7578759B1Active Publication Date: 2024-11-06KDDI CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023089549
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-11-06
Estimated Expiration
2043-05-31

AI Technical Summary

Technical Problem

The challenge in virtual fitting systems is that the color set for a product avatar often differs from the actual color of the product due to material variations, leading to discrepancies between the avatar's color and the actual product's color.

Method used

An information processing device that acquires product image data, determines the actual product's color, and adjusts the avatar's color to match, using environmental information to correct imaging conditions and display the avatar in a consistent virtual environment.

Benefits of technology

This approach reduces the color discrepancy between the product avatar and the actual product, enhancing the accuracy and reliability of virtual fitting experiences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007578759000001_ABST
    Figure 0007578759000001_ABST
Patent Text Reader

Abstract

Reduce the difference between the color of the product avatar and the actual product. [Solution] The information processing device 1 has an acquisition unit 131 that acquires product image data of an actual product corresponding to a product avatar, which is an avatar of the product, a determination unit 132 that identifies the color of the actual product indicated by the product image data acquired by the acquisition unit 131 and determines the color of the product avatar to be the identified color of the actual product, and a product display control unit 136 that displays the product avatar of the determined color on a user terminal 2.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing method. [Background technology]

[0002] Conventionally, virtual fitting has been performed in which an avatar that imitates a user tries on products such as clothes in a virtual space (for example, see Patent Document 1). Virtual fitting allows a user to check the impression of themselves when trying on a product without trying it on themselves. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2023-002440 A Summary of the Invention [Problem to be solved by the invention]

[0004] When creating an avatar of a product to be tried on by a user's avatar in a virtual space, a setter may set the color of the avatar of the product by selecting a color corresponding to the actual product from a plurality of predetermined colors. However, depending on the material of the product, etc., a problem occurs in that the color set for the avatar of the product may differ from the color of the actual product.

[0005] The present invention has been made in consideration of these points, and has an object to reduce the difference between the color of a product avatar and the color of the actual product. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present invention has an acquisition unit that acquires product image data of an actual product corresponding to a product avatar, which is an avatar of the product, a determination unit that identifies a color of the actual product indicated by the product image data acquired by the acquisition unit and determines the color of the product avatar to be the identified color of the actual product, and a display control unit that displays the product avatar in the determined color on a user's terminal.

[0007] The acquisition unit acquires the product image data including environmental information indicating the imaging environment when the actual product was imaged, and the information processing device further has a memory control unit that associates the product avatar, the color of the product avatar determined by the determination unit, and the environmental information included in the product image data acquired by the acquisition unit and stores them in a memory unit, and a setting unit that sets a virtual imaging environment to be applied to the product avatar to be displayed on the terminal, and the display control unit may identify the color of the product avatar when the imaging environment indicated by the environmental information associated with the product avatar in the memory unit is corrected to the virtual imaging environment set by the setting unit, and display the product avatar of the identified color on the terminal.

[0008] The information processing device may further have a memory control unit that associates avatar data indicating the product avatar of the specified color, or avatar data indicating the product avatar before color correction, and environmental information indicating the virtual imaging environment, which have been displayed on the terminal by the display control unit, with identification information of the user and stores them in a memory unit.

[0009] When multiple product avatars are displayed simultaneously on the terminal, the display control unit may identify the colors of each of the multiple product avatars when the imaging environment indicated by environmental information associated with each of the multiple product avatars is corrected to a virtual imaging environment set by the setting unit, and display the multiple product avatars of the identified colors on the terminal.

[0010] When the display control unit simultaneously displays the product avatar and a non-product avatar different from the product avatar on the terminal, the display control unit may identify the colors of the product avatar and the non-product avatar when the imaging environment indicated by environmental information associated with the product avatar and the non-product avatar, respectively, is corrected to a virtual imaging environment set by the setting unit, and display the product avatar and the non-product avatar in the identified colors on the terminal.

[0011] The device may further include a memory control unit that associates the user's identification information with multiple avatar data corresponding to the multiple avatars of the specified color that the display control unit has displayed on the terminal, and stores them in a memory unit, and the display control unit may, in response to receiving a display operation for the multiple avatars of the specified color from the terminal, simultaneously display the multiple avatars of the specified color on the terminal based on the multiple avatar data stored in the memory unit.

[0012] The setting unit may acquire from the terminal specified image data, which is image data including a specified color and is captured by the terminal, and set a virtual imaging environment to be applied to the product avatar based on the specified color indicated by the acquired specified image data and the actual specified color.

[0013] The setting unit may acquire from the terminal specified image data, which is image data captured by the terminal, and set a virtual imaging environment to be applied to the product avatar based on the environmental information contained in the acquired specified image data.

[0014] The display control unit may cause the terminal to display the reliability of the color of the avatar based on the amount of correction of the environmental information when the imaging environment associated with the product avatar is corrected to a virtual imaging environment set by the setting unit.

[0015] An information processing method according to a second aspect of the present invention includes the steps of: acquiring product image data, which is an image of an actual product corresponding to a product avatar, executed by a computer; identifying a color of the actual product indicated by the acquired product image data, determining the color of the product avatar to be the identified color of the actual product; and displaying the product avatar in the determined color on a user's terminal. Effect of the Invention

[0016] According to the present invention, it is possible to reduce the difference between the color of a product avatar and the color of the actual product. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 is a diagram illustrating an overview of an information processing device. [Diagram 2] FIG. 2 is a diagram illustrating a functional configuration of an information processing device. [Diagram 3] FIG. 11 is a diagram showing an example of store-specific product information. [Figure 4] FIG. 11 is a diagram illustrating an example of avatar information. [Diagram 5] FIG. 13 is a diagram showing an example of a try-on image screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] [Overview of information processing device 1] 1 is a diagram for explaining an overview of an information processing device 1. The information processing device 1 is a computer that displays a product avatar, which is an avatar of a product, on a user terminal 2 or the like used by a user.

[0019] The product is, for example, clothing sold in a virtual store such as an apparel shop operating on a communication network such as the Internet. When displaying a product avatar on a user terminal 2, the information processing device 1 acquires the product avatar from a store terminal 3 used by a person involved in the virtual store, and also acquires product image data of an actual product corresponding to the product avatar ((1) in FIG. 1). The product avatar is, for example, a three-dimensional model generated by three-dimensionally scanning an actual product, or a three-dimensional model generated to imitate the actual product using an application program for creating avatars.

[0020] The information processing device 1 identifies the color of the actual product indicated by the acquired product image data ((2) in FIG. 1), and determines the color of the product avatar to be the color of the product identified from the product image data ((3) in FIG. 1). In this way, the information processing device 1 can reduce the difference between the color of the product avatar and the color of the actual product.

[0021] Thereafter, the information processing device 1 accepts a selection of a product sold in the virtual store from the user terminal 2 ((4) in FIG. 1). Upon accepting the product selection, the information processing device 1 causes the user terminal 2 to display a product avatar corresponding to the product in the determined color ((5) in FIG. 1). Then, when the user wishes to purchase the product corresponding to the product avatar, the information processing device 1 accepts a product purchase request from the user terminal 2 ((6) in FIG. 1). In this manner, the user can proceed with purchasing the product after checking the product avatar in the color of the actual product.

[0022] [Functional configuration of information processing device 1] Next, a description will be given of the functional configuration of the information processing device 1. Fig. 2 is a diagram showing the functional configuration of the information processing device 1. The information processing device 1 has a communication unit 11, a storage unit 12, and a control unit 13.

[0023] The communication unit 11 is a communication interface for transmitting and receiving data to and from the user terminal 2. The storage unit 12 is a storage medium that stores various data, and includes a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, etc. The storage unit 12 stores programs executed by the control unit 13. The storage unit 12 stores programs that cause the control unit 13 to function as an acquisition unit 131, a determination unit 132, a storage control unit 133, a setting unit 134, a reception unit 135, a product display control unit 136, and a purchase processing unit 137.

[0024] The storage unit 12 stores store-specific product information including information on products sold in each of a plurality of stores. FIG. 3 is a diagram showing an example of the store-specific product information. As shown in FIG. 3, the store-specific product information is information that associates a store ID that identifies each of a plurality of virtual stores, a virtual store name, a category of the virtual store, a product ID that identifies a product sold in the virtual store, product-related information, and a product avatar corresponding to the product. The product-related information is information about a product, such as information indicating the product category, price, size, etc. The product category is information for identifying the part of the body on which the product is worn, such as tops or bottoms.

[0025] The control unit 13 is, for example, a CPU (Central Processing Unit). The control unit 13 executes the programs stored in the storage unit 12, thereby functioning as an acquisition unit 131, a determination unit 132, a storage control unit 133, a setting unit 134, a reception unit 135, a product display control unit 136, and a purchase processing unit 137.

[0026] [Product avatar color selection] First, a process of determining the color of a commodity avatar will be described. The acquisition unit 131 acquires a commodity avatar, which is an avatar of a commodity. The acquisition unit 131 also acquires commodity image data, which is image data obtained by capturing an image of an actual commodity corresponding to the commodity avatar. The acquisition unit 131 acquires the commodity image data including environmental information indicating an imaging environment when the actual commodity was captured. The environmental information is, for example, a color temperature included in Exif (Exchangeable Image File Format) information added to the image data, but is not limited thereto, and may be an ISO (International Organization for Standardization) sensitivity, an exposure time, an F value, and an EV (Exposure Value) value (exposure value) that can be specified by these values.

[0027] The determination unit 132 specifies the color of the actual product indicated by the product image data acquired by the acquisition unit 131, and determines the color of the product avatar to be the specified color of the actual product. The determination unit 132 specifies the color of the product by analyzing the product image data and specifying an RGB value indicating the color of the product shown in the image indicated by the product image data. When multiple colors are applied to the product, the determination unit 132 specifies the color of each of multiple parts of the product.

[0028] The storage control unit 133 associates the product avatar, the product ID of the product corresponding to the product avatar, color information (RGB value) indicating the color of the product avatar determined by the determination unit 132, and environmental information included in the product image data, and stores them as avatar information in the storage unit 12. Fig. 4 is a diagram showing an example of avatar information. In the example shown in Fig. 4, it can be seen that the product avatar, RGB value, and environmental information are associated with the product ID.

[0029] In addition, when the determination unit 132 specifies the color of each of the multiple parts of the product, the memory control unit 133 associates position information indicating the position of each of the multiple parts of the product avatar with the color specified for that position and stores the associated information in the memory unit 12.

[0030] Furthermore, the storage control unit 133 associates color information indicating the color of the product avatar with environmental information included in the image data acquired by the acquisition unit 131 and stores them in the storage unit 12, but this is not limited thereto. For example, in addition to image data of an actual product, the acquisition unit 131 may acquire same-environment image data of a predetermined color captured in the same imaging environment as the image data. The predetermined color is, for example, white, and the same-environment image data is, for example, image data generated by capturing an image of a white object such as white paper.

[0031] The storage control unit 133 may then specify a color temperature of the same environment image data based on the RGB values ​​of pixels corresponding to a predetermined color included in the acquired same environment image data and a reference value of the RGB values ​​that is predetermined for the predetermined color. The storage control unit 133 may then set the specified color temperature as environmental information corresponding to the product image data. The storage control unit 133 may then store color information indicating the color of the product avatar and the specified environmental information in the storage unit 12 in association with each other.

[0032] [Setting up a virtual imaging environment] Next, a process for setting a virtual imaging environment to be applied to a product avatar will be described. The setting unit 134 sets a virtual imaging environment to be applied to the product avatar so that the product avatar is displayed in an environment in which the user can easily check the color of the product.

[0033] For example, the setting unit 134 acquires predetermined image data, which is image data including a predetermined color, captured by the user terminal 2 from the user terminal 2. The predetermined color is, for example, white, and the predetermined image data is, for example, image data generated by capturing an image of a white object such as white paper. The setting unit 134 may acquire the predetermined image data and may also accept an area of ​​the predetermined color in the predetermined image data from the user terminal 2.

[0034] The setting unit 134 sets a virtual imaging environment to be applied to the commodity avatar based on the predetermined color indicated by the acquired predetermined image data and the actual predetermined color. For example, the setting unit 134 specifies the imaging environment corresponding to the acquired predetermined image data based on the difference between a reference value of RGB value predetermined for the actual predetermined color and the RGB value of the predetermined color indicated by the acquired captured image. When the setting unit 134 receives an area of ​​the predetermined color in the predetermined image data from the user terminal 2, the setting unit 134 specifies the imaging environment corresponding to the predetermined image data based on the difference between the RGB value of the predetermined color included in the area and the reference value of RGB value corresponding to the predetermined color.

[0035] For example, the setting unit 134 specifies a color temperature corresponding to an image represented by the predetermined image data as an imaging environment based on a difference between an RGB value of an actual predetermined color and an RGB value of a predetermined color represented by an acquired captured image. Then, the setting unit 134 sets the specified imaging environment as a virtual imaging environment to be applied to the product avatar.

[0036] [Display product avatar] Next, a process related to displaying a product avatar will be described. When displaying a product avatar, the reception unit 135 acquires a user ID from the user terminal 2 and receives a selection of a virtual store. For example, the reception unit 135 displays virtual store information indicating a plurality of virtual stores on the user terminal 2 used by the user, and receives a selection of one of the plurality of virtual stores.

[0037] Next, the reception unit 135 receives a selection of a product sold in the selected virtual store. For example, the reception unit 135 displays a virtual space corresponding to the selected virtual store, in which product avatars of a plurality of products are arranged, and receives a selection of at least one of the product avatars arranged in the virtual space, thereby receiving the selection of one or more products. Here, if there is an actual store corresponding to the virtual store, the virtual space corresponding to the virtual store may be a virtual space that imitates the actual store. Furthermore, the reception unit 135 may display a list of products sold in the virtual store on the user terminal 2, and receive the selection of one or more products via the list.

[0038] The product display control unit 136 displays, on the user terminal 2, the product avatar of one or more products selected by the receiving unit 135 and having the color determined by the determining unit 132. The product display control unit 136 specifies the color of the product avatar when the imaging environment indicated by the environmental information associated with the product avatar in the storage unit 12 is corrected to the virtual imaging environment set by the setting unit 134, and displays, on the user terminal 2, the product avatar of the specified color.

[0039] When multiple product avatars are displayed simultaneously on the user terminal 2, the product display control unit 136 identifies the colors of each of the multiple product avatars when the imaging environment indicated by the environmental information associated with each of the multiple product avatars is corrected to a virtual imaging environment set by the setting unit 134, and displays the multiple product avatars of the identified colors on the user terminal 2.

[0040] For example, assume that a first product whose product category is tops and a second product whose product category is bottoms are selected. In this case, the product display control unit 136 identifies the color of the first product avatar associated with the first product avatar when the color temperature as the imaging environment associated with the first product avatar corresponding to the first product is corrected to the color temperature set by the setting unit 134. Similarly, the product display control unit 136 identifies the color of the second product avatar associated with the second product avatar when the color temperature as the imaging environment associated with the second product avatar corresponding to the second product is corrected to the color temperature set by the setting unit 134.

[0041] Note that the commodity display control unit 136 specifies the color of the commodity avatar associated with the commodity avatar by correcting the color temperature as the imaging environment, but is not limited thereto. The commodity display control unit 136 may specify the color of the commodity avatar when an imaging environment different from the color temperature is corrected to a virtual imaging environment. For example, the commodity display control unit 136 may specify the color of the commodity avatar associated with the commodity avatar when an EV value as the imaging environment associated with the commodity avatar is corrected to the EV value set by the setting unit 134. In addition, the commodity display control unit 136 may specify the color of the commodity avatar when values ​​of multiple elements such as color temperature and EV value as the imaging environment are corrected to values ​​of multiple elements indicated by the virtual imaging environment.

[0042] The product display control unit 136 performs a coloring process of the first product avatar and the second product avatar with the specified color. Then, the product display control unit 136 generates image data of the user's avatar captured by the virtual camera in a state in which the colored first product avatar and the second product avatar are tried on by the avatar of the user associated with the user ID acquired by the reception unit 135, and generates a try-on image screen including the image data. Here, the product display control unit 136 may display information indicating a virtual imaging environment (color temperature and white balance corresponding to the color temperature) on the try-on image screen.

[0043] The product display control unit 136 causes the generated try-on image screen to be displayed on the user terminal 2. FIG. 5 is a diagram showing an example of the try-on image screen. As shown in FIG. 5, the try-on image screen displays information indicating the virtual imaging environment (color temperature and white balance corresponding to the color temperature) together with a user avatar trying on a product avatar. In this way, the information processing device 1 can prevent the impression given when multiple product avatars are combined from differing from the impression given when actual products corresponding to the multiple product avatars are combined.

[0044] The storage control unit 133 may associate the user ID of the user with a plurality of avatar data corresponding to a plurality of avatars of a color specified based on the virtual imaging environment that the product display control unit 136 has displayed on the user terminal 2, and store them in the storage unit 12. In this case, for example, in response to displaying a fitting image screen on the user terminal 2, the storage control unit 133 associates the user ID with a plurality of avatar data corresponding to a plurality of avatars of a color specified based on the virtual imaging environment that the product display control unit 136 has displayed on the user terminal 2, and stores them as display history information in the storage unit 12. Here, the avatar data is, for example, a combination of a product avatar and a color specified based on the virtual imaging environment.

[0045] Then, in response to receiving a display operation of the multiple avatars from the user terminal 2, the product display control unit 136 causes the multiple avatars to be simultaneously displayed on the user terminal 2 based on the multiple avatar data stored in the storage unit 12 in association with the user ID. For example, in response to selection of a menu button M provided on the fitting image screen shown in FIG. 5, the user terminal 2 causes a menu to be displayed. The menu includes an item for selecting one of multiple product avatars previously displayed on the user terminal 2 based on display history information. In response to the selection of the item, the user terminal 2 accepts the selection of one of multiple product avatars previously displayed on the user terminal 2.

[0046] The product display control unit 136 causes the user terminal 2 to simultaneously display, in correspondence with the selected product avatar, a plurality of avatars of the specified color based on a plurality of avatar data items stored in association with the user ID in the storage unit 12. In this manner, the user can cause the user terminal 2 to redisplay, in the same state as when the plurality of avatars were previously displayed, on the user terminal 2.

[0047] Furthermore, the product display control unit 136 may simultaneously display a product avatar and a non-product avatar different from the product avatar on the user terminal 2. The non-product avatar is, for example, a sample avatar that is not for sale but is provided to be selectable by the user in the virtual store. For example, if the virtual store sells tops and bottoms as clothing, the non-product avatar is an avatar representing an item such as a hat, bag, shoes, or accessory.

[0048] In this case, the reception unit 135 receives the selection of a product and also receives the selection of an item not for sale. The product display control unit 136 specifies the color of each of the product avatar and the non-product avatar when the imaging environment indicated by the environmental information associated with each of the product avatar corresponding to the selected product and the non-product avatar corresponding to the selected item is corrected to the virtual imaging environment set by the setting unit 134. Then, the product display control unit 136 causes the user terminal 2 to display a fitting image screen indicating the product avatar and the non-product avatar of the specified color. In this way, the user can check the impression when wearing the product selected by the user in combination with an item not sold by the virtual store.

[0049] Here, the reception unit 135 receives a selection of an item not for sale from the user, but this is not limited thereto. The reception unit 135 may acquire item image data representing an item owned by the user, which is captured by the user terminal 2, from the user terminal 2. In this case, the product display control unit 136 may identify the shape and color of the item by analyzing the acquired item image data. Here, the product display control unit 136 may identify the imaging environment of the item image data, and identify the color of the item represented by the item image data when the imaging environment is corrected to a virtual imaging environment. The product display control unit 136 may select an item having a shape similar to the shape of the identified item from among a plurality of items not for sale, and set the color of the non-product avatar corresponding to the selected item to the identified color.

[0050] For example, if the selected product is bottoms, the reception unit 135 acquires item image data of a top owned by the user from the user terminal 2. The product display control unit 136 analyzes the acquired item image data and identifies the shape and color of the top. Then, the product display control unit 136 selects a top with a shape similar to the identified shape from among multiple tops that are not for sale, and sets the color of the selected top to the identified color. Then, the product display control unit 136 causes the user terminal 2 to display a fitting image screen showing a product avatar and a non-product avatar in the identified color. In this way, the user can check the impression when wearing the product selected by the user in accordance with the items owned by the user.

[0051] Furthermore, when the imaging environment associated with the commodity avatar is corrected to the virtual imaging environment set by the setting unit 134, the greater the correction amount, the higher the probability that the actual color of the commodity avatar in the virtual imaging environment differs from the corrected color of the commodity avatar. In response to this, the commodity display control unit 136 may specify the reliability of the color of the avatar based on the correction amount of the environmental information when the imaging environment associated with the commodity avatar is corrected to the virtual imaging environment set by the setting unit 134.

[0052] For example, the product display control unit 136 specifies the reliability such that the greater the correction amount of the environmental information, the lower the reliability. Then, the product display control unit 136 may include the specified reliability in the fitting image screen, thereby causing the user terminal 2 to display the reliability. In this way, the user can consider purchasing a product while checking the reliability of the color corresponding to the product avatar displayed on the user terminal 2.

[0053] [Processing related to product purchases] Next, a process for purchasing a product by a user will be described. For example, the purchase processing unit 137 accepts a selection of a product to be purchased from the user of the user terminal 2. For example, the purchase processing unit 137 selects a product corresponding to the product avatar by accepting an operation to store the product avatar displayed on the fitting image screen in a virtual cart for collecting products to be purchased.

[0054] Then, the purchase processing unit 137 accepts a purchase request for the selected product. When the purchase processing unit 137 accepts the purchase request for the product, it accepts information related to the delivery destination of the product and information related to the payment method from the user, and settles the purchase amount of the product based on the accepted information. When the payment is completed, the purchase processing unit 137 notifies the store terminal of the virtual store of information indicating the product purchased by the user and information related to the delivery destination. This allows a store clerk at the virtual store to carry out processing related to shipping the product.

[0055] [Variations] Note that the setting unit 134 sets the virtual imaging environment to be applied to the commodity avatar based on the predetermined image data, and specifies the color of the commodity avatar in the set virtual imaging environment, but is not limited thereto. For example, the setting unit 134 may acquire a captured image captured by the user terminal 2 from the user terminal 2, and set the virtual imaging environment to be applied to the commodity avatar based on environmental information included in the acquired captured image. In this case, for example, when a color temperature is included in Exif information, which is environmental information included in the captured image, the setting unit 134 specifies the color temperature as the virtual imaging environment.

[0056] Furthermore, the setting unit 134 may accept new settings for a virtual imaging environment after displaying the fitting image screen. In this case, for example, the user terminal 2 displays a menu in response to selection of a menu button M provided on the fitting image screen shown in Fig. 5. The menu includes a setting item for color temperature, which is a virtual imaging environment.

[0057] In response to the selection of the setting item, the user terminal 2 displays a setting screen for color temperature, which is a virtual imaging environment. The setting unit 134 accepts the virtual imaging environment from the user terminal 2 via the setting screen. Then, in response to the setting unit 134 accepting the virtual imaging environment from the user terminal 2, the product display control unit 136 specifies the color of the product avatar when the imaging environment associated with the product avatar is corrected to the virtual imaging environment, and displays a try-on image screen including the product avatar of the specified color on the user terminal 2. In this way, the user can check the try-on image of the product in various virtual imaging environments.

[0058] [Effects of information processing device 1] As described above, the information processing device 1 according to the present embodiment acquires product image data of an actual product corresponding to a product avatar, which is an avatar of the product, and identifies the color of the actual product indicated by the acquired product image data. Then, the information processing device 1 determines the color of the product avatar to be the identified color of the actual product, and displays the product avatar of the determined color on the user terminal 2. In this way, the information processing device 1 can reduce the difference between the color of the product avatar and the color of the actual product.

[0059] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote industry, innovation and infrastructure."

[0060] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0061] 1. Information processing device 11 Communications Department 12 Storage section 13 Control section 131 Acquisition Department 132 Decision Section 133 Memory control unit 134 Setting section 135 Reception 136 Product display control unit 137 Purchase Reception 2. User terminal 3. Store terminal

Claims

1. An acquisition unit that acquires product image data of an actual product corresponding to a product avatar, the product image data including environmental information indicating an imaging environment when the actual product was imaged; A determination unit that specifies a color of the actual product indicated by the product image data acquired by the acquisition unit, and determines a color of the product avatar to be the specified color of the actual product; a storage control unit that stores the product avatar, the color of the product avatar determined by the determination unit, and environmental information included in the product image data acquired by the acquisition unit in a storage unit in association with each other; a setting unit that acquires from a user's terminal predetermined image data, which is image data including a predetermined color captured by the terminal, and sets a virtual imaging environment to be applied to the commodity avatar to be displayed on the terminal based on the predetermined color indicated by the acquired predetermined image data and an actual predetermined color; a display control unit that displays the commodity avatar in the determined color on the terminal, the display control unit specifying a color of the commodity avatar when an imaging environment indicated by environmental information associated with the commodity avatar in the storage unit is corrected to a virtual imaging environment set by the setting unit, and displays the commodity avatar in the specified color on the terminal; An information processing device having the above configuration.

2. An acquisition unit that acquires product image data of an actual product corresponding to a product avatar, the product image data including environmental information indicating an imaging environment when the actual product was imaged; A determination unit that specifies a color of the actual product indicated by the product image data acquired by the acquisition unit, and determines a color of the product avatar to be the specified color of the actual product; a storage control unit that stores the product avatar, the color of the product avatar determined by the determination unit, and environmental information included in the product image data acquired by the acquisition unit in a storage unit in association with each other; A setting unit that sets a virtual imaging environment to be applied to the commodity avatar to be displayed on a user's terminal; a display control unit that displays the product avatar in the determined color on the terminal, the display control unit specifying a color of the product avatar when an imaging environment indicated by environmental information associated with the product avatar in the storage unit is corrected to a virtual imaging environment set by the setting unit, and displays the product avatar in the specified color on the terminal, and also displays a reliability of the color of the avatar on the terminal based on a correction amount of the environmental information when the environmental information associated with the product avatar is corrected to the virtual imaging environment set by the setting unit; An information processing device having the above configuration.

3. a storage control unit that causes avatar data indicating a combination of the product avatar displayed on the terminal by the display control unit and a color specified based on the virtual imaging environment, and environmental information indicating the virtual imaging environment, to be stored in a storage unit in association with identification information of the user; 3. The information processing device according to claim 1 or 2.

4. When multiple product avatars are simultaneously displayed on the terminal, the display control unit specifies colors of the multiple product avatars when an imaging environment indicated by environmental information associated with each of the multiple product avatars is corrected to a virtual imaging environment set by the setting unit, and displays the multiple product avatars of the specified colors on the terminal.

3. The information processing device according to claim 1 or 2.

5. When the display control unit simultaneously displays the commodity avatar and a non-commodity avatar different from the commodity avatar on the terminal, the display control unit specifies colors of the commodity avatar and the non-commodity avatar when an imaging environment indicated by environmental information associated with the commodity avatar and the non-commodity avatar is corrected to a virtual imaging environment set by the setting unit, and displays the commodity avatar and the non-commodity avatar in the specified colors on the terminal.

3. The information processing device according to claim 1 or 2.

6. a storage control unit that stores in a storage unit, in association with the user's identification information and a plurality of avatar data corresponding to the plurality of commodity avatars that the display control unit has caused to be displayed on the terminal, the plurality of avatar data indicating a combination of the commodity avatar with a color specified for the commodity avatar based on the virtual imaging environment; the display control unit, in response to receiving a display operation of a plurality of product avatars of the specified color from the terminal, causes the plurality of product avatars of the specified color to be simultaneously displayed on the terminal based on the plurality of avatar data stored in the storage unit; The information processing device according to claim 4.

7. The setting unit acquires predetermined image data, which is image data captured by the terminal, from the terminal, and sets a virtual imaging environment to be applied to the commodity avatar based on the environmental information included in the acquired predetermined image data.

3. The information processing device according to claim 1 or 2.

8. The computer executes acquiring product image data of an actual product corresponding to a product avatar, the product image data including environmental information indicating an imaging environment when the actual product was imaged; A step of identifying a color of the actual product indicated by the acquired product image data, and determining a color of the product avatar to be the identified color of the actual product; storing the commodity avatar, the determined color of the commodity avatar, and environmental information included in the acquired commodity image data in a storage unit in association with each other; acquiring predetermined image data, which is image data including a predetermined color captured by a user's terminal, from the terminal, and setting a virtual imaging environment to be applied to the commodity avatar to be displayed on the terminal based on the predetermined color indicated by the acquired predetermined image data and the actual predetermined color; a step of displaying the commodity avatar in the determined color on the terminal, the step of specifying a color of the commodity avatar when an imaging environment indicated by environmental information associated with the commodity avatar in the storage unit is corrected to the virtual imaging environment set in the setting step, and displaying the commodity avatar in the specified color on the terminal; An information processing method comprising the steps of:

9. The computer executes acquiring product image data of an actual product corresponding to a product avatar, the product image data including environmental information indicating an imaging environment when the actual product was imaged; A step of identifying a color of the actual product indicated by the acquired product image data, and determining a color of the product avatar to be the identified color of the actual product; storing the commodity avatar, the determined color of the commodity avatar, and environmental information included in the acquired commodity image data in a storage unit in association with each other; Setting a virtual imaging environment to be applied to the product avatar displayed on a user's terminal; a step of displaying the commodity avatar in the determined color on the terminal, the step of specifying a color of the commodity avatar when an imaging environment indicated by environmental information associated with the commodity avatar in the storage unit is corrected to the virtual imaging environment set in the setting step, displaying the commodity avatar in the specified color on the terminal, and displaying a reliability of the color of the avatar on the terminal based on a correction amount of the environmental information when the environmental information associated with the commodity avatar is corrected to the virtual imaging environment set in the setting step; An information processing method comprising the steps of:

Citation Information

Patent Citations

  • Coordinate information providing method and device, coordinate information providing system, and coordinate information providing program

    JP2004220200A

  • Electronic apparatus

    JP2015011631A

  • Information processing device, 3D system, and information processing method

    JP2023002440A