Information processing device, information processing method, and information processing program
The information processing device addresses the lack of comfortable clothing suggestions by integrating environmental and image data to recommend appropriate clothing based on weather and user preferences, improving user comfort.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-06-20
- Publication Date
- 2026-03-16
AI Technical Summary
Existing clothing recommendation systems do not adequately suggest comfortable clothing options based on environmental conditions, leaving room for improvement.
An information processing device that acquires environmental and image information, calculates clothing and solar radiation indices, and provides image suggestions tailored to user preferences and owned items, displayed alongside weather information.
Enables users to easily find comfortable clothing options suitable for current and predicted weather conditions, enhancing user satisfaction.
Smart Images

Figure 0007830246000001 
Figure 0007830246000002 
Figure 0007830246000003
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus, an information processing method, and an information processing program.
Background Art
[0002] Conventionally, techniques for proposing clothing for when going out are known. For example, Patent Document 1 discloses a technique for proposing clothing to a user based on information about clothing corresponding to the information of the user's destination.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, although the technique described in Patent Document 1 can propose clothing according to the destination, it is desirable to propose items such as more comfortable clothing to the user, and there is room for improvement in this regard.
[0005] The present application has been made in view of the above, and an object thereof is to provide an information processing apparatus, an information processing method, and an information processing program capable of proposing more comfortable items to a user.
Means for Solving the Problems
[0006] The information processing device according to this application comprises an environmental information acquisition unit, an image information acquisition unit, and a provision unit. The environmental information acquisition unit acquires environmental information, including weather information. The image information acquisition unit acquires image information, which is information about captured images of a person wearing an item corresponding to the environmental information, based on the environmental information acquired by the environmental information acquisition unit. The provision unit provides the image information acquired by the image information acquisition unit as information to be displayed together with weather information. [Effects of the Invention]
[0007] According to one embodiment of the system, it is possible to offer users items that provide them with greater comfort. [Brief explanation of the drawing]
[0008] [Figure 1] Figure 1 shows an example of information processing according to the embodiment. [Figure 2] Figure 2 shows an example of the configuration of the information provision system according to the embodiment. [Figure 3] Figure 3 shows an example of the configuration of a terminal device according to this embodiment. [Figure 4] Figure 4 shows an example of the configuration of an information processing device according to the present invention. [Figure 5] Figure 5 shows an example of a user information table stored in the user information storage unit according to this embodiment. [Figure 6] Figure 6 shows an example of a clothing thickness index-related information table stored in the index-related information storage unit according to the embodiment. [Figure 7] Figure 7 shows an example of weather content provided by the information processing device according to this embodiment. [Figure 8] Figure 8 shows another example of weather content provided by the information processing device according to the embodiment. [Figure 9] Figure 9 is a flowchart showing an example of information processing by the processing unit of the information processing device according to the embodiment. [Figure 10]Figure 10 is a flowchart showing an example of content provision processing by the processing unit of the information processing device according to the embodiment. [Figure 11] Figure 11 shows another example of the configuration of a terminal device according to the embodiment. [Figure 12] Figure 12 is a hardware configuration diagram showing an example of a computer that implements the functions of the information processing device according to the embodiment. [Modes for carrying out the invention]
[0009] The following describes in detail, with reference to the drawings, the embodiments for implementing the information processing apparatus, information processing method, and information processing program according to the present application (hereinafter referred to as "embodiments"). Note that these embodiments do not limit the information processing apparatus, information processing method, and information processing program according to the present application. Furthermore, each embodiment can be appropriately combined as long as the processing content is not inconsistent. Also, the same parts are denoted by the same reference numerals in each of the following embodiments, and redundant descriptions are omitted.
[0010] [1. An example of information processing] First, an example of information processing according to the embodiment will be described using Figure 1. Figure 1 is a diagram showing an example of information processing according to the embodiment.
[0011] The information processing device 1 shown in Figure 1 provides content related to a portal site to user U on terminal device 2. The content related to the portal site includes weather-related content. Furthermore, the content related to the portal site may also include content related to web search sites, news sites, map provision sites, social networking sites, etc.
[0012] As shown in FIG. 1, the information processing apparatus 1 acquires environmental information from a server 3 having a function as an environmental information providing apparatus that provides environmental information including information related to the weather (step S1). The environmental information includes information related to the weather in each region. The information related to the weather includes information indicating the current weather and information indicating the predicted weather situation.
[0013] Further, the information processing apparatus 1 acquires it from a server 4 having a function as an image information providing apparatus that provides image information which is information of a captured image (step S2). The server 4 is, for example, an information processing apparatus that provides a shopping site, an auction site, a flea market site, a posting site, etc., and provides the image information provided on each site to the information processing apparatus 1.
[0014] The image information provided from the server 4 to the information processing apparatus 1 is information of a captured image of a person wearing an item. The items worn by the person are, for example, clothes, shoes, hats, arm covers, sunglasses, etc. The server 4 provides the information processing apparatus 1 with image information including a plurality of pieces of information of captured images of persons wearing different items.
[0015] The image information provided from the server 4 to the information processing apparatus 1 includes, in addition to the information indicating the captured image, for example, information indicating the type of the item included in the captured image, information indicating the attribute of the person included in the captured image, information indicating the capture position and capture date and time of the captured image, and additional information such as information indicating the attribute (for example, age and gender) of the person included in the captured image.
[0016] The information processing apparatus 1 stores the environmental information acquired from the server 3 in step S1 and the image information acquired from the server 4 in step S2 in an internal storage unit (step S3).
[0017] Next, the information processing device 1 receives a content request transmitted from the terminal device 2 (step S4). The content request is a request to transmit weather content. The weather content includes information about the weather, as well as image information, which is information about captured images of a person wearing an item corresponding to the weather information.
[0018] A content request includes information indicating a specified region and information to identify user U. The specified region is the region specified by user U. However, if information indicating a specified region has been pre-configured in the information processing device 1 by user U, the content request does not need to include information indicating a specified region.
[0019] Next, the information processing device 1 obtains environmental information, including weather information for the specified region indicated by the content request, from its internal storage unit (step S5). In step S5, if the content request does not include information for the specified region, the information processing device 1 obtains environmental information, including weather information for the specified region, from its internal storage unit based on pre-configured information indicating the specified region.
[0020] Next, the information processing device 1 obtains image information from its internal storage unit (step S6) which is information about an image of a person wearing an item corresponding to the environmental information, based on the environmental information acquired in step S5. An item corresponding to the environmental information is, for example, an item corresponding to an index corresponding to at least one of the current weather and the predicted weather conditions. The image information acquired in step S6 does not include, but is not limited to, some or all of the additional information described above.
[0021] An index that corresponds to at least one of the current weather conditions and the forecasted weather conditions is a clothing index that indicates the recommended level of clothing. Such a clothing index increases as the recommended level of clothing increases, but is not limited to this example. For example, such a clothing index may decrease as the recommended level of clothing increases.
[0022] The information processing device 1 calculates the clothing thickness index based on environmental information. However, if the environmental information obtained from the server 3 includes information indicating the clothing thickness index, it can also obtain information indicating the clothing thickness index from the environmental information.
[0023] Furthermore, items corresponding to environmental information include, for example, items corresponding to the solar radiation index, which is an index based on at least one of the current solar radiation and the predicted solar radiation. The solar radiation index increases as solar radiation increases, but is not limited to this example. For example, such a solar radiation index may be an index that decreases as solar radiation increases.
[0024] The information processing device 1 has index relation information indicating the type of item for each index value or range of values, and based on this index relation information, it obtains image information from its internal storage unit, which is information about captured images of people wearing items corresponding to the thickness index and solar radiation index of a designated area.
[0025] For example, suppose the clothing index is shown in the range of 0 to 100, the clothing index for a designated area is 10, and the type of item with a clothing index of "10" is "T-shirt / cut and sewn garment." In this case, the information processing device 1 obtains image information of a person wearing a "T-shirt" or "cut and sewn garment" from its internal storage unit.
[0026] Furthermore, the information processing device 1 assumes that the solar radiation index is displayed in the range of 0 to 100, the solar radiation index for the designated area is 50, and the type of item with a solar radiation index of "50" is "hat". In this case, in addition to the item corresponding to the thermal clothing index, the information processing device 1 obtains image information of a person wearing a "hat" from its internal storage unit.
[0027] Furthermore, let's assume that the solar radiation index for the designated area is 100, and the types of items corresponding to a solar radiation index of "100" are "hats," "sunglasses," and "arm covers." In this case, the information processing device 1 acquires image information from its internal storage unit of a person wearing a "hat," "sunglasses," and "arm covers," in addition to the items corresponding to the heavy clothing index.
[0028] In step S6, the information processing device 1 randomly selects information from one or more captured images from among multiple captured images, each representing an image of a person wearing an item corresponding to the environmental information, and uses this information as the first image information. In the following, the captured image represented by the first image information may be referred to as the first captured image.
[0029] Furthermore, in the processing of step S6, the information processing device 1 acquires information from one or more captured images that satisfy predetermined conditions from among multiple captured images, each showing an image of a person wearing an item corresponding to the environmental information, as second image information, which is displayed together with the first captured image and is smaller in size than the first captured image. In the following, the captured image shown in the second image information may be referred to as the second captured image.
[0030] The predetermined conditions include, for example, conditions based on the information of user U, who is the recipient of the image information, and conditions based on the captured image. User U's information includes information indicating the types of items owned by user U, information indicating user U's preferences for items, and information indicating user U's attributes. In the following, the recipient of the image information may be referred to as the information provider.
[0031] The information processing device 1, for example, prioritizes acquiring information from one or more captured images corresponding to user U's information as second image information from among multiple captured images. For example, the information processing device 1 prioritizes acquiring information from captured images of a person wearing an item corresponding to the type of item owned by user U as second image information from among multiple captured images. This allows user U to easily find an item to wear from among the items they own that are appropriate for the weather.
[0032] Furthermore, the information processing device 1 can prioritize acquiring information from multiple captured images of a person wearing an item that corresponds to user U's preferences as second image information. This allows user U to find items that are appropriate for the weather and that suit user U's preferences.
[0033] Furthermore, information from one or more captured images can be prioritized and acquired as second image information based on conditions specific to each captured image. Examples of conditions specific to each captured image include conditions related to the recentness of the captured image date and time, conditions related to the evaluation of the captured image, conditions related to at least one of the region and weather at the time the image was captured, and conditions related to the age of the person included in the captured image at the time the image was captured.
[0034] For example, the information processing device 1, as a condition regarding the recency of the captured image's capture date and time, prioritizes acquiring information from one or more captured images from among multiple captured images, starting with the most recent image, as second image information. This allows user U to find new outfit items that are appropriate for the weather.
[0035] Furthermore, the information processing device 1, as a condition for evaluating the captured image, prioritizes acquiring information from one or more captured images with higher evaluations from among multiple captured images as second image information. The evaluation of the captured image is, for example, a positive evaluation on a shopping site. The positive evaluation may be the number of OK buttons (e.g., "Like" buttons) pressed on the captured image or the number of positive comments, but it may also be the ratio of the number of OK button presses to the total number of OK and NG button presses.
[0036] Furthermore, the information processing device 1 can also prioritize acquiring information from one or more captured images as second image information if at least one of the specified region and the weather of the specified region matches or is similar to at least one of the region and weather at the time the captured image was taken. This allows the information processing device 1 to suggest more comfortable items to the user U according to the weather.
[0037] Furthermore, the information processing device 1 prioritizes acquiring information from one or more captured images in which the age of the user U, who is the recipient of the information, matches or is similar to the age of the person in the image, as second image information. This allows the information processing device 1 to suggest more comfortable items to user U that are appropriate for the weather and user U's age.
[0038] Furthermore, the information processing device 1 can calculate a score for each captured image by weighting it according to the information of the user U to whom the information is provided and weighting it according to the captured image, and can acquire information on up to a predetermined number of captured images with high calculated scores as second image information.
[0039] Next, the information processing device 1 generates weather content (step S7) that includes weather forecast information for a specified area included in the environmental information acquired in step S5 and image information acquired in step S6. Then, the information processing device 1 provides the weather content to user U by transmitting the weather content generated in step S7 to terminal device 2 (step S8). This allows the information processing device 1 to suggest more comfortable items to user U.
[0040] The weather content shown in Figure 1 includes weather information, a first image, multiple second images, information indicating the clothing temperature index, index text overlays, and link buttons.
[0041] The weather information shown in Figure 1 includes information indicating the current weather in the designated area (e.g., temperature, humidity, atmospheric pressure, etc.). The weather information may also include, in addition to or instead of, current weather information indicating the current weather in the designated area, weather forecast information indicating the predicted weather conditions in the designated area.
[0042] In the weather content shown in Figure 1, the warm clothing index is 60%, and three of the five indicator icons are highlighted. User U can easily understand that the warm clothing index is 60% from these five indicator icons. These indicator icons allow user U to easily understand how many layers of clothing are needed. Note that the warm clothing index may also be indicated by a level meter or similar means instead of indicator icons.
[0043] Furthermore, in the weather content shown in Figure 1, the index text displays the message, "It's a good idea to wear a jacket or something similar." This index text also allows user U to easily understand how many layers of clothing they should wear.
[0044] Furthermore, in the weather content shown in Figure 1, a link button is displayed, and by selecting (for example, tapping) the link button, user U can have information about captured images of a person wearing an item corresponding to the weather in the specified region displayed on the terminal device 2 from the information processing device 1 or server 4.
[0045] In this way, the information processing device 1 acquires environmental information, including weather information, and based on the acquired environmental information, acquires image information, which is information about captured images of a person wearing an item corresponding to the environmental information. The information processing device 1 then provides the acquired image information as information to be displayed together with the weather information. As a result, the information processing device 1 can suggest more comfortable items to the user U.
[0046] Furthermore, weather content may be displayed by processing primarily performed by terminal device 2, or it may be displayed on terminal device 2 by the information processing device 1 based on information input from terminal device 2 via an interface such as an API (Application Programming Interface). Also, although Figure 1 shows a case where terminal device 2 and information processing device 1 are separate devices, terminal device 2 and information processing device 1 may be integrated.
[0047] The configuration of the information provision system, including the information processing device 1, terminal device 2, and servers 3 and 4 that perform such processing, will be described in detail below.
[0048] [2. Configuration of the Information Provision System] Figure 2 shows an example of the configuration of an information provision system according to the embodiment. As shown in Figure 2, the information provision system 100 according to the embodiment includes an information processing device 1, a plurality of terminal devices 2, and servers 3 and 4.
[0049] The information processing device 1, terminal device 2, and servers 3 and 4 are connected to each other via a network N, either by wire or wireless connection, enabling communication between them. Note that the information provision system 100 shown in Figure 2 may include multiple instances of each of the information processing device 1 and servers 3 and 4.
[0050] Terminal device 2 may be, for example, a desktop PC (Personal Computer), a notebook PC, a tablet device, a smartphone, a mobile phone, or a PDA (Personal Digital Assistant). However, terminal device 2 is not limited to the examples above; it may also be, for example, a smartwatch or a wearable device.
[0051] Server 3 is a server that functions as an environmental information provider, providing environmental information including weather information. The environmental information includes weather information for each region. The weather information includes information indicating the current weather and information indicating the predicted weather conditions. Weather refers to meteorological conditions, which include, for example, the state of weather-related elements such as temperature, humidity, solar radiation, wind, cloud cover, visibility, rain, snow, and thunderstorms. The information indicating the predicted weather conditions is weather forecast information.
[0052] Server 4 functions as an image information provider, handling image information, which is information about captured images. Server 4 is an information processing device that provides, for example, shopping sites, auction sites, flea market sites, posting sites, etc., and provides image information provided on each site to the information processing device 1. The image information provided on each site is information about captured images posted by sellers or exhibitors, but it may also be information about captured images posted by posters other than sellers or exhibitors.
[0053] The image information provided from server 4 to information processing device 1 includes, in addition to information indicating the captured image, additional information such as information indicating the type of item included in the captured image, information indicating the attributes of the person included in the captured image, information indicating the location and date and time of capture of the captured image, and information indicating the attributes of the person included in the captured image (e.g., age and gender).
[0054] [3. Terminal device 2] Figure 3 shows an example of the configuration of the terminal device 2 according to the embodiment. As shown in Figure 3, the terminal device 2 according to the embodiment includes a communication unit 10, a display unit 11, an operation unit 12, a sensor group 13, a storage unit 14, and a processing unit 15.
[0055] [3.1. Communications Section 10] The communication unit 10 is implemented, for example, by a NIC (Network Interface Card). The communication unit 10 is connected to the network N by wire or wireless connection and transmits and receives information to and from the information processing device 1 via the network N.
[0056] [3.2. Display section 11] The display unit 11 is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display.
[0057] [3.3. Operation unit 12] The operation unit 12 includes, for example, a keyboard with keys for entering letters, numbers, and spaces, an enter key and arrow keys, a mouse, and a power button. If the display unit 11 is a touch panel compatible display, the operation unit 12 includes a touch panel.
[0058] [3.4. Sensor Group 13] The sensor group 13 includes, for example, a positioning sensor, an accelerometer, a gyroscope, and an image sensor. The positioning sensor is a sensor that detects the position of the terminal device 2. The accelerometer is a sensor that detects the acceleration of the terminal device 2. The gyroscope is a sensor that detects the attitude of the terminal device 2, such as its tilt and rotation. The image sensor is a sensor that captures images of the area around the terminal device 2.
[0059] [3.5. Storage section 14] The memory unit 14 is implemented by, for example, semiconductor memory elements such as RAM (Random Access Memory) and flash memory, or by storage devices such as hard disks and optical discs.
[0060] The storage unit 14 stores, for example, information transmitted from the information processing device 1 and acquired by the processing unit 15 via the network N and the communication unit 10, as well as detection information, which is information detected by the sensor group 13.
[0061] [3.6. Processing Unit 15] The processing unit 15 is a controller, and is implemented, for example, by a CPU (Central Processing Unit) or MPU (Micro Processing Unit) executing various programs stored in the memory device inside the terminal device 2 using RAM as the working area. The processing unit 15 may be partially or entirely implemented by an integrated circuit, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The processing unit 15 includes an information acquisition unit 16, a display processing unit 17, and an information output unit 18.
[0062] [3.6.1. Information acquisition unit 16] The information acquisition unit 16 acquires various content transmitted from the information processing device 1 and received by the communication unit 10 via the network N. The content transmitted from the information processing device 1 is, for example, the weather content mentioned above.
[0063] [3.6.2. Display Processing Unit 17] The display processing unit 17 displays the information acquired by the information acquisition unit 16 on the display unit 11. For example, the display processing unit 17 displays content acquired by the information acquisition unit 16 on the display unit 11.
[0064] [3.6.3. Information Output Unit 18] The information output unit 18 transmits, for example, operation information corresponding to operations performed by user U on the operation unit 12 to the information processing device 1 via the communication unit 10. The information output unit 18 also transmits detection information, which is information detected by the sensor group 13, to the information processing device 1 via the communication unit 10.
[0065] [4. Configuration of Information Processing Device 1] Figure 4 shows an example of the configuration of an information processing device 1 according to an embodiment. As shown in Figure 4, the information processing device 1 has a communication unit 20, a storage unit 21, and a processing unit 22.
[0066] [4.1. Communications Section 20] The communication unit 20 is implemented, for example, by a NIC (Network Interface Card). The communication unit 20 is connected to the network N by wire or wireless connection and transmits and receives information with various other devices. For example, the communication unit 20 transmits and receives information with the terminal device 2 via the network N.
[0067] [4.2. Storage section 21] The memory unit 21 is implemented by, for example, semiconductor memory elements such as RAM and flash memory, or storage devices such as hard disks and optical discs. The memory unit 21 includes a user information storage unit 30, an index relationship information storage unit 31, an environment information storage unit 32, and an image information storage unit 33.
[0068] [4.2.1. User information storage unit 30] The user information storage unit 30 stores various types of information about user U. Figure 5 shows an example of a user information table stored in the user information storage unit 30 according to this embodiment. In the example shown in Figure 5, the user information table stored in the user information storage unit 30 includes information on items such as "user ID," "attribute information," and "history information."
[0069] The "User ID" is an identifier that identifies User U. The "Attribute Information" is attribute information about User U's attributes associated with the "User ID". User U's attributes include, for example, demographic attributes and psychographic attributes. Demographic attributes are demographic attributes such as age, gender, occupation, place of residence, annual income, and family structure. Psychographic attributes are psychological attributes such as lifestyle, values, and interests.
[0070] "History information" refers to history information that includes information such as the service usage history, and includes, for example, user U's payment history information, user U's search history information, user U's browsing history information, and user U's settings history information.
[0071] User U's payment history information includes purchase history information for goods purchased by User U online, in physical stores, or at physical facilities using the payment service, and service usage history information for services used by User U for a fee online, in physical stores, or at physical facilities using the payment service.
[0072] Purchase history information includes information about the products purchased by user U, purchase costs, purchase date and time, and store of purchase. Service usage history information includes information about the services used by user U, usage costs, usage date and time, and store of use.
[0073] User U's search history information includes, for example, information on web content searches on search engines and search history on various websites. User U's browsing history information includes information on product information browsing history on various websites. User U's settings information is information that User U has set on the information processing device 1, and includes, for example, information on a specified region.
[0074] In the example shown in Figure 5, user U with user ID "U1" has attribute information "CH1" and history information "PH1", user U with user ID "U2" has attribute information "CH2" and history information "PH2", and user U with user ID "U3" has attribute information "CH3" and history information "PH3".
[0075] In the example shown in Figure 5, attribute information and history information are represented by abstract codes such as "CH1" to "CH3" and "PH1" to "PH3," but attribute information and history information can be, for example, text data or data in file format. Furthermore, the user information storage unit 30 is not limited to the above and may store various types of information depending on the purpose.
[0076] [4.2.2. Index-related information storage unit 31] The index-related information storage unit 31 stores index-related information, which is information about items related to the index. The index-related information includes a clothing-related index-related information table, which contains information related to the clothing-related index, and a solar radiation index-related information table, which contains information related to the solar radiation index.
[0077] Figure 6 shows an example of a clothing index-related information table stored in the index-related information storage unit 31 according to the embodiment. In the example shown in Figure 6, the clothing index-related information table stored in the index-related information storage unit 31 contains information on items such as "clothing index," "index ticker," and "item type."
[0078] The "Warmth Index" is information indicating the recommended level of warmth. The Warmth Index is a value that indicates the recommended degree of warmth, and is shown, for example, within a range of 0 to 100. In the example shown in Figure 6, the Warmth Index is shown in 11 stages, divided into increments of 10, within the range of 0 to 100.
[0079] The "Index Caption" is a string of text information associated with the value of the Warm Clothing Index. The "Item Type" is information indicating the type of item associated with the value of the Warm Clothing Index.
[0080] In Figure 6, when the warm clothing index is "0", the index caption reads "Beat the heat with breathable clothing", and the item types are "T-shirts / cut and sewn tops", "tank tops", and "tube tops". When the warm clothing index is "10", the index caption reads "Wear summer clothing such as a T-shirt", and the item type is "T-shirts / cut and sewn tops".
[0081] Furthermore, at a clothing index of "20," the index caption reads "You can stay comfortable in just a short-sleeved shirt," and the item type is "polo shirt." At a clothing index of "30," the index caption reads "Short sleeves are recommended for those who get hot easily," and the item types are "polo shirt" and "shirt / blouse."
[0082] In the example shown in Figure 6, the "item type" in the clothing index information table shows the type of tops (upper garments), but the type of bottoms (lower garments) and the type of shoes may be included instead of or in addition to the type of tops (upper garments).
[0083] Furthermore, the solar radiation index-related information table stored in the index-related information storage unit 31 contains information on items such as "solar radiation index," "index ticker," and "item type." The "solar radiation index" is information indicating the solar radiation index, and the solar radiation index becomes larger as the amount of solar radiation increases.
[0084] The "index ticker" is string information associated with the solar radiation index. The "item type" is information indicating the type of item associated with the solar radiation index. In the solar radiation index relationship information table, for example, the item type when the solar radiation index is 50 is "hat," and the item types when the solar radiation index is 100 are "hat," "sunglasses," and "arm covers."
[0085] The solar radiation index-related information table may also include the type of hat, the type of sunglasses, the type of arm covers, etc., instead of "hat," "sunglasses," and "arm covers." Furthermore, the index-related information storage unit 31 may store various types of information depending on the purpose, not limited to the above.
[0086] Furthermore, in the clothing index information table, instead of associating each clothing index value with a "Culture Index Caption" and "Item Type," the same may be applied to ranges of clothing index values. Similarly, in the solar radiation index information table, instead of associating each solar radiation index value with a "Culture Index Caption" and "Item Type," the same may be applied to ranges of solar radiation index values.
[0087] [4.2.3.Environmental information storage unit 32] The environmental information storage unit 32 stores environmental information acquired by the processing unit 22 from the server 3 via the communication unit 20. The environmental information stored in the environmental information storage unit 32 includes information about the weather in each region. The weather information includes information indicating the current weather and information indicating the predicted weather conditions.
[0088] Furthermore, the environmental information stored in the environmental information storage unit 32 includes information indicating the clothing temperature index and information indicating the solar radiation index. The information indicating the clothing temperature index is information of an index corresponding to at least one of the current weather conditions and the predicted weather conditions. The information indicating the solar radiation index is information of an index corresponding to at least one of the current solar radiation and the predicted solar radiation.
[0089] [4.2.4. Image Information Storage Unit 33] The image information storage unit 33 stores image information acquired by the processing unit 22 from the server 4 via the communication unit 20. The image information stored in the image information storage unit 33 includes additional information such as information indicating the captured image, information indicating the type of item included in the captured image, information indicating the attributes of the person included in the captured image, information indicating the capture location and date and time of capture of the captured image, information indicating the attributes of the person included in the captured image (e.g., age and gender), and keyword information.
[0090] [4.3. Processing Unit 22] The processing unit 22 is a controller and is implemented, for example, by a processor such as a CPU or MPU, which executes various programs (an example of an information processing program) stored in a memory device (e.g., memory unit 21) inside the information processing device 1, using RAM as a working area. Alternatively, the processing unit 22 may be partially or entirely implemented by an integrated circuit such as an ASIC or FPGA.
[0091] As shown in Figure 4, the processing unit 22 includes an acquisition unit 40, a receiving unit 41, a generation unit 42, and a providing unit 43, and realizes or executes the information processing functions and operations described below. Note that the internal configuration of the processing unit 22 is not limited to the configuration shown in Figure 4, and other configurations are also acceptable as long as they perform the information processing described later.
[0092] [4.3.1. Acquisition part 40] The acquisition unit 40 acquires various types of information. The acquisition unit 40 acquires various types of information from the storage unit 21. The acquisition unit 40 acquires various types of information from the user information storage unit 30, the index-related information storage unit 31, the image information storage unit 33, and the environment information storage unit 32, etc.
[0093] The acquisition unit 40 receives various information from an external information processing device via the communication unit 20. The acquisition unit 40 also receives various information from the terminal device 2, an external device, the server 3, or the server 4.
[0094] The acquisition unit 40 acquires user information from an external device and stores the acquired user information in the user information storage unit 30. For example, the acquisition unit 40 acquires user information from an external device at predetermined intervals and updates the user information stored in the user information storage unit 30.
[0095] Furthermore, as shown in Figure 4, the acquisition unit 40 includes an environmental information acquisition unit 44 that acquires environmental information from the server 3 and an image information acquisition unit 45 that acquires image information from the server 4.
[0096] [4.3.1.1.Environmental information acquisition unit 44] The environmental information acquisition unit 44 acquires environmental information, including weather information, from the server 3 and stores the acquired environmental information in the environmental information storage unit 32. For example, the environmental information acquisition unit 44 acquires environmental information from the server 3 at predetermined intervals and stores the acquired environmental information in the environmental information storage unit 32.
[0097] If the environmental information acquisition unit 44 does not include information indicating the clothing temperature index and information indicating the solar radiation index, the environmental information acquisition unit 44 functions as an index information generation unit that generates information indicating the clothing temperature index and information indicating the solar radiation index for each region based on the weather information included in the environmental information acquired from the server 3.
[0098] For example, the environmental information acquisition unit 44 determines the warm clothing index based on temperature, humidity, atmospheric pressure, and solar radiation indicated by weather information. The environmental information acquisition unit 44 increases the value of the warm clothing index as the temperature, humidity, and solar radiation decrease. The environmental information acquisition unit 44 can determine the warm clothing index based on the weighted sum of temperature, humidity, atmospheric pressure, and solar radiation indicated by weather information.
[0099] The environmental information acquisition unit 44 can also determine the warm clothing index using elements other than temperature, humidity, atmospheric pressure, and solar radiation, and can also determine the warm clothing index using three or fewer elements from temperature, humidity, atmospheric pressure, and solar radiation. In the processing unit 22, the index information generation unit may be provided separately from the environmental information acquisition unit 44.
[0100] Furthermore, the environmental information acquisition unit 44 determines the solar radiation index based on the amount of solar radiation indicated in the weather information. The environmental information acquisition unit 44 increases the value of the solar radiation index as the amount of solar radiation increases. The environmental information acquisition unit 44 adds information including the determined information on the heavy clothing index and the determined solar radiation index to the environmental information for the corresponding area.
[0101] Furthermore, when a content request is received by the reception unit 41, the environmental information acquisition unit 44 acquires environmental information from the environmental information storage unit 32, including information about the weather in the designated area indicated by the content request received by the reception unit 41. For example, if the designated area indicated by the content request is Chiyoda-ku, Tokyo, the environmental information acquisition unit 44 acquires environmental information from the environmental information storage unit 32, including information about the weather in Chiyoda-ku, Tokyo.
[0102] Furthermore, if the environmental information acquisition unit 44 does not have environmental information, including information about the weather in the specified region indicated by the content request received by the reception unit 41, stored in the environmental information storage unit 32, it acquires environmental information, including information about the weather in the specified region indicated by the content request, from the server 3.
[0103] Furthermore, if the content request received by the reception unit 41 does not include information about a specified region, the environmental information acquisition unit 44 determines whether or not there is information indicating a specified region that is pre-set in the user information of user U identified in the content request. The user information of user U is the user information corresponding to the user ID of user U identified in the content request, from among the user information of multiple users U included in the user information table stored in the user information storage unit 30.
[0104] If the user information of user U identified by the content request contains information indicating a designated region that has been set in advance, the environmental information acquisition unit 44 acquires environmental information from the environmental information storage unit 32, including information regarding the weather in the designated region that has been set in advance.
[0105] [4.3.1.2. Image information acquisition unit 45] The image information acquisition unit 45 acquires image information from the server 4 and stores the acquired image information in the image information storage unit 33. For example, the image information acquisition unit 45 acquires image information from the server 4 at predetermined intervals and stores the acquired image information in the image information storage unit 33.
[0106] The image information acquisition unit 45 acquires image information, which is information about captured images of a person wearing an item corresponding to the environmental information, based on the environmental information acquired by the environmental information acquisition unit 44.
[0107] For example, when a content request is received by the reception unit 41, the image information acquisition unit 45 acquires image information, which is information about an image of a person wearing an item corresponding to the environmental information of a designated area acquired by the environmental information acquisition unit 44. Such image information does not include, but is not limited to, some or all of, the additional information described above.
[0108] The image information acquisition unit 45 acquires, for example, information of captured images of a person wearing an item corresponding to the clothing thickness index included in the environmental information of a designated area, as provided image information, which is information of captured images provided to user U.
[0109] For example, suppose the clothing index information table is in the state shown in Figure 6, and the clothing index included in the environmental information for the designated area is "20". In this case, the image information acquisition unit 45 acquires information from the image information storage unit 33 as provided image information about an image of a person wearing an item of type "polo shirt".
[0110] The image information stored in the image information storage unit 33 includes information indicating the type of item, and the image information acquisition unit 45 acquires image information from the image information storage unit 33 as provided image information, which includes information indicating the type of item corresponding to the thick clothing index included in the environmental information of the designated area.
[0111] As described above, the "item type" in the clothing index relationship information table shown in Figure 6 may include, in addition to or instead of, the type of top, at least one of the types of bottoms and shoes. In this case, the image information acquisition unit 45 acquires information from the image information storage unit 33 as provided image information about captured images of a person wearing, in addition to or instead of an item of the type of top, at least one of the types of bottoms and shoes.
[0112] In the clothing index information table shown in Figure 6, the categories of items (tops, bottoms, shoes, etc.) are defined as the types of items, but the examples are not limited to this. For example, the types of items may include the material of the item in addition to the category of the item. Examples of item materials include linen, wool, and cotton.
[0113] Furthermore, the image information acquisition unit 45 acquires information about captured images of people wearing items corresponding to the thermal clothing index included in the environmental information of the designated area, as well as items corresponding to the solar radiation index included in the environmental information of the designated area, as provided image information, which is captured image information provided to user U. The items corresponding to the solar radiation index are at least one of a hat, arm covers, and sunglasses.
[0114] For example, suppose that in the solar radiation index information table, the item type when the solar radiation index is 50 is "hat," and the item types when the solar radiation index is 100 are "hat," "sunglasses," and "arm covers."
[0115] In this case, if the solar radiation index included in the environmental information of the designated area is "50", the image information acquisition unit 45 acquires image information from the image information storage unit 33 as provided image information of a person wearing a "hat" as an item of the same type as the solar radiation index, in addition to the items of the same type as the heavy clothing index.
[0116] Furthermore, if the solar radiation index included in the environmental information of the designated area is "100", the image information acquisition unit 45 acquires image information from the image information storage unit 33 as provided image information of a person wearing "hats," "sunglasses," and "arm covers" as items of the same type as the solar radiation index, in addition to items of the same type as the solar radiation index.
[0117] Thus, when an index relationship information table has item groups associated with each index value or range of index values, the image information acquisition unit 45 acquires image information from the image information storage unit 33 as provided image information of a person wearing multiple types of items indicated by the item group corresponding to the index included in the environmental information of the specified area.
[0118] The image information acquisition unit 45 randomly acquires information from one or more target images from among multiple target images, each representing an image of a person wearing an item corresponding to the environmental information, as first image information, which is information from one or more first images.
[0119] Furthermore, the image information acquisition unit 45 acquires information from one or more captured images that satisfy predetermined conditions from among multiple target captured images as second image information, which is information about the second captured image. The second captured image is information about an captured image that is displayed together with the first captured image indicated in the first image information, and is displayed at a smaller size than the first captured image. The first image information and the second captured image are examples of the provided image information described above.
[0120] The predetermined conditions include, for example, user conditions, which are conditions corresponding to the information of user U to whom the information will be provided, and image conditions, which are conditions corresponding to the captured images. User U's information includes information indicating the types of items owned by user U, information indicating user U's preferences for items, and information indicating user U's attributes.
[0121] The image information acquisition unit 45, for example, prioritizes acquiring information from one or more target images corresponding to user U's information as second image information from among multiple captured images. For example, the image information acquisition unit 45 prioritizes acquiring information from images of a person wearing an item corresponding to the type of item owned by user U as second image information from among multiple target images. This allows user U to easily find an item to wear from among the items they own that are appropriate for the weather.
[0122] Furthermore, the image information acquisition unit 45 can prioritize acquiring information from images of people wearing items that correspond to user U's preferences as second image information from among multiple captured images of targets. This allows user U to find items that are appropriate for the weather and that suit user U's preferences.
[0123] Furthermore, the image information acquisition unit 45 can prioritize acquiring information from images of a person wearing an item corresponding to the user U's attributes as second image information from among multiple captured images of the target. This allows user U to find items that are appropriate for the weather and match user U's attributes.
[0124] Furthermore, the image information acquisition unit 45 can prioritize acquiring information from one or more target captured images from among multiple target captured images according to the captured image conditions as second image information. The captured image conditions include, for example, conditions relating to the recentness of the captured image date and time, conditions relating to the evaluation of the captured image, conditions relating to at least one of the region and weather at the time the captured image was taken, and conditions relating to the age of the person included in the captured image at the time the captured image was taken.
[0125] For example, the image information acquisition unit 45 prioritizes acquiring information from one or more target images as second image information, starting with the most recent target image, as a condition regarding the recency of the captured image's date and time. This allows user U to find out about new outfit items that are appropriate for the weather.
[0126] Furthermore, the image information acquisition unit 45 prioritizes acquiring information from one or more target images with higher evaluations from among multiple target image capture images as second image information, based on the conditions for evaluating the captured image. The evaluation of the captured image is, for example, a positive evaluation on a shopping site. The positive evaluation may be the number of OK buttons (e.g., "Like" buttons) pressed on the captured image or the number of positive comments, but it may also be the ratio of the number of OK button presses to the total number of OK and NG button presses.
[0127] Furthermore, the image information acquisition unit 45 can also prioritize acquiring information from one or more target captured images as second image information if at least one of the specified region and the weather of the specified region matches or is similar to at least one of the region and weather at the time of capture of the captured image.
[0128] For example, suppose the designated area is Chiyoda Ward, Tokyo, and the weather in Chiyoda Ward, Tokyo is 30 degrees Celsius and 54% humidity. The image information acquisition unit 45 acquires information as second image information from among multiple target images, specifically images taken in areas matching or surrounding Chiyoda Ward, Tokyo, and with weather conditions matching or similar to 30 degrees Celsius and 54% humidity. This allows the image information acquisition unit 45 to suggest more comfortable items to the user U according to the weather and location.
[0129] Furthermore, the image information acquisition unit 45 prioritizes acquiring information from one or more target images among multiple target images in which the age of the user U to whom the information is provided matches or is similar to the age of the person at the time of imaging, and uses this information as second image information.
[0130] For example, suppose user U, the recipient of the information, is in their 20s. In this case, the image information acquisition unit 45 prioritizes acquiring information from one or more target images in which the person's age at the time of imaging is in their 20s, as second image information. This allows the image information acquisition unit 45 to suggest more comfortable items to user U that are appropriate for the weather and user U's age.
[0131] Furthermore, the image information acquisition unit 45 can calculate a score for each target image based on weighting according to the information of the user U to whom the information is provided and weighting according to the captured image, and can acquire information on up to a predetermined number of target images with high calculated scores as second image information.
[0132] Furthermore, when the image information acquisition unit 45 receives an image capture request from the reception unit 41, it acquires information on multiple target images corresponding to the image capture request from the image information storage unit 33, based on the thickness index and solar radiation index of the designated area indicated in the image capture request. The method for acquiring information on the image capture in response to the image capture request is, for example, the same as the method for acquiring the first image information, but it may also be the same as the method for acquiring the second image information.
[0133] Furthermore, if the image acquisition unit 45 receives an image acquisition request from the reception unit 41 and includes a tag keyword, it acquires information from the image information storage unit 33 about target images that include information about keywords matching the tag keyword among the information about target images corresponding to the clothing index and solar radiation index of the specified region indicated in the image acquisition request. For example, if the tag keyword is "pants style", it acquires information from the image information storage unit 33 about target images that include "pants style" as a keyword.
[0134] [4.3.2. Reception Department 41] The reception unit 41 receives content requests transmitted from the terminal device 2. The content request includes information indicating a designated region and information for identifying user U (e.g., user ID). The designated region is the region specified by user U. However, if information indicating a designated region has been pre-configured in the information processing device 1 by user U, the content request may not include information indicating a designated region.
[0135] The reception unit 41 also accepts requests for captured images. These requests may include information such as the clothing temperature index and solar radiation index for a designated area. The reception unit 41 can also accept requests other than content requests and captured image requests.
[0136] [4.3.3. Generation unit 42] The generation unit 42 generates weather content that includes weather forecast information for a designated area included in the environmental information acquired by the environmental information acquisition unit 44, and image information acquired by the image information acquisition unit 45.
[0137] Furthermore, when the reception unit 41 receives an image capture request, the generation unit 42 generates image capture content that includes information from multiple images acquired by the image information acquisition unit 45 based on the thickness index and solar radiation index of the specified area indicated in the image capture request.
[0138] [4.3.4.Providing Department 43] The provisioning unit 43 provides the image information acquired by the image information acquisition unit 45 as information to be displayed together with weather information. For example, the provisioning unit 43 provides the weather content to the user U by transmitting the weather content generated by the generation unit 42 to the terminal device 2.
[0139] Figure 7 shows an example of weather content provided by the information processing device 1 according to this embodiment. The weather content 50 shown in Figure 7 includes weather information 51, a first captured image 52, a plurality of second captured images 53, clothing thickness index information 54, text overlay information 55, and link buttons 56, etc.
[0140] Weather information 51 is information about the weather. The weather information 51 shown in Figure 7 includes information indicating the current weather in Chiyoda Ward, the designated area (for example, information such as temperature, humidity, and atmospheric pressure). Weather information 51 may include weather forecast information, which is the predicted weather conditions for the designated area, in addition to or instead of current weather information indicating the current weather in the designated area.
[0141] The first captured image 52 is a randomly selected captured image, and the multiple second captured images 53 are captured images that satisfy predetermined conditions. Since the size of each of the multiple second captured images 53 is smaller than the size of the first captured image 52, the first captured image 52 can be presented to the user U preferentially while the multiple second captured images 53 are presented side by side to the user U.
[0142] The clothing warmth index information 54 shown in Figure 7 has three of the five indicator icons for indicating the clothing warmth index highlighted, allowing user U to easily understand that the clothing warmth index is 60%. These indicator icons allow user U to easily understand how many layers of clothing are needed. Note that the clothing warmth index may also be indicated by a level meter or similar means instead of the indicator icons.
[0143] Furthermore, the text information 55 shown in Figure 7 displays the message, "It's reassuring to have something to wear over your clothes, such as a jacket." This text information 55 allows user U to easily understand how many layers of clothing they should wear.
[0144] The link button 56 shown in Figure 7 is a button for displaying information on captured images other than the first captured image 52 and the second captured image 53, of a person wearing an item appropriate for the weather in a specified area, on the terminal device 2. By selecting (for example, tapping) the link button 56, the information processing unit 43 of the information processing device 1 or the server 4 further displays information on captured images of a person wearing an item appropriate for the weather in a specified area on the terminal device 2.
[0145] The weather content 50 provided by the provisioning unit 43 is not limited to the example shown in Figure 7. Figure 8 shows another example of weather content 50 provided by the information processing device 1 according to this embodiment.
[0146] The weather content 50 shown in Figure 8 includes weather information 51, a first captured image 52, multiple second captured images 53, clothing temperature index information 54, text overlay information 55, link buttons 56, multiple first selection tags 57, and multiple second selection tags 58, etc.
[0147] In the weather content 50 shown in Figure 8, the first captured image 52, multiple second captured images 53, clothing index information 54, text overlay information 55, and link buttons 56 are the same as those in the weather content 50 shown in Figure 7. The weather information 51 shown in Figure 8 includes weather forecast information, which is the weather condition for the designated area, Chiyoda Ward.
[0148] The first selection tag 57 is a tag used to display information on captured images on the terminal device 2 that has been narrowed down by the tag keyword indicated by the tag from the information of captured images of a person wearing an item appropriate for the weather in the specified region. In the weather content 50 shown in Figure 8, multiple first selection tags 57 include a tag with the tag keyword "pants style", a tag with the tag keyword "clean and neat", and a tag with the tag keyword "short person outfit".
[0149] The second selection tag 58 is a tag for selecting a date. In the weather content 50 shown in Figure 8, weather information for "Today: 11 / 19 (Tue)" is displayed. By selecting (for example, tapping) the second selection tag 58 for "Tomorrow: 11 / 20 (Wed)", user U can display the weather information for "Tomorrow: 11 / 20 (Wed)" on terminal device 2.
[0150] Furthermore, when the receiving unit 41 receives a request for captured images, the providing unit 43 provides the captured image content to the user U by transmitting the captured image content generated by the generation unit 42 to the terminal device 2.
[0151] For example, if link button 56 is selected, the information output unit 18 of the terminal device 2 transmits an image capture request corresponding to link button 56 to the information processing device 1 via the communication unit 10 and the network N. When the image capture request is received by the reception unit 41, the provision unit 43 transmits the image capture content generated by the generation unit 42 to the terminal device 2.
[0152] Furthermore, if the second selection tag 58 is selected, the information output unit 18 of the terminal device 2 transmits an image capture request corresponding to the second selection tag 58 to the information processing device 1 via the communication unit 10 and the network N. The image capture request includes tag keywords such as "pants style," and when the image capture request is received by the reception unit 41, the provision unit 43 transmits image capture content, including information on the image capture corresponding to "pants style" generated by the generation unit 42, to the terminal device 2.
[0153] Furthermore, the providing unit 43 can, for example, transmit environmental information acquired by the environmental information acquisition unit 44 and image information acquired by the image information acquisition unit 45 based on information input from the terminal device 2 via an interface such as an API, causing the terminal device 2 to display weather content 50.
[0154] [5. Processing Procedure] Next, the procedure for information processing by the processing unit 22 of the information processing device 1 according to the embodiment will be described. Figure 9 is a flowchart showing an example of information processing by the processing unit 22 of the information processing device 1 according to the embodiment.
[0155] As shown in Figure 9, the processing unit 22 of the information processing device 1 determines whether or not it is time to acquire environmental information (step S10). The timing for acquiring environmental information is either a timing that occurs at predetermined intervals or the timing when a content request is received.
[0156] If the processing unit 22 determines that it is time to acquire environmental information (step S10: Yes), it acquires environmental information from the server 3 and stores the acquired environmental information in the storage unit 21 (step S11). Also, if the environmental information acquired in step S11 does not include information on various indices, the processing unit 22 calculates various indices (step S12). In the process of step S12, the processing unit 22 calculates the clothing thickness index and the solar radiation index, and adds the index information, including the calculated clothing thickness index and solar radiation index, to the environmental information.
[0157] If the processing in step S12 is completed, or if it is determined that it is not yet time to acquire environmental information (step S10: No), the processing unit 22 determines whether it is time to acquire an image (step S13). The image acquisition timing is a timing that occurs at predetermined intervals or the timing when a content request is received.
[0158] If the processing unit 22 determines that it is time to acquire an image (step S13: Yes), it acquires image information from the server 3 and stores the acquired image information in the storage unit 21 (step S14).
[0159] If the processing in step S14 is completed, or if it is determined that it is not time to acquire an image (step S13: No), the processing unit 22 determines whether or not there is a content request (step S15). If the processing unit 22 determines that there is a content request (step S15: Yes), it performs the content provision process (step S16). The processing in step S16 is the same as the processing in steps S20 to S25 shown in Figure 10, which will be described in detail later.
[0160] If the processing in step S16 is completed, or if it is determined that there is no content request (step S15: No), the processing unit 22 determines whether or not there is a request for an captured image (step S17). If the processing unit 22 determines that there is a request for an captured image (step S17: Yes), it provides captured image content that includes information about the captured image corresponding to the captured image request (step S18).
[0161] When the processing in step S18 is completed, or when it is determined that there is no request for an image to be captured (step S17: No), the processing unit 22 determines whether or not it is time to terminate the operation (step S19). For example, the processing unit 22 determines that it is time to terminate the operation when the power to the information processing device 1 is turned off, or when it is determined that a termination operation has been performed by operating on an unillustrated control unit of the information processing device 1.
[0162] If the processing unit 22 determines that it is not yet time to terminate the operation (step S19: No), it proceeds to step S10. If it determines that it is time to terminate the operation (step S19: Yes), it terminates the process shown in Figure 9.
[0163] Figure 10 is a flowchart showing an example of content provision processing by the processing unit 22 of the information processing device 1 according to the embodiment. As shown in Figure 10, the processing unit 22 obtains environmental information corresponding to the specified region indicated in the content request from the storage unit 21 (step S20). Then, the processing unit 22 determines the type of item corresponding to an index such as the clothing thickness index or the solar radiation index (step S21).
[0164] Next, the processing unit 22 randomly acquires information from the storage unit 21 as first image information, which is the image of the person wearing the item determined in step S21 (step S22). The processing unit 22 also acquires information from the storage unit 21 as second image information, which is the image of the person wearing the item determined in step S22, based on predetermined conditions (step S23).
[0165] Then, the processing unit 22 generates weather content including the first image information acquired in step S22, the second image information acquired in step S23, and weather information (step S24). Then, the processing unit 22 provides the weather content 50 generated in step S24 (step S25), and terminates the process shown in Figure 10.
[0166] [6. Variant Example] In the example described above, the image information acquisition unit 45 acquires information about captured images in which the wearer is wearing an item of the type corresponding to the index, but it is not limited to this example. For example, if the index relationship information table includes items of a specific manufacturer and specific product number for each range of index values, the image information acquisition unit 45 acquires information about captured images in which the wearer is wearing an item of a specific manufacturer and specific product number corresponding to the index.
[0167] Furthermore, in the example described above, the user U's information is not associated with the item type in the index relationship information table, but the user U's information may be associated with the item type. For example, in the index relationship information table, the item type may be associated with the index value or range of index values for each of the genders of user U: male, female, and unknown. In this case, the image information acquisition unit 45 acquires information from the captured image of a person wearing an item of a type associated with an index such as the clothing thickness index or solar radiation index and the gender of user U as information from the target captured image.
[0168] Furthermore, the user U information associated with the item type is not limited to the user U's gender; for example, the item type may be associated with each combination of gender, age, residential area, and occupation. In this case, the image information acquisition unit 45 acquires information from the captured image of a person wearing an item of a type associated with a combination of an index such as the clothing thickness index or solar radiation index, and gender, age, residential area, and occupation, as information from the target captured image.
[0169] Furthermore, in the example described above, the weather content 50 includes first image information and second image information, but the weather content 50 may also include only one of the first image information and the second image information. For example, the providing unit 43 provides weather content that includes only one of the first image information and the second image information, based on either the attribute information or behavioral history of user U who provides the weather content 50.
[0170] Furthermore, in the example described above, the image information acquisition unit 45 acquires information of the captured image that includes items worn by the person as items corresponding to the index. However, it can also acquire information of the captured image that includes items carried or held by the person in addition to items worn by the person (for example, towels, parasols, umbrellas, etc.).
[0171] In this case, the index-related information storage unit 31 stores a table that associates the types of items worn with the types of items carried or possessed for each range of index values. The image information acquisition unit 45 acquires information from the captured image, which includes items worn as well as items carried or possessed as items corresponding to the index.
[0172] Furthermore, the image information acquisition unit 45 can also determine the type of item according to the environmental information of the specified region by using an item recommendation model that takes environmental information of the specified region as input and outputs a score for each item type. In this case, the image information acquisition unit 45 inputs the environmental information of the specified region into the item recommendation model and determines the type of item according to the environmental information of the specified region based on the score for each item type output from the item recommendation model.
[0173] For example, the image information acquisition unit 45 determines the type of item with the highest score as the type of item corresponding to the environmental information of the specified area. The image information acquisition unit 45 then acquires information from the captured image of a person wearing an item of the type determined using the item recommendation model as information from the target captured image. The input to the item recommendation model is information on at least one of the current weather and the predicted weather conditions, but information on the clothing temperature index and solar radiation index may be included instead of or in addition to such information. Furthermore, a weather item recommendation model may be provided for each of the following: tops (upper garments) and bottoms (lower garments).
[0174] The item recommendation model may be, for example, a learning model generated by GBDT (Gradient Boosting Decision Tree) or a learning model generated by deep learning using a deep neural network (DNN), but is not limited to such examples, and may be a learning model generated by other machine learning methods. For example, the item recommendation model may be generated using machine learning with other learning algorithms, such as regression methods such as linear regression, multiple regression, or logistic regression, or learning algorithms such as support vector machines.
[0175] Furthermore, the image information acquisition unit 45 can acquire "item type" information from the index relationship information table, and the generation unit 42 can generate weather content 50 that further includes the "item type" information acquired by the image information acquisition unit 45.
[0176] For example, suppose the clothing index information table is in the state shown in Figure 6, and the clothing index for the specified area is "30". In this case, the generation unit 42 generates weather content 50 that includes information indicating the item type, such as a string of text like, "We recommend 'polo shirts' or 'shirts or blouses'."
[0177] Furthermore, in the example described above, the information processing device 1 generates weather content 50 and displays it on the terminal device 2. However, the terminal device 2 may also be configured to collect information from the information processing device 1, generate weather content 50, and display the generated weather content 50. In this case, the terminal device 2 functions as part of an information providing device that performs some of the functions of the information processing device 1 described above together with the information processing device 1. Alternatively, the terminal device 2 may be configured to function as an information providing device that performs all of the functions of the information processing device 1 described above.
[0178] Figure 11 shows another example of the configuration of the terminal device 2 according to the embodiment. The terminal device 2 shown in Figure 11 differs from the terminal device 2 shown in Figure 3 in that the processing unit 15 has different functions. The processing unit 15 of the terminal device 2 shown in Figure 11 differs from the terminal device 2 shown in Figure 3 in that it further comprises a receiving unit 41, a generation unit 42, and a supply unit 43.
[0179] Each of the receiving unit 41, generating unit 42, and providing unit 43 shown in Figure 11 has some or all of the functions of each of the receiving unit 41, generating unit 42, and providing unit 43 shown in Figure 4, for example. The receiving unit 41 receives a specific operation as a content request when the operation to the user U's operation unit 12 is a specific operation.
[0180] The information acquisition unit 16 includes the functions of the acquisition unit 40. For example, when a content request is received by the reception unit 41, the information acquisition unit 16 functions as the environment information acquisition unit 44 described above and acquires environment information for the specified region indicated in the content request from the server 3. Also, when a content request is received by the reception unit 41, the information acquisition unit 16 functions as the image information acquisition unit 45 described above and acquires image information from the server 4 based on the environment information for the specified region acquired by the information acquisition unit 16.
[0181] The generation unit 42 of the terminal device 2 generates weather content 50, which includes image information acquired by the information acquisition unit 16. The providing unit 43 of the terminal device 2 then causes the display processing unit 17 to execute the process of displaying the weather content 50 generated by the generation unit 42 on the display unit 11. The providing unit 43 may also include the functions of the display processing unit 17.
[0182] Furthermore, the terminal device 2 only needs to be able to generate weather content 50 in cooperation with the information processing device 1 and display the generated weather content 50 on the display unit 11, and is not limited to the configuration described above. For example, the terminal device 2 may have a configuration that does not include the reception unit 41.
[0183] Thus, the terminal device 2 can perform the functions of the receiving unit 41, the generating unit 42, and the providing unit 43 in cooperation with the information processing device 1, and can function as part of an information providing device having the functions of the receiving unit 41, the generating unit 42, and the providing unit 43. In the following, the configuration including the above-described information processing device 1 and part or all of the terminal device 2 may be referred to as the information processing device 1.
[0184] The processing unit 15 shown in Figure 11 is realized, for example, by a processor such as a CPU or MPU executing various programs (an example of an information processing program) stored in a memory device (for example, a memory unit 14) inside the terminal device 2, using RAM as the working area.
[0185] [7. Hardware Configuration] The information processing device 1 or terminal device 2 according to the above embodiment is implemented by a computer 80 having a configuration such as that shown in Figure 12. The following explanation will use the information processing device 1 as an example. Figure 12 is a hardware configuration diagram showing an example of a computer 80 that implements the functions of the information processing device 1 according to the embodiment. The computer 80 has a CPU 81, RAM 82, ROM (Read Only Memory) 83, HDD (Hard Disk Drive) 84, communication interface (I / F) 85, input / output interface (I / F) 86, and media interface (I / F) 87.
[0186] The CPU 81 operates based on programs stored in the ROM 83 or HDD 84, and controls various parts of the system. The ROM 83 stores boot programs executed by the CPU 81 when the computer 80 starts up, as well as programs that depend on the computer 80's hardware.
[0187] HDD84 stores programs executed by CPU81 and data used by such programs. The communication interface85 receives data from other devices via network N (see Figure 2) and sends it to CPU81, and transmits data generated by CPU81 to other devices via network N.
[0188] The CPU 81 controls output devices such as displays and printers, and input devices such as keyboards and mice, via the input / output interface 86. The CPU 81 acquires data from input devices via the input / output interface 86. The CPU 81 also outputs data it has generated to output devices via the input / output interface 86.
[0189] The media interface 87 reads a program or data stored in the recording medium 88 and provides it to the CPU 81 via the RAM 82. The CPU 81 loads the program from the recording medium 88 onto the RAM 82 via the media interface 87 and executes the loaded program. The recording medium 88 can be, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase Change Rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.
[0190] For example, when the computer 80 functions as an information processing device 1 according to the embodiment, the CPU 81 of the computer 80 realizes the functions of the processing unit 22 by executing a program loaded on the RAM 82. The HDD 84 stores data from the storage unit 21. The CPU 81 of the computer 80 reads and executes these programs from the recording medium 88, but as another example, these programs may be obtained from other devices via a network N.
[0191] [8. Other] Furthermore, some of the processes described as being performed automatically in the above embodiments can be performed manually. Alternatively, all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and various data and parameters shown in the above documents and drawings can be changed at will unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.
[0192] Furthermore, the components of each illustrated device are functionally conceptual and do not necessarily need to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions.
[0193] For example, the information processing device 1 described above may be implemented using multiple server computers, and the configuration can be flexibly changed, such as by calling external platforms via APIs or network computing depending on the function. Also, some of the processing of the information processing device 1 described above may be handled by the terminal device 2. In this case, some functions of the terminal device 2 will function as an information processing device together with the information processing device 1.
[0194] Furthermore, for example, some or all of the storage unit 21 shown in Figure 4 may be stored in a storage server or the like, rather than being held by each device. In this case, each device obtains various information by accessing the storage server.
[0195] [9. Effects] As described above, the information processing device 1 according to this embodiment comprises an environmental information acquisition unit 44, an image information acquisition unit 45, and a provision unit 43. The environmental information acquisition unit 44 acquires environmental information, including weather information. The image information acquisition unit 45 acquires image information, which is information about an image of a person wearing an item corresponding to the environmental information, based on the environmental information acquired by the environmental information acquisition unit 44. The provision unit 43 provides the image information acquired by the image information acquisition unit 45 as information to be displayed together with weather information. As a result, the information processing device 1 can suggest more comfortable items to the user U.
[0196] Furthermore, the environmental information acquisition unit 44 acquires information as environmental information, which includes index information corresponding to at least one of the current weather and the predicted weather conditions. The image information acquisition unit 45 acquires information as image information, which is an image of a person wearing an item corresponding to the index. As a result, the information processing device 1 can suggest more comfortable items to the user U.
[0197] Furthermore, the index is an indicator of the degree of clothing thickness, and the image information acquisition unit 45 acquires information as image information from captured images of a person wearing an item corresponding to the index. As a result, the information processing device 1 can suggest more comfortable items to the user U.
[0198] Furthermore, the environmental information acquisition unit 44 acquires environmental information including index information corresponding to at least one of the current solar radiation and the predicted solar radiation. The image information acquisition unit 45 acquires image information of captured images in which the user is wearing an item corresponding to the index. As a result, the information processing device 1 can suggest more comfortable items to the user U.
[0199] Furthermore, the image information acquisition unit 45 randomly acquires information from one or more captured images from among multiple captured images, each showing an image of a person wearing an item corresponding to the environmental information. This prevents the information processing device 1 from becoming fixated on specific items suggested to the user U, and allows it to suggest more comfortable items to the user U.
[0200] Furthermore, the image information acquisition unit 45 acquires information from one or more captured images that meet predetermined conditions from among multiple captured images, as second image information, which is displayed together with the captured image indicated by the image information and is displayed at a smaller size than the captured image indicated by the image information. The providing unit provides the second image information. As a result, the information processing device 1 can suggest more comfortable items to the user U.
[0201] Furthermore, the image information acquisition unit 45 prioritizes acquiring one or more captured images from among multiple captured images, corresponding to the information of the user U to whom the image information will be provided, as second image information. This allows the information processing device 1 to propose more comfortable items to the user U.
[0202] Furthermore, the user U's information includes information indicating the types of items owned by user U. The image information acquisition unit 45 prioritizes acquiring information from multiple captured images of a person wearing an item corresponding to the type of item owned by user U as second image information. This allows user U to easily find an item to wear from among their own items that are appropriate for the weather.
[0203] Furthermore, the user U's information includes information indicating user U's preferences for items. The image information acquisition unit 45 prioritizes acquiring information from multiple captured images of a person wearing an item corresponding to user U's preferences as second image information. This allows user U to find items that are appropriate for the weather and that suit their preferences.
[0204] Furthermore, the image information acquisition unit 45 prioritizes acquiring information from one or more captured images from among multiple captured images, starting with the most recent image, as second image information. This allows user U to learn about new outfit items that are appropriate for the weather.
[0205] Furthermore, the image information acquisition unit 45 prioritizes acquiring information from one or more captured images in order of their evaluation from among multiple captured images, and uses this information as second image information. This allows the image information acquisition unit 45 to suggest more comfortable and highly-rated items to the user U according to the weather.
[0206] Furthermore, the image information acquisition unit 45 prioritizes acquiring information from one or more captured images as second image information if at least one of the specified region and the weather of the specified region matches or is similar to at least one of the region and weather at the time of capture. This allows the image information acquisition unit 45 to suggest more comfortable items to the user U according to the weather and region.
[0207] Furthermore, the image information acquisition unit 45 prioritizes acquiring information from one or more captured images where the age of the user U, who is the recipient of the image information, matches or is similar to the age of the person in the image, as second image information. This allows the image information acquisition unit 45 to suggest more comfortable items to user U that are appropriate for the weather and user U's age.
[0208] Although embodiments of the present application have been described in detail based on the drawings, these are illustrative examples, and the present invention can be implemented in various other forms, including those described in the disclosure section of the invention, based on the knowledge of those skilled in the art.
[0209] Furthermore, the terms "section, module, unit" mentioned above can be replaced with "means" or "circuit," etc. For example, the acquisition unit can be replaced with acquisition means or acquisition circuit. [Explanation of Symbols]
[0210] 1. Information Processing Device 2 Terminal devices 3,4 Servers 10,20 Communications Department 11 Display section 12 Control section 13 Sensor Groups 14,21 Storage section 15,22 Processing Unit 16 Information acquisition department 17 Display Processing Unit 18. Information Output Unit 30 User information storage unit 31. Index-related information storage unit 32 Environmental information storage section 33 Image Information Storage Unit 40 Acquisition Department 41 Reception Department 42 Generation part 43 Providing Department 44 Environmental Information Acquisition Department 45 Image Information Acquisition Unit 50 Weather Contents 51 Weather Information 52 First image 53 Second image 54 Thick clothing index information 55 Text overlay information 56 Link Buttons 57 First Select Tag 58 Second Select Tag 100 Information Provision System
Claims
1. An environmental information acquisition unit that acquires environmental information including weather information, An image information acquisition unit acquires, based on the environmental information acquired by the environmental information acquisition unit, image information which is information of captured images of a person wearing an item corresponding to the environmental information, and image information provided on an e-commerce site. The system includes a providing unit that provides the image information acquired by the image information acquisition unit as information to be displayed together with weather information, The aforementioned image information acquisition unit, Information of captured images selected based on the high ratings of users of the aforementioned e-commerce site is acquired as the image information. An information processing device characterized by the following:
2. The aforementioned environmental information acquisition unit is: The environmental information includes information that includes an index corresponding to at least one of the current weather and the predicted weather conditions. The aforementioned image information acquisition unit, Information from an image of a person wearing an item corresponding to the aforementioned index is acquired as image information. The information processing apparatus according to feature 1.
3. The aforementioned index is It is an indicator of how thick clothing is worn. The aforementioned image information acquisition unit, Information from an image of a person wearing an item corresponding to the aforementioned index is acquired as image information. The information processing apparatus according to feature 2.
4. The aforementioned environmental information acquisition unit is: We obtain environmental information that includes information on an index corresponding to at least one of the current solar radiation and the predicted solar radiation. The aforementioned image information acquisition unit, Information from an image of a person wearing an item corresponding to the aforementioned index is acquired as image information. The information processing apparatus according to feature 1.
5. The aforementioned image information acquisition unit, From a plurality of captured images, each showing an image of a person wearing an item corresponding to the aforementioned environmental information, information from one or more captured images is randomly acquired as the image information. The information processing apparatus according to any one of claims 1 to 4.
6. The aforementioned image information acquisition unit, From the aforementioned plurality of captured images, information from one or more captured images that satisfy predetermined conditions is further acquired as second image information, which is information from a captured image that is displayed together with the captured image indicated in the image information and is displayed at a smaller size than the captured image indicated in the image information. The aforementioned supply unit is, The second image information is provided The information processing apparatus according to feature 5.
7. The aforementioned image information acquisition unit, From the plurality of captured images, one or more captured images corresponding to the user information to whom the image information will be provided are selected as the second image information. The information processing apparatus according to feature 6.
8. The user information mentioned above is: This includes information indicating the type of item owned by the user, The aforementioned image information acquisition unit, From the aforementioned multiple captured images, information from the captured image of a person wearing an item corresponding to the type of item owned by the user is prioritized and acquired as the second image information. The information processing apparatus according to feature 7.
9. The user information mentioned above is: This includes information indicating the user's preferences for the item, The aforementioned image information acquisition unit, From the aforementioned plurality of captured images, information from the captured image of a person wearing an item corresponding to the user's preferences is prioritized and acquired as the second image information. The information processing apparatus according to feature 7.
10. The aforementioned image information acquisition unit, From the aforementioned plurality of captured images, information from one or more captured images is prioritized and acquired as the second image information, starting with the most recent captured image and proceeding in descending order of newness. The information processing apparatus according to feature 6.
11. The aforementioned image information acquisition unit, From the aforementioned plurality of captured images, information from one or more captured images is prioritized and acquired as the second image information, in order of the highest evaluation of each captured image. The information processing apparatus according to feature 6.
12. The aforementioned image information acquisition unit, From the plurality of captured images, information from one or more captured images in which at least one of the specified region and the weather of the specified region matches or is similar to at least one of the region and weather at the time of acquisition is prioritized and acquired as the second image information. The information processing apparatus according to feature 6.
13. The aforementioned image information acquisition unit, From the aforementioned plurality of captured images, information from one or more captured images in which the age of the user to whom the image information will be provided matches or is similar to the age of the person at the time of capture is prioritized and acquired as the second image information. The information processing apparatus according to feature 6.
14. A method of information processing performed by a computer, An environmental information acquisition process that acquires environmental information including weather information, Image information acquisition step, based on the environmental information acquired by the environmental information acquisition step, acquires image information which is information of captured images of a person wearing an item corresponding to the environmental information, and image information provided on an e-commerce site. The process includes providing the image information acquired by the image information acquisition process as information to be displayed together with weather information, The aforementioned image information acquisition process is as follows: Information of captured images selected based on the high ratings of users of the aforementioned e-commerce site is acquired as the image information. An information processing method characterized by the following:
15. Procedures for obtaining environmental information, including weather information, An image information acquisition procedure, which acquires image information that is information of an image of a person wearing an item corresponding to the environmental information, based on the environmental information acquired by the environmental information acquisition procedure, and which is provided on an e-commerce site. The computer is instructed to perform a provision procedure, which involves providing the image information acquired by the image information acquisition procedure as information to be displayed together with weather information, The aforementioned image information acquisition procedure is as follows: Information of captured images selected based on the high ratings of users of the aforementioned e-commerce site is acquired as the image information. An information processing program characterized by the following features.
Citation Information
Patent Citations
Ceremony planning support device
JP2008226087A
Information processor, cloth proposing method and cloth proposing program
JP2019071027A
Information processing device, information processing system, learning device, learned estimation model, and method for collecting data for learning
JP2020071811A
Dress proposal device, dress proposal method, and program
JP2020107084A
Clothing information acquisition system and clothing information acquisition method
JP2021081877A