Information provision system and information provision program

JP7652145B2Active Publication Date: 2025-03-27TOYOTA JIDOSHA KK
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2022117304
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-07-22
Publication Date
2025-03-27
Estimated Expiration
2042-07-22

Smart Images

  • Figure 0007652145000001
    Figure 0007652145000001
  • Figure 0007652145000002
    Figure 0007652145000002
  • Figure 0007652145000003
    Figure 0007652145000003
Patent Text Reader

Abstract

To propose to a user at least one of a destination and a vehicle that are suitable to the user.SOLUTION: An information provision system proposes to a user an action item that includes at least one of a destination and a vehicle. A database represents a correlation between a clothing type and a recommended action item. The information provision system performs: obtaining an image that has picked up a user clothing being a clothing of the user to recognize a type of the user clothing on the basis of the image; further referring to the database and select as a recommended action item, an action item to be recommended in association with the type of the user clothing; and proposing the recommended action item to the user.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a technology for suggesting at least one of a destination and a vehicle to a user. [Background technology]

[0002] Patent Document 1 discloses an information processing device that provides information to a user. The information processing device stores user attributes including the user's needs, preferences, or characteristics. The user attributes are input by the user himself / herself. The information processing device identifies facilities that are suitable for the user attributes. Furthermore, the information processing device provides the user with information on facilities that the user has not yet visited among the identified facilities. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-134953 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is room for improvement in technology for providing information suited to a user's preferences, etc. One object of the present disclosure is to provide a technology capable of proposing to a user at least one of a destination and a vehicle suited to the user. [Means for solving the problem]

[0005] A first aspect relates to an information provision system that suggests action items including at least one of a destination and a vehicle to a user. The information provision system is one or more processors; one or more storage devices for storing a database showing the correspondence between clothing types and recommended activity items; Equipped with. The one or more processors Acquire an image showing the user's clothes, which are the clothes of the user; Recognize the type of user clothing based on the image; Refer to the database and select recommended action items for the user's outfit type as recommended action items; Suggest recommended action items to users It is configured as follows.

[0006] A second aspect relates to an information providing program that suggests to a user action items including at least one of a destination and a vehicle. The database indicates the correspondence between types of clothing and recommended activity items. The information providing program is executed by a computer to: Acquiring an image showing a user's clothing, which is clothing of a user; Recognizing a type of user clothing based on the image; Refer to the database and select recommended action items for the user's outfit type as recommended action items; Suggesting recommended action items to the user; to be executed by the computer. Effect of the Invention

[0007] According to the present disclosure, a recommended action item (at least one of a destination and a vehicle) is selected based on the type of user clothing and is proposed to the user. The type of user clothing reflects the user's preferences and mood. Also, by taking the type of user clothing into consideration, it is possible to exclude action items that do not match the user clothing. Therefore, it is possible to propose recommended action items suitable for the user to the user. [Brief description of the drawings]

[0008] [Figure 1] 1 is a conceptual diagram for explaining an overview of an information providing system according to an embodiment. [Diagram 2] 1A to 1C are diagrams showing various examples of clothing types according to an embodiment. [Diagram 3] FIG. 2 is a conceptual diagram for explaining an overview of an information providing process performed by the information providing system according to the embodiment. [Figure 4] 1 is a block diagram showing a configuration related to an information providing system according to an embodiment; [Diagram 5] 1 is a block diagram showing a configuration of an information providing system according to an embodiment; [Figure 6] 4 is a flowchart showing an information providing process performed by the information providing system according to the embodiment. [Figure 7] FIG. 2 is a conceptual diagram illustrating an example of a database related to a vehicle according to an embodiment. [Figure 8] 10 is a flowchart showing an example of step S300 in the process of providing information about a vehicle according to the embodiment. [Figure 9] FIG. 11 is a conceptual diagram showing another example of a database related to a vehicle according to an embodiment. [Figure 10] FIG. 4 is a conceptual diagram illustrating an example of a database related to destinations in the embodiment. [Figure 11] FIG. 11 is a conceptual diagram illustrating another example of a database related to destinations in the embodiment. [Figure 12] 13 is a flowchart illustrating an example of step S300 in information providing processing related to a destination in the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0010] 1. Overview FIG. 1 is a conceptual diagram for explaining an overview of an information providing system 100 according to the present embodiment. The information providing system 100 provides various information to a user 1. Typically, the information providing system 100 provides various information to a user 1 through a terminal 10 operated by the user 1. For example, the terminal 10 is a mobile terminal (e.g., a smartphone) of the user 1. As another example, the terminal 10 may be an information terminal (e.g., a digital signage) installed in a city or a building.

[0011] In the following, the provision of information useful for "outings" such as sightseeing, driving, shopping, and dining will be considered. For example, the information providing system 100 proposes recommended destinations to the user 1. Examples of destinations include tourist spots, scenic spots, hiking trails, entertainment facilities, commercial facilities, restaurants, and the like. As another example, the information providing system 100 may propose recommended vehicles (mobility) to the user 1. The vehicles may be used for traveling to the destinations, or for driving.

[0012] In the following description, an "action item ACT" is a concept including at least one of a destination and a vehicle. An action item ACT may include both a destination and a vehicle. The information provision system 100 proposes (recommends) an action item ACT to the user 1. In particular, the information provision system 100 automatically proposes (recommends) an action item ACT suitable for the user 1, taking into consideration the preferences, mood, etc. of the user 1.

[0013] In proposing the action item ACT, the inventors of the present application focused on the "clothing" of the user 1. It is considered that the clothing of the user 1 reflects the user 1's preferences and mood of the day. Therefore, by taking into consideration the clothing of the user 1, it is possible to understand the preferences and mood of the user 1. Also, by taking into consideration the clothing of the user 1, it is possible to exclude from the options action items ACT that do not match the clothing of the user 1.

[0014] Therefore, the information provision system 100 according to the present embodiment automatically proposes (recommends) an action item ACT suitable for the user 1, taking into consideration the clothing of the user 1. For this purpose, a database DB indicating the correspondence between clothing types and recommended action items ACT is prepared in advance. The clothing type is the type of clothing worn by the user 1.

[0015] FIG. 2 shows various examples of clothing types. In FIG. 2, clothing types are defined from three perspectives: atmosphere, color tone, and functionality. An example of "clothing atmosphere," which is one perspective of clothing types, is the opposing "sporty" and "dressy." An example of "clothing color tone," which is another perspective of clothing types, is the opposing "colorful" and "monochrome." An example of "clothing functionality," which is yet another perspective of clothing types, is the opposing "easy to move in" and "difficult to move in."

[0016] FIG. 3 is a conceptual diagram for explaining an overview of information provision processing by the information provision system 100. The terminal 10 is equipped with a camera and takes an image of the user 1. The image IMG taken by the camera of the terminal 10 shows user clothes, which are the clothes of the user 1. The information provision system 100 acquires the image IMG showing the user clothes, and recognizes the type of the user clothes based on the image IMG. For example, image recognition AI (Artificial Intelligence) obtained through machine learning is used to recognize the type of the user clothes based on the image IMG.

[0017] The information provision system 100 also holds a database DB indicating the correspondence between clothing types and recommended action items ACT. The information provision system 100 refers to the database DB to select an action item ACT recommended for the type of user clothing. The action item ACT selected here, i.e., the action item ACT associated with the type of user clothing, is hereinafter referred to as a "recommended action item RACT." The recommended action item RACT includes at least one of a recommended destination and a recommended vehicle.

[0018] The information providing system 100 proposes the recommended action item RACT to the user 1. That is, the information providing system 100 notifies the terminal 10 of suggested information indicating the recommended action item RACT, and the terminal 10 presents the suggested information to the user 1. For example, the terminal 10 displays the suggested information indicating the recommended action item RACT on a display device.

[0019] <Effects> As described above, according to this embodiment, a recommended action item RACT is selected based on the type of user clothing and is proposed to the user 1. The type of user clothing reflects the preferences and mood of the user 1. In addition, by taking the type of user clothing into consideration, it is also possible to eliminate action items ACT that do not match the user clothing. Therefore, it is possible to propose to the user 1 a recommended action item RACT that is suitable for the user 1.

[0020] Furthermore, according to this embodiment, the user 1 does not need to input his / her preferences or mood in detail. The user 1 only needs to take a picture of himself / herself using the camera of the terminal 10. Then, the information providing system 100 automatically suggests recommended action items RACT suitable for the user 1.

[0021] In addition, the clothing of the user 1 may reflect a latent preference of the user 1 that the user 1 himself is not aware of. In that case, the information providing system 100 may suggest a recommended action item RACT that the user 1 himself would not have thought of. This increases the opportunities for the user 1 to make new discoveries.

[0022] A specific example of the information providing system 100 according to the present embodiment will be described below.

[0023] 2. Examples of information provision systems 2-1. Configuration example 4 is a block diagram showing a terminal 10 and a management server 20 as components related to the information providing system 100. The terminal 10 is operated by a user 1. Examples of the terminal 10 include a mobile terminal (e.g., a smartphone) of the user 1, and an information terminal (e.g., a digital signage) installed in a city or building. The terminal 10 and the management server 20 are capable of communicating with each other.

[0024] The terminal 10 includes a communication interface 11, a camera 12, a user interface 13, and a position acquisition unit 14. The terminal 10 communicates with the management server 20 via the communication interface 11. The camera 12 captures images of the surroundings of the terminal 10. The user interface 13 is an interface for receiving information from the user 1 and for providing information to the user 1. Examples of the user interface 13 include a touch panel, a keyboard, a display device, and the like. The position acquisition unit 14 acquires position information of the terminal 10 by using a Global Navigation Satellite System (GNSS).

[0025] The management server 20 includes a communication interface 21. The management server 20 communicates with the terminal 10 via the communication interface 21.

[0026] For example, the information providing system 100 is included in the terminal 10. As another example, the information providing system 100 may be included in the management server 20. When the information providing system 100 is included in the management server 20, the information providing system 100 communicates with the terminal 10, acquires necessary information from the terminal 10, and provides various information to the terminal 10. As yet another example, the information providing system 100 may be distributed between the terminal 10 and the management server 20. In general, the information providing system 100 has the following configuration.

[0027] 5 is a block diagram showing the configuration of an information providing system 100. The information providing system 100 includes an I / O (Input / Output) interface 110, one or more processors 120 (hereinafter simply referred to as "processors 120"), and one or more storage devices 130 (hereinafter simply referred to as "storage devices 130").

[0028] The I / O interface 110 is an interface for receiving various types of information and outputting various types of information. For example, when the information providing system 100 is included in the terminal 10, the I / O interface 110 includes a communication interface 11 and a user interface 13. As another example, when the information providing system 100 is included in the management server 20, the I / O interface 110 includes a communication interface 21.

[0029] The processor 120 performs various types of information processing. For example, the processor 120 includes a CPU (Central Processing Unit). The storage device 130 stores various types of information required for processing by the processor 120. Examples of the storage device 130 include a volatile memory, a non-volatile memory, a HDD (Hard Disk Drive), and an SSD (Solid State Drive).

[0030] The information provision program 140 is a computer program executed by the processor 120. The functions of the information provision system 100 are realized by cooperation between the processor 120 executing the information provision program 140 and the storage device 130. The information provision program 140 is stored in the storage device 130. The information provision program 140 may be recorded in a computer-readable recording medium. The information provision program 140 may be provided via a network. The information provision program 140 may be an application executed by the terminal 10 (e.g., a smartphone).

[0031] Furthermore, the storage device 130 stores an image IMG, an image recognition model REC, a database DB, suggested information INF, and the like.

[0032] The image IMG is captured by the camera 12 of the terminal 10. The image IMG shows user clothes, which are clothes worn by the user 1.

[0033] The image recognition model REC is an AI (Artificial Intelligence) model that can recognize (classify) the type of user clothing shown in the image IMG. The type of clothing may include three perspectives: atmosphere, color tone, and functionality (see FIG. 2). The image recognition model REC is generated in advance through machine learning such as deep learning, and is provided to the information provision system 100.

[0034] The database DB indicates the correspondence between the clothing type and the recommended action item ACT. An example of the database DB is as described above with reference to Fig. 2. The database DB is created in advance by a system designer and provided to the information provision system 100.

[0035] The suggested information INF is information including recommended action items RACT suggested to the user 1 .

[0036] 2-2.Processing flow FIG. 6 is a flowchart showing the information provision process by the processor 120 of the information provision system 100. As shown in FIG.

[0037] In step S100, the processor 120 acquires an image IMG showing the user's clothes. More specifically, the user 1 operates the user interface 13 of the terminal 10 to activate the camera 12. The camera 12 takes a picture of the user 1 and acquires the image IMG showing the user's clothes. If the processor 120 is included in the terminal 10, the processor 120 acquires the image IMG from the camera 12. As another example, if the processor 120 is included in the management server 20, the processor 120 communicates with the terminal 10 via the I / O interface 110 (communication interface 21) and acquires the image IMG from the terminal 10.

[0038] In step S200, the processor 120 recognizes the type of the user's clothing based on the image IMG. More specifically, the processor 120 recognizes the type of the user's clothing shown in the image IMG by inputting the image IMG to an image recognition model REC. The type of the user's clothing may include three aspects: atmosphere, color tone, and functionality (see FIG. 2).

[0039] In step S300, the processor 120 refers to the database DB and selects an action item ACT recommended for the type of the user's outfit as a recommended action item RACT.

[0040] In step S400, the processor 120 proposes the recommended action item RACT to the user 1. More specifically, the processor 120 presents the suggested information INF including the recommended action item RACT to the user 1 via the I / O interface 110. For example, when the processor 120 is included in the terminal 10, the processor 120 presents the suggested information INF to the user 1 via the user interface 13 (e.g., display device). As another example, when the processor 120 is included in the management server 20, the processor 120 transmits the suggested information INF to the terminal 10 via the communication interface 21 and instructs the terminal 10 to present the suggested information INF to the user 1.

[0041] 3. Vehicle proposal In Section 3, a case where the action item ACT includes a vehicle will be described. In this case, a vehicle-related database DB is used. The vehicle-related database DB includes a first database DB-1 that indicates a correspondence between an outfit type and a recommended vehicle.

[0042] FIG. 7 is a conceptual diagram showing an example of the first database DB-1. In the example shown in FIG. 7, a vehicle is defined by a vehicle type and a vehicle color. Examples of vehicle types include a sedan, an SUV, a wagon, and a minivan. In addition, the above-mentioned "atmosphere of clothing" and "color tone of clothing" are used as clothing types (see FIG. 2). As shown in FIG. 7, "atmosphere of clothing" and "recommended vehicle type" are associated with each other, and "color tone of clothing" and "recommended vehicle color" are associated with each other. That is, the first database DB-1 shows the correspondence relationship between "atmosphere of clothing" and "recommended vehicle type", and the correspondence relationship between "color tone of clothing" and "recommended vehicle color".

[0043] FIG. 8 is a flowchart showing an example of step S300 in the process of providing information about a vehicle.

[0044] In step S310, the processor 120 refers to the first database DB-1 to select a car model recommended for the atmosphere of the user's clothing.

[0045] In step S311, the processor 120 refers to the first database DB-1 to select a vehicle color recommended for the color tone of the user's clothing.

[0046] In step S312, the processor 120 sets the vehicle of the selected model and color (e.g., a red SUV) as a recommended vehicle. This recommended vehicle is a recommended action item RACT proposed to the user 1.

[0047] As a modified example, only one of step S310 and step S311 may be performed. That is, only one of the vehicle type and vehicle color according to the user's clothing may be selected. When only the vehicle type is selected, a vehicle of the selected vehicle type is set as a recommended vehicle. On the other hand, when only the vehicle color is selected, a vehicle of the selected vehicle color is set as a recommended vehicle.

[0048] Fig. 9 is a conceptual diagram showing another example of the database DB related to vehicles. In the example shown in Fig. 9, the database DB related to vehicles includes a vehicle database DB-V in addition to the first database DB-1. The vehicle database DB-V indicates the correspondence between the vehicle ID, vehicle model, and vehicle color of a specific vehicle. By also referring to the vehicle database DB-V, the processor 120 can suggest to the user 1 a specific vehicle that corresponds to the recommended vehicle set in step S312.

[0049] For example, the position acquisition unit 14 of the terminal 10 (see FIG. 4) acquires the position of the terminal 10 as the current position of the user 1. Alternatively, the user 1 specifies an arbitrary position using the user interface 13. The processor 120 acquires the current position of the user 1 or the position specified by the user 1 as the reference position. Furthermore, the processor 120 acquires a vehicle database DB-V related to currently available vehicles from a management system that manages rental car services or car sharing services available around the reference position. The processor 120 can suggest to the user 1 a specific vehicle that corresponds to the recommended vehicle set in step S312 by referring to the vehicle database DB-V.

[0050] 4. Destination suggestions Section 4 describes the case where the action item ACT includes a destination. In this case, a destination-related database DB is used. The destination-related database DB includes a second database DB-2 that indicates the correspondence between clothing types and recommended destinations.

[0051] FIG. 10 is a conceptual diagram showing an example of the second database DB-2. In the example shown in FIG. 10, the second database DB-2 shows the correspondence between a destination, the location of the destination, and a clothing type suitable for the destination. The clothing type includes three aspects: atmosphere, color tone, and functionality. For example, clothing that is sporty, colorful, and easy to move in is suitable for "*** Amusement Park." Conversely, the destination recommended for clothing that is sporty, colorful, and easy to move in is "*** Amusement Park."

[0052] Fig. 11 is a conceptual diagram showing another example of the second database DB-2. In the example shown in Fig. 11, the second database DB-2 shows the correspondence between a destination, the location of the destination, and the suitability of the destination for a clothing type. The suitability of the destination for a clothing type is defined for each specific item of the clothing type. In Fig. 11, ◯ means high suitability, △ means that suitability is not low, and × means that suitability is low.

[0053] FIG. 12 is a flowchart showing an example of step S300 in the destination-related information providing process.

[0054] In step S320, processor 120 acquires information on the current location of user 1 or a location specified by user 1. For example, location acquisition unit 14 (see FIG. 4) of terminal 10 acquires the location of terminal 10 as the current location of user 1. Alternatively, user 1 specifies an arbitrary location using user interface 13. Processor 120 acquires the current location of user 1 or the location specified by user 1 as a reference location.

[0055] In step S321, the processor 120 sets a search area including the reference position. For example, the search area is an area within a first distance from the reference position. The first distance may be a fixed distance or may be specified by the user 1. As another example, the search area is an area that can be reached within a first hour from the reference position. The first time may be a fixed time or may be specified by the user 1. When the user 1 performs the specification, the user interface 13 is used.

[0056] In step S322, the processor 120 extracts candidate destinations included in the search area. As described above, the second database DB-2 includes location information of each destination. The processor 120 extracts one or more destinations included in the search area as candidate destinations from all destinations registered in the second database DB-2.

[0057] In step S323, the processor 120 selects a recommended destination from among the candidate destinations. More specifically, the processor 120 refers to the second database DB-2 and selects the candidate destinations recommended for the type of user clothing as the recommended destination.

[0058] For example, in the case of the second database DB-2 shown in Fig. 10, the processor 120 acquires information on the type of clothing suitable for each candidate destination. Then, the processor 120 selects the candidate destination having the most items matching the type of clothing of the user as the recommended destination.

[0059] As another example, in the case of the second database DB-2 shown in FIG. 11, the processor 120 calculates a score for each candidate destination based on the type of user clothing. For example, if the suitability for the type of user clothing is ◯, the score is increased. If the suitability for the type of user clothing is ×, the score is decreased. If the suitability for the type of user clothing is △, the score does not increase or decrease. Then, the processor 120 selects the candidate destination with the highest score as the recommended destination.

[0060] In this manner, the processor 120 selects a recommended destination from among the candidate destinations based on the type of user clothing. The recommended destination is a recommended action item RACT to be proposed to the user 1.

[0061] 5. Combinations A combination of the above-mentioned sections 3 and 4 is also possible. That is, the processor 120 may suggest both a recommended vehicle and a recommended destination to the user 1. [Explanation of symbols]

[0062] 1 User 10 Terminal 20 Management Server 100 Information provision system 110 I / O Interface 120 processors 130 Storage device 140 Information Program ACT Action Items DB Database IMG Image INF proposal information RACT Recommended Action Items REC Image Recognition Model

Claims

1. An information provision system that proposes an action item including at least one of a destination and a vehicle to a user, one or more processors; one or more storage devices for storing a database showing the correspondence between types of clothing and the recommended behavioral items; Equipped with The one or more processors: Acquire an image showing the user's clothing, which is the clothing of the user; Recognizing a type of the user's clothing based on the image; Refer to the database and select the action items recommended for the type of the user's outfit as recommended action items; Suggesting the recommended action items to the user It is configured as follows: the action item includes the vehicle; the type of attire includes a color tone of the attire; the database indicates a correspondence between the color tone of the clothing and the vehicle color of the recommended vehicle; The one or more processors: Refer to the database to select the vehicle color recommended for the color tone of the user's clothing; Setting the vehicle of the selected vehicle color as a recommended vehicle; The recommended vehicle is proposed to the user. It was configured as Information provision system.

2. An information provision system that proposes to a user an action item including at least one of a destination and a vehicle, one or more processors; one or more storage devices for storing a database showing the correspondence between types of clothing and the recommended behavioral items; Equipped with The one or more processors: Acquire an image showing the user's clothing, which is the clothing of the user; Recognizing a type of the user's clothing based on the image; Refer to the database and select the action items recommended for the type of the user's outfit as recommended action items; Suggesting the recommended action items to the user It is configured as follows: the action item includes the vehicle; The type of the outfit includes an atmosphere of the outfit; the database indicates a correspondence relationship between the atmosphere of the clothing and the type of the vehicle to be recommended; The one or more processors: Refer to the database to select the vehicle model recommended for the user's clothing style; Setting the vehicle of the selected model as a recommended vehicle; The recommended vehicle is proposed to the user. It was configured as Information provision system.

3. An information providing program executed by a computer to suggest to a user an action item including at least one of a destination and a vehicle, The database indicates a correspondence between the type of clothing and the recommended behavioral items; The information providing program is Acquiring an image showing a user's clothing, which is the clothing of the user; Recognizing a type of the user's clothing based on the image; and selecting, as recommended action items, the action items recommended for the type of the user's outfit, by referring to the database; Suggesting the recommended action items to the user; causing the computer to execute the action item includes the vehicle; the type of attire includes a color tone of the attire; the database indicates a correspondence between the color tone of the clothing and the vehicle color of the recommended vehicle; The information providing program is selecting the vehicle color recommended for the user's clothing color scheme by referencing the database; setting the vehicle of the selected vehicle color as a recommended vehicle; Proposing the recommended vehicle to the user; causing the computer to execute Informational program.

4. An information provision program executed by a computer to suggest to a user an action item including at least one of a destination and a vehicle, The database indicates a correspondence between the type of clothing and the recommended behavioral items; The information providing program is Acquiring an image showing a user's clothing, which is the clothing of the user; Recognizing a type of the user's clothing based on the image; and selecting, as recommended action items, the action items recommended for the type of the user's outfit, by referring to the database; Suggesting the recommended action items to the user; causing the computer to execute the action item includes the vehicle; The type of the outfit includes an atmosphere of the outfit; the database indicates a correspondence relationship between the atmosphere of the clothing and the type of the vehicle to be recommended; The information providing program is selecting the vehicle model recommended for the user's clothing style by referring to the database; setting the vehicle of the selected vehicle type as a recommended vehicle; Proposing the recommended vehicle to the user; causing the computer to execute Informational program.

Citation Information

Patent Citations

  • Information processing system, server, program, and information processing method

    JP2020077262A

  • Information processor, method for processing information, and program

    JP2020134953A

  • A method for navigation service based on the state of things and a terminal therefor

    KR1020130023478A

  • Information processing device, information processing method and moving body device

    WO2017179285A1