Facility proposal device

Abstract

To provide a facility proposal device capable of proposing facility recommendation information without requiring complicated operations.SOLUTION: An in-vehicle device is provided, comprising: a related information output processing unit 53 configured to output facility-related information at predetermined timing; a reaction detection unit 54 configured to detect reaction of a user to the output of the related information; a recommendation information generation unit 55 configured to generate facility recommendation information based on the reaction of the user detected by the reaction detection unit 54; and a recommendation information proposal unit 56 for proposing the recommendation information to the user.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a facility suggestion device that suggests facilities to be used to a user. [Background technology]

[0002] Conventionally, there has been known an in-vehicle guidance device that, when a destination or passing point appears on the display screen, refers to a location-scent correspondence table and releases a scent corresponding to the scent number set in correspondence with the location genre indicating the destination or passing point, thereby allowing the vehicle driver to use their sense of smell to recognize the scent corresponding to the destination or passing point that appears on the display screen (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2001-349739 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, the in-vehicle guidance device disclosed in the above-mentioned Patent Document 1 only emits a scent in association with a location such as a destination. On the other hand, although facilities belonging to a genre designated by a user have been displayed in the past, there has been no method combining the above-mentioned emission of a scent. In addition, when the user himself / herself designates a genre in advance, an operation for that purpose is required, and there is a problem that the operation becomes complicated, especially when the operation is performed during a break from driving, because the operation is sometimes restricted while driving. Therefore, a method is desired that can obtain recommended information on facilities that reflects the user's intention without performing complicated operations.

[0005] The present invention has been made in consideration of the above-mentioned points, and has as its object to provide a facility recommendation device that can suggest recommended information about facilities without requiring complicated operations. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, the facility suggestion device of the present invention includes a related information output means for outputting related information about a facility at a predetermined timing, a reaction detection means for detecting a reaction of a user to the output of the related information, a recommended information creation means for creating recommended information about the facility based on the reaction of the user detected by the reaction detection means, and a recommended information suggestion means for suggesting the recommended information to the user. The user's reaction detected by the reaction detection means is the user's pleasant / unpleasant feelings, the related information output means outputs a plurality of pieces of related information at different times, and the recommended information creation means creates recommended information for facilities corresponding to the related information in which the user has expressed a pleasant feeling, and creates the recommended information for facilities corresponding to the related information in which the user has expressed the greatest degree of pleasantness among the user's reactions detected by the reaction detection means for each of the plurality of pieces of related information. is.

[0007] The system creates recommended facility information by detecting the user's reaction when related information about a facility is output, so that the user can create and propose recommended facility information to the system without having to perform complicated operations.

[0008] The related information is preferably one or a combination of two or more of scents, sounds, and images related to the facility. Also , as mentioned above like, The reaction of the user to be detected by the reaction detection means is the user's pleasant / unpleasant feelings, and the recommended information create The method is to create recommended information for facilities corresponding to related information in which the user expressed a positive emotion. Is By using scents, sounds, and images that are reminiscent of the facility, it is possible to predict how the user will feel about the facility based on the user's reaction at that time, making it possible to provide recommended information about facilities that the user desires.

[0009] It is also preferable that the system further includes a camera for capturing an image of the user's face, and the reaction detection means detects the reaction of the user based on the facial expression of the user captured by the camera. By capturing an image of the user's facial expression with the camera, it is possible to know how the user feels about the output of related information based on the movement of the facial muscles around the eyes and mouth.

[0010] It is also preferable that the device further includes a microphone for collecting the user's voice, and the reaction detection means detects the user's reaction based on the voice emitted by the user collected by the microphone. By collecting the contents (voice) spoken by the user when the related information is output, it is possible to know how the user feels about the output of the related information.

[0011] In addition, like, The related information output means outputs a plurality of pieces of related information at different times, and the recommended information creation means creates recommended information for facilities based on the user's reaction detected by the reaction detection means for each of the plurality of pieces of related information. Is In particular, it is preferable that the related information output means outputs a plurality of pieces of related information at different times, and the recommended information creation means creates the recommended information for the facility corresponding to the related information that gives the user the greatest degree of pleasure among the user's reactions to each of the plurality of pieces of related information detected by the reaction detection means. This makes it possible to estimate the facility for which the user most wants recommended information to be created out of the plurality of facilities.

[0012] The predetermined timing is preferably when the vehicle position approaches the facility corresponding to the related information by more than a predetermined threshold while traveling. This makes it possible to present recommended information about nearby facilities only when the user desires it.

[0013] In addition, the above-mentioned predetermined timing is preferably when a predetermined time is reached. This makes it possible to present recommended information about facilities that are available at limited times (for example, during lunch or dinner hours) only when the user desires it. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an in-vehicle device according to an embodiment. [Diagram 2] 2 is a diagram showing functional blocks of a facility proposal processing unit that operates by executing a facility proposal operation program by a CPU. FIG. [Diagram 3] 13 is a flowchart showing an operation procedure for outputting related information about facilities at a predetermined timing, and outputting recommended information about the facilities based on a reaction of the user at that time. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, an embodiment of an in-vehicle device to which a facility proposal device of the present invention is applied will be described with reference to the drawings.

[0016] 1 is a diagram showing the configuration of an in-vehicle device according to an embodiment of the present invention. As shown in FIG 1, the in-vehicle device according to the present embodiment includes a head unit 1, a speaker 4, a microphone 5, a camera 100, and a fragrance emitting device 110.

[0017] In the in-vehicle device of this embodiment, in parallel with performing general navigation operations, relevant information about facilities is output at a predetermined timing, the reaction of the user (driver) at that time is detected, and if the reaction is good, recommended information corresponding to the facility is created and output (facility suggestion operation).

[0018] The head unit 1 is installed, for example, in a central position on the dashboard, and includes a navigation processing unit 10, an operation unit 20, an input control unit 26, a display processing unit 30, a display device 32, a digital-to-analog converter (D / A) 40, an analog-to-digital converter (A / D) 42, a CPU 50, a memory 60, and an input / output interface unit (I / O IF) 80.

[0019] The navigation processing unit 10 performs navigation operations to guide the vehicle equipped with the head unit 1 along its travel path using map data stored in the memory 60. The navigation operations include operations such as vehicle position detection using the GPS device 12, map display of the area around the vehicle position, route search to calculate a travel route to the destination, route guidance to guide the vehicle along the calculated travel route to the destination, and facility search based on the user's operation.

[0020] The operation unit 20 is for accepting operations by the user on the head unit 1, and is configured to include various operation keys, operation switches, operation knobs, etc. arranged around the display device 32. In addition, when various operation screens or input screens are displayed on the display device 32, the user can directly point to a part of the operation screen or input screen with a finger or the like to select a display item of the operation screen or input screen, and in order to enable operations using such operation screens or input screens, a touch panel that detects the position of a pointed finger or the like is provided as a part of the operation unit 20. Note that instead of using a touch panel, a part of the operation screen or input screen may be selected according to an instruction from the user using a remote control unit or the like. The input control unit 26 monitors the operation unit 20 and determines the operation content.

[0021] The display processing unit 30 outputs video signals for displaying various operation screens, input screens, etc., and displays these screens on the display device 32, as well as displaying the processing contents and operation screens by the navigation processing unit 10, and related information and recommended information regarding facilities. The display device 32 is installed in the center front between the driver's seat and the passenger seat, and is configured using, for example, a liquid crystal display device (LCD).

[0022] The digital-to-analog converter 40 converts audio data generated by processing in the navigation processing unit 10 and the like into an analog audio signal and outputs it toward the vehicle interior from the speaker 4. Note that, in reality, an amplifier for amplifying the signal is connected between the digital-to-analog converter 40 and the speaker 4, but this amplifier is omitted in FIG.

[0023] The analog-digital converter 42 converts the user's speech (analog voice signal) collected and output by the microphone 5 into digital speech data.

[0024] The CPU 50 executes a predetermined program stored in the memory 60 to control the entire head unit 1 and to perform facility suggestion operations such as outputting related information and outputting recommended information. Specific details of the facility suggestion operations will be described later.

[0025] The memory 60 stores the operation program of the CPU 50 and is used as a working area for storing various data necessary for the operation of the CPU 50. The operation program executed by the CPU 50 includes a facility proposal operation program for the head unit 1 to perform a facility proposal operation. The memory 60 is composed of, for example, semiconductor memory such as ROM and RAM, and may also include a hard disk device and the like in addition to these.

[0026] The input / output interface unit 80 performs input / output processing of signals (data) between various input / output devices. In this embodiment, a camera 100, a fragrance emitting device 110, and the like are connected as input / output devices that are targets of signal processing.

[0027] The camera 100 is mainly for capturing an image of a user (driver) in the vehicle cabin, and is set in front of the driver. The scent emitting device 110 mainly emits a scent toward the user. This scent is ultimately used to determine whether or not recommended information about facilities is proposed, and is used by the user to select a facility that he or she wishes to use. For example, it is assumed that the scent of a specific dish is emitted at lunchtime or dinnertime. Specifically, it is possible to spray the scent component of a representative dish, or spray an appropriate combination of multiple types of scent components required to reproduce the scents of multiple dishes.

[0028] Fig. 2 is a diagram showing functional blocks of a facility proposal processing unit which operates by executing a facility proposal operation program by the CPU 50. As shown in Fig. 2, the facility proposal processing unit 50A includes a preference information collecting unit 51, an output timing determining unit 52, a related information output processing unit 53, a response detecting unit 54, a recommended information creating unit 55, and a recommended information proposing unit 56.

[0029] The preference information collecting unit 51 collects preference information regarding the user's use of facilities. For example, information such as the types and chain names of restaurants that are frequently used at lunchtime, dinnertime, and other times, or the types of facilities that are often used for purposes other than eating, is collected as preference information. These facilities and types can be identified, for example, by using information from a facility search performed using the navigation processing unit 10, or by using information from facilities that have actually been used in the past.

[0030] The output timing determination unit 52 determines the output timing of related information of facilities that are thought to be associated with the candidate facility as a suggested target. Specifically, it can be when the vehicle position approaches the candidate facility beyond a predetermined threshold (for example, when it is within 1 km), when a predetermined time is reached (for example, after 11:00 a.m.), or when these are combined.

[0031] The related information output processing unit 53 outputs related information of facilities that match the user's preferences at the output timing determined by the output timing determination unit 52. This related information includes any one or a combination of two or more of aroma, sound, and image. For example, if the user often visits a curry specialty restaurant at lunchtime, the aroma of curry spices may be output as related information, and an image of curry may be created as related information and displayed on the display device 32 in parallel with the output of this aroma. Similarly, if the user often visits a yakiniku restaurant at dinnertime, the aroma and sound emitted when yakiniku is being grilled, or an image of yakiniku being grilled, may be used as related information.

[0032] The specific aroma is generated by instructing the aroma generating device 110 from the related information output processing unit 53 to output the aroma. The specific sound is output by outputting sound data generated by the related information output processing unit 53 (for example, sound data of grilling meat is generated in advance and stored in the memory 60) from the speaker 4 through the digital-analog converter 40. The specific video is displayed by displaying image data generated by the related information output processing unit 53 (for example, image data showing the state of grilling meat is generated in advance and stored in the memory 60) on the display device 32 through the display processing unit 30.

[0033] When the related information is output by the related information output processing unit 53, the reaction detection unit 54 detects the reaction of the user corresponding to this output. As the reaction of the user, the pleasant / unpleasant emotion of the user is detected. This detection is performed based on at least one of the facial expression of the user and the voice emitted by the user when the related information is output. By observing the facial image of the user captured by the camera 100 as the facial expression of the user, particularly the movement of the facial muscles around the mouth and eyes, it is possible to determine whether the user's emotion at that time is in a pleasant state or an unpleasant state. In addition, when the voice emitted by the user and collected by the microphone 5 includes a voice that actively indicates agreement with the related information (for example, "like" or "I want to eat XX"), it is possible to determine that the user is in a pleasant state.

[0034] When the reaction detection unit 54 detects the user's comfort state, the recommendation information creation unit 55 creates recommendation information related to the facility that is the subject of the detection of the comfort state. For example, assuming that the user's comfort state is detected in response to the smell of curry or the output of a video, the recommendation information creation unit 55 searches for curry specialty restaurants near the vehicle position and creates recommendation information including an introduction to the restaurant. Specifically, the recommendation information includes image data and audio data indicating information such as the restaurant name, the distance from the vehicle position, and the availability of parking.

[0035] The recommended information proposing unit 56 displays an image indicating the recommended information on the display device 32 using image data as the recommended information, and outputs a sound indicating the recommended information from the speaker 4 using audio data as the recommended information.

[0036] The above-mentioned related information output processing unit 53, fragrance generating device 110, display processing unit 30, display device 32, digital-analog converter 40, and speaker 4 correspond to related information output means, the reaction detection unit 54, camera 100, microphone 5, and analog-digital converter 42 correspond to reaction detection means, the recommendation information creation unit 55 corresponds to recommendation information creation means, and the recommendation information proposal unit 56, display processing unit 30, display device 32, digital-analog converter 40, and speaker 4 correspond to recommendation information proposal means.

[0037] The in-vehicle device of this embodiment has the above-mentioned configuration, and its operation will now be described.

[0038] 3 is a flow chart showing the operation procedure for outputting related information about facilities at a predetermined timing, and outputting recommended information about the facilities based on the user's reaction at that time. Note that the operation of collecting preference information by the preference information collecting unit 51 is performed in parallel before this operation procedure, and the contents of the collection are updated as appropriate.

[0039] While the vehicle is traveling, the output timing determination unit 52 determines whether the output timing of the related information has arrived (step 100). If it is not the output timing, a negative determination is made, and this determination is repeated. If the output timing arrives, a positive determination is made in the determination of step 100. For example, a positive determination is made when it is past 11:00 a.m.

[0040] Next, the related information output processing unit 53 specifies one facility for which related information is to be created (step 102). For example, taking into consideration the user's preference information, a facility that the user would most like to use at that time, or a facility that is close to the vehicle's position at that time and that matches the user's preference, etc. are specified.

[0041] Next, the related information output processing unit 53 creates related information for the identified facility (step 104). Related information (one or a combination of scent, sound, and image) that can be associated with the identified facility is created. The related information output processing unit 53 also outputs the created related information (step 106).

[0042] Next, the reaction detection unit 54 detects the reaction of the user corresponding to the output related information (step 108). Specifically, the user's facial expression and the voice uttered by the user are detected. The reaction detection unit 54 also judges whether the user has a pleasant emotion or not based on the detected facial expression and voice of the user (step 110). For example, when the output related information is preferred by the user, the user often shows a satisfied facial expression, and the user's pleasant emotion can be known by observing the movement of the facial muscles. When the output related information is preferred by the user, the user may utter positive words, and the user's pleasant emotion can be known from the uttered words (voice). When it cannot be said that the user has a pleasant emotion, a negative judgment is made in the judgment of step 110. In this case, the process returns to step 100 and the judgment of the output timing of the related information is repeated.

[0043] If the user is considered to have a positive emotion, a positive determination is made in the determination of step 110. Next, the recommendation information creating unit 55 creates recommendation information about the facility corresponding to the related information that is the subject of the user's positive emotion (step 112). Furthermore, the recommendation information proposing unit 56 proposes the created recommendation information to the user by displaying or speaking (step 114). After that, the process returns to step 100 and the determination of the output timing of the related information is repeated.

[0044] In this way, the in-vehicle device of this embodiment detects the user's reaction when facility-related information is output and creates recommended facility information, so that the user can create and propose recommended facility information to the user without having to perform complicated operations.

[0045] In particular, by using scents, sounds, and images that are reminiscent of the facility, it is possible to predict how the user will feel about the facility based on the user's reaction at that time, making it possible to provide recommended information about facilities that the user desires.

[0046] Furthermore, by capturing an image of the user's facial expression with the camera 100, it is possible to know how the user feels about the output of related information based on the movement of the facial muscles around the eyes and mouth.

[0047] Furthermore, by collecting the contents (voice) of the user's speech when the related information is output by the microphone 5, it is possible to know how the user feels about the output of the related information.

[0048] In addition, by outputting related information when the vehicle position during travel approaches a facility corresponding to the related information by more than a predetermined threshold, it becomes possible to present recommended information about nearby facilities only when the user desires it. Alternatively, by outputting related information when a predetermined time is reached, it becomes possible to present recommended information about facilities that are available for limited time (for example, during lunch or dinner hours) only when the user desires it.

[0049] The present invention is not limited to the above embodiment, and various modifications are possible within the scope of the gist of the present invention. For example, in the above embodiment, two types of user emotions, pleasant and unpleasant, were distinguished as detected by the reaction detection unit 54, but more distinctions may be made. For example, pleasant and unpleasant may be further subdivided as shown below. In addition, when subdivided, it is desirable to provide differences in the content of the recommended information according to the degree of pleasantness.

[0050] +4: Extremely easy (Displays facility icons on the map, notifies you with voice, and prompts you to set your destination) +3: Very convenient (displays facility icon on map and notifies by voice) +2: Expedited (display facility icon on map) +1: Somewhat easier (make it easier to select when searching for facilities, e.g. place it at the top of the search list) 0: Neither pleasant nor unpleasant -1: Somewhat uncomfortable -2: Unpleasant -3: Very uncomfortable -4: Extremely uncomfortable In the above embodiment, one facility is specified as the target for outputting related information (step 102 in FIG. 3), but the related information output processing unit 53 may specify multiple facilities and output multiple pieces of related information corresponding to each facility in sequence at different times, and the recommended information creating unit 55 may create recommended information corresponding to each facility based on the user's reaction detected by the reaction detection unit 54 to each piece of related information. In this case, the recommended information creating unit 55 creates recommended information for the facility corresponding to the related information that gives the user the greatest level of pleasure among the user's reactions detected by the reaction detection unit 54 to each piece of related information. This makes it possible to estimate the facility for which the user most wants recommended information to be created regarding the multiple facilities. Alternatively, the recommended information corresponding to each of the multiple facilities may be output in parallel or in sequence (for example, in descending order of pleasure).

[0051] In addition, in the above-described embodiment, there is no particular limitation on the scent generated by the scent generating device 110. However, for example, the scent specific to a facility collected by a scent sensor when actually using the facility may be digitized, and this data may be used to reproduce the scent specific to the facility as scent related information corresponding to the facility. [Industrial Applicability]

[0052] As described above, according to the present invention, the user's reaction when facility-related information is output is detected and recommended facility information is created, so that the user can create and propose recommended facility information to the user without having to perform complicated operations. [Explanation of symbols]

[0053] 1 Head Unit 4 Speakers 5 Microphone 10 Navigation Processing Section 20 Control section 40 Digital-to-Analog Converter (D / A) 42 Analog-to-Digital Converter (A / D) 50 CPU 50A Facility Proposal Processing Unit 51 Preference Information Collection Department 52 Output timing determination unit 53 Related information output processing section 54 Reaction detection unit 55 Recommendation Information Creation Department 56 Recommendation Information Suggestion Section 100 Cameras 110 Fragrance Generator

Claims

1. related information output means for outputting related information about the facility at a predetermined timing; A reaction detection means for detecting a reaction of a user to the output of the related information; a recommendation information generating means for generating recommendation information about facilities based on the reaction of the user detected by the reaction detecting means; a recommendation information suggestion means for suggesting the recommendation information to a user; wherein the reaction of the user to be detected by the reaction detection means is a pleasant / unpleasant feeling of the user, the related information output means outputs a plurality of pieces of related information at different timings; The facility suggestion device is characterized in that the recommendation information creation means creates recommendation information for facilities corresponding to the related information for which the user has expressed a feeling of pleasure, and creates recommendation information for the facility corresponding to the related information for which the user feels the greatest degree of pleasure among the user's reactions detected by the reaction detection means to each of the multiple related information.

2. 2. The facility suggestion device according to claim 1, wherein the related information is any one or a combination of two or more of a scent, a sound, and a video related to the facility.

3. Further comprising a camera for capturing an image of the user's face, 3. The facility recommendation device according to claim 1, wherein the reaction detection means detects the reaction of the user based on a facial expression of the user captured by the camera.

4. Further comprising a microphone for collecting the voice of the user, 4. The facility recommendation device according to claim 1, wherein the reaction detection means detects the reaction of the user based on a voice emitted by the user collected by the microphone.

5. the related information output means outputs a plurality of pieces of related information at different timings; The facility suggestion device according to any one of claims 1 to 4, characterized in that the recommendation information creation means creates recommended information for facilities based on the user's reaction to each of the plurality of related information detected by the reaction detection means.

6. The facility recommendation device according to any one of claims 1 to 5, characterized in that the specified timing is when the vehicle's position while traveling approaches the facility corresponding to the related information by more than a specified threshold.

7. 7. The facility recommendation device according to claim 1, wherein the predetermined timing is when a predetermined time has arrived.

Images