Information processing method, information processing device, and program

Abstract

Provided is an information processing method capable of executing prescribed effects for a user riding in a vehicle. This information processing method comprises: a detection process for detecting conditions inside and outside the vehicle; a calculation process for calculating, on the basis of the conditions, a degree of smooth progress indicating that the vehicle is progressing smoothly along a travel route of the vehicle; and an effects control process for setting and executing specific effects according to the degree of smooth progress.

Description

Information processing method, information processing device, and program

[0001] The present invention relates to an information processing method, an information processing device, and a program that can execute a predetermined effect for a user riding in a vehicle.

[0002] Conventionally, a technology has been proposed for executing a predetermined effect for a user riding in a vehicle. For example, JP2020-199944A proposes a technology for executing an effect of a vehicle interior space corresponding to information such as vehicle location information and entertainment content implementation information.

[0003] The above-described conventional technology can increase the user's sense of anticipation and improve the entertainment value of the vehicle cabin space by changing the air conditioning mode, the type of fragrance, the amount of light through the photochromic glass, etc., depending on the distance to the destination. However, depending on the conditions inside and outside the vehicle, the distance to the destination may not be linked to the state of mind of the vehicle occupants. For example, if a traffic jam occurs on a road near the destination and the vehicle is unable to move forward, or if the vehicle takes a wrong turn just before the destination and has to take a detour, depending on the presentation, the vehicle occupants may feel uncomfortable. In this case, if a cheerful presentation intended to increase the user's sense of anticipation is implemented as the vehicle approaches the destination, the user's discomfort may be further increased, and the intimacy between the vehicle and the user may be reduced.

[0004] The present invention aims to increase the user's familiarity with the vehicle by providing appropriate in-vehicle effects that correspond to the conditions inside and outside the vehicle, while also suppressing an increase in the effect processing load due to the execution of inappropriate in-vehicle effects.

[0005] One aspect of the present invention is an information processing method capable of executing a predetermined effect for a user riding in a vehicle. This information processing method includes a detection process for detecting conditions inside and outside the vehicle, a calculation process for calculating a smoothness level indicating whether the vehicle is progressing smoothly along its travel route based on the conditions, and a performance control process for setting and executing a performance content according to the smoothness level.

[0006] FIG. 1 is a diagram showing an example of the configuration of the interior of a vehicle. FIG. 2 is a block diagram showing an example of the system configuration of an information processing system. FIG. 3 is a diagram showing an example of the configuration of a device performance DB. FIG. 4 is a diagram showing an example of transitions between grassland images displayed on a display unit. FIG. 5 is a diagram showing an example of transitions between sandy beach images displayed on a display unit. FIG. 6 is a diagram showing an example of performance control processing. FIG. 7 is a diagram showing an example of performance control processing based on the conditions inside and outside the vehicle. FIG. 8 is a diagram showing an example of calculation processing of a smoothness degree based on the conditions outside the vehicle. FIG. 9 is a diagram showing an example of calculation processing of a smoothness degree based on navigation information. FIG. 10 is a diagram showing an example of calculation processing of a smoothness degree based on driving operation information. FIG. 11 is a diagram showing an example of calculation processing of a smoothness degree based on vehicle status information. FIG. 12 is a diagram showing an example of calculation processing of a smoothness degree based on user status information. FIG. 13 is a diagram showing a modified example of performance control processing.

[0007] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0008] [Example of installation of display unit] Fig. 1 is a simplified diagram showing an example of the configuration of the interior of a vehicle C1. Fig. 1 shows the interior of the vehicle C1 in front of the driver's seat and passenger seat (not shown) as viewed from the rear in the longitudinal direction of the vehicle C1. To facilitate explanation, Fig. 1 omits illustrations of components other than a dashboard 2, a steering wheel 3, a front window 4, a rearview mirror 5, side windows 6 and 7, and an output device 200.

[0009] The output device 200 is an output device installed inside the vehicle C1, and executes various output operations based on instructions from the information processing device 110 (see FIG. 2). The output device 200 is an device installed on the dashboard 2, and includes a display unit 210, a sound output unit 220, and a reception unit 230 (see FIG. 2). In FIG. 1, a display device that is long in the left-right direction of the vehicle C1 is shown as an example of the output device 200.

[0010] For example, the output device 200 is an in-vehicle system including one or more devices capable of providing various types of information. For example, the output device 200 may be at least one of a navigation device, an audio device, a DVD device, a TV tuner device, an IVI (In-Vehicle Infotainment), etc. The image displayed on the output device 200 may be a HUD (Head Up Display) implemented on the windshield 4 or another display device. Alternatively, an information processing device such as a portable device that the driver D1 can carry (or a device that can be installed in the vehicle C1), for example, a smartphone, a tablet terminal, or a portable personal computer, may be used.

[0011] The output device 200 also performs an output operation of each piece of information to be provided to a user (including the driver) riding in the vehicle C1. For example, the display unit 210 of the output device 200 can display map information based on a navigation function. This map information can display, for example, a current location indicator indicating the current location of the vehicle C1. Although not shown, route information (e.g., arrows colored blue, red, etc.) indicating the travel route of the vehicle C1 may be displayed on the map, and information about various features (e.g., buildings, landmarks) may be displayed on the map. Although not shown, map information with a different viewpoint may also be displayed as appropriate.

[0012] Furthermore, various images corresponding to the destination set using the navigation function are displayed on the display unit 210 of the output device 200. Display examples of these various images will be described in detail with reference to FIGS.

[0013] Here, various effects may be executed according to a destination set using the navigation function. For example, an image corresponding to the destination may be displayed on the display unit 210 of the output device 200, a scent corresponding to the destination may be output from a scent emitting device, or music corresponding to the destination may be output from an audio device. Furthermore, various effects may be executed according to the distance to the destination. For example, an effect that heightens the user's sense of anticipation (e.g., an exciting effect) may be executed as the distance to the destination decreases. For example, the image displayed on the display unit 210 of the output device 200 may be brightened, a strong or exciting scent may be output from a scent emitting device, cheerful music (e.g., cheerful background music) may be output from an audio device, or the amount of light entering from outside the vehicle C1 may be adjusted to a brighter level.

[0014] However, depending on the conditions inside and outside the vehicle C1, the distance to the destination may not be related to the state of mind of the occupants of the vehicle C1. For example, if a situation occurs in which a heavy traffic jam occurs on a road near the destination and the vehicle cannot proceed, or if the vehicle takes a wrong turn just before the destination and has to take a detour, depending on the presentation, the occupants of the vehicle C1 may feel uncomfortable. In this case, if a cheerful presentation is implemented to heighten the user's sense of anticipation as the vehicle approaches the destination, this may further increase the user's discomfort and reduce the intimacy between the vehicle and the user. It is also possible that the user may not feel like they are driving together with the vehicle C1.

[0015] Therefore, in this embodiment, an appropriate in-vehicle effect is performed according to the inside and outside conditions of the vehicle C1, thereby increasing the user's familiarity with the vehicle C1. This reduces unnecessary user operations, such as stopping inappropriate in-vehicle effects or changing to other in-vehicle effects, and reduces the processing load related to in-vehicle effect control. In other words, it is possible to suppress an increase in the processing load due to the execution of inappropriate in-vehicle effects.

[0016] [Configuration Example of Information Processing System] FIG. 2 is a block diagram showing an example of the system configuration of the information processing system 100 installed in the vehicle C1.

[0017] The information processing system 100 includes a sound acquisition unit 101, an interior image acquisition unit 102, an exterior image acquisition unit 103, sensors 104, an information processing device 110, an output device 200, and performance devices 300. The information processing device 110 is an example of a device capable of executing a predetermined performance for a user riding in a vehicle C1. The output device 200 and the performance devices 300 are examples of performance devices capable of executing a predetermined performance for a user.

[0018] The information processing device 110, the output device 200, and the performance devices 300 are connected by a communication method using wired communication or wireless communication. The information processing device 110 is also connected to the network 20 by a communication method using wireless communication. The network 20 is a network such as a public line network or the Internet. The output device 200 and the performance devices 300 may also be connected to the network 20 by a communication method using wireless communication. Although FIG. 3 shows an example in which the information processing device 110, the output device 200, and the performance devices 300 are configured as separate entities, at least two of the information processing device 110, the output device 200, and the performance devices 300 may also be configured as an integrated device.

[0019] The sound acquisition unit 101 is provided inside the vehicle C1, acquires sounds inside the vehicle C1, and outputs sound information related to the acquired sounds to the information processing device 110. As the sound acquisition unit 101, for example, one or more microphones or sound acquisition sensors can be used.

[0020] The interior image acquisition unit 102 captures an image of a subject inside the vehicle C1 to generate an image (image data), and outputs image information related to the generated image to the information processing device 110. The interior image acquisition unit 102 is provided inside the vehicle C1 (e.g., on the ceiling), and captures an image of a subject inside the vehicle C1 to generate an image (image data). For example, one interior image acquisition unit 102 may be provided in the front of the vehicle C1 to capture an image of a subject from the front to generate an image (image data), and another interior image acquisition unit 102 may be provided in the rear of the vehicle C1 to capture an image of a subject from the rear to generate an image (image data).

[0021] The vehicle exterior image acquisition unit 103 captures images of subjects outside the vehicle C1 to generate images (image data), and outputs image information related to the generated images to the information processing device 110. Two or more vehicle exterior image acquisition units 103 may be provided, and all or some of the images from these vehicle exterior image acquisition units 103 may be used. For example, one vehicle exterior image acquisition unit 103 may be provided in front of the vehicle C1 to capture images of subjects in front of the vehicle C1 to generate images (image data), and another vehicle exterior image acquisition unit 103 may be provided behind the vehicle C1 to capture images of subjects behind the vehicle C1 to generate images (image data). Furthermore, one or more devices capable of capturing images of subjects in all directions from the vehicle C1 and subjects inside the vehicle C1, such as a 360-degree camera, may be used. The interior image acquisition unit 102 and the exterior image acquisition unit 103 may be the same device or different devices.

[0022] The vehicle interior image acquisition unit 102 and the vehicle exterior image acquisition unit 103 are each configured with, for example, an image sensor that receives light from a subject collected by a lens and an image processing unit that performs predetermined image processing on image data generated by the image sensor. The image sensor may be, for example, a charge coupled device (CCD) type or a complementary metal oxide semiconductor (CMOS) type image sensor.

[0023] The sensors 104 are various sensors installed in the vehicle C1, and output detection information acquired by each sensor to the information processing device 110. Examples of the sensors include a LiDAR (Light Detection and Ranging), a RADAR (Radio Detection and Ranging), sonar, a vehicle speed sensor, an acceleration sensor, a steering sensor (steering force angle meter), an accelerator position sensor, a position information acquisition sensor (position information acquisition unit), an illuminance sensor, a temperature sensor, a non-contact temperature sensor, a human presence sensor, a vehicle width sensor, a rear distance sensor, and a biological sensor (e.g., a CO2 sensor or a drowsiness detection sensor). Known sensors can be used for each of these sensors. The LiDAR, RADAR, sonar, human presence sensor, vehicle width sensor, and rear distance sensor are examples of sensors that detect the surrounding conditions of the vehicle C1. Furthermore, the vehicle speed sensor, acceleration sensor, steering sensor, accelerator position sensor, etc. are examples of sensors that detect the driving operation status of the driver. However, these are only examples, and other sensors may be used. Furthermore, only some of these sensors may be used.

[0024] The location information acquisition unit acquires location information regarding the location of the vehicle C1. For example, the location information acquisition unit can be realized by a GNSS (Global Navigation Satellite System) receiver that acquires location information using the GNSS. The location information includes data regarding the location, such as latitude, longitude, and altitude, at the time of receiving the GNSS signal. The location information may also be acquired by other location information acquisition methods. For example, the location information may be derived using information from nearby access points or base stations. The location information may also be acquired using a beacon.

[0025] The CO2 sensor is a sensor capable of detecting the concentration of carbon dioxide inside the vehicle C1. The drowsiness detection sensor is a sensor capable of detecting whether the driver is drowsy. The human presence sensor is a sensor capable of detecting the number of people present around the vehicle C1. The vehicle width sensor is a sensor capable of detecting the width of the road on which the vehicle C1 is traveling. The rear distance sensor is a sensor capable of detecting the distance to another vehicle present behind the vehicle C1.

[0026] The information processing device 110 includes a control unit 120, a storage unit 130, and a communication unit 140. The communication unit 140 exchanges various types of information with other devices using wired or wireless communication under the control of the control unit 120. For example, when the communication unit 140 receives driving assistance information, various types of performance information, and the like from an external device (e.g., a server), the communication unit 140 outputs the information to the control unit 120.

[0027] The control unit 120 controls each unit based on various programs stored in the storage unit 130. The control unit 120 is realized by a processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). Note that the vehicle ECU (Electronic Control Unit) of the vehicle C1 may also be used as the control unit 120, or a processing device different from the vehicle ECU may be provided as the control unit 120.

[0028] The control unit 120 executes various controls based on the information output from the sound acquisition unit 101, the vehicle interior image acquisition unit 102, the vehicle exterior image acquisition unit 103, the sensors 104, the communication unit 140, etc., and the information acquired by the vehicle information acquisition unit 121. For example, the control unit 120 executes control processing to control the operating states of the output devices 200 and the performance devices 300. Specifically, the control unit 120 includes a vehicle information acquisition unit 121, a detection unit 122, a calculation unit 123, a performance control unit 124, and a destination setting unit 125.

[0029] Furthermore, the control unit 120 acquires speech information related to the speech of each user (including the user) included in the sound information by executing a predetermined sound analysis process on the sound information output from the sound acquisition unit 101. This sound analysis process can be performed using a known sound analysis process.

[0030] The control unit 120 also performs a predetermined image analysis process on the image information (interior image) output from the interior image acquisition unit 102 to acquire various pieces of information about the interior of the vehicle C1 contained in the image information. This image analysis process can be performed using known image analysis processes. As various pieces of user information, for example, each user's behavior, such as facial expressions, gaze, hand, face, and body movements, can be acquired. This makes it possible to detect, for example, whether each user gets on or off the vehicle C1, whether each seat in the vehicle C1 is occupied, the hand movements of each user, the gaze direction of each user, and the facial expressions of each user. That is, based on the interior image, user situation information about the situation of each user and interior situation information about the situation inside the vehicle C1 are acquired.

[0031] The control unit 120 also performs a predetermined image analysis process on the image information (exterior image) output from the exterior image acquisition unit 103 to acquire various pieces of information about the outside of the vehicle C1 contained in the image information. This image analysis process can be performed using known image analysis processes. Examples of the various pieces of information about the outside of the vehicle C1 include the type and width of the road on which the vehicle C1 is traveling, traffic signals and signs ahead of the vehicle C1, and the presence or absence of objects (vehicles, people) around the vehicle C1. That is, exterior situation information about the situation outside the vehicle C1 is acquired based on the exterior image.

[0032] The vehicle information acquisition unit 121 acquires information (vehicle state information) relating to various vehicle states of the vehicle C1 and outputs the acquired vehicle state information to the detection unit 122. The vehicle state information can be acquired, for example, from a CAN (Controller Area Network) signal. The vehicle state information includes, for example, vehicle speed, acceleration, shift lever position (e.g., P range, D range), accelerator pedal depression amount, brake pedal depression amount, and position information. For example, it is possible to determine whether the vehicle C1 is stopped, running, moving forward, or reverse based on the vehicle speed, acceleration, shift lever position, etc.

[0033] The detection unit 122 detects the conditions inside and outside the vehicle C1 based on the information output from the sound acquisition unit 101, the vehicle interior image acquisition unit 102, the vehicle exterior image acquisition unit 103, the sensors 104, the vehicle information acquisition unit 121, the communication unit 140, etc. Then, the detection unit 122 outputs the detected contents to the calculation unit 123.

[0034] For example, the detection unit 122 detects that a specific event has occurred outside the vehicle C1 based on the vehicle exterior image acquired by the vehicle exterior image acquisition unit 103. The specific event may be, for example, a traffic jam around the vehicle C1, the number of times the vehicle stops at a traffic light, etc. The method for detecting the specific event will be described in detail with reference to FIGS.

[0035] The calculation unit 123 calculates a smoothness degree indicating whether the vehicle C1 is proceeding smoothly along the travel route of the vehicle C1 based on the conditions inside and outside the vehicle C1 detected by the detection unit 122. The calculation unit 123 then outputs the calculated smoothness degree to the performance control unit 124. Specifically, the smoothness degree is information used to determine whether the vehicle C1 is proceeding smoothly or unsmoothly along the travel route of the vehicle C1. For example, when a specific event is detected by the detection unit 122, the calculation unit 123 calculates a smoothness degree in accordance with the detected specific event. For example, when a specific event is detected, the calculation unit 123 turns on a flag corresponding to the specific event (see FIG. 3 ) and calculates a value indicating unsmoothness as the smoothness degree. In other words, when at least one specific event is detected, a value indicating unsmoothness is calculated as the smoothness degree. Note that a value indicating unsmoothness may be calculated as the smoothness degree on the condition that two or more specific events are detected. Alternatively, for example, the number of detected specific events may be used as a value indicating the degree of smoothness, and a condition for determining that the system is running poorly may be that this value exceeds a threshold value (e.g., a value equal to or greater than two). Alternatively, for example, a weight may be set according to each specific event, and the sum of the weights according to the detected specific events may be used as a value indicating the degree of smoothness, and a condition for determining that the system is running poorly may be that this value exceeds a threshold value. Note that these threshold values ​​may be set appropriately based on experiments, simulations, or the like. This method for calculating the degree of smoothness will be described in detail with reference to FIGS. 8 to 12.

[0036] The performance control unit 124 controls the operating states of the output device 200 and the performance devices 300 based on the destination of the vehicle C1 set by the destination setting unit 125, the smoothness calculated by the calculation unit 123, and the like. For example, when the destination of the vehicle C1 is set by the destination setting unit 125, the performance control unit 124 sets and executes the content of the performance of the output device 200 and the performance devices 300 according to the destination. Also, for example, the performance control unit 124 sets and executes the content of the performance of the output device 200 and the performance devices 300 according to the smoothness calculated by the calculation unit 123. For example, when it is determined that the vehicle C1 is proceeding smoothly, a comfort performance is executed to make the user feel comfortable. On the other hand, when it is determined that the vehicle C1 is proceeding unsmoothly, a sympathetic performance is executed to make the user empathize with the fact that the vehicle C1 is not proceeding smoothly. Each of these performance examples will be described in detail with reference to Figures 3 to 13, etc.

[0037] The destination setting unit 125 is configured to realize a known navigation function and outputs various navigation information to the performance control unit 124. For example, the destination setting unit 125 sets a destination for the vehicle C1 and a travel route to the destination based on a user operation received by the reception unit 230, and outputs the set destination and travel route to the performance control unit 124. In this case, for example, the destination setting unit 125 acquires destination information related to the destination specified by the user using map information displayed on the display unit 210. The destination setting unit 125 then sets a destination corresponding to the acquired destination information and sets a travel route from the current location of the vehicle C1 to the destination based on the current location of the vehicle C1 acquired by a location information acquisition unit included in the sensors 104 and the map information stored in the map information DB 131. Note that known setting methods can be used to set the destination and travel route. Furthermore, the destination setting unit 125 outputs navigation information, including current location information related to the current location of the vehicle C1, road information such as roads on which the vehicle C1 is traveling, and surrounding information, to the performance control unit 124 as needed.

[0038] The storage unit 130 is a storage medium that stores various types of information. For example, the storage unit 130 stores various types of information (e.g., a control program, a map information DB 131, and a device performance DB 300 (see FIG. 3)) required for the control unit 120 to perform various processes. The storage unit 130 also stores various types of information acquired via the communication unit 140. The storage unit 130 may be, for example, a read-only memory (ROM), a random access memory (RAM), a static random access memory (SRAM), a hard disk drive (HDD), a solid state drive (SSD), or a combination thereof. The device performance DB 300 will be described in detail with reference to FIG. 3.

[0039] The map information DB 131 stores map information such as road information about roads required for route guidance of the vehicle C1. The map information includes information about the locations of various facilities and places such as parks, beaches, and building parking lots. The map information DB 131 and the device performance DB 300 may be stored in the storage unit 130 of the vehicle C1 or may be obtained from an external device via the network 20.

[0040] The output device 200 is a device that can convey various types of information to a user or the like by displaying various types of images or outputting various types of audio information based on instructions from the information processing device 110 .

[0041] The output device 200 includes a display unit 210, a sound output unit 220, and a reception unit 230. The display unit 210, the sound output unit 220, and the reception unit 230 are controlled based on a control unit (not shown) included in the output device 200.

[0042] The display unit 210 is a monitor that displays various images based on instructions from the information processing device 110. As the display unit 210, for example, a display panel such as an organic EL (Electro Luminescence) panel or an LCD (Liquid Crystal Display) panel can be used.

[0043] The sound output unit 220 outputs various sounds based on instructions from the information processing device 110. As the sound output unit 220, for example, one or more speakers can be used.

[0044] The reception unit 230 receives user input from the user of the vehicle C1 and outputs the received input to the control unit 120. For example, a touch panel or various operation members can be used as the reception unit 230. The display unit 210 and the reception unit 230 may be configured as a touch panel that allows the user to perform operation input by touching or approaching the display surface with their finger, or may be configured as a separate user interface. The display unit 210, the sound output unit 220, and the reception unit 230 are examples of user interfaces, and some of them may be omitted, or other user interfaces may be used.

[0045] For example, by adjusting the setting values ​​(parameters) of the display unit 210, it is possible to set brightness, luminance, color contrast, saturation, etc. Here, brightness is an index representing the degree of color brightness. For example, the higher the brightness, the brighter the user perceives the image. Therefore, by adjusting the brightness, it is possible to improve the brightness and visibility of the display unit 210. Furthermore, for example, it is possible to set the content to be displayed on the display unit 210. For example, images depicting natural objects such as grasslands and water ripples can be displayed as this content. Furthermore, it is possible to set the content to be displayed on the display unit 210, such as the movement of objects in the image, the frequency of the movement, the color of the objects, the number of objects, etc. Furthermore, for example, it is possible to set the volume, pitch, tone, etc. of the sound by adjusting the setting values ​​of the sound output unit 220. Note that the setting values ​​may also be referred to as control amounts, adjustment amounts, etc.

[0046] The performance devices 300 are devices capable of executing various performances based on instructions from the information processing device 110, and are, for example, light-emitting devices, light-control glass, fragrance-emitting devices, etc. For example, by adjusting the setting values ​​of each performance device, it is possible to execute a desired performance using each performance device.

[0047] The light-emitting device is, for example, an LED (Light Emitting Diode) lamp, and by adjusting the setting values, it is possible to set the brightness, color (e.g., R, G, B), blinking interval, lighting width, and movement speed in the up, down, left, and right directions. For example, in the case of an LED lamp that is long in one direction, it is possible to set the position, length, and color of the light-emitting part in that direction. For example, it is possible to move the light-emitting part in that direction, move the blinking position, or change the color of the light-emitting part. For example, to create a bright and cheerful effect, it is possible to increase the yellow color or make it blink faster.

[0048] The light-controlling glass is glass whose light-blocking state can be changed by applying a voltage, for example. For example, by adjusting a setting value, the amount of light transmitted and the color of the transmitted light (e.g., R (Red), G (Green), B (Blue)) can be set. For example, the windows of the vehicle C1 (e.g., windows including the side windows 6 and 7) can be made into light-controlling glass.

[0049] A fragrance emitting device is a device that can emit a specific fragrance, and by adjusting the settings, it is possible to set the type of fragrance, the fragrance emission concentration, the fragrance emission frequency, etc. For example, by adjusting the settings, it is possible to change from continuous fragrance emission to discrete fragrance emission through pulse emission.

[0050] For example, if it is determined that the vehicle C1 is moving smoothly, a comfort effect is executed to make the user feel comfortable. On the other hand, if it is determined that the vehicle C1 is not moving smoothly, a sympathy effect is executed to make the user sympathize with the fact that the vehicle C1 is not moving smoothly, depending on the degree of smoothness. Note that a method for setting the setting values ​​of these effect devices will be described in detail with reference to FIG. 3.

[0051] [Configuration Example of Device Performance DB] FIG. 3 is a diagram showing a simplified configuration example of the device performance DB 150 stored in the storage unit 130. As shown in FIG.

[0052] The device performance DB 150 is a database that manages the setting values ​​used when performing various performances using each performance device installed in the vehicle C1.

[0053] Specifically, the device rendering DB 150 stores values ​​for setting each setting value of the rendering device 151 to be set. For example, each setting value of the rendering device 151 to be set is set based on at least one of the vehicle external situation 152, navigation information 153, driving operation information 154, vehicle situation information 155, and user situation information 156.

[0054] For example, if a specific event occurs on the travel route to the destination, a flag corresponding to the specific event is turned on. For example, if the detection unit 122 detects that a traffic jam has occurred ahead on the road on which the vehicle C1 is traveling, the traffic jam flag 161 is turned on. In this case, values ​​obtained by subtracting each value corresponding to the traffic jam flag 161 from a reference value are set as the set values. For example, a set value obtained by subtracting 30% from the reference value is set for each of the brightness of the light-emitting device, the transmittance of the light-control glass, the brightness of the display unit 210, and the luminance of the display unit 210. Similarly, for the other flags (traffic light flag on 162, ..., awakening flag on 170), values ​​obtained by subtracting each value corresponding to each flag from a reference value are set as the set values.

[0055] It is also assumed that multiple specific events occur along the travel route to the destination. In this case, flags corresponding to the multiple specific events are turned on. For example, if a traffic jam is detected ahead on the road on which the vehicle C1 is traveling and the number of times the vehicle C1 stops at traffic lights is equal to or greater than a threshold, the traffic jam flag 161 and the traffic light flag ON 162 are turned on. In this case, values ​​corresponding to the traffic jam flag 161 and the traffic light flag ON 162 are added together for each type of performance device to determine an added value, and the added value is subtracted from a reference value to set the set value. For example, an added value of 50% (30% + 20%) is calculated for each of the brightness of the light-emitting device, the transmittance of the light-control glass, the brightness of the display unit 210, and the luminance of the display unit 210. Then, the set value is set by subtracting the added value (50%) from the reference value. Here, if multiple specific events are detected, it is assumed that the added value may exceed 100%. In this case, the upper limit of the added value is set to 100%. 3, the closer the reference value is to 0 (i.e., the closer the added value is to 100%), the stronger the degree of empathy that the user feels for the fact that the vehicle C1 is not progressing smoothly. In other words, the stronger the degree of a dark impression that gives the impression of discomfort.

[0056] The setting value of each effect device set in this way will be referred to as effect coefficient A. Specifically, effect coefficient A = (additional value of light emitting device (brightness) 171, additional value of light control glass (transmittance) 172, additional value of display unit (brightness) 173, additional value of display unit (luminance) 174, ...). Note that when one specific event is detected, a value corresponding to that specific event (on flag) is stored instead of the additional value.

[0057] In this way, the setting value of each device can be set according to the degree of smoothness. The closer the reference value of each device is to 0, the stronger the degree of empathy effect can be. The method for detecting a specific event will be described in detail with reference to Figures 8 to 12.

[0058] 4 and 5 are diagrams showing transition examples of images displayed on the display unit 210 of the output device 200. 4 and 5 show transition examples when an image corresponding to a destination set by the destination setting unit 125 is displayed on the display unit 210.

[0059] 4A shows an example of an initial image 181 displayed on the display unit 210 when a park is set as the destination by the destination setting unit 125. In this way, when a park is set as the destination, the initial image 181 showing a wide grassland that evokes the image of a park is displayed on the display unit 210. Furthermore, when a park is set as the destination, the sound output unit 220 may output the sound of a pleasant breeze that evokes the image of a park. Furthermore, it is possible to set the color emitted by the light-emitting device to green, which evokes the image of a forest, the scent emitted from the scent emitting device to a forest scent, and the light-control glass to green. Similarly, for other performance devices, initial settings related to the park are set, and various performances are executed.

[0060] FIG. 4B shows an example of a smooth progress effect image 182 displayed on the display unit 210 when it is determined that the vehicle C1 is traveling smoothly along the route to the destination. When the vehicle C1 is traveling smoothly along the route to the destination, the user driving the vehicle C1 is considered to be highly comfortable. Therefore, the smooth progress effect image 182, which depicts flowers blooming in abundance in the grassland of the initial image 181 and a rainbow over the grass, creating a pleasant impression, is displayed on the display unit 210. In this case, the saturation of the display unit 210 can be set high to create a bright effect. Alternatively, pleasant music or the like that evokes a sense of comfort may be output from the sound output unit 220. Other effect devices will be described in detail with reference to FIGS. 6 to 13 .

[0061] FIG. 4C shows an example of a non-smooth performance image 183 displayed on the display unit 210 when it is determined that the vehicle C1 is not traveling smoothly along the route to the destination. In this manner, if the vehicle C1 is not traveling smoothly along the route to the destination, the user driving the vehicle C1 is considered to be at a low level of comfort. Therefore, the grassland in the initial image 181 changes to a desert, and the non-smooth performance image 183, in which the desert sky gives a dark impression, is displayed on the display unit 210. In this case, the saturation of the display unit 210 can be set low to produce a dark performance. Alternatively, a dark sound that evokes discomfort may be output from the sound output unit 220. Other performance devices will be described in detail with reference to FIGS. 6 to 13 .

[0062] 5A shows an example of an initial image 185 displayed on the display unit 210 when a swimming beach is set as the destination by the destination setting unit 125. Thus, when a swimming beach is set as the destination, an initial image 185 showing a wide sandy beach reminiscent of a swimming beach is displayed on the display unit 210. Furthermore, when a swimming beach is set as the destination, the sound output unit 220 may output a soothing sound of water (sandy beach sound) that evokes the image of a sandy beach. It is also possible to set the light-emitting device to emit a blue light that evokes the image of the ocean, the scent emitted from the fragrance emitting device to the scent of a sandy beach, and the dimming glass to blue. Similarly, the initial settings associated with a swimming beach are set for the other performance devices, and various performances are executed.

[0063] FIG. 5B shows an example of a smooth progress effect image 186 displayed on the display unit 210 when it is determined that the vehicle C1 is traveling smoothly along the route to the destination. In this manner, when the vehicle C1 is traveling smoothly along the route to the destination, the user driving the vehicle C1 is considered to be highly comfortable. Therefore, the smooth progress effect image 186, which gives a comfortable impression of birds flying over the sandy beach in the initial image 185, is displayed on the display unit 210. In this case, the saturation of the display unit 210 can be set high to produce a bright effect. Alternatively, pleasant music or the like that evokes a sense of comfort may be output from the sound output unit 220. Other effect devices will be described in detail with reference to FIGS. 6 to 13.

[0064] FIG. 5C shows an example of a mishap effect image 187 displayed on the display unit 210 when it is determined that the vehicle C1 is not traveling smoothly along the route to the destination. In this manner, if the vehicle C1 is not traveling smoothly along the route to the destination, the user driving the vehicle C1 is considered to be at a low level of comfort. Therefore, the display unit 210 displays the mishap effect image 187, in which the sandy beach in the initial image 185 is darkened by clouds, giving the impression that it is about to rain on the beach. In this case, the saturation of the display unit 210 can be set low to produce a dark effect. Alternatively, a dark sound that evokes discomfort may be output from the sound output unit 220. Other effect devices will be described in detail with reference to FIGS. 6 to 13 .

[0065] Also, for example, if the destination setting unit 125 sets a building parking lot as the destination, it is possible to display on the display unit 210 an initial image showing a grassland that evokes the image of buildings and the buildings towering in the background.

[0066] Here, for example, before driving of the vehicle C1 is started and before a destination is set by the user, it is conceivable that only the minimum necessary information (e.g., meters) is displayed on the display unit 210. Then, when a destination is set by the user, an initial image corresponding to the destination can be displayed on the display unit 210. In this way, by displaying an initial image corresponding to the destination at the timing when the user sets the destination, it is possible to heighten the user's anticipation. Furthermore, after the initial image is displayed, it is possible to constantly display the initial image (or an image changed depending on the smoothness of the driving) as a background image for information necessary for driving, etc. (e.g., meters). Note that when the initial image (or an image changed depending on the smoothness of the driving) is displayed on the display unit 210, the information necessary for driving, etc. (e.g., meters), etc. may be displayed as a HUD on the windshield 4.

[0067] [Example of operation of information processing system] Figure 6 is a flowchart showing an example of performance control processing in the information processing system 100. This performance control processing is executed by the control unit 120 (see Figure 2) based on a program stored in the storage unit 130 (see Figure 2). Similarly, each of the processes shown in Figures 7 to 13 is executed by the control unit 120 based on a program stored in the storage unit 130. This performance control processing is executed at a predetermined timing after the start key of the vehicle C1 is turned on. This performance control processing will be explained with appropriate reference to Figures 1 to 5.

[0068] In step S501, the performance control unit 124 determines whether or not a destination for the vehicle C1 has been set by the user based on information from the destination setting unit 125. If a destination has been set, the process proceeds to step S502. On the other hand, if a destination has not been set, the process proceeds to step S503.

[0069] In step S502, the performance control unit 124 determines a default performance according to the destination set by the user and executes the default performance. For example, the performance control unit 124 initializes the performance coefficient A and sets each value of the performance coefficient A to 0. Furthermore, for example, if a park is set as the destination, the performance control unit 124 determines to display the initial image 181 (see FIG. 4) on the display unit 210. Furthermore, for example, if a beach is set as the destination, the performance control unit 124 determines to display the initial image 185 (see FIG. 5) on the display unit 210. In this way, it is possible to determine a default performance according to the set destination.

[0070] In step S503, the performance control unit 124 determines the initial setting performance based on predetermined conditions and executes the initial setting performance. For example, it is possible to determine whether the vehicle C1 satisfies predetermined conditions based on the movement history information of the vehicle C1, and if the predetermined conditions are satisfied, to determine the initial setting performance based on the predetermined conditions. Here, the predetermined condition is, for example, departing from a location corresponding to the movement history information of the vehicle C1 during a time period corresponding to the movement history information of the vehicle C1. Note that the movement history information of the vehicle C1 can be stored in the storage unit 130.

[0071] For example, assume that a user uses vehicle C1 to commute to work in the morning and evening on weekdays. In this case, the travel route of vehicle C1 traveling from home to work in the morning on a weekday and the travel route of vehicle C1 traveling from work to home in the evening on a weekday are associated with time information and stored in the travel history information of vehicle C1. Therefore, if it is detected that the user gets into vehicle C1 parked at home on a weekday morning and turns on the start key to start vehicle C1, it can be determined based on the travel history information of vehicle C1 that the destination of vehicle C1 is the workplace. In this case, for example, the performance control unit 124 determines to display an initial image related to the workplace on the display unit 210. In this case, the performance control unit 124 initializes the performance coefficient A to set each value of the performance coefficient A to 0.

[0072] In step S504, the performance control unit 124 executes a performance control process to set the in-vehicle performance based on the conditions inside and outside the vehicle C1. Specifically, the performance control unit 124 executes the performance control process based on the smoothness calculated by the calculation unit 123. In other words, the performance control unit 124 can appropriately change the in-vehicle equipment depending on the smoothness of the road conditions and other factors on the way to the destination. This performance control process will be described in detail with reference to Figures 7 to 12.

[0073] [Example of Operation of Performance Control Processing] Fig. 7 is a flowchart showing an example of performance control processing in the information processing system 100. This performance control processing is constantly executed for each control cycle. In addition, this performance control processing will be explained with appropriate reference to Figs. 1 to 6.

[0074] In step S511, the performance control unit 124 determines whether the distance K to the destination is shorter than the threshold value T based on the navigation information from the destination setting unit 125. Here, the threshold value T is a value for setting the timing for executing a smooth performance in response to smooth travel of the vehicle C1 when the vehicle C1 is traveling smoothly on the route to the destination. For example, a value of several kilometers to several tens of kilometers can be set. Note that the threshold value T can be set appropriately based on experiments, simulations, etc. If the distance K is shorter than the threshold value T, the process proceeds to step S512. On the other hand, if the distance K is equal to or greater than the threshold value T, the process proceeds to step S517.

[0075] In step S512, the detection unit 122 detects the conditions inside and outside the vehicle C1 and detects the occurrence of each event inside or outside the vehicle C1. This detection method will be described in detail with reference to FIGS.

[0076] In step S530, the calculation unit 123 executes a smoothness degree calculation process to calculate a smoothness degree indicating that the vehicle C1 is progressing smoothly along the route to the destination, based on the conditions inside and outside the vehicle C1 detected in step S512. This smoothness degree calculation process will be described in detail with reference to FIGS.

[0077] In step S513, the performance control unit 124 determines whether the vehicle C1 is proceeding smoothly along the route to the destination. If it is determined that the vehicle C1 is proceeding smoothly along the route to the destination, the process proceeds to step S515. On the other hand, if it is determined that the vehicle C1 is not proceeding smoothly along the route to the destination, the process proceeds to step S514.

[0078] For example, if a specific event is detected to have occurred inside or outside the vehicle C1, it is determined that the vehicle C1 is not proceeding smoothly along the route to the destination. On the other hand, if no specific event is detected to have occurred inside or outside the vehicle C1, it is determined that the vehicle C1 is proceeding smoothly along the route to the destination. Specifically, if all of the flags (see FIG. 3) are off, it is determined that the vehicle C1 is proceeding smoothly along the route to the destination. On the other hand, if at least one of the flags is on, it is determined that the vehicle C1 is not proceeding smoothly along the route to the destination. The specific event will be described in detail with reference to FIGS. 8 to 12.

[0079] In step S514, the performance control unit 124 sets the setting value of each performance device based on the degree of success calculated in step S530. Specifically, the performance control unit 124 determines the setting value of each performance device using a performance coefficient A and the following formula 1. Setting value = initial setting value - A ... formula 1

[0080] Here, the initial setting value means the initial setting value determined in step S502 or S503 (see FIG. 6). That is, as shown in FIG. 3, the value obtained by subtracting the total value of the values ​​corresponding to the turned-on flags from the initial setting value is used as the setting value of each performance device.

[0081] In step S515, the performance control unit 124 sets the setting value of each performance device based on the distance K to the destination. Specifically, the performance control unit 124 determines the setting value of each performance device using the distance K, the threshold T, and the following formula 2: Setting value = old setting value + (T - K) x (Bimax - Bi) / T ... formula 2

[0082] Here, Bimax indicates the upper limit of the setting value of each device, Bi indicates the initial setting value of each device according to the destination, and the previous setting value indicates the setting value immediately before on the time axis.

[0083] In step S516, the performance control unit 124 causes each performance device to execute each performance based on the setting values ​​set in step S514 or S515. Specifically, the performance control unit 124 outputs the setting values ​​set in step S514 or S515 to each performance device to cause each performance device to execute each performance.

[0084] For example, if it is determined in step S513 that the vehicle C1 is not proceeding smoothly, a sympathy effect is executed in step S516 to express sympathy for the vehicle C1 not proceeding smoothly. On the other hand, if it is determined in step S513 that the vehicle C1 is proceeding smoothly, a comfort effect is executed in step S516 to make the user feel comfortable.

[0085] Steps S517 to S519 correspond to steps S512, S513, and S530, and therefore detailed description thereof will be omitted here.

[0086] In step S520, the performance control unit 124 sets the setting value of each performance device based on the degree of smoothness calculated in step S518. Specifically, the performance control unit 124 determines the setting value of each performance device using the performance coefficient A and the following formula 3. Note that the old setting value in formula 3 is the same as the old setting value in formula 2. Setting value = old setting value - A ... formula 3

[0087] As shown in steps S511, S517 to S519, if it is determined that the vehicle C1 is proceeding smoothly along the route to the destination, the effects of the various effect devices are not changed until the vehicle C1 approaches the destination. Furthermore, as shown in steps S511, S512, S513, S515, and S530, when the vehicle C1 approaches the destination and is proceeding smoothly along the route to the destination, the effects are set based on the distance K to the destination. For example, it is expected that the shorter the distance K, the higher the user's expectations will be, so it is preferable to execute brighter, more cheerful effects. Therefore, it is possible to control the setting values ​​of the various effect devices to be increased. This makes it possible to convey to the user through brighter, more cheerful effects that the vehicle C1 is proceeding smoothly and approaching the destination.

[0088] On the other hand, if it is determined that the vehicle C1 is not proceeding smoothly on the route to the destination, each effect is set based on the degree of smoothness according to a specific event that occurred inside or outside the vehicle C1, regardless of the distance to the destination K. This makes it possible to inform the user that the vehicle C1 is not proceeding smoothly by using gloomy effects, etc., even when the vehicle C1 appears to be approaching the destination.

[0089] [Example of Operation of Smoothness Degree Calculation Processing] Figure 8 is a flowchart showing an example of the smoothness degree calculation processing in the information processing system 100. This smoothness degree calculation processing is constantly executed for each control cycle. This smoothness degree calculation processing shows an example in which the smoothness degree is calculated based on the situation outside the vehicle C1. This smoothness degree calculation processing will be explained with appropriate reference to Figures 1 to 7.

[0090] In step S531, the detection unit 122 detects the situation outside the vehicle C1 and detects the occurrence of each event outside the vehicle C1.

[0091] In step S532, the detection unit 122 determines whether or not a traffic jam has occurred in the traveling direction of the road on which the vehicle C1 is traveling, based on the situation outside the vehicle C1 detected in step S531. If a traffic jam has been detected in the traveling direction of the road on which the vehicle C1 is traveling, the detection unit 122 outputs a signal to the calculation unit 123 indicating that a traffic jam has been detected, and the process proceeds to step S533. On the other hand, if a traffic jam has not been detected in the traveling direction of the road on which the vehicle C1 is traveling, the process proceeds to step S534.

[0092] For example, the detection unit 122 can detect that congestion has occurred on the road on which the vehicle C1 is traveling, based on the navigation information output from the destination setting unit 125. For example, when the vehicle C1 is traveling on a normal road, if the vehicle speed of the vehicle C1 on the road is less than a predetermined value for a predetermined period of time or more, or if there is no change in the vehicle speed of the vehicle C1, the detection unit 122 can detect that congestion has occurred on the road on which the vehicle C1 is traveling. Furthermore, the destination setting unit 125 acquires and stores traffic information, road information, and the like that can be acquired from an external device (e.g., a traffic information providing server) via the network 20, and the detection unit 122 can acquire each of these pieces of information and detect that congestion has occurred on the road on which the vehicle C1 is traveling.

[0093] Furthermore, for example, the detection unit 122 can detect that a large number of vehicles are parked on the road ahead of the vehicle C1, based on the vehicle exterior image (captured image) acquired by the vehicle exterior image acquisition unit 103. Therefore, when a large number of vehicles are parked side by side on the road ahead of the vehicle C1, the detection unit 122 can detect that a traffic jam has occurred ahead of the vehicle C1.

[0094] In step S533, the calculation unit 123 turns on the congestion flag.

[0095] In step S534, the detection unit 122 determines whether the number of times the vehicle C1 stops at traffic lights on the route to the destination is equal to or greater than a threshold, based on the external conditions of the vehicle C1 detected in step S531. If it is detected that the number of times the vehicle C1 stops at traffic lights on the route to the destination is equal to or greater than the threshold, the detection unit 122 outputs this information to the calculation unit 123 and proceeds to step S535. On the other hand, if the number of times the vehicle C1 stops at traffic lights on the route to the destination is less than the threshold, the process proceeds to step S536. The threshold value shown here can be set to, for example, about half the number of traffic lights on the route from the departure point of the vehicle C1 to the destination. Note that the threshold value shown here is an example, and other values ​​may be set depending on the user, road conditions, etc.

[0096] For example, the detection unit 122 can acquire the number of traffic lights present on the travel route from the departure point of the vehicle C1 to the destination based on the navigation information output from the destination setting unit 125. The detection unit 122 can also acquire the relationship between the current location of the vehicle C1 acquired by the location information acquisition unit and the locations of traffic lights present on the travel route. The detection unit 122 can also detect the traffic light ahead of the vehicle C1 and the color of the traffic light based on the exterior image acquired by the exterior image acquisition unit 103. Therefore, when the traffic light ahead of the vehicle C1 is red and the vehicle C1 is stopped in front of the traffic light, the detection unit 122 can detect that the vehicle C1 has stopped in front of the traffic light.

[0097] In step S535, the calculation unit 123 turns on the traffic light flag.

[0098] In step S536, the detection unit 122 determines whether the slow-down time on the predetermined road has continued for a predetermined time or longer, based on the external conditions of the vehicle C1 detected in step S531. If it is detected that the slow-down time on the predetermined road has continued for a predetermined time or longer, the detection unit 122 outputs this information to the calculation unit 123, and the process proceeds to step S537. On the other hand, if there is no slow-down time on the predetermined road, or if there is a slow-down time on the predetermined road but the slow-down time is shorter than the predetermined time, the process proceeds to step S538. The predetermined time shown here can be set, for example, based on an estimated travel time from the departure point of the vehicle C1 to the destination. For example, a value of approximately (1 / 5 to 1 / 20) of the estimated travel time can be set. Note that the predetermined time shown here is merely an example, and other values ​​may be set depending on the user, road conditions, etc.

[0099] Here, the predetermined road refers to, for example, a narrow road, a parking lot, a road in a residential area with many pedestrians, etc. For example, the detection unit 122 can detect the width of the road on which the vehicle C1 is traveling, the parking lot, the road in the residential area, the number of pedestrians, etc., based on an exterior image acquired by the exterior image acquisition unit 103 (e.g., an around view monitor). Furthermore, for example, the detection unit 122 can detect the number of people around the vehicle C1 based on a human presence sensor included in the sensors 104. Furthermore, for example, the detection unit 122 can detect the width of the road on which the vehicle C1 is traveling based on a vehicle width sensor included in the sensors 104. Furthermore, for example, the detection unit 122 can grasp the road from the departure point to the destination of the vehicle C1 based on navigation information output from the destination setting unit 125. Furthermore, for example, the detection unit 122 can detect the road on which the vehicle C1 is traveling based on the current location of the vehicle C1 acquired by the position information acquisition unit.

[0100] Furthermore, for example, the detection unit 122 can detect the vehicle speed of the vehicle C1 based on a vehicle speed sensor. Therefore, when the vehicle C1 is traveling on a predetermined road and the vehicle speed on that road is equal to or less than a predetermined value (e.g., 10 km / h), the detection unit 122 can detect that the vehicle C1 is traveling slowly on the predetermined road. Furthermore, the detection unit 122 can measure the time of the slow-down travel and determine whether the time of the slow-down travel on the predetermined road has continued for a predetermined period of time or more.

[0101] In step S537, the calculation unit 123 turns on the slow-moving flag.

[0102] In step S538, the detection unit 122 determines whether the vehicle C1 has been tailgated by another vehicle based on the external conditions of the vehicle C1 detected in step S531. That is, if the other vehicle closes the distance between the vehicle C1 and the vehicle C1, or if the other vehicle threatens or provokes the vehicle C1, and the vehicle C1's travel is obstructed by the other vehicle, it can be determined that the vehicle C1 has been tailgated by the other vehicle. If it is detected that the vehicle C1 has been tailgated by the other vehicle, the detection unit 122 outputs this information to the calculation unit 123, and the process proceeds to step S539. On the other hand, if the vehicle C1 has not been tailgated by the other vehicle, the process proceeds to step S540.

[0103] For example, the detection unit 122 can detect other vehicles present around the vehicle C1 based on the exterior image acquired by the exterior image acquisition unit 103. Therefore, the detection unit 122 can detect that the travel of the vehicle C1 is being obstructed by other vehicles present around the vehicle C1, such as when the other vehicles close the distance between the vehicle C1 and the vehicle C1 or when the other vehicles threaten or provoke the vehicle C1. Furthermore, for example, the detection unit 122 can detect the distance to other vehicles present behind the vehicle C1 based on a rear distance sensor included in the sensors 104. Therefore, the detection unit 122 can detect that the vehicle C1 is being tailgated by other vehicles when the distance between the other vehicles present behind the vehicle C1 and the vehicle C1 remains within a predetermined distance (e.g., several meters) for a predetermined period of time or longer.

[0104] In step S539, the calculation unit 123 turns on the provocation flag.

[0105] In step S540, the detection unit 122 determines whether the vehicle C1 is traveling on a highway and has been yielded to by another vehicle in a merging lane, based on the situation outside the vehicle C1 detected in step S531. If the vehicle C1 is not traveling on a highway, or if it is detected that the vehicle C1 has been yielded to by another vehicle in a merging lane, the process proceeds to step S542. On the other hand, if the vehicle C1 is traveling on a highway and has not been yielded to by another vehicle in a merging lane, the detection unit 122 outputs a signal to that effect to the calculation unit 123, and the process proceeds to step S541.

[0106] For example, the detection unit 122 can detect that the vehicle C1 is traveling on an expressway or in a merging lane of the expressway based on the exterior image acquired by the exterior image acquisition unit 103. Furthermore, for example, the detection unit 122 can detect that the vehicle C1 is traveling on an expressway or in a merging lane of the expressway based on navigation information output from the destination setting unit 125. Therefore, if the vehicle C1 is traveling on an expressway and fails to merge into the merging lane of the expressway within a predetermined time, the detection unit 122 can detect that the vehicle C1 is traveling on the expressway and has not yielded to another vehicle in the merging lane. The predetermined time shown here can be set to, for example, a value of several seconds. Note that the predetermined time shown here is merely an example, and other values ​​may be set depending on the user, road conditions, etc.

[0107] In step S541, the calculation unit 123 turns on the merging lane flag.

[0108] In step S542, the calculation unit 123 calculates the smoothness degree. For example, the calculation unit 123 detects the number of flags that are turned on among the above-mentioned flags, and calculates the number of turned-on flags as the smoothness degree. In this case, if the smoothness degree is 0, it can be determined that the vehicle C1 is proceeding smoothly along the movement route to the destination. On the other hand, if the smoothness degree is 1 or more, it can be determined that the vehicle C1 is proceeding unsmoothly along the movement route to the destination. In addition, the calculation unit 123 calculates the performance coefficient A based on the turned-on flags. Note that the smoothness degree and the performance coefficient A are calculated in the same manner for each of the processes of step S556 shown in FIG. 9, step S564 shown in FIG. 10, step S574 shown in FIG. 11, and step S584 shown in FIG. 12.

[0109] [Example of Calculation Process of Smoothness Degree Based on Navigation Information] Figure 9 is a flowchart showing an example of calculation process of the smoothness degree in the information processing system 100. This calculation process of the smoothness degree is always executed for each control cycle. This calculation process of the smoothness degree shows an example of calculating the smoothness degree based on the navigation information. This calculation process of the smoothness degree will be explained with appropriate reference to Figures 1 to 8.

[0110] In step S551, the detection unit 122 acquires the navigation information output from the destination setting unit 125 and detects the occurrence of each event outside the vehicle C1.

[0111] In step S552, the detection unit 122 determines, based on the navigation information acquired in step S551, whether or not the vehicle C1 has traveled on a road other than the travel route to the destination set by the destination setting unit 125. If it is detected that the vehicle C1 has traveled on a wrong road, the detection unit 122 outputs a notice to that effect to the calculation unit 123, and the process proceeds to step S553. On the other hand, if it is not detected that the vehicle C1 has traveled on a wrong road, the process proceeds to step S554.

[0112] For example, the detection unit 122 can acquire a travel route to the destination based on navigation information output from the destination setting unit 125. The detection unit 122 can compare the current location of the vehicle C1 acquired by the position information acquisition unit with the travel route to the destination and determine whether the vehicle C1 is traveling on the travel route. If the detection unit 122 determines that the vehicle C1 is not traveling on the travel route to the destination, it detects that the vehicle C1 has taken a wrong turn.

[0113] In step S553, the calculation unit 123 turns on the error flag.

[0114] In step S554, the detection unit 122 determines, based on the navigation information acquired in step S551, whether or not a parking space for the vehicle C1 exists after the vehicle has arrived at the destination set by the destination setting unit 125. If it is detected that a parking space for the vehicle C1 does not exist after the vehicle has arrived at the destination, the detection unit 122 outputs a notice to that effect to the calculation unit 123, and the process proceeds to step S555. On the other hand, if it is detected that a parking space for the vehicle C1 exists after the vehicle has arrived at the destination, the process proceeds to step S556.

[0115] For example, the detection unit 122 can acquire a destination based on navigation information output from the destination setting unit 125. For example, the detection unit 122 can detect that the vehicle C1 has arrived at the destination when route guidance using the navigation function ends. Furthermore, the detection unit 122 can compare the current location of the vehicle C1 acquired by the position information acquisition unit with the destination to determine whether the vehicle C1 has arrived at the destination. Furthermore, for example, the detection unit 122 can determine whether a parking lot is available at the destination based on the navigation information output from the destination setting unit 125. Furthermore, for example, the detection unit 122 can detect whether a parking lot is available around the vehicle C1, whether there is a parking space in the parking lot, and the like, based on an exterior image acquired by the exterior image acquisition unit 103. The presence or absence of a parking space can be determined based on a parking lot indicator light (e.g., the word "full" or "vacant").

[0116] For example, if the vehicle C1 continues to travel for a predetermined time or longer without stopping after arriving at the destination (e.g., after the navigation guidance has ended), it is assumed that the user is searching for a parking space for the vehicle C1. Therefore, if the vehicle C1 continues to travel for a predetermined time or longer without stopping after arriving at the destination, the detection unit 122 can determine that there is no parking space for the vehicle C1 after arriving at the destination.

[0117] In step S555, the calculation unit 123 turns on the no parking lot flag.

[0118] In step S556, the calculation unit 123 calculates the degree of success and the performance coefficient A.

[0119] [Example of Calculation Process of Smoothness Degree Based on Driving Operation Information] Figure 10 is a flowchart showing an example of calculation process of smoothness degree in the information processing system 100. This calculation process of smoothness degree is always executed for each control cycle. This calculation process of smoothness degree shows an example of calculating the smoothness degree based on driving operation information. This calculation process of smoothness degree will be explained with appropriate reference to Figures 1 to 9.

[0120] In step S561, the detection unit 122 acquires the driving operation information output from the vehicle information acquisition unit 121 and detects the occurrence of each event in the vehicle C1.

[0121] In step S562, the detection unit 122 determines, based on the driving operation information acquired in step S561, whether the number of times the vehicle enters a parking space at a predetermined location is equal to or exceeds a predetermined value within a predetermined time period. Here, the predetermined location is, for example, the destination set by the destination setting unit 125. The number of times the vehicle enters a parking space is equal to or exceeds a predetermined value. The predetermined time period can be set to, for example, several minutes to several tens of minutes. The predetermined value can be set to, for example, several times to several tens of times. If the detection unit 122 detects that the number of times the vehicle enters a parking space is equal to or exceeds the predetermined value, the detection unit 122 outputs a corresponding signal to the calculation unit 123, and the process proceeds to step S563. On the other hand, if the detection unit 122 does not detect that the number of times the vehicle enters a parking space is less than the predetermined value, the process proceeds to step S564.

[0122] For example, the detection unit 122 can detect that the vehicle C1 has reached a parking lot, based on the navigation information output from the destination setting unit 125. Furthermore, for example, the detection unit 122 can detect whether the vehicle C1 has moved forward or backward, based on the driving operation information output from the vehicle information acquisition unit 121. Thus, the detection unit 122 can detect the number of times the vehicle C1 has moved forward or backward within a predetermined time period since arriving at the parking lot, and detect whether the number of times the vehicle C1 has parked in the parking lot is equal to or greater than a predetermined value.

[0123] In step S563, the calculation unit 123 turns on the garage entry flag.

[0124] In step S564, the calculation unit 123 calculates the degree of success and the performance coefficient A.

[0125] [Example of Calculation Process of Smoothness Degree Based on Vehicle Status Information] Figure 11 is a flowchart showing an example of calculation process of the smoothness degree in the information processing system 100. This calculation process of the smoothness degree is always executed for each control cycle. This calculation process of the smoothness degree shows an example of calculating the smoothness degree based on the vehicle status information. This calculation process of the smoothness degree will be explained with appropriate reference to Figures 1 to 10.

[0126] In step S571, the detection unit 122 acquires the vehicle status information output from the vehicle information acquisition unit 121, and detects the occurrence of each event in the vehicle C1.

[0127] In step S572, the detection unit 122 determines whether the remaining driving distance of the vehicle C1 is shorter than the distance to the destination of the vehicle C1, based on the vehicle status information acquired in step S571. If it is detected that the remaining driving distance of the vehicle C1 is shorter than the distance to the destination of the vehicle C1, the detection unit 122 outputs a message to that effect to the calculation unit 123, and the process proceeds to step S573. On the other hand, if it is detected that the remaining driving distance of the vehicle C1 is longer than the distance to the destination of the vehicle C1, the process proceeds to step S574.

[0128] For example, if the vehicle C1 is a gasoline-powered vehicle, the driving range of the vehicle C1 can be estimated based on the amount of gasoline remaining in the fuel tank. On the other hand, if the vehicle C1 is an electric vehicle, the driving range of the vehicle C1 can be estimated based on the remaining battery charge. Furthermore, the distance to the destination can be calculated based on navigation information.

[0129] In step S573, the calculation unit 123 turns on the garage entry flag.

[0130] In step S574, the calculation unit 123 calculates the degree of success and the performance coefficient A.

[0131] [Example of Calculation Process of Successful Progress Based on User Status Information] Figure 12 is a flowchart showing an example of calculation process of successive progress in the information processing system 100. This calculation process of successive progress is constantly executed for each control period. This calculation process of successive progress is an example of calculating the successive progress based on user status information. This calculation process of successive progress will be explained with appropriate reference to Figures 1 to 11.

[0132] In step S581, the detection unit 122 acquires user status information output from the sensors 104 and the like, and detects the occurrence of various events inside the vehicle C1. This user status information is, for example, a user's biological signal output from a sensor capable of acquiring various types of information related to the user's biological activity. This sensor is, for example, an image sensor (in-vehicle image acquisition unit 102) capable of acquiring images of the user's face and body, a sound acquisition sensor (sound acquisition unit 101) capable of acquiring the user's voice, a CO2 sensor capable of detecting the concentration of carbon dioxide around the user, a drowsiness detection sensor capable of detecting whether the user is drowsy, etc.

[0133] In step S582, the detection unit 122 determines whether the user's level of alertness is below a threshold based on the user situation information acquired in step S571. Here, alertness is an index indicating the degree to which the user is awake and alert, with a higher value indicating a more alert and alert state. In other words, if the user's level of alertness is low, there is a risk of drowsy driving, etc., and therefore it is highly likely that the vehicle C1 is not proceeding smoothly on the route to the destination. If the detection unit 122 detects that the user's level of alertness is below the threshold, it outputs a signal to that effect to the calculation unit 123, and the process proceeds to step S583. On the other hand, if the detection unit 122 detects that the user's level of alertness is equal to or greater than the threshold, the process proceeds to step S584.

[0134] For example, the detection unit 122 can detect the level of alertness of the user based on the face (particularly the eyes) of the user acquired by the in-vehicle image acquisition unit 102. For example, the detection unit 122 can detect the level of alertness of the user based on the length of time the user's eyes are closed, the interval between those eyes being closed, etc. For example, if the length of time the user's eyes are closed is equal to or greater than a threshold, or if the interval between those eyes is equal to or less than a threshold, it can be determined that the level of alertness of the user is below the threshold.

[0135] Furthermore, for example, the detection unit 122 can detect the user's level of alertness based on the concentration of carbon dioxide around the user acquired by a CO2 sensor. For example, when the concentration of carbon dioxide around the user is equal to or greater than a reference value, the detection unit 122 can determine that the user's level of alertness is below a threshold. The detection unit 122 may also detect the user's level of alertness based on both the user's face (particularly the eyes) and the concentration of carbon dioxide around the user. For example, when the concentration of carbon dioxide around the user is equal to or greater than a reference value and the length of time the user's eyes are closed is equal to or greater than a threshold (or when the interval between eye closures is equal to or less than a threshold), the detection unit 122 can determine that the user's level of alertness is below a threshold. Note that these are merely examples, and the user's level of alertness may also be determined based on other user status information (e.g., the user's facial expression, the user's movements).

[0136] In step S583, the calculation unit 123 turns on the awakening flag.

[0137] Although the example shown in FIG. 12 illustrates an example in which the user's alertness is detected based on the user situation information, other events related to the user may also be detected and used. For example, when multiple occupants are riding in the vehicle C1, it is possible to detect a fight between the multiple occupants (e.g., a marital dispute). This fight can be detected based on the interior image acquired by the interior image acquisition unit 102, the interior sound acquired by the sound acquisition unit 101, and the like. For example, if audio information containing a predetermined keyword is detected or a predetermined fighting motion is detected, it can be determined that multiple occupants are fighting. In this case, a fight flag can be turned on and used. In this way, when a fight breaks out in the vehicle, the occupants who are fighting can be easily notified that the vehicle C1 recognizes the tense atmosphere in the vehicle, and the user can be informed that the vehicle C1 recognizes the user's situation. This can increase intimacy between the vehicle and the user.

[0138] In step S584, the calculation unit 123 calculates the degree of success and the performance coefficient A.

[0139] [Example of operation of performance control processing when a change from poor to good condition] Figure 13 is a flowchart showing an example of performance control processing in the information processing system 100. This performance control processing is always executed for each control cycle. This performance control processing also shows an example of performance control processing when a judgment based on the degree of good condition changes from poor to good. This performance control processing will also be explained with appropriate reference to Figures 1 to 12.

[0140] In step S591, the performance control unit 124 acquires the smoothness degree calculated by the calculation unit 123. For example, the smoothness degree calculated by the calculation process shown in Figs. 8 to 12 is acquired.

[0141] In step S592, the performance control unit 124 determines whether each flag (see FIG. 3) is off based on the degree of smoothness acquired in step S591. These flags are the flags shown in FIGS. 8 to 12. If each flag is off, there is a possibility that the condition has changed from poor to good, so the process proceeds to step S593. On the other hand, if each flag is not off, the poor condition is maintained, so the performance control process ends.

[0142] In step S593, the performance control unit 124 determines whether any flag was determined to be on in the determination process immediately prior to the determination process in step S592. That is, if any flag was determined to be on in the previous determination process, it is determined that the situation is unsuccessful. In this case, if it is determined that all flags are off in the current determination process, it means that the situation has changed from unsuccessful to successful. On the other hand, if it is determined that all flags are off in the previous determination process and all flags are also off in the current determination process, it means that the situation is maintained in a successful state. Therefore, if it is determined that any flag is on in the immediately prior determination process, that is, if the situation has changed from unsuccessful to successful, the process proceeds to step S594. On the other hand, if it is determined that all flags are off in the immediately prior determination process, that is, if the situation is maintained in a successful state, the performance control process ends.

[0143] In step S594, the performance control unit 124 executes a process to cancel the non-smooth performance. That is, the non-smooth performance is canceled. Specifically, the performance control unit 124 determines the setting value of each performance device so that the performance state before the non-smooth performance was determined is restored. For example, the performance control unit 124 can determine the setting value of each performance device using a performance coefficient A and the following formula 4. Setting value = old setting value + A ... formula 4

[0144] Here, the old setting value may be the setting value immediately before the vehicle C1 is determined to be running smoothly, or may be the setting value of the initial state. In this way, when the vehicle changes from running smoothly to running smoothly, i.e., when the running smoothly state is resolved, it is possible to abruptly switch from the running smoothly effect to the running smoothly effect. For example, it is possible to return each running smoothly effect setting value to the state it was in immediately before the running smoothly effect. In other words, by abruptly switching the in-vehicle effect, the user can easily recognize that the running smoothly state of the vehicle C1 has changed. This makes it possible to convey to the user that the vehicle C1 is aware of the running smoothly state of the vehicle C1, thereby enhancing intimacy between the vehicle and the user.

[0145] In step S595, the performance control unit 124 controls each performance device based on the setting value set in step S594 to execute each performance.

[0146] [Example of Discomfort Alleviation Effect for Alleviating Discomfort] In the effect control process described above, when it is determined that the smoothness level is a value indicating unsmoothness (one of the flags is on), an empathy effect is executed to sympathize with the user's feelings that the vehicle C1 is not progressing smoothly. It is assumed that there may be users who dislike their feelings being downcast by an empathy effect. Therefore, some adjustments may be made for users who dislike their feelings being downcast by an empathy effect. For example, after the vehicle C1 empathizes with the user's feelings of anxiety, an effect to relieve the user's feelings of anxiety (e.g., a relaxation effect or a discomfort alleviation effect) may be executed. That is, if the smoothness level remains at a value indicating unsmoothness after executing an empathy effect, the effect control unit 124 may execute an discomfort alleviation effect to alleviate the user's discomfort that the vehicle C1 is not progressing smoothly. In this case, the effect control unit 124 sets a setting value corresponding to the discomfort alleviation effect in each effect device to change the content of the effect. The discomfort alleviation effect may be executed in response to a user operation. For example, an exciting button may be provided on the display unit 210, and an exciting discomfort-relief effect may be executed on condition that the exciting button is selected.

[0147] [Example of User-Selected Initial Setting Values] The above describes an example in which, when a destination is set by the user, an initial setting value related to the destination is automatically set. However, multiple initial setting values ​​related to the destination may be prepared in advance and presented to the user. In this case, the initial setting value selected by the user from the multiple initial setting values ​​can be set for each performance device. For example, when the user specifies an initial setting value, the user may specify a theme and select the initial setting value. Alternatively, the user may specify the type of initial setting value from themes corresponding to the destination. For example, when a swimming beach is set as the destination, the user may select one sandy beach image from multiple types of sandy beach images. In this case, for example, detailed customization by the user may be possible. For example, if an initial image mainly consisting of a light blue color is set, the user may edit it to a darker blue color through a user operation.

[0148] Similarly, the setting values ​​of each effect device can be customized according to the user's preferences. This allows each effect device to execute effects with initial settings according to the user's preferences. Furthermore, the user can enjoy transitions in effects that suit the user's preferences based on the smoothness of the vehicle C1's driving. Note that the initial setting values ​​set by the user can be recorded as a history in the customization database of the storage unit 130 as a result of customization.

[0149] [Example of Setting Initial Values ​​Using Generative AI] Alternatively, the initial value may be set using information related to a destination set by a user and the generative AI. For example, an initial image can be set according to the destination set by the user. For example, an initial image can be generated based on the destination set by the user using a technology (e.g., an image generation model, an AI model, or a generative AI) that generates new data using artificial intelligence (AI), and the initial image can be displayed on the display unit 210. For example, a generative adversarial network (GAN) can be used as this technology. For example, the input to the generative AI can be characters related to the destination (e.g., ABC Theme Park).

[0150] For example, the performance control unit 124 can acquire features related to the destination set by the user (e.g., characters related to the destination) and generate an initial image based on these features. Note that the features related to the destination may be set in advance or acquired using the generation AI. Similarly, the performance control unit 124 can acquire features related to the destination set by the user and generate initial setting values ​​for each performance device using the generation AI based on these features. Note that the initial setting values ​​set using the generation AI can be recorded as a history in the customization database of the storage unit 130 as a result of customization.

[0151] [Example of Uploading and Downloading Initial Settings] As described above, initial settings set by user specification and initial settings set using the generation AI can be recorded as a history in the customization database of the storage unit 130 as a result of customization. Here, when a user has set settings (various setting values) that suit their preferences, they can be uploaded to a predetermined network such as a social networking service (SNS). For example, a transition of background images from the vehicle C1's departure point to its destination can be uploaded in association with the destination. It may also be difficult for a user to set settings that suit their preferences. Therefore, it is possible to download and acquire settings of others associated with the destination. In this way, customization of setting values ​​of performance devices according to destinations, themes, etc. can be shared among users, and downloading and updating may be possible via the network 20. For example, it is possible to download and update themes corresponding to destinations and setting values ​​for when things go wrong (e.g., performance coefficient A). That is, the performance control unit 124 can perform at least one of an upload process for uploading the initial setting values ​​set in the performance control process to another device (for example, a management server) and a download process for downloading the initial setting values ​​set in the performance control process from another device. This communication process is performed using the communication unit 140.

[0152] [Example of Effect of the Present Embodiment] As described above, in the present embodiment, even when the distance to the destination and the state of mind of the occupants of the vehicle C1 are not linked, appropriate in-vehicle effects can be provided according to the conditions inside and outside the vehicle C1, thereby further enhancing intimacy through empathy with the user. For example, the setting values ​​of each effect device can be adjusted according to the degree of smoothness of the vehicle C1's driving. For example, if the vehicle C1's driving is not going smoothly, dark effects can be provided according to the degree of smoothness, making it easy for the user to recognize that the vehicle C1 is also not going smoothly. This reduces unnecessary user operations, such as stopping inappropriate in-vehicle effects or changing to other in-vehicle effects, and reduces the computational processing load related to in-vehicle effect control. In other words, it is possible to suppress an increase in the effect processing load due to the execution of inappropriate in-vehicle effects.

[0153] Also, for example, if the vehicle C1 is traveling smoothly, a bright effect can be displayed according to the distance to the destination, allowing the user to easily recognize that the vehicle C1 is also traveling smoothly. For example, it is possible to issue voice information such as "We'll soon reach the destination," or "It's good that it's plain." In this case, it is possible to give the user the impression that the vehicle C1 is also cheerful and in a good mood.

[0154] [Example of Executing Processing in Other Devices or Systems] Note that, although the above describes an example in which the detection processing, calculation processing, performance control processing, etc. are executed in the information processing device 110 (or the information processing system 100), all or part of each of these processes may be executed in other devices. In this case, the information processing system is configured by each device that executes part of each of these processes. For example, at least part of each process can be executed using various information processing devices and various electronic devices, such as in-vehicle devices, devices that can be used by the user (e.g., smartphones, tablet terminals, personal computers, car navigation devices, IVIs), and servers that can be connected via a predetermined network such as the Internet.

[0155] Furthermore, a part (or all) of the information processing system capable of executing the functions of the information processing device 110 (or the information processing system 100) may be provided by an application that can be provided via a predetermined network such as the Internet. This application is, for example, SaaS (Software as a Service).

[0156] [Configuration Example and Effects of the Present Embodiment] The information processing method according to the present embodiment is an information processing method capable of executing a predetermined effect for a user riding in the vehicle C1. This information processing method includes a detection process (steps S512, S517) for detecting conditions inside and outside the vehicle C1, a calculation process (steps S530, S518, S531 to S542, S551 to S556, S561 to S564, S571 to S574, S581 to S584) for calculating a progress level indicating that the vehicle C1 is progressing smoothly along its travel route based on the conditions, and a performance control process (steps S502, S504, S513 to S516, S519, S520) for setting and executing the content of a performance according to the progress level. Furthermore, the program according to the present embodiment is a program that causes a computer to execute each of these processes. In other words, the program according to the present embodiment is a program that causes a computer to realize each function executable by the information processing device 110.

[0157] This configuration allows for more intimacy with the user through empathy by providing appropriate in-vehicle effects according to the conditions inside and outside the vehicle C1. This reduces unnecessary user operations, such as stopping inappropriate in-vehicle effects or changing to other in-vehicle effects, and reduces the computational processing load related to in-vehicle effect control. In other words, it is possible to suppress an increase in the processing load due to the execution of inappropriate in-vehicle effects.

[0158] The information processing method according to this embodiment further includes a destination setting process (step S501) for setting a destination of the vehicle C1 and a travel route to the destination. In the calculation process (steps S530, S518, S531 to S542, S551 to S556, S561 to S564, S571 to S574, and S581 to S584), a smoothness degree is calculated for the travel route of the vehicle C1 toward the destination.

[0159] According to this configuration, by providing appropriate in-vehicle effects according to the degree of smoothness calculated for the route that vehicle C1 takes to reach its destination, it is possible to further enhance intimacy through empathy with the user.

[0160] In the information processing method according to this embodiment, the rendering is performed using one or more devices (e.g., output device 200, rendering devices 300) installed in vehicle C1. In the rendering control process (steps S502 and S503), when a destination is set, the devices are controlled based on initial setting values ​​corresponding to the destination at the time of setting. For example, as shown in FIGS. 4A and 5A, initial images 181 and 185 are displayed on display unit 210 based on the initial setting values.

[0161] With this configuration, the device is controlled based on the initial setting value corresponding to the set destination, so it is possible to provide the user who set the destination with a performance related to that destination, thereby increasing the user's sense of anticipation for the destination.

[0162] In the information processing method according to this embodiment, the detection process (steps S512 and S517) detects the occurrence of a specific event inside or outside vehicle C1 as a situation. In the calculation process (steps S530, S518, S531 through S542, S551 through S556, S561 through S564, S571 through S574, and S581 through S584), if a specific event is detected, a value indicating an unsuccessful condition is calculated as the degree of smoothness (e.g., a corresponding flag is set to "1"). In the performance control process (steps S513, S514, S516, S519, and S520), if the degree of smoothness is a value indicating an unsuccessful condition, the setting values ​​of the devices are changed according to the degree of smoothness to change the content of the performance.

[0163] With this configuration, even if the distance to the destination, etc., is not linked to the state of mind of the occupants of vehicle C1, it is possible to further increase intimacy through empathy with the user by providing appropriate in-vehicle presentations that correspond to the situation inside and outside vehicle C1.

[0164] In the information processing method according to this embodiment, in the effect control process (steps S513, S514, S516, S519, and S520), when the degree of smoothness is a value indicating an unsmooth state, the content of the effect is changed by setting a setting value in the device corresponding to an empathy effect that sympathizes with the user that the vehicle C1 is not progressing smoothly, according to the degree of smoothness. For example, as shown in Figures 4(C) and 5(C), unsmooth effect images 183 and 187 corresponding to the degree of smoothness are displayed on the display unit 210.

[0165] According to this configuration, when the vehicle C1 is running unsmoothly, a dark effect is executed according to the degree of the unsmoothness, making it possible to easily make the user aware that the vehicle C1 is also feeling unsmooth.

[0166] In the information processing method according to this embodiment, in the performance control process (steps S591 to S595), if the degree of smoothness is determined to be a value indicating poor performance and the content of the performance is changed, and then it is determined that the degree of smoothness is a value indicating good performance, the setting value of the equipment is returned to the setting value before the degree of smoothness was determined to be a value indicating poor performance, and the content of the performance is changed.

[0167] According to this configuration, when the vehicle C1 changes from poor to good condition, the display can be suddenly switched from the poor condition display to the good condition display. By suddenly switching the display in the vehicle in this way, the user can easily recognize that the vehicle C1's condition has changed. This makes it possible to convey to the user that the vehicle C1 is aware of the vehicle C1's condition, thereby enhancing intimacy between the vehicle and the user.

[0168] In the information processing method according to this embodiment, in the performance control processing (steps S513, S514, S516, S519, S520), after the degree of smoothness is determined to be a value indicating poor progress and an empathy performance is executed to sympathize with the user that vehicle C1 is not progressing smoothly, if the state in which the degree of smoothness remains at a value indicating poor progress, the content of the performance may be changed by setting in the device a setting value corresponding to a discomfort mitigation performance that alleviates the user's discomfort that vehicle C1 is not progressing smoothly.

[0169] For example, for a user who dislikes feeling down due to empathy effects, the vehicle C1 can empathize with the user's anxious feelings and then execute an effect to ease the anxious feelings (for example, a relaxation effect or discomfort alleviation effect), thereby alleviating the user's discomfort caused by the vehicle C1 not progressing smoothly.

[0170] In the information processing method according to this embodiment, in the performance control process (steps S513, S515), when the degree of smoothness is a value indicating smoothness and the distance from vehicle C1 to the destination is less than a threshold value, as the distance decreases, the device is sequentially set with setting values ​​corresponding to comfortable performances that will make the user comfortable, and the content of the performance is changed.

[0171] According to this configuration, when the vehicle C1 is traveling smoothly, a bright effect is displayed according to the distance to the destination, making it possible to easily make the user aware that the vehicle C1 is also traveling smoothly.

[0172] In the information processing method according to this embodiment, in the performance control process (steps S503 and S504), when a destination is set, an initial setting value is calculated using information related to the destination and the generation AI.

[0173] According to this configuration, it is possible to generate initial setting values ​​according to the user's preferences using the generation AI, thereby enabling customization of various effects according to the user's preferences.

[0174] In the information processing method according to this embodiment, in the performance control process (steps S503 and S504), when a destination is set, an initial setting value designated by the user from among a plurality of initial setting values ​​related to the destination is set in the device.

[0175] According to this configuration, the user can set the initial setting value according to his / her preference through user operation, thereby enabling customization of various effects according to the user's preference.

[0176] The information processing method according to the present embodiment further includes a communication process for executing at least one of an upload process for uploading the initial setting values ​​set in the performance control process (steps S503 and S504) to another device and a download process for downloading the initial setting values ​​set in the performance control process (steps S503 and S504) from another device. For example, the control unit 120 executes the communication process via the communication unit 140.

[0177] According to this configuration, it is possible for users to share customization of the setting values ​​of the performance devices according to the destination, theme, etc.

[0178] The information processing device 110 is an information processing device capable of executing a predetermined performance for a user riding in the vehicle C1. The information processing device 110 includes a detection unit 122 that detects conditions inside and outside the vehicle C1, a calculation unit 123 that calculates a progress level indicating whether the vehicle C1 is progressing smoothly along its travel route based on the conditions inside and outside the vehicle C1, and a performance control unit 124 that sets and executes the content of a performance according to the progress level. The information processing device 110 may be a device built into either the output device 200 or the performance devices 300, or may be a device separate from the output device 200 and the performance devices 300. Instead of the information processing device 110, an information processing system configured with multiple devices capable of executing the processes realized by the information processing device 110 may also be used.

[0179] This configuration allows for more intimacy with the user through empathy by providing appropriate in-vehicle effects according to the conditions inside and outside the vehicle C1. This reduces unnecessary user operations, such as stopping inappropriate in-vehicle effects or changing to other in-vehicle effects, and reduces the computational processing load related to in-vehicle effect control. In other words, it is possible to suppress an increase in the processing load due to the execution of inappropriate in-vehicle effects.

[0180] Note that each processing procedure shown in this embodiment is an example for realizing this embodiment, and the order of some of the processing procedures may be changed within the scope that makes it possible to realize this embodiment, and some of the processing procedures may be omitted or other processing procedures may be added.

[0181] Each process in this embodiment is executed based on a program that causes a computer to execute various processing procedures. This embodiment can also be understood as an embodiment of a program that realizes the function of executing each process and a recording medium that stores the program. For example, an update process for adding a new function to an information processing device can store the program in the storage device of the information processing device. This makes it possible to cause the updated information processing device to execute each process described in this embodiment.

[0182] Although the embodiments of the present invention have been described above, the above embodiments merely show application examples of the present invention, and are not intended to limit the technical scope of the present invention to the specific configurations of the above embodiments.

Claims

An information processing method capable of executing a predetermined performance for a user riding in a vehicle, a detection process for detecting conditions inside and outside the vehicle; a calculation process for calculating a smoothness degree indicating that the vehicle is progressing smoothly on the travel route of the vehicle based on the situation; A performance control process that sets and executes the content of the performance according to the degree of smoothness; An information processing method including:

2. The information processing method according to claim 1, a destination setting process for setting a destination of the vehicle and the travel route to the destination, In the calculation process, the smoothness degree is calculated for the travel route until the vehicle heads toward the destination. Information processing methods.

3. The information processing method according to claim 2, The performance is performed using one or more devices installed in the vehicle, In the performance control process, when the destination is set, the device is controlled based on an initial setting value corresponding to the destination at the time of setting. Information processing methods.

4. The information processing method according to claim 3, In the detection process, the occurrence of a specific event inside or outside the vehicle is detected as the situation, In the calculation process, when the specific event is detected, a value indicating a malfunction is calculated as the degree of malfunction; In the performance control process, when the degree of smoothness is a value indicating poor performance, the setting value of the device is changed according to the degree of smoothness to change the content of the performance. Information processing methods.

4. The information processing method according to claim 3, In the performance control process, when the smoothness degree is a value indicating an unsmooth running, a setting value corresponding to an empathy performance that sympathizes with the user for the fact that the vehicle is not running smoothly is set in the device according to the smoothness degree, and the content of the performance is changed. Information processing methods.

6. The information processing method according to claim 4 or 5, In the performance control process, after the degree of smoothness is determined to be a value indicating poor performance and the content of the performance is changed, if the degree of smoothness is determined to be a value indicating good performance, the setting value of the device is returned to the setting value before the degree of smoothness is determined to be a value indicating poor performance, and the content of the performance is changed. Information processing methods.

6. The information processing method according to claim 4 or 5, In the presentation control process, after the smoothness degree is determined to be a value indicating an unsmooth running and a sympathy presentation is executed to sympathize with the user for the vehicle not moving smoothly, if the smoothness degree continues to be a value indicating an unsmooth running, a setting value corresponding to a discomfort mitigation presentation to alleviate the user's discomfort for the vehicle not moving smoothly is set in the device, and the content of the presentation is changed. Information processing methods.

4. The information processing method according to claim 3, In the performance control process, when the smoothness degree is a value indicating smoothness and the distance from the vehicle to the destination is less than a threshold value, as the distance decreases, setting values ​​corresponding to comfortable performances that make the user comfortable are sequentially set in the device, thereby changing the content of the performance. Information processing methods.

4. The information processing method according to claim 3, In the performance control process, when the destination is set, the initial setting value is calculated using information related to the destination and a generation AI. Information processing methods.

4. The information processing method according to claim 3, In the performance control process, when the destination is set, an initial setting value designated by the user from among a plurality of initial setting values ​​related to the destination is set to the device. Information processing methods.

11. The information processing method according to claim 9, further comprising: and a communication process for executing at least one of an upload process for uploading the initial setting value set in the performance control process to another device and a download process for downloading the initial setting value set in the performance control process from the other device. Information processing methods. 　 An information processing device capable of executing a predetermined performance for a user riding in a vehicle, a detection unit that detects conditions inside and outside the vehicle; a calculation unit that calculates a smoothness degree indicating that the vehicle is progressing smoothly on the travel route of the vehicle based on the situation; a performance control unit that sets and executes the content of the performance according to the degree of smoothness; An information processing device comprising: 　 A program that causes a computer to execute the information processing method according to claim 1.

Images