Excitement degree determination device

Abstract

To provide an excitement degree determination device which supports driver's driving by effectively adjusting an excitement degree by a driver of a movable body.SOLUTION: An excitement degree determination device includes a feature quantity acquisition part which detects a feature quantity relating to behavior of a driver of a movable body, a travel control information acquisition part which acquires travel control information as information relating to a travel control state of the movable body when the feature quantity is detected, and an excitement degree determination part which determines an excitement degree of an occupant on the basis of the feature quantity and travel control information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an excitement level determination device, for example, an excitement level determination device capable of determining the excitement level of a user. [Background technology]

[0002] A terminal device has been proposed that compares beat information of a piece of music with the detection result of a user's movements to determine whether or not the user is moving their body in time with the music, and stores the information about the music and information indicating the determination result of whether or not the user is moving their body in association with each other (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6055659 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, in a mobile object such as an automobile, it is desirable that the driver responsible for operating the mobile object is not in an overly excited state. Therefore, it is preferable to be able to determine the driver's excited state. However, the terminal device described in Patent Document 1 merely determines whether the user is moving in time with the music when the music is being played and stores the result. Therefore, one example of a problem is that it is difficult to accurately determine whether the user is currently in an excited state using the terminal device described in Patent Document 1 and the information acquired thereby.

[0005] The present invention has been made in consideration of the above-mentioned points, and aims to provide, for example, an excitement level determination device that assists a driver in driving a mobile vehicle by effectively adjusting the driver's state of excitement. [Means for solving the problem]

[0006] The invention described in claim 1 is an excitement level determination device characterized by comprising a feature acquisition unit that detects feature values ​​related to the behavior of the driver of a mobile body, a driving control information acquisition unit that acquires driving control information, which is information related to the driving control state of the mobile body when the feature values ​​are detected, and an excitement level determination unit that determines the excitement level of the occupant based on the feature values ​​and the driving control information. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a perspective view of a front seat portion of a car equipped with an excitement level adjusting device according to a first embodiment of the present invention. [Figure 2] 1 is a block diagram showing an example of the configuration of an excitement level adjusting device according to a first embodiment of the present invention. [Figure 3] 1 is a flowchart of an operation routine of an excitement level adjusting device according to a first embodiment of the present invention. [Figure 4] FIG. 10 is a diagram showing an example of an excitement level data table. [Figure 5] 10 is an example of a reference value table. [Figure 6] 10 is an example of a reference value table. [Figure 7] 1 is a flowchart of an operation routine of an excitement level adjusting device according to a first embodiment of the present invention. [Figure 8] 1 is a flowchart of an operation routine of an excitement level adjusting device according to a first embodiment of the present invention. [Figure 9] 1 is a flowchart of an operation routine of an excitement level adjusting device according to a first embodiment of the present invention. [Figure 10] 1 is a flowchart of an operation routine of an excitement level adjusting device according to a first embodiment of the present invention. [Figure 11] 1 is a flowchart of an operation routine of an excitement level adjusting device according to a first embodiment of the present invention. [Figure 12] 1 is a flowchart of an operation routine of an excitement level adjusting device according to a first embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0008] In the following, preferred embodiments of the present invention will be described. However, these may be modified and combined as appropriate. In the following description and accompanying drawings, substantially the same or equivalent parts will be denoted by the same reference numerals. In the following description, the term "video" will be used to refer to both moving and still images. [Example]

[0009] An excitement level reducing device 10 according to a first embodiment of the present invention will be described below with reference to the accompanying drawings. In the first embodiment, the excitement level adjusting device 10 is mounted on an automobile M as an example.

[0010] Fig. 1 is a diagram showing an example of the front seat portion of an automobile M as a moving body to which an excitement level adjustment device 10 is attached. Fig. 1 shows a case in which the excitement level adjustment device 10 is attached to the center console portion of the front seat of the automobile M as an example of attachment.

[0011] Upper body camera 11, which serves as a passenger photographing unit, is a camera capable of photographing the upper body of a passenger in automobile M. Upper body camera 11 is provided, for example, on dashboard DB and oriented so as to be able to photograph the driver in the driver's seat. Upper body camera 11 may be disposed in a position where it can photograph the movements of the passenger's upper body and other conditions. For example, upper body camera 11 may be provided on rearview mirror RM or on the ceiling at the top edge of windshield FG or near the top edge.

[0012] The upper body camera 11 is communicably connected to the excitement level adjustment device 10 and is capable of transmitting a signal of the captured image to the excitement level adjustment device 10.

[0013] Lower body camera 13 is a camera capable of capturing images of the lower body, for example, the feet, of a vehicle occupant. Lower body camera 13 is provided, for example, on the surface of dashboard DB and to the side of steering wheel H, and is oriented so as to capture images of the driver's feet. Lower body camera 13 is communicably connected to excitement level adjustment device 10, and is capable of transmitting a signal of the captured image to excitement level adjustment device 10.

[0014] The microphone 15 is a microphone device that receives sounds inside the vehicle, and is arranged, for example, on the dashboard DB. The microphone 15 may be arranged anywhere, such as on the rearview mirror RM or the steering wheel, as long as it can receive sounds inside the vehicle. The microphone 15 is connected to the excitement level adjustment device 10 so as to be able to communicate with the excitement level adjustment device 10, and can transmit signals of the collected sounds to the excitement level adjustment device 10.

[0015] The upper body camera 11, the lower body camera 13, and the microphone 15 are used as a feature amount detection unit for detecting feature amounts relating to the passenger's behavior.

[0016] The GPS receiver 17 is a device that receives signals (GPS signals) from GPS (Global Positioning System) satellites. The GPS receiver 17 is disposed, for example, on a dashboard DB. The GPS receiver 17 may be disposed anywhere as long as it can receive GPS signals. The GPS receiver 17 is communicably connected to the excitement level adjustment device 10, and can transmit the received GPS signals to the excitement level adjustment device 10.

[0017] The touch panel 19 is, for example, a touch panel monitor that combines a display 19A, such as a liquid crystal display capable of displaying images, with a touch pad 19B. The touch panel 19 is disposed, for example, on the dashboard DB. The touch panel 19 may be disposed in a location that is visible to the driver and within the driver's reach. For example, the touch panel 19 may be attached to the center console CC in the dashboard DB.

[0018] The display 19A is communicably connected to the excitement level adjustment device 10 and is capable of displaying a screen based on the control of the excitement level adjustment device 10. In addition, the touch panel 19B is capable of transmitting to the excitement level adjustment device 10 a signal representing an input operation to the touch panel 19B received from the user.

[0019] The speaker 21 is provided, for example, on the interior side of the A-pillar P or the door DR. The speaker 21 is communicably connected to the excitement level adjustment device 10 and can emit sounds such as music and voices based on the control of the excitement level adjustment device 10.

[0020] [1. System configuration and operation] 2 shows the configuration of the excitement level adjustment device 10. For example, the excitement level adjustment device 10 is a device in which a mass storage device 33, a control unit 35, an input unit 37, an output unit 39, a data communication unit 41, and a content reading unit 43 cooperate with each other via a system bus 31.

[0021] The mass storage device 33 is configured by, for example, a hard disk drive, a solid state drive (SSD), a flash memory, etc., and stores various programs such as an operating system and software for the terminal.

[0022] The various programs may be acquired, for example, from another server device or the like via a network, or may be recorded on a recording medium and read via various drive devices. That is, the various programs stored in the mass storage device 33 (including a program for executing the processing in the excitement level adjusting device 10 described later) can be transmitted via a network, or can be recorded on a computer-readable recording medium and transferred.

[0023] The control unit 35 is configured with a CPU (Central Processing Unit) 35A, a ROM (Read Only Memory) 35B, a RAM (Random Access Memory) 35C, etc., and functions as a computer. The CPU 35A reads and executes various programs stored in the ROM 35B and the large-capacity storage device 33, thereby realizing various functions.

[0024] The input unit 37 is an interface unit that communicatively connects the excitement level adjustment device 10 and the touchpad 19B. The excitement level adjustment device 10 can receive a signal indicating an input operation to the touchpad 19B via the input unit 37. The input unit 37 can also be an interface unit that communicatively connects the excitement level adjustment device 10 and the microphone 15. In this case, the excitement level adjustment device 10 can receive a voice input signal related to a voice input operation by the user from the microphone 15 via the input unit 37.

[0025] The output unit 39 is communicatively connected to the display 19A and the speaker 21, and is capable of transmitting video or image signals to the display 19A to display the image, and transmitting audio signals to the speaker 21 to output sound.

[0026] Data collection unit 41 is an interface unit that communicatively connects excitement level adjustment device 10 with upper body camera 11, lower body camera 13, and microphone 15. Excitement level adjustment device 10 receives video signals from upper body camera 11 and lower body camera 13 via data collection unit 41.

[0027] The excitement level adjustment device 10 also receives audio signals from the microphone 15 via the data collection unit 41. The control unit 35 can calculate, from the video and audio signals received via the data collection unit 41, motion feature quantities such as the amount of movement of each part of the driver's body during the driver's movements in the vehicle in which the excitement level adjustment device 10 is installed.

[0028] For example, control unit 35 can calculate a motion feature amount based on the magnitude of the motion of the occupant of automobile M, based on the video signals from upper body camera 11 and lower body camera 13. This motion feature amount is, for example, normalized so that the detected amount of movement of each body part is a value between 0 and 1, with a preset maximum amount of movement of each body part being 1. In this embodiment, as an example, image processing is performed to calculate the motion feature amount using only the amount of movement of the head, hands, and feet of the driver of automobile M.

[0029] For example, the control unit 35 can calculate a voice feature based on the volume of the voice of the passenger of the automobile M, based on the voice input from the microphone 15. This voice feature is, for example, normalized so that the input voice has a value between 0 and 1, with a preset maximum voice being set to 1. In this embodiment, as an example, the voice feature is calculated using an extracted voice of only the driver of the automobile M as the input voice.

[0030] The calculated voice feature amount and action feature amount are stored in an excitement level database (excitement level storage DB) 33A in the mass storage device 33.

[0031] The data collection unit 41 also serves as an interface that communicatively connects the excitement level adjustment device 10 with the driving control device VC of the automobile M in which the excitement level adjustment device 10 is mounted. The driving control device VC is a device that controls the driving of the automobile M. In this embodiment, the driving control device VC determines whether the automobile M should be manually driven or automatically driven at any one of levels 1 to 5.

[0032] In this embodiment, the driving control device VC can transmit control information indicating whether the automobile M is currently being driven under manual driving control or under automatic driving control at any of automatic driving levels 1 to 5 to the excitement level adjustment device 10 via the data collection unit 41. The state of manual driving control is assumed to be automatic driving level 0.

[0033] Furthermore, when the driving control device VC has a plan to change the driving control mode of the automobile M, the driving control device VC can transmit the plan to the excitement level adjusting device 10 via the data collecting unit 41.

[0034] The content reading unit 43 may be, for example, an optical disc reading device (optical disc drive, etc.) for an optical disc such as a CD (Compact Disc), a DVD, or a BD (Blu-ray (registered trademark) Disc), or may be communicably connected to such a device. It may also be an interface with digital media, such as a USB terminal, or a wireless communication device such as a Wi-Fi communication device or a Bluetooth (registered trademark) communication device. That is, the excitement level adjusting device 10 can acquire content data from the outside via the content reading unit 43.

[0035] The control unit 35 is capable of reproducing content data read from the outside via the content reading unit, and displaying a video or image (hereinafter simply referred to as video) of the content on the display 19A via the output unit 39. The control unit 35 is also capable of reproducing content data read from the outside via the content reading unit, and causing the speaker 21 to generate a sound including the voice and sound of the content.

[0036] [Operation as an excitability memory device] The operation of the excitement level adjustment device 10 when it functions as an excitement level storage device will be described below. When functioning as an excitement level storage device, the excitement level adjustment device 10 plays content and receives and acquires an input of an evaluated excitement level, which is an evaluation by the driver of the automobile M of the level of excitement of the driver during the playback of the content. In the following description, the evaluated excitement level by the driver (hereinafter also referred to as a user) and the actual excitement level, which is the actual excitement level of the driver, are assumed to be three levels, from 1 to 3. Furthermore, the autonomous driving levels in the following description are autonomous driving levels defined by, for example, the Japanese government or the National Highway Traffic Safety Administration (NHTSA) of the U.S. Department of Transportation.

[0037] When functioning as an excitement level storage device, the excitement level adjustment device 10 acquires behavioral features of the driver during playback of content and the driver's evaluated excitement level when the behavioral features are detected. The excitement level adjustment device 10 aggregates the detected behavioral features of the driver for each level of evaluated excitement when the behavioral features are detected. Then, the excitement level adjustment device 10 calculates a reference value as a feature corresponding to each excitement level, such as an average value of the behavioral features at each excitement level, from the feature values ​​aggregated for each level of evaluated excitement. The excitement level adjustment device 10 associates each excitement level with the feature corresponding to that excitement level and stores them.

[0038] When determining the actual excitement level of the driver of automobile M from the behavioral features of the driver, it is possible to use a predetermined reference value for the determination. However, by using a reference value calculated by aggregating the behavioral features for each evaluated excitement level of the driver of automobile M, it is possible to estimate or determine the actual excitement level of the driver taking into account the individual characteristics of the behavior of the driver of automobile M. In other words, by using the calculated reference value, it is possible to more accurately determine the excitement level of the driver of automobile M from the behavioral features of the driver.

[0039] The excitement level adjusting device 10 can provide a reference value of the feature amount that contributes to accurate determination of the driver's excitement level.

[0040] [An example of a routine for operation as an excitability memory device] An example of an operation routine of the excitement level adjusting device 10 when it functions as an excitement level storage device will be described below.

[0041] 3 is a diagram showing an excitement level storage routine R1 as an example of an operation routine. The excitement level storage routine R1 is repeatedly executed when the excitement level adjusting device 10 is powered on, for example.

[0042] When the excitement level storage routine R1 is started, the control unit 35 first determines whether or not the playback of the content has started (step S1). If it is determined in step S1 that the playback of the content has not started (step S1: NO), the routine R1 ends.

[0043] For example, when a driver or the like performs a content playback operation via the touchpad 19B, playback of the content is started by the control unit 35. Note that, in playing back the content, the content read from the content reading unit 43 may be played back, or the content stored in the mass storage device 33 may be played back.

[0044] In step S1, when it is determined that playback of the content has started (step S1: YES), control unit 35 acquires behavioral features including motion features and voice features of the driver (step S2). For example, control unit 35 detects and acquires behavioral features of the driver from the video obtained from upper body camera 11 and lower body camera 13 and the voice obtained from microphone 15. In this step S1, control unit 35 functions as a feature detection unit.

[0045] In acquiring these behavioral features, the above-described behavioral features relating to the driver's movements may be calculated and acquired, for example, by motion capturing the movements of each part of the driver's body from images obtained from the upper body camera 11 and the lower body camera 13.

[0046] When step S2 is completed, the control unit 35 acquires the autonomous driving level (step S3). This autonomous driving level can be acquired from the driving control device VC via the data collection unit 41, as described above.

[0047] When step S3 is completed, the control unit 35 determines whether or not the playback of the content has finished (step S4). If it is determined in step S4 that the playback of the content has not finished (step S4: NO), the control unit 35 repeatedly executes step S4.

[0048] In step S4, if it is determined that the playback of the content has ended (step S4: YES), the control unit 35 waits for input of an evaluation excitement level from the driver (step S5). When waiting for input of the evaluation excitement level, options for the evaluation excitement level may be displayed on the display 19A to prompt the driver to input the evaluation excitement level on the touchpad 19B. In this step S5, the control unit 35 functions as an excitement level acquisition unit.

[0049] After executing step S5, the control unit 35 determines whether or not an evaluated excitement level has been input (step S6). This determination can be made based on whether or not a level of the evaluated excitement level has been selected via the touchpad 19B. If it is determined in step S6 that an evaluated excitement level has not been input (step S6: NO), the control unit 35 executes step S5 again and waits for input of an evaluated excitement level.

[0050] In step S6, if it is determined that the evaluation excitement level has been input (step S6: YES), the control unit 35 stores the content being played and the acquired evaluation excitement level, autonomous driving level, and behavior feature amount as excitement level data in the excitement level database 33A (step S7). In this step S7, the control unit 35 functions as a feature amount storage unit.

[0051] 4 shows an excitement level data table T1, which is an example of excitement level data stored in the excitement level database 33A. In the excitement level data table T1 shown in FIG. 4, as an example, a data ID is assigned to each excitement level data, and the content, the autonomous driving level when the content is being played, the evaluated excitement level, and each feature amount are arranged in this order from left to right. Note that the excitement level data table T1 does not distinguish between autonomous driving levels 3 and above. This is because, for example, at autonomous driving levels 3 and above, it is thought that the driver's physical freedom does not change and no difference in the tendency of behavioral features will occur.

[0052] When step S7 is completed, the control unit 35 totalizes the excitement level data stored in the excitement level database 33A after the excitement level data has been added in step S6, calculates the reference value of the feature amount that can be used as the criterion for determining the actual excitement level, and stores this in the excitement level database 33A (step S8).

[0053] The reference value that can be used as a criterion for determining the actual excitement level may be the average value of the behavioral features associated with the same evaluated excitement level for each body part. For example, the reference value corresponding to Level 1 of the evaluated excitement level may be found by calculating the average value of the features associated with data ID1, ID3, ID7, etc., which are data having the same evaluated excitement level, in the excitement level data table T1 shown in Figure 4.

[0054] 5 shows a reference value table T2, which is an example of the reference value data stored in the excitement level database 33 A. As shown in the reference value table T2, the reference values ​​of the feature quantities of each body part and the reference values ​​of the feature quantities of the voice are stored in correspondence with each level of excitement level, i.e., linked to each level of excitement level.

[0055] In this way, the excitement level adjustment device 10 functioning as the above-described excitement level storage device stores, for each excitement level, a reference value for each feature that serves as a criterion for determining whether the driver is at one of the respective excitement levels. By using such reference values, it becomes easier to accurately determine the actual excitement level from the driver feature, taking into account the driver's behavioral habits. In other words, the excitement level adjustment device 10 functioning as the above-described excitement level storage device can provide reference values ​​that contribute to accurately determining the actual excitement level, taking into account the driver's behavioral habits.

[0056] When determining the level of excitement using these reference values, for example, a set of reference features is determined that is most similar to each feature of the driver calculated from the video signals obtained from upper body camera 11 and lower body camera 13 and the audio signal obtained from microphone 15. Then, the actual excitement level of the driver may be determined to be the excitement level linked to the set of reference features.

[0057] In the above explanation, the driver's physical freedom may differ depending on the level of autonomous driving.

[0058] For example, at automated driving level 0, the driver must manually perform all operations related to driving the vehicle, so the driver is unable to take his / her hands off the steering wheel and cannot take his / her feet off the accelerator or brake. On the other hand, at automated driving level 3 or higher, steering and acceleration / deceleration are automated, so the driver can move his / her hands relatively freely.

[0059] In order to calculate the reference value of the feature that takes into account the degree of physical freedom due to differences in the level of autonomous driving, the feature may be aggregated for each situation with the same level of excitement and the same level of autonomous driving, and the reference value of each feature may be calculated and saved.

[0060] 6 shows a reference value table T3, which is an example of reference value data stored in the excitement level database 33A. As shown in the reference value table T3, the reference feature amount may be stored in association with each combination of excitement level and autonomous driving level.

[0061] In this way, by further subdividing the reference values ​​that serve as criteria for determining the degree of excitement according to the level of autonomous driving, it is possible to provide reference values ​​that contribute to more accurate judgments.

[0062] The excitement level adjustment device 10 may function as an excitement suppression device that determines the excitement level using the reference value and performs suppression action to suppress the driver's excitement level when it determines that the excitement level exceeds a predetermined threshold. In this case, the excitement level adjustment device 10 may acquire the driver's behavioral feature amount during a predetermined time period and determine the driver's excitement level based on the behavioral feature amount and the reference value.

[0063] [Operation as an excitement level determination device] The following describes the operation of the excitement level adjustment device 10 when it functions as an excitement level determination device. In the following description, it is assumed that the larger the behavioral feature, the higher the excitement level. When functioning as an excitement level determination device, the excitement level adjustment device 10 acquires behavioral feature values ​​of each body part of the driver of the automobile M and driving control information of the automobile M when the behavioral feature values ​​were acquired. The driving control information includes an autonomous driving level. Then, the excitement level of the driver is determined based on the acquired behavioral feature values ​​and driving control information.

[0064] The autonomous driving level changes the degree of dependency of the driving control of the automobile M on the driver. Therefore, the autonomous driving level can also be said to be dependency information regarding the degree of dependency of the driving control of the automobile M on the driver.

[0065] It is predicted that the degree of freedom of a driver's physical movements will differ depending on the level of autonomous driving. Therefore, by taking the autonomous driving level into account when determining the level of excitement based on behavioral features, it may be possible to accurately determine the level of excitement of a driver.

[0066] When determining the excitement level, the excitement level adjustment device 10 may correct the behavior feature amount based on the autonomous driving level and determine the excitement level using the corrected value. In other words, the correction coefficient for the behavior feature amount may be set individually for each autonomous driving level.

[0067] Furthermore, the correction of the behavior feature may be performed individually for each behavior feature of each part of the driver's body, i.e., the correction coefficient for the behavior feature may be set individually for each behavior feature of each part of the driver's body.

[0068] The degree of freedom of movement of each part of the driver's body varies depending on the situation of autonomous driving. For example, when steering must be performed manually, the degree of freedom of movement of the upper body is low. Also, for example, when acceleration and deceleration must be performed manually, the degree of freedom of movement of the lower body is low. Therefore, by correcting the behavioral features based on the autonomous driving level for each part of the driver's body, it may be possible to determine the level of excitement by taking into account the degree of freedom of each part of the driver's body.

[0069] The excitement level adjustment device 10 may change the excitement level determination reference value, which is a reference value used to determine the excitement level, based on the autonomous driving level, without correcting the behavioral feature amount.

[0070] Furthermore, the excitement level adjustment device 10 may be configured to determine a lower excitement level as the autonomous driving level becomes higher. For example, when determining the excitement level, the excitement level adjustment device 10 may be configured to decrease the corrected value of the behavioral feature amount as the autonomous driving level becomes higher. Furthermore, when determining the excitement level, the excitement level adjustment device 10 may be configured to increase the reference value used for determining the excitement level as the autonomous driving level becomes higher.

[0071] Generally, the higher the autonomous driving level, the greater the freedom of the driver's physical movements. Therefore, the lower the autonomous driving level, i.e., the greater the dependency on the driver, the more likely the excitement level is to be determined to be high, which may enable the excitement level to be determined appropriately.

[0072] [Example of operation routine for operation as an excitement level determination device] An example of an operation routine of the excitement level adjusting device 10 when it functions as an excitement level determining device will be described below.

[0073] 7 is a diagram showing an excitement level determination routine R2 as an example of an operation routine. The excitement level determination routine R2 is repeatedly executed when the excitement level adjusting device 10 is powered on, for example.

[0074] When the excitement level storage routine R2 is started, the control unit 35 first detects and acquires behavioral features including an action feature and a voice feature of the driver (step S1). In this step S1, the control unit 35 functions as a feature detection unit.

[0075] For example, control unit 35 acquires behavioral features of the driver from the video obtained from upper body camera 11 and lower body camera 13 and the audio obtained from microphone 15. In acquiring these behavioral features, the motion features related to the driver's movements described above may be calculated and acquired by motion capturing the movements of each part of the driver's body from the video obtained from upper body camera 11 and lower body camera 13, for example.

[0076] When step S1 is completed, the control unit 35 acquires the autonomous driving level (step S2). As described above, this autonomous driving level can be acquired from the driving control device VC via the data collection unit 41. In step S2, the control unit 35 functions as a driving control information acquisition unit.

[0077] After step S2 is completed, the control unit 35 corrects each of the behavioral feature amounts acquired in step S1 based on the autonomous driving level (step S3). For example, this correction may be performed by multiplying each of the behavioral feature amounts by a coefficient that increases as the autonomous driving level increases. In other words, the more operations the driver performs to drive the automobile M, that is, the higher the degree to which the driving control of the automobile M depends on the driver, the larger the coefficient that may be multiplied by each of the behavioral feature amounts.

[0078] As described above, different correction values ​​may be set for each behavior feature. For example, when the autonomous driving level is 1 or 2, if steering is automated, the hand behavior feature may be multiplied by a correction value of 0.7, and other behavior feature values ​​may not be corrected. When acceleration and deceleration are automated, the foot behavior feature may be multiplied by a correction value of 0.8, and other behavior feature values ​​may not be corrected. Furthermore, when the autonomous driving level is 3 or higher, all action feature values ​​may be multiplied by a correction value of 0.5, and voice feature values ​​may not be corrected.

[0079] After step S3 is completed, the control unit 35 determines the excitement level of the driver using the correction value acquired in step S3 (step S4). In step S4, the control unit 35 functions as an excitement level determination unit. This excitement level determination may be made based on a preset reference value. Alternatively, this excitement level determination may be made based on a reference value of the behavioral feature calculated and stored by the excitement level adjustment device 10 using the above-described function as an excitement level storage device.

[0080] In this way, the excitement level adjustment device 10 functioning as the above-described excitement level determination device can determine the excitement level taking into account differences in automation levels. Specifically, for example, the excitement level of a driver can be determined based on behavioral features while taking into account the physical freedom of the driver, which differs depending on the automation level. This makes it possible to accurately determine the excitement level of a driver.

[0081] In the above description of the excitement level determination routine R2, each of the behavioral feature amounts is corrected in step S3, but each of the behavioral feature amounts does not have to be corrected. In this case, the reference value that is preset for determining the excitement level may be corrected based on the level of automatic driving of the automobile M, or the mode of automatic driving control such as automatic acceleration / deceleration control or automatic steering control.

[0082] [Operation as an excitation suppressor (Pattern 1)] An example of the operation of the excitement level adjustment device 10 when functioning as an excitement level suppression device will be described below. In the following description, it is assumed that the larger the behavioral feature value, the higher the excitement level. When functioning as an excitement level suppression device, the excitement level adjustment device 10 acquires behavioral feature values ​​of each body part of the driver of the automobile M and the autonomous driving level of the automobile M when the behavioral feature value is acquired.

[0083] The excitement level adjustment device 10 determines the excitement level of the driver based on the acquired behavioral feature amount. Then, the excitement level adjustment device 10 determines whether the determined excitement level exceeds an excitement level threshold determined based on the current autonomous driving level of the automobile M, and if it determines that the excitement level exceeds the excitement level threshold, it executes an operation to suppress the excitement level of the driver.

[0084] This operation of suppressing the excitement level may be, for example, an operation of playing video content or audio or sound content via display 19A or speaker 21 that reduces the excitement level of the driver, that is, that calms the driver.

[0085] The excitement level adjustment device 10 may set the excitement level threshold lower as the autonomous driving level becomes lower, i.e., as the degree of dependency on the driver for driving control of the automobile M becomes higher. Furthermore, the determination of whether the excitement level threshold has been exceeded may be made based on whether the average value of the driver's behavioral feature amounts exceeds a predetermined threshold, or whether one or more of the individual behavioral feature amounts exceed a threshold set for each individual behavioral feature amount.

[0086] The excitement level adjustment device 10, which functions as the excitement level suppression device described above, can appropriately control the driver's excitement level according to the level of automatic driving, i.e., the degree of dependence of the driving control of the automobile M on the driver, thereby bringing the driver into a state appropriate for driving.

[0087] [An example of a behavioral routine for operation as an excitability suppressor (Pattern 1)] An example of an operation routine of the excitement level adjustment device 10 when it functions as an excitement level reduction device will be described below. Fig. 8 is a diagram showing an excitement level reduction routine R3 as an example of an operation routine. The excitement level reduction routine R3 is repeatedly executed, for example, when the excitement level adjustment device 10 is powered on.

[0088] When the excitement level reduction routine R3 is started, the control unit 35 first acquires behavioral features including motion features and voice features of the driver as an excitement level (step S1). For example, the control unit 35 acquires the behavioral features of the driver from the video obtained from the upper body camera 11 and the lower body camera 13 and the voice obtained from the microphone 15. In step S1, the control unit 35 functions as an excitement level acquisition unit.

[0089] In acquiring these behavioral features, the above-described behavioral features relating to the driver's movements may be calculated and acquired, for example, by motion capturing the movements of each part of the driver's body from images obtained from the upper body camera 11 and the lower body camera 13.

[0090] When step S1 is completed, the control unit 35 acquires the autonomous driving level (step S2). As described above, this autonomous driving level can be acquired from the driving control device VC via the data collection unit 41. In step S2, the control unit 35 functions as a driving control information acquisition unit.

[0091] When step S2 is completed, the control unit 35 determines whether the excitement level acquired in step S1 exceeds an excitement level threshold determined corresponding to the autonomous driving level (step S3). In step S3, the control unit 35 functions as an excitement level determination unit. In this determination, if the average of the behavioral features of each body part acquired in step S1 exceeds the feature threshold determined corresponding to the autonomous driving level, it may be determined that the excitement level has exceeded the excitement level threshold.

[0092] In addition, in this judgment, if one or more of the behavioral features of each part of the body acquired in step S1 exceed a feature threshold value set for each behavioral feature of each part of the body corresponding to the autonomous driving level, it may be determined that the excitement level has exceeded the excitement threshold value.

[0093] In step S3, if it is determined that the excitement level does not exceed the threshold (step S3: NO), the routine then ends. If it is determined in step S3 that the excitement level exceeds the threshold (step S3: YES), the control unit 35 executes an excitement level suppression operation to suppress the driver's excitement level (step S4). In this step S4, the control unit 35 functions as an excitement suppression unit. As described above, this excitement level suppression operation may be, for example, an operation to play content that reduces the driver's excitement level, i.e., calms the driver, via the display 19A or the speaker 21, or an operation to play content with a low excitement level stored in the excitement level storage device.

[0094] In the above description of the excitement level suppression routine R3, in step S3, it is determined whether the excitement level has exceeded the excitement level threshold value using the feature amount threshold value determined according to the autonomous driving level.

[0095] However, the feature threshold may be determined not only according to the level of autonomous driving but also according to the mode of autonomous driving control. For example, when the steering control is automatic, the driver does not need to operate the steering wheel and has a high degree of freedom in hand movement, so the threshold for the feature related to hand movement may be increased or eliminated. Also, for example, when the acceleration / deceleration control is automatic, the driver does not need to operate the accelerator or brake and has a high degree of freedom in foot movement, so the threshold for the feature related to foot movement may be increased or eliminated.

[0096] [Operation as an excitation suppressor (Pattern 2)] An example of the operation of the excitement level adjusting device 10 when functioning as an excitement level suppressing device will be described below. In the following description, it is assumed that the greater the behavioral feature amount, the higher the excitement level.

[0097] When functioning as an excitement level suppression device, the excitement level adjustment device 10 acquires driving control mode transition information (hereinafter also simply referred to as mode transition information) issued from the driving control device VC when there is a transition between driving control modes with different degrees of dependency on the driver, for example, a transition between autonomous driving levels. The mode transition information includes, for example, information on the current driving control mode and the driving control mode after the transition. In other words, the mode transition information is information related to the transition of driving control modes.

[0098] When the excitement level adjustment device 10 receives, i.e., acquires, the mode transition information, it determines whether the post-transition driving control mode is more dependent on the driver than the pre-transition driving control mode. Specifically, for example, it determines whether the post-transition autonomous driving level is lower than the pre-transition autonomous driving level.

[0099] When the excitement level adjustment device 10 determines that the driving control mode after the transition is more dependent on the driver than the driving control mode before the transition, it executes an operation to suppress the driver's excitement level. This operation to suppress the excitement level may be, for example, an operation to play video content or audio or sound content that reduces the driver's excitement level, i.e., calms the driver, via the display 19A or the speaker 21.

[0100] The excitement level adjustment device 10 may acquire the driver's current excitement level, determine whether it exceeds an excitement level threshold determined based on the driving control mode after the transition, for example, an autonomous driving level, and, if it determines that the excitement level threshold is exceeded, execute an operation to suppress the driver's excitement level. The driver's excitement level may be calculated based on the driver's behavioral features.

[0101] Furthermore, when the acquired driver's excitement level exceeds the excitement level threshold, the excitement level adjustment device 10 may perform an operation that has a greater effect of suppressing the excitement level, the greater the difference between the acquired driver's excitement level and the excitement level threshold. Furthermore, the excitement level adjustment device 10 may perform an operation that has a greater effect of suppressing the excitement level, the shorter the time until the transition to the driving control mode.

[0102] The effect of suppressing the excitement level may be greater as the mellower the melody of the music being played, specifically, as the pitch of the music being played slower.

[0103] According to the excitement level adjustment device 10 that functions as the excitement level suppression device described above, when the driving control mode shifts to a mode that is more dependent on the driver, it is possible to control the driver's excitement level and bring the driver into a state appropriate for driving.

[0104] [An example of a routine for operation as an excitability suppressor (Pattern 2)] An example of an operation routine of the excitement level adjustment device 10 when it functions as an excitement level reduction device will be described below. Fig. 9 is a diagram showing an excitement level reduction routine R4 as an example of an operation routine. The excitement level reduction routine R4 is repeatedly executed, for example, when the excitement level adjustment device 10 is powered on.

[0105] When the excitement reduction routine R4 is started, the control unit 35 first waits for the arrival of mode transition information (step S1). The mode transition information is issued from the driving control device VC when the driving control device VC determines that the driving control mode will be transitioned. This determination may be made, for example, by the driving control device VC acquiring position information from the GPS receiver 17 and determining whether the allowable autonomous driving levels for the current location and the soon-to-be-arrived location differ.

[0106] When step S1 is completed, control unit 35 determines whether mode transition information has arrived and been received (step S2). In steps S1 and S2, control unit 35 functions as a mode transition information acquisition unit. If it is determined in step S2 that mode transition information has not yet been received (step S2: NO), control unit 35 continues to execute step S1 and waits for the arrival of mode transition information.

[0107] If it is determined in step S2 that mode transition information has been received (step S2: YES), the control unit 35 determines whether the driving control mode will transition to a mode with high driver dependency (step S3). In this determination, for example, the driving control mode may transition to a mode with high driver dependency by determining that the autonomous driving level after the transition is lower than the current driving level before the transition.

[0108] In step S3, if it is determined that the vehicle will not transition to a driving control mode that is highly dependent on the driver (step S3: NO), that is, if it is determined that the degree of dependency on the driver will remain the same as the current control mode or that the degree of dependency on the driver will decrease, routine R4 ends.

[0109] In step S3, if it is determined that the driving control mode will be changed to one that is highly dependent on the driver (step S3: YES), the control unit 35 determines whether the current excitement level exceeds the excitement level threshold determined by the driving control mode to which the mode will be changed (step S4).

[0110] In step S4, for example, control unit 35 acquires behavioral features of each body part based on information from upper body camera 11, lower body camera 13, or microphone 15. Then, if the average of the acquired behavioral features of each body part exceeds a feature threshold determined in accordance with the driving control mode, for example, the autonomous driving level, it may be determined that the excitement level exceeds the excitement threshold.

[0111] In addition, in step S4, if one or more of the acquired behavioral features of each part of the body exceed a feature threshold value that is set for each behavioral feature of each part of the body in accordance with the driving control mode, for example, the autonomous driving level, it may be determined that the excitement level exceeds the excitement threshold value.

[0112] In step S4, if it is determined that the excitement level exceeds the threshold (step S4: YES), the control unit 35 executes an excitement level suppression operation to suppress the excitement level of the driver (step S5). In steps S3 to S5, the control unit 35 functions as an excitement suppression unit. As described above, this excitement level suppression operation may be, for example, an operation of playing content that reduces the excitement level of the driver via the display 19A or the speaker 21.

[0113] When step S5 is completed or when it is determined in step S4 that the excitement level exceeds the threshold (step S4: NO), the control unit 35 determines whether or not the timing for switching the driving control mode has arrived (step S6). This determination may be made, for example, by the control unit 35 inquiring of the driving control device VC about the timing for switching the driving control mode.

[0114] In step S6, if it is determined that the timing to switch to the control mode has arrived (step S6: NO), the control unit 35 ends the excitement level suppression operation, and the routine ends. In step S6, if it is determined that the timing to switch to the control mode has not yet arrived (step S6: NO), the control unit 35 executes step S4 again, and if the excitement level still exceeds the threshold, continues the excitement level suppression operation.

[0115] In the excitement level reduction routine R4, the difference between the excitement level and the excitement level threshold or the time until the transition to the driving control mode is not taken into consideration, but these may be taken into consideration.

[0116] 10 shows the excitement suppression routine R5 when taking into account the difference between the excitement level and the excitement level threshold or the time until the transition of the driving control mode. The excitement suppression routine R5 differs only in part from the excitement suppression routine R4, so only the different parts will be explained.

[0117] In the excitement level reduction routine R5, if it is determined in step S4 that the excitement level exceeds the threshold value (step S4: YES), the control unit 35 determines whether the time until the transition to the driving control mode is less than a predetermined time (step S4-1).

[0118] In step S4-1, if it is determined that there is more than a predetermined time until the transition of the driving control mode (step S4-1: YES), the control unit 35 determines whether the difference between the driver's current excitement level and the excitement level threshold determined by the driving control mode after the transition is more than a predetermined value (step S4-2).

[0119] If it is determined in step S4-2 that the difference between the current excitement level and the excitement level threshold is equal to or less than a predetermined value (step S4-2: NO), the control unit 35 executes a normal excitement level suppression operation (step S5-1). If it is determined in step S4-1 that the time until the transition to the driving control mode is less than a predetermined time (step S4-1: YES) or if it is determined in step S4-2 that the difference between the current excitement level and the excitement level threshold is equal to or greater than a predetermined value (step S4-2: YES), the control unit 35 executes a special excitement level suppression operation (step S5-2).

[0120] This special excitement suppression operation is more effective in suppressing (reducing) the driver's excitement than the normal excitement suppression operation. For example, the special excitement suppression operation may be performed by playing music with a softer melody than that played in the normal excitement suppression operation.

[0121] [Operation as a content selection device] An example of the operation of the excitement level adjusting device 10 when it functions as a content selection device will be described below.

[0122] When functioning as a content selection device, the excitement level adjustment device 10 plays content such as video or audio, acquires the behavioral characteristics of the driver while the content is being played, and stores and accumulates them in association with content information, which is information about the content.

[0123] When functioning as a content selection device, the excitement level adjustment device 10 selects the next content to be played after one content when the first content is played, based on the stored content information and the behavioral features linked to it.

[0124] For example, this content selection is performed by selecting content that is similar in excitement and mood to the one content being played (hereinafter simply referred to as excitement level) of the user. In the following explanation, if there is a high degree of agreement between the user's behavioral features of one content and other content, it is determined that the one content and other content are similar in excitement to the user.

[0125] Therefore, the excitement level reduction device 10 selects from among the other contents based on a comparison between the behavioral feature associated with the one piece of content currently being played and the behavioral feature associated with the other content. For example, the excitement level reduction device 10 selects from among the other contents based on a comparison between the behavioral feature associated with the one piece of content currently being played and the behavioral feature associated with the other content. Specifically, for example, the excitement level reduction device 10 selects from among the other contents a content associated with a behavioral feature that is highly similar to the behavioral feature associated with the one piece of content currently being played.

[0126] The degree of similarity of the behavioral features may be evaluated by comparing the linked behavioral features of one content with other content for each body part, and evaluating the degree of similarity as high when the total difference in the features is small.

[0127] Furthermore, the degree of matching of the behavioral features may be evaluated by comparing the ratio of the behavioral features for each body part linked to one content (for example, head features: hand features: foot features) with the behavioral features for each body part linked to another content, and evaluating the degree of matching as high when the ratio values ​​are highly similar.

[0128] In this way, the excitement reduction device 10 functioning as the content selection device described above can select content to be played back next to the currently played content that is similar to the currently played content in terms of how excited the user is, thereby enabling content to be played back without damaging the user's excitement. Also, when content for reducing the excitement level is being played back, it is possible to play content for reducing the excitement level next.

[0129] [Example of an operating routine for operation as a content selection device] An example of an operation routine of the excitement level adjusting device 10 when it functions as an excitement level storage device will be described below.

[0130] 11 is a diagram showing an excitement level accumulation routine R6 as an example of an operation routine for accumulating how excited the user is. The excitement level accumulation routine R6 is repeatedly executed, for example, when the excitement level adjusting device 10 is powered on.

[0131] When the excitement level accumulation routine R6 starts, the control unit 35 first determines whether or not content playback has started (step S1). If it is determined in step S1 that content playback has not started (step S1: NO), the routine R6 ends.

[0132] In step S1, when it is determined that playback of the content has started (step S1: YES), control unit 35 detects and acquires behavioral features including motion features and voice features of the driver (step S2). In this step S2, control unit 35 functions as a feature detection unit. For example, control unit 35 acquires behavioral features of the driver from the video obtained from upper body camera 11 and lower body camera 13 and the voice obtained from microphone 15.

[0133] In acquiring these behavioral features, the above-described behavioral features relating to the driver's movements may be calculated and acquired, for example, by motion capturing the movements of each part of the driver's body from images obtained from the upper body camera 11 and the lower body camera 13.

[0134] When step S2 ends, the control unit 35 determines whether or not the playback of the content has ended (step S3). If it is determined in step S3 that the playback of the content has not ended (step S3: NO), the control unit 35 repeatedly executes step S3.

[0135] If it is determined in step S3 that the playback of the content has ended (step S4: YES), the control unit 35 stores the content that has been played and the behavioral feature amount as excitement level data in the excitement level database 33A (step S4). In this step S4, the control unit 35 functions as a storage unit.

[0136] Here, the data stored in the excitement level database 33A may be, for example, the excitement level data table T1 shown in FIG. 4 in the above description, excluding the automatic driving level and the evaluated excitement level.

[0137] In this way, the excitement level accumulation routine R6 accumulates information including content and behavioral features linked to the content.

[0138] 12 is a diagram showing a content playback routine R7 in which the user selects as the next content a content that is similarly exciting to the content currently being played and plays it back. The content playback routine R7 may be started, for example, when a content playback operation is received from the user via the touchpad 19B or the like.

[0139] When the content playback routine is started, first, the control unit 35 starts playing back the content (step S1). In this step S1, the control unit 35 functions as a content playback unit. When step S1 ends, the control unit 35 selects content that excites the user in a manner similar to that of the content being played back (step S2). In this step S3, the control unit 35 functions as a content selection unit.

[0140] For example, in this selection, the control unit 35 first refers to the data stored in the excitement level database 33A by the above-mentioned excitement level accumulation routine R5, reads out the behavior feature associated with the content being played back, and then selects the content associated with the behavior feature that most closely matches the read-out behavior feature as the next playback content to be played back.

[0141] After step S2 is completed, control unit 35 determines whether a playback end operation has been received from the user (step S3). This determination may be made based on whether a content playback end operation has been received from the user via touchpad 19B or the like, for example.

[0142] If it is determined in step S3 that a playback end operation has been received (step S3: YES), routine R7 ends.

[0143] If it is determined in step S3 that a playback end operation has not been accepted (step S3: NO), the control unit 35 determines whether the currently played content has ended (step S4). If it is determined in step S4 that the currently played content has not ended (step S4: NO), the control unit 35 executes step S4 again.

[0144] In step S4, if it is determined that the currently played content has ended (step S4: YES), the control unit 35 plays the next content selected in step S2 (step S5). After step S5 ends, the control unit 35 executes step S2 again.

[0145] According to the excitement level adjusting device 10 described in the first embodiment, it is possible to effectively adjust the excitement level of the driver, thereby making it possible to assist the driver in driving.

[0146] The configuration, routines, data format, etc. of the excitement level adjusting device 10 in the above-described embodiment are merely examples, and can be appropriately selected or changed depending on the application, etc. [Explanation of symbols]

[0147] 10 Excitement level adjustment device 31 System Bus 33 Mass storage 35 Control Unit

Claims

1. a feature acquisition unit that detects feature amounts related to the behavior of a driver of a mobile object; a driving control information acquisition unit that acquires driving control information that is information about a driving control state of the moving object when the feature amount is detected; and an excitement level determination unit that determines the driver's excitement level based on the result of correcting the feature amount based on the driving control information.

2. The excitement level determination device described in claim 1, characterized in that the features include a plurality of individual features obtained for each part of the driver's body, and the excitement level determination unit determines the driver's excitement level based on the results of correcting each of the plurality of individual features based on the driving control information.

3. The excitement level determination device described in claim 2, characterized in that the driving control information includes dependency information regarding the dependency of the driving control of the mobile body on the driver, and the excitement level determination unit determines the excitement level of the driver based on the result of correcting each of the multiple individual features by a correction coefficient set corresponding to the dependency.

4. 4. The excitement level determination device according to claim 3, wherein the correction coefficient is set for each of the plurality of individual feature amounts.

5. 5. The excitement level determination device according to claim 3, wherein the excitement level determination unit is more likely to determine the excitement level to be high as the dependency level increases.

6. The excitement level determination device described in claim 1, characterized in that the excitement level determination unit determines the excitement level based on an excitement level determination reference value which is a reference value for determining the excitement level and which changes based on the driving control information.

Images