Control device

By obtaining user information from the vehicle and selecting appropriate multimedia content for playback, the problem of not being able to select playback content based on user information in existing technologies is solved, thus improving playback quality and user experience.

CN122086341APending Publication Date: 2026-05-26TOYOTA JIDOSHA KK
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
TOYOTA JIDOSHA KK
Filing Date
2025-11-03
Publication Date
2026-05-26

AI Technical Summary

Technical Problem

Existing multimedia content display devices in vehicles cannot select suitable playback content based on the information of passengers, resulting in poor playback quality.

Method used

By installing a user information acquisition device in the vehicle, user information is obtained and specific multimedia content is selected for playback based on this information. Combined with the output control of the display and speakers, the switching and playback of animations can be realized.

Benefits of technology

Selecting appropriate multimedia content based on user information improves the adaptability of multimedia content playback and user experience in vehicles.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122086341A_ABST
    Figure CN122086341A_ABST
Patent Text Reader

Abstract

The invention relates to a control device. The control device includes an execution device and a non-transitory computer-readable storage medium. The storage medium stores a plurality of playback contents. The playback content is a content in which a plurality of movies are switched and displayed on a display. The execution device acquires user information of a user seated in a vehicle. The execution device selects specific content from among the plurality of playback content on the basis of the acquired user information. The execution device displays the animation on the display by playing the selected specific content.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to control devices. Background Technology

[0002] Japanese Patent Publication No. 2024-509999 describes a multimedia content display device. For this multimedia content display device, if a display mode is selected, the animation is displayed in that mode.

[0003] It should be noted that the multimedia content display device described in Japanese Patent Publication No. 2024-509999 sometimes uses a vehicle-mounted display as a control device. Such a control device sometimes stores playback content. The playback content consists of multiple animations that are switched and displayed on the display. However, the control device may not be able to play playback content suitable for users traveling in a vehicle. Summary of the Invention

[0004] One aspect of this disclosure involves a control device configured to control output to a display mounted in a vehicle. The control device includes a non-transitory computer-readable storage medium and an execution device. The storage medium stores multiple playback contents. The playback contents are multiple animations that are switched and displayed on the display. The execution device is configured to obtain user information of a user riding in the vehicle, select specific content from the multiple playback contents based on the obtained user information, and cause the display to output the animation by playing the selected specific content. Attached Figure Description

[0005] Figure 1 This is a simplified diagram representing one embodiment of the vehicle.

[0006] Figure 2 This is an explanatory diagram showing the playback content of this embodiment.

[0007] Figure 3 This is a flowchart illustrating a series of processes, including selection and playback, for the content to be played in this embodiment.

[0008] Figure 4 This is a series of flowcharts illustrating the processes related to controlling the display of the monitor in this embodiment.

[0009] Figure 5 This is a schematic diagram showing the start image included in the start animation of the display mode of this embodiment.

[0010] Figure 6 This is a schematic diagram illustrating the parking images included in the parking animation of this embodiment.

[0011] Figure 7This is a schematic diagram showing the first guide image included in the parking animation of this embodiment.

[0012] Figure 8 This is a schematic diagram showing the first driving image included in the first driving animation of this embodiment.

[0013] Figure 9 This is a schematic diagram showing the second guide image included in the first driving animation of this embodiment.

[0014] Figure 10 This is a schematic diagram showing the driving assistance images included in the driving assistance animation of this embodiment.

[0015] Figure 11 This is a schematic diagram showing the third guide image included in the animation of the driving assistance in this embodiment.

[0016] Figure 12 This is a schematic diagram showing the charging images included in the charging animation of this embodiment.

[0017] Figure 13 This is a schematic diagram showing the fourth guide image included in the charging animation of this embodiment.

[0018] Figure 14 This is a schematic diagram showing the second driving image included in the second driving animation of this embodiment. Detailed Implementation

[0019] Hereinafter, one embodiment of the control device will be described with reference to the accompanying drawings.

[0020] <Vehicle Overview>

[0021] like Figure 1 As shown, vehicle 10 includes a charging port 21, a charging device 22, a battery 23, and a drive motor 24. Vehicle 10 is an electric vehicle.

[0022] The charging port 21 is connected to the charging connector 90 on the outside of the vehicle 10. When the charging connector 90 is connected to the charging port 21, the battery 23 can be charged from an external power source of the vehicle 10.

[0023] The drive motor 24 is the driving source for the vehicle 10. The drive motor 24 uses electricity stored in the battery 23 to drive the vehicle 10. The battery 23 stores the electricity that enables the drive motor 24 to operate.

[0024] The charging device 22 includes a relay and a power conversion circuit that selectively switches the connection and disconnection of the power path from the charging port 21 to the battery 23. By controlling the charging device 22, the battery 23 is charged.

[0025] The vehicle 10 is equipped with a braking device 31 and a steering device 32. The braking device 31 mechanically brakes the wheels of the vehicle 10. The braking device 31 is a so-called mechanical brake. For example, the braking device 31 is a disc brake.

[0026] The steering device 32 is a rack and pinion electric steering system. The steering device 32 can change the orientation of the steering wheels of the vehicle 10 by controlling the rack and pinion (not shown).

[0027] Vehicle 10 includes a display 41 and a speaker 42. The display 41 is mounted on vehicle 10. The display 41 is located at a position that the driver of vehicle 10 can visually view while vehicle 10 is in motion. In this embodiment, the display 41 is a central display. The display 41 displays images and animations. The speaker 42 outputs sound to the interior of vehicle 10.

[0028] Vehicle 10 is equipped with a user information acquisition device 43. The user information acquisition device 43 acquires information about the users riding in vehicle 10, namely user information US. The user information acquisition device 43 includes a camera that takes pictures of the interior of vehicle 10.

[0029] The user information acquisition device 43 calculates user information US based on images captured by the camera, indicating the number of users riding in the vehicle 10, the gender of each user, and the age group of each user. The user information acquisition device 43 outputs the acquired user information US to the control device 70.

[0030] The vehicle 10 includes multiple sensors 50, multiple operating elements 60, and a control device 70. The multiple sensors 50 include, for example, a vehicle speed sensor, a gear position sensor, a sonar sensor, and a camera sensor. Among them, in... Figure 1 In this diagram, only two of the multiple sensors 50 are shown. Sensor 50 outputs detection signals to the control device 70.

[0031] The operating element 60 can be operated by the driver while the vehicle 10 is in motion. The operating element 60 is operated to achieve the functions required for the vehicle 10 to operate. These functions include driving functions, charging functions, and driver assistance functions. If operation of the operating element 60 is detected, an operation signal is output to the control device 70.

[0032] Multiple operating components 60 include an accelerator pedal 61 and a brake pedal 62. The accelerator pedal 61 is operated by the driver pressing it with their foot while the vehicle 10 is in motion. That is, the accelerator pedal 61 is operated to perform the function of moving the vehicle 10 in the driving function.

[0033] The brake pedal 62 is operated by the driver pressing it with their foot when adjusting deceleration while the vehicle 10 is in motion. That is, the brake pedal 62 is operated to achieve the function of stopping the vehicle 10 in the driving function.

[0034] The vehicle 10 is equipped with a steering wheel 63. The steering wheel 63 includes a steering wheel body 64, multiple switches 65, a first touch display 66, and a second touch display 67. The steering wheel body 64 is operated by the driver when adjusting the steering angle while the vehicle 10 is in motion. That is, the steering wheel body 64 is operated to realize the function of turning the vehicle 10 in the driving function.

[0035] Switch 65 is operated by the driver while the vehicle 10 is in motion. For example, if switch 65 is operated, the turn indicator lights and the hazard warning lights of the vehicle 10 flash. That is, switch 65 is operated to achieve the functions required for driving of the vehicle 10.

[0036] The first touch display 66 is located near the steering wheel body 64. The first touch display 66 is operated by the driver while the vehicle 10 is in motion. The first touch display 66 displays, for example, the operation screen of the driving assistance functions described later. That is, the first touch display 66 is operated to enable the driving functions of the vehicle 10.

[0037] The second touchscreen display 67 is located near the steering wheel body 64. The second touchscreen display 67 is operated by the driver when the vehicle 10 is in motion. The second touchscreen display 67 displays, for example, a screen that allows selection of the driving mode of the vehicle 10. Driving modes include, for example, economy mode and sport mode. That is, the second touchscreen display 67 is operated to enable the driving functions of the vehicle 10.

[0038] In this embodiment, the first touch display 66 is located on the front side window glass side of the vehicle 10, closer to the driver's seat than the steering wheel body 64. The second touch display 67 is located on the passenger side side of the vehicle 10, closer to the passenger seat than the steering wheel body 64.

[0039] The multiple operating components 60 include a steering wheel body 64, a switch 65, a first touch display 66, and a second touch display 67. Additionally, the multiple operating components 60 include a charging operation button 68.

[0040] A charging operation button 68 is located near the driver's seat of the vehicle 10. By performing a predetermined operation on the charging operation button 68, the charging port 21 can be connected to an external charging connector 90 of the vehicle 10. Specifically, when the charging operation button 68 is operated, the control device 70 opens the cover covering the connection port of the charging port 21. The charging operation button 68 is only usable when the vehicle 10 is not in motion or when the vehicle 10 is in motion at a predetermined speed below a certain speed. That is, the charging operation button 68 is operated to enable the charging function of the vehicle 10.

[0041] <Control Device>

[0042] The control device 70 controls the charging, driving, driving assistance, and multimedia output of the vehicle 10. The control device 70 includes an execution unit 71 as a central processing unit (CPU) and a storage unit 72 as a memory. The storage unit 72 stores various programs that the execution unit 71 executes. The execution unit 71 controls the charging, driving, driving assistance, and multimedia output of the vehicle 10 by executing these various programs. The execution unit 71 is a processing circuit containing one or more processors that execute various processes according to computer programs (software). The storage unit 72 is a non-transitory computer-readable storage medium.

[0043] The control device 70 controls the charging of the vehicle 10. When the charging operation button 68 is operated as specified, the control device 70 opens the cover of the charging port 21. Next, if it is detected that the charging connector 90 is connected to the charging port 21, the control device 70 controls the charging device 22 to begin charging the battery 23. The control device 70 controls the charging device 22 to end charging the battery 23 by referring to the charging rate of the battery 23.

[0044] The control unit 70 controls the movement of the vehicle 10. The control unit 70 uses electricity stored in the battery 23 to drive the drive motor 24. The control unit 70 controls the output of the drive motor 24 based on the amount of operation of the accelerator pedal 61. The control unit 70 controls the output of the braking device 31 based on the amount of operation of the brake pedal 62. The control unit 70 controls the steering device 32 based on the amount of operation of the steering wheel body 64.

[0045] The control unit 70 controls the driving assistance of the vehicle 10. The control unit 70 can implement multiple functions included in the Advanced Driver Assistance System (ADAS). These ADAS functions include Pre-Crash Safety (PCS) and Adaptive Cruise Control (ACC). Detailed explanations of the specific implementation methods for each function are omitted. The control unit 70 implements these functions based on detection signals from the sensor 50. Again, detailed explanations of the specific implementation methods for each function are omitted.

[0046] The control device 70 controls the output of multimedia content in the vehicle 10. In particular, the control device 70 controls the output to the display 41 and the speaker 42 in the display mode of the vehicle 10 when it is not in motion.

[0047] Storage device 72 stores output program PR for multimedia content output in the display mode of vehicle 10. Additionally, storage device 72 stores multiple playback content CTs.

[0048] Playback content (CT) is used to play multimedia content. Playback content (CT) contains multiple animation files (DA). Animation files (DA) are data files used for playing animations. Playback content (CT) is the content displayed on monitor 41 by switching between multiple animation files (DA) at predetermined intervals.

[0049] The animation file DA contains sound data that, if output to display 41, will be output to speaker 42. The image data contains multiple images in a time sequence. The sound data, for example, contains data representing music that matches the time sequence of the image data.

[0050] In addition, the storage device 72 stores multiple playback content CTs. The multiple playback content CTs include a first playback content CT1, a second playback content CT2, a third playback content CT3, and a fourth playback content CT4. The first playback content CT1 is content that progresses through a standard scene.

[0051] like Figure 2As shown, the first playback content CT1 contains multiple animation files DA. These multiple animation files DA include a first file D1 for playing the display mode start animation M1, a second file D2 for playing the parking animation M2, and a third file D3 for playing the first driving animation M3. Additionally, these multiple animation files DA include a fourth file D4 for playing the driver assistance animation M4, and a fifth file D5 for playing the charging animation M5. Furthermore, these multiple animation files DA include a sixth file D6 for playing the second driving animation M6, and a seventh file D7 for playing the display mode end animation M7. Thus, in this embodiment, the first playback content CT1 stores seven animation files DA.

[0052] In this embodiment, the combination of the first animation and the second animation in the first playback content CT1 can be one of the following six cases. In the first combination, the display mode start animation M1 is the first animation, and the first file D1 is the first animation file used to play the first animation. In this case, the parking animation M2 is the second animation, and the second file D2 is the second animation file used to play the second animation.

[0053] In the second combination, the parking animation M2 is the first animation, and the second file D2 is the first animation file. At this time, the first driving animation M3 is the second animation, and the third file D3 is the second animation file.

[0054] In the third combination, the first driving animation M3 is the first animation, and the third file D3 is the first animation file. At this time, the driving assistance animation M4 is the second animation, and the fourth file D4 is the second animation file.

[0055] In the fourth combination, the driver assistance animation M4 is the first animation, and the fourth file D4 is the first animation file. At this time, the charging animation M5 is the second animation, and the fifth file D5 is the second animation file.

[0056] In the fifth combination, the charging animation M5 is the first animation, and the fifth file D5 is the first animation file. At this time, the second driving animation M6 is the second animation, and the sixth file D6 is the second animation file.

[0057] In the sixth group, the second driving animation M6 is the first animation, and the sixth file D6 is the first animation file. At this time, the display mode end animation M7 is the second animation, and the seventh file D7 is the second animation file.

[0058] As described below, the first driving animation M3, the driver assistance animation M4, and the second driving animation M6 are all images simulating the state of the vehicle 10 while it is in motion. Therefore, in the second to sixth combinations, at least one of the first and second animations is an image simulating the state of the vehicle 10 while it is in motion.

[0059] Details regarding the second playback content CT2, the third playback content CT3, and the fourth playback content CT4 are omitted, but all or part of the multiple playback content CTs are different from each other.

[0060] The second play, CT2, is presented in a scenario geared towards multiple users, including children. The third play, CT3, is presented in a scenario simulating high-speed driving. The fourth play, CT4, is presented in a scenario simulating driving in a city.

[0061] <Selection and playback of playback content>

[0062] If a multimedia display is initiated in vehicle 10 in presentation mode, the execution device 71 begins executing program PR, assuming vehicle 10 is not in motion. If the execution device 71 begins executing program PR, it selects and plays playback content CT based on user information US. If vehicle 10 is in park and its speed is zero, the execution device 71 determines that vehicle 10 is not in motion.

[0063] like Figure 3 As shown, if the execution device 71 begins to output the execution of program PR, the execution device 71 first performs the processing in step S11. In step S11, the execution device 71 obtains user information US from the user information acquisition device 43. After that, the execution device 71 causes the processing to proceed to step S12.

[0064] In step S12, the execution device 71 selects one playback content CT, i.e., a specific content CS, from multiple playback content CTs based on user information US. The execution device 71 uses the user information US as input to a mapping determined in advance through experimentation and simulation, and calculates a value representing the specific content CS as the output value.

[0065] For example, when the number of users in the user information US is 1 and the user's gender is female, the execution device 71 selects the 4th playback content CT4 as the specific content CS regardless of the age group.

[0066] When the number of users in the user information US is 1 and the user's gender is male, the execution device 71 selects the third playback content CT3 as the specific content CS, regardless of the age group.

[0067] When the number of users in the user information US is 2 or more, including users under the age of 10, the execution device 71 selects the third playback content CT3 as the specific content CS, regardless of the user's gender.

[0068] When the number of users in the user information US is two or more and does not include users under the age of 10, the execution device 71 selects the first playback content CT1 as the specific content CS, regardless of the user's gender. Then, the execution device 71 proceeds to step S13.

[0069] In step S13, the execution device 71 begins playback of the specific content CS selected in step S12. Detailed processing of the playback of the specific content CS will be described later. Then, the execution device 71 causes the process to proceed to step S14.

[0070] In step S14, the execution device 71 determines whether the specific content CS is completed. Specifically, the execution device 71 determines that the specific content CS is completed when the entire scene of the specific content CS is completed, that is, when the final animation is finished playing.

[0071] When the specific content CS is completed (S14: Yes), the execution device 71 ends the current series of processes. On the other hand, when the specific content CS is not completed (S14: No), the execution device 71 causes the process to proceed to step S15.

[0072] In step S15, the execution device 71 determines whether a predetermined time has elapsed since the start of playback of the specific content CS. The predetermined time is a time predetermined through experimentation and simulation, representing the time during which the progression of the scene of the specific content CS pauses midway. If the predetermined time has not elapsed (S15: No), the execution device 71 returns the process to step S14. On the other hand, if the predetermined time has elapsed (S15: Yes), the execution device 71 terminates the current series of processes.

[0073] <Details on playback of specific content>

[0074] If playback of a specific content CS begins after the processing in step S14 described above, the execution device 71 uses multiple animation files DA to perform a series of processes related to multimedia output. Hereinafter, the first playback content CT1 will be selected as the specific content CS for explanation.

[0075] <Start Animation for Display Mode>

[0076] like Figure 4 As shown, if the execution device 71 begins to output the execution of program PR, it first performs the processing of step S21. In step S21, the execution device 71 plays the display mode start animation M1. Specifically, the execution device 71 displays an image represented by the image data contained in the first file D1 used to play the display mode start animation M1 on the display 41, and outputs sound represented by the sound data contained in the first file D1 to the speaker 42.

[0077] like Figure 5 As shown, the display mode start animation M1 includes a start image IM1 representing the start of the display mode. The start image IM1 includes an appearance image IP1 representing the exterior of the vehicle 10. For example, the display mode start animation M1 is an animation that shows the exterior of the vehicle 10 viewed from different directions in a time sequence, changing the image of the vehicle 10 viewed from the front, the right side, the rear, and the left side.

[0078] like Figure 4 As shown, after the execution device 71 displays the display mode start animation M1, if a predetermined period has elapsed, the playback of the display mode start animation M1 ends. Then, the execution device 71 proceeds to step S22.

[0079] In step S22, the execution device 71 plays the parking animation M2. Specifically, the execution device 71 displays an image represented by the image data contained in the second file D2 used to play the parking animation M2 on the display 41, and outputs sound represented by the sound data contained in the second file D2 to the speaker 42.

[0080] <Animation of Parking>

[0081] like Figure 6 As shown, the parking animation M2 includes a parking image IM2 simulating the view from the driver's seat when the vehicle 10 is stopped. The parking image IM2 is an image from the driver's perspective, viewed from the driver's seat of the vehicle 10. The driver's perspective image is an image within the range forward observed from the driver's seat of the vehicle 10, including a steering wheel image V63 representing the steering wheel 63 and a partial image IP2 representing a portion of the windshield of the vehicle 10. Additionally, the driver's perspective image is an image within the range forward observed from the driver's seat of the vehicle 10, including a partial image IP3 representing a portion of the front side window glass of the vehicle 10 on the driver's side. The steering wheel image V63 includes a steering wheel body image V64 representing the steering wheel body 64 and a switch image V65 representing the switch 65. The steering wheel image V63 also includes a first touch display image V66 representing the first touch display 66 and a second touch display image V67 representing the second touch display 67. The parking image IM2 shows the driver's hands gripping the steering wheel body 64.

[0082] like Figure 7As shown, the parking animation M2 includes the first guide image IM3, which is located later in the time sequence than the parking image IM2. The first guide image IM3 and the parking image IM2 are both images from the driver's perspective. The first guide image IM3 is an image representing the operation of a first specific operation 60A for switching to the next animation, which is a predetermined operation 60.

[0083] The first specific operation element 60A is an operation element 60 used to switch the display to the next animation when the parking animation M2 is displayed. In this embodiment, the first specific operation element 60A is the first touch display 66. The first guidance image IM3 includes a partial image IP4 that guides the operation of the first touch display 66. Specifically, the partial image IP4 shows the driver's right hand operating the first touch display 66, which is the first specific operation element 60A.

[0084] In the continuous images of the parking animation M2 over time, the images showing the scenery outside the vehicle 10 do not change. Specifically, the continuous images of the parking animation M2 over time do not include images showing the scenery outside the vehicle 10.

[0085] like Figure 4 As shown, after the execution device 71 displays the parking animation M2 in step S22, the process proceeds to step S23. In step S23, the execution device 71 determines whether the first specific operation element 60A has been operated. If the first specific operation element 60A, i.e., the first touch display 66, has not been operated (S23: No), the execution device 71 repeatedly performs the process of step S23. On the other hand, if the first specific operation element 60A has been operated (S23: Yes), the execution device 71 proceeds to step S24. The parking animation M2 continues to play until the determination in step S23 is affirmative.

[0086] In step S24, the execution device 71 plays the first driving animation M3 instead of the parking animation M2. Specifically, the execution device 71 displays an image represented by the image data contained in the third file D3 used to play the first driving animation M3 on the display 41, and outputs sound represented by the sound data contained in the third file D3 to the speaker 42.

[0087] That is, when the vehicle 10 is not in motion and the display 41 shows the parking animation M2, the actuator 71, on the condition that the first specific operation member 60A is operated, replaces the parking animation M2 and displays the first driving animation M3 on the display 41.

[0088] <First Animation During Driving>

[0089] like Figure 8 As shown, the first driving animation M3 includes the first driving image IM4, which simulates the view from the driver's seat when the vehicle 10 is in motion. The first driving image IM4 is an image of the vehicle 10 in motion. The first driving image IM4 and the parking image IM2 are also images from the driver's perspective.

[0090] The first driving image IM4 has a first background image IP5 showing the scenery outside the vehicle 10. The first background image IP5 shows the situation of driving on a road surrounded by trees. Moreover, in the continuous images of the first driving animation M3, the images showing the scenery outside the vehicle 10 change as the vehicle 10 is driving.

[0091] like Figure 9 As shown, the first driving animation M3 includes the second guide image IM5, which is located later in the time sequence than the first driving image IM4. The second guide image IM5 and the parking image IM2 are both from the driver's perspective. The second guide image IM5 has a text image IP6 indicating a message asking whether to activate a driver assistance function. The text image IP6 shows the operation of switch 65 when activating ADAS functions. Specifically, the text image IP6 displays the message "Please operate switch 65 when activating driver assistance functions."

[0092] like Figure 4 As shown, after displaying the first driving animation M3 in step S24, the execution device 71 proceeds to step S25. In step S25, the execution device 71 determines whether a request for driving assistance has been made. A request for driving assistance refers to operating the second specific operation element 60B. The second specific operation element 60B is a pre-determined operation element 60 used to switch to the next animation following the first driving animation M3. The second specific operation element 60B is a switch 65. Therefore, the execution device 71 determines whether a request for driving assistance has been made using the switch 65.

[0093] When the operation of requesting driving assistance using switch 65 is not performed (S25: No), the execution device 71 repeatedly performs the processing of step S25. On the other hand, when the operation of requesting driving assistance using switch 65 is performed (S25: Yes), the execution device 71 causes the processing to proceed to step S26. In this process, the first driving animation M3 continues to be played until it is determined to be affirmative in step S25.

[0094] <Animations in Driving Assistance>

[0095] In step S26, the actuator 71 plays the driving assistance animation M4. Specifically, the actuator 71 displays an image represented by the image data contained in the fourth file D4 used to play the driving assistance animation M4 on the display 41, and outputs sound represented by the sound data contained in the fourth file D4 to the speaker 42.

[0096] That is, when the vehicle 10 is not in motion and the display 41 shows the first in-motion animation M3, the actuator 71, on the condition that the second specific operation element 60B has been operated, replaces the first in-motion animation M3 with the driver assistance animation M4 displayed on the display 41. The condition at this time is that an operation to request driver assistance using the second specific operation element 60B has been performed.

[0097] like Figure 10 As shown, the driver assistance animation M4 includes a driver assistance image IM6 simulating the state of vehicle 10 when it is driving and performing driver assistance functions. Driver assistance image IM6 represents the state of vehicle 10 when performing driver assistance functions. Both driver assistance image IM6 and parking image IM2 are images from the driver's perspective.

[0098] The driver assistance image IM6 has a second background image IP7 showing the scenery outside the vehicle 10. The second background image IP7 is a different scenery from the first background image IP5. Additionally, the driver assistance image IM6 has a partial image IP8 showing a vehicle traveling in front of the vehicle 10. In this embodiment, the partial image IP8 uses a simulated icon to indicate the vehicle traveling in front.

[0099] Image IM6 in the driver assistance section includes a portion of image IP9 representing the driver assistance process currently in operation. Image IP9 representing the driver assistance process in operation, for example, illustrates the functions of the driver assistance being performed, such as setting the vehicle speed, detecting a vehicle ahead, and setting the inter-vehicle distance. Figure 10 In the example shown, part of the image IP9 indicates that ACC is being executed.

[0100] like Figure 11 As shown, the driver assistance animation M4 includes the third guide image IM7, which is located later in the time sequence than the driver assistance image IM6. The third guide image IM7 and the parking image IM2 are both driver-view images. The third guide image IM7 includes a partial image IP10 guiding the operation for charging the battery 23. Partial image IP10 shows the operation of the charging operation button 68 located on the driver's seat of the vehicle 10.

[0101] like Figure 4As shown, after displaying the driver assistance animation M4 in step S26, the execution device 71 proceeds to step S27. In step S27, the execution device 71 determines whether a charging operation has been performed. The charging operation refers to operating the third specific operation element 60C. The third specific operation element 60C is a pre-determined operation element 60 for switching to the next animation after driver assistance animation M4. The third specific operation element 60C is the charging operation button 68. Therefore, the execution device 71 determines whether a charging operation using the charging operation button 68 has been performed.

[0102] When the charging operation button 68 is not operated (S27: No), the execution device 71 repeatedly performs the process of step S27. When the charging operation button 68 is operated (S27: Yes), the execution device 71 causes the process to proceed to step S28. During this process, the driving assistance animation M4 continues to play until the determination is affirmative in step S27.

[0103] In step S28, the execution device 71 plays the charging animation M5. Specifically, the execution device 71 displays an image represented by the image data contained in the fifth file D5 used to play the charging animation M5 on the display 41, and outputs sound represented by the sound data contained in the fifth file D5 to the speaker 42.

[0104] That is, when the vehicle 10 is not in motion and the display 41 shows the driver assistance animation M4, the actuator 71, on the condition that the third specific operation member 60C is operated, replaces the driver assistance animation M4 with the charging animation M5 on the display 41. The condition at this time is that the charging operation using the third specific operation member 60C has been performed.

[0105] <Animation While Charging>

[0106] like Figure 12 As shown, the charging animation M5 includes a charging image IM8 simulating the charging of the battery 23 of vehicle 10. The charging image IM8 is an image simulating the charging of the battery 23 of vehicle 10. The charging image IM8 shows the state of the charging connector 90 connected to the charging port 21 of vehicle 10. Furthermore, the charging image IM8 shows the battery 23 of vehicle 10 being charged. The charging animation M5 shows the gradual increase in the power stored in the battery 23.

[0107] like Figure 13As shown, the charging animation M5 includes the fourth guide image IM9, which is located later in the time sequence than the charging image IM8. The fourth guide image IM9 and the parking image IM2 are both images from the driver's perspective. The fourth guide image IM9 is an image representing the operation of a fourth specific operation 60D, which is a pre-determined operation 60 used to switch to the next animation, the charging animation M5.

[0108] The fourth specific operation element 60D is an operation element 60 used to switch the display to the next animation when the charging animation M5 is displayed. In this embodiment, the fourth specific operation element 60D is the second touch display 67. The fourth guide image IM9 includes a portion of image IP11 that guides the operation of the second touch display 67.

[0109] like Figure 4 As shown, after displaying the charging animation M5 in step S28, the execution device 71 proceeds to step S29. In step S29, the execution device 71 determines whether the fourth specific operation member 60D has been operated. If the fourth specific operation member 60D, i.e., the second touch display 67, has not been operated (S29: No), the execution device 71 repeatedly performs the process of step S29. On the other hand, if the fourth specific operation member 60D has been operated (S29: Yes), the execution device 71 proceeds to step S30. The charging animation M5 continues to be displayed until the process of step S29 is determined to be affirmative.

[0110] In step S30, the execution device 71 displays the second driving animation M6. Specifically, the execution device 71 displays an image represented by the image data contained in the sixth file D6 used to play the second driving animation M6 on the display 41, and outputs sound represented by the sound data contained in the sixth file D6 to the speaker 42.

[0111] That is, when the vehicle 10 is not in motion and the display 41 shows the charging animation M5, the actuator 71, on the condition that the fourth specific operation member 60D is operated, replaces the charging animation M5 and displays the second driving animation M6 on the display 41.

[0112] <Second Animation During Driving>

[0113] like Figure 14As shown, the second driving animation M6 includes a second driving image IM10 simulating the view from the driver's seat when the vehicle 10 is in motion. The second driving image IM10 is an image simulating the vehicle 10 in motion. The second driving image IM10 is a driver's viewpoint image, but the range it reflects differs from that of the first driving image IM4. Specifically, the range shown in the second driving image IM10 is biased towards the driver's side front side window compared to the range shown in the first driving image IM4. Therefore, the portion of the front side window shown in the second driving image IM10 (IP13) shows a wider range than the portion of the front side window shown in the first driving image IM4 (IP3). On the other hand, the portion of the windshield shown in the second driving image IM10 (IP12) shows a narrower range than the portion of the windshield shown in the first driving image IM4 (IP2). The second driving animation M6 has a third background image IP14 showing the scenery outside the vehicle 10. The third background image IP14 is a different landscape from the first background image IP5. Specifically, the third background image IP14 shows a scene of driving along the coast.

[0114] Furthermore, the second driving animation M6 includes a guidance sound in its sound data. This guidance sound indicates a query asking whether the simulated driving state of vehicle 10 should end. The guidance sound, while the second driving animation M6 is displayed, conveys the instruction to operate the fifth specific operation device 60E, which is an operation device 60 used to switch the display to the next animation. In this embodiment, the fifth specific operation device 60E is the brake pedal 62. Specifically, the guidance sound is the message, "Please operate the brake pedal 62 when the vehicle 10 has come to a stop."

[0115] like Figure 4 As shown, after the execution device 71 displays the second driving animation M6 in step S30, the process proceeds to step S31. In step S31, the execution device 71 determines whether the fifth specific operation element 60E has been operated. Specifically, the execution device 71 determines whether the brake pedal 62 has been operated.

[0116] When the fifth specific operation element 60E is not operated (S31: No), the execution device 71 repeatedly performs the processing of step S31. On the other hand, when the fifth specific operation element 60E is operated (S31: Yes), the execution device 71 causes the processing to proceed to step S32. In this process, the second driving animation M6 continues to be played until it is determined to be affirmative in step S31.

[0117] In step S32, the execution device 71 displays the display mode end animation M7. The display mode end animation M7 is an animation that indicates the end of the display in the display mode on the vehicle 10.

[0118] That is, when the vehicle 10 is not in motion and the display 41 is displaying the second in motion animation M6, the actuator 71, on the condition that the fifth specific operation element 60E is operated, replaces the second in motion animation M6 and displays the display mode end animation M7 on the display 41.

[0119] Subsequently, if the playback of the display mode end animation M7 ends, the execution device 71 terminates the current series of processes. In this embodiment, if the playback of the display mode end animation M7 ends, the execution device 71 displays a state indicating that it will again accept the operation to start the display in the display mode.

[0120] <Different content for multiple playbacks>

[0121] The difference between the second playback content CT2 and the first playback content CT1 lies in the first background image IP5 in the first driving image IM4 included in the first driving animation M3. In the second playback content CT2, the first background image IP5 shows the vehicle driving on a road heading towards the amusement park. Furthermore, in the continuous images of the first driving animation M3 over time, the images showing the scenery outside the vehicle 10 change in a manner that gradually approaches the amusement park as the vehicle 10 moves.

[0122] The difference between the third playback content CT3 and the first playback content CT1 lies in the first background image IP5 in the first driving image IM4 included in the first driving animation M3. In the third playback content CT3, the first background image IP5 is shown as driving on a highway. Furthermore, compared to the first playback content CT1, the simulated driving speed of the vehicle 10 in the sequential images of the first driving animation M3 and the driver assistance animation M4 is faster.

[0123] The difference between the fourth playback content CT4 and the first playback content CT1 lies in the first background image IP5 in the first driving image IM4 included in the first driving animation M3. In the fourth playback content CT4, the first background image IP5 shows the vehicle driving on a city road. Furthermore, compared to the first playback content CT1, the simulated driving speed of the vehicle 10 in the sequential images of the first driving animation M3 and the driver assistance animation M4 is slower. Also, in the fourth playback content CT4, some images IP9 show the vehicle executing PCS.

[0124] <Function of the first embodiment>

[0125] According to the first embodiment, if a user sitting in the driver's seat of the vehicle 10 performs an operation to start the display in the display mode, they can experience the multimedia output using the display 41 and the speaker 42.

[0126] If the user initiates a display in the presentation mode, playback of the specific content CS selected based on the user information US will begin. Thus, the user can experience the specific content CS selected from multiple playback content CTs based on the user's user information US.

[0127] <Effects of the Implementation Method>

[0128] (1) The control device 70 selects a specific content CS from multiple playback content CTs based on the user information US of the user riding in the vehicle 10. Therefore, by playing the playback content CT selected based on the user information US, the control device 70 can display an animation suitable for the user on the display 41.

[0129] (2) The multiple animations displayed on the display 41 by playing specific content CS include a driving animation, which contains images simulating the vehicle 10 in motion. Therefore, when the specific content CS is played, a user riding in the vehicle 10 can view an animation showing the vehicle 10 in motion on the display 41 when the vehicle 10 is not in motion.

[0130] (3) The image simulating the state of vehicle 10 in motion is an image of the range in front of the driver's seat of vehicle 10, including the steering wheel image V63 of vehicle 10 and a partial image IP2 showing a portion of the windshield of vehicle 10. Therefore, the user sitting in the driver's seat of vehicle 10 can watch an animation of driving vehicle 10 in the state of vehicle 10 in motion. Thus, the user sitting in the driver's seat of vehicle 10 can experience the state of driving vehicle 10 in a simulated way.

[0131] (4) The image that simulates the state of the vehicle 10 while it is in motion is a partial image IP3 of the area in front of the view from the driver's seat of the vehicle 10, which includes a portion of the front side window glass showing the driver's seat side of the vehicle 10. Therefore, the user sitting in the driver's seat of the vehicle 10 can experience the simulated view of the scenery, etc., through the front side window glass while driving the vehicle 10.

[0132] (5) Multiple animations, including a charging animation M5, are displayed on the display 41 by playing specific content CS. Thus, a user riding in the vehicle 10 can watch the status of the battery 23 while it is charging. In particular, for example, for a user who is considering purchasing the vehicle 10 as an electric vehicle, being able to experience the operation of charging the battery 23 before purchasing can influence their purchase intention.

[0133] (6) Multiple animations, including the driving assistance animation M4, are displayed on the display 41 by playing specific content CS. Thus, a user riding in the vehicle 10 can watch the state of driving assistance being activated through the animation. In particular, for example, for a user who has never used the driving assistance function, even if driving assistance is not activated, they can still gain a sense of security when driving assistance is activated by watching the state of driving assistance being activated.

[0134] (7) The storage device 72 stores a first animation file for playing the first animation and a second animation file for playing the second animation. Specifically, the multiple animation files DA include the first animation file and the second animation file. Moreover, when the vehicle 10 is not in motion and the display 41 is displaying the first animation, the execution device 71, on the condition that the operation member 60 is operated, replaces the first animation and displays the second animation on the display 41.

[0135] Based on the above configuration, when a user in the driver's seat of vehicle 10 operates the control unit 60, they can experience the switching of animations displayed on the display 41. Therefore, the control device 70 can provide the user of vehicle 10 with an experience where animations simulating the driving of vehicle 10, displayed on the display 41, switch as vehicle 10 is operated.

[0136] (8) The execution device 71 displays the second animation in place of the first animation, provided that a specific operation 60 among the plurality of operation elements 60 is operated. That is, even if an operation element 60 different from the specific operation element 60 is operated, the execution device 71 does not switch the animation displayed on the display 41. Therefore, the control device 70 can link the type of operation element 60 with the display on the display 41.

[0137] <Example of Change>

[0138] The above-described embodiments can be implemented by modification as follows. The above-described embodiments and the following modifications can be combined with each other within a technically compatible scope.

[0139] Vehicle 10 is not limited to electric vehicles. For example, vehicle 10 may also use an engine as a power source. In this case, vehicle 10 may not have a battery 23. In addition, vehicle 10 may not have a charging port 21 and a charging device 22.

[0140] Vehicle 10 includes a display 41 and a speaker 42 for outputting multimedia content, but the multimedia content may also include content such as fragrance and vibration. In this case, vehicle 10 may also include a device for outputting fragrance and a device for outputting vibration. Alternatively, vehicle 10 may not include a speaker 42 as long as it can at least output image data.

[0141] Display 41 is not limited to a central display. For example, display 41 can also be an instrument display, and a first touch display 66 and a second touch display 67 can serve as display 41. Furthermore, display 41 does not necessarily have to be a single screen. For example, a central display and an instrument display can be used as display 41.

[0142] The vehicle 10 only needs to have at least one operating element 60. Multiple operating elements 60 may also exclude the accelerator pedal 61, brake pedal 62, steering wheel body 64, multiple switches 65, first touch display 66, second touch display 67, and part of charging operation button 68.

[0143] The plurality of operating elements 60 are not limited to the examples of the above embodiments. For example, the plurality of operating elements 60 may also include switches for opening and closing the front side windows. Additionally, if the display 41 is a touch display, the plurality of operating elements 60 may be switches displayed on the display 41. Furthermore, for example, the plurality of operating elements 60 may also be a gear lever. Preferably, the operating elements 60 are components used to operate functions required for driving the vehicle 10.

[0144] The control device 70 includes an execution device 71, which is a processing circuitry comprising one or more processors that perform various processes according to a computer program (software). However, the control device 70 may also include a processing circuitry comprising one or more application-specific integrated circuits (ASICs) or combinations thereof that perform at least a portion of the various processes. The processor includes a CPU, RAM, ROM, and other memories. The memories store program code or instructions configured to cause the CPU to perform processes. Memory, or computer-readable medium, includes all available media that can be accessed by a general-purpose or special-purpose computer.

[0145] The control device 70 may also not control the charging in the vehicle 10. For example, if the vehicle 10 is not using the battery 23 as a power source, charging may not be controlled. Alternatively, the charging of the battery 23 in the vehicle 10 may be controlled by a device different from the control device 70.

[0146] The control unit 70 may also not control the driving of the vehicle 10. For example, the driving of the vehicle 10 may be controlled by a device different from the control unit 70. The control unit 70 may also not control the driving assistance in the vehicle 10. For example, the driving assistance in the vehicle 10 may be controlled by a device different from the control unit 70. Specifically, the control unit 70 may be a multimedia ECU that controls the output of multimedia systems, and the vehicle 10 may also have a driving assistance ECU that controls the driving assistance of the vehicle 10.

[0147] Driving assistance is not limited to the examples of the above embodiments. Driving assistance is not limited to advanced driver assistance systems. Driving assistance is any system that assists the functions of the braking device 31, the drive motor 24 as a drive source, and the steering device 32 based on the detection signals of the sensor 50.

[0148] The control device 70 only needs to be able to display the animation on the display 41, and it may not need to output sound from the speaker 42. In addition, the control device 70 can also control the output of fragrance from the fragrance output device and the output of vibration from the vibration output device in the above-described modified example based on the animation.

[0149] The multiple animation files DA stored in storage device 72 are not limited to the examples of the above embodiments. For example, the multiple animation files DA may also include files for playing animations of driving during nighttime periods and files for playing animations of driving during daytime periods. In addition, for example, the multiple animation files DA may also include files for playing animations containing images showing the appearance of the vehicle 10 in motion.

[0150] The animation file DA contains images that simulate the state of the vehicle 10 while it is in motion, i.e., images of the vehicle in motion, or images of a portion of the front side window glass on the driver's side that are not included in the range of the animation file DA.

[0151] Furthermore, the image of a vehicle in motion does not necessarily have to be from the driver's perspective. For example, the image of a vehicle in motion could be from the perspective of a passenger in the front passenger seat, or it could be an image showing the exterior of the vehicle 10 in motion.

[0152] The images exemplified in the above embodiments contained in each animation can also be appropriately modified. For example, the text image IP6 in the second guidance image IM5, which represents the message asking whether to perform the driving assistance function, can be shown as an illustration, or the image can be omitted and the message can be conveyed through sound data. Alternatively, the text image IP6 can be shown and sound data can be output.

[0153] Additionally, for example, the portion of image IP8 included in the driver assistance image IM6, which shows a vehicle traveling in front of vehicle 10, illustrates a virtual illustration, but it could also be an illustration of a vehicle traveling in front. Furthermore, the control device 70 can also display the portion of image IP9 included in the driver assistance image IM6, which indicates that driver assistance is being performed, and also output the display of the instrument panel when actual driver assistance is being performed.

[0154] The storage device 72 may omit a portion of the five combinations of the first and second animations. The storage device 72 only needs to store at least one combination of the first and second animations. Furthermore, the execution device 71 only needs to switch the animations within at least one combination of the first and second animations. Moreover, the combinations are not limited to the examples described in the above embodiments. For example, the execution device 71 may switch from the first driving animation M3 to the charging animation M5.

[0155] The specific operation element 60 used to switch each animation to the next animation is not limited to the examples of the above embodiments. For example, the specific operation element 60 used to switch from the parking animation M2 to the first driving animation M3 could also be the accelerator pedal 61.

[0156] The control device 70 can also switch the display of the display 41 from the first animation to the second animation when any one of the multiple operating elements 60 is operated. That is, the execution device 71 can also display the second animation without the condition that a specific operating element 60 predetermined among the multiple operating elements 60 is operated.

[0157] The control device 70 can also display the charging animation M5 without requiring an operation to request charging of the battery 23. For example, it can be conditional only on the operation of a specific operating element 60.

[0158] The control device 70 can also display the animation M4 in the driving assistance without requiring an operation to request driving assistance. For example, it can be conditional only on the operation of a specific operating element 60.

[0159] As a condition for switching animations, the control device 70 may not require the operation of the operating element 60. For example, the control device 70 may switch to the next animation if the playback time of the displayed animation has elapsed. The playback content CT can be any content displayed on the monitor 41 that switches between multiple animations.

[0160] The differences between the multiple playback content CTs are not limited to the examples of the embodiments described above. For example, the second playback content CT2 may not include the fifth file D5 for playing the charging animation M5. Additionally, the third playback content CT3 may include multiple files for playing animations during driver assistance. Thus, the multiple playback content CTs may have different playback times, different numbers of included animations, and different types of included animations. Including animations that introduce highly requested functions based on different user information US would be particularly suitable for users who have previously purchased the vehicle 10.

[0161] The method of selecting specific content CS based on user information US is not limited to the examples of the above embodiments. If a highly interesting playback content CT is established in advance through experiments and simulations to correspond with user information US, the execution device 71 only needs to select the playback content CT corresponding to the user information US as the specific content CS.

[0162] The execution device 71 can also play the selected content CS as a condition, after displaying it on the display 41 in a user-selectable manner. In this case, the control device 70 can play the selected content CS if the user is interested in it.

[0163] Storage device 72 can also store multiple animation files DA by retrieving them from an external server or external storage device outside the vehicle 10. For example, storage device 72 can temporarily store the files by retrieving them from an external server or external storage device when execution device 71 starts executing the output program PR.

Claims

1. A control device configured to control the output of a display mounted on a vehicle, wherein, The control device includes a non-transitory computer-readable storage medium and an execution device. The storage medium stores multiple playback contents. The playback content consists of multiple animations that are switched and displayed on the monitor. The actuator is configured as follows: Obtain user information of the users who ride in the vehicle. Based on the obtained user information, specific content is selected from the plurality of playback content. The animation is displayed on the monitor by playing the selected specific content.

2. The control device according to claim 1, wherein, The animations displayed on the display by playing the specific content include a driving animation, which includes images simulating the vehicle in motion.

3. The control device according to claim 2, wherein, The image simulates the vehicle in motion and is a range of images showing the steering wheel and a portion of the windshield of the vehicle as viewed from the driver's seat.

4. The control device according to claim 3, wherein, The image simulating the state of the vehicle while it is in motion is an image of a range in front of the view from the driver's seat, including an image showing a portion of the front side window glass of the vehicle on the driver's side.

5. The control device according to any one of claims 1 to 4, wherein, The animations displayed on the display by playing the specific content include a charging animation, which contains images simulating the charging of the vehicle's battery.

6. The control device according to any one of claims 1 to 4, wherein, The plurality of animations displayed on the display by playing the specific content include animations in driver assistance, which contain images of the vehicle’s driver assistance functions being performed.

7. The control device according to any one of claims 1 to 4, wherein, The multiple animations include animation 1 and animation 2. When the first animation is displayed, if a predetermined condition is met, the execution device replaces the first animation and displays the second animation on the display.

8. The control device according to claim 7, wherein, The vehicle includes multiple operating components. The condition includes the situation where a specific one of the plurality of operating elements is operated.