Display equipment control method and device, equipment and medium
By adjusting the display device's image based on the vehicle's driving status information, the problem of motion sickness during travel has been solved. This achieves consistency between the visual and vestibular systems, preventing motion sickness and improving the travel experience.
Patent Information
- Application Number
- CN202411126467.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-15
- Publication Date
- 2026-03-03
AI Technical Summary
Motion sickness caused by looking at screens during travel, especially dizziness and nausea caused by a conflict between the visual and vestibular systems, urgently needs to be addressed.
By predicting the vehicle's driving status information within a target time period, the video information to be played on the display device is adjusted to match the vehicle's swaying information, thereby reducing the perceptual conflict between the visual system and the vestibular system.
It effectively avoids motion sickness, improves the riding experience, and ensures that the visual system experiences the same swaying sensation as the vestibular system.
Smart Images

Figure CN121603707A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the technical field of display device control, and in particular to a control method for a display device, a control device for a display device, an electronic device, and a computer-readable storage medium. Background Technology
[0002] In practical applications, passengers may watch the in-vehicle screen or other mobile device screens to increase the enjoyment of their ride. When watching the screen, the visual system is constantly staring at it, which causes a conflict between its perception and that of the vestibular system, resulting in symptoms such as dizziness and nausea. This phenomenon is medically known as motion sickness.
[0003] How to prevent passengers from experiencing motion sickness due to looking at screens while traveling has become one of the urgent problems to be solved in the context of traveling by car. Summary of the Invention
[0004] In view of the above problems, a control method for a display device, a control device for a display device, an electronic device, and a computer-readable storage medium are proposed to overcome or at least partially solve the above problems, comprising:
[0005] A method for controlling a display device, the method comprising:
[0006] Predict the vehicle's predicted driving status information within the target time period, and adjust the image information to be played on the display device based on the predicted driving status information;
[0007] The adjusted video information to be played is displayed on the display device.
[0008] Optionally, adjusting the image information to be played on the display device based on the predicted driving state information includes:
[0009] Based on the predicted driving status information, determine the vehicle body sway information within the target time period;
[0010] Generate first image information that matches the vehicle body sway information;
[0011] The video information to be played on the display device during the target time period is replaced with the first video information.
[0012] Optionally, adjusting the image information to be played on the display device based on the predicted driving state information includes:
[0013] Based on the predicted driving status information, determine the vehicle body sway information within the target time period;
[0014] Based on the vehicle body sway information, the position of each frame of the video information to be played is adjusted on the display device.
[0015] Optionally, adjusting the image information to be played on the display device based on the predicted driving state information includes:
[0016] Based on the predicted driving status information, determine the vehicle body sway information within the target time period;
[0017] Acquire second image information that matches the vehicle body sway information;
[0018] Based on the image information to be played and the second image information, generate the third image information;
[0019] Playing the adjusted video information to be played on the display device includes:
[0020] The third image information is played on the display device.
[0021] Optionally, the prediction of the vehicle's predicted driving state information within the target time period includes:
[0022] Obtain the vehicle's historical driving status information, surrounding environment information, and navigation information;
[0023] Based on the historical driving status information, the surrounding environment information, and the navigation information, the predicted driving status information of the vehicle within the target time period is predicted.
[0024] Optionally, the method further includes:
[0025] Based on the predicted driving status information, predict whether the target user will experience motion sickness within the target time period;
[0026] When it is determined that the target user will experience motion sickness during the target time period, the step of adjusting the video information to be played on the display device based on the predicted driving status information is executed.
[0027] Optionally, predicting whether the target user will experience motion sickness during the target time period based on the predicted driving status information includes:
[0028] Based on the predicted driving status information, predict the target probability of the target user experiencing motion sickness within the target time period;
[0029] When the target probability exceeds a preset value, it is determined that the target user will experience motion sickness during the target time period.
[0030] Optionally, predicting the target probability of the target user experiencing motion sickness within a target time period based on the predicted driving status information includes:
[0031] The predicted driving state information is input into the first preset model, and the target probability output by the first preset model is obtained.
[0032] Optionally, predicting the target probability of the target user experiencing motion sickness within a target time period based on the predicted driving status information includes:
[0033] Obtain the user characteristic information of the target user;
[0034] Based on the predicted driving status information and the user characteristic information, predict the target probability of the target user experiencing motion sickness within the target time period.
[0035] Optionally, the method further includes:
[0036] Obtain the preset value set for the target user.
[0037] This invention also provides a control device for a display device, the device comprising:
[0038] The adjustment module is used to predict the vehicle's predicted driving status information within a target time period, and adjust the image information to be played on the display device based on the predicted driving status information.
[0039] A control module is used to play the adjusted video information to be played on the display device.
[0040] Optionally, the adjustment module is configured to determine the vehicle body sway information within the target time period based on the predicted driving state information; generate first image information matching the vehicle body sway information; and replace the image information to be played by the display device within the target time period with the first image information.
[0041] Optionally, the adjustment module is used to determine the vehicle body sway information within the target time period based on the predicted driving state information; and to adjust the position of each frame of the video information to be played on the display device based on the vehicle body sway information.
[0042] Optionally, the adjustment module is configured to determine the vehicle body sway information within the target time period based on the predicted driving state information; acquire second image information matching the vehicle body sway information; and generate third image information based on the image information to be played and the second image information.
[0043] The control module is used to play the third image information on the display device.
[0044] Optionally, the adjustment module is used to acquire the vehicle's historical driving status information, surrounding environment information, and navigation information; and based on the historical driving status information, surrounding environment information, and navigation information, to predict the vehicle's predicted driving status information within a target time period.
[0045] Optionally, the device further includes:
[0046] The prediction module is used to predict whether the target user will experience motion sickness within the target time period based on the predicted driving status information.
[0047] The adjustment module is used to adjust the video information to be played on the display device based on the predicted driving status information when the prediction module determines that the target user will experience motion sickness during the target time period.
[0048] Optionally, the prediction module is used to predict the target probability of the target user experiencing motion sickness within a target time period based on the predicted driving status information; when the target probability exceeds a preset value, it is determined that the target user will experience motion sickness within the target time period.
[0049] Optionally, the prediction module is used to input the predicted driving state information into a first preset model and obtain the target probability output by the first preset model.
[0050] Optionally, the prediction module is used to obtain user characteristic information of the target user; and predict the target probability of the target user experiencing motion sickness within a target time period based on the predicted driving status information and the user characteristic information.
[0051] Optionally, the device further includes:
[0052] The acquisition module is used to acquire the preset value set for the target user.
[0053] This invention also provides an electronic device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, it implements the above-described control method for a display device.
[0054] This invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the above-described control method for a display device.
[0055] The embodiments of the present invention have the following advantages:
[0056] In this embodiment of the invention, the predicted driving state information of the vehicle within a target time period can be predicted first, and the image information to be played on the display device can be adjusted according to the predicted driving state information; then, the adjusted image information to be played on the display device. Compared to playing ordinary image information, this embodiment of the invention plays image information adjusted based on predicted driving state information, which allows the visual system to perceive that the target user is moving when viewing the display device in the vehicle, thereby avoiding motion sickness caused by the perceptual conflict between the visual system and the vestibular system when the target user views the display device in the vehicle. Attached Figure Description
[0057] To more clearly illustrate the technical solution of the present invention, the accompanying drawings used in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0058] Figure 1 This is a flowchart illustrating the steps of a control method for a display device according to an embodiment of the present invention;
[0059] Figure 2 This is a flowchart of another control method for a display device according to an embodiment of the present invention;
[0060] Figure 3 This is a flowchart illustrating the steps of another control method for a display device according to an embodiment of the present invention;
[0061] Figure 4 This is a flowchart illustrating the steps of another control method for a display device according to an embodiment of the present invention;
[0062] Figure 5a This is a flowchart illustrating the steps of another control method for a display device according to an embodiment of the present invention;
[0063] Figure 5b This is a flowchart illustrating the steps of controlling a display device according to an embodiment of the present invention;
[0064] Figure 6 This is a structural block diagram of a control device for a display device according to an embodiment of the present invention. Detailed Implementation
[0065] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without inventive effort are within the scope of protection of the present invention.
[0066] Reference Figure 1 The diagram illustrates a flowchart of a control method for a display device according to an embodiment of the present invention, which may include the following steps:
[0067] Step 101: Predict the vehicle's predicted driving status information within the target time period, and adjust the video information to be played on the display device based on the predicted driving status information.
[0068] Step 102: Play the adjusted video information to be played on the display device.
[0069] The display device can be the vehicle's central control screen, the display screen of the vehicle's multimedia playback device, or the display screen of the target user's mobile terminal. This embodiment of the invention does not limit the type of display device.
[0070] In practical applications, during the vehicle's operation, the predicted driving status information of the vehicle within a future target time period can be predicted; this predicted driving status information may include the vehicle's speed, trajectory, acceleration, deceleration, etc.
[0071] After obtaining the predicted driving status information, the video information to be played on the display device can be adjusted according to the predicted driving status information of the vehicle in the target time period. This adjustment can reduce motion sickness caused by the target user watching the display device. For example, the adjusted video information to be played can be shaky video information that is related to the bumpy situation of the vehicle in the target time period.
[0072] As an example, effects such as rotation and acceleration can be superimposed on the video information to be played. The video information to be played can be image data captured by the vehicle's front-facing camera; new video information can also be generated (for example, a roller coaster moving in a valley, the movement of the roller coaster can be set based on the shaking of the vehicle body; the GPU (Graphics Processing Unit) renders the scene of the roller coaster moving in a way that matches the shaking of the vehicle body).
[0073] After adjusting the video information to be played on the display device based on the predicted driving status information, the adjusted video information can be played on the display device within the target time period. Compared with playing ordinary video information, the present invention's embodiment of playing video information adjusted based on the predicted driving status information allows the target user's visual system to also perceive that the target user is moving, thereby avoiding motion sickness caused by the perceptual conflict between the target user's visual system and vestibular system, thus improving the target user's riding experience.
[0074] In some feasible embodiments, when playing video information, the user may be prompted to stop watching the display device to further reduce the possibility of motion sickness in the target user.
[0075] In this embodiment of the invention, the predicted driving state information of the vehicle within a target time period can be predicted first, and the image information to be played on the display device can be adjusted according to the predicted driving state information; then, the adjusted image information to be played on the display device. Compared to playing ordinary image information, this embodiment of the invention plays image information adjusted based on predicted driving state information, which allows the visual system to perceive that the target user is moving when viewing the display device in the vehicle, thereby avoiding motion sickness caused by the perceptual conflict between the visual system and the vestibular system when the target user views the display device in the vehicle.
[0076] Reference Figure 2 The diagram illustrates a flowchart of another control method for a display device according to an embodiment of the present invention, which may include the following steps:
[0077] Step 201: Predict the vehicle's driving status information within the target time period.
[0078] Step 202: Based on the predicted driving status information, determine the vehicle body sway information within the target time period.
[0079] Step 203: Generate first image information that matches the vehicle body sway information.
[0080] Step 204: Replace the video information to be played on the display device within the target time period with the first video information.
[0081] Step 205: Play the first image information on the display device.
[0082] In practical applications, during the vehicle's operation, the predicted driving status information of the vehicle within a future target time period can be predicted; this predicted driving status information may include the vehicle's speed, trajectory, acceleration, deceleration, etc.
[0083] After obtaining the predicted driving status information, the vehicle body sway information can be determined based on the predicted driving status information within the target time period. This body sway information can include the vehicle's velocity and acceleration in the x-axis, y-axis, and z-axis directions, as well as the rotational velocity and acceleration in the pitch, yaw, and roll directions.
[0084] After obtaining the vehicle body sway information, a first image information matching the vehicle body sway information can be generated. For example, the sway of the image corresponding to the first image information is consistent with or similar to the vehicle body sway information. For instance, the velocity and acceleration of the image corresponding to the first image information in the x-axis, y-axis, and z-axis directions, as well as the rotational velocity and acceleration in the pitch, yaw, and roll directions, are consistent with or similar to the velocity and acceleration in the vehicle body sway information.
[0085] For example, the first image information can be a picture of a roller coaster moving, and the speed and acceleration of the roller coaster in different directions are the same as or similar to the speed and acceleration in the vehicle body shaking information.
[0086] After obtaining the first image information, the image information to be played on the display device within the target time period can be replaced with the first image information. Since the shaking of the image screen of the first image information matches the shaking of the vehicle body within the target time period, playing the first image information within the target time period can make the perception of the target user's visual system consistent with the perception of the vestibular system, thereby avoiding the problem of motion sickness caused by the target user watching the display device.
[0087] After replacing the video information to be played on the display device with the first video information, the first video information can be played on the display device within the target time period.
[0088] In this embodiment of the invention, the vehicle's predicted driving state information within a target time period is predicted; based on the predicted driving state information, the vehicle's body sway information within the target time period is determined; first image information matching the body sway information is generated; the image information to be played on the display device within the target time period is replaced with the first image information; and the first image information is played on the display device. Through this embodiment of the invention, by playing specific images, the perception of the target user's visual system and vestibular system can be made consistent, thereby avoiding motion sickness caused by viewing the display device.
[0089] Reference Figure 3 The diagram illustrates a flowchart of another control method for a display device according to an embodiment of the present invention, which may include the following steps:
[0090] Step 301: Predict the vehicle's driving status information within the target time period.
[0091] Step 302: Based on the predicted driving status information, determine the vehicle body sway information within the target time period.
[0092] Step 303: Based on the vehicle body sway information, adjust the position of each frame of the video information to be played on the display device.
[0093] Step 304: Play the adjusted video information to be played on the display device.
[0094] In practical applications, during the vehicle's operation, the predicted driving status information of the vehicle within a future target time period can be predicted; this predicted driving status information may include the vehicle's speed, trajectory, acceleration, deceleration, etc.
[0095] After obtaining the predicted driving status information, the vehicle's body sway information can be determined based on the predicted driving status information within the target time period.
[0096] In some feasible embodiments, playing specific images may affect the user's experience using the display device; therefore, the present invention can also adjust the playback position of the image information to be played on the display device at different times within a target time period based on the vehicle body sway information. Specifically, the playback and display positions of different frames in the image information to be played can be adjusted based on the vehicle body sway information.
[0097] In the adjusted video information, the playback positions of different frames may be different; thus, the video information played on the display device appears shaky; when passengers watch it, the visual system can perceive that the human body is swaying.
[0098] For example, the adjusted video information to be played can be played within the target time period. Since the positions of the images in different frames of the adjusted video information to be played are adjusted, when the target user is watching the information played on the display device, the visual system can perceive that the human body is moving, so that the perception of the target user's visual system is consistent with the perception of the vestibular system, thereby avoiding the problem of motion sickness caused by the target user watching the display device.
[0099] In this embodiment of the invention, the predicted driving state information of the vehicle within a target time period is predicted; based on the predicted driving state information, the vehicle body sway information within the target time period is determined; based on the vehicle body sway information, the playback position of each frame of the image information to be played on the display device is adjusted; and the adjusted image information to be played is played on the display device. Through this embodiment of the invention, the image desired by the user can be played on the display device, while ensuring that the perception of the target user's visual system and vestibular system are consistent, thereby avoiding motion sickness caused by viewing the display device.
[0100] Reference Figure 4 The diagram illustrates a flowchart of another control method for a display device according to an embodiment of the present invention, which may include the following steps:
[0101] Step 401: Predict the vehicle's driving status information within the target time period.
[0102] Step 402: Based on the predicted driving status information, determine the vehicle body sway information within the target time period.
[0103] Step 403: Obtain second image information that matches the vehicle body sway information.
[0104] Step 404: Generate third image information based on the image information to be played and the second image information.
[0105] Step 405: Play the third image information on the display device.
[0106] In practical applications, during the vehicle's operation, the predicted driving status information of the vehicle within a future target time period can be predicted; this predicted driving status information may include the vehicle's speed, trajectory, acceleration, deceleration, etc.
[0107] After obtaining the predicted driving status information, the vehicle's body sway information can be determined based on the predicted driving status information within the target time period.
[0108] After obtaining the vehicle body sway information, a second image information matching the vehicle body sway information can be acquired; for example, the swaying of the image corresponding to the second image information is consistent with or similar to the vehicle body sway information; for example, the second image information can be a set of points that move in different directions with different accelerations and speeds according to the swaying situation corresponding to the vehicle body sway information.
[0109] After obtaining the second image information, the third image information can be generated based on the image information to be played and the second image information. For example, the image of each frame in the second image information can be fused with the image of the corresponding frame in the image information to be played to obtain the third image information.
[0110] After obtaining the third image information, it can be played on the display device within the target time period. Since the third image information integrates the second image information, which is consistent with or similar to the shaking information of the screen and the shaking information of the vehicle body, the visual system can also perceive the shaking of the human body when the target user is watching the third image information. This makes the perception of the target user's visual system consistent with the perception of the vestibular system, thereby avoiding the problem of motion sickness caused by the target user watching the display device.
[0111] In this embodiment of the invention, the predicted driving state information of a vehicle within a target time period is predicted; based on the predicted driving state information, the vehicle body sway information within the target time period is determined; second image information matching the vehicle body sway information is acquired; third image information is generated based on the image information to be played and the second image information; and the third image information is played on a display device. Through this embodiment of the invention, second image information where the image swaying and the vehicle body sway information are consistent or similar can be fused, ensuring that the perception of the target user's visual system is consistent with the perception of their vestibular system, thereby avoiding motion sickness caused by viewing the display device.
[0112] Reference Figure 5a The diagram illustrates a flowchart of another control method for a display device according to an embodiment of the present invention, which may include the following steps:
[0113] Step 501: Obtain the vehicle's historical driving status information, surrounding environment information, and navigation information.
[0114] Step 502: Based on historical driving status information, surrounding environment information, and navigation information, predict the vehicle's predicted driving status information within the target time period.
[0115] Step 503: Based on the predicted driving status information, predict whether the target user will experience motion sickness within the target time period.
[0116] Step 504: When it is determined that the target user will experience motion sickness within the target time period, the video information to be played on the display device is adjusted according to the predicted driving status information.
[0117] Step 505: Play the adjusted video information to be played on the display device.
[0118] In practical applications, target users within a vehicle can be detected to determine whether they are currently viewing a display device. Upon detecting that a target user is viewing a display device, the vehicle's historical driving status information, the surrounding environment information, and the navigation information corresponding to the vehicle's current driving trajectory can be obtained.
[0119] Historical driving status information refers to the vehicle's driving status information relative to the current time period. This information may include vehicle body data and vehicle control information. Vehicle body data may refer to data from the nine-axis IMU on the vehicle body, as well as vehicle speed data collected from tires or other locations. Control information may include, but is not limited to, control data for the accelerator, brakes, and steering wheel during autonomous or manual driving. This data can be quantified as acceleration, deceleration, and steering data.
[0120] Information about the surrounding environment can be obtained from image data captured by cameras on the vehicle; navigation information can be used to supplement road information; it can be obtained from the navigation system.
[0121] After obtaining historical driving status information, surrounding environment information, and navigation information, these information can be input into a preset model. The preset model can then output predicted driving status information for the vehicle within a target time period in the future, based on the historical driving status information, surrounding environment information, and navigation information.
[0122] In some feasible embodiments, in addition to outputting predicted driving status information of the vehicle in the future target time period based on historical driving status information, surrounding environment information, and navigation information, the preset model can also predict whether the target user will experience motion sickness during the target time period based on the predicted driving status information. For example, if the vehicle body shakes violently and frequently accelerates and decelerates during the target time period, it can be predicted that the target user will experience motion sickness during the target time period. This embodiment of the invention does not impose any limitations on this.
[0123] If it is predicted that the target user will not experience motion sickness during the target time period, step 501 can be repeated; otherwise, if it is predicted that the target user will experience motion sickness during the target time period, the video information to be played on the display device can be adjusted based on the predicted driving status information of the vehicle during the target time period. This adjustment can reduce motion sickness caused by the target user watching the display device. For example, the adjusted video information to be played can be shaky video information that is related to the bumpy conditions of the vehicle during the target time period.
[0124] After adjusting the video information to be played on the display device based on the predicted driving status information, the adjusted video information can be played on the display device within the target time period. Compared with playing ordinary video information, the present invention's embodiment of playing video information adjusted based on the predicted driving status information allows the target user's visual system to also perceive that the target user is moving, thereby avoiding motion sickness caused by the perceptual conflict between the target user's visual system and vestibular system, thus improving the target user's riding experience.
[0125] For example, such as Figure 5b As shown, vehicle body data, road images, control information, and navigation information can be acquired and input into a preset model; the preset model can output the predicted driving status information of the vehicle during the target time period, as well as the target probability of the target user during the target time period.
[0126] After obtaining the predicted driving status information, the images captured by the camera can be adjusted based on the predicted driving status information; or image information can be generated based on the predicted driving trajectory information.
[0127] When the target probability is greater than the preset value, the image obtained by the camera after adjustment can be played on the display device, or the image information generated based on the predicted driving trajectory information can be played on the display device; if the target probability is not greater than the preset value, the normal image information that the user expects to watch can be played on the display device.
[0128] In one embodiment of the present invention, the following sub-steps can be used to predict whether a target user will experience motion sickness during a target time period:
[0129] Sub-step 11: Based on the predicted driving status information, predict the target probability of the target user experiencing motion sickness within the target time period.
[0130] Sub-step 12: When the target probability exceeds the preset value, determine that the target user will experience motion sickness within the target time period.
[0131] In some feasible embodiments, the predicted driving status information can be input into a preset model; the preset model can predict the target probability of a target user experiencing motion sickness within a target time period based on the predicted driving status information; the level of this target probability can be used to characterize the likelihood of a target user experiencing motion sickness; the higher the target probability, the more likely the target user is to experience motion sickness within the target time period; the lower the target probability, the less likely the target user is to experience motion sickness within the target time period.
[0132] For example, the preset model can take the vehicle's driving status information as input information and the set probability of motion sickness as output data to learn the relationship between the vehicle's driving status information and the probability of motion sickness, thereby outputting the target probability of the target user experiencing motion sickness within a target time period based on the predicted driving status information.
[0133] In one embodiment of the present invention, the target probability can be determined in the following manner:
[0134] Obtain user characteristic information of the target user; based on the predicted driving status information and user characteristic information, predict the target probability of the target user experiencing motion sickness within the target time period.
[0135] In some feasible embodiments, the triggering conditions for motion sickness are different for different users; some users experience motion sickness as soon as they get in a car, while others do not experience motion sickness even after sitting in a car for a long time; based on the individual characteristics, embodiments of the present invention can also obtain user characteristic information of the target user.
[0136] The user characteristic information may include the user identifier of the target user; specifically, the user can set the corresponding user identifier according to their own situation; so that the preset model can determine the target probability by combining the user identifier.
[0137] In addition, user characteristic information can also include the user's age, gender, and current physical condition, such as fatigue or illness; then, the pre-set model can use this information to more accurately determine the target probability of the target user.
[0138] After obtaining the target probability, it can be determined whether the target probability exceeds a preset value. If the target probability does not exceed the preset value, it can be determined that the target user will not experience motion sickness during the target time period. Conversely, if the target probability exceeds the preset value, it can be determined that the target user will experience motion sickness during the target time period.
[0139] In one embodiment of the present invention, the above method may further include the following step: obtaining a preset value set for the target user.
[0140] In some feasible embodiments, the preset value can be set by the target user; for example, if the target user knows that they are less likely to experience motion sickness, they can set the preset value higher; if the target user knows that they are more likely to experience motion sickness, they can set the preset value lower. This embodiment of the invention does not limit this.
[0141] In one embodiment of the present invention, the target probability can also be determined in the following manner:
[0142] The predicted driving status information is input into the first preset model, and the target probability output by the first preset model is obtained.
[0143] In some feasible embodiments, the predicted driving state information can be input into a preset first preset model; the first preset model can be trained based on the driving state information and the probability used to characterize the possibility of the target user experiencing motion sickness; after receiving the predicted driving state information, the first preset model can extract the corresponding feature information from the predicted driving state information and determine the target probability corresponding to the predicted driving state information based on prior knowledge.
[0144] In this embodiment of the invention, historical driving status information, surrounding environment information, and navigation information of the vehicle are acquired; based on the historical driving status information, surrounding environment information, and navigation information, the predicted driving status information of the vehicle within a target time period is predicted; based on the predicted driving status information, it is predicted whether the target user will experience motion sickness within the target time period; when it is determined that the target user will experience motion sickness within the target time period, the video information to be played on the display device is adjusted according to the predicted driving status information. Compared to playing ordinary video information, this embodiment of the invention plays video information adjusted based on the predicted driving status information, which allows the target user's visual system to also perceive that the target user is moving, thereby avoiding motion sickness caused by perceptual conflict between the target user's visual system and vestibular system; thus improving the target user's riding experience.
[0145] It should be noted that, for the sake of simplicity, the method embodiments are all described as a series of actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions involved are not necessarily essential to the embodiments of the present invention.
[0146] Reference Figure 6 The diagram illustrates the structure of a control device for a display device according to an embodiment of the present invention, which may include the following modules:
[0147] The adjustment module 601 is used to predict the vehicle's predicted driving status information within a target time period, and adjust the image information to be played on the display device based on the predicted driving status information.
[0148] The control module 602 is used to play the adjusted video information to be played on the display device.
[0149] In an optional embodiment of the present invention, the adjustment module 601 is used to determine the vehicle body sway information within a target time period based on the predicted driving state information; generate first image information matching the vehicle body sway information; and replace the image information to be played on the display device within the target time period with the first image information.
[0150] In an optional embodiment of the present invention, the adjustment module 601 is used to determine the vehicle body sway information within a target time period based on the predicted driving state information; and to adjust the position of each frame of the image information to be played on the display device based on the vehicle body sway information.
[0151] In an optional embodiment of the present invention, the adjustment module 601 is used to determine the vehicle body sway information within a target time period based on the predicted driving state information; acquire second image information matching the vehicle body sway information; and generate third image information based on the image information to be played and the second image information.
[0152] The control module 602 is used to play third image information on the display device.
[0153] In an optional embodiment of the present invention, the adjustment module 601 is used to acquire historical driving status information of the vehicle, surrounding environment information, and navigation information; and to predict the vehicle's predicted driving status information within a target time period based on the historical driving status information, surrounding environment information, and navigation information.
[0154] In an optional embodiment of the present invention, the apparatus further includes:
[0155] The prediction module is used to predict whether a target user will experience motion sickness within a target time period based on predicted driving status information.
[0156] The adjustment module 601 is used to adjust the video information to be played on the display device based on the predicted driving status information when the prediction module determines that the target user will experience motion sickness within the target time period.
[0157] In an optional embodiment of the present invention, the prediction module is used to predict the target probability of a target user experiencing motion sickness within a target time period based on the predicted driving status information; when the target probability exceeds a preset value, it is determined that the target user will experience motion sickness within the target time period.
[0158] In an optional embodiment of the present invention, the prediction module is used to input the predicted driving state information into a first preset model and obtain the target probability output by the first preset model.
[0159] In an optional embodiment of the present invention, the prediction module is used to obtain user characteristic information of the target user; and predict the target probability of the target user experiencing motion sickness within a target time period based on the predicted driving status information and the user characteristic information.
[0160] In an optional embodiment of the present invention, the apparatus further includes:
[0161] The acquisition module is used to retrieve preset values set for the target user.
[0162] In this embodiment of the invention, the predicted driving state information of the vehicle within a target time period can be predicted first, and the image information to be played on the display device can be adjusted according to the predicted driving state information; the adjusted image information to be played is then played on the display device. Compared with playing ordinary image information, this embodiment of the invention plays image information adjusted based on predicted driving state information, which allows the visual system to perceive the target user's movement when the target user is viewing the display device in the vehicle, thereby avoiding motion sickness caused by the perception conflict between the visual system and the vestibular system when the target user is viewing the display device in the vehicle; thus improving the target user's riding experience.
[0163] This invention also provides an electronic device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, it implements the above-described control method for the display device.
[0164] This invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the above-described control method for a display device.
[0165] As the apparatus embodiment is basically similar to the method embodiment, it is described in a relatively simple manner. For relevant details, please refer to the description of the method embodiment.
[0166] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.
[0167] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, apparatus, or computer program products. Therefore, embodiments of the present invention can take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects. Furthermore, embodiments of the present invention can take the form of computer program products implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0168] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0169] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0170] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal equipment, causing a series of operational steps to be performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable terminal equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0171] Although preferred embodiments of the present invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of the embodiments of the present invention.
[0172] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes said element.
[0173] The foregoing has provided a detailed description of a control method for a display device, a control device for a display device, an electronic device, and a computer-readable storage medium. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.
Claims
1. A control method for a display device, characterized in that, The method includes: Predict the vehicle's predicted driving status information within the target time period, and adjust the image information to be played on the display device based on the predicted driving status information; The adjusted video information to be played is displayed on the display device.
2. The method according to claim 1, characterized in that, The step of adjusting the image information to be played on the display device based on the predicted driving state information includes: Based on the predicted driving status information, determine the vehicle body sway information within the target time period; Generate first image information that matches the vehicle body sway information; The video information to be played on the display device during the target time period is replaced with the first video information.
3. The method according to claim 1, characterized in that, The step of adjusting the image information to be played on the display device based on the predicted driving state information includes: Based on the predicted driving status information, determine the vehicle body sway information within the target time period; Based on the vehicle body sway information, the position of each frame of the video information to be played is adjusted on the display device.
4. The method according to claim 1, characterized in that, The step of adjusting the image information to be played on the display device based on the predicted driving state information includes: Based on the predicted driving status information, determine the vehicle body sway information within the target time period; Acquire second image information that matches the vehicle body sway information; Based on the image information to be played and the second image information, generate the third image information; Playing the adjusted video information to be played on the display device includes: The third image information is played on the display device.
5. The method according to claim 1, characterized in that, The predicted driving status information of the vehicle within the target time period includes: Obtain the vehicle's historical driving status information, surrounding environment information, and navigation information; Based on the historical driving status information, the surrounding environment information, and the navigation information, the predicted driving status information of the vehicle within the target time period is predicted.
6. The method according to claim 1, characterized in that, The method further includes: Based on the predicted driving status information, predict whether the target user will experience motion sickness during the target time period; When it is determined that the target user will experience motion sickness during the target time period, the step of adjusting the video information to be played on the display device based on the predicted driving status information is executed.
7. The method according to claim 6, characterized in that, The step of predicting whether the target user will experience motion sickness within the target time period based on the predicted driving status information includes: Based on the predicted driving status information, predict the target probability of the target user experiencing motion sickness within the target time period; When the target probability exceeds a preset value, it is determined that the target user will experience motion sickness during the target time period.
8. The method according to claim 7, characterized in that, The step of predicting the target probability of the target user experiencing motion sickness within a target time period based on the predicted driving status information includes: The predicted driving state information is input into the first preset model, and the target probability output by the first preset model is obtained.
9. The method according to claim 7, characterized in that, The step of predicting the target probability of the target user experiencing motion sickness within a target time period based on the predicted driving status information includes: Obtain the user characteristic information of the target user; Based on the predicted driving status information and the user characteristic information, predict the target probability of the target user experiencing motion sickness within the target time period.
10. The method according to claim 7, characterized in that, The method further includes: Obtain the preset value set for the target user.
11. A control device for a display device, characterized in that, The device includes: The adjustment module is used to predict the vehicle's predicted driving status information within a target time period, and adjust the image information to be played on the display device based on the predicted driving status information. A control module is used to play the adjusted video information to be played on the display device.
12. An electronic device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program, when executed by the processor, implements the control method of the display device as described in any one of claims 1 to 10.
13. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium, which, when executed by a processor, implements the control method of the display device as described in any one of claims 1 to 10.