Display method, display apparatus, and electronic device
By predicting the vehicle acceleration and angular velocity, visual anti-haze content with low or no delay is displayed, users' motion sickness problems are solved, and personalized anti-haze solutions are provided to improve user experience.
Patent Information
- Application Number
- PCT/CN2025/077736
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-02-20
- Filing Date
- 2025-02-18
- Publication Date
- 2025-08-28
AI Technical Summary
During the vehicle driving, users are sick due to the conflict between vision and vestibular perception, and the motion sickness status of different users is quite different, so the prior art is difficult to provide personalized relief solutions.
By predicting the acceleration and angular velocity of the vehicle, combining user characteristics and vehicle status, visual anti-halo content with low or no delay is displayed in advance, and the content display method is adjusted to reduce the conflict between vision and vestibular perception, providing a personalized anti-halo effect.
Effectively alleviate users' motion sickness, improve driving experience, adapt to individual differences between different users, and reduce the conflict between visual perception and vestibular perception.
Smart Images

Figure CN2025077736_28082025_PF_FP_ABST
Abstract
Description
Display method, display device, and electronic equipment
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on February 20, 2024, with application number 202410192130.3, and invention name “Display method, display device and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of electronic devices, and more particularly, to a display method, a display device, and an electronic device. Background Art
[0003] With the advancement of science and technology, vehicles can now carry multiple screens, providing navigation, entertainment, leisure, and other functions to enhance the user experience. However, viewing the screens while driving can easily cause motion sickness in passengers, negatively impacting the user experience. Furthermore, different users may experience varying degrees of motion sickness in the same driving scenario, depending on their individual state.
[0004] Therefore, how to effectively alleviate users' motion sickness and provide users with personalized motion sickness relief services based on their individual differences is an urgent problem that needs to be solved. Summary of the Invention
[0005] The present application provides a display method, a display device, and an electronic device. The method can effectively alleviate a user's motion sickness and provide a personalized motion sickness alleviation service based on the user's individual differences.
[0006] In a first aspect, a display method is provided, which is applied to an electronic device, including: predicting first information, where the first information is information at a first moment, and the first information includes at least one of the following: acceleration of the electronic device, angular velocity of the electronic device; at the first moment, displaying first content according to the first information.
[0007] Exemplarily, the electronic device may be a vehicle including a display device, and the first content may be visual anti-sickness content.
[0008] Based on the above solution, the acceleration and / or angular velocity of the vehicle at a certain moment in the future can be predicted to provide users with low-latency or even no-latency visual anti-motion sickness content, reduce the conflict between visual perception results and vestibular perception results, and alleviate users' motion sickness.
[0009] In combination with the first aspect, in certain implementations of the first aspect, displaying the first content according to the first information at the first moment includes: determining the second moment according to the first delay; outputting the first information at the second moment; and displaying the first content according to the first information at the first moment after the first delay, the second moment being before the first moment.
[0010] It should be noted that there will be a certain system delay before the electronic device finally displays the visual anti-dizziness content for the user. System delay includes but is not limited to the time taken for data transmission between the various domains carried by the electronic device, the time taken for each module to process data, etc. The second moment may be the moment of outputting data, the first moment is the moment of displaying the first content, and the first delay is the system delay. Due to the existence of system delay, the first information output at the second moment will be after the first delay (system delay) before the first content is displayed. It can be seen that taking into account the system delay, outputting the first information in advance can provide users with low-latency or even no-latency visual anti-dizziness content.
[0011] In combination with the first aspect, in certain implementations of the first aspect, before predicting the first information, the method also includes: obtaining second information, the second information being information at a third moment, the third moment being before the first moment, the second information including at least one of the following: the mass of the electronic device, the pedal opening and closing degree of the electronic device, the speed of the electronic device, road condition parameters, the angle of the steering wheel of the electronic device, and the angular velocity of the steering wheel of the electronic device.
[0012] It should be noted that before predicting the first information at the first moment, relevant information needs to be acquired.
[0013] In combination with the first aspect, in certain implementations of the first aspect, when the first information is the acceleration of the electronic device, the predicting of the first information includes: predicting the acceleration of the electronic device based on the mass of the electronic device, the pedal opening and closing degree of the electronic device, the speed of the electronic device, and the road condition parameters.
[0014] In combination with the first aspect, in certain implementations of the first aspect, when the first information is the angular velocity of the electronic device, predicting the first information includes: predicting the angular velocity of the electronic device based on the angle of the steering wheel of the electronic device, or based on the angular velocity of the steering wheel of the electronic device.
[0015] For example, the vehicle's torque can be calculated based on the vehicle's pedal opening and speed. The vehicle's torque affects the vehicle's power. The vehicle's acceleration at a certain moment is then determined based on the vehicle's mass and road condition parameters. The vehicle's angular velocity at a certain moment is determined based on the vehicle's steering wheel angular velocity or the angular velocity of the vehicle's steering wheel.
[0016] In combination with the first aspect, in certain implementations of the first aspect, before displaying the first content based on the first information, the method also includes: determining a display method of the first content based on the first information, and the display method of the first content includes: a moving direction of the first content and a speed change characteristic of the first content.
[0017] Based on the above solution, in order to achieve a better display effect for the visual motion sickness prevention content, the display method of the visual motion sickness prevention content can be adjusted. The visual motion sickness prevention content can adjust its movement direction and speed change characteristics on the display device based on the predicted vehicle acceleration and / or angular velocity.
[0018] In combination with the first aspect, in some implementations of the first aspect, determining the display mode of the first content based on the first information includes: when the acceleration of the electronic device and the angular velocity of the electronic device do not meet preset conditions, determining that the first content is stationary.
[0019] For example, when the vehicle's acceleration and angular velocity are less than a first threshold, the vehicle is stationary or traveling at a constant or near-constant speed along its direction of travel, and the visual motion sickness prevention content is determined to be stationary. When the electronic device's acceleration and angular velocity do not meet the preset conditions, the user's vestibule cannot perceive that the vehicle is accelerating, decelerating, or turning, and the user's vestibule believes that the vehicle is stationary or traveling at a constant speed, and the visual motion sickness prevention content is also stationary.
[0020] In combination with the first aspect, in certain implementations of the first aspect, determining the display mode of the first content based on the first information includes: when the acceleration of the electronic device meets a preset condition, determining that the moving direction of the first content is to expand toward the edge or to shrink toward the center, and the speed change characteristics of the first content are related to the acceleration of the electronic device.
[0021] For example, the electronic device's acceleration meets a preset condition, which can be understood as the acceleration of the electronic device or its absolute value reaching a threshold that the user can perceive. This includes two situations: one is vehicle acceleration, and the other is vehicle deceleration. When the acceleration during vehicle acceleration meets the preset condition, the visual anti-sickness content moves in an expanding direction toward the edge; when the acceleration during vehicle deceleration meets the preset condition, the visual anti-sickness content moves in a contracting direction toward the center.
[0022] In combination with the first aspect, in certain implementations of the first aspect, determining the display method of the first content based on the first information includes: when the angular velocity of the electronic device meets a preset condition, determining that the moving direction of the first content is opposite to the movement direction of the electronic device, and the speed change characteristics of the first content are related to the angular velocity of the electronic device.
[0023] For example, the angular velocity of the electronic device meeting a preset condition can be understood as reaching a threshold that the user can perceive. When the angular velocity of the electronic device meets the preset condition, the user's vestibule can sense that the vehicle is turning, and the visual anti-sickness content moves in the opposite direction of the vehicle's turn, providing the user with a visual indication of the vehicle's turn. Furthermore, as the vehicle's angular velocity increases, the speed of the visual anti-sickness content may also increase.
[0024] In combination with the first aspect, in some implementations of the first aspect, the method further includes: adjusting the speed change characteristics of the first content according to a first parameter, where the first parameter includes at least one of the following: user characteristics, user status, and motion status of the electronic device.
[0025] For example, the user characteristic can be understood as the user's motion sickness susceptibility, the user state can be understood as the user's current level of motion sickness, and the motion state of the electronic device can be understood as the vehicle's driving speed. For example, when the user's motion sickness susceptibility is high, the speed of changes in the visual motion sickness prevention content can be reduced; when the user's current level of motion sickness increases, the speed of changes in the visual motion sickness prevention content can be reduced.
[0026] Based on the above solution, the speed change characteristics of the visual anti-sickness content can be adjusted based on user characteristics, user status and the motion state of the electronic device, so that the anti-sickness effect of the visual anti-sickness content can be personalized and adapted to different users.
[0027] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: adjusting the preset condition according to a first parameter, where the first parameter includes at least one of the following: user characteristics, user status, and motion status of the electronic device.
[0028] For example, the trigger threshold can be lowered when the user's susceptibility to motion sickness is higher, or the current level of motion sickness is higher. Furthermore, the trigger threshold can be adjusted based on the vehicle's motion state. For example, when the vehicle is moving at high speed, the vehicle's vibration frequency is high, and the user can perceive the vehicle's acceleration at a higher threshold. Therefore, the trigger threshold can be increased.
[0029] Based on the above solution, the user's trigger threshold can be adjusted based on user characteristics, user status and the motion state of the electronic device, so that the anti-sickness effect of the visual anti-sickness content can be personalized and adapted to different users.
[0030] In combination with the first aspect, in certain implementations of the first aspect, before displaying the first content based on the first information, the method also includes: determining the display area of the first content based on any one of the first parameter and the second parameter; and / or determining the display position of the first content based on any one of the first parameter and the second parameter; the first parameter includes at least one of the following: user characteristics, user status, motion status of the electronic device; the second parameter is the relative relationship between the screen of the electronic device and the user's retina.
[0031] Based on the above scheme, the display area of the first content can be adjusted based on user characteristics, user status, the movement state of the electronic device and the relative relationship between the screen of the electronic device and the user's retina; the display position of the first content can also be adjusted based on user characteristics, user status, the movement state of the electronic device and the relative relationship between the screen of the electronic device and the user's retina, so that the anti-dizziness effect of the visual anti-dizziness content can be personalized to adapt to different users.
[0032] In a second aspect, a display device is provided, which includes a processing unit, wherein the processing unit is used to predict first information, where the first information is information at a first moment, and the first information includes at least one of the following: the acceleration of the device, the angular velocity of the device; the processing unit is also used to display first content according to the first information at the first moment.
[0033] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to determine a second moment based on a first delay; output the first information at the second moment; and after a first delay, at the first moment, display the first content based on the first information, and the second moment is before the first moment.
[0034] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is further used to obtain second information, where the second information is information at a third moment, and the third moment is before the first moment. The second information includes at least one of the following: the mass of the device, the pedal opening and closing degree of the device, the speed of the device, road condition parameters, the angle of the steering wheel of the device, and the angular velocity of the steering wheel of the device.
[0035] In combination with the second aspect, in certain implementations of the second aspect, when the first information is the acceleration of the device, the processing unit is specifically used to predict the acceleration of the device based on the mass of the device, the pedal opening and closing degree of the device, the speed of the device, and the road condition parameters.
[0036] In combination with the second aspect, in certain implementations of the second aspect, when the first information is the angular velocity of the device, the processing unit is specifically used to predict the angular velocity of the device based on the angle of the steering wheel of the device or the angular velocity of the steering wheel of the device.
[0037] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is also used to determine the display mode of the first content based on the first information, and the display mode of the first content includes: the moving direction of the first content and the speed change characteristics of the first content.
[0038] In combination with the second aspect, in some implementations of the second aspect, the processing unit is specifically configured to determine that the first content is stationary when the acceleration of the device and the angular velocity of the device do not meet a preset condition.
[0039] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to determine that the moving direction of the first content is to expand toward the edge or to shrink toward the center when the acceleration of the device meets a preset condition, and the speed change characteristics of the first content are related to the acceleration of the device.
[0040] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is specifically used to determine that the moving direction of the first content is opposite to the movement direction of the device when the angular velocity of the device meets a preset condition, and the speed change characteristics of the first content are related to the angular velocity of the device.
[0041] In combination with the second aspect, in some implementations of the second aspect, the processing unit is further used to adjust the speed change characteristics of the first content according to a first parameter, and the first parameter includes at least one of the following: user characteristics, user status, and motion status of the device.
[0042] In combination with the second aspect, in some implementations of the second aspect, the processing unit is further used to adjust the preset condition according to a first parameter, where the first parameter includes at least one of the following: user characteristics, user status, and motion status of the device.
[0043] In combination with the second aspect, in certain implementations of the second aspect, the processing unit is further used to determine the display area of the first content based on any one of the first parameter and the second parameter; and / or determine the display position of the first content based on any one of the first parameter and the second parameter; the first parameter includes at least one of the following: user characteristics, user status, and motion status of the device.
[0044] In a third aspect, an electronic device is provided, which can be used to execute the method in the first aspect and any possible implementation thereof.
[0045] In a fourth aspect, a display device is provided, comprising: a processor coupled to a memory, the memory being used to store a computer program, the processor being used to run the computer program, so that the display device executes the method as described in the first aspect and any possible implementation thereof.
[0046] In combination with the fourth aspect, some implementations of the fourth aspect also include one or more of the memory and the transceiver, and the transceiver is used to receive signals and / or send signals.
[0047] In a fifth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a computer, the computer executes the above-mentioned first aspect and any method that can be implemented in the first aspect.
[0048] In a sixth aspect, a computer program product comprising instructions is provided, which, when run on a computer, enables the computer to execute the above-mentioned first aspect and any method that can be implemented in the first aspect.
[0049] In a seventh aspect, a chip is provided, which includes a processor and a data interface. The processor reads instructions stored in a memory through the data interface to execute the above-mentioned first aspect and any method that can be implemented in the first aspect.
[0050] In combination with the seventh aspect, in one possible implementation, the processor is coupled to the memory through an interface.
[0051] In combination with the seventh aspect, in a possible implementation, the chip system also includes a memory, in which a computer program or computer instructions are stored. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] FIG1 is a schematic diagram of an application scenario of a display method provided in an embodiment of the present application.
[0053] FIG2 is a schematic flow chart of a display method provided in an embodiment of the present application.
[0054] FIG3 is a schematic flow chart of a display method provided in an embodiment of the present application.
[0055] FIG4 is a schematic diagram of a process for obtaining vehicle acceleration provided in an embodiment of the present application.
[0056] FIG5 is a schematic diagram of time synchronization of motion information of a vehicle provided in an embodiment of the present application.
[0057] FIG6 is a schematic diagram of time synchronization of motion information of a vehicle provided in an embodiment of the present application.
[0058] FIG7 is a schematic diagram of displaying visual anti-dizziness content provided in an embodiment of the present application.
[0059] FIG8 is a schematic diagram of displaying visual anti-dizziness content provided in an embodiment of the present application.
[0060] FIG9 is a flow chart showing how visual anti-sickness content changes with the acceleration and angular velocity of a vehicle, provided by an embodiment of the present application.
[0061] FIG10 is a schematic diagram of a scenario provided in an embodiment of the present application.
[0062] FIG11 is a schematic diagram of a scenario provided in an embodiment of the present application.
[0063] FIG12 is a schematic diagram of a scenario provided in an embodiment of the present application.
[0064] FIG13 is a schematic diagram of a scenario provided in an embodiment of the present application.
[0065] FIG14 is a schematic flow chart of a display method provided in an embodiment of the present application.
[0066] FIG15 is a schematic block diagram of a display device provided in an embodiment of the present application.
[0067] FIG16 is a schematic block diagram of a display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0068] The technical solution in this application will be described below with reference to the accompanying drawings.
[0069] To facilitate understanding, the technical terms that may be involved in this application are first introduced.
[0070] motion sickness
[0071] Motion sickness is a type of motion sickness, a syndrome caused by physical and / or visual motion.
[0072] Susceptibility to motion sickness
[0073] Generally refers to a user's susceptibility to motion sickness, which varies significantly from person to person and is affected by a variety of factors. In this application, it also refers to a user's susceptibility to motion sickness in their current state. For example, a user is more likely to experience motion sickness when they are not in good condition, which is considered a high susceptibility to motion sickness.
[0074] As shown in Figure 1, it shows the scenarios to which the display method provided by the present application can be applied. For example, a plurality of screens can be carried in the vehicle, including a central control screen, a co-pilot screen, a rear seat screen, a laser curtain screen, a head-up display (HUD), and a screen of a mobile terminal device. Among them, the mobile terminal can join the network where preset screens such as the vehicle's central control screen, co-pilot screen, rear seat screen, laser curtain screen, HUD, etc. are located through communication technologies such as the magic suction interface (maglink, M-link), so as to realize communication between the screen of the mobile terminal device and the preset screen. Users can also observe the virtual screen through virtual reality (VR) technology in the vehicle. The display method provided by the present application alleviates the user's motion sickness by displaying visual anti-sickness content on the screen, thereby providing the user with a good driving experience.
[0075] Motion sickness (for example, motion sickness) is a common condition experienced by users while riding in a vehicle, and visual-vestibular conflict is the primary cause of motion sickness when viewing screens in a vehicle. Specifically, the vestibular system can detect changes in acceleration along the front, back, left, right, and top and bottom axes caused by acceleration, deceleration, cornering, and bumps, potentially perceiving the user as in motion. By visually viewing the screen, the user may perceive the user as relatively stationary. Because the vestibular system perceives the user as in motion, while the visual system perceives the user as relatively stationary, the conflicting results from the two perceptions can cause motion sickness.
[0076] To alleviate motion sickness, users can use methods such as displaying moving objects. For example, using VR glasses to display virtual moving objects, or displaying images of a moving vehicle on the screen. However, these methods have the following problems:
[0077] First, there will be a delay in the display of moving objects.
[0078] For example, when a vehicle is moving, sensors acquire motion information and can report the motion information to the vehicle domain controller (VDC). The VDC transmits the processed motion information to the vehicle intranet unit (VIU), which transmits the processed motion information to the cockpit domain controller (CDC). The CDC can parse the processed motion data. The CDC displays the parsed motion data and renders it, and the end user can obtain the rendered data. There is a significant delay in the process from vehicle movement to the end user obtaining the rendered data, and the user cannot obtain the rendered data immediately. For example, at time t-1, the vehicle is moving straight, and the user's vestibular perception is that it is moving straight; at time t, the vehicle turns left, and the user's vestibular perception is that it is turning left, and the visual prompt information shows that the vehicle is moving straight; at time t+1, the vehicle turns right, and the user's vestibular perception is that it is turning right, and the visual prompt information shows that the vehicle is turning left. Obviously, due to the delay, a good anti-sickness effect cannot be produced.
[0079] Second, there is a conflict between the results of visual perception and vestibular perception.
[0080] For example, when the vehicle is decelerating or moving at a constant speed, the result of visual perception conflicts with the result of vestibular perception. It should be noted that the direction of motion perceived by the vestibular sense is consistent with the direction of acceleration when the vehicle is moving, and the direction of motion perceived by the visual sense is consistent with the direction of velocity when the vehicle is moving. When the vehicle is decelerating, the direction of vehicle acceleration is opposite to the direction of motion, and the direction of motion perceived by the vestibular sense is opposite to the direction of motion perceived by the visual sense. Therefore, the results of the two perceptions conflict. When the vehicle is moving at a constant speed, the acceleration of the vehicle is 0, the vestibular sense perceives that the vehicle is in a relatively stationary state, the velocity direction of the vehicle is forward, and the visual sense perceives that the vehicle is moving forward. Therefore, the perception results of the two are also conflicting.
[0081] For example, when a vehicle presents the same speed change in different speed scenarios, the results of visual perception and vestibular perception may also conflict. When the vehicle accelerates from 40 kph to 60 kph, the speed change is 20 kph. The acceleration perceived by the vestibular sense is the physical acceleration, which can be understood as the difference in speed change, i.e., 20 kph. The acceleration perceived by the visual sense is the result obtained by dividing the difference in speed change by the initial speed (20 kph / 40 kph). Obviously, the acceleration perceived by the vestibular sense is different from the acceleration perceived by the visual sense. When the vehicle accelerates from 10 kph to 30 kph, the speed change is also 20 kph. The acceleration perceived by the vestibular sense is 20 kph, and the acceleration perceived by the visual sense is 20 kph / 10 kph. It can be seen that in both scenarios, although the same speed change (20 kph) is presented, the result of visual perception is also related to the initial speed, which causes the result of visual perception to conflict with the result of vestibular perception.
[0082] Third, different users may have different susceptibility to motion sickness.
[0083] It should be noted that due to individual differences in vestibular sensitivity, different users have different needs for motion sickness prevention. Therefore, personalized motion sickness prevention solutions are needed to meet the motion sickness needs of as many users as possible.
[0084] Therefore, the present application provides a display method, a display device, and an electronic device, which determine the acceleration and angular velocity of a vehicle with low or even no latency through prediction, and provide visual anti-motion sickness content that matches the acceleration and / or angular velocity of the vehicle on the vehicle's display device in combination with information such as user characteristics, user status, and vehicle motion status, thereby reducing the conflict between the results of visual perception and the results of vestibular perception and alleviating the user's motion sickness.
[0085] As shown in Figure 2, a schematic flow chart of a display method provided in an embodiment of the present application is shown. The method can be applied to vehicles, ships, airplanes and other transportation vehicles, and the method is described in detail below.
[0086] First, by predicting the acceleration and angular velocity at a certain moment in the future and comprehensively considering various system delays, the final anti-sickness visual content is displayed with no delay. This process mainly includes the following steps S201 to S203.
[0087] S201, obtaining vehicle information at time T1.
[0088] S202, predicting the acceleration and angular velocity of the vehicle at time T2.
[0089] S203: Determine the acceleration and angular velocity of the vehicle at time T3.
[0090] Exemplarily, vehicle information includes pedal opening and closing degree, steering wheel angle, speed, time, vehicle mass and other information.
[0091] Simply put, the vehicle information at time T1 is obtained and the acceleration and angular velocity of the vehicle at time T2 in the future are predicted. And by combining the time-consuming information such as data storage, transmission, display rendering, etc. with the time synchronization of the above-mentioned predicted results, the acceleration and angular velocity of the vehicle at the time of user-side reception (time T3) can be determined, and finally the visual anti-sickness content is displayed according to the calculated acceleration and angular velocity of the vehicle. It can be understood that the visual anti-sickness content is displayed in the form of pictures, animations or videos. For example, when the visual anti-sickness content is displayed according to the acceleration of the vehicle, it can be displayed as a moving object. In other words, the acceleration and angular velocity of the vehicle are presented through moving or mobile visual anti-sickness content. This process predicts the acceleration and angular velocity of the vehicle at a certain moment in the future based on the current vehicle information, and combines the system delay time to make the display of the visual anti-sickness content low-latency or even no-latency, thereby improving the anti-sickness effect.
[0092] The above solution will be described in detail below with reference to FIG3 .
[0093] S301 : Calculate the vehicle torque based on the pedal opening / closing degree and the vehicle speed.
[0094] It's important to note that the essence of vehicle motion is that vehicle power drives the vehicle's movements. Vehicle power is related to torque, which typically affects the vehicle's load capacity, starting speed, and other factors, making it a crucial metric for measuring vehicle power. Therefore, calculating torque is crucial before determining vehicle power.
[0095] For example, the torque of a vehicle is related to various parameters, such as the speed of the vehicle, the degree of opening and closing of the vehicle's throttle and / or brake pedals (percentage or push rod travel value). The torque of the vehicle can be determined by the degree of opening and closing of the vehicle pedals (including the throttle and brake pedals) and the speed of the vehicle.
[0096] It should be noted that in the display method provided in the embodiments of the present application, the vehicle torque can be calculated based on the vehicle speed and the degree of pedal engagement. The relationship between the vehicle speed, the degree of pedal engagement, and the vehicle torque can be represented by a throttle characteristic (Pedalmap). The vehicle speed and the degree of pedal engagement are used as a set of parameters, and in step S301, the vehicle torque under any set of parameters can be obtained through methods such as bilinear interpolation.
[0097] S302: Predict the acceleration of the vehicle at time t-ahead1 based on the vehicle parameters and the road condition parameters.
[0098] For example, vehicle parameters include vehicle posture, vehicle mass, etc. Road condition parameters are used to characterize road surface types, such as cement road surface, plastic road surface, etc.
[0099] For example, as shown in FIG4 , a schematic diagram of a process for obtaining the acceleration of a vehicle is shown. The process includes:
[0100] S401, the driver operates the vehicle.
[0101] S402, the vehicle's power system responds to the driver's operation.
[0102] S403: Detecting that the vehicle is moving.
[0103] Specifically, when the driver steps on the accelerator or brake pedal, the vehicle's power system can respond to the driver's operation and convert the vehicle's power into a numerical value (v) requested by the driver. The vehicle determines the vehicle's acceleration in response to the numerical value requested by the driver. At the same time, the vehicle's sensors (e.g., an inertial navigation system or an inertial measurement unit (IMU)) determine that the vehicle is moving and transmit the currently measured acceleration of the vehicle to the vehicle's internal pathways. Through processing in the vehicle's internal pathways, visual anti-sickness content can be displayed to the user. Among them, the numerical value requested by the driver can be understood as the vehicle's torque calculated in step S301.
[0104] In the above process, there are two time differences. From the driver operating the vehicle to the vehicle's power system responding to the driver's operation, there is a time difference t1 (i.e., the time between step S401 and step S402); from the vehicle's power system responding to the driver's operation to sensing that the vehicle is moving, there is a time difference t2 (i.e., the time between step S402 and step S403). Usually, the time difference t1 is greater than the time difference t2. It can be seen that through the process shown in Figure 4, from the driver operating the vehicle to the process of displaying visual anti-sickness content for the user, at least t1+t2 time period is required. It can be seen that there will be a delay in the display of visual anti-sickness content. In order to minimize the delay, the display method provided in the embodiment of the present application can predict the motion information of the vehicle at a certain moment in the future. When the vehicle accelerates, decelerates, or turns, the user will be prone to motion sickness. Therefore, the display method of the embodiment of the present application includes but is not limited to predicting the acceleration of the vehicle and the angular velocity of the vehicle. The method for predicting the motion information of the vehicle is specifically introduced below.
[0105] First, the acceleration of the vehicle at a certain moment in the future can be predicted.
[0106] When the vehicle obtains information about the driver's operation of the vehicle, the vehicle's acceleration can be determined according to the following formula (1). a=c1*tor / mn Formula (1)
[0107] Where a represents the vehicle acceleration calculated in response to the driver's operation; tor represents the torque calculated in step S301; m represents the vehicle mass; n represents the reduction in vehicle acceleration due to factors such as friction; and c1 represents the conversion coefficient between the vehicle's torque and vehicle power. c1 / m and n can be obtained through calibration. For example, by repeatedly obtaining the vehicle's tor and the corresponding a (read by the IMU), c1 / m and n can be estimated using a set of equations. Road condition parameters can affect parameter n in formula (1).
[0108] After determining the vehicle's acceleration using the above formula (1), ignoring the millisecond-level calculation time, compared to vehicle sensors such as IMU, the vehicle's acceleration can be obtained t1+t2 in advance to achieve the purpose of predicting the vehicle's acceleration after t-ahead1 (t-ahead1=t1+t2).
[0109] Secondly, the angular velocity of the vehicle at a certain moment in the future can be predicted.
[0110] S303 : Predicting the angular velocity of the vehicle at t-ahead2 based on the steering wheel angle / steering wheel angular velocity.
[0111] For example, the angular velocity of the vehicle may be predicted according to any one of the angle of the steering wheel and the angular velocity of the steering wheel.
[0112] Specifically, for vehicle steering, the angle of the wheel is related to the angle of the steering wheel. The following formula (2) shows the relationship between the angle of the steering wheel and the angle of the wheel. wheel =f(angle sas )*angle sas Formula (2)
[0113] Among them, angle wheel Indicates the angle of the wheel; angle sas Indicates the angle of the steering wheel; f(angle sas ) represents a constant that changes with the steering wheel angle. After obtaining the real-time wheel angle, the angular velocity of the vehicle can be calculated when it turns.
[0114] It should be noted that during the vehicle turning process, the angular velocity of the vehicle conforms to the Ackerman core formula, as shown in the following formula (3).
[0115] in, Represents the inner wheel turning angle of the vehicle; β represents the front outer wheel turning angle of the vehicle; K represents the center distance between the two kingpins; L represents the wheelbase. When the vehicle turns, the turning radius R of the vehicle can be calculated based on the current wheel turning angle and the wheelbase of the vehicle. In a short period of time Δt, the speed of the vehicle is v. At this time, the distance traveled by the vehicle in Δt is v*Δt, the arc turned by the vehicle is v*Δt / R, and the corresponding angular velocity is v*Δt / R / Δt (that is, v / R). To describe the angular velocity of the vehicle more accurately, the vehicle's acceleration a can be introduced. The distance traveled by the vehicle in Δt is v*Δt+(1 / 2)a(Δt) 2 The arc of the vehicle is [v*Δt+(1 / 2)a(Δt) 2 ] / R, the corresponding angular velocity is [v*Δt+(1 / 2)a(Δt) 2 ] / R / Δt (that is, v+(1 / 2)a(Δt) / R).
[0116] It should be understood that the wheel angle obtained by the above formula (2) is not necessarily the turning angle of the vehicle. The vehicle will turn only when the wheel deflects and has a certain speed.
[0117] It should be noted that, similar to what is described in method 400, there is a time difference from when the user steps on the accelerator or brake pedal to when the sensor senses that the vehicle is moving (accelerating or decelerating). There is also a time difference when the user turns the steering wheel to when the sensor senses that the vehicle is moving (turning). Through step S302, in the display method provided in the embodiment of the present application, the angular velocity of the vehicle can be obtained in advance based on the angle of the steering wheel or the angular velocity of the steering wheel, compared with the vehicle's sensors such as the IMU, so as to achieve the purpose of obtaining the angular velocity of the vehicle after t-ahead2.
[0118] For example, t-ahead1 may be different from t-ahead2.
[0119] It should be noted that the vehicle's sensors obtain corresponding acceleration and steering signals after the vehicle actually accelerates (or decelerates) or turns. In other words, the vehicle's sensors cannot obtain corresponding signals before the actual signals are generated. However, in the embodiments of the present application, the vehicle's acceleration and angular velocity at a certain moment in the future can be predicted before the vehicle's sensors obtain acceleration and steering signals.
[0120] Based on the above solution, in steps S301 to S303, the time difference between the vehicle receiving user operation signals (including pedal opening and closing, steering wheel angle, etc.) and displaying the corresponding visual anti-sickness content can predict vehicle motion information such as future acceleration and angular velocity for a period of time. This can adapt to the situation where the user suddenly operates the vehicle in a human-driven scenario and predict vehicle motion information in advance.
[0121] Exemplarily, the above t-ahead1 may be 290ms, and t-ahead2 may be 150ms.
[0122] S304: storing the vehicle's motion information and synchronizing the time, and outputting the vehicle's motion information.
[0123] It should be noted that according to the above steps, the motion information of the vehicle at a certain moment in the future can be predicted, but it is also necessary to further combine the time-consuming processes of storage, transmission, display rendering, etc. of the vehicle's motion information (system delay), and synchronize the time with the above-mentioned predicted vehicle motion information to determine the moment when the user end receives the vehicle's motion information, and ensure that the visual anti-dizziness content is displayed on the screen at the moment the user end receives the vehicle's motion information.
[0124] For ease of understanding, Figure 5 shows a schematic diagram of the time synchronization of a vehicle's motion information. Figure 5 shows three time coordinate systems, which represent, from top to bottom, the vehicle's acceleration time coordinate system, the vehicle's angular velocity time coordinate system, and the vehicle's motion information output time coordinate system. The solid patterns (including solid triangles, squares, and circles) represent the motion information (including the vehicle's acceleration and the vehicle's angular velocity) calculated at time t1, t2, and t3, respectively. That is, the solid triangle on the vehicle's acceleration time coordinate system indicates that the vehicle's acceleration is calculated at time t1, the solid square indicates that the vehicle's acceleration is calculated at time t2, and the solid circle indicates that the vehicle's acceleration is calculated at time t3. The solid triangle on the corner moment coordinate system indicates that the vehicle's angular velocity is calculated at time t1, the solid square indicates that the vehicle's angular velocity is calculated at time t2, and the solid circle indicates that the vehicle's angular velocity is calculated at time t3.
[0125] According to the above, the acceleration of the vehicle after the future time t-ahead1 and the angular velocity of the vehicle after the future time t-ahead2 are predicted. The hollow patterns (including hollow triangles, squares, and circles) represent the output moments of the vehicle's acceleration and the vehicle's angular velocity. That is, the hollow triangle on the vehicle's acceleration moment coordinate system represents the moment when the vehicle's acceleration calculated at time t1 (solid triangle) is actually output, the hollow square represents the moment when the vehicle's acceleration calculated at time t2 (solid square) is actually output, and the hollow circle represents the moment when the vehicle's acceleration calculated at time t3 (solid circle) is actually output. The hollow triangle on the vehicle's angular velocity moment coordinate system represents the moment when the vehicle's angular velocity calculated at time t1 (solid triangle) is actually output, the hollow square represents the moment when the vehicle's angular velocity calculated at time t2 (solid square) is actually output, and the hollow circle represents the moment when the vehicle's angular velocity calculated at time t3 (solid circle) is actually output.
[0126] That is, the vehicle acceleration or angular velocity is calculated at the time corresponding to the solid pattern in Figure 5, and the vehicle acceleration or angular velocity is output at the time corresponding to the hollow pattern. In actual processing, the vehicle acceleration or angular velocity calculated at the time corresponding to the solid pattern is stored before the time corresponding to the hollow pattern to meet the storage requirements of the data (vehicle acceleration and / or angular velocity of Che Lina).
[0127] The output time coordinate system of the vehicle motion information shown in FIG5 is not completely aligned with the acceleration time coordinate system and the turning angle time coordinate system of the vehicle, and a time synchronization operation is required.
[0128] Exemplarily, the moment corresponding to the solid five-pointed star in Figure 5 is the target moment, and the target moment is the moment when data needs to be output (including the acceleration of the vehicle and / or the angular velocity of the vehicle). It can be clearly seen from Figure 5 that the moment when the hollow patterns (including hollow triangles, hollow squares, and hollow circles) on the vehicle's acceleration moment coordinate system and the vehicle's angular velocity moment coordinate system correspond to the output data, and the moment when the solid five-pointed star on the vehicle's motion information output moment coordinate system actually needs to output data is not aligned, and the specific data output at the moment when data output actually needs to be output (the moment corresponding to the solid five-pointed star) cannot be determined. Therefore, the data actually output at the target moment can be determined through time synchronization operations. It should be noted that time synchronization operations include but are not limited to the following methods:
[0129] 1. Use the nearest neighboring data as the data actually output at the target time. For example, for the vehicle's acceleration, in the vehicle's acceleration moment coordinate system, the closest object to the solid five-pointed star corresponding to the data output moment coordinate system is the hollow square. Therefore, the vehicle's acceleration corresponding to the hollow square in the vehicle's acceleration moment coordinate system can be used as the data actually output at the target time. For the vehicle's angular velocity, in the vehicle's angular velocity moment coordinate system, the closest object to the solid five-pointed star corresponding to the data moment coordinate system is the hollow square. Therefore, the vehicle's angular velocity corresponding to the hollow square in the vehicle's angular velocity moment coordinate system can be used as the data actually output at the target time.
[0130] 2. Use linear interpolation to determine the actual output data at the target time. For example, for the vehicle's acceleration, the acceleration corresponding to the hollow triangle in the vehicle's acceleration moment coordinate system can be subtracted from the acceleration corresponding to the hollow square. The resulting value is used as the actual output acceleration of the vehicle at the target time corresponding to the solid five-pointed star in the data output moment coordinate system. For the vehicle's angular velocity, the angular velocity corresponding to the hollow square in the vehicle's angular velocity moment coordinate system can be subtracted from the angular velocity corresponding to the hollow circle. The resulting value is used as the actual output angular velocity of the vehicle at the target time corresponding to the solid five-pointed star in the data output moment coordinate system.
[0131] It should be understood that the data actually output at the target moment can be determined through time synchronization operations. The embodiments of the present application do not limit the specific implementation of time synchronization operations. The use of other linear or nonlinear interpolation methods to determine the data actually output at the target moment also falls within the scope of protection of this application.
[0132] Furthermore, in order to enhance the stability and smoothness of the actual output data at the target moment, the output data may be filtered by methods such as Kalman filtering. The specific method of filtering is not limited in the present application.
[0133] It should be noted that the time corresponding to the solid five-pointed star is the target time, which is the time when data output is required. In other words, at the target time, the vehicle's display device is required to display visual motion sickness prevention content. As described above, the data actually output at the target time includes the vehicle's acceleration or angular velocity. It is understood that the visual motion sickness prevention content can be displayed on the display device via images, animations, or videos. The visual motion sickness prevention content can include moving objects, whose movement reflects the vehicle's acceleration or angular velocity. Therefore, before actual display, the vehicle's acceleration or angular velocity can be integrated to obtain the corresponding vehicle speed and angle. This allows the object to be displayed at the resulting speed or angle to achieve a motion sickness prevention effect. As can be seen, the user can obtain visual motion sickness prevention content at the target time. The actual output at the target time is a moving object. The object's speed or angle is obtained by integrating the vehicle's acceleration and angular velocity. Alternatively, it can be understood that the time integration calculation ultimately determines the position of the moving object to be displayed in the current frame. Among them, the integration calculation of the vehicle acceleration or the vehicle angular velocity requires the input of the integration time, which is related to the frame rate actually displayed on the display device. For example, at a 60Hz frame rate, the integration is performed over a duration of 1 / 60 second.
[0134] Furthermore, the vehicle's turning angle is obtained by integrating the vehicle's angular velocity. Since the vehicle's turning angle can be accumulated, the vehicle's turning angle can be corrected under the following conditions:
[0135] 1. When describing the angle based on the relative position of the vehicle body in the geodetic coordinate system (for example, due north is 0°) at the moment of vehicle start, there is a possibility that the cumulative turning angle will exceed 360°. When the angular velocity of the vehicle exceeds 360°, normalization is required. The normalized turning angle is within the range of greater than or equal to 0° and less than or equal to 360°. For example, when the turning angle is 365°, the normalized angle is 5°. In the geodetic coordinate system, when the front of the vehicle faces due north, it is 0°, and when the front of the vehicle faces due east, it is 90°.
[0136] 2. When the wheel and the vehicle body return to 0°, that is, when the new angle after a certain turn of the vehicle is used as the new angle origin (0°) for angle description, normalization processing is required. The normalized turning angle is within the range of greater than or equal to -180° and less than or equal to 180°.
[0137] It should be noted that there will be a certain amount of system latency before the visual anti-sickness content is finally displayed to the user. System latency includes, but is not limited to, the time it takes for data to be transmitted between domains and the time it takes for each module to process data. For example, the data transmission process between the controller area network (CAN) bus and the in-vehicle display domain may include the time for data compression, data transmission, and data decompression. The CDC module consumes a considerable amount of time for video rendering.
[0138] As can be seen, due to the aforementioned system delay, when data is output at the target time shown in Figure 5, the user will actually receive the data output at a time after the target time, which will result in the data not being delivered to the user in a timely manner. Therefore, the target time shown in Figure 5 can be advanced to overcome the problem caused by system delay.
[0139] As shown in Figure 6, a schematic diagram of time synchronization of vehicle motion information is shown. In addition to the three time coordinate systems shown in Figure 5 (the vehicle acceleration time coordinate system, the vehicle angular velocity time coordinate system, and the vehicle motion information output time coordinate system), Figure 6 also includes the vehicle motion information output time coordinate system that takes into account system delay. For example, the system delay time is t delay In order for the user to receive data at the time corresponding to the solid five-pointed star, the data can be output at the new target time corresponding to the hollow five-pointed star in the output time coordinate system of the vehicle's motion information considering the system delay, after the system delay time t delay After the user receives the data at the target time, the user receives the data at the same time as the vehicle actually executes the data. In other words, the acceleration and turning angle of the visual anti-sickness content displayed on the screen are consistent with the actual acceleration and turning angle of the current vehicle, achieving a delay-free effect. For example, if the user receives the visual anti-sickness content on the screen at time t1 indicating a left turn, the vehicle will also turn left at t1.
[0140] It should be noted that, during the system delay time t delay When the system delay time t is less than the above t-ahead1 and less than the above t-ahead2, the delay-free effect can be achieved. delay If the delay time is greater than t-ahead1 or t-ahead2, the system delay can be reduced, but the delay-free effect cannot be achieved. For example, t-ahead1 can be 290ms, t-ahead2 can be 150ms, and the system delay time t delay It is generally less than 100ms. It can be seen that, under normal circumstances, the display method provided by the above embodiment of the present application can achieve a zero-delay effect.
[0141] S305: Display visual anti-sickness content according to the acceleration and angular velocity of the vehicle.
[0142] It should be noted that after determining the vehicle's acceleration and angular velocity, visual anti-dizziness content can be displayed for the user. The visual anti-dizziness content can be synchronized with the vehicle's actual motion information and displayed on the vehicle's display device, including but not limited to the co-pilot screen, rear seat screen, laser curtain screen, etc.
[0143] For example, the visual anti-sickness content can represent the actual current motion information of the vehicle by moving an image. For example, FIG7 shows a schematic diagram of a visual anti-sickness content.
[0144] Figure 7 shows a schematic diagram of visual anti-sickness content on a display device. The center portion of Figure 7 represents normal display content, which could be an image, video, or web page currently displayed on a vehicle's display device. Multiple blocks are displayed around the normal display content, and the movement of these blocks conveys vehicle motion information to the user.
[0145] For example, when the user is facing the display device, the block may reflect the vehicle's motion information according to the following motion rules:
[0146] 1. The block moves towards the user, expanding from the center to the edge, corresponding to the vehicle accelerating forward.
[0147] 2. The block faces away from the user and shrinks from the periphery to the center, corresponding to the vehicle slowing down.
[0148] 3. Construct a coordinate system in the display device's space, with each pixel at the center and edge representing different distances. For example, a pixel at the center represents 1 meter, while a pixel at the edge represents 10 centimeters. The vehicle's acceleration can be converted based on the pixel movement.
[0149] For example, integrating the vehicle's acceleration yields velocity v. The block at the center moves at velocity v, while the blocks at the edge move at velocity v. Because the distance corresponding to one pixel at the center is greater than the distance corresponding to the edge, the blocks actually move one pixel, and from a visual perspective, the blocks at the edge move faster.
[0150] 4. When the block moves from the right to the left, the corresponding vehicle is turning right; when the block moves from the left to the right, the corresponding vehicle is turning left.
[0151] 5. Within the coordinate system constructed in the space where the display device is located, the angle of left and right movement of the visual anti-sickness content is -60° to 60°. The rotation angle of the visual anti-sickness content corresponds to the steering angle of the vehicle. The visual anti-sickness content moves 1°, corresponding to the vehicle turning 1°.
[0152] Based on the various steps introduced in the above method 300, the vehicle's motion information (including the vehicle's acceleration and the vehicle's angular velocity) can be predicted, and the vehicle's acceleration and angular velocity can be displayed on the vehicle's display device in the form of an object moving, providing users with low-latency or even zero-latency visual anti-motion sickness content, thereby achieving the purpose of alleviating motion sickness symptoms or avoiding motion sickness symptoms.
[0153] Next, the movement direction and speed characteristics of the visual motion sickness prevention content can be determined based on the vehicle's acceleration and angular velocity. The speed characteristics can be adjusted based on user characteristics, user status, or vehicle motion status to achieve motion sickness prevention in various scenarios. This process primarily includes steps S204 to S205.
[0154] S204 : When any one of the acceleration and the angular velocity of the vehicle at time T3 is greater than or equal to the trigger threshold, determine a display mode according to the acceleration and the angular velocity of the vehicle.
[0155] It should be noted that T3 represents the moment when the user receives the data (vehicle acceleration and angular velocity). The display mode can be understood as the display mode of the visual motion sickness prevention content. The movement direction and speed change characteristics of the visual motion sickness prevention content can be determined based on the vehicle's acceleration and angular velocity.
[0156] Exemplarily, the display mode includes the movement direction and speed change characteristics of the visual motion sickness prevention content. The visual motion sickness prevention content may be a block as shown in Figure 7. The movement direction may include expanding toward the edge, contracting toward the center, moving left, or moving right; and the speed change characteristics may include acceleration, deceleration, constant speed, or stillness.
[0157] Optionally, the speed change characteristics may be adjusted according to user characteristics, user status, or vehicle motion status.
[0158] For example, a user characteristic may be the user's susceptibility to motion sickness, which varies among individuals. A user state may be the severity of the user's current motion sickness. A vehicle's motion state may be the vehicle's speed, etc.
[0159] For ease of understanding, a schematic diagram of visual anti-sickness content on a display device is shown in Figure 8. The moving direction and speed change characteristics of the visual anti-sickness content can be adjusted according to various factors to achieve a better anti-sickness effect.
[0160] In one implementation, as shown in (a) of FIG8 , normal display content is displayed in the middle portion of the display area of the display device, and visual anti-sickness content is displayed in the peripheral portion.
[0161] In one implementation, as shown in (b) of FIG8 , the entire display area of the display device is displayed with normal display content, and the visual anti-sickness content is displayed as a layer superimposed on the normal display content.
[0162] It should be noted that visual anti-sickness content can be in the form of a cube, a flat block, a stone, a sphere, horizontal and vertical lines, a wireframe, a combination of lines, particles, etc. It can also be a combination of the above patterns or shapes. For ease of understanding, as shown in Figure 8 (c), a set of visual anti-sickness content is shown, which can be vertical lines, wireframes, particles, or a combination of multiple patterns.
[0163] It should be noted that the visual anti-sickness content can adjust its moving direction and speed change characteristics on the display device according to the vehicle acceleration and / or the vehicle's angular velocity.
[0164] As shown in Figure 9, a flow chart of how the visual anti-sickness content changes with the acceleration and angular velocity of the vehicle is shown. It should be noted that the way in which the visual anti-sickness content changes with the acceleration and angular velocity of the vehicle can include the following scenarios:
[0165] S901: Acquire the acceleration and angular velocity of the vehicle.
[0166] Scene 1
[0167] S902: Determine whether the acceleration and angular velocity of the vehicle are less than a first threshold.
[0168] S903: Determine whether the visual anti-sickness content is still.
[0169] That is, in the scenario shown in Figure 10, the vehicle is stationary or traveling at a constant speed or near constant speed along the vehicle's direction of travel. When the vehicle's acceleration and angular velocity are less than a first threshold, the visual anti-sickness content is stationary.
[0170] The first threshold is the threshold that the user can perceive. When the vehicle's acceleration or angular velocity reaches the first threshold, the user's vestibule senses that the vehicle is accelerating or turning. When the vehicle is traveling at a near-constant speed, and neither the acceleration nor the angular velocity reaches the first threshold, the user's vestibule cannot perceive the vehicle's acceleration, deceleration, or turning. The user's vestibule perceives the vehicle as traveling at a constant speed, and the visual anti-sickness content remains static.
[0171] Scene 2
[0172] S904: Determine whether the acceleration of the vehicle is greater than or equal to a second threshold.
[0173] S905: Determine whether the visual anti-sickness content is extended toward the edge.
[0174] That is, as shown in the scenario in Figure 11, the vehicle is accelerating. At this time, the vehicle's driving direction is consistent with the acceleration direction. When the vehicle's acceleration is greater than or equal to the second threshold, the visual anti-sickness content expands toward the edge.
[0175] The second threshold is a threshold perceivable by the user. Since the vehicle is accelerating, its direction of travel aligns with the acceleration. The second threshold is a positive number, and the vehicle's acceleration is also a positive number. When the vehicle's acceleration is greater than or equal to the second threshold, the user's vestibule perceives the vehicle's acceleration. The direction in which the visual anti-sickness content expands toward the edge provides the user with a visual indication of vehicle acceleration. As the vehicle's speed increases, the speed at which the visual anti-sickness content expands toward the edge also increases.
[0176] Furthermore, the moving speed of the visual anti-sickness content is related to the acceleration of the vehicle. For example, formula (4) shows the relationship between the moving speed of the visual anti-sickness content and time. V1 = f(t) Formula (4)
[0177] Wherein, V1 represents the moving speed of the visual anti-sickness content when the vehicle accelerates, and t represents time.
[0178] It should be noted that the speed of the motion-sickness-prevention content, represented by V1, can vary with the vehicle's speed. As the vehicle accelerates, the speed of the motion-sickness-prevention content increases over time. The speed of change in the motion-sickness-prevention content can be understood as its acceleration, or rather, its speed variation characteristics.
[0179] Alternatively, the speed at which V1 changes can be a fixed value. For example, V1 = m*t, where m is a constant that does not change with the vehicle's acceleration. Alternatively, the speed at which V1 changes can vary with the vehicle's acceleration.
[0180] It should be noted that V1 may have a maximum value, which may be a fixed value or may change with changes in the vehicle's speed or acceleration. For example, the greater the vehicle's speed or acceleration, the larger or smaller the maximum value of V1. For users who are highly susceptible to motion sickness, the smaller the maximum value of V1, the better the anti-motion sickness effect may be. The maximum value of V1 can be set to different levels according to the vehicle's speed or acceleration. When V1 reaches its maximum value, the visual anti-motion sickness content can maintain the moving speed of the maximum value of V1 until the vehicle's acceleration is less than the second threshold.
[0181] It should be noted that the speed of V1 changes is related to user characteristics and user status. In other words, the speed change characteristics of visual motion sickness prevention content can be adjusted based on user characteristics and user status. User characteristics refer to the user's susceptibility to motion sickness. Motion sickness susceptibility varies from person to person. A user's motion sickness susceptibility can be directly obtained through user reporting; the user's current motion sickness susceptibility can also be inferred from the user's historical records; or the user's current motion sickness susceptibility can be determined based on the user's current status (when the user's status is poor, the user is more prone to motion sickness). When the user's motion sickness susceptibility is high, the speed of V1 changes can be reduced. In other words, when the user's motion sickness susceptibility is high, the speed of change of the visual motion sickness prevention content can be reduced. The user status refers to the user's current level of motion sickness. As the user's current level of motion sickness increases, the speed of V1 changes can be reduced. In other words, as the user's current level of motion sickness increases, the speed of change of the visual motion sickness prevention content can be reduced.
[0182] Scene 3
[0183] S906: Determine whether the absolute value of the acceleration of the vehicle is greater than or equal to the absolute value of a third threshold.
[0184] S907: Determine whether the visual anti-sickness content shrinks toward the center.
[0185] In other words, as shown in Figure 12, the vehicle is decelerating. At this point, the vehicle's direction of travel is opposite to the direction of acceleration. When the absolute value of the vehicle's acceleration is greater than or equal to the absolute value of the third threshold, the visual anti-sickness content expands toward the edge.
[0186] The third threshold is a threshold perceivable by the user. Since the vehicle is decelerating and its direction of travel is opposite to its acceleration, the third threshold is a negative number, and the vehicle's acceleration is also a negative number. When the absolute value of the vehicle's acceleration is greater than or equal to the absolute value of the third threshold, the user's vestibular perception indicates that the vehicle is decelerating. The direction in which the visual anti-sickness content shrinks toward the center provides the user with a visual indication of vehicle deceleration. As the vehicle's speed decreases, the speed at which the visual anti-sickness content shrinks toward the center also increases.
[0187] Furthermore, the moving speed of the visual anti-sickness content is related to the acceleration of the vehicle. For example, formula (5) shows the relationship between the moving speed of the visual anti-sickness content and time. V1 = g(t) Formula (5)
[0188] Among them, V2 represents the moving speed of the visual anti-sickness content when the vehicle decelerates, and t represents time.
[0189] It should be noted that the speed of the motion sickness prevention content, represented by V2, can vary with vehicle speed. As the vehicle decelerates, the slower the vehicle's speed, the faster the motion sickness prevention content will move. The speed of change in the motion sickness prevention content can be understood as its acceleration, or rather, its speed variation characteristics.
[0190] Optionally, the speed at which V2 changes can be a fixed value, or can be set to different gears according to the acceleration of the vehicle, or can change with the change of the acceleration of the vehicle.
[0191] It should be noted that V2 may have a maximum value, which may be a fixed value or may vary with changes in the vehicle's speed or acceleration. For example, the greater the vehicle's speed or acceleration, the greater or smaller the maximum value of V2. The maximum value of V2 may be set to different levels based on the vehicle's speed or acceleration. When V2 reaches its maximum value, the visual anti-sickness content may maintain the speed of the maximum value of V2 until the absolute value of the vehicle's acceleration is less than the absolute value of the third threshold.
[0192] It should be noted that the speed at which V2 changes is related to user characteristics and user status. In other words, the speed change characteristics of the visual anti-motion sickness content can be adjusted according to user characteristics and user status. Among them, user characteristics refer to the user's susceptibility to motion sickness. When the user's susceptibility to motion sickness is high, the speed of change of V2 can be reduced. In other words, when the user's susceptibility to motion sickness is high, the speed of change of the movement of the visual anti-motion sickness content can be reduced. The user status refers to the user's current level of motion sickness. When the user's current level of motion sickness increases, the speed of change of V2 can be reduced. In other words, when the user's current level of motion sickness increases, the speed of change of the movement of the visual anti-motion sickness content can be reduced.
[0193] Scene 4
[0194] S908: Determine whether the angular velocity of the vehicle is greater than or equal to a fourth threshold.
[0195] S909: Determine that the visual anti-sickness content moves in the opposite direction of the vehicle's steering.
[0196] That is, as shown in the scenario of Figure 13, the vehicle is turning left. When the vehicle angular velocity is greater than or equal to the fourth threshold, the visual anti-sickness content moves in the opposite direction of the vehicle turning.
[0197] The fourth threshold is a threshold that is perceptible to the user. When the vehicle's angular velocity is greater than or equal to the fourth threshold, the user's vestibular perception of the vehicle's turn occurs. By moving the visual anti-sickness content in the opposite direction of the vehicle's turn, the user's visual perception of the vehicle's turn is provided. As the vehicle's angular velocity increases, the speed of the visual anti-sickness content also increases.
[0198] Furthermore, the moving speed of the visual anti-sickness content is related to the angular velocity of the vehicle. For example, formula (6) shows the relationship between the moving speed of the visual anti-sickness content and the angular velocity of the vehicle. V3 = f(yaw_speed) Formula (6)
[0199] Among them, V3 represents the moving speed of the visual anti-sickness content when the vehicle turns, and yaw_speed represents the angular velocity of the vehicle.
[0200] It should be noted that V2 can be a fixed value, set to different levels as the vehicle's angular velocity changes, change linearly with the vehicle's angular velocity, change exponentially with the vehicle's angular velocity, or change power-wise with the vehicle's angular velocity. The functional relationship between V3 and the vehicle's angular velocity is related to user characteristics and user status. In other words, the movement speed of visual motion sickness prevention content can be adjusted based on user characteristics and user status. User characteristics refer to the user's susceptibility to motion sickness, and user status refers to the user's current level of motion sickness.
[0201] For example, when the user is highly susceptible to motion sickness, the slope of the linear change of the moving speed of the visual anti-motion sickness content with the angular velocity of the vehicle can be reduced; when the user's current motion sickness level increases, the slope of the linear change of the moving speed of the visual anti-motion sickness content with the angular velocity of the vehicle can be reduced.
[0202] It should be noted that when entering Scene 1 from Scene 2, Scene 3, or Scene 4, the movement speed of the visual motion sickness prevention content can enter a static state through a sudden or gradual change. Specifically, when the movement speed of the visual motion sickness prevention content enters a static state in a gradual manner, it can gradually decrease to 0 starting from the moment the trigger threshold is reached. When switching between scenes, the movement speed of the visual motion sickness prevention content can change suddenly, or, to maintain the continuity of the picture and provide the user with a more coherent visual display effect, adopt a gradual change.
[0203] In summary, in the display method provided in the embodiments of this application, the movement direction and speed characteristics of the visual motion sickness prevention content can be determined based on the vehicle's acceleration and angular velocity. The movement direction of the visual motion sickness prevention content includes expanding toward the edge, contracting toward the center, moving to the left, moving to the right, and so on. The speed characteristics of the visual motion sickness prevention content include acceleration, deceleration, constant speed, or stationary speed.
[0204] For example, the vehicle's acceleration and angular velocity can be obtained according to the content introduced in method 300 above; the vehicle's acceleration and angular velocity can also be obtained through an IMU sensor or a global positioning system (GPS) sensor; the vehicle's acceleration and angular velocity can also be calculated based on the vehicle's speed; the vehicle's acceleration and angular velocity can also be obtained by extracting signals obtained by the vehicle's camera; the vehicle's acceleration and angular velocity can also be obtained through calculation results of a navigation application. In the display method provided in the embodiment of the present application, the specific method of obtaining the vehicle's acceleration and angular velocity in step S901 is not limited.
[0205] S205, displaying visual anti-sickness content.
[0206] It should be noted that the moving direction and speed change characteristics of the visual anti-sickness content are determined in the above different scenarios, and the visual anti-sickness content is displayed on the display device.
[0207] Optionally, the visual anti-dizziness content can be displayed on the peripheral part of the display device as shown in (a) in Figure 8 above; or it can be displayed as a layer superimposed on the normal display content as shown in (b) in Figure 8 above.
[0208] Next, the trigger threshold is adjusted based on at least one of the user's characteristics, the user's state, and the vehicle's motion state; or the display area and display position of the visual motion mitigation content are adjusted for the user based on at least one of the user's characteristics, the user's state, and the vehicle's motion state, as well as the viewing angle and position of the display device relative to the user's retina, to achieve personalized display of the visual motion mitigation content and achieve better motion mitigation effects. This process mainly includes the following steps S206 to S208.
[0209] S206: Adjust the trigger threshold.
[0210] It should be noted that the trigger thresholds are the first threshold, the second threshold, the third threshold and the fourth threshold in the above method 900.
[0211] Exemplarily, step S206 may be performed before step S204.
[0212] S207: Adjust the display area of the visual anti-sickness content.
[0213] S208: Adjust the display position of the visual anti-sickness content.
[0214] Exemplarily, step S207 and step S205 can be performed before step S205, that is, before the visual anti-sickness content is finally displayed on the display device, the moving direction and speed change characteristics of the visual anti-sickness content are adjusted, and the display area and display position of the visual anti-sickness content can also be adjusted.
[0215] It should be noted that you can adjust only the trigger threshold, only the display area and position of the visual anti-sickness content, or both, and this is not limited in the present embodiment. The following specifically describes methods for adjusting the trigger threshold and adjusting the display area and position of the visual anti-sickness content.
[0216] First, adjust the trigger threshold.
[0217] Exemplarily, the trigger threshold is adjusted based on at least one of user characteristics, user status, and vehicle motion status.
[0218] It should be noted that when either the vehicle's acceleration or angular velocity is greater than or equal to a trigger threshold, the display mode of the visual anti-sickness content can be determined based on the vehicle's acceleration and angular velocity. The trigger thresholds for vehicle acceleration and angular velocity may be different.
[0219] For example, the display method of the visual anti-sickness content includes motion characteristics, colors, symbols, etc. in addition to the moving direction and speed change characteristics of the visual anti-sickness content introduced above.
[0220] It should be noted that the trigger threshold varies significantly from user to user. Generally, a threshold that most users can perceive can be set as the trigger threshold. To achieve a better anti-sickness effect, the trigger threshold can be adjusted.
[0221] It should be noted that user characteristics refer to the user's susceptibility to motion sickness, and user status refers to the user's current level of motion sickness. The higher the user's susceptibility to motion sickness, or the higher the current level of motion sickness, the lower the threshold for perceiving the vehicle's acceleration, deceleration, or turning. Therefore, the trigger threshold can be adjusted based on the user characteristics or user status. For example, when the user's susceptibility to motion sickness is higher, or the current level of motion sickness is higher, the trigger threshold can be lowered. In addition, the trigger threshold can be adjusted based on the vehicle's motion state. For example, when the vehicle's speed is high, the vehicle's vibration frequency is high, and the user's threshold for perceiving the vehicle's acceleration is higher. Therefore, the trigger threshold can be increased.
[0222] It should be understood that parameters that can be used to adjust the trigger threshold include user characteristics, user status, and vehicle motion status. In practical applications, the trigger threshold can be adjusted based on at least one of these parameters. When the trigger threshold is adjusted based on multiple parameters, the minimum threshold obtained by adjustment is the adjusted trigger threshold.
[0223] For example, the relationship between the above parameters (user characteristics, user status, and vehicle motion status) as input data and the trigger threshold can be shown in the following formula (7). threshold = f(S) Formula (7)
[0224] Wherein, threshold represents the trigger threshold, and S represents input data. The relationship between the input data and the trigger threshold includes, but is not limited to, a linear relationship, a power function relationship, and an exponential function relationship.
[0225] For example, if the trigger threshold adjusted based on user characteristics and user status is threshold 1, and further based on the vehicle motion status, the trigger threshold adjusted is threshold 2. If threshold 1 is less than threshold 2, the final trigger threshold adjusted this time is threshold 1.
[0226] It is understandable that when the vehicle's acceleration and / or the vehicle's angular velocity is greater than or equal to the trigger threshold, the display method of the visual anti-sickness content, such as motion characteristics, color, symbols, etc., can be determined based on the vehicle's acceleration and the vehicle's angular velocity.
[0227] For example, the greater the vehicle's acceleration or angular velocity, the greater the acceleration or angular velocity of the motion sickness prevention content. The acceleration or angular velocity of the motion sickness prevention content can be represented by color, symbols, arrows, and other methods. For example, brighter colors indicate greater acceleration, while more curved arrows indicate greater angular velocity.
[0228] Second, adjust the display area and position of the visual anti-dizziness content.
[0229] Exemplarily, the display area and display position of the visual anti-sickness content are adjusted based on at least one of user characteristics, user status, vehicle motion status, and the viewing angle size and position of the display device relative to the user's retina.
[0230] For example, after determining the display mode of the anti-sickness content, the display area and display position of the anti-sickness content may be further adjusted.
[0231] It should be noted that user characteristics refer to the user's susceptibility to motion sickness, and user status refers to the user's current degree of motion sickness. The larger the display area of the visual anti-motion sickness content, the better the anti-motion sickness effect. When the user is in a state with a high probability of motion sickness, the display area of the visual anti-motion sickness content is increased. Therefore, the display area of the visual anti-motion sickness content can be adjusted according to at least one of the user characteristics, user status and vehicle motion status. For example, when the user's susceptibility to motion sickness is higher, or the current degree of motion sickness is higher, the display area is expanded or reduced. When the speed of the vehicle is high, the display area is expanded or reduced. Among them, users who are prone to visual dizziness (for example, 3D vertigo) can reduce the display area to avoid causing visual dizziness.
[0232] It should be noted that different viewing angles and positions of the user's retina have different processing capabilities for motion stimuli, and the display position of the visual anti-sickness content needs to be adjusted according to the viewing angle size and position of the display device relative to the user's retina. Generally speaking, the peripheral visual field has a stronger processing capability for the motion stimuli of an object than the central visual field. Therefore, when displaying visual anti-sickness content, it can be displayed preferentially on the peripheral part of the display device, for example, as shown in (a) in Figure 8. As the display area of the visual anti-sickness content increases, the area of the peripheral visual field is preferentially expanded; as the display area of the visual anti-sickness content further increases, it may be limited by the size of the display device, and the visual anti-sickness content can expand the display area toward the central visual field.
[0233] It is understandable that the display area and display position of the visual anti-dizziness content will affect the anti-dizziness effect of the visual anti-dizziness content. In actual practice, in order to achieve a good anti-dizziness effect, the display area and display position of the visual anti-dizziness content can be comprehensively considered.
[0234] The viewing angle size and position of the display device relative to the user's retina can be determined based on the characteristics of the display device, the height of the human eye, and the distance between the user and the display device. Among them, the characteristics of the display device include the hardware screen size of the display device, the size of the displayed content, the actual display size of the projected image (the display device is a projection screen), the center point position of the displayed content, etc. The height of the human eye position can be estimated by cameras and seat pressure perception. The distance between the user and the display device can be estimated by a camera, or by detecting the distance between the user's seat and the display device, or by obtaining the distance between the user and the display device through technical means such as sound wave reflection.
[0235] After adjusting the display position of the anti-visual dizziness content according to the viewing angle size and position of the display device relative to the user's retina, the display area of the anti-visual dizziness content can be further adjusted to obtain a better display position and display area of the anti-visual dizziness content, thereby achieving a better anti-visual dizziness effect.
[0236] For example, the relationship between the display area of the visual anti-sickness content and the above-mentioned input data, as well as the viewing angle and position of the display device relative to the user's retina, can be shown as follows: Formula (8). The relationship between the display position of the visual anti-sickness content and the above-mentioned input data, as well as the viewing angle and position of the display device relative to the user's retina, can be shown as follows: Formula (9). position(x,y)=F(S / A / B) Formula (8) area=F1(S / A / B) Formula (9)
[0237] Among them, position represents the display position of the visual anti-sickness content, area represents the display area of the visual anti-sickness content, S represents the input data (including user characteristics, user status and vehicle motion status), A represents the position of the display device relative to the user's retina, and B represents the viewing angle of the display device relative to the user's retina.
[0238] As shown in FIG14 , a schematic flowchart of a display method provided in an embodiment of the present application is shown. This method can be applied to the scenario shown in FIG1 . The method 1400 is described in detail below.
[0239] S1401, predict first information.
[0240] Exemplarily, the first information includes at least one of the following: acceleration of the electronic device, angular velocity of the electronic device, wherein the electronic device may be a vehicle.
[0241] S1402: At a first moment, display first content according to first information.
[0242] It should be noted that the first information is information at the first moment. That is, the electronic device can predict the first information at the first moment and display the first content on the display device, where the first content is visual anti-sickness content.
[0243] It can be seen that the acceleration and / or angular velocity of the vehicle at a certain moment in the future can be predicted to provide users with low-latency or even no-latency visual anti-motion sickness content, reduce the conflict between visual perception results and vestibular perception results, and alleviate users' motion sickness.
[0244] Specifically, a second moment is determined according to a first time delay; first information is output at the second moment; and after the first time delay, first content is displayed according to the first information at the first moment, wherein the second moment is before the first moment.
[0245] It should be noted that there will be a certain system delay before the electronic device finally displays the visual anti-dizziness content for the user. System delay includes but is not limited to the time taken for data transmission between the various domains carried by the electronic device, the time taken for each module to process data, etc. The above-mentioned second moment can be the new target moment as shown in Figure 6, which is the moment of outputting data, the first moment is the target moment, and the first delay is the system delay. Due to the existence of system delay, the first information output at the second moment will be after the first delay (system delay) before the first content is displayed. It can be seen that taking into account the system delay, outputting the first information in advance can provide users with low-latency or even no-latency visual anti-dizziness content.
[0246] In one implementation, before predicting the first information, related information needs to be obtained.
[0247] Specifically, before predicting the first information, the second information is obtained, where the second information is information at a third moment, and the third moment is before the first moment, wherein the second information includes at least one of the following: the mass of the electronic device, the pedal opening and closing degree of the electronic device, the speed of the electronic device, the road condition parameters, the angle of the steering wheel of the electronic device, and the angular velocity of the steering wheel of the electronic device.
[0248] It should be noted that the electronic device can predict the first information at the first moment in the future based on the information at the third moment before the first moment in the future. The specific method of prediction can be as described above in FIG3 and will not be repeated here.
[0249] In one implementation, when the first information is the acceleration of the electronic device, the acceleration of the electronic device can be predicted based on the mass of the electronic device, the pedal opening and closing degree of the electronic device, the speed of the electronic device, and road condition parameters.
[0250] In one implementation, when the first information is the angular velocity of the electronic device, the angular velocity of the electronic device may be predicted according to the angle of the steering wheel of the electronic device or according to the angular velocity of the steering wheel of the electronic device.
[0251] For example, the vehicle's torque can be calculated based on the vehicle's pedal opening and speed. The vehicle's torque affects the vehicle's power. The vehicle's acceleration at a certain moment is then determined based on the vehicle's mass and road condition parameters. The vehicle's angular velocity at a certain moment is determined based on the vehicle's steering wheel angular velocity or the angular velocity of the vehicle's steering wheel.
[0252] In order to achieve a better display effect of the visual anti-sickness content, the display method of the visual anti-sickness content can be adjusted.
[0253] Specifically, before displaying the first content according to the first information, the electronic device may determine a display mode of the first content according to the first information, where the display mode of the first content includes a moving direction of the first content and a speed change characteristic of the first content.
[0254] That is, the visual anti-sickness content can adjust its movement direction and speed change characteristics on the display device according to the predicted vehicle acceleration and / or vehicle angular velocity. The specific adjustment method can be as described above in Figure 9 and will not be repeated here.
[0255] Exemplarily, when the acceleration of the electronic device and the angular velocity of the electronic device do not satisfy a preset condition, it is determined that the first content is stationary.
[0256] That is, as shown in Scenario 1 above, when the vehicle's acceleration and angular velocity are less than the first threshold, the vehicle is stationary or traveling at a constant or near-constant speed along its direction of travel, and the visual anti-sickness content is determined to be stationary. When the electronic device's acceleration and angular velocity do not meet the preset conditions, the user's vestibule cannot perceive that the vehicle is accelerating, decelerating, or turning, and the user's vestibule believes that the vehicle is stationary or traveling at a constant speed, and the visual anti-sickness content is also stationary.
[0257] Exemplarily, when the acceleration of the electronic device meets a preset condition, the moving direction of the first content is determined to be expanding toward the edge or contracting toward the center, and the speed change characteristic of the first content is related to the acceleration of the electronic device.
[0258] That is, as shown in Scenarios 2 and 3 above, the acceleration of the electronic device meets the preset conditions, which can be understood as the acceleration of the electronic device or the absolute value of the acceleration reaching the threshold that the user can perceive. This includes two situations: one is vehicle acceleration, and the other is vehicle deceleration. When the acceleration during vehicle acceleration meets the preset conditions, the direction of movement of the visual anti-sickness content is expansion toward the edge; when the acceleration during vehicle deceleration meets the preset conditions, the speed of movement of the visual anti-sickness content is contraction toward the center.
[0259] Exemplarily, when the angular velocity of the electronic device meets a preset condition, it is determined that the moving direction of the first content is opposite to the moving direction of the electronic device, and the speed change characteristic of the first content is related to the angular velocity of the electronic device.
[0260] In other words, as shown in Scenario 4 above, the angular velocity of the electronic device meets the preset conditions, which can be understood as reaching the threshold that the user can perceive. When the angular velocity of the electronic device meets the preset conditions, the user's vestibule can sense that the vehicle is turning, and the visual anti-sickness content moves in the opposite direction of the vehicle's turn, providing the user with a visual prompt that the vehicle is turning. Moreover, as the vehicle's angular velocity increases, the movement speed of the visual anti-sickness content can also increase.
[0261] Furthermore, in order to personalize the anti-dizziness effect of the visual anti-dizziness content to suit different users, the speed change characteristics of the first content may be further adjusted, or the threshold that the user can perceive may be adjusted, or the display position and / or display area of the first content may be adjusted.
[0262] Specifically, the speed change characteristic of the first content is adjusted according to a first parameter, where the first parameter includes at least one of the following: user characteristics, user status, and motion status of the electronic device.
[0263] For example, the user characteristic can be understood as the user's motion sickness susceptibility, the user state can be understood as the user's current level of motion sickness, and the motion state of the electronic device can be understood as the vehicle's driving speed. For example, when the user's motion sickness susceptibility is high, the speed of changes in the visual motion sickness prevention content can be reduced; when the user's current level of motion sickness increases, the speed of changes in the visual motion sickness prevention content can be reduced.
[0264] Specifically, the preset condition is adjusted according to a first parameter, where the first parameter includes at least one of the following: user characteristics, user status, and motion status of the electronic device.
[0265] For example, the trigger threshold can be lowered when the user's susceptibility to motion sickness is higher, or the current level of motion sickness is higher. Furthermore, the trigger threshold can be adjusted based on the vehicle's motion state. For example, when the vehicle is moving at high speed, the vehicle's vibration frequency is high, and the user can perceive the vehicle's acceleration at a higher threshold. Therefore, the trigger threshold can be increased.
[0266] Specifically, the display area of the first content is determined according to any one of the first parameter and the second parameter; and / or the display position of the first content is determined according to any one of the first parameter and the second parameter; the first parameter includes at least one of the following: user characteristics, user status, and motion status of the electronic device, and the second parameter is the relative relationship between the screen of the electronic device and the user's retina.
[0267] It should be noted that the specific method of adjusting the display area and display position of the first content can be found in the above description of steps S206 to S208, and will not be repeated here to avoid redundancy.
[0268] The present application provides a display method, a display device, and an electronic device, which determine the acceleration and angular velocity of a vehicle with low or even no delay through prediction, and provide visual anti-motion sickness content that matches the acceleration and / or angular velocity of the vehicle on the vehicle's display device in combination with information such as the user status, user characteristics, and the vehicle's motion status, thereby reducing the conflict between the results of visual perception and the results of vestibular perception and alleviating the user's motion sickness.
[0269] The display method provided by the embodiments of the present application is described in detail above with reference to Figures 1 to 14. In the various embodiments of the present application, unless otherwise specified or logically conflicting, the terms and / or descriptions between the various embodiments are consistent and can be referenced to each other. The technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.
[0270] The apparatus provided in the embodiments of the present application will be described in detail below with reference to Figures 15 and 16. It should be understood that the description of the apparatus embodiment corresponds to the description of the method embodiment, and therefore, for matters not described in detail, reference can be made to the method embodiment above, and for the sake of brevity, no further description will be given here.
[0271] FIG15 shows a schematic block diagram of an apparatus 1500 provided in an embodiment of the present application. The apparatus 1500 may include a unit for executing the method shown in FIG14 .
[0272] Specifically, the device 1500 includes a processing unit 1510 and a transceiver unit 1520 .
[0273] Optionally, the device 1500 also includes a storage unit, which can be used to store instructions and / or data, and the processing unit 1510 can read the instructions and / or data in the storage unit so that the device implements the relevant actions performed by the electronic device in the aforementioned various method embodiments.
[0274] The apparatus 1500 can be used to execute the actions performed by the electronic device in each of the above method embodiments. In this case, the apparatus 1500 can be a component of the electronic device, for example, a chip or integrated circuit in the electronic device. The processing unit 1510 is used to execute the processing-related operations of the electronic device in the above method embodiments, and the transceiver unit 1520 is used to execute the transceiver-related operations of the electronic device in the above method embodiments.
[0275] It should be understood that the specific process of each unit executing the above corresponding steps has been described in detail in the above method embodiment, and for the sake of brevity, it will not be repeated here.
[0276] In a specific implementation, the actions performed by the processing unit 1510 and the transceiver unit 1520 may be implemented by one processor, or may be implemented by multiple processors.
[0277] Figure 16 is another schematic block diagram of an apparatus provided in an embodiment of the present application. The apparatus 1600 shown in Figure 16 may include: a processor 1610, a transceiver 1620, and a memory 1630. The processor 1610, the transceiver 1620, and the memory 1630 are connected via an internal connection path. The memory 1630 is used to store instructions, and the processor 1610 is used to execute the instructions stored in the memory 1630 to implement the methods in the above embodiments. Optionally, the memory 1630 can be coupled to the processor 1610 via an interface or integrated with the processor 1610.
[0278] It should be noted that the transceiver 1620 may include but is not limited to a transceiver device such as an input / output interface to implement communication between the device 1600 and other devices or a communication network.
[0279] Memory 1630 may be a volatile memory and / or a non-volatile memory. The non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM). For example, RAM may be used as an external cache. By way of example and not limitation, RAM includes the following forms: static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).
[0280] It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, the memory (storage module) can be integrated into the processor.
[0281] It should also be noted that the memory described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0282] The transceiver 1620 uses a transceiver device such as but not limited to a transceiver to implement communication between the apparatus 1600 and other devices or a communication network, so as to receive / send data / information used to implement the methods in the above embodiments.
[0283] The device 1600 may be a chip or a circuit provided in the above-mentioned electronic device.
[0284] An embodiment of the present application further provides a computer program product, which includes computer program code. When the computer program code runs on a computer, the computer implements the methods in the above embodiments of the present application.
[0285] An embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on a computer, the computer implements the methods in the above embodiments of the present application.
[0286] An embodiment of the present application also provides a chip, including a circuit, for executing the methods in the above embodiments of the present application.
[0287] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0288] In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is a kind of association relationship that describes associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In this application, "at least one" refers to one or more, and "more than one" refers to two or more. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.
[0289] In the embodiments of this application, prefixes such as "first" and "second" are used only to distinguish different description objects and have no limiting effect on the position, order, priority, quantity, or content of the described objects. The use of prefixes such as ordinal numbers in the embodiments of this application to distinguish description objects does not constitute a limitation on the described objects. For a statement of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary limitation.
[0290] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0291] In the various embodiments of the present application, unless otherwise specified or there is a logical conflict, the terms and / or descriptions between the various embodiments are consistent and can be referenced by each other. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.
[0292] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.
[0293] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0294] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A display method, characterized in that: The method is applied to an electronic device, comprising: Predicting first information, where the first information is information at a first moment, and the first information includes at least one of the following: The acceleration of the electronic device and the angular velocity of the electronic device; At the first moment, first content is displayed according to the first information.
2. The method according to claim 1, characterized in that The displaying of the first content according to the first information at the first moment includes: determining a second time instant according to the first time delay; outputting the first information at the second moment; After a first time delay, at the first moment, the first content is displayed according to the first information, and the second moment is before the first moment.
3. The method according to claim 1 or 2, characterized in that Before predicting the first information, the method further includes: Obtain second information, where the second information is information at a third moment, the third moment being before the first moment, and the second information includes at least one of the following: The mass of the electronic device, the degree of pedal opening and closing of the electronic device, the speed of the electronic device, road condition parameters, the angle of the steering wheel of the electronic device, and the angular velocity of the steering wheel of the electronic device.
4. The method according to claim 3, characterized in that When the first information is the acceleration of the electronic device, the predicting the first information includes: The acceleration of the electronic device is predicted according to the mass of the electronic device, the pedal opening and closing degree of the electronic device, the speed of the electronic device, and the road condition parameter.
5. The method according to claim 3 or 4, characterized in that When the first information is the angular velocity of the electronic device, the predicting the first information includes: The angular velocity of the electronic device is predicted according to the angle of the steering wheel of the electronic device or according to the angular velocity of the steering wheel of the electronic device.
6. The method according to any one of claims 1 to 5, characterized in that Before displaying the first content according to the first information, the method further includes: Determining a display mode of the first content according to the first information, where the display mode of the first content includes: The moving direction of the first content and the speed change characteristics of the first content.
7. The method according to claim 6, characterized in that The determining, according to the first information, a display mode of the first content includes: When the acceleration of the electronic device and the angular velocity of the electronic device do not satisfy a preset condition, it is determined that the first content is stationary.
8. The method according to claim 6, characterized in that The determining, according to the first information, a display mode of the first content includes: When the acceleration of the electronic device meets a preset condition, it is determined that the moving direction of the first content is expanding toward the edge or contracting toward the center, and the speed change characteristic of the first content is related to the acceleration of the electronic device.
9. The method according to claim 6, characterized in that The determining a display mode of the first content according to the first information includes: When the angular velocity of the electronic device meets a preset condition, it is determined that the moving direction of the first content is opposite to the moving direction of the electronic device, and the speed change characteristic of the first content is related to the angular velocity of the electronic device.
10. The method according to any one of claims 6 to 9, characterized in that The method further comprises: Adjust the speed change characteristic of the first content according to a first parameter, where the first parameter includes at least one of the following: User characteristics, user status, and motion status of electronic devices.
11. The method according to any one of claims 6 to 10, characterized in that The method further comprises: The preset condition is adjusted according to a first parameter, wherein the first parameter includes at least one of the following: User characteristics, user status, and motion status of electronic devices.
12. The method according to any one of claims 1 to 11, characterized in that Before displaying the first content according to the first information, the method further includes: Determining a display area of the first content according to any one of the first parameter and the second parameter; and / or determining a display position of the first content according to any one of the first parameter and the second parameter; The first parameter includes at least one of the following: User characteristics, user status, and motion status of electronic devices; The second parameter is the relative relationship between the screen of the electronic device and the user's retina.
13. A display device, characterized in that: The display device comprises means for performing the method according to any one of claims 1 to 12.
14. An electronic device, characterized in that: The electronic device is configured to execute the method according to any one of claims 1 to 12.
15. A display device, characterized in that: include: A processor coupled to a memory, wherein the memory is used to store a computer program, and the processor is used to run the computer program so that the display device performs the method according to any one of claims 1 to 12.
16. The display device according to claim 15, wherein: It also includes one or more of the memory and the transceiver, where the transceiver is used to receive signals and / or send signals.
17. A computer-readable storage medium, characterized in that A computer program is stored thereon, and when the computer program is executed by a computer, the computer is caused to implement the method according to any one of claims 1 to 12.
18. A computer program product comprising instructions, characterized in that When the computer program product is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 12.
19. A chip, characterized in that: The chip includes a processor and a data interface, and the processor reads instructions stored in a memory through the data interface to execute the method according to any one of claims 1 to 12.
Citation Information
Patent Citations
Display method, display device and electronic equipment
CN120523423A
Picture display method, intelligent vehicle, storage medium and device
CN112654959A
Display adjustment method, model calibration method, equipment, device and storage medium
CN114494430A
Motion sickness prediction prompting method and device, electronic equipment and computer readable medium
CN116039652A
Mobile display method, medium, program product and electronic equipment
CN116954534A