A display adjustment, model calibration method, device, apparatus, and storage medium

Abstract

An embodiment of the present application provides a display adjustment, model calibration method, device, apparatus, and storage medium. Obtain the shock absorption displacement, vehicle state information, and vehicle vibration attributes at a first moment; input the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into a display prediction model to determine the display adjustment parameters at a second moment; and adjust the display image corresponding to the second moment based on the display adjustment parameters. Through the above embodiment, according to the obtained shock absorption displacement, vehicle state information, and vehicle vibration attributes at the first moment, prediction processing is performed using the display prediction model to obtain the display adjustment parameters; furthermore, the display image is adjusted at the second moment so that the adjusted display image cancels or overcomes the influence brought by vehicle shaking or bumping, and remains relatively stationary with the viewer (passenger) as much as possible, reducing dizziness or discomfort in the viewing effect.

Description

Technical Field

[0001] This application relates to the field of image processing technologies, and in particular, to a display adjustment, model calibration method, device, apparatus, and storage medium. Background Art

[0002] With the intelligence of vehicles, more and more vehicles are equipped with large-size entertainment displays. Different from traditional in-vehicle displays, large-size displays are mainly for passengers. For example, a large-size display screen can be installed on the front-row seats or the front-row roof for the rear passengers to watch, or it can be installed on the center console or the co-pilot center console for the co-pilot passengers to watch. It is easy to understand that during the driving of the vehicle, due to actions such as acceleration, deceleration, lane change, turning, or because of uneven road surfaces, the vehicle will shake or jolt. Passengers will maintain a long-term stable gaze during use and watch the display content when the vehicle shakes or jolts, which is extremely likely to cause motion sickness or discomfort. Therefore, a new solution is urgently needed. Summary of the Invention

[0003] Embodiments of this application provide a display adjustment, model calibration method, device, apparatus, and storage medium for accurately adjusting a display image accordingly when the vehicle shakes or jolts.

[0004] In a first aspect, embodiments of this application provide a display adjustment method, including:

[0005] Obtain the shock absorption displacement, vehicle state information, and vehicle vibration attributes at a first moment;

[0006] Input the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into a display prediction model to determine the display adjustment parameters at a second moment;

[0007] Based on the display adjustment parameters, adjust the display image corresponding to the second moment.

[0008] Optionally, obtaining the vehicle vibration attributes includes: obtaining the vehicle weight, shock absorption parameters, and damping parameters; inputting the vehicle weight, the shock absorption parameters, and the damping parameters into a vehicle vibration model to determine the vehicle vibration attributes.

[0009] Optionally, the step of inputting the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into a display prediction model to determine the display adjustment parameters at a second moment includes: determining the second moment according to the first moment input into the display prediction model; inputting the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into the display prediction model to determine the translation parameters and scaling parameters as the display adjustment parameters.

[0010] Optionally, adjusting the display image corresponding to the second moment based on the display adjustment parameter includes: determining a target display image corresponding to the second moment in the video to be played according to the timestamp of the display image; and adjusting the target display image based on the display adjustment parameter.

[0011] Optionally, adjusting the target display image based on the display adjustment parameter includes: performing a translation adjustment on the target display image based on the translation parameter of the display adjustment parameter; and / or performing a scaling adjustment on the target display image based on the scaling parameter of the display adjustment parameter.

[0012] In a second aspect, an embodiment of the present application provides a model calibration method, including:

[0013] Obtaining the calibrated shock absorption displacement, the calibrated vehicle state information, and the calibrated vehicle vibration attribute of the calibrated vehicle;

[0014] Obtaining the calibrated display screen vibration parameter in the calibrated vehicle;

[0015] Generating a display prediction model to be calibrated based on the calibrated shock absorption displacement, the calibrated vehicle state parameter, and the calibrated vehicle vibration attribute;

[0016] Inputting the calibrated display screen vibration parameter into the display prediction model to be calibrated for calibration processing;

[0017] Generating the display prediction model.

[0018] In a third aspect, an embodiment of the present application provides an electronic device, including: a memory, a processor, a communication component, and a display component; the memory is used for storing one or more computer instructions; the processor is used for executing the one or more computer instructions to: execute the steps in the method of the first aspect or the steps in the method of the second aspect through the processor.

[0019] In a fourth aspect, an embodiment of the present application provides a vehicle device, including the electronic device described in the third aspect.

[0020] In a fifth aspect, an embodiment of the present application provides a display adjustment device, which is applied to a vehicle device. The device includes:

[0021] An acquisition module, configured to acquire the shock absorption displacement and the vehicle state information at the first moment;

[0022] A determination module, configured to input the shock absorption displacement and the vehicle state information into a display prediction model to determine a display adjustment parameter at the second moment;

[0023] An adjustment module, configured to adjust the display image corresponding to the second moment based on the display adjustment parameter.

[0024] In a sixth aspect, an embodiment of the present application provides a model calibration device, which includes:

[0025] An acquisition module, configured to acquire the calibrated shock absorption displacement, the calibrated vehicle state information, and the calibrated vehicle vibration attribute of a calibrated vehicle;

[0026] The acquisition module is further configured to acquire the calibrated display screen vibration parameter in the calibrated vehicle;

[0027] A generation module, configured to generate a display prediction model to be calibrated based on the calibrated shock absorption displacement, the calibrated vehicle state parameter, and the calibrated vehicle vibration attribute;

[0028] An input module, configured to input the calibrated display screen vibration parameter into the display prediction model to be calibrated for calibration processing;

[0029] The generation module is further configured to generate the display prediction model.

[0030] In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium storing a computer program, and when the computer program is executed, it can implement the steps in the method described in the first aspect or the steps in the method described in the second aspect.

[0031] In the display adjustment method, device, apparatus, and storage medium provided by the embodiments of the present application, the shock absorption displacement, the vehicle state information, and the vehicle vibration attribute at the first moment are acquired; the shock absorption displacement, the vehicle state information, and the vehicle vibration attribute are input into a display prediction model to determine the display adjustment parameter at the second moment; based on the display adjustment parameter, the display image corresponding to the second moment is adjusted. Through the above embodiments, according to the acquired shock absorption displacement, vehicle state information, and vehicle vibration attribute at the first moment, prediction processing is performed using the display prediction model to obtain the display adjustment parameter; furthermore, the display image corresponding to the second moment is adjusted so that the adjusted display image is displayed at the second moment to offset or overcome the influence brought by vehicle shaking or bumping, and keep relatively stationary with the viewer (passenger) as much as possible, reducing dizziness or discomfort in the viewing effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The drawings described herein are used to provide a further understanding of the present application, and constitute a part of the present application. The schematic embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation to the present application. In the drawings:

[0033] Figure 1 It is a schematic flowchart of a display adjustment method provided by an embodiment of the present application;

[0034] Figure 2 A schematic diagram of a feature processing flow provided by an embodiment of the present application;

[0035] Figure 3 A schematic diagram of the structure for calibrating a display prediction model provided by an embodiment of the present application;

[0036] Figure 4 A schematic diagram of display image adjustment illustrated by an example of an embodiment of the present application;

[0037] Figure 5 A schematic diagram of vehicle coordinate decomposition provided by an embodiment of the present application;

[0038] Figure 6 A schematic diagram of the structure of vehicle equipment provided by an embodiment of the present application;

[0039] Figure 7 A schematic diagram of a display adjustment device provided by an embodiment of the present application;

[0040] Figure 8 A schematic diagram of a model calibration device provided by an embodiment of the present application. Detailed implementation manners

[0041] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.

[0042] In some processes described in the specification, claims and the above-mentioned drawings of the present invention, there are multiple operations that appear in a specific order. These operations may not be executed in the order in which they appear herein or may be executed in parallel. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions such as "first" and "second" in this article are used to distinguish different messages, devices, modules, etc., and do not represent a sequence, nor do they limit that "first" and "second" are of different types.

[0043] To make the objectives, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be clearly and completely described below with reference to the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without making creative efforts shall fall within the protection scope of the present application.

[0044] With the development of vehicle intelligence, in-vehicle displays are configured in more and more new vehicle models. The in-vehicle display can not only provide drivers with more intuitive and comprehensive vehicle-related information, but also provide better riding experiences for in-vehicle passengers. For example, some business people have the need to work in the car, and some children like to watch their favorite cartoons while riding in the car, etc. It is easy to understand that when the vehicle is driving, it does not always move in a straight line and at a constant speed. There are needs to change lanes or turn, or start and stop due to traffic lights ahead, or jolt due to uneven road surfaces. For passengers watching videos, when they are concentrating on watching the in-vehicle display, a sudden jolt will cause a sudden change in the relative position relationship between the passenger and the in-vehicle display, which is likely to cause discomfort problems such as motion sickness for passengers. Therefore, a solution that can accurately adjust the displayed image according to the viewing needs of passengers is required.

[0045] The following will, in conjunction with the accompanying drawings, elaborate on the technical solutions provided by the embodiments of the present application.

[0046] First Embodiment

[0047] Figure 1 is a schematic flowchart of the display adjustment method provided by the embodiment of the present application. As Figure 1 shown, the method includes:

[0048] 101: Obtain the shock absorption displacement and vehicle state information at the first moment.

[0049] 102: Input the shock absorption displacement and the vehicle state information into the display prediction model to determine the display adjustment parameters at the second moment.

[0050] 103: Adjust the display image corresponding to the second moment based on the display adjustment parameters.

[0051] In this embodiment, in order to improve the driving and riding experiences of vehicle drivers or passengers, vehicle shock absorption has become a standard configuration. When the vehicle motion state changes, the shock absorption can play a good buffering role. In order to obtain vehicle vibration-related information more accurately, a front shock absorption displacement sensor and a rear shock absorption displacement sensor can be respectively installed at the front shock absorption position and the rear shock absorption position to collect the shock absorption displacements corresponding to the front shock absorption and the rear shock absorption respectively when the vehicle motion state changes. It should be noted that although various acceleration sensors and other related devices can be used to judge the vehicle motion state, it is impossible to accurately determine how much the change state actually affects the passengers. Therefore, the result obtained by using the method of obtaining the shock absorption displacement and the vehicle state information to comprehensively determine the display adjustment parameters is more accurate.

[0052] The vehicle status information mentioned here includes the vehicle's own status information and the load status information. Among them, the vehicle's own status information includes the vehicle's own weight, the steering of the vehicle's front wheels, the vehicle speed, etc. The load status information includes the passenger weight, the passenger position, the cargo weight, the cargo position, etc.

[0053] It is easy to understand that when the vehicle's status changes, there is a certain lag for the rear passengers. For example, when the vehicle passes over a speed bump, the front wheels first contact the speed bump, which causes a change in the shock displacement corresponding to the front shock absorber. Due to the buffering effect of the front shock absorber, or further considering that there is a certain distance between the passengers and the front wheels, if the shock displacement of the front shock absorber and the corresponding vehicle status information are collected at the first moment, the passengers will feel the change in the vehicle's status at a slightly later second moment. Specifically, due to the overall inertia of the vehicle, the motion peak of the in-vehicle display has a certain delay relative to the bump of the front wheels.

[0054] Therefore, in order to achieve a more precise adjustment of the in-vehicle display, after determining the display adjustment parameters, the display image corresponding to the second moment needs to be adjusted, so as to effectively avoid adjusting the display image too early or too late, so that the display image when playing the video at the second moment is the adjusted image.

[0055] In this embodiment, it is necessary to use the output result of the pre-calibrated display prediction model to adjust the display image. Specifically, after collecting the shock displacement of the front shock absorber, the vehicle status information, and the vehicle vibration attributes through sensors, etc., the shock displacement, the vehicle status information, and the vehicle vibration attributes are input into the display prediction model. Furthermore, the second moment for adjusting the display image can be obtained through the display prediction model. And adjust the display image to be played at the second moment, for example, perform left-right movement or zoom adjustment, etc., so that the adjusted display image played at the second moment is relatively stationary with the passengers, so that when the passengers watch the video, the impact brought by the bumps is reduced.

[0056] It should be noted that the adjustment scheme disclosed in this embodiment can not only be applied to the adjustment of the display image of in-vehicle videos, but also be applied to the adjustment of other fields or scenarios (such as, 4D movie scenarios).

[0057] Second Embodiment

[0058] As Figure 2 is a schematic flow chart of the display prediction model calibration method provided by the embodiment of the present application. In practical applications, calibration can be performed based on a large amount of historical data. Due to the relatively large amount of calculation, a local server or a cloud server can be used to implement the calibration work of the display prediction model. From Figure 2As can be seen, the display prediction model is obtained through pre-calibration. The calibration method of the display prediction model specifically includes the following steps: 201: Obtain the calibrated shock absorption displacement, calibrated vehicle state information, and calibrated vehicle vibration attributes of the calibrated vehicle. 202: Obtain the calibrated display screen vibration parameters in the calibrated vehicle. 203: Generate a display prediction model to be calibrated based on the calibrated shock absorption displacement, the calibrated vehicle state parameters, and the calibrated vehicle vibration attributes. 204: Input the calibrated display screen vibration parameters into the display prediction model to be calibrated for calibration processing. 205: Generate the display prediction model.

[0059] For ease of understanding, the following will be combined with the attached Figure 3 for an illustrative example. Such as Figure 3 is a schematic structural diagram for calibrating the display prediction model provided by an embodiment of the present application. As can be seen from Figure 3 it, first, a display prediction model to be calibrated is constructed based on the vehicle vibration model M, the calibrated shock absorption displacement, and the vehicle state information. Since the prediction accuracy of this prediction model is not very good, therefore, the prediction model needs to be further calibrated. Specifically, obtain the real calibrated shock absorption displacement (front shock absorption displacement and / or rear shock absorption displacement), and the real calibrated vehicle state information. At the same time, it is also necessary to obtain the calibrated display screen vibration parameters. Generally speaking, when calibrating the vehicle to be calibrated, a high-precision acceleration sensor can be installed at the position of the in-vehicle display screen, and through this sensor, the real display screen vibration parameters generated due to the change of the vehicle motion state can be obtained. Input the real calibrated shock absorption displacement (front shock absorption displacement and rear shock absorption displacement), and the real calibrated vehicle state information into the display prediction model to be calibrated, so as to obtain the calibrated display screen vibration parameters to be calibrated. According to the difference relationship between the actually collected real display screen vibration parameters and the calibrated display screen vibration parameters to be calibrated, the parameters of the display prediction model to be calibrated are adjusted, so that the calibrated display prediction model can be obtained, and more accurate prediction of the display adjustment parameters can be realized.

[0060] In practical applications, the display adjustment time also needs to be determined during the calibration of the display prediction model. Specifically, it includes: determining the third moment corresponding to the calibrated shock absorption displacement of the calibrated vehicle and the fourth moment corresponding to the calibrated display screen vibration parameters; determining the display adjustment time based on the difference between the fourth moment and the third moment.

[0061] When calibrating the display prediction model, while obtaining the shock absorption displacement of the calibration vehicle, record the corresponding third moment when obtaining the shock absorption displacement. When obtaining the vibration parameters of the calibration display screen, record the fourth moment when the parameter reaches the maximum value. Assume that the calibration vehicle needs to pass over a speed bump. Then, at time T1, the front wheel runs over the speed bump, causing a change in the front shock absorption, and the shock absorption displacement A1 is obtained. Furthermore, at time T2, the high-precision acceleration sensor installed at the position of the display screen detects an acceleration value of a. Through calculation, it can be known that the display adjustment time is T = T2 - T1.

[0062] The display prediction model calibrated through the above embodiments can provide a basis for adjusting the display image, so that passengers cannot perceive the existence of vehicle vibration when watching video images.

[0063] Third Embodiment

[0064] Before adjusting the display image of the vehicle, it is necessary to obtain the vehicle weight, shock absorption parameters, and damping parameters by means of sensors, etc.; input the vehicle weight, the shock absorption parameters, and the damping parameters into the vehicle vibration model to determine the vehicle vibration attributes.

[0065] In practical applications, the degrees of freedom selected in the vehicle vibration model can be further increased as needed, taking into account the vehicle weight, shock absorption parameters, and damping parameters. For example, the vehicle longitudinal speed, yaw angular velocity, and center of mass side slip angle can also be considered. Using the vehicle vibration model, the vibration attributes of the vehicle can be output.

[0066] In one or more embodiments of the present application, the step of inputting the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into the display prediction model to determine the display adjustment parameters at the second moment includes: determining the second moment according to the first moment input into the display prediction model; inputting the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into the display prediction model to determine the translation parameter and / or the scaling parameter as the display adjustment parameters.

[0067] For example, assume that the display adjustment time is T, and the corresponding first moment is T3. Then, through calculation, it can be known that the second moment T4 = T + T3. That is, after obtaining the shock absorption displacement, vehicle state information, and vehicle vibration attributes of the vehicle, these data can be input into the display prediction model, and then the display adjustment parameters can be determined. The display adjustment parameters mentioned here include the translation parameter and the scaling parameter. Based on the translation parameter and the scaling parameter, the display image on the display screen is directly adjusted. Specifically, such as Figure 4Schematic diagram for illustrating display image adjustment according to an embodiment of the present application. When the vehicle starts, the display image is enlarged based on the zoom parameter; when the vehicle decelerates, the display image is reduced based on the zoom parameter; when the vehicle turns left at a constant speed, the display image is translated to the right based on the translation parameter; when the vehicle turns right at a constant speed, the display image is translated to the left based on the translation parameter; when the vehicle turns left while decelerating, the display image is translated to the right and reduced based on the translation parameter and the zoom parameter. The specific adjustment process will be specifically illustrated in the following embodiments and will not be repeated here.

[0068] In one or more embodiments of the present application, adjusting the display image corresponding to the second moment based on the display adjustment parameter includes: determining a target display image in the video to be played corresponding to the second moment according to the timestamp of the display image; and adjusting the target display image based on the display adjustment parameter. Further, after adjusting the target display image, the adjusted target display image is stored in a specified cache for playing at the second moment.

[0069] In practical applications, some display images are obtained by playing a video to be played using an in-vehicle video device (including at least a storage device and a display device). It is possible to know the timestamp corresponding to each frame of the display image in the video to be played. For example, for a 1-minute video with a total of 1440 frames of images, when the vehicle runs over a speed bump at 30 seconds and the display adjustment time is 1 second, it can be known that 24 frames of images between the timestamp of 30 seconds and 31 seconds in the 1440 frames of images are used as the target display images and adjusted according to the display adjustment parameter. In order to enable the viewer (passenger) to obtain a better viewing effect, the target display image can be adjusted and stored in the cache before playing, and then the target video content in the cache can be played smoothly directly.

[0070] In one or more embodiments of the present application, adjusting the target display image based on the display adjustment parameter includes: performing a translation adjustment on the target display image based on the translation parameter; and / or performing a zoom adjustment on the target display image based on the zoom parameter.

[0071] In practical applications, acceleration a will be generated at the position where the in-vehicle display screen is located due to vehicle acceleration, deceleration, jolting, etc. It should be noted that the acceleration data collected by the high-precision acceleration sensor installed at the position of the in-vehicle display screen is the vibration that has been transmitted to the display screen position. The display prediction model can be used to predict in advance, so that there is time to adjust the display image in the in-vehicle display screen. Specifically, as Figure 5 Schematic diagram of vehicle coordinate decomposition provided by an embodiment of the present application. As Figure 5As shown in the figure, a is decomposed into the acceleration a_x in the X-axis direction, the acceleration a_y in the Y-axis direction, and the acceleration a_z in the Z-axis direction according to the vehicle axis. Further, the screen is translated on the display plane (the vehicle YZ plane), and the translation parameters between the centers of adjacent display images are m_y = p_1 * k_1 * a_y and m_z = p_1 * k_1 * a_z, where k_1 is a constant obtained from vehicle testing, p_1 is a decimal number with a value range of 0 to 2, which can be adjusted by the user for adaptation, and m_y and m_z are the translation parameters.

[0072] In the vehicle traveling direction (X-axis direction), there is a central scaling between adjacent display images, and the image scaling ratio s = p_2 * k_2 * a_x, where k_2 is a constant obtained from vehicle testing, p_2 is a decimal number with a value range of -2 to 2, which can be adjusted by the user for adaptation, and s is the scaling parameter.

[0073] In some of the processes described in the above embodiments and the accompanying drawings, a plurality of operations appear in a specific order. However, it should be clearly understood that these operations can be executed not in the order in which they appear in this text or in parallel. The operation numbers such as 11, 12, etc. are only used to distinguish different operations, and the numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations can be executed in sequence or in parallel.

[0074] It should be noted that the descriptions such as "first", "second", etc. in this text are used to distinguish different messages, devices, modules, etc., do not represent a sequence, and do not limit that "first" and "second" are of different types.

[0075] Fourth Embodiment

[0076] Figure 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As Figure 6 shown, the terminal device includes: a memory 601 and a processor 602.

[0077] The memory 601 is used to store computer programs and can be configured to store various other data to support operations on the terminal device. Examples of these data include instructions for any application program or method for operating on the terminal device, contact data, phone book data, messages, pictures, videos, etc.

[0078] Among them, the memory 601 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0079] The electronic device further includes: a display component 603. A processor 602, coupled to the memory 601, is configured to execute a computer program in the memory 601 for: obtaining the shock absorption displacement, vehicle state information, and vehicle vibration attributes at a first moment; inputting the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into a display prediction model to determine display adjustment parameters at a second moment; and adjusting the display image corresponding to the second moment based on the display adjustment parameters.

[0080] In practical applications, the electronic device may be an in-vehicle electronic device, thereby realizing the adjustment of the in-vehicle display image.

[0081] Further optionally, the processor 602 is further configured to: obtain the vehicle weight, shock absorption parameters, and damping parameters; input the vehicle weight, the shock absorption parameters, and the damping parameters into a vehicle vibration model to determine the vehicle vibration attributes.

[0082] Further optionally, the processor 602 is further configured to: determine the second moment according to the first moment input into the display prediction model; input the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into the display prediction model to determine translation parameters and / or scaling parameters as the display adjustment parameters.

[0083] Further optionally, the processor 602 is further configured to: determine a target display image in the video to be played corresponding to the second moment according to the timestamp of the display image; and adjust the target display image based on the display adjustment parameters.

[0084] Further optionally, the processor 602 is further configured to: store the adjusted target display image in a specified cache for playback.

[0085] Further optionally, the processor 602 is further configured to: perform a translation adjustment on the target display image based on the translation parameters; and / or perform a scaling adjustment on the target display image based on the scaling parameters.

[0086] The above Figure 6 The memory in the above can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disc.

[0087] The above Figure 6The display component 603 therein includes a screen, which may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operations.

[0088] The above-mentioned Figure 6 The audio component 604 therein can be configured to output and / or input audio signals. For example, the audio component includes a microphone (MIC), which is configured to receive external audio signals when the device where the audio component is located is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory or sent via the communication component. In some embodiments, the audio component further includes a speaker for outputting audio signals.

[0089] Furthermore, as Figure 6 shown, the vehicle device further includes other components such as a communication component 605 and a power supply component 606. Figure 6 Only some components are schematically shown therein, which does not mean that the vehicle device only includes Figure 6 the components shown.

[0090] The above-mentioned Figure 6 The communication component 605 therein is configured to facilitate communication between the device where the communication component is located and other devices in a wired or wireless manner. The device where the communication component is located can access a wireless network based on a communication standard, such as WiFi, 2G, 6G, 4G, or 5G, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component can be implemented based on near field communication (NFC) technology, radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0091] Among them, the power supply component 606 provides power for various components of the device where the power supply component is located. The power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device where the power supply component is located.

[0092] The fifth embodiment

[0093] In the fifth embodiment, as Figure 7 is a schematic diagram of the display adjustment device provided by the embodiment of the present application. As Figure 7 shown, the display adjustment device includes:

[0094] An acquisition module 71, configured to acquire the shock absorption displacement, vehicle state information, and vehicle vibration attributes at a first moment.

[0095] A determination module 72, configured to input the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into a display prediction model to determine a display adjustment parameter at a second moment.

[0096] An adjustment module 73, configured to adjust the display image corresponding to the second moment based on the display adjustment parameter.

[0097] Optionally, the acquisition module 71 is further configured to acquire the vehicle weight, shock absorption parameters, and damping parameters. Input the vehicle weight, the shock absorption parameters, and the damping parameters into a vehicle vibration model to determine the vehicle vibration attributes.

[0098] Optionally, the determination module 72 is further configured to determine the second moment according to the first moment input into the display prediction model. Input the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into the display prediction model to determine a translation parameter and / or a scaling parameter as the display adjustment parameter.

[0099] Optionally, the adjustment module 73 is further configured to determine a target display image corresponding to the second moment in a to-be-played video according to the time stamp of the display image; adjust the target display image based on the display adjustment parameter.

[0100] Optionally, the adjustment module 73 is further configured to store the adjusted target display image into a specified cache for playing.

[0101] Optionally, the adjustment module 73 is further configured to perform a translation adjustment on the target display image based on the translation parameter; and / or perform a scaling adjustment on the target display image based on the scaling parameter.

[0102] Sixth Embodiment

[0103] In the sixth embodiment, Figure 8 is a schematic diagram of a model calibration device provided by an embodiment of the present application. As Figure 8 shown, the model calibration device includes:

[0104] An acquisition module 81, configured to acquire the calibrated shock absorption displacement, calibrated vehicle state information, and calibrated vehicle vibration attributes of a calibrated vehicle.

[0105] The acquisition module 81 is further configured to acquire the vibration parameter of a calibrated display screen in the calibrated vehicle.

[0106] A generation module 82, configured to generate a display prediction model to be calibrated based on the calibrated shock absorption displacement, the calibrated vehicle state parameters, and the calibrated vehicle vibration attributes.

[0107] An input module 83, configured to input the calibrated display screen vibration parameters into the display prediction model to be calibrated for calibration processing, and generate the display prediction model.

[0108] Optionally, it further includes a determination module 84, configured to determine a third moment corresponding to the calibrated shock absorption displacement of the calibrated vehicle and a fourth moment corresponding to the calibrated display screen vibration parameters, and determine a display adjustment time based on a difference between the fourth moment and the third moment.

[0109] The display prediction model calibrated through the above embodiments can provide a basis for adjusting the display image, so that when a passenger watches a video image, the existence of vehicle vibration cannot be perceived.

[0110] In the embodiments of the present application, the shock absorption displacement, vehicle state information, and vehicle vibration attributes at a first moment are obtained; the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes are input into a display prediction model to determine display adjustment parameters at a second moment; based on the display adjustment parameters, the display image is adjusted at the second moment. Through the above embodiments, according to the obtained shock absorption displacement, vehicle state information, and vehicle vibration attributes at the first moment, prediction processing is performed using the display prediction model to obtain display adjustment parameters; furthermore, the display image is adjusted at the second moment, so that the adjusted display image is kept relatively stationary with respect to the viewer (passenger) as much as possible, and the influence of vehicle vibration cannot be perceived from the viewing effect.

[0111] Correspondingly, the embodiments of the present application further provide a computer-readable storage medium storing a computer program, and when the computer program is executed, each step executable by a terminal device in the above method embodiments can be implemented.

[0112] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0113] The present invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each flow and / or block of the flowchart illustrations and / or block diagrams, and combinations of flows and / or blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing apparatus create means for implementing the functions specified in the flowchart flow or flows and / or block or blocks. Figure 1 in a flow or flows and / or block or blocks Figure 1 or blocks.

[0114] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means that implement the functions specified in the flowchart flow or flows and / or block or blocks. Figure 1 in a flow or flows and / or block or blocks Figure 1 or blocks.

[0115] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions executed on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and / or block or blocks. Figure 1 in a flow or flows and / or block or blocks Figure 1 or blocks.

[0116] In a typical configuration, a computing device includes one or more processors (CPUs), an input / output interface, a network interface, and memory.

[0117] The memory may include non-permanent memory in the form of computer-readable media, random access memory (RAM), and / or non-volatile memory such as read-only memory (ROM) or flash memory. Memory is an example of computer-readable media.

[0118] A computer-readable medium includes both permanent and non-permanent, removable and non-removable media and can implement information storage by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, disk storage or other magnetic storage devices, or any other non-transitory medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer-readable medium does not include transitory computer-readable media such as modulated data signals and carrier waves.

[0119] It should also be noted that the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or apparatus comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or apparatus. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising the element.

[0120] The above description is only for the embodiments of the present application and is not intended to limit the present application. For those skilled in the art, the present application can have various changes and modifications. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.

Claims

1. A display adjustment method, characterized in that, The method includes: Obtain the shock absorption displacement, vehicle state information, and vehicle vibration attributes at a first moment; Input the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into a display prediction model to determine display adjustment parameters at a second moment, including: Determine the second moment according to the first moment input into the display prediction model; Input the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into the display prediction model to determine a translation parameter and / or a scaling parameter as the display adjustment parameters; Adjust the display image corresponding to the second moment based on the display adjustment parameters; the second moment is the first moment plus T, where T = T2 - T1; T1 is the moment when the shock absorption displacement is detected during the calibration process of the display prediction model; T2 is the moment when the acceleration sensor at the position of the display screen detects an acceleration value after detecting the shock absorption displacement.

2. The method according to claim 1, wherein The obtaining of the vehicle vibration attributes includes: Obtain the vehicle weight, shock absorption parameters, and damping parameters; Input the vehicle weight, the shock absorption parameters, and the damping parameters into a vehicle vibration model to determine the vehicle vibration attributes.

3. The method according to claim 1, wherein The adjusting of the display image corresponding to the second moment based on the display adjustment parameters includes: Determine a target display image in the video to be played corresponding to the second moment according to the timestamp of the display image; Adjust the target display image based on the display adjustment parameters.

4. The method according to claim 3, wherein The adjusting of the target display image based on the display adjustment parameters includes: Perform a translation adjustment on the target display image based on the translation parameter of the display adjustment parameters; and / or, perform a scaling adjustment on the target display image based on the scaling parameter of the display adjustment parameters.

5. A model calibration method, characterized in that, The method includes: Obtain the calibrated shock absorption displacement, calibrated vehicle state information, and calibrated vehicle vibration attributes of a calibrated vehicle; Obtain the calibrated display screen vibration parameters of the calibrated vehicle; Generate a display prediction model to be calibrated based on the calibrated shock absorption displacement, the calibrated vehicle state parameters, and the calibrated vehicle vibration attributes; Input the calibrated display screen vibration parameters into the display prediction model to be calibrated for calibration processing; Generate the display prediction model; Wherein, the display prediction model is used to input the shock absorption displacement, vehicle state information, and vehicle vibration attributes at a first moment into the display prediction model to determine display adjustment parameters at a second moment, including: Determine the second moment according to the first moment input into the display prediction model; Input the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into the display prediction model to determine a translation parameter and / or a scaling parameter as the display adjustment parameters; The display adjustment parameter is used to adjust the display image corresponding to the second moment; the second moment is the first moment plus T, where T = T2 - T1; T1 is the moment when the shock absorption displacement is detected during the calibration process of the display prediction model; T2 is the moment when the acceleration sensor at the position of the display screen detects an acceleration value after the shock absorption displacement is detected.

6. An electronic device, characterized in that, Including: A memory, a processor, a communication component, and a display component; The memory is used to store one or more computer instructions; The processor is configured to execute the one or more computer instructions for: executing the steps in the method according to any one of claims 1-4 or executing the steps in the method according to claim 5 through the processor.

7. A vehicle, characterized in that, Including the electronic device of claim 6.

8. A display adjustment device, applied to vehicle equipment, characterized in that, The device includes: An acquisition module, configured to acquire the shock absorption displacement, vehicle state information, and vehicle vibration attributes at the first moment; A determination module, configured to input the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into the display prediction model to determine the display adjustment parameter at the second moment; The determination module is further configured to determine the second moment according to the first moment input into the display prediction model; input the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into the display prediction model to determine the translation parameter and / or scaling parameter as the display adjustment parameter; An adjustment module, configured to adjust the display image corresponding to the second moment based on the display adjustment parameter; The second moment is the first moment plus T, where T = T2 - T1; T1 is the moment when the shock absorption displacement is detected during the calibration process of the display prediction model; T2 is the moment when the acceleration sensor at the position of the display screen detects an acceleration value after the shock absorption displacement is detected.

9. A model calibration device, characterized in that, The device includes: An acquisition module, configured to acquire the calibrated shock absorption displacement, calibrated vehicle state information, and calibrated vehicle vibration attributes of the calibrated vehicle; The acquisition module is further configured to acquire the calibrated display screen vibration parameters in the calibrated vehicle; A generation module, configured to generate a display prediction model to be calibrated based on the calibrated shock absorption displacement, the calibrated vehicle state parameters, and the calibrated vehicle vibration attributes; An input module, configured to input the calibrated display screen vibration parameters into the display prediction model to be calibrated for calibration processing; The generation module is further configured to generate the display prediction model; Wherein, the display prediction model is used to input the shock absorption displacement, vehicle state information, and vehicle vibration attributes at the first moment into the display prediction model to determine the display adjustment parameter at the second moment, including: Determining the second moment according to the first moment input into the display prediction model; Inputting the shock absorption displacement, the vehicle state information, and the vehicle vibration attributes into the display prediction model to determine the translation parameter and / or scaling parameter as the display adjustment parameter; The display adjustment parameter is used to adjust the display image corresponding to the second moment; the second moment is the first moment plus T, where T = T2 - T1; T1 is the moment when the shock absorption displacement is detected during the calibration process of the display prediction model; T2 is the moment when the acceleration sensor at the position of the display screen detects an acceleration value after the shock absorption displacement is detected.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed, it can implement the steps in the method described in any one of claims 1-4 or the steps in the method described in claim 5.

Images