Control method and device and carrying tool

CN119998789APending Publication Date: 2025-05-13YINWANG INTELLIGENT TECHNOLOGIES CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202380070210.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-01-19
Publication Date
2025-05-13

AI Technical Summary

Technical Problem

In vehicle smart cockpits, problems such as display freezes lead to poor user experience. How to improve the user's driving experience and driving safety has become an urgent problem to be solved.

Method used

By dynamically adjusting the display frame rate of the display device according to the operating status of the vehicle and the user's position in the cockpit, it ensures that the display effect meets user needs, improves user experience, and flexibly determines the display frame rate when resources are limited, reducing display Regarding the energy consumption of the equipment, priority is given to ensuring that the display equipment in the main driving area displays at a higher frame rate.

Benefits of technology

It improves the user experience and driving safety, ensures the smoothness and energy efficiency of the display device, avoids lagging caused by excessive computing unit resources, and prioritizes ensuring that the display device in the main driving area displays at a high frame rate, improving Driving experience and safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119998789A_ABST
    Figure CN119998789A_ABST
Patent Text Reader

Abstract

The invention discloses a control method and device and a carrier, and the method comprises the steps: according to at least one of the operation state of the carrier, the position of a user in a cabin of the carrier, the touch screen operation of display equipment of the carrier, and the type of an application program to which an interface to be displayed of the display equipment belongs; determining a display frame rate of the display equipment; and controlling the display equipment to display at the display frame rate. The control method can be applied to the intelligent vehicle, the driving experience of the user can be improved, and further, the driving safety can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Control method, device and vehicle Technical Field

[0001] The present application relates to the field of smart cockpits, and in particular, to a control method, device, and vehicle. Background Art

[0002] As vehicles become increasingly intelligent and connected, cockpits are evolving into intelligent cockpits centered around human-machine interaction and featuring multi-screen collaboration. While these intelligent cockpits offer increasingly rich audio and video entertainment features, they can also experience issues like display freezes, leading to a poor user experience. Therefore, improving the user experience of in-vehicle displays has become a pressing issue.

[0003] Summary of the Invention

[0004] The present application provides a control method, device and vehicle, which can control the display frame rate of the display device of the vehicle according to the operating status of the vehicle and / or the position of the user in the vehicle, thereby improving the user's driving experience and further improving driving safety.

[0005] In a first aspect, a control method is provided, which can be executed by a vehicle; or, it can be executed by a computing platform of a vehicle; or, it can be executed by a chip or circuit module used for a vehicle, and this application does not make specific limitations on this.

[0006] The vehicles involved in this application may include road vehicles, water vehicles, air vehicles, industrial equipment, agricultural equipment, or entertainment equipment. For example, the vehicle can be a vehicle, which is a vehicle in the broad sense, and can be a vehicle (such as a commercial vehicle, a passenger car, a motorcycle, a flying car, a train, etc.), an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), agricultural equipment (such as a lawn mower, a harvester, etc.), amusement equipment, a toy vehicle, etc. The embodiments of this application do not specifically limit the type of vehicle. For another example, the vehicle can be a vehicle such as an airplane or a ship.

[0007] The method includes: determining the display frame rate of the display device based on at least one of the operating status of the vehicle, the user's position in the cabin of the vehicle, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs; and controlling the display device to display at the display frame rate.

[0008] Compared to existing technologies, the above solution proposes a new reference factor for determining the display frame rate. This allows for flexible determination of the display frame rate under limited resource conditions, allowing the display effect to better meet user needs and improve the user experience. For example, when there are multiple display devices and the computing power of the chip controlling the display devices is insufficient to support all display devices displaying at full frame rate, the display frame rate of one or more display devices can be reduced to ensure that the remaining display devices display at a higher frame rate, thereby improving the smoothness of the remaining display devices.

[0009] Exemplarily, the above-mentioned display devices may include but are not limited to: a head-up display, a central control screen, a passenger entertainment screen, a screen behind the driver's headrest, and a screen behind the passenger's headrest.

[0010] The display frame rate referred to in this application refers to the frequency (or rate) at which bitmap images, measured in frames, appear continuously on a display device. Alternatively, the display frame rate can be understood as the number of frames of display data submitted to the display device by the display synthesis system (surface flinger) per unit time. It is understood that the higher the display frame rate, the smoother the image.

[0011] In combination with the first aspect, in certain implementations of the first aspect, the display frame rate of the display device is determined based on at least one of the operating status of the vehicle, the position of the user in the cabin of the vehicle, the touch-screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs, including adjusting the display frame rate based on changes in at least one of the operating status, the position of the user in the cabin of the vehicle, the touch-screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.

[0012] In the above technical solution, dynamic adjustment of the display frame rate of the display device is achieved based on at least one of the operating status of the vehicle, the position of the user in the cabin, the touch screen operation, and the type of application. For example, when the vehicle is driving, it helps to improve driving safety while ensuring the user experience; when the vehicle is parked, it helps to improve the user's entertainment experience.

[0013] In combination with the first aspect, in certain implementations of the first aspect, the change in the operating state includes a transition between a driving state and a parking state, or a change in the level of automatic driving.

[0014] In combination with the first aspect, in certain implementations of the first aspect, the display device is used to display at least one item of the operating condition information and navigation information of the vehicle, and the display frame rate is adjusted based on changes in at least one of the operating status, the user's position in the vehicle cabin, the touch screen operation of the display device for the vehicle, and the type of application to which the interface to be displayed on the display device belongs, including: increasing the display frame rate in response to the operating status changing from a parking state to a driving state; decreasing the display frame rate in response to the operating status changing from a driving state to a parking state; increasing the display frame rate in response to a decrease in the vehicle's autonomous driving level; or decreasing the display frame rate in response to an increase in the vehicle's autonomous driving level.

[0015] For example, operating condition information may include, but is not limited to, driving speed, engine speed, gear position, remaining battery or fuel level, remaining mileage, and indicator or warning light information. The indicator or warning light may include at least one of the following: an antifreeze level warning light, a fuel level indicator light, a washer fluid level indicator light, a charging indicator light, a high- and low-beam dimmer indicator light, a transmission gear position indicator light, an anti-lock braking system indicator light, a driving force adjustment indicator light, and an airbag warning light.

[0016] For example, the navigation information may include at least one of the following: the destination of the vehicle during the current trip, the route of the vehicle from the current location to the destination, and the remaining distance of the vehicle from the current location to the destination. In some possible implementations, the navigation information is displayed via a navigation application.

[0017] Exemplarily, the display device may include an instrument screen, or may include a head-up display, or may include a central control screen.

[0018] In the above technical solution, when the vehicle is in motion, the display device displaying navigation information and operating condition information is controlled to display at a higher frame rate, ensuring real-time and high-speed refresh of driving safety-related information, thereby helping to improve driving safety. At higher levels of automated driving, the driver's reliance on navigation information and operating condition information may decrease, so the display device displaying navigation information and operating condition information can be controlled to display at a lower frame rate.

[0019] In combination with the first aspect, in certain implementations of the first aspect, the display device is used to display entertainment information, and the display frame rate is adjusted based on changes in at least one of the operating status, the user's position in the cabin of the vehicle, the touch screen operation of the display device for the vehicle, and the type of application to which the interface to be displayed on the display device belongs, including: lowering the display frame rate in response to the operating status changing from a parking state to a driving state; increasing the display frame rate in response to the operating status changing from a driving state to a parking state; lowering the display frame rate in response to a decrease in the vehicle's autonomous driving level; or increasing the display frame rate in response to an increase in the vehicle's autonomous driving level.

[0020] For example, entertainment information may include, but is not limited to, videos, games, news, and music. In some possible implementations, the entertainment information is displayed through entertainment-related applications, such as video applications, music applications, and game applications.

[0021] Exemplarily, the display device may include a central control screen, or may also include a co-pilot entertainment screen, or may also include a screen behind the driver's (or co-pilot's) headrest.

[0022] In the above technical solution, when the vehicle is parked, the display device displaying entertainment information is controlled to display at a higher frame rate, ensuring that entertainment-related information is refreshed in real time and at high speed, helping to enhance the user's entertainment experience. At higher levels of autonomous driving, the display device displaying entertainment information can also be controlled to display at a higher frame rate to provide a better entertainment experience for the user.

[0023] In combination with the first aspect, in certain implementations of the first aspect, the display frame rate is adjusted based on a change in at least one of the operating status, the user's position in the vehicle cabin, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs, including: increasing the display frame rate in response to the user coming to the position corresponding to the display device in the cabin; or decreasing the display frame rate in response to the user leaving the position corresponding to the display device in the cabin.

[0024] For example, a position in the cockpit corresponding to the display device may include: content displayed by the display device is mainly for viewing by a user at the position.

[0025] For example, when the display device is a central control screen or an instrument screen, the position in the cockpit corresponding to the display device can be the main driver's position; when the display device is a screen behind the main driver's headrest, the position in the cockpit corresponding to the display device can be the left side of the second row.

[0026] In the above technical solution, when a user is detected, the display frame rate of the display device corresponding to the user's position is increased, which helps to improve the user's interactive experience and screen usage experience; when the user leaves, the display frame rate of the display device corresponding to the user's position is reduced, which helps to save power consumption.

[0027] In combination with the first aspect, in certain implementations of the first aspect, the display frame rate is adjusted based on changes in at least one of the operating status, the user's position in the vehicle cabin, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs, including: lowering the display frame rate in response to no further touch screen operation occurring within a predetermined time after the touch screen operation occurs; or increasing the display frame rate in response to the touch screen operation, wherein no touch screen operation occurs within a predetermined time before the touch screen operation occurs.

[0028] Exemplarily, the predetermined time may be 3 seconds, or 5 seconds, or other durations.

[0029] In some possible implementations, while controlling to increase the display frame rate of the display device, the display frame rates of other display devices that do not detect the touch screen signal are reduced.

[0030] In the above technical solution, according to the user's touch screen behavior, the display frame rate of the touched display device is increased, the hand tracking performance of the display device is improved, and it helps to improve the user's interactive experience when using the display device.

[0031] In combination with the first aspect, in certain implementations of the first aspect, the display device includes a first display device and a second display device, wherein the first display device corresponds to a first area within the cabin and the second display device corresponds to a second area within the cabin, and determining the display frame rate of the display device includes: determining that the display frame rate of the first display device is different from the display frame rate of the second display device.

[0032] In combination with the first aspect, in certain implementations of the first aspect, determining that the display frame rate of the first display device is different from the display frame rate of the second display device includes: in response to there being no user in the first area and there being a user in the second area, determining that the display frame rate of the first display device is lower than the display frame rate of the second display device; in response to there being a user in the first area and there being no user in the second area, determining that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to there being a user in the first area and there being a user in the second area, the first area being the main driving area of ​​the cockpit, and the second area including one or more areas other than the main driving area, determining that the display frame rate of the first display device is higher than the display frame rate of the second display device.

[0033] The first display device corresponds to a first area in the cockpit, including: the first display device is disposed in the first area; or the first display device is used to display information to users in the first area. The second display device corresponds to a second area in the cockpit, including: the second display device is disposed in the second area; or the second display device is used to display information to users in the second area.

[0034] Exemplarily, if the first area is the main driving area, the first display device may include an instrument screen, or may also include a head-up display, or may also include a central control screen; if the first area is the co-pilot area, the first display device includes a co-pilot entertainment screen; or, if the first area is the rear area, the first display device includes a screen behind the main driver's headrest, and / or a screen behind the co-pilot's headrest.

[0035] In the above technical solution, priority is given to ensuring that display devices corresponding to user areas in the cockpit display at a higher frame rate, which helps improve the user experience. Furthermore, when users are in multiple areas including the main driver's seat, priority is given to ensuring that display devices in the main driver's seat display at a higher frame rate, which helps improve the main driver's driving experience and driving safety.

[0036] In combination with the first aspect, in certain implementations of the first aspect, determining that the display frame rate of the first display device is different from the display frame rate of the second display device includes: in response to the first display device having a user touch screen operation within a preset time and the second display device having no user touch screen operation within a preset time, determining that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to the first display device having no user touch screen operation within a preset time and the second display device having a user touch screen operation within a preset time, determining that the display frame rate of the first display device is lower than the display frame rate of the second display device.

[0037] Exemplarily, the preset time may be 3 seconds, or 5 seconds, or other durations.

[0038] In some possible implementations, the full frame rate of the first display device and the second display device are both 60 frames per second (fps). When the first display device displays at 60 fps and the second display device displays at 30 fps, when a touch screen operation is detected on the second display device and no touch screen operation is detected on the first display device, the display frame rate of the first display device can be controlled to drop to 30 fps, or 45 fps, and the display frame rate of the second display device can be controlled to increase to 60 fps.

[0039] In the above technical solution, when there are multiple display devices in the cockpit, the display frame rate of the touched display device is increased according to the touch screen operation on the display device, so that it can display at a higher frame rate, thereby improving the hand tracking performance of the display device; the display frame rate of the untouched display device is reduced, which can save energy consumption when the display device is displaying and improve the intelligence of the display device and the vehicle.

[0040] In combination with the first aspect, in certain implementations of the first aspect, determining that the display frame rate of the first display device is different from the display frame rate of the second display device includes: in response to the priority of the first application to which the interface to be displayed on the first display device belongs being higher than the priority of the second application to which the interface to be displayed on the second display device belongs, determining that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to the priority of the first application to which the interface to be displayed on the first display device belongs being lower than the priority of the second application to which the interface to be displayed on the second display device belongs, determining that the display frame rate of the first display device is lower than the display frame rate of the second display device.

[0041] In the above technical solution, controlling the display frame rate of the display device according to the priority of the application to be displayed helps to further improve the intelligence of the vehicle. For example, when the vehicle is in motion, the priority of the navigation application can be set to a higher level, while the priority of the entertainment application can be set to a lower level. This ensures that the display device displaying the navigation application displays at a higher frame rate, while controlling the display device displaying the entertainment application to display at a lower frame rate, thereby improving driving safety. When the vehicle is parked, the priority of the navigation application can be set to a lower level, while controlling the display device displaying the entertainment application to display at a higher frame rate. This ensures that the display device displaying the navigation application displays at a lower frame rate, while controlling the display device displaying the entertainment application to display at a higher frame rate, thereby improving the user's entertainment experience.

[0042] In combination with the first aspect, in certain implementations of the first aspect, determining the display frame rate of the display device includes: determining the display frame rate based on resource occupancy information; wherein the resource occupancy information indicates the used resource capacity of the computing unit and / or the available resource capacity in the remaining resources, and the computing unit is associated with the display device.

[0043] Exemplarily, the computing unit is associated with the display device and may include: the computing unit performs data processing to implement a display function for the display device. For example, the computing unit may include a central processing unit (CPU), a graphics processing unit (GPU), etc.

[0044] In some possible implementations, if the display devices corresponding to areas without users in the cabin are turned off, then when the resource occupancy information indicates that the used resource capacity of the computing unit is greater than or equal to a preset capacity threshold, the display frame rate of the display devices in the areas with users indicated by the first state is controlled to be reduced. For example, if there are users in the main driver's seat and the front passenger's seat, then when the resource occupancy information indicates that the used resource capacity of the computing unit is greater than or equal to a preset capacity threshold, the display frame rate of the display devices corresponding to the main driver's seat (such as the central control screen, instrument panel, head-up display) and the display devices corresponding to the front passenger's seat (such as the front passenger entertainment screen) are controlled to be reduced.

[0045] Furthermore, when the used capacity of the computing resource is less than a preset capacity threshold, the display frame rate of the display device is controlled to be increased.

[0046] Exemplarily, the preset capacity threshold may be 75%, or 70%, or other values.

[0047] In the above technical solution, the frame rate of the display device is adjusted according to the used resource capacity of the computing unit, which helps to rationally utilize the chip computing power. When the used resource capacity of the computing unit is too high, the display frame rate of the turned-on display device is controlled to be reduced, which helps to prevent the display device from being stuck due to the high used resource capacity of the computing unit; when the used resource capacity of the computing unit is small, the display device is controlled to display at a higher display frame rate to improve the smoothness of the picture, thereby enhancing the user experience.

[0048] In combination with the first aspect, in certain implementations of the first aspect, the display device includes a third display device, which is used to display at least one of entertainment information and navigation information. The determination of the display frame rate includes: when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, determining that the display frame rate is a first frame rate; when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is less than the preset capacity threshold, determining that the display frame rate is a second frame rate; wherein, the first frame rate is higher than the second frame rate.

[0049] For example, the third display device may be a display device other than the display device used to display operating status information. For example, the third display device may include at least one of the following: a central control screen, a passenger entertainment screen, a screen behind the driver's headrest, and a screen behind the passenger's headrest. In some possible implementations, the third display device may also include a heads-up display.

[0050] In some possible implementations, the space of the vehicle's driving area is relatively narrow, or the vehicle is in the process of reversing, then the third display device may be other display devices in addition to the one for displaying 360-degree surround view images and / or reversing images. For example, the third display device may include at least one of the following: a head-up display, an instrument screen, a co-pilot entertainment screen, a screen behind the main driver's headrest, and a screen behind the co-pilot's headrest.

[0051] In some possible implementations, the third display device can be a display device selected by the user. For example, the user can set the display frame rate of display devices such as the passenger entertainment screen or the rear screen to be reduced when the resource occupancy information indicates that the resource capacity used by the computing unit is greater than or equal to a preset capacity threshold.

[0052] In the above technical solution, when a vehicle is in motion and the computing unit's used resource capacity is greater than or equal to a preset capacity threshold, the display frame rate of all display devices, except those displaying vehicle operating status information, is reduced. Maintaining the display frame rate of display devices like the instrument panel and central control panel, even when computing unit resources are limited, helps improve driving safety and user experience.

[0053] In combination with the first aspect, in some implementations of the first aspect, the third display device includes one or more display devices other than the instrument screen.

[0054] In combination with the first aspect, in certain implementations of the first aspect, determining the display frame rate of the display device includes: when the vehicle is in the driving state and the single-frame processing time within the first preset time length is greater than or equal to the preset processing time length, determining to reduce the display frame rate of the display device.

[0055] For example, the first preset duration can be 1 second, or 1.5 seconds, or other durations; the preset processing duration can be 16.7 milliseconds, or other preset processing durations. For example, if the processing duration of a single frame for consecutive 1 second is greater than or equal to 16.7 milliseconds, it indicates that the processing power of the computing platform is insufficient to support the display device to display at 60 fps, and control is then performed to reduce the display frame rate of some or all display devices.

[0056] In the above technical solution, when the processing power of the computing platform is insufficient, the display frame rate of the display device is controlled to be reduced to reduce the probability of the display device being stuck or dropping frames, thereby improving the user experience.

[0057] In a second aspect, a control method is provided, which includes: determining that a vehicle is in a first preset scene, the first preset scene being associated with at least one of the operating state of the vehicle and the position of the user in the cabin of the vehicle, wherein the operating state includes a driving state or a parking state; and controlling the display frame rate of the display device of the vehicle according to the first preset scene.

[0058] In the above technical solution, the display frame rate of the display device is adjusted according to the preset scenario, so that the picture of the display device can be displayed smoothly, thereby improving the user experience.

[0059] In some possible implementations, controlling the display frame rate of the display device of the vehicle according to the first preset scene includes: when determining that the vehicle switches from the second preset scene to the first preset scene, controlling the display frame rate to switch from the second frame rate to the first frame rate.

[0060] In some possible implementations, the first preset scene indicates that the vehicle is in the parking state, the second preset scene indicates that the vehicle is in the driving state, the display device is used to display at least one of the operating condition information and navigation information of the vehicle, and the first frame rate is less than the second frame rate.

[0061] In some possible implementations, the first preset scene indicates that the vehicle is in the parking state, the second preset scene indicates that the vehicle is in the driving state, the display device is used to display entertainment information, and the first frame rate is higher than the second frame rate.

[0062] In some possible implementations, the display device includes a first display device and a second display device, wherein the first display device corresponds to the main driving area of ​​the cockpit, and the second display device corresponds to the first area of ​​the cockpit, and the first area includes one or more areas other than the main driving area. The display frame rate of the display device of the vehicle is controlled according to the first preset scene, including: when the first preset scene indicates that the first user is located in the main driving area and the second user is located in the first area, the display frame rate of the first display device is controlled to be a third frame rate, and the display frame rate of the second display device is controlled to be a fourth frame rate; wherein the third frame rate is higher than the fourth frame rate, and the users include the first user and the second user.

[0063] In some possible implementations, the method further includes: obtaining resource occupancy information, the resource occupancy information indicating the used resource capacity of the computing unit and / or the available resource capacity in the remaining resources, the computing unit being associated with the display device; and controlling the display frame rate of the display device of the vehicle according to the first preset scenario, including: controlling the display frame rate of the display device according to the resource occupancy information and the first preset scenario.

[0064] In some possible implementations, the display device includes a third display device, which is used to display at least one of entertainment information and navigation information. The display frame rate of the display device is controlled according to the resource occupancy information and the first preset scenario, including: when the resource occupancy information indicates that the used resource capacity is greater than or equal to the preset capacity threshold, and the first preset scenario indicates that the vehicle is in the driving state, controlling the reduction of the display frame rate to the third display device.

[0065] In some possible implementations, controlling the display frame rate of the display device includes: when a touch screen operation on the third display device is detected, controlling to increase the display frame rate of the third display device.

[0066] In some possible implementations, the third display device includes one or more display devices other than an instrument screen.

[0067] In some possible implementations, the display device includes a fourth display device, which is used to display at least one of entertainment information and navigation information. The display frame rate of the display device of the vehicle is controlled according to the first preset scenario, including: when the first preset scenario indicates that the vehicle is in the driving state and the single-frame processing time within the first preset time length is greater than or equal to the preset processing time length, controlling to reduce the display frame rate of the fourth display device.

[0068] In a third aspect, a control device is provided, which includes a determination unit and a processing unit, wherein the determination unit is used to determine the display frame rate of the display device based on at least one of the operating status of the vehicle, the position of the user in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs; and the processing unit is used to control the display device to display at the display frame rate.

[0069] In combination with the third aspect, in certain implementations of the third aspect, the device also includes an adjustment unit, which is used to adjust the display frame rate based on changes in at least one of the operating status, the user's position in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.

[0070] In combination with the third aspect, in certain implementations of the third aspect, the change in the operating state includes a transition between a driving state and a parking state, or a change in the level of automatic driving.

[0071] In combination with the third aspect, in certain implementations of the third aspect, the display device is used to display at least one of the operating condition information and navigation information of the vehicle, and the adjustment unit is used to: increase the display frame rate in response to the operating state changing from a parking state to a driving state; reduce the display frame rate in response to the operating state changing from a driving state to a parking state; increase the display frame rate in response to a decrease in the automatic driving level of the vehicle; or, reduce the display frame rate in response to an increase in the automatic driving level of the vehicle.

[0072] In combination with the third aspect, in certain implementations of the third aspect, the display device is used to display entertainment information, and the adjustment unit is used to: reduce the display frame rate in response to the operating state changing from a parking state to a driving state; increase the display frame rate in response to the operating state changing from a driving state to a parking state; reduce the display frame rate in response to a decrease in the autonomous driving level of the vehicle; or increase the display frame rate in response to an increase in the autonomous driving level of the vehicle.

[0073] In combination with the third aspect, in certain implementations of the third aspect, the adjustment unit is used to: increase the display frame rate in response to the user coming to the position corresponding to the display device in the cabin; or, reduce the display frame rate in response to the user leaving the position corresponding to the display device in the cabin.

[0074] In combination with the third aspect, in certain implementations of the third aspect, the adjustment unit is used to: lower the display frame rate in response to no further touch screen operation occurring within a predetermined time after the touch screen operation occurs; or, increase the display frame rate in response to the touch screen operation, wherein no touch screen operation occurs within a predetermined time before the touch screen operation occurs.

[0075] In combination with the third aspect, in certain implementations of the third aspect, the display device includes a first display device and a second display device, wherein the first display device corresponds to a first area within the cabin and the second display device corresponds to a second area within the cabin, and the determination unit is used to determine that the display frame rate of the first display device is different from the display frame rate of the second display device.

[0076] In combination with the third aspect, in certain implementations of the third aspect, the determination unit is used to: in response to there being no user in the first area and there being a user in the second area, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device; in response to there being a user in the first area and there being no user in the second area, determine that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to there being a user in the first area and there being a user in the second area, the first area is the main driving area of ​​the cockpit, and the second area includes one or more areas other than the main driving area, determine that the display frame rate of the first display device is higher than the display frame rate of the second display device.

[0077] In combination with the third aspect, in certain implementations of the third aspect, the determination unit is used to: determine that the display frame rate of the first display device is higher than the display frame rate of the second display device in response to the user touching the screen operation on the first display device within a preset time and the user not touching the screen operation on the second display device within a preset time; or, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device in response to the user not touching the screen operation on the first display device within a preset time and the user touching the screen operation on the second display device within a preset time.

[0078] In combination with the third aspect, in certain implementations of the third aspect, the determination unit is used to: determine that the display frame rate of the first display device is higher than the display frame rate of the second display device in response to the priority of the first application to which the interface to be displayed on the first display device belongs being higher than the priority of the second application to which the interface to be displayed on the second display device belongs; or, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device in response to the priority of the first application to which the interface to be displayed on the first display device belongs being lower than the priority of the second application to which the interface to be displayed on the second display device belongs.

[0079] In combination with the third aspect, in certain implementations of the third aspect, the determination unit is used to: determine the display frame rate based on resource occupancy information; wherein the resource occupancy information indicates the used resource capacity of the computing unit and / or the available resource capacity in the remaining resources, and the computing unit is associated with the display device.

[0080] In combination with the third aspect, in certain implementations of the third aspect, the display device includes a third display device, which is used to display at least one of entertainment information and navigation information, and the determination unit is used to: when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is greater than or equal to the preset capacity threshold, determine that the display frame rate is a first frame rate; when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is less than the preset capacity threshold, determine that the display frame rate is a second frame rate; wherein, the first frame rate is higher than the second frame rate.

[0081] In combination with the third aspect, in some implementations of the third aspect, the third display device includes one or more display devices other than the instrument screen.

[0082] In combination with the third aspect, in certain implementations of the third aspect, the determination unit is used to: when the vehicle is in the driving state and the single-frame processing time within the first preset time length is greater than or equal to the preset processing time length, determine to reduce the display frame rate of the display device.

[0083] In a fourth aspect, a control device is provided, which includes a determination unit and a processing unit, wherein the determination unit is used to: determine that a vehicle is in a first preset scene, and the first preset scene is associated with at least one of the operating status of the vehicle and the position of the user in the cabin of the vehicle, wherein the operating status includes a driving state or a parking state; and the processing unit is used to: control the display frame rate of the display device of the vehicle according to the first preset scene.

[0084] In a fifth aspect, a control device is provided, which includes: a memory for storing a computer program; and a processor for executing the computer program stored in the memory, so that the device performs a method in any possible implementation of the first aspect or the second aspect.

[0085] In a sixth aspect, a vehicle is provided, which includes an apparatus as in any possible implementation of the third to fifth aspects, and a display device.

[0086] In combination with the sixth aspect, in certain implementations of the sixth aspect, the vehicle is a vehicle.

[0087] In a seventh aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute the method in any possible implementation of the first or second aspect.

[0088] It should be noted that the above-mentioned computer program code may be stored in whole or in part on a first storage medium, wherein the first storage medium may be packaged together with the processor or separately from the processor.

[0089] In an eighth aspect, a computer-readable medium is provided, wherein the computer-readable medium stores instructions. When the instructions are executed by a processor, the processor implements the method in any possible implementation of the first aspect or the second aspect.

[0090] In a ninth aspect, a chip is provided, which includes a circuit for executing the method in any possible implementation of the first aspect or the second aspect.

[0091] In the present application, the display frame rate of the display device can be dynamically adjusted according to one or more of the operating status of the vehicle, the position of the user in the cockpit, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed by the display device belongs, so that the display device can display the picture smoothly and improve the user's experience. Specifically, when the vehicle is in a driving state, the display device displaying navigation information and operating condition information is controlled to display at a higher display frame rate to ensure that the driving safety-related information is refreshed in real time and at high speed, which helps to improve driving safety; when the vehicle is in a parked state, the display device displaying entertainment information is controlled to display at a higher display frame rate to ensure that the entertainment-related information is refreshed in real time and at high speed, which helps to improve the user's entertainment experience. In addition, the control method provided in the present application can also give priority to ensuring that the display device in the main driving area displays at a higher frame rate, which helps to improve the driving experience and driving safety of the main driver. Furthermore, the control method provided by this application can also adjust the frame rate of the display device based on the used resource capacity of the computing unit. When the used resource capacity of the computing unit is too high, the display frame rate of the enabled display device is controlled to be reduced, helping to prevent the display device from freezing due to the high used resource capacity of the computing unit. When the used resource capacity of the computing unit is low, the display device is controlled to display at a higher display frame rate to improve the smoothness of the picture, thereby enhancing the user experience. When the vehicle is in a driving state and the used resource capacity of the computing unit is greater than or equal to a preset capacity threshold, the display frame rate of all display devices other than the display device displaying the vehicle's operating status information is controlled to be reduced, ensuring the display frame rate of display devices such as the instrument screen that display operating status information, helping to improve driving safety and user experience. The control method provided by this application can also increase the display frame rate of the touched display device based on the user's touch screen behavior, improving the display device's hand tracking and helping to enhance the user's interactive experience when using the display device. When the computing platform's processing power is insufficient, the control method provided by this application controls the display frame rate of the display device to reduce the probability of freezing and frame drops, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0092] FIG1 is a functional block diagram of a vehicle provided in an embodiment of the present application;

[0093] FIG2 is a schematic diagram of a cockpit scene provided by an embodiment of the present application;

[0094] FIG3 is a schematic diagram of a system architecture required for implementing the control method provided in an embodiment of the present application;

[0095] FIG4 is a schematic flow chart of a control method provided in an embodiment of the present application;

[0096] FIG5 is a schematic diagram of an application scenario of the control method provided in an embodiment of the present application;

[0097] FIG6 is another schematic flow chart of a control method provided in an embodiment of the present application;

[0098] FIG7 is another schematic diagram of an application scenario of the control method provided in an embodiment of the present application;

[0099] FIG8 is another schematic flow chart of a control method provided in an embodiment of the present application;

[0100] FIG9 is another schematic diagram of an application scenario of the control method provided in an embodiment of the present application;

[0101] FIG10 is another schematic flow chart of a control method provided in an embodiment of the present application;

[0102] FIG11 is another schematic flow chart of a control method provided in an embodiment of the present application;

[0103] FIG12 is another schematic diagram of an application scenario of the control method provided in an embodiment of the present application;

[0104] FIG13 is a schematic block diagram of a control device provided in an embodiment of the present application;

[0105] FIG14 is a schematic block diagram of a control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0106] The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0107] FIG1 is a functional block diagram of a vehicle 100 provided in an embodiment of the present application. The vehicle 100 may include a perception system 120, a display device 130, and a computing platform 150, wherein the perception system 120 may include one or more sensors for sensing information about the environment surrounding the vehicle 100. For example, the perception system 120 may include a positioning system, which may be a global positioning system (GPS), a BeiDou system or other positioning systems, an inertial measurement unit (IMU), a laser radar, a millimeter-wave radar, an ultrasonic radar, and a camera device; the perception system 120 may also include a pressure sensor, which is provided under a seat to detect whether there is a user in the seat; the perception system 120 may also include an acoustic wave sensor to detect audio information in the cabin.

[0108] Some or all functions of the vehicle 100 can be controlled by the computing platform 150. The computing platform 150 may include one or more processors, such as processors 151 to 15n (n is a positive integer). A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction reading and execution capabilities, such as a CPU, a microprocessor, a GPU (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationship of a hardware circuit. The logical relationship of the hardware circuit is fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration file to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 150 can also include a memory for storing instructions. Some or all of the processors 151 to 15n can call the instructions in the memory and execute the instructions to achieve corresponding functions.

[0109] The vehicle 100 may include an advanced driving assistant system (ADAS). ADAS utilizes a variety of sensors on the vehicle (including but not limited to: lidar, millimeter-wave radar, camera, ultrasonic sensor, global positioning system, inertial measurement unit) to obtain information from the surroundings of the vehicle, and analyzes and processes the obtained information to achieve functions such as obstacle perception, target recognition, vehicle positioning, path planning, user monitoring / reminders, etc., thereby improving the safety, automation and comfort of vehicle driving.

[0110] At different levels of autonomous driving (L0-L5), ADAS can achieve different levels of autonomous driving assistance based on artificial intelligence algorithms and information obtained from multiple sensors. These levels are based on the grading standards of the Society of Automotive Engineers (SAE). L0 is no automation; L1 is driving assistance; L2 is partial automation; L3 is conditional automation; L4 is highly automated; and L5 is fully automated. At levels L1 to L3, the tasks of monitoring and responding to road conditions are completed jointly by the user and the system, and the user must take over dynamic driving tasks. Levels L4 and L5 allow the user to fully transition to the role of passenger.

[0111] The display devices 130 in the cockpit are mainly divided into two categories: the first is the onboard display screen; the second is a projection display screen, such as a head-up display (HUD). An onboard display screen is a physical display screen and a key component of the in-vehicle infotainment system. Multiple displays can be installed in the cockpit, such as the digital instrument panel, the center console, the display in front of the front passenger (also known as the front passenger), the display in front of the left rear passenger, and the display in front of the right rear passenger. Even the windows can serve as display screens. A head-up display, also known as a head-up display system, is primarily used to display driving information such as speed and navigation on a display device in front of the driver (e.g., the windshield). This reduces the driver's gaze shift time, avoids pupil changes caused by the driver's gaze shift, and improves driving safety and comfort. HUDs include, for example, combiner-HUD (C-HUD), windshield-HUD (W-HUD), and augmented reality HUD (AR-HUD).

[0112] In this embodiment of the present application, the processor may obtain seat pressure information, user facial information, audio information, and the like detected by the perception system 120, and then control the display frame rate of the display device 130 based on the operating status of the vehicle and / or at least one of the seat pressure information, user facial information, and audio information. In some possible implementations, the seat pressure information, user facial information, audio information, and the like may also be stored as data in a memory within the computing platform 150.

[0113] It should be understood that the above operations can be performed by the same processor, or can be performed by one or more processors, and the embodiments of the present application do not specifically limit this.

[0114] FIG2 is a schematic diagram of a vehicle cockpit scene provided in an embodiment of the present application, and the vehicle may be an example of the vehicle 100 shown in FIG1 . One or more vehicle-mounted display screens (or vehicle-mounted screens) are provided inside the smart cockpit, including but not limited to display screen 201 (or, it may also be referred to as a central control screen), display screen 202 (or, it may also be referred to as a co-pilot entertainment screen), display screen 203 (or, it may also be referred to as a screen behind the main driver's headrest), display screen 204 (or, it may also be referred to as a screen behind the co-pilot's headrest) and display screen 205 (or, it may also be referred to as an instrument screen). In some possible implementations, display screen 201 may also be a long screen extending to the co-pilot area. One or more cameras may also be installed in the cockpit shown in FIG2 for capturing images inside or outside the cabin, for example, a camera of a driver monitor system (DMS), a camera of a cabin monitor system (CMS), and a camera of a dashcam. The camera used to capture images inside and outside the cabin may be the same camera or different cameras. In addition, one or more pressure sensors and acoustic wave sensors are also provided in the cabin to monitor whether there is a user inside the cabin and the user's position. Furthermore, the display screens 201 to 205 can display a graphical user interface (GUI).

[0115] It should be understood that the method of controlling the display in the following embodiments is described using the five-seater vehicle shown in FIG2 as an example, and the embodiments of the present application are not limited thereto. For example, for a seven-seater sport / suburban utility vehicle (SUV), the cockpit may include a central control screen, a co-pilot entertainment screen, a screen behind the driver's headrest, a screen behind the co-pilot's headrest, entertainment screens in the three-row left area, and entertainment screens in the three-row right area. For another example, for a passenger car, the cockpit may include front-row entertainment screens and rear-row entertainment screens; or, the cockpit may include a display screen in the driving area and an entertainment screen in the passenger area. In one implementation, the entertainment screen in the passenger area may also be set on the top of the cockpit.

[0116] Under current technology, the surface flinger submits a fixed number of frames per minute of display data to each of the multiple display devices in the cockpit, and the frame rate of display data submitted by the surface flinger to each of the multiple display devices may be the same, for example, they may all be 60fps. Because the surface flinger and hardware composer (HWC) perform image synthesis, rendering, and display on multiple display devices without distinction, when multiple display devices cannot all display at the highest frame rate (for example, 60fps), it may cause image freezes and frame drops on multiple display devices, which in turn seriously affects the user experience.

[0117] In view of this, the embodiments of the present application provide a control method, device and vehicle that can dynamically adjust the display frame rate of one or more display devices in the cabin according to the operating status of the vehicle and / or the position information of the user in the cabin of the vehicle, reduce the probability of freezes and frame drops during the display process of the display device, improve the smoothness of the picture, and thereby improve the user experience.

[0118] Figure 3 shows a schematic block diagram of the system architecture required to implement the control method provided in an embodiment of the present application. As shown in Figure 3, the layered architecture divides the control software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the control system can be divided into five layers: application layer, framework layer, system layer, kernel layer, and hardware layer, from top to bottom.

[0119] The application layer can include a series of application packages. As shown in Figure 3, these packages can include applications such as video applications, navigation applications, communication applications, and search applications. The video application provides users with video playback capabilities; the navigation application provides users with navigation information; the communication application provides users with call functions; and the search application allows users to more conveniently obtain the information they need.

[0120] The framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The framework layer can include some predefined functions. As shown in Figure 3, the framework layer can include a multi-display window manager (MDWM) and a rendering module.

[0121] MDWM includes a detection module and a frame rate decision module, wherein the detection module is used to detect at least one of the following: the operating status of the vehicle, the user's position in the cockpit, the touch screen signal of the display device, the type of application to which the interface to be displayed on the display device belongs, the used resource capacity of the computing unit, and the time required for single-frame processing; and send the detection result to the frame rate decision module, so that the frame rate decision module determines the target frame rate corresponding to the display device based on the detection result. The target frame rate is the frame rate at which surfaceflinger synthesizes display data, that is, the display frame rate of the display device at the hardware layer.

[0122] The system library may include multiple functional modules. For example, as shown in FIG3 , the system library may include: surface flinger.

[0123] For example, after an application (such as a video application) is triggered by the surface flinger to render, the rendering thread of the rendering module is called to render the layer data sent from the application layer, and the rendered data is sent to the surface flinger for synthesis.

[0124] In an embodiment of the present application, the frame rate decision module in the MDWM sends the target frame rate corresponding to the display device determined according to the detection result to the surface flinger, so that the surface flinger controls the synthesis of data for display on the display device according to the target frame rate.

[0125] The kernel layer is the layer between hardware and software. It contains at least the HWC, which uses hardware to combine and display image data. The HWC receives the layers and target frame rate from the surface flinger, processes the layers according to the target frame rate, and sends them to one or more display devices in the hardware layer for display.

[0126] The display devices 351 to 35n of the hardware layer may include one or more of the display apparatuses 130 in FIG. 1 , or the display devices 351 to 35n may include one or more of the display screens 201 to 205 shown in FIG. 2 .

[0127] It should be understood that the above modules and devices are merely examples, and in actual applications, the above modules and devices may be added or deleted according to actual needs.

[0128] FIG4 shows a schematic flow chart of a control method 400 provided in an embodiment of the present application. The method 400 can be applied to the vehicle 100 shown in FIG1 , or can be executed by the system shown in FIG3 . More specifically, the method 400 can be executed by the MDWM shown in FIG3 . The method 400 includes:

[0129] S401, determining a display frame rate of a display device of the vehicle according to an operating state of the vehicle.

[0130] Illustratively, the vehicle may include the vehicle shown in FIG. 1 .

[0131] Exemplarily, the operating state may include a driving state or a parking state; or, it may also include the automatic driving level of the vehicle.

[0132] In one example, the operating state of a vehicle can be determined based on the gear information of the vehicle. For example, when the vehicle is in reverse (R) or drive (D), the vehicle is determined to be in a driving state; when the vehicle is in parking (P), the vehicle is determined to be in a parking state.

[0133] In another example, the operating state of a vehicle can be determined based on its speed. For example, when the speed of the vehicle is greater than a preset speed threshold, the vehicle is determined to be in a driving state; when the speed of the vehicle is less than or equal to the preset speed threshold, the vehicle is determined to be in a parked state. For example, the preset speed threshold can be 0 kilometers per hour (kph), 5 kph, or other values.

[0134] Exemplarily, the display device may include the display apparatus 130 shown in FIG. 1 ; or, the display device may include at least one of the display screens 201 to 205 shown in FIG. 2 ; or, the display device may include at least one of the display devices 351 to 35n shown in FIG. 3 .

[0135] In some possible implementations, the relationship between the operating state of the vehicle and the display frame rate of the display device may be pre-set, as shown in Table 1.

[0136] Table 1

[0137] As shown in Table 1, when the vehicle is in a driving state, the instrument screen, AR-HUD and other display devices that display operating condition information and / or navigation information are controlled to display at a higher display frame rate, and the central control screen, co-pilot entertainment screen and other display devices that display entertainment information are controlled to display at a lower display frame rate; when the vehicle is in a parked state, the instrument screen, AR-HUD and other display devices that display operating condition information and / or navigation information are controlled to display at a lower display frame rate, and the central control screen, co-pilot entertainment screen and other display devices that display entertainment information are controlled to display at a higher display frame rate. Display; when the autonomous driving level of the vehicle is low, the instrument screen, AR-HUD and other display devices that display operating condition information and / or navigation information are controlled to display at a higher display frame rate, and the central control screen, co-pilot entertainment screen and other display devices that display entertainment information are controlled to display at a lower display frame rate; when the autonomous driving level is high, the instrument screen, AR-HUD and other display devices that display operating condition information and / or navigation information are controlled to display at a lower display frame rate, and the central control screen, co-pilot entertainment screen and other display devices that display entertainment information are controlled to display at a higher display frame rate.

[0138] In a specific implementation, when the vehicle is in different operating states, the display frame rate of one or more display devices in the cabin can be determined according to the specific operating state.

[0139] For example, taking a vehicle that is a five-seater vehicle and a cabin that includes display screens 201 to 205 as an example, as shown in FIG5 , when the vehicle is in different operating states, the display screens in the cabin can be displayed at different frame rates.

[0140] As shown in FIG5(a), the gear bar 501 displayed on the display screen 205 indicates that the vehicle is in gear P, and the speed information bar 502 and the power information bar 503 indicate that the vehicle's speed and power are zero, respectively, meaning that the vehicle is currently parked. If the display device 205 displays operating status information, the display frame rate of the display device can be determined to be a lower display frame rate, such as 30 fps; if the display device 202 displays entertainment information, the display frame rate of the display device can be determined to be a higher display frame rate, such as 60 fps.

[0141] As shown in FIG5( b ), the gear bar 501 displayed on the display screen 205 indicates that the vehicle is in gear D, and the speed information bar 502 and the power information bar 503 indicate that the vehicle's speed and power are 60 km / h and 60 kilowatts, respectively, indicating that the vehicle is currently in motion. If the display device 205 displays operating information, the display frame rate of the display device can be determined to be a higher display frame rate, such as 60 fps; if the display device 202 displays entertainment information, the display frame rate of the display device can be determined to be a lower display frame rate, such as 30 fps.

[0142] As shown in (c) in Figure 5, the information bar 504 of the display screen 205 shows that the vehicle's automatic driving level is L0. When the display device is a display screen 205 that displays operating condition information, it can be determined that the display frame rate of the display device is a higher display frame rate, such as 60fps; when the display device is a display screen 202 that displays entertainment information, it can be determined that the display frame rate of the display device is a lower display frame rate, such as 30fps.

[0143] As shown in (d) in Figure 5, the information bar 504 of the display screen 205 shows that the vehicle's autonomous driving level is L3. When the display device is a display screen 205 that displays operating condition information, it can be determined that the display frame rate of the display device is a lower display frame rate, such as 30fps; when the display device is a display screen 202 that displays entertainment information, it can be determined that the display frame rate of the display device is a higher display frame rate, such as 60fps.

[0144] S402: Control the display device to display at the display frame rate.

[0145] In some possible implementations, the display frame rate of the display device may be adjusted based on changes in the vehicle's operating state, including transitions between a driving state and a parking state, or changes in the level of autonomous driving.

[0146] For example, in combination with Table 1, when the vehicle changes from a driving state to a parking state, or when the autonomous driving level of the vehicle is improved, the display frame rate of display devices such as the instrument screen, AR-HUD, etc. that display operating condition information and / or navigation information can be reduced, and the display frame rate of display devices such as the central control screen, the co-pilot entertainment screen, etc. that display entertainment information can be increased; when the vehicle changes from a parking state to a driving state, or when the autonomous driving level of the vehicle is reduced, the display frame rate of display devices such as the instrument screen, AR-HUD, etc. that display operating condition information and / or navigation information can be increased, and the display frame rate of display devices such as the central control screen, the co-pilot entertainment screen, etc. that display entertainment information can be reduced.

[0147] The control method provided in the embodiments of the present application can dynamically adjust the display frame rate of the display device according to the operating status of the vehicle, so that the display device can display images smoothly and improve the user experience. When the vehicle is in a driving state, the display device displaying navigation information and operating condition information is controlled to display at a higher display frame rate, ensuring that driving safety-related information is refreshed in real time and at high speed, which helps to improve driving safety. When the vehicle is in a parked state, the display device displaying entertainment information is controlled to display at a higher display frame rate, ensuring that entertainment-related information is refreshed in real time and at high speed, which helps to improve the user's entertainment experience.

[0148] FIG6 shows a schematic flow chart of a control method 600 provided in an embodiment of the present application. The method 600 can be applied to the vehicle 100 shown in FIG1 . The method 600 can also be executed by the system shown in FIG3 . More specifically, the method 600 can be executed by the MDWM shown in FIG3 . The method 600 includes:

[0149] S601, determining a display frame rate of a display device according to a position of a user in a vehicle cabin.

[0150] Illustratively, the vehicle may include the vehicle in the above embodiment, and the display device may include the display device in the above embodiment.

[0151] Exemplarily, the vehicle can determine the user's position in the cabin through sensor information, including but not limited to: determining whether there is a user in a certain seat through an acoustic wave sensor; determining whether there is a user in a certain seat through a camera device or a visual sensor in the cabin; determining whether there is a user in a seat through a pressure sensor set at the seat.

[0152] In some possible implementations, the relationship between the user's position in the cockpit and the display frame rate of the display device may be pre-set, as shown in Table 2.

[0153] Table 2

[0154] As shown in Table 2, when there is only one user in the cabin, the display frame rate of the display device corresponding to the user's position in the cabin can be prioritized, and the display device can be controlled to display at a higher display frame rate; when there are multiple users in the cabin, and the multiple users include users in the main driving area, the display frame rate of the display device corresponding to the main driving area can be prioritized, and the display device can be controlled to display at a higher display frame rate.

[0155] It should be noted that a display device corresponding to a certain location includes: the content displayed by the display device is primarily for viewing by users at that location. A display device corresponding to a certain area, or a certain area corresponding to a display device, includes: the content displayed by the display device is primarily for viewing by users in that area; or the area includes the display device. In embodiments of the present application, an area within the cabin may include a specific location, for example, the main driving area includes the main driving position.

[0156] For example, if the area is the main driving area, the display device may include at least one of an instrument screen, an AR-HUD, and a central control screen; if the area is the co-pilot area, the display device may be a co-pilot screen, such as display screen 202; if the area is the left side area of ​​the second row of the vehicle, the display device may be a screen behind the main driving headrest, such as display screen 203; if the area is the right side area of ​​the second row of the vehicle, the display device may be a screen behind the co-pilot headrest, such as display screen 204.

[0157] In a specific implementation, the display frame rate of one or more display devices in the cockpit is determined according to the actual position of the user in the cockpit.

[0158] In some possible implementations, when the display device includes two or more display devices, for example, display device 1 and display device 2, the display frame rate of display device 1 can be determined to be different from the display frame rate of display device 2 based on the user's position in the cockpit. In one example, in combination with Table 2, taking display device 1 as the central control screen corresponding to the main driving area and display device 2 as the passenger entertainment screen corresponding to the passenger driving area as an example: when there is a user in the main driving area and no user in the passenger driving area, the display frame rate of display device 1 (e.g., 60fps) is determined to be higher than the display frame rate of display device 2 (e.g., 0 or 30fps); when there is no user in the main driving area and a user in the passenger driving area, the display frame rate of display device 1 (e.g., 30fps) is determined to be lower than the display frame rate of display device 2 (e.g., 60fps); when there are users in both the main driving area and the passenger driving area, the display frame rate of display device 1 (e.g., 60fps) is determined to be higher than the display frame rate of display device 2 (e.g., 30fps). In another example, combined with Table 2, taking the display device 1 as the central control screen corresponding to the main driving area and the display device 2 as the screen behind the main driving headrest corresponding to the left rear area as an example: when there are users in both the main driving area and the left rear area, it is determined that the display frame rate of the display device 1 (such as 60fps) is higher than the display frame rate of the display device 2 (such as 30fps).

[0159] S602: Control the display device to display at the display frame rate.

[0160] In some possible implementations, the display frame rate of the display device may be adjusted based on the user's position within the cabin. For example, in response to the user arriving at a location within the cabin corresponding to the display device, the display frame rate of the display device may be increased; or in response to the user leaving the location within the cabin corresponding to the display device, the display frame rate of the display device may be decreased.

[0161] For example, taking a vehicle as a five-seater vehicle and a cabin including display screens 201 to 205 as an example, as shown in FIG7 , when the position of the user in the cabin changes, the display frame rate of the display screens in the cabin can be adjusted.

[0162] As shown in FIG7 (a), before user 701 enters the main driving area, the display frame rates of the display screens 201 and 205 corresponding to the main driving area are both 30 fps. As shown in FIG7 (b), when user 701 takes the main driving seat, the display frame rates of the display screens 201 and 205 corresponding to the main driving area can be increased to 60 fps. Furthermore, after user 701 leaves the main driving area, the display frame rates of the display screens 201 and 205 corresponding to the main driving area can be further reduced to 30 fps.

[0163] The control method provided in the embodiments of the present application can dynamically adjust the display frame rate of the display device based on the user's position in the cabin, giving priority to ensuring that the display devices corresponding to the user-occupied areas of the cabin display at a higher frame rate, thereby improving the user experience. Furthermore, when there are users in multiple areas, including the main driver's seat, the display devices in the main driver's seat are prioritized to display at a higher frame rate, thereby improving the main driver's driving experience and driving safety.

[0164] FIG8 shows a schematic flow chart of a control method 800 provided in an embodiment of the present application. The method 800 can be applied to the vehicle 100 shown in FIG1 , or can be executed by the system shown in FIG3 . More specifically, the method 800 can be executed by the MDWM shown in FIG3 . The method 800 includes:

[0165] S801: Determine a display frame rate of the display device according to a touch screen operation on the display device of the vehicle.

[0166] Illustratively, the vehicle may include the vehicle in the above embodiment, and the display device may include the display device in the above embodiment.

[0167] In some possible implementations, when a display device is displaying at a frame rate lower than its full frame rate, the display frame rate of the display device may be increased in response to a touch screen operation on the display device, wherein no touch screen operation occurred within a predetermined time before the touch screen operation. Furthermore, if no further touch screen operation occurs within a predetermined time after the touch screen operation occurs, the display frame rate of the display device may be decreased.

[0168] For example, if the full frame rate of a display device is 60fps and a touch screen operation is detected when the display device is displaying at 30fps, the display frame rate of the display device can be controlled to increase to 60fps. For example, the display frame rate of the display device can be controlled to increase directly from 30fps to 60fps (which can be understood as an instantaneous increase); or, the display frame rate of the display device can be controlled to increase from 30fps to 60fps at a fixed rate (which can be understood as a gradual increase). For example, the fixed rate can be 30fps / s, or other rates.

[0169] Exemplarily, the predetermined time may be 3 seconds, or 5 seconds, or other durations.

[0170] In the embodiment of the present application, the full frame rate can be understood as the maximum display frame rate supported by the display device.

[0171] In some possible implementations, when two or more display devices in the cockpit are displaying, if a touch screen operation is detected on a certain display device, the display frame rate of the display device can be increased while the display frame rate of other display devices that have not detected the touch screen signal can be reduced.

[0172] For example, taking a vehicle that seats five and a cabin that includes display screens 201 to 205 as an example, as shown in FIG9 , when a touch screen operation on one display screen is detected, the display frame rate of the display screen in the cabin can be adjusted.

[0173] As shown in (a) in Figure 9, display screen 201 and display screen 202 display at display frame rates of 60fps and 30fps respectively. At this time, if a touch screen signal is detected for display screen 202 (as shown in (b) in Figure 9), the display frame rate of display screen 202 can be increased to 60fps, and the display frame rate of display screen 201 can be reduced to 30fps.

[0174] S802: Control the display device to display at the display frame rate.

[0175] The control method provided in the embodiments of the present application can dynamically adjust the display frame rate of a display device based on touchscreen operations performed on the display device of a vehicle. Based on the user's touchscreen behavior, the display frame rate of the touched display device is increased, improving the hand tracking of the display device, thereby enhancing the user's interactive experience when using the display device. When multiple display devices are displayed in the cockpit, the display frame rate of the touched display device is increased, while the display frame rate of the untouched display device is decreased based on the touchscreen operations performed on the display device. This can save energy consumption when the display device is displaying and improve the intelligence of the display device and the vehicle.

[0176] FIG10 is a schematic flow chart of a control method 1000 provided in an embodiment of the present application. The method 1000 can be applied to the vehicle 100 shown in FIG1 , or can be executed by the system shown in FIG3 . More specifically, the method 1000 can be executed by the MDWM shown in FIG3 . The method 1000 includes:

[0177] S1010 , determining a display frame rate of a display device according to a type of an application to which an interface to be displayed on the display device belongs.

[0178] Illustratively, the vehicle may include the vehicle in the above embodiment, and the display device may include the display device in the above embodiment.

[0179] For example, application types may include, but are not limited to, entertainment, driving, and communication. Entertainment applications may include audio applications, video applications, and game applications; driving applications may include navigation applications and driver assistance applications; and communication applications may include call applications and chat applications.

[0180] In some possible implementations, the relationship between the type of application to which the interface to be displayed on the display device belongs and the display frame rate of the display device may be preset, as shown in Table 3.

[0181] Table 3

[0182] As shown in Table 3, when the display device is a central control screen, if the interface to be displayed on the central control screen belongs to a driving application, the display frame rate of the central control screen is determined to be 60fps; if the interface to be displayed on the central control screen belongs to an entertainment application or a communication application, the display frame rate of the central control screen is determined to be 30fps. When the display device is one of other display screens, if the interface to be displayed on the display screen belongs to an entertainment application, the display frame rate of the display screen is determined to be 60fps; if the interface to be displayed on the display screen belongs to a driving application or a communication application, the display frame rate of the display screen is determined to be 30fps.

[0183] In some possible implementations, a correspondence between the priority of the application and the display frame rate of the display device may be preset, and the display frame rate of the display device may be determined according to the priority of the application.

[0184] As shown in Table 4, driving applications have the highest priority, and the display frame rate of driving applications can be 60fps; entertainment applications have a medium priority, and the display frame rate of entertainment applications can be 45fps; communication applications have the lowest priority, and the display frame rate of communication applications can be 30fps.

[0185] Table 4

[0186] In some possible implementations, in conjunction with Table 4, when the display device includes two or more display devices, for example, display device 3 and display device 4, the display frame rate of display device 3 can be determined to be different from the display frame rate of display device 4 based on the priority of the applications to which the interfaces to be displayed on display devices 3 and 4 belong. For example, if the interface to be displayed on display device 3 belongs to a driving application, and the interface to be displayed on display device 4 belongs to an entertainment application, since the priority of the driving application is higher than the priority of the entertainment application, the display frame rate of display device 3 (e.g., 60 fps) is determined to be higher than the display frame rate of display device 4 (e.g., 45 fps); if the interface to be displayed on display device 3 belongs to a communication application, and the interface to be displayed on display device 4 belongs to an entertainment application, since the priority of the communication application is lower than the priority of the entertainment application, the display frame rate of display device 3 (e.g., 30 fps) is determined to be lower than the display frame rate of display device 4 (e.g., 45 fps).

[0187] S1020: Control the display device to display at the display frame rate.

[0188] The control method provided in the embodiment of the present application can dynamically adjust the display frame rate of the display device according to the type of application to which the interface to be displayed on the display device belongs, which helps to improve the intelligence of the display device and the vehicle.

[0189] FIG11 shows a schematic flow chart of a control method 1100 provided in an embodiment of the present application. The method 1100 can be applied to the vehicle 100 shown in FIG1 , or can be executed by the system shown in FIG3 . More specifically, the method 100 can be executed by the MDWM shown in FIG3 . The method 1000 includes:

[0190] S1110, determine the display frame rate of the display device based on at least one of the operating status of the vehicle, the user's position in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.

[0191] Illustratively, the vehicle may include the vehicle in the above embodiment, and the display device may include the display device in the above embodiment.

[0192] Exemplarily, the method for determining the display frame rate of the display device based on any one of the operating status of the vehicle, the position of the user in the cabin of the vehicle, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs can refer to the descriptions in Method 400, Method 600, Method 800, and Method 1000, and will not be repeated here.

[0193] In some possible implementations, the display frame rate of the display device can also be determined based on at least two of the operating status of the vehicle, the user's position in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.

[0194] In one example, the display frame rate of the display device may be determined based on the operating status of the vehicle and the position of the user in the cabin of the vehicle.

[0195] As shown in Table 5, if the vehicle is in driving state and there is only a user in the main driving area, at least one of the instrument screen, AR-HUD, and central control screen corresponding to the main driving area can be controlled to display at a higher display frame rate (such as 60fps); or, if the vehicle is in driving state and there is only a user in the main driving area, the instrument screen and / or AR-HUD for displaying operating condition information and navigation information in the display device corresponding to the main driving area can be controlled to display at a higher display frame rate (such as 60fps), and the central control screen in the display device corresponding to the main driving area can be controlled to display at a lower display frame rate (such as 30fps).

[0196] If the vehicle is in motion and there is a user in the main driving area and the co-pilot area, at least one of the instrument screen, AR-HUD, and central control screen corresponding to the main driving area can be controlled to display at a higher display frame rate (such as 60fps), and the co-pilot entertainment screen corresponding to the co-pilot area can be controlled to display at a lower display frame rate (such as 30fps).

[0197] If the vehicle is in motion and there is a user in the main driving area, the co-pilot area and the rear area, at least one of the instrument screen, AR-HUD and central control screen corresponding to the main driving area can be controlled to display at a higher display frame rate (such as 60fps), the co-pilot entertainment screen corresponding to the co-pilot area can be controlled to display at a lower display frame rate (such as 30fps), and the rear screen corresponding to the rear area can be controlled to display at a lower display frame rate (such as 30fps).

[0198] If the vehicle is in a parked state and there is a user in the main driver's seat, the co-driver's seat, and the back row of the cabin, the instrument screen and / or AR-HUD used to display operating condition information and navigation information in the display device corresponding to the main driver's area can be controlled to display at a lower display frame rate (such as 30fps), the central control screen in the display device corresponding to the main driver's area can be controlled to display at a higher display frame rate (such as 60fps), the co-driver's entertainment screen corresponding to the co-driver's area can be controlled to display at a higher display frame rate (such as 60fps), and the rear screen corresponding to the rear area can be controlled to display at a higher display frame rate (such as 60fps).

[0199] Table 5

[0200] In some possible implementations, after determining the display frame rate of a display device based on the vehicle's operating state and the user's position within the vehicle, upon detecting a touchscreen operation on a particular display device, the display frame rate of the display device may be adjusted based on the touchscreen operation. For example, referring to Table 5, when the vehicle is in motion and there is a user in both the main and passenger areas, and after determining that the display frame rate of the instrument panel, AR-HUD, and central control screen corresponding to the main driver area is 60fps and the display frame rate of the passenger entertainment screen corresponding to the passenger area is 30fps, upon detecting a touchscreen operation on the passenger entertainment screen, the display frame rate of the passenger entertainment screen may be increased to 60fps.

[0201] In another example, the display frame rate of the display device may be determined according to the operating status of the vehicle and the type of application to which the interface to be displayed on the display device belongs.

[0202] As shown in Table 6, when the vehicle is in motion, when the instrument screen displays at a higher display frame rate (for example, 60fps) and the central control screen displays entertainment applications (such as audio applications, video applications, game applications, etc.), the central control screen can be controlled to display the interface of the application at a lower display frame rate (for example, 30fps), and no matter what interface is displayed on other display screens except the central control screen and the instrument screen, the other display screens are controlled to display at a lower display frame rate (for example, 30fps).

[0203] When the vehicle is in motion, the instrument screen displays at a higher display frame rate (for example, 60fps), and the central control screen displays driving applications (such as navigation applications, driving assistance applications, etc.), the central control screen can be controlled to display the interface of the application at a higher display frame rate (for example, 60fps), and no matter what interface is displayed on other display screens except the central control screen and the instrument screen, the other display screens are controlled to display at a lower display frame rate (for example, 30fps).

[0204] When the vehicle is parked, the instrument screen displays at a lower display frame rate (for example, 30fps), and the central control screen displays an entertainment application, the central control screen can be controlled to display the interface of the application at a higher display frame rate (for example, 60fps), and no matter what type of application is displayed on other display screens except the central control screen and the instrument screen, the other display screens are controlled to display at a higher display frame rate (for example, 60fps).

[0205] When the vehicle is parked, the instrument screen displays at a lower display frame rate (for example, 30fps), and the central control screen displays a driving application, the central control screen can be controlled to display the interface of the application at a lower display frame rate (for example, 30fps), and no matter what interface is displayed on other display screens except the central control screen and the instrument screen, the other display screens are controlled to display at a higher display frame rate (for example, 60fps).

[0206] Table 6

[0207] For example, taking a vehicle as a five-seater vehicle and a cabin including display screens 201 to 205 as an example, as shown in FIG12 , the display frame rate of the display screens in the cabin can be adjusted according to the operating status of the vehicle and the position of the user in the cabin.

[0208] As shown in (a) of FIG12 , the gear bar 1201 displayed on the display screen 205 indicates that the vehicle is in gear P, i.e., the vehicle is currently parked. When there are users in the main driving area and the right rear area of ​​the vehicle, the display frame rate of the display screen 201 and / or display 205 corresponding to the main driving area can be determined based on the vehicle's operating status, and the display frame rate of the display screen 204 corresponding to the right rear area can be determined based on the vehicle's operating status. Furthermore, the display frame rate of the display screen can be determined based on the type of application to which the interface to be displayed on the display screen belongs. For example, when the interface to be displayed on the display screen 201 belongs to a driving application, such as a navigation application 1202, the display frame rate of the display screen 201 can be determined to be a lower display frame rate, such as 30fps; when the interface to be displayed on the display screen 204 belongs to an entertainment application, such as a video application, the display frame rate of the display screen 204 can be determined to be a higher display frame rate, such as 60fps.

[0209] As shown in FIG12(b), the gear bar 1201 displayed on display screen 205 indicates that the vehicle is in P gear, i.e., the vehicle is currently parked. If the interface to be displayed on display screen 201 is an entertainment application, such as audio application 1203, the display frame rate of display screen 201 can be determined to be a higher display frame rate, such as 60 fps. If the interface to be displayed on display screen 204 is an entertainment application, such as a video application, the display frame rate of display screen 204 can be determined to be a higher display frame rate, such as 60 fps.

[0210] As shown in (c) of FIG12 , the gear bar 1201 displayed on the display screen 205 indicates that the vehicle is in gear D, i.e., the vehicle is currently in driving. When there are users in the main driving area and the right rear area of ​​the vehicle, the display frame rate of the display screen 201 and / or display 205 corresponding to the main driving area can be determined according to the operating state of the vehicle, and the display frame rate of the display screen 204 corresponding to the right rear area can be determined according to the operating state of the vehicle. Furthermore, the display frame rate of the display screen can be determined according to the type of application to which the interface to be displayed on the display screen belongs. For example, when the interface to be displayed on the display screen 201 belongs to a driving application, such as a navigation application 1202, the display frame rate of the display screen 201 can be determined to be a higher display frame rate, such as 60fps; when the interface to be displayed on the display screen 204 belongs to an entertainment application, such as a video application, the display frame rate of the display screen 204 can be determined to be a lower display frame rate, such as 30fps.

[0211] As shown in FIG12(d), the gear bar 1201 displayed on display screen 205 indicates that the vehicle is in gear D, i.e., the vehicle is currently in driving mode. When the interface to be displayed on display screen 201 is an entertainment application, such as audio application 1203, the display frame rate of display screen 201 can be determined to be a lower display frame rate, such as 30 fps. When the interface to be displayed on display screen 204 is an entertainment application, such as a video application, the display frame rate of display screen 204 can be determined to be a lower display frame rate, such as 30 fps.

[0212] In some possible implementations, after determining the display frame rate of the display device based on the operating status of the vehicle, the user's position in the vehicle, and the type of application to which the interface to be displayed on the display device belongs, when a touch screen operation on a certain display device is detected, the display frame rate of the display device can be adjusted according to the touch screen operation.

[0213] For example, in combination with (d) in Figure 12, still taking the vehicle as an example: the vehicle is in a driving state, and after determining that the display frame rates of display screen 201 and display screen 204 are both 30fps, as shown in (e) in Figure 12, a touch screen operation on display screen 204 is detected, the display frame rate of display screen 204 can be increased to 60fps.

[0214] In some possible implementations, the method further includes: determining the display frame rate based on resource occupancy information; wherein the resource occupancy information indicates the used resource capacity of the computing unit and / or the available resource capacity in the remaining resources, and the computing unit is associated with the display device.

[0215] Exemplarily, when the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, and the first state indicates that the vehicle is in the driving state, control is performed to reduce the display frame rate of one or more display devices, wherein the one or more display devices are used to display at least one of entertainment information and navigation information.

[0216] For example, as shown in Table 7, taking the computing unit as the CPU and the preset capacity threshold as 70% as an example, when the used resource capacity of the CPU is greater than or equal to 70%, the display frame rate of one or more display devices in the central control screen, the co-pilot entertainment screen, and the AR-HUD can be controlled to be reduced.

[0217] In some possible implementations, when the vehicle is in the driving state, the central control screen displays a 360-degree surround view image and / or a reversing image, and the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, the display frame rate of one or more display devices other than the central control screen can be controlled to be reduced. For example, the display frame rate of the instrument screen and / or AR-HUD can be controlled to be reduced.

[0218] In some possible implementations, when the resource usage information indicates that the used resource capacity is greater than or equal to a preset capacity threshold and the vehicle is in the parked state, control is performed to reduce the display frame rate of one or more display devices. For example, as shown in Table 7, when the CPU's used resource capacity is less than 70%, the central control screen and the passenger entertainment screen are controlled to display at a display frame rate of 60 fps. When the CPU's used resource capacity is greater than or equal to 70%, the display frame rate of the central control screen and the passenger entertainment screen is reduced to 45 fps.

[0219] Table 7

[0220] In some possible implementations, after the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, and the display frame rate of one or more display devices is controlled to be reduced according to the resource occupancy information, when a touch screen signal is detected for a display device among the one or more display devices, the display frame rate of the display device is controlled to be increased.

[0221] For example, referring to Table 7, when the vehicle is in motion and the CPU's used resource capacity is 85%, the display frame rate of the AR-HUD and the central control screen is controlled to drop to 30fps. Furthermore, when a touch signal for the central control screen is detected, the display frame rate of the central control screen is controlled to increase to 60fps. In some possible implementations, in the above scenario, when a touch signal for the passenger entertainment screen is detected, the touch signal of the passenger entertainment screen can also be controlled to increase to 60fps.

[0222] In some possible implementations, after the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, and the display frame rate of one or more display devices is controlled to be reduced according to the resource occupancy information, when a touch screen signal is detected for a display device among the one or more display devices, the display frame rate of the display device is controlled to be increased, and at the same time, the display frame rates of other display devices among the one or more display devices except the display device are controlled to be further reduced.

[0223] For example, referring to Table 7, when the vehicle is in motion and the CPU's used resource capacity is 85%, the display frame rates of the AR-HUD and central control screen are controlled to drop to 45fps. Furthermore, when a touch signal is detected on the central control screen, the display frame rate of the central control screen is controlled to increase to 60fps, and the display frame rate of the AR-HUD is further controlled to drop to 30fps.

[0224] In some possible implementations, when the used resource capacity is greater than or equal to a preset capacity threshold, the display frame rate of which display device is prioritized can be set by the user. For example, if the user sets the display frame rate of the central control screen to be prioritized, then when the used resource capacity is greater than or equal to the preset capacity threshold, the display frame rates of all display devices except the central control screen will be reduced according to the user's settings.

[0225] In some possible implementations, when the single-frame processing time within a first preset time period is greater than or equal to the preset processing time period, the display frame rate of one or more display devices is controlled to be reduced, and the one or more display devices are used to display entertainment information and / or navigation information.

[0226] It should be noted that the single-frame processing time mentioned above can be the time required to synthesize a frame of data for display on a display device. For example, the single-frame processing time can be the time required for a surface flinger to synthesize and render a frame of image. Generally speaking, the preset processing time is the inverse of the display frame rate of the display device. For example, if the display frame rate is 60fps, the preset processing time is 16.7 milliseconds. If the single-frame processing time is longer than 16.7 milliseconds, frame loss will occur.

[0227] Exemplarily, the first preset duration can be 1 second, or 1.5 seconds, or another duration; the preset processing duration can be 16.7 milliseconds, or another preset processing duration. For example, if the processing duration of a single frame for consecutive 1 seconds is greater than or equal to 16.7 milliseconds, it indicates that the processing power of the computing platform is insufficient to support the display device to display at 60fps, and the display frame rate of the display device is controlled to be reduced. Exemplarily, the one or more display devices may include at least one of a central control screen, a passenger entertainment screen, a screen behind the driver's headrest, and a screen behind the passenger's headrest.

[0228] 1120 , control the display device to display at the display frame rate.

[0229] Exemplarily, controlling the display device to perform display at the display frame rate may include: controlling a surface flinger to control synthesis of data for display on the display device at the display frame rate.

[0230] The control method provided in the embodiment of the present application can dynamically adjust the display frame rate of the display device according to at least one of the operating status of the vehicle, the position of the user in the cabin of the vehicle, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed by the display device belongs, so that the image of the display device can be displayed smoothly, thereby improving the user's experience. The frame rate of the display device can also be adjusted according to the used resource capacity of the computing unit. When the used resource capacity of the computing unit is too high, the display frame rate of the turned-on display device is controlled to be reduced, which helps to prevent the display device from being stuck due to the high used resource capacity of the computing unit; when the used resource capacity of the computing unit is small, the display device is controlled to display at a higher display frame rate to improve the smoothness of the image, thereby improving the user's experience.

[0231] It should be noted that the correspondence between the vehicle status and the display frame rate of the display device shown in Tables 1 to 7 is merely exemplary. In specific implementations, the correspondence may also take other forms. Furthermore, the display frame rates shown in Tables 1 to 7 may also be other values. For example, the specific value of the display frame rate may be user-settable, and this is not specifically limited in the present embodiment.

[0232] The following example illustrates a method for a vehicle to determine whether there is a user in the cabin and the user's position in the cabin.

[0233] For example, an acoustic wave sensor is used to detect whether a user is seated at a certain seat. Specifically, the vehicle can determine whether there is a user in the cabin and the user's actual location based on the audio information obtained by the acoustic wave sensor. The audio information can be audio information obtained by excluding various invalid audio information from the audio information collected from the interior of the vehicle. Invalid audio information can be audio information with a volume that is too low. The sound source position can be the location of the sound source corresponding to the audio information. The sound source position can be a relative position to a display device based on sound source positioning, or it can be a specific position coordinate. This embodiment of the present application does not impose any specific restrictions on this.

[0234] For example, the location of a sound source can be determined based on the time difference of arrival (TDOA) principle using audio information collected by multiple acoustic wave sensors. For example, acoustic wave sensors A and B each detect audio emanating from a sound source S. The sound signal from source S arrives at sensor A at time t1 and sensor B at time t2. The time difference dt = |t1-t2|. Assuming the distance between source S and sensor A is AS, the distance between source S and sensor B is BS, and the speed of sound is c, we can obtain dt = t1-t2 = AS / c-BS / c. Based on the distance a between the two acoustic wave sensors, one of the sensors is selected as the reference point to determine the location of the sound source.

[0235] In some possible implementations, the audio information may be a voice message containing a specific wake-up word, such as "turn on the smart screen." The acoustic wave sensor may be an ultrasonic transceiver integrated or mounted on a display device, or an ultrasonic transceiver mounted inside a vehicle cabin (including but not limited to a microphone sensor or microphone sensor array).

[0236] Exemplarily, a camera device or an in-cabin visual sensor is used to detect whether a user is seated at a certain seat. Specifically, the camera device or in-cabin visual sensor may be used to obtain the user's facial information, and then determine whether the user is in the cabin and the user's actual location based on the user's facial information. The above-mentioned camera device or in-cabin visual sensor includes, but is not limited to, a camera sensor integrated or mounted on a display device or a camera sensor mounted inside the vehicle cabin, such as a red, green, blue (RGB) camera, a red, green, blue-infrared radiation (RGB-IR) camera, or a time of flight (TOF) camera.

[0237] In some possible implementations, after obtaining the user's facial information, the user's gender, age, etc. may be determined using algorithms such as facial attribute recognition algorithms and facial gender classification algorithms. For example, after obtaining the user's facial information, a gaze estimation algorithm or a gaze tracking algorithm may be used to determine whether the user's gaze is focused on the display device, thereby controlling the content displayed on the display device.

[0238] In some possible implementations, it is also possible to detect whether there is a user in a certain seat by using a laser radar integrated or installed on the display device or a laser radar installed inside the vehicle cabin, a radio transceiver on the display device or at the edge of the display device (including but not limited to millimeter wave radar or centimeter wave radar), an infrared sensing device integrated on the display device or at the edge of the display device (including but not limited to infrared rangefinder, laser rangefinder), an eye tracker, etc.

[0239] For example, a pressure sensor provided on a seat detects whether a user is seated on the seat. Specifically, when the pressure on a seat is greater than or equal to a preset threshold, the seat is confirmed to be occupied by a user. For example, the preset threshold may be 100 Newtons (N), 200 N, or other values, which are not specifically limited in this embodiment of the present application.

[0240] It should be understood that when detecting whether there is a user in the cabin and the actual location of the user, any one of the above methods can be used, or a combination of the above methods can be used, or other methods can be used. The embodiments of the present application do not specifically limit this.

[0241] In the various embodiments of the present application, unless otherwise specified or there is a logical conflict, the terms and / or descriptions between the various embodiments are consistent and can be referenced by each other. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.

[0242] The method provided in the embodiments of the present application is described in detail above with reference to Figures 1 to 12 . The apparatus provided in the embodiments of the present application will be described in detail below with reference to Figures 13 and 14 . It should be understood that the description of the apparatus embodiment corresponds to the description of the method embodiment. Therefore, for matters not described in detail, reference can be made to the method embodiment above, and for the sake of brevity, no further description will be given here.

[0243] FIG13 shows a schematic block diagram of a control device 2000 provided in an embodiment of the present application. The device 2000 includes a determination unit 2010 and a processing unit 2020 .

[0244] The apparatus 2000 may include units for executing the method in Figure 4, Figure 6, Figure 8, Figure 10, or Figure 11. Furthermore, each unit in the apparatus 2000 is for implementing a corresponding process of the method embodiment in Figure 4, Figure 6, Figure 8, Figure 10, or Figure 11.

[0245] When the device 2000 is used to execute the method 1100 in FIG. 11 , the determining unit 2010 may be used to execute S1110 in the method 1100 , and the processing unit 2020 may be used to execute S1120 in the method 1100 .

[0246] Specifically, the determination unit 2010 is used to determine the display frame rate of the display device based on at least one of the operating status of the vehicle, the user's position in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs; the processing unit 2020 is used to control the display device to display at the display frame rate.

[0247] Optionally, the device also includes an adjustment unit for adjusting the display frame rate based on changes in at least one of the operating status, the user's position in the vehicle cabin, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.

[0248] Optionally, the change in the operating state includes a transition between a driving state and a parking state, or a change in the level of automatic driving.

[0249] Optionally, the display device is used to display at least one of the operating condition information and navigation information of the vehicle, and the adjustment unit is used to: increase the display frame rate in response to the operating state changing from a parking state to a driving state; reduce the display frame rate in response to the operating state changing from a driving state to a parking state; increase the display frame rate in response to a decrease in the automatic driving level of the vehicle; or, reduce the display frame rate in response to an increase in the automatic driving level of the vehicle.

[0250] Optionally, the display device is used to display entertainment information, and the adjustment unit is used to: reduce the display frame rate in response to the operating state changing from a parking state to a driving state; increase the display frame rate in response to the operating state changing from a driving state to a parking state; reduce the display frame rate in response to a decrease in the autonomous driving level of the vehicle; or increase the display frame rate in response to an increase in the autonomous driving level of the vehicle.

[0251] Optionally, the adjustment unit is used to: increase the display frame rate in response to the user coming to the position corresponding to the display device in the cabin; or reduce the display frame rate in response to the user leaving the position corresponding to the display device in the cabin.

[0252] Optionally, the adjustment unit is used to: reduce the display frame rate in response to no further touch screen operation occurring within a predetermined time after the touch screen operation occurs; or increase the display frame rate in response to the touch screen operation, wherein no touch screen operation occurs within a predetermined time before the touch screen operation occurs.

[0253] Optionally, the display device includes a first display device and a second display device, wherein the first display device corresponds to a first area in the cabin and the second display device corresponds to a second area in the cabin, and the determination unit 2010 is used to determine that the display frame rate of the first display device is different from the display frame rate of the second display device.

[0254] Optionally, the determination unit 2010 is used to: in response to there being no user in the first area and there being a user in the second area, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device; in response to there being a user in the first area and there being no user in the second area, determine that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to there being a user in the first area and there being a user in the second area, the first area being the main driving area of ​​the cockpit, and the second area including one or more areas other than the main driving area, determine that the display frame rate of the first display device is higher than the display frame rate of the second display device.

[0255] Optionally, the determination unit 2010 is used to: determine that the display frame rate of the first display device is higher than the display frame rate of the second display device in response to the user touching the screen operation on the first display device within a preset time and the user not touching the screen operation on the second display device within a preset time; or, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device in response to the user not touching the screen operation on the first display device within a preset time and the user touching the screen operation on the second display device within a preset time.

[0256] Optionally, the determination unit 2010 is used to: determine that the display frame rate of the first display device is higher than the display frame rate of the second display device in response to the priority of the first application to which the interface to be displayed on the first display device belongs being higher than the priority of the second application to which the interface to be displayed on the second display device belongs; or, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device in response to the priority of the first application to which the interface to be displayed on the first display device belongs being lower than the priority of the second application to which the interface to be displayed on the second display device belongs.

[0257] Optionally, the determination unit 2010 is used to: determine the display frame rate based on resource occupancy information; wherein the resource occupancy information indicates the used resource capacity of the computing unit and / or the available resource capacity in the remaining resources, and the computing unit is associated with the display device.

[0258] Optionally, the display device includes a third display device, which is used to display at least one of entertainment information and navigation information. The determination unit 2010 is used to: when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, determine the display frame rate to be a first frame rate; when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is less than the preset capacity threshold, determine the display frame rate to be a second frame rate; wherein the first frame rate is higher than the second frame rate.

[0259] Optionally, the third display device includes one or more display devices other than the instrument screen.

[0260] Optionally, the determination unit 2010 is used to: when the vehicle is in the driving state and the single-frame processing time within the first preset time length is greater than or equal to the preset processing time length, determine to reduce the display frame rate of the display device.

[0261] Exemplarily, the determination unit 2010 and the processing unit 2020 can be set in the vehicle 100 shown in Figure 1, more specifically, the determination unit 2010 and the processing unit 2020 can be set in the computing platform 150 shown in Figure 1; or, the determination unit 2010 and the processing unit 2020 can also be set in the MDWM shown in Figure 3.

[0262] It should be understood that the division of the various units in the above device is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a single physical entity, or they may be physically separated. Furthermore, the units in the device may be implemented in the form of a processor calling software; for example, the device includes a processor connected to a memory storing instructions, and the processor calls the instructions stored in the memory to implement any of the above methods or the functions of the various units in the device. The processor may be a general-purpose processor, such as a CPU or a microprocessor, and the memory may be a memory within the device or external to the device. Alternatively, the units in the device may be implemented in the form of hardware circuits, and the functions of some or all of the units may be implemented through the design of the hardware circuits. The hardware circuits may be understood as one or more processors. For example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all of the above units may be implemented through the design of the logical relationships between the components within the circuits. In another implementation, the hardware circuit may be implemented using a PLD, such as an FPGA, which may include a large number of logic gate circuits. The connections between the logic gate circuits are configured using a configuration file to implement the functions of some or all of the above units. All units of the above apparatus may be implemented entirely in the form of software called by a processor, or entirely in the form of hardware circuits, or partially in the form of software called by a processor and the rest in the form of hardware circuits.

[0263] Each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0264] In addition, the various units in the above devices can be fully or partially integrated together, or can be implemented independently. In one implementation, these units are integrated together and implemented in the form of a system-on-a-chip (SOC). The SOC may include at least one processor for implementing any of the above methods or implementing the functions of the various units of the device. The type of the at least one processor can be different, for example, including a CPU and FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, etc.

[0265] In a specific implementation, the operations performed by the determination unit 2010 and the processing unit 2020 may be performed by a single processor, or by different processors. In a specific implementation, the one or more processors may be processors provided in the computing platform 150 shown in FIG1 ; or the apparatus 2000 may be a chip provided in the computing platform 150.

[0266] Figure 14 is a schematic block diagram of a control device provided in an embodiment of the present application. The control device 2100 shown in Figure 14 may include: a processor 2110, a transceiver 2120, and a memory 2130. The processor 2110, the transceiver 2120, and the memory 2130 are connected via an internal connection path. The memory 2130 is used to store instructions, and the processor 2110 is used to execute the instructions stored in the memory 2130 to implement the control methods in the above-mentioned embodiments. Optionally, the memory 2130 can be coupled to the processor 2110 via an interface or integrated with the processor 2110.

[0267] It should be noted that the transceiver 2120 may include but is not limited to a transceiver device such as an input / output interface to implement communication between the device 2100 and other devices or a communication network.

[0268] The memory 2130 may be a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM).

[0269] The transceiver 2120 uses a transceiver device such as but not limited to a transceiver to implement communication between the device 2100 and other devices or communication networks to receive / send data / information used to implement the control methods in the above embodiments.

[0270] In a specific implementation process, the device 2100 may be provided in the computing platform 150 shown in FIG. 1 , or may be provided in the MDWM shown in FIG. 3 .

[0271] An embodiment of the present application also provides a vehicle, which includes the above-mentioned device 2000 or the above-mentioned device 2100.

[0272] In some possible implementations, the vehicle is a vehicle.

[0273] An embodiment of the present application further provides a computer program product, which includes computer program code. When the computer program code runs on a computer, the computer implements the control method in the above embodiments of the present application.

[0274] An embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on a computer, the computer implements the control method in the above embodiments of the present application.

[0275] An embodiment of the present application also provides a chip, including a circuit, for executing the control method in the above embodiments of the present application.

[0276] In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is a kind of association relationship that describes associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In this application, "at least one" refers to one or more, and "more than one" refers to two or more. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0277] In the embodiments of this application, prefixes such as "first" and "second" are used only to distinguish different description objects and have no limiting effect on the position, order, priority, quantity, or content of the described objects. The use of prefixes such as ordinal numbers in the embodiments of this application to distinguish description objects does not constitute a limitation on the described objects. For a statement of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary limitation.

[0278] During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor or by instructions in the form of software. The method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or a power-on erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.

[0279] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0280] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0281] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0282] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0283] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A control method, characterized in that: include: Determining a display frame rate of the display device according to at least one of an operating state of a vehicle, a position of a user in a cabin of the vehicle, a touch screen operation on a display device of the vehicle, and a type of an application to which an interface to be displayed by the display device belongs; The display device is controlled to display at the display frame rate.

2. The method according to claim 1, characterized in that The determining the display frame rate of the display device according to at least one of the operating state of the vehicle, the position of the user in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed by the display device belongs comprises: The display frame rate is adjusted based on changes in at least one of the operating status, the user's position in the vehicle cabin, the touch screen operation on the vehicle's display device, and the type of application to which the interface to be displayed on the display device belongs.

3. The method according to claim 2, characterized in that The change in the operating state includes a transition between a driving state and a parking state, or a change in the level of automatic driving.

4. The method according to claim 2 or 3, characterized in that The display device is used to display at least one of the operating condition information and navigation information of the vehicle, and the display frame rate is adjusted based on a change in at least one of the operating state, the position of the user in the cabin of the vehicle, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed by the display device belongs, including: In response to the running state changing from a parking state to a driving state, increasing the display frame rate; In response to the operating state changing from a driving state to a parking state, reducing the display frame rate; In response to a decrease in the level of autonomous driving of the vehicle, increasing the display frame rate; or, In response to an increase in the autonomous driving level of the vehicle, the display frame rate is reduced.

5. The method according to any one of claims 2 to 4, characterized in that The display device is used to display entertainment information, and the display frame rate is adjusted based on at least one change of the operating state, the position of the user in the cabin of the vehicle, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed by the display device belongs, including: In response to the running state changing from a parking state to a driving state, reducing the display frame rate; In response to the running state changing from a driving state to a parking state, increasing the display frame rate; In response to a decrease in the level of autonomous driving of the vehicle, reducing the display frame rate; or, In response to an increase in the autonomous driving level of the vehicle, the display frame rate is increased.

6. The method according to any one of claims 2 to 5, characterized in that The adjusting the display frame rate based on a change in at least one of the running state, the position of the user in the vehicle cabin, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed by the display device belongs comprises: In response to the user coming to the position corresponding to the display device in the cockpit, the display frame rate is increased; or, in response to the user leaving the position corresponding to the display device in the cockpit, the display frame rate is reduced.

7. The method according to any one of claims 2 to 6, characterized in that The adjusting the display frame rate based on a change in at least one of the running state, the position of the user in the vehicle cabin, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed by the display device belongs comprises: In response to no further touch screen operation occurring within a predetermined period of time after the touch screen operation occurs, reducing the display frame rate; or, In response to the touch screen operation, the display frame rate is increased, wherein no touch screen operation occurs within a predetermined time before the touch screen operation occurs.

8. The method according to any one of claims 1 to 7, characterized in that The display device includes a first display device and a second display device, wherein the first display device corresponds to a first area in the cockpit, and the second display device corresponds to a second area in the cockpit, and determining the display frame rate of the display device includes: It is determined that a display frame rate of the first display device is different from a display frame rate of the second display device.

9. The method according to claim 8, characterized in that The determining that the display frame rate of the first display device is different from the display frame rate of the second display device includes: In response to there being no user in the first area and there being a user in the second area, determining that a display frame rate of the first display device is lower than a display frame rate of the second display device; In response to there being a user in the first area and no user in the second area, determining that a display frame rate of the first display device is higher than a display frame rate of the second display device; or, In response to there being a user in the first area and there being a user in the second area, the first area being the main driving area of ​​the cockpit, and the second area including one or more areas other than the main driving area, it is determined that the display frame rate of the first display device is higher than the display frame rate of the second display device.

10. The method according to claim 8 or 9, characterized in that The determining that the display frame rate of the first display device is different from the display frame rate of the second display device includes: In response to a user touch screen operation on the first display device within a preset time and a user no touch screen operation on the second display device within a preset time, determining that a display frame rate of the first display device is higher than a display frame rate of the second display device; or, In response to no user touch screen operation on the first display device within a preset time and a user touch screen operation on the second display device within a preset time, it is determined that a display frame rate of the first display device is lower than a display frame rate of the second display device.

11. The method according to any one of claims 8 to 10, characterized in that The determining that the display frame rate of the first display device is different from the display frame rate of the second display device includes: In response to the fact that the priority of a first application to which the interface to be displayed on the first display device belongs is higher than the priority of a second application to which the interface to be displayed on the second display device belongs, determining that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, In response to a first application program to which the interface to be displayed on the first display device belongs having a lower priority than a second application program to which the interface to be displayed on the second display device belongs, it is determined that a display frame rate of the first display device is lower than a display frame rate of the second display device.

12. The method according to any one of claims 1 to 11, characterized in that The determining the display frame rate of the display device includes: Determining the display frame rate according to the resource occupancy information; The resource occupancy information indicates the used resource capacity of the computing unit and / or the available resource capacity in the remaining resources, and the computing unit is associated with the display device.

13. The method according to claim 12, characterized in that The display device includes a third display device, and the third display device is used to display at least one of entertainment information and navigation information. The determining the display frame rate includes: When the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is greater than or equal to the preset capacity threshold, the display frame rate is determined to be a first frame rate; when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is less than the preset capacity threshold, the display frame rate is determined to be a second frame rate; wherein the first frame rate is higher than the second frame rate.

14. The method according to claim 13, characterized in that The third display device includes one or more display devices other than the instrument screen.

15. The method according to any one of claims 1 to 14, characterized in that The determining the display frame rate of the display device includes: When the vehicle is in the driving state and the single-frame processing time within the first preset time is greater than or equal to the preset processing time, it is determined to reduce the display frame rate of the display device.

16. A control device, characterized in that: It includes a determination unit and a processing unit, wherein: The determination unit is used to determine the display frame rate of the display device according to at least one of the operating state of the vehicle, the position of the user in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed by the display device belongs; The processing unit is used to control the display device to display at the display frame rate.

17. The device according to claim 16, characterized in that The device further comprises a regulating unit, which is used for: The display frame rate is adjusted based on changes in at least one of the operating status, the user's position in the vehicle cabin, the touch screen operation on the vehicle's display device, and the type of application to which the interface to be displayed on the display device belongs.

18. The device according to claim 17, characterized in that The change in the operating state includes a transition between a driving state and a parking state, or a change in the level of automatic driving.

19. The device according to claim 17 or 18, characterized in that The display device is used to display at least one of the operating condition information and navigation information of the vehicle, and the adjustment unit is used to: In response to the running state changing from a parking state to a driving state, increasing the display frame rate; In response to the operating state changing from a driving state to a parking state, reducing the display frame rate; In response to a decrease in the level of autonomous driving of the vehicle, increasing the display frame rate; or, In response to an increase in the autonomous driving level of the vehicle, the display frame rate is reduced.

20. The device according to any one of claims 17 to 19, characterized in that The display device is used to display entertainment information, and the adjustment unit is used to: In response to the running state changing from a parking state to a driving state, reducing the display frame rate; In response to the running state changing from a driving state to a parking state, increasing the display frame rate; In response to a decrease in the level of autonomous driving of the vehicle, reducing the display frame rate; or, In response to an increase in the autonomous driving level of the vehicle, the display frame rate is increased.

21. The device according to any one of claims 17 to 20, characterized in that The regulating unit is used for: In response to the user coming to the position corresponding to the display device in the cockpit, the display frame rate is increased; or, in response to the user leaving the position corresponding to the display device in the cockpit, the display frame rate is reduced.

22. The device according to any one of claims 17 to 21, characterized in that The regulating unit is used for: In response to no further touch screen operation occurring within a predetermined period of time after the touch screen operation occurs, reducing the display frame rate; or, In response to the touch screen operation, the display frame rate is increased, wherein no touch screen operation occurs within a predetermined time before the touch screen operation occurs.

23. The device according to any one of claims 16 to 22, characterized in that The display device includes a first display device and a second display device, wherein the first display device corresponds to a first area in the cockpit, and the second display device corresponds to a second area in the cockpit, and the determining unit is used to: It is determined that a display frame rate of the first display device is different from a display frame rate of the second display device.

24. The device according to claim 23, characterized in that The determining unit is used for: In response to there being no user in the first area and there being a user in the second area, determining that a display frame rate of the first display device is lower than a display frame rate of the second display device; In response to there being a user in the first area and no user in the second area, determining that a display frame rate of the first display device is higher than a display frame rate of the second display device; or, In response to there being a user in the first area and there being a user in the second area, the first area being the main driving area of ​​the cockpit, and the second area including one or more areas other than the main driving area, it is determined that the display frame rate of the first display device is higher than the display frame rate of the second display device.

25. The device according to claim 23 or 24, characterized in that The determining unit is used for: In response to a user touch screen operation on the first display device within a preset time and no user touch screen operation on the second display device within a preset time, determining that a display frame rate of the first display device is higher than a display frame rate of the second display device; or, In response to no user touch screen operation on the first display device within a preset time and a user touch screen operation on the second display device within a preset time, it is determined that a display frame rate of the first display device is lower than a display frame rate of the second display device.

26. The device according to any one of claims 23 to 25, characterized in that The determining unit is used for: In response to a first application to which the interface to be displayed on the first display device belongs having a higher priority than a second application to which the interface to be displayed on the second display device belongs, determining that a display frame rate of the first display device is higher than a display frame rate of the second display device; or, In response to a first application program to which the interface to be displayed on the first display device belongs having a lower priority than a second application program to which the interface to be displayed on the second display device belongs, it is determined that a display frame rate of the first display device is lower than a display frame rate of the second display device.

27. The device according to any one of claims 16 to 26, characterized in that The determining unit is used for: Determining the display frame rate according to the resource occupancy information; The resource occupancy information indicates the used resource capacity of the computing unit and / or the available resource capacity in the remaining resources, and the computing unit is associated with the display device.

28. The device according to claim 27, characterized in that The display device includes a third display device, the third display device is used to display at least one of entertainment information and navigation information, and the determination unit is used to: When the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, determining the display frame rate to be a first frame rate; When the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is less than the preset capacity threshold, the display frame rate is determined to be a second frame rate; wherein the first frame rate is higher than the second frame rate.

29. The device according to claim 28, characterized in that The third display device includes one or more display devices other than the instrument screen.

30. The device according to any one of claims 16 to 29, characterized in that The determining unit is used for: When the vehicle is in the driving state and the single-frame processing time within the first preset time is greater than or equal to the preset processing time, it is determined to reduce the display frame rate of the display device.

31. A control device, characterized in that: include: Memory for storing computer programs; A processor, configured to execute the computer program stored in the memory, so that the apparatus performs the method according to any one of claims 1 to 15.

32. A vehicle, characterized in that: The device comprises the apparatus as claimed in any one of claims 16 to 31, and the display device.

33. A computer-readable storage medium, characterized in that: Instructions are stored thereon, and when the instructions are executed by a processor, the processor implements the method according to any one of claims 1 to 15.

34. A chip, characterized in that: The chip comprises a circuit for executing the method according to any one of claims 1 to 15.

Citation Information

Patent Citations

  • Display control device, display device for vehicle, display control method, and program

    CN111630587A

  • Display frame rate regulation and control method and device and computer readable storage medium

    CN112102780A

  • Frame rate adjusting method and related device

    CN114443269A

  • Display method and device and mobile carrier

    CN115328594A

  • Display control method and device and mobile carrier

    CN115534822A