Display method, display device, steering wheel and vehicle

The handle with adaptive switching functionality addresses the space and flexibility issues of steering wheel buttons by dynamically adjusting the interface based on environmental and vehicle conditions, user preferences, and scenario recognition, enhancing user experience and safety.

JP2024541197AActive Publication Date: 2024-11-08YINWANG INTELLIGENT TECHNOLOGIES CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024522272
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2021-10-15
Publication Date
2024-11-08
Estimated Expiration
2041-10-15

AI Technical Summary

Technical Problem

The limited space on steering wheels for function buttons and the inflexibility in arranging these buttons across different vehicle models make it difficult to accommodate diverse and customizable control requirements.

Method used

A handle with adaptive switching functionality that displays a vehicle operating interface based on environmental and vehicle status information, user preferences, and scenario recognition, allowing for customizable and flexible operation interfaces.

Benefits of technology

Enhances user experience by providing a personalized and efficient control interface that reduces search time for functions, minimizes erroneous operations, and improves driving safety and reliability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024541197000001_ABST
    Figure 2024541197000001_ABST
Patent Text Reader

Abstract

The embodiments of the present application provide a display method, a display device, a steering wheel, and a vehicle. The display method, the display device, and the steering wheel provided in the embodiments of the present application are applicable to intelligent vehicles, new energy vehicles, etc. The steering wheel includes a steering wheel body and a touch unit. The touch unit is attached to the steering wheel body by using an attachment part. The display method, the display device, the steering wheel, and the vehicle provided in the present application can provide a rich and personalized operation interface for the user, provide an adaptive switching function, and provide the most convenient operation interface for the user at any time. This not only ensures driving safety and collision safety, but also improves user operation efficiency, reduces the risk of erroneous operation, and meets diverse and personalized requirements and scenario requirements.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present application relates to the automotive field, in particular to a display method, a display device, a steering wheel and a vehicle. [Background technology]

[0002] The steering wheel is one of the important parts of an automobile. By controlling the steering wheel, the driver can control the driving direction of the automobile. With the development of automobile technology, the control requirements for in-vehicle devices become more and more diverse, and more functions are incorporated into the steering wheel. The corresponding function buttons are placed on the steering wheel rim and the steering wheel spokes, and multi-function steering wheels emerge. The functions of the common buttons on the multi-function steering wheel include Bluetooth® call on / off, multimedia control, cruise control on / off and settings, voice assistant wake-up, voice control and adjustment, instrument control / electronic control unit control, lane keeping / lane departure alert control, customized function buttons, etc. Today, automobiles have more functions, but the space for placing function buttons on the steering wheel is limited. Therefore, it is difficult to place physical buttons for all functions. In addition, different models of vehicles may further have different numbers or types of functions, and therefore it is difficult to flexibly adjust the type, number, and placement layout of the function buttons on the steering wheel. Summary of the Invention

[0003] The present application provides a steering wheel, an electronic device, a vehicle, and a control method. The steering wheel provided in the present application can provide a rich control menu to a user, has an adaptive switching function, and provides the most convenient operation input to the user at any time.

[0004] A first aspect of the present application provides a method for displaying a vehicle operation interface. In a first possible implementation form of the first aspect, the method includes: acquiring state information, where the state information includes environmental information; acquiring a first scenario based on the state information; acquiring a first operation interface corresponding to the first scenario; and displaying the first operation interface.

[0005] Optionally, according to the display method provided in the present application, the operation interface may be updated when the environment, vehicle state, etc. change, thereby simplifying the user's complicated operation of searching for a specific button or function entry, and providing the user with an adaptive switching function of the operation interface. In different environments, the user's requirements for operation may change. A variety of operation interfaces and an adaptive interface adjustment mechanism are provided, so that the user may obtain an operation interface that is more suitable for the user's requirements.

[0006] Optionally, the current scenario may be obtained based on the environment information. Optionally, the current scenario may be obtained based on the vehicle information. The introduction of the scenario facilitates unified management and recommendation of the same sub-scenario type. For example, different related scenarios of a unified scenario type may display different operation interfaces that are correlated. In this way, the efficiency of the user's selection of an operation interface can be improved, the success rate of recommending an operation interface can be improved, and the time for the user to search for a specific operation interface can be reduced. In addition, the introduction of the scenario can reduce the possibility of frequent switching of the operation interface caused by changes in input information (e.g., vehicle state information and / or environment information), reducing the interference to the user and improving the user's driving reliability.

[0007] According to a first possible implementation form of the first aspect, in a second possible implementation form, the method further includes the steps of acquiring user identity information, and acquiring user setting information based on the user identity information, the user setting information including at least one scenario, at least one operation interface, and information regarding a correspondence between the scenario and the operation interface. The step of acquiring a first operation interface that matches the first scenario specifically includes the step of acquiring a first operation interface that matches the first scenario based on the user setting information.

[0008] According to a second possible implementation form of the first aspect, in a third possible implementation form, the method further includes a step of obtaining a first user command, where the first user command instructs to select the first operation interface as the operation interface that matches the first scenario, and a step of updating user setting information if the first operation interface is different from the second operation interface, where the second operation interface is in the user setting information and is the operation interface that currently matches the first scenario.

[0009] Optionally, in the method provided in the first aspect of the present application, the operation interface may be further switched based on the user's selection. This allows the user to control the switching of the operation interface more flexibly. If the user wants to return to the previous operation interface, the user can tap one button to return to the previous operation interface. In addition, this also provides the possibility of introducing a manual correction option when the operation interface is switched by mistake.

[0010] Optionally, in the display method provided in this application, the operation interface may further be displayed based on the user identity, which provides more types of choices for users to customize settings. In this way, the problem that the number of control buttons on the steering wheel is limited or the layout position is fixed and cannot be changed can be effectively solved under the premise that the steering wheel has a limited arrangement space.

[0011] Optionally, the pre-defined scenarios may be customized by the user or may be pre-defined by the system.

[0012] Optionally, the operation interface may be customized by the user or may be pre-configured by the system.

[0013] Optionally, the correspondence between the preset scenarios and the operation interface may be customized by the user or preset by the system. Based on the user setting information, a more personalized experience may be provided to the user, and a more flexible operation experience may be provided to the user. The user may set the operation interface in a specific scenario based on preferences to implement more efficient control over the vehicle or the in-vehicle device. The user setting information is updated. When the user changes the setting of the operation interface, the user's latest setting may be recorded to provide an updated operation interface next time. This improves the user experience.

[0014] Optionally, if the vehicle erroneously recognizes the scenario, manual correction may be performed. In a possible implementation form, after the step of acquiring the first scenario based on the state information, the method further includes the steps of acquiring a second user instruction, where the second user instruction instructs whether to switch to the first scenario, acquiring a first operation interface corresponding to the first scenario if the second user instruction instructs to switch to the first scenario, or acquiring a third instruction, where the third instruction instructs to switch to the second scenario if the second user instruction instructs not to switch to the first scenario, acquiring a second operation interface corresponding to the second scenario, and displaying the second operation interface.

[0015] According to the first to third possible implementation forms of the first aspect, in a fourth possible implementation form, the environmental information includes at least one of location information, road information, weather information, and accident information.

[0016] Optionally, the environmental information may include multiple dimensions of information, such as location information, road information, weather information, and accident information. When the environmental information changes, a more suitable operation interface can be provided, which reduces the user's time to search for a specific function operation button, and improves the efficiency of the user to perform a suitable action. This effectively improves the driving experience and driving safety.

[0017] According to the first to fourth possible implementation forms of the first aspect, in a fifth possible implementation form, the state information further includes vehicle information, and the vehicle information includes at least one of driving state information and use state information. The driving state information includes at least one of driving mode information, gear information, motion state information, drive system state information, energy system state information, lighting system state information, and vehicle fault information. The use state information includes at least one of call state information, screen brightness, speaker volume, temperature control mode, air circulation mode, seat state, window state, and atmosphere light state.

[0018] With rich information input, the user can be provided with an operation interface that is more suitable for the current operation requirements. Optionally, the information input source can be vehicle status information, and the available operation interface can be provided to the user by fully considering the functions and states of the vehicle. Optionally, the information input source can be information outside the vehicle, and the optimal operation interface in different environments can be provided to the user by fully considering the environmental information outside the vehicle. In this way, the variety and flexibility of the display of the operation interface can be improved, and a better operation experience can be brought to the user.

[0019] According to the first to fifth possible implementation forms of the first aspect, in a sixth possible implementation form, after the step of obtaining the first scenario based on the state information, the method further includes a step of obtaining a feedback mode corresponding to the first scenario based on the first scenario. The feedback mode includes a feedback manner and a feedback intensity. The feedback manner includes at least one of vibration feedback, audio feedback, and brightness feedback. The feedback intensity includes at least one of vibration amplitude, vibration frequency, volume, and brightness.

[0020] In this case, feedback can be provided based on user operation. Vibration, sound and picture feedback can improve the user's operation experience, and bring the user more realistic touch, sound and picture. In addition, the feedback intensity and feedback method can be adaptively adjusted to effectively reduce the probability of erroneous operation, and improve driving safety.

[0021] According to the first to sixth possible implementation forms of the first aspect, in a seventh possible implementation form, the vehicle displays the first operation interface by using a steering wheel, and the method further includes a step of obtaining a steering wheel angle and a step of adjusting a display angle of the first operation interface based on the steering wheel angle.

[0022] In this way, a more suitable picture operation angle for different steering wheel angles can be provided to the user. When the steering wheel angle is not zero, a more convenient operation interface for identification and operation can be provided to the user.

[0023] According to the first to seventh possible implementation forms of the first aspect, in an eighth possible implementation form, the vehicle includes a first display device and a second display device, and the first operation interface includes a first sub-interface and a second sub-interface. The step of displaying the first operation interface specifically includes the steps of displaying the first sub-interface by using the first display device and displaying the second sub-interface by using the second display device.

[0024] Optionally, the display method provided in this application may be applied to a steering wheel including at least one operation unit. For example, the steering wheel may include a first operation unit and a second operation unit. When there are multiple operation units, multiple same or different operation interfaces may be displayed simultaneously to provide a better operation experience for the user. It should be noted that the arrangement manner of the operation units needs to take into account the collision safety requirements of the vehicle.

[0025] A second aspect of the present application provides an apparatus for displaying a vehicle operation interface. In a first possible implementation form, the apparatus includes: an acquisition unit configured to acquire state information, where the state information includes environmental information; a processing unit configured to acquire a first scenario based on the state information, where the processing unit is further configured to acquire a first operation interface corresponding to the first scenario; and a display unit configured to display the first operation interface.

[0026] Optionally, according to the display device provided in the present application, the operation interface may be updated when the environment, vehicle state, etc. change, thereby simplifying the complicated operation of the user searching for a specific button or function entry, and providing the user with an adaptive switching function of the operation interface. In different environments, the user's requirements for operation may change. A variety of operation interfaces and an adaptive interface adjustment mechanism are provided, so that the user may obtain an operation interface that is more suitable for the user's requirements.

[0027] Optionally, the current scenario information may be obtained based on the environment information and / or vehicle state information. The introduction of scenario information facilitates unified management and recommendation of the same sub-scenario type. For example, different related scenarios of a unified scenario type may display different correlated operation interfaces. In this way, the efficiency of the user's selection of an operation interface can be improved, the success rate of recommending an operation interface can be improved, and the time for the user to search for a specific operation interface can be reduced. In addition, the introduction of scenarios can reduce the possibility of frequent switching of operation interfaces caused by changes in input information (e.g., vehicle state information and / or environment information), reducing interference to the user and improving the user's driving reliability.

[0028] According to a first possible implementation form of the second aspect, in a second possible implementation form, the apparatus includes an identity information acquisition unit configured to acquire user identity information. The processing unit is further configured to acquire user setting information based on the user identity information, the user setting information including at least one scenario, at least one operation interface, and information on the correspondence between the scenario and the operation interface. The processing unit is further configured to acquire a first operation interface that matches the first scenario based on the user setting information.

[0029] Optionally, the display device provided in the second aspect of the present application may further switch the operation interface based on the user's selection. This allows the user to control the switching of the operation interface more flexibly. If the user wants to return to the previous operation interface, the user can tap one button to return to the previous operation interface. In addition, this also provides the possibility of introducing a manual correction option when the operation interface is switched by mistake.

[0030] Optionally, the display device provided in this application may further display an operation interface based on user identity, which provides more types of choices for users to customize settings. In this way, the problem that the number of control buttons on the steering wheel is limited or the layout position is fixed and cannot be changed can be effectively solved under the premise that the steering wheel has a limited arrangement space.

[0031] Optionally, the pre-defined scenarios may be customized by the user or may be pre-defined by the system.

[0032] Optionally, the operation interface may be customized by the user or may be pre-configured by the system.

[0033] Optionally, the correspondence between the preset scenarios and the operation interface may be customized by the user or preset by the system. Based on the user setting information, a more personalized experience may be provided to the user, and a more flexible operation experience may be provided to the user. The user may set the operation interface in a specific scenario based on preferences to implement more efficient control over the vehicle or the in-vehicle device. The user setting information is updated. When the user changes the setting of the operation interface, the user's latest setting may be recorded to provide an updated operation interface next time. This improves the user experience.

[0034] Optionally, if the vehicle erroneously recognizes the scenario, manual correction may be performed. In a possible implementation form, after obtaining the first scenario based on the state information, the method further includes: obtaining a second user instruction, where the second user instruction indicates whether to switch to the first scenario; and if the second user instruction indicates to switch to the first scenario, obtaining a first operation interface corresponding to the first scenario; or if the second user instruction indicates not to switch to the first scenario, obtaining a third instruction, where the third instruction indicates to switch to the second scenario; obtaining a second operation interface corresponding to the second scenario; and displaying the second operation interface.

[0035] According to a second possible implementation form of the second aspect, in a third possible implementation form, the apparatus includes a receiving unit configured to receive a first user instruction, the first user instruction instructing to select the first operation interface as an operation interface that matches the first scenario. The processing unit is further configured to update the user setting information when the first operation interface is different from the second operation interface. The second operation interface is in the user setting information and is the operation interface that currently matches the first scenario.

[0036] According to the first to third possible implementation forms of the second aspect, in a fourth possible implementation form, the environmental information includes at least one of location information, road information, weather information, and accident information.

[0037] Optionally, the environmental information may include multiple dimensions of information, such as location information, road information, weather information, and accident information. When the environmental information changes, a more suitable operation interface can be provided, which reduces the user's time to search for a specific function operation button, and improves the efficiency of the user to perform a suitable action. This effectively improves the driving experience and driving safety.

[0038] According to the first to fourth possible implementation forms of the second aspect, in a fifth possible implementation form, the state information further includes vehicle information, and the vehicle information includes at least one of driving state information and use state information. The driving state information includes at least one of driving mode information, gear information, motion state information, drive system state information, energy system state information, lighting system state information, and vehicle fault information. The use state information includes at least one of call state information, screen brightness, speaker volume, temperature control mode, air circulation mode, seat state, window state, and atmosphere light state.

[0039] With rich information input, the user can be provided with an operation interface that is more suitable for the current operation requirements. Optionally, the information input source can be vehicle status information, and the available operation interface can be provided to the user by fully considering the functions and states of the vehicle. Optionally, the information input source can be information outside the vehicle, and the optimal operation interface in different environments can be provided to the user by fully considering the environmental information outside the vehicle. In this way, the variety and flexibility of the display of the operation interface can be improved, and a better operation experience can be brought to the user.

[0040] According to the first to fifth possible implementation forms of the second aspect, in a sixth possible implementation form, the processing unit is further configured to obtain a feedback mode that matches the first scenario based on the first scenario. The feedback mode includes a feedback manner and a feedback intensity. The feedback manner includes at least one of vibration feedback, audio feedback, and brightness feedback. The feedback intensity includes at least one of vibration amplitude, vibration frequency, volume, and brightness.

[0041] In this case, feedback can be provided based on user operation. Vibration, sound and picture feedback can improve the user's operation experience, and bring the user more realistic touch, sound and picture. In addition, the feedback intensity and feedback method can be adaptively adjusted to effectively reduce the probability of erroneous operation, and improve driving safety.

[0042] According to the first to sixth possible implementation forms of the second aspect, in a seventh possible implementation form, the vehicle displays the first operation interface by using a steering wheel, and the acquisition unit is further configured to acquire a steering wheel angle. The processing unit is further configured to adjust a display angle of the first operation interface based on the steering wheel angle.

[0043] In this way, a more suitable picture operation angle for different steering wheel angles can be provided to the user. When the steering wheel angle is not zero, a more convenient operation interface for identification and operation can be provided to the user.

[0044] According to the first to seventh possible implementation forms of the second aspect, in an eighth possible implementation form, the display unit includes a first display subunit and a second display subunit, and the first operation interface includes a first sub-interface and a second sub-interface. The first display subunit is configured to display the first sub-interface, and the second display subunit is configured to display the second sub-interface.

[0045] Optionally, the display method provided in this application may be applied to a steering wheel including at least one operation unit. For example, the steering wheel may include a first operation unit and a second operation unit. When there are multiple operation units, multiple same or different operation interfaces may be displayed simultaneously to provide a better operation experience for the user. It should be noted that the arrangement manner of the operation units needs to take into account the collision safety requirements of the vehicle.

[0046] A third aspect of the present application provides a handle. In a first possible implementation form of the third aspect, the handle includes: a first operation unit configured to display an operation interface and receive a user command, the operation interface being obtained based on state information, the state information including environmental information; and A first mounting portion to which the first operation unit is detachably attached.

[0047] Optionally, the environmental information includes at least one of location information, road information, weather information, and accident information.

[0048] Optionally, the operation interface may also be obtained based on vehicle information. The vehicle information includes at least one of driving state information and use state information. The driving state information includes at least one of driving mode information, gear information, motion state information, drive system state information, energy system state information, lighting system state information, and vehicle fault information. The use state information includes at least one of call state information, screen brightness, speaker volume, temperature control mode, air circulation mode, seat state, window state, and atmosphere light state.

[0049] Optionally, the operation interface may also be obtained based on user setting information. The user setting information may be obtained based on user identity information, and the user setting information includes at least one scenario, at least one operation interface, and information about the correspondence between the scenario and the operation interface. Based on the user setting information, a first operation interface that matches the first scenario is obtained.

[0050] Optionally, in the handle provided in the third aspect of the present application, the first operation unit can be detachably connected to the handle. This facilitates the upgrade of the first operation unit. Considering the constantly accelerating update speed of vehicles, in order to better meet the constantly upgrading function demands of users, the first operation unit can be replaced separately, ensuring that the vehicle can easily upgrade hardware.

[0051] Optionally, in a possible implementation, the first operating unit may be integrated with the handle. The first operating unit and the handle are integrated. This helps reduce costs, improve reliability, and reduce security risks in the event of a collision.

[0052] With reference to the first possible implementation form of the third aspect, in a second possible implementation form, the first operation unit is magnetically fixedly attached to the first mounting portion.

[0053] Optionally, in the handle provided in the present application, the first operating unit may be connected to the handle body via magnetic attraction. The magnetic attraction connection can improve the reliability of the connection between the first operating unit and the handle. In addition, the magnetic connection is also convenient for disassembly and positioning. During installation, the magnetic attraction can further provide a guide for installation so that the user can install the first operating unit on the handle. When the first operating unit is placed in a position close to the installation point, the magnetic attraction part can align the first operating unit with the handle by suction to facilitate the alignment and installation.

[0054] According to the first and second possible implementation forms of the third aspect, in the third possible implementation form, the first operation unit further includes a first connection portion, the first mounting portion further includes a second connection portion, and the first operation unit is a first operation unit that uses the first connection portion and the second connection portion. Mounting Part is fixed at.

[0055] Optionally, the connection may be a snap-fit ​​connection. The snap-fit ​​connection can effectively improve the reliability of the connection between the first operating unit and the handle. When the first operating unit is attached to the handle and in a locked state, it can effectively prevent the first operating unit or a part of the first operating unit from falling off or flying off during a vehicle collision, thereby improving the safety of the occupants during a vehicle collision.

[0056] According to the first to third possible implementation forms of the third aspect, in a fourth possible implementation form, the first operation unit includes a wireless charging receiving end, the first mounting portion includes a wireless charging transmitting end, and the first mounting portion supplies power to the first operation unit via the wireless charging transmitting end and the wireless charging receiving end.

[0057] Optionally, in the handle provided in the present application, the first operation unit may be wirelessly powered by the handle. Wireless power supply can reduce the hardware interface and effectively improve the dustproof and waterproof ability of the first operation unit. In addition, the convenience of disassembling and assembling the first operation unit can be improved.

[0058] Optionally, in a possible implementation, the handle may supply power to the first operation unit through a wired connection method. When the wired connection method is used for power supply, the stability of power supply transmission can be improved. When the first operation unit and the handle are integrated, the system configuration is simplified and the reliability is improved.

[0059] According to the first to fourth possible implementation forms of the third aspect, in a fifth possible implementation form, the handle includes a first interface, and the first operating unit establishes a communication connection with the handle via the first interface.

[0060] According to the first to fourth possible implementation forms of the third aspect, in a sixth possible implementation form, the first operation unit further includes a wireless communication unit configured to establish a wireless communication connection with an in-vehicle device of the vehicle.

[0061] Optionally, the handle provided in the present application may establish a communication connection with the first operation unit in a wired or wireless manner. If the wireless manner is used to perform the communication connection, the hardware interface connection can be simplified, and it is convenient for the first operation unit to establish a wireless communication connection with any vehicle-mounted unit. If the wired manner is used to perform the communication connection, the stability of the communication connection can be improved, and it can be guaranteed that the first operation unit controls the vehicle in real time.

[0062] According to the first to sixth possible implementation forms of the third aspect, in a seventh possible implementation form, the handle further includes an airbag accommodating portion, and the airbag accommodating portion does not overlap with a projection of the first operating unit onto the rotation plane of the handle.

[0063] Optionally, in the steering wheel provided in the present application, the airbag housing does not overlap with the projection of the first operating unit onto the rotation plane of the steering wheel, thereby avoiding the interference of the first operating unit with the airbag ignition process, and improving the safety of the occupants in the event of a vehicle collision.

[0064] Optionally, in a possible implementation, the airbag may alternatively pop out from another location on the outside of the steering wheel, particularly in cases where the steering wheel rim is imperfectly round or has an unusual shape, in order to protect the driver.

[0065] With reference to the first to seventh possible implementation forms of the third aspect, in an eighth possible implementation form, the handle further includes an identity recognition unit, the identity recognition unit including at least one of a fingerprint recognition unit, a voice recognition unit, and a face recognition unit.

[0066] Optionally, the identity recognition unit may be a fingerprint recognition unit or a face recognition unit. Alternatively, the identity recognition unit may further include another implementation, for example, may be a palm print recognition unit, an iris authentication unit, or a voice recognition unit. After the user identity is recognized by the identity recognition unit, a more suitable function or operation interface for recommending content may be provided to the user based on the user preferences.

[0067] Optionally, the steering wheel may further include a heart rate detection unit. The heart rate detection unit may detect the user's heart rate to provide health guidance to the user. In addition, the heart rate detection unit may provide information input for sensing the user's emotion to comprehensively evaluate the user's emotion. In addition, the heart rate detection unit may further provide information input for a driver monitoring system. For example, whether the user is a real person may be determined by monitoring the heart rate, and ensure that the user is ready to take over driving permission at any time.

[0068] According to the first to eighth possible implementation forms of the third aspect, in a ninth possible implementation form, the handle further includes a second operation unit, and the handle further includes a second mounting portion. The second operation unit is configured to display an operation interface and receive user commands, and the second operation unit is removably attached to the second mounting portion.

[0069] Optionally, the handle provided in the present application may include at least one operation unit. For example, the handle may include a first operation unit and a second operation unit. When there are multiple operation units, multiple operation interfaces may be displayed simultaneously, providing users with a better operation experience. It should be noted that the arrangement manner of the operation units needs to take into account the collision safety requirements of the vehicle.

[0070] A fourth aspect of the present application provides an electronic device. In a first possible implementation form of the fourth aspect, the electronic device includes: an operation unit configured to display an operation interface and receive a user command, the operation interface being obtained based on state information, the state information including environmental information; and A first connection portion configured to releasably secure an electronic device.

[0071] Optionally, the environmental information includes at least one of location information, road information, weather information, and accident information.

[0072] Optionally, the operation interface may also be obtained based on vehicle information. The vehicle information includes at least one of driving state information and use state information. The driving state information includes at least one of driving mode information, gear information, motion state information, drive system state information, energy system state information, lighting system state information, and vehicle fault information. The use state information includes at least one of call state information, screen brightness, speaker volume, temperature control mode, air circulation mode, seat state, window state, and atmosphere light state.

[0073] Optionally, the operation interface may be obtained based on user setting information. The user setting information may be obtained based on user identity information, and the user setting information includes at least one scenario, at least one operation interface, and information about the correspondence between the scenario and the operation interface. Based on the user setting information, a first operation interface that matches the first scenario is obtained.

[0074] Optionally, the electronic device provided in the fourth aspect of the present application may display an appropriate operation interface based on input information such as vehicle status information, environmental information, and user setting information, to provide the user with a more comfortable operation experience.

[0075] Optionally, the electronic device provided in the fourth aspect of the present application may have multiple hardware configuration solutions. When a vehicle needs to upgrade its hardware configuration, an electronic device with a lower hardware configuration may be removed and an upgraded electronic device may be installed.

[0076] According to a first possible implementation form of the fourth aspect, in a second possible implementation form, the first connection portion includes at least one of a magnetic attraction unit and a snap-fit ​​unit.

[0077] Optionally, the electronic device provided in the fourth aspect of the present application may be connected to the handle provided in the third aspect of the present application by magnetic attraction, a snap fit, or a combination of magnetic attraction and a snap fit. The electronic device is connected by magnetic attraction or a snap fit to facilitate attachment of the electronic device to the handle or to facilitate removal of the electronic device from the handle.

[0078] Optionally, the reliability of the connection between the first operating unit and the handle may be effectively improved by a snap-fit ​​connection. When the first operating unit is attached to the handle and in a locked state, it is possible to effectively prevent the first operating unit or a part of the first operating unit from falling off or flying off in a vehicle collision, thereby improving the safety of the occupants in the event of a vehicle collision.

[0079] Optionally, in the handle provided in the present application, the first operating unit may be connected to the handle body via magnetic attraction. The magnetic attraction connection can improve the reliability of the connection between the first operating unit and the handle. In addition, the magnetic connection is also convenient for disassembly and positioning. During installation, the magnetic attraction can further provide a guide for installation so that the user can install the first operating unit on the handle. When the first operating unit is placed in a position close to the installation point, the magnetic attraction part can align the first operating unit with the handle by suction to facilitate the alignment and installation.

[0080] With reference to the first or second possible implementation form of the fourth aspect, in a third possible implementation form, the device further includes a wireless charging receiving end, the wireless charging receiving end being configured to transmit electrical energy.

[0081] Optionally, the electronic device provided in the present application may include a wireless charging receiving end. Charging wirelessly can reduce the external hardware interface of the electronic device, simplify the connection or mounting method, and improve the dustproof and waterproof ability of the electronic device. In addition, the convenience of disassembling and assembling the first operation unit can be improved.

[0082] In a possible implementation, the wireless communication connection can be implemented by using a wireless charging transceiver coil. When the wireless communication connection is established by using a charging coil, the wireless charging coil can be fully used in a frequency division multiplexing manner or a time division multiplexing manner. In this way, the structure of the electronic device can be simplified.

[0083] According to the first or second possible implementation form of the fourth aspect, in the fourth possible implementation form, the apparatus further includes a communication interface, the communication interface configured to establish a communication connection with the in-vehicle device.

[0084] Optionally, the handle provided in the present application may establish a communication connection with the first operation unit in a wired or wireless manner. If the wireless manner is used to perform the communication connection, the hardware interface connection can be simplified, and it is convenient for the first operation unit to establish a wireless communication connection with any vehicle-mounted unit. If the wired manner is used to perform the communication connection, the stability of the communication connection can be improved, and it can be guaranteed that the first operation unit controls the vehicle in real time.

[0085] According to the first or second possible implementation form of the fourth aspect, in a fifth possible implementation form, the apparatus further includes a wireless communication unit, the wireless communication unit configured to establish a wireless communication connection with an on-board device of the vehicle.

[0086] According to any one of the first to fifth possible implementation forms of the fourth aspect, in a sixth possible implementation form, the device further includes a feedback unit, and the feedback unit includes at least one of a vibration feedback unit, an audio feedback unit, and a picture feedback unit. The vibration feedback unit is configured to output a vibration signal according to a user command. The audio feedback unit is configured to output an audio signal according to a user command. The picture feedback unit is configured to output a picture effect according to a user command.

[0087] Optionally, the electronic device provided in the present application may further include a feedback unit. The feedback unit may feedback the user's operation based on vehicle state information, environmental information, etc. For example, when the user presses an operation button on the operation unit, the electronic device may feedback a vibration signal to provide the user with a tactile sensation. In addition, other modes of feedback, such as audio and images, may be provided. In different vehicle states and / or environments, or in different scenarios, both the feedback mode and feedback intensity of the feedback unit may be adaptively adjusted to provide the user with a better operation experience.

[0088] A fifth aspect of the present application provides a computer-readable storage medium. The computer-readable storage medium stores code or instructions that, when executed, perform any of the methods provided in the first aspect of the present application.

[0089] A sixth aspect of the present application provides a vehicle, the vehicle including any of the devices provided in the second aspect of the present application, the vehicle including any of the handles provided in the third aspect of the present application, or the vehicle including any of the devices provided in the fourth aspect of the present application.

[0090] In conclusion, the handle, electronic device, vehicle, and control method provided in this application provide the user with a rich and personalized operation interface, and the operation interface has an adaptive switching function, and can provide the user with the most convenient operation interface at any time. This not only ensures driving safety and collision safety, but also improves user operation efficiency and reduces the risk of erroneous operation. In addition, the handle, electronic device, and vehicle provided in this application can further make hardware upgrades more convenient, simplify upgrade steps and installation requirements, and bring more possibilities for the user's personalized configuration. [Brief description of the drawings]

[0091] [Figure 1] FIG. 2 is a schematic block diagram of vehicle functions according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram of a vehicle handle layout according to an embodiment of the present application. [Figure 3-a] FIG. 1 is a schematic diagram of the architecture of a handle system according to an embodiment of the present application. [Figure 3-b] FIG. 1 is a schematic diagram of another handle system architecture according to an embodiment of the present application. [Figure 4-a] FIG. 2 is a schematic diagram of a handle according to an embodiment of the present application. [Figure 4-b] FIG. 2 is a schematic diagram of a handle body according to an embodiment of the present application. [Figure 4-c] FIG. 2 is a schematic diagram of a touch display unit according to an embodiment of the present application; [Figure 4-d] FIG. 13 is a schematic diagram of another handle body according to an embodiment of the present application. [Figure 4-e] FIG. 2 is a schematic diagram of another touch display unit according to an embodiment of the present application. [Figure 5-a] FIG. 2 is a schematic diagram of an operation interface of a handle according to an embodiment of the present application. [Figure 5-b]FIG. 13 is a schematic diagram of another operation interface of the handle according to an embodiment of the present application. [Figure 5-c] FIG. 13 is a schematic diagram of another operation interface of the handle according to an embodiment of the present application. [Figure 5-d] FIG. 13 is a schematic diagram of another operation interface of the handle according to an embodiment of the present application. [Figure 5-e] FIG. 13 is a schematic diagram of another operation interface of the handle according to an embodiment of the present application. [Figure 5-f] FIG. 13 is a schematic diagram of another operation interface of the handle according to an embodiment of the present application. [Figure 6] FIG. 2 is a schematic diagram of an operation interface display method according to an embodiment of the present application; [Figure 7] FIG. 2 is a schematic diagram of an operation interface display method according to an embodiment of the present application; [Figure 8] FIG. 2 is a schematic diagram of an operation interface display method according to an embodiment of the present application; [Figure 9] FIG. 2 is a schematic diagram of an operation interface display method according to an embodiment of the present application; [Figure 10] FIG. 2 is a schematic diagram of a data out migration method according to an embodiment of the present application; [Figure 11] FIG. 2 is a schematic diagram of a data-in-migration method according to an embodiment of the present application; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0092] The following describes in detail the embodiments of the present application with reference to the accompanying drawings. It is clear that the described embodiments are only a part, not all, of the embodiments of the present application. Those skilled in the art may know that with the technological development and emergence of new scenarios, the technical solutions provided in the embodiments of the present application can also be applied to similar technical problems.

[0093] Automobiles are evolving and innovating in the movement of electrification, networking, intelligence, sharing, and the like. FIG. 1 is a functional schematic diagram of a vehicle 100 according to an embodiment of the present application. The vehicle 100 may include various subsystems, such as an infotainment system 110, a sensing system 120, a decision control system 130, a drive system 140, and a computing platform 150. Optionally, the vehicle 100 may include more or fewer subsystems, and each subsystem may include multiple components. Additionally, each subsystem and component of the vehicle 100 may be interconnected in a wired or wireless manner.

[0094] In some embodiments, infotainment system 110 may include a communication system 111, an entertainment system 112, and a navigation system 113.

[0095] The communication system 111 may include a wireless communication system. The wireless communication system may perform wireless communication with one or more devices directly or through a communication network. For example, the wireless communication system may use a third generation (3G) cellular communication technology, such as code division multiple access (CDMA), or a fourth generation (4G) cellular communication technology, such as long time evolution (LTE) communication technology, or a fifth generation (5G) cellular communication technology, such as new radio (NR) communication technology. The wireless communication system may communicate with a wireless local area network (WLAN) by using Wi-Fi. In some embodiments, the wireless communication system may communicate with the devices directly through an infrared link or by using Bluetooth or ZigBee. In other wireless protocols, such as various vehicular communication systems, for example, the wireless communication system may include one or more dedicated short range communication (DSRC) devices, which may include public and / or private data communications between vehicles and / or roadside stations.

[0096] The entertainment system 112 may include a central control screen, a microphone, and a sounder. A user may listen to the radio or play music in the vehicle through the entertainment system. Alternatively, a mobile phone may be connected to the vehicle to realize a screen projection of the mobile phone on the central control screen. The central control screen may be a touch screen, and a user may perform operations by touching the screen. In some cases, the user's voice signal may be acquired by using a microphone, and some controls performed by the user on the vehicle 100 are implemented based on the analysis of the user's voice signal, for example, the temperature in the vehicle is adjusted. In other cases, music may be played to the user through the sounder.

[0097] The navigation system 113 may include a map service provided by a map supplier to provide navigation of a driving route for the vehicle 100. The navigation system 113 may be used in conjunction with the vehicle's global positioning system 121 and inertial measurement unit 122. The map service provided by the map provider may be a two-dimensional map or a high-resolution map.

[0098] The sensing system 120 may include several types of sensors that sense the surrounding environment information of the vehicle 100. For example, the sensing system 120 may include a global positioning system 121 (the global positioning system may be a global positioning satellite (GPS) system, a BeiDou system, or another positioning system), an inertial measurement unit (IMU) 122, a lidar 123, a millimeter wave radar 124, an ultrasonic radar 125, and a camera device 126. The sensing system 120 may further include sensors of the internal systems of the vehicle 100 being monitored (e.g., an on-board air quality monitor, a fuel gauge, or an engine oil temperature gauge). Sensor data from one or more of these sensors can be used to detect objects and corresponding characteristics of the objects (such as position, shape, orientation, speed, etc.). Such detection and recognition are important functions of the safe operation of the vehicle 100.

[0099] The positioning system 121 may be configured to estimate the geographic position of the vehicle 100. The inertial measurement unit 122 is configured to sense changes in position and orientation of the vehicle 100 based on inertial acceleration. In some embodiments, the inertial measurement unit 122 may be a combination of an accelerometer and a gyroscope. The lidar 123 may sense objects in the environment in which the vehicle 100 is located by using a laser. In some embodiments, the lidar 123 may include one or more laser sources, a laser scanner, one or more detectors, and other system components. The millimeter wave radar 124 may sense objects in the environment surrounding the vehicle 100 by using a radio signal. In some embodiments, in addition to sensing objects, the radar 124may be further configured to sense the speed and / or direction of movement of an object. The ultrasonic radar 125 may sense objects around the vehicle 100 by using ultrasonic signals. The camera device 126 may be configured to capture image information of the surrounding environment of the vehicle 100. The camera device 126 may include a monocular camera, a binocular camera, a structured light camera, a panoramic camera, etc. The image information acquired by the camera device 126 may include a still image or may include video stream information.

[0100] The decision control system 130 includes a computing system 131 that performs analysis and decision making based on the information obtained by the sensing system 120. The decision control system 130 further includes a vehicle controller 132 that controls a power system of the vehicle 100, a steering system 133 configured to control the vehicle 100, an accelerator pedal 134 (including exemplary names herein an accelerator pedal for an electric vehicle or a throttle for a fuel vehicle), and a braking system 135.

[0101] The computing system 131 may operate to process and analyze various information acquired by the sensing system 120 to identify targets, objects, and / or features in the environment surrounding the vehicle 100. The targets may include pedestrians or animals, and the objects and / or features may include traffic signals, road boundaries, and obstacles. The computing system 131 may use techniques such as object recognition algorithms, structure from motion (SFM) algorithms, and video tracking. In some embodiments, the computing system 131 may be configured to map the environment, track objects, estimate the speed of objects, and the like. The computing system 131 may analyze the various acquired information and derive a control policy for the vehicle.

[0102] The vehicle controller 132 may be configured to perform coordinated control over the vehicle's power battery and driver 141 to improve the power performance of the vehicle 100.

[0103] The steering system 133 may operate to adjust the direction of travel of the vehicle 100. For example, in one embodiment, the steering system 133 may be a steering wheel system. The accelerator pedal 134 is configured to control the driving speed of the driver 141 and thus the speed of the vehicle 100.

[0104] Braking system 135 is configured to control and slow down vehicle 100. Braking system 135 may slow down wheels 144 by using frictional forces. In some embodiments, braking system 135 may convert kinetic energy of wheels 144 into electrical current. Braking system 135 may also slow down the rotational speed of wheels 144 by using another form to control the speed of vehicle 100.

[0105] Drive system 140 may include components that provide power for vehicle 100 to move. In one embodiment, drive system 140 may include driver 141, energy source 142, transmission system 143, and wheels 144. Driver 141 may be an internal combustion engine, an electric motor, an air compression engine, or a combination of other types of engines, such as a hybrid engine formed by a gasoline engine and an electric motor, or a hybrid engine formed by an internal combustion engine and an air compression engine. Driver 141 converts energy source 142 into mechanical energy.

[0106] Examples of energy source 142 include gasoline, diesel, other oil-based fuels, propane, other compressed gas-based fuels, ethyl alcohol, solar panels, batteries, and other power sources. Energy source 142 may also provide energy to other systems of vehicle 100.

[0107] The transmission 143 transmits mechanical power from the driver 141 to the wheels 144. The transmission 143 may include a gearbox, a differential, and a drive shaft. In one embodiment, the transmission 143 may further include other components, such as a clutch. The drive shaft transmits mechanical power to one or more wheels. 144 The shaft may include one or more shafts that may be coupled to the

[0108] Some or all functions of vehicle 100 are controlled by computing platform 150. Computing platform 150 may include at least one processor 151, which may execute instructions 153 stored in a non-transitory computer-readable medium, such as memory 152. In some embodiments, computing platform 150 may alternatively be multiple computing devices that control individual components or subsystems of vehicle 100 in a distributed manner.

[0109] Processor 151 may be any conventional processor, such as a central processing unit (CPU), or alternatively, processor 151 may be a graphics processing unit (GPU), a field programmable gate array (FPGA), a system on chip (SOC), an application specific integrated circuit (API), or a combination of both. circuit The computer may further include an application-specific integrated circuit (ASIC) chip, or a combination thereof. Ta's Although processors, memories, and other elements are functionally depicted within the same block, those skilled in the art should understand that a processor, computer, or memory may actually include multiple processors, computers, or memories that may or may not be stored in the same physical enclosure. For example, a memory may be a hard disk drive, or a computer Ta's The storage medium may be located in a different housing than the housing. Thus, reference to a processor or computer is understood to include reference to a set of processors or computers or memories that may or may not operate in parallel. Unlike using a single processor to perform the steps described herein, some components, such as steering components and deceleration components, may include respective processors. The processors perform only calculations related to the component's specific function.

[0110] In various aspects described herein, the processor may be located remotely from the vehicle and perform wireless communications with the vehicle. In another aspect, some processes described herein are performed on a processor located within the vehicle, and other processes are performed by the remote processor, including performing the steps necessary for a single operation.

[0111] In some embodiments, memory 152 may include instructions 153 (e.g., program logic) that may be executed by processor 151 to perform various functions of vehicle 100. Memory 152 may also include additional instructions, including instructions used to send data to, receive data from, interact with, and / or control one or more of infotainment system 110, sensing system 120, decision control system 130, and drive system 140.

[0112] In addition to instructions 153, memory 152 may further store data, such as road maps, route information, position, direction, speed, and other vehicle data, and other information for the vehicle. This information may be used by vehicle 100 and computing platform 150 during operation of vehicle 100 in autonomous, semi-autonomous, and / or manual modes.

[0113] Computing platform 150 may control functions of vehicle 100 based on inputs received from various subsystems (e.g., drive system 140, sensing system 120, and decision control system 130). For example, computing platform 150 may utilize inputs from decision control system 130 to control steering system 133 and avoid obstacles detected by sensing system 120. In some embodiments, computing platform 150 may operate to provide control over many aspects of vehicle 100 and its subsystems.

[0114] Optionally, one or more of the aforementioned components may be mounted separately from or associated with vehicle 100. For example, memory 152 may be partially or completely present or separate from vehicle 100. The aforementioned components may be communicatively coupled in a wired and / or wireless manner.

[0115] Optionally, the above components are only examples. During practical application, the components in the above modules can be added or removed based on practical requirements. Figure 1 should not be construed as a limitation on this embodiment of the present application.

[0116] Optionally, vehicle 100 may be configured to be in a fully or partially autonomous driving mode. For example, vehicle 100 acquires surrounding environment information of vehicle 100 by using sensing system 120, acquires an autonomous driving policy based on an analysis of the surrounding environment information, and implements fully autonomous driving, or presents the analysis result to a user, and implements partially autonomous driving.

[0117] An autonomous vehicle traveling on a road, such as vehicle 100, may identify an object in the autonomous vehicle's surrounding environment and determine to adjust its current speed. The object may be another vehicle, a traffic control device, or another type of object. In some examples, each identified object may be considered independently, and based on characteristics of each object, such as the object's current speed, the object's acceleration, and the spacing between the object and the vehicle, may be used to determine the speed to be adjusted by the autonomous vehicle.

[0118] Optionally, the vehicle 100 or a sensing and computing device associated with the vehicle 100 (e.g., computing system 131 or computing platform 150) may predict the behavior of the identified object based on the characteristics of the identified object and the state of the surrounding environment (e.g., traffic, rain, and ice on the road). Optionally, all identified objects depend on each other's behavior, and therefore, all identified objects may be considered together to predict the behavior of a single identified object. The vehicle 100 may adjust the speed of the vehicle 100 based on the predicted behavior of the identified object. In other words, the autonomous vehicle may determine the state (e.g., accelerate, decelerate, stop) to which the vehicle should be adjusted based on the predicted behavior of the object. In this process, other factors, such as the horizontal position of the vehicle 100 on the road on which the vehicle travels, the curvature of the road, and the proximity between static and dynamic objects, may also be considered to determine the speed of the vehicle 100.

[0119] In addition to providing instructions to adjust the speed of the autonomous vehicle, the computing device may provide instructions to modify the steering angle of vehicle 100 so that the autonomous vehicle can follow a given trajectory and / or maintain a safe horizontal and vertical distance from objects near the autonomous vehicle (e.g., cars in adjacent lanes of the road).

[0120] Vehicle 100 may be a car, truck, motorcycle, bus, boat, airplane, helicopter, lawn mower, recreational vehicle, play vehicle, construction equipment, wheelbarrow, golf cart, train, etc. This is not a limitation of the embodiments of the present application.

[0121] The display method, the display device and the steering wheel provided in this application may be applied to the vehicle shown in Fig. 1. The vehicle 100 may be a vehicle including a cockpit shown in Fig. 2. It should be noted that the steering wheel provided in this application may be applied to a left-hand drive vehicle or a right-hand drive vehicle. The type of the vehicle is not limited in the embodiment of this application.

[0122] The following describes the architecture of the steering wheel control system provided in the embodiment of the present application.

[0123] FIG. 3-a is a diagram of an architecture of a communication connection between a touch display unit of a steering wheel and a vehicle according to an embodiment of the present application. In a possible implementation, as shown in FIG. 3-a, the steering wheel provided in this embodiment of the present application may include at least one touch display unit, for example, touch display unit 1 and touch display unit 2. In addition, the touch display unit 1 and touch display unit 2 are connected to an intelligent digital vehicle platform (iDVP) through a hardware interface on the steering wheel to control another system by using the intelligent digital vehicle platform iDVP. The intelligent digital vehicle platform can provide software interfaces and data of various vehicle functions, provide developers with a more flexible function development environment, and help developers implement more complex and diverse function development. For example, the steering wheel provided in this embodiment of the present application may control multiple systems, such as an infotainment system, an air conditioning system, and a power system. In addition, the steering wheel provided in this embodiment of the present application may further control each system of the vehicle by using a terminal device. In the embodiment shown in FIG. 3-a, the stability of signal transmission can be ensured through the hardware interface connection, and external interference can be reduced.

[0124] FIG. 3-b is another architecture diagram of the communication connection between the touch display unit of the steering wheel and the vehicle according to an embodiment of the present application. In a possible implementation, as shown in FIG. 3-b, the steering wheel provided in this embodiment of the present application may include a touch display unit 1. The touch display unit 1 is connected to the intelligent digital vehicle platform iDVP via a wireless connection, and the intelligent digital vehicle platform controls another system. In another possible implementation, as shown in FIG. 3-b, the steering wheel provided in this embodiment of the present application may further include a terminal device. The terminal device may establish a communication connection to another system of the vehicle in a wireless manner and control the other system of the vehicle. For example, the terminal device may control multiple systems, such as the infotainment system, air conditioning, and power system of the vehicle. As another example, the terminal device may customize various systems of the vehicle.

[0125] In the implementation form shown in FIG. 3-b, in order to improve the waterproof level of the touch display unit or another terminal device, reduce the impact of dust, liquid, etc. on the touch display unit and the steering wheel, and help reduce the hardware interface, the touch display unit or the terminal device establishes a communication connection with another system of the vehicle in a wireless manner.

[0126] The handle, the display method, the display device, and the vehicle provided in the present application will be described in detail below.

[0127] The embodiment of the present application provides a handle system to provide a better control experience and a better display effect. Figure 4-a shows a handle 400 according to the present application, and Figure 4-d shows another handle 410 according to the present application.

[0128] FIG. 4-a is a schematic diagram of a steering wheel 400 according to an embodiment of the present application. As shown in FIG. 4-a, the steering wheel 400 includes a steering wheel body 401 and a display unit 402 with a touch control function. A user can control a vehicle by operating the display unit 402. The display unit 402 with a touch control function is also referred to as a display unit 402 or a touch display unit 402 in the specification of the present application. In FIG. 4-a, there are two touch display units 402 on the steering wheel 400, which are located on the left and right sides of the steering wheel body 401, respectively.

[0129] It should be noted that the present application does not limit the number of touch display units on the handle body 401. In a possible implementation, the handle body 401 may include only one touch display unit 402. In another possible implementation, the handle body 401 may include at least two touch display units.

[0130] In the embodiment provided in the present application, as shown in FIG. 4-a, the handle body 401 may further include a handle shaft portion or central portion 401(a), a handle rim 401(b), and handle spokes 401(c).

[0131] It should be noted that the handle rim 401(b) may cover the entire circumference or a portion of the circumference. Alternatively, from another perspective, the projection of the shape of the handle rim 401(b) onto the surface of rotation of the handle may be a standard circle, an ellipse or another variation of an unusual shape. The shape of the handle rim 401(b) is not limited in this embodiment of the present application.

[0132] In a possible implementation, as shown in Fig. 4-a, the handle 400 further includes a snap-fit ​​switch 403. The snap-fit ​​switch 403 can be a physical button, for example, the snap-fit ​​switch is connected to a snap-fit ​​through a mechanical structure. When the snap-fit ​​switch 403 is pressed, the touch display unit 402 can be detached from the handle body 401.

[0133] In addition, in another possible implementation form, the snap-fit ​​switch 403 may be a virtual button, and the snap-fit ​​between the touch display unit 402 and the handle is controlled by an electronic device. The virtual button may control an execution unit to release the lock state of the snap-fit ​​so that the touch display unit 402 is detached from the handle body 401. The execution unit may be a micromotor, or the execution unit may be a microactuator. The specific execution unit is not limited in this embodiment of the present application.

[0134] In a possible implementation, as shown in Fig. 4-a, the steering wheel 400 may further include a fingerprint recognition module 404. The fingerprint recognition module 404 may be configured to recognize an identity and may be configured to implement functions such as one-tap starting the vehicle after successful recognition of the user identity.

[0135] In a possible implementation, the steering wheel 400 may further include an image recognition unit (not shown in FIG. 4-a). For example, the image recognition unit may be disposed on a panel in the center portion 401(a) of the steering wheel. The image recognition module may be configured to recognize an identity or to monitor the state of an occupant. For example, the image recognition unit may be used in a driver monitoring system. If it is detected that the driver is not concentrating or has a tendency to fall asleep, the vehicle will generate a sound alarm, a vibration alarm, or a light alarm to prompt the driver to improve his / her attention. This improves driving safety.

[0136] In a possible implementation, the handle 400 may further include a lighting unit (not shown in FIG. 4-a). For example, the lighting unit may be disposed in the central portion 401(a) of the handle body 401, the lighting unit may be a light strip disposed in the handle rim portion 401(b), or the lighting unit may be a light strip disposed in the handle rim portion 401(c). unit may be light strips disposed on the steering wheel spokes 401(c).

[0137] In a possible implementation, as shown in FIG. 4-a, the central part 401(a) of the steering wheel further includes an airbag to ensure the life safety of the occupant during a vehicle collision. In another possible implementation, the airbag is disposed outside the steering wheel body 401. When a vehicle collision occurs and the airbag protection needs to be triggered, the airbag extends from the gap between the steering wheel rim 401(b) and the central part 401(a) of the steering wheel, and then inflates to envelop and protect the occupant. This improves the collision safety.

[0138] In a possible implementation, as shown in Fig. 4-a, the center portion 401(a) of the steering wheel may further include a horn switch (not shown in Fig. 4-a). When the horn switch is pressed, the vehicle's horn emits a sound signal to the outside to attract the attention of pedestrians, vehicles, or other traffic participants.

[0139] Fig. 4-b is a schematic diagram of a handle body 401 of a handle 400 according to an embodiment of the present application. As shown in Fig. 4-b, the handle body 401 is provided with a mounting part 405. The touch display unit 402 shown in Fig. 4-a is mounted on the handle body 401 by using the mounting part 405.

[0140] In a possible implementation, as shown in FIG. 4-b, the handle body 401 may include an interface 405(a). The interface 401(a) of the handle body 405 cooperates with the interface 402(a) of the touch display unit 402. The cooperation described herein may be understood as two interfaces being connected to implement an expected function. For example, the interface 405(a) and the interface 402(a) may be connected to implement a function of signal transmission or energy transmission.

[0141] In a possible implementation, as shown in Fig. 4-b, the interface 405(a) can be both a power supply interface and a communication interface. The handle body 401 can supply power to the touch display unit 402 shown in Fig. 4-a through the interface 405(a). In addition, the handle body 401 can also communicate with the touch display unit 402 through the interface 405(a).

[0142] In the present application, when the interface 405(a) is capable of providing both power supply services and communication services, the interface 405(a) may be an iDVP interface as described in the specification of the present application.

[0143] In a possible implementation, as shown in Fig. 4-b, the mounting portion 405 may include an interface 405(a). The interface 405(a) may be a power supply interface, and the handle body 401 may supply power to the touch display unit 402 shown in Fig. 4-a through the interface 405(a). The touch display unit 402 may communicate with another device in the vehicle in a wireless manner, for example, may establish a communication connection to a vehicle cockpit domain controller via Bluetooth, near field communication (NFC), or Wi-Fi.

[0144] It should be noted that the interface 405(a) shown in FIG. 4-b may use another alternative solution. For example, the contact power supply may be replaced by a wireless power supply, and the hardware communication interface may also be replaced by a wireless communication interface. In addition, it should be noted that in this application, the location of the interface 405(a) is not limited, and the type and form of the interface 405(a) are not limited. For example, the interface 405(a) may be located at the geometric center of the mounting portion 405. As another example, the interface 405(a) may be a USB Type-C interface. As another example, the interface 405(a) may alternatively be another type of interface.

[0145] In a possible implementation, as shown in FIG. 4-b, the mounting portion 405 may include a magnetic attraction positioning portion 405(b). The magnetic attraction positioning portion 405(b) may provide magnetic attraction positioning assistance to the touch display unit 402 in the process of mounting the touch display unit 402 to the handle body 401. On the one hand, it is convenient for the touch display unit 402 to be aligned with the mounting portion 405 to improve mounting efficiency. On the other hand, when the touch display unit 402 is mounted on the handle body 401, a magnetic attraction force is provided to increase the interaction force between the surface of the touch display unit 402 and the surface of the mounting portion 405, which increases the friction force of the contact surface, reduces the possibility of the touch display unit 402 falling off from the handle body 401, and helps to improve the reliability of mounting the touch display unit 402 to the handle body 401.

[0146] Please note that "magnetically fixed", "magnetic attraction positioning", and "magnetic attraction" in this application may be understood as a method of fixing or positioning by using the magnetic attraction force of a permanent magnet. "Magnetic attraction positioning part", "magnetic attraction unit", etc. in this application may be understood as a part or unit that has a permanent magnet or can be attracted by a permanent magnet.

[0147] In a possible implementation, as shown in FIG. 4-b, the mounting portion 405 may further include a snap-fit ​​portion 405(c). The snap-fit ​​portion 405(c) cooperates with the snap-fit ​​portion 402(c) of the touch display unit 402. It should be noted that the snap-fit ​​portion 405(c) may lock the touch display unit 402 when the touch display unit 402 is mounted on the handle body 401. This can prevent the touch display unit 402 from falling off from the handle body 401, and can improve the mounting reliability. When a vehicle collision occurs, the snap-fit ​​portion 405(c) can greatly reduce the risk of injury to the occupant caused by the touch display unit 402 falling off and flying off. This can ensure the collision safety of the vehicle.

[0148] As shown in FIG. 4-b, the handle body 401 further includes a snap-fit ​​switch 403. In a possible implementation, when the snap-fit ​​switch 403 is pressed, the touch display unit 402 can be removed from the handle body 401. When the touch unit 402 is attached to the handle 401, the snap-fit ​​portion 405(c) and the snap-fit ​​portion 402(c) are automatically locked. In addition, in another possible implementation, the snap-fit ​​switch 403 can be a virtual button, and the snap-fit ​​between the touch display unit 402 and the handle is controlled by an electronic device. The virtual button can control an execution unit to release the lock state of the snap-fit ​​so that the touch display unit 402 is removed from the handle body 401. The execution unit can be a micromotor, or the execution unit can be a microactuator. The specific execution unit is not limited in this application.

[0149] Figure 4-c shows a touch display unit 402 according to an embodiment of the present application. The touch display unit can be attached to the handle body 401 shown in Figure 4-b.

[0150] In a possible implementation, as shown in Fig. 4-c, the touch display unit 402 may include an interface 402(a). The interface 402(a) of the touch display unit 402 cooperates with the interface 401(a) of the handle body 405. "Cooperation" in this specification refers to the description in other embodiments of the present application.

[0151] It should be noted that the interface in this application may be a power supply interface or a communication interface, or an interface that can supply power and perform communication. The interface may be implemented in a wireless or wired manner.

[0152] In a possible implementation, as shown in Fig. 4-c, the interface 402(a) can be both a power supply interface and a communication interface. The touch display unit 402 can be powered by the handle body 401 through the interface 402(a). In addition, the touch display unit 402 can communicate with the handle body 401 through the interface 402(a).

[0153] In the present application, when the interface 402(a) can provide both power supply services and communication services, the interface 402(a) can be an iDVP interface.

[0154] In addition, it should be noted that the location of the interface 402(a) is not limited in the present application, and the type and form of the interface 402(a) are not limited. For example, the interface 402(a) may be located at the geometric center of the touch display unit 402. As another example, the interface 402(a) may be a USB Type-C interface. As another example, the interface 402(a) may alternatively be another type of interface.

[0155] In another possible implementation, as shown in FIG. 4-c, the touch display unit 402 may include an interface 402(a). The interface 402(a) may be a power supply interface, and the handle body 401 may supply power to the touch display unit 402 shown in FIG. 4-c through the interface 402(a). The touch display unit 402 may communicate with another device in the vehicle in a wireless manner, for example, may establish a communication connection to a vehicle cockpit domain controller via Bluetooth, near field communication (NFC), or Wi-Fi.

[0156] In a possible implementation, as shown in FIG. 4-c, the touch display unit 402 may include a magnetic attraction positioning portion 402(b). The magnetic attraction positioning portion 402(b) may provide magnetic attraction positioning assistance to the touch display unit 402 in the process of attaching the touch display unit 402 to the handle body 401. On the one hand, it is convenient for the touch display unit 402 to be aligned with the mounting portion 405 to improve the attachment efficiency. On the other hand, when the touch display unit 402 is attached to the handle body 401, a magnetic attraction force is provided to increase the interaction force between the surface of the touch display unit 402 and the surface of the mounting portion 405, which increases the friction force of the contact surface, reduces the possibility of the touch display unit 402 falling off from the handle body 401, and helps to improve the reliability of attaching the touch display unit 402 to the handle body 401.

[0157] In a possible implementation, as shown in FIG. 4-c, the touch display unit 402 may further include a snap-fit ​​portion 402(c). The snap-fit ​​portion 402(c) cooperates with the snap-fit ​​portion 405(c) of the handle body 401. As shown in FIG. 4-b, the handle body 401 further includes a snap-fit ​​switch 403. In a possible implementation, when the snap-fit ​​switch 403 is pressed, the touch display unit 402 may be removed from the handle body 401. When the touch unit 402 is attached to the handle 401, the snap-fit ​​portion 405(c) and the snap-fit ​​portion 402(c) are automatically locked.

[0158] It should be noted that the snap-fit ​​portion 402(c) can lock the touch display unit 402 when the touch display unit 402 is attached to the handle body 401. This can prevent the touch display unit 402 from falling off the handle body 401, and can improve the attachment reliability. When a vehicle collision occurs, the snap-fit ​​portion 402(c) can greatly reduce the risk of injury to the occupants caused by the touch display unit 402 falling off and flying away. This can ensure the collision safety of the vehicle.

[0159] The embodiment of the present application further provides a handle 410. In Fig. 4-d and Fig. 4-e, the handle body 411 and the touch display unit 412 of the handle 410 are shown, respectively. Another configuration of the handle 410 may be similar to that of the handle 400. Details are not described again here. The difference between the handle 410 provided in this embodiment of the present application and the handle 400 provided in embodiment 1 is that in the handle 410, a wireless power supply and wireless communication solution can be used between the touch display unit 412 and the handle body 411.

[0160] FIG. 4-d shows a handle body 411 according to an embodiment of the present application. As shown in FIG. 4-d, the handle body 411 may further include a handle shaft portion or center portion 411(a), a handle rim 411(b), and a handle spoke 411(c). In addition, the handle body 411 may also include one or more of a snap-fit ​​switch 413, a fingerprint recognition module 414, an image recognition module, a light-emitting module, an airbag, a horn switch, and the like. The function or configuration of the handle body 411 may be the same as the function or configuration described in one or more implementations of the handle body 401.

[0161] In a possible implementation, as shown in FIG. 4-d, the wireless charging transmitting end 415(d) is disposed at the mounting portion 415 of the handle body 411 as shown by the dashed line. The wireless charging cable transmitting end 415(d) of the handle body 411 cooperates with the wireless charging receiving end 412(d) of the touch display unit 412. The handle body 411 can wirelessly supply power to the touch display unit 412 through the wireless charging transmitting end 415(d) and the wireless charging receiving end 412(d) of the touch display unit 412.

[0162] In a possible implementation, the touch display unit 412 may communicate wirelessly with other devices in the vehicle, for example, establishing a communication connection to a vehicle cockpit domain controller via Bluetooth or Wi-Fi.

[0163] In a possible implementation, as shown in FIG. 4-d, the mounting part 415 of the handle body 411 may include a magnetic attraction positioning part 415(b). The magnetic attraction positioning part 415(b) may provide magnetic attraction positioning assistance to the touch display unit 412 in the process of mounting the touch display unit 412 to the handle body 411. On the one hand, it is convenient for the touch display unit 412 to be aligned with the mounting part 415 to improve mounting efficiency. On the other hand, when the touch display unit 412 is mounted on the handle body 411, a magnetic attraction force is provided to increase the interaction force between the surface of the touch display unit 412 and the surface of the mounting part 415, which increases the friction force of the contact surface, reduces the possibility of the touch display unit 412 falling off from the handle body 411, and helps improve the reliability of mounting the touch display unit 412 to the handle body 411.

[0164] In a possible implementation, as shown in FIG. 4-d, the mounting portion 415 may further include a snap-fit ​​portion 415(c). The snap-fit ​​portion 415(c) cooperates with the snap-fit ​​portion 412(c) of the touch display unit 412. As shown in FIG. 4-d, the handle body 411 further includes a snap-fit ​​switch 413. In a possible implementation, when the snap-fit ​​switch 413 is pressed, the touch display unit 412 may be detached from the handle body 411. When the touch unit 412 is attached to the handle 411, the snap-fit ​​portion 415(c) and the snap-fit ​​portion 412(c) are automatically locked.

[0165] It should be noted that the snap-fit ​​portion 415(c) can lock the touch display unit 412 when the touch display unit 412 is attached to the handle body 411. This can prevent the touch display unit 412 from falling off from the handle body 411, and can improve the attachment reliability. When a vehicle collision occurs, the snap-fit ​​portion 415(c) can greatly reduce the risk of injury to the occupants caused by the touch display unit 412 falling off and flying away. This can ensure the collision safety of the vehicle.

[0166] FIG. 4-e shows another touch display unit 412 according to an embodiment of the present application. As shown in the dashed line portion of FIG. 4-e, a wireless charging receiving end 412(d) may be disposed in the touch display unit 412. The wireless charging receiving end 412(d) may receive energy transferred by the wireless charging transmitting end 415(d) in the handle body 411 to power the touch display unit 412. In addition, the touch display unit 412 may establish a wireless connection with another device of the vehicle. For example, the touch display unit 412 may be connected to a cockpit domain controller via Bluetooth or Wi-Fi.

[0167] In a possible implementation, as shown in FIG. 4-e, the touch display unit 402 may include a magnetic attraction positioning portion 412(b). The magnetic attraction positioning portion 412(b) may provide magnetic attraction positioning assistance to the touch display unit 412 in the process of attaching the touch display unit 412 to the handle body 411. On the one hand, it is convenient for the touch display unit 412 to be aligned with the mounting portion 415 to improve the attachment efficiency. On the other hand, when the touch display unit 412 is attached to the handle body 411, a magnetic attraction force is provided to increase the interaction force between the surface of the touch display unit 412 and the surface of the mounting portion 415, which increases the friction force of the contact surface, reduces the possibility of the touch display unit 412 falling off from the handle body 411, and helps to improve the reliability of attaching the touch display unit 412 to the handle body 411.

[0168] In a possible implementation, as shown in FIG. 4-e, the touch display unit 412 may further include a snap-fit ​​portion 412(c). The snap-fit ​​portion 412(c) cooperates with the snap-fit ​​portion 411(c) of the handle body 415. As shown in FIG. 4-d, the handle body 411 further includes a snap-fit ​​switch 413. In a possible implementation, when the snap-fit ​​switch 413 is pressed, the touch display unit 412 may be removed from the handle body 411. When the touch unit 412 is attached to the handle 411, the snap-fit ​​portion 415(c) and the snap-fit ​​portion 412(c) are automatically locked.

[0169] It should be noted that the snap-fit ​​portion 412(c) can lock the touch display unit 412 when the touch display unit 412 is attached to the handle body 411. This can prevent the touch display unit 412 from falling off from the handle body 411, and can improve the attachment reliability. When a vehicle collision occurs, the snap-fit ​​portion 412(c) can greatly reduce the risk of injury to the occupant caused by the touch display unit 412 falling off and flying away. This can ensure the collision safety of the vehicle.

[0170] It should be noted that the touch display unit (402, 412) may use wireless power supply. The advantages of using a wireless power supply method include helping to improve the waterproof ability of the handle body (401, 411) and the touch display unit (402, 412), and reducing the impact of dust, liquid, etc. on communication and power supply.

[0171] Additionally, when a coil is used to implement wireless charging, wireless charging and NFC may share the coil in a time-shared manner, a frequency-shared manner, etc.

[0172] In another possible implementation, the mobile phone handset may be attached directly to the handle by suction.

[0173] In a possible implementation, the iDVP interface provided in the present application may support hot swapping of devices. According to the iDVP interface provided in the present application, in some embodiments, the touch display unit (402, 412) can be plug-and-play and can be quickly attached by suction by fully using the magnetic suction part. In addition, the touch display unit (402, 412) can be securely connected to the handle body (401, 411) by using the snap-fit ​​part. The handle provided in this embodiment of the present application allows users to conveniently replace and upgrade the touch display unit in the handle. Since the hot swap installation mode is very simple and user-friendly, users can purchase a new touch display unit and manually replace the touch display unit. The hardware upgrade can be completed by the user. Users do not need to send the vehicle to a specific service point for a professional to replace the touch display unit. By users replacing more advanced touch display units, users can have more personalized choices, the hardware of the vehicle's handle can be continuously updated, and the user experience can also be continuously optimized.

[0174] The steering wheel provided in this embodiment of the present application may include one or more touch display units, which may establish a communication connection with another system of the vehicle, obtain data of the other system, and control the other system based on the user's operation.

[0175] In conclusion, the steering wheel with a display unit provided in this embodiment of the present application includes one or more displays with touch control functions. The display unit can provide a shortcut operation interface of vehicle functions, and the operation interface is customized by the user. In addition, the interface of the steering wheel provided in some embodiments of the present application supports hot swapping and plug-and-play. In some embodiments, the touch display unit can be attached to the steering wheel by using magnetic attraction and snap-fit ​​parts to facilitate installation and replacement. In addition, the touch display unit can have multiple different hardware configurations. For example, the touch display unit can include a standard configuration version and an advanced configuration version, so that the user can easily upgrade the hardware or obtain more functions through network upgrade.

[0176] In addition, the steering wheel provided in this embodiment of the present application may further provide a scenario memory function and adaptive switching function of the operation interface, and may automatically display the most appropriate operation interface based on vehicle state information, environmental information, scenario, and user identity information.

[0177] Above, some handles provided in the present application have been described. The following describes in detail the operation interface of the handles provided in this embodiment of the present application.

[0178] In a possible implementation, the touch display unit (402, 412) provided in this embodiment of the present application can use modular design and adjust hardware parameters and software versions based on requirements such as vehicle model positioning, user preferences, and manufacturer customization. For example, an automobile manufacturer can select standard function modules or advanced function modules. In addition, the touch display unit provided in this embodiment of the present application supports remote upgrade to unlock more functions continuously. This brings users a common new driving experience.

[0179] The steering wheel (400, 410) provided in this embodiment of the present application can implement multiple control functions by using the touch display units (402, 412). For example, the steering wheel (400, 410) provided in this embodiment of the present application can implement functions such as music control, call answering, gear control, scenario mode switching, air conditioner control, and vehicle setting customization.

[0180] The handle provided in this embodiment of the present application has multiple display modes. The specification of the present application provides examples of multiple different display modes, which are shown in Figures 5-a to 5-f, respectively.

[0181] FIG. 5-a is a display mode of a touch display unit of a steering wheel according to an embodiment of the present application. In a possible implementation, as shown in FIG. 5-a, the steering wheel provided in this embodiment of the present application may include a first touch display unit and a second touch display unit. The first touch display unit may be configured to display a vehicle gear state. As shown in the left display unit of FIG. 5-a, the first touch display unit may include reverse gear (R), neutral gear (N), drive gear (D), and parking gear (P). The second touch display unit is configured to display a current driving speed and gear. As shown in the right display unit of FIG. 5-a, the second touch display unit indicates that the current speed is 80km / h and the current gear is gear 2. Optionally, the first touch display unit may further display an autonomous driving state switching button. When a user presses the autonomous driving button and the autonomous driving system or driving assistance system of the vehicle determines that the vehicle meets the requirements for autonomous driving or assisted driving, the autonomous driving mode or driving assistance mode is enabled.

[0182] In this way, the user can control the gear and vehicle speed more easily and enter the autonomous driving mode more quickly. The steering wheel provided in the present application can greatly improve the user's operation efficiency, reduce the time the user spends searching for menus, and bring about a better driving experience.

[0183] FIG. 5-b is a display mode of the touch display unit of the steering wheel according to one embodiment of the present application. In a possible implementation, as shown in FIG. 5-b, the steering wheel provided in this embodiment of the present application may include a first touch display unit and a second touch display unit. The first touch display unit may be configured to display call information and contact information. The second touch displayThe unit can display music album information, song information, singer information, volume information, etc. The user can control answering and hanging up calls by using the touch display unit. In addition, the user can control playing, pausing, and switching music, and control the music volume.

[0184] FIG. 5-c is a display mode of the touch display unit of the steering wheel according to an embodiment of the present application. In a possible implementation form, as shown in FIG. 5-c, the steering wheel provided in this embodiment of the present application may include a first touch display unit and a second touch display unit. The first touch display unit may be configured to display the temperature information and the air conditioner wind speed information of the vehicle. The second touch display unit may be configured to display the air conditioner operation mode and the ventilation mode. For example, the air conditioner operation mode may be cooling, ventilation, or heating, and the ventilation mode may be external circulation and internal circulation. A user may adjust the air conditioning by using the touch display unit provided in this embodiment of the present application. For example, a user may tap the "ventilation" button to switch the operation mode of the air conditioning from "cooling" to "ventilation". In addition, a user may tap "temperature" to adjust the set temperature of the air conditioner, for example, from "23°C" to "26°C". In addition, a user may tap "air volume" to adjust the air supply level of the air conditioner, for example, from level "04" to level "03".

[0185] Fig. 5-d is a display mode of the touch display unit of the steering wheel according to an embodiment of the present application. In a possible implementation, as shown in Fig. 5-d, the first touch display unit or the second touch display unit may display construction information of the road ahead or accident information of the road ahead. According to the steering wheel and display method provided in the embodiment of the present application, when the sensor of the steering wheel senses or obtains information about the road conditions ahead through the Internet of Vehicles, the display unit can notify the user, and the touch display unit of the steering wheel provides the user with warnings and driving prompts to help the user effectively avoid traffic jams, and improve the user's driving safety and driving experience.

[0186] Fig. 5-e is a display mode of the touch display unit of the steering wheel according to one embodiment of the present application. In a possible implementation, as shown in Fig. 5-e, the first touch display unit or the second touch display unit can display identity verification status and vehicle scenario mode. For example, as shown in Fig. 5-e, the first touch display unit can display user identity verification information, and when user identity verification is successful, a prompt indicating that identity verification is successful is sent to the user.

[0187] The second touch display unit shown in FIG. 5-e may further display scenario information, for example, a concert hall mode. In the concert hall mode, the user may enjoy a high-quality audio feast. The vehicle may adaptively enable active noise reduction and provide the user with a multimedia control operation interface shown in FIG. 5-b, allowing the user to adjust parameters such as volume and sound quality. In addition, the scenario information may be further bound to user account information or user identity information. For example, if the user's identity verification is successful, a pre-set concert hall scenario operation interface may be automatically displayed, or an operation interface more suitable for the current usage request may be displayed based on the vehicle state information and / or environmental information. For example, based on the vehicle state information and / or environmental information, when it is identified that the current vehicle is in a highway scenario, vehicle gear information or vehicle speed information may be displayed, facilitating the user to control the vehicle speed and gear. Please note that for the description of "scenario" in this specification, please refer to the description in other parts of this specification of the present application.

[0188] FIG. 5-f is a display mode of the touch display unit of the steering wheel according to one embodiment of the present application. In a possible implementation, as shown in FIG. 5-f, the first touch display unit or the second touch display unit may display the user's data storage and synchronization status information. For example, if a user wants to synchronize vehicle data to the cloud, the user may select data out migration and select a mode in which data is stored in the cloud, so that the second touch display unit may display the data synchronization operation interface shown in FIG. 5-f. As another example, the user may further select to synchronize some data, for example, the user's chat data, multimedia data, and photo data. In a possible implementation, the user may further select to synchronize the account data, for example, the data of user A, or the data of user B.

[0189] It should be noted that the touch display unit provided in this embodiment of the present application may further provide more abundant customized settings to always maintain the optimal user experience. For example, functions such as touch button customization, common function customization, touch picture customization, touch widget customization, and touch scenario customization may be implemented, so that the user can obtain the optimal driving experience in various different scenarios. The handle provided in this embodiment of the present application can effectively simplify the interaction interface, improve the interaction efficiency, reduce physical components, and reduce costs. The operation interfaces provided in the above-mentioned embodiments are merely some embodiments, not all embodiments, and should not be construed as limitations on the present application.

[0190] When the vehicle includes multiple touch screens, different operation interfaces can be displayed on different touch screens respectively. As shown in FIG. 5-a, when the steering wheel has a first touch screen and a second touch screen, the operation interface displayed on the first touch screen can include gear status information, a gear switching button, an automatic parking activation button, and an autonomous driving / assisted driving activation button. The operation interface displayed on the second touch screen can include speed information, a speed control button, a D (drive) gear information, and a gear control button. In this way, the user can obtain more vehicle status information by using two different touch display units.

[0191] In addition, it should be noted that the aforementioned operation interface or related information may be displayed on the touch display unit of the steering wheel. In a possible implementation, the operation interface displayed on the steering wheel may be switched to another display or displayed in another display manner. In a possible implementation, an operation method for switching the display interface by a user may include the following steps: obtaining a user command, the command instructing to switch a display mode; Obtaining target display scheme and / or target display unit information according to a user command; and Displaying the relevant information in a target display manner by using a target display unit.

[0192] The target display unit may take several forms. For example, the relevant information may be displayed by using a separate display, a head-up display (HUD) or an augmented reality display. HUD The image may be displayed via an augmented reality HUD (AR-HUD) or by using AR glasses. The display method may include a screen display, a projection display, a holographic display, etc. In addition, the display method may further include setting information such as brightness, picture position, picture rotation angle, picture color, resolution, and contrast, and may be adjusted based on user setting information or based on scenario information. The display unit may include a HUD, an AR-HUD, AR glasses, a display, a holographic display device, etc.

[0193] In addition, the user's command to switch the display picture can be implemented in such manners as voice, air gesture, slide operation gesture on the screen, or touch operation on the screen. For example, the user may select an operation interface by using a specific operation, or some information is displayed on the display or displayed via the HUD / AR-HUD. For example, the user may perform an upward slide gesture operation on the current operation interface, so that the information of the current touch screen is displayed in front of the user via the HUD / AR-HUD. Alternatively, the user may perform a "grab" gesture operation with the hand in the air, so that the information of the current touch screen is displayed by using the AR glasses.

[0194] The adjustment of the picture rotation angle in the enlargement method will be described below.

[0195] In a possible implementation, when the steering wheel is rotated during manual driving or when the system controls the steering wheel to rotate during autonomous driving / assisted driving, the steering wheel generates an angular displacement. When the steering wheel rotates and an angular displacement occurs, the operation interface on the touch screen also rotates by a corresponding angle together with the steering wheel. This causes inconvenience to user operation. In this case, the operation interface can be adjusted based on the steering wheel angle to ensure that the operation interface on the steering wheel can be conveniently controlled at any angle and time.

[0196] In a possible implementation, the operation interface may be adjusted based on a steering wheel angle. The adjustment method may include obtaining a steering wheel angle and displaying an operation interface based on the steering wheel angle.

[0197] In a possible implementation, the operation interface may be adjusted based on the user's gaze direction. The adjustment method may include obtaining the user's gaze direction and displaying the operation interface based on the user's gaze direction and the steering wheel angle. The user's gaze direction may be the direction of the horizontal line of the user's eyes, or the user's reading direction may be determined through image recognition. When the user adjusts the gaze direction, for example, when the user turns to the steering wheel and tilts his head clockwise 90°, the operation interface on the touch screen may also be synchronized with the user, and the picture is rotated clockwise 90°. In this way, the user can accurately identify the operation interface of the touch screen in different gaze directions. This reduces the probability of erroneous operation and brings the user a better operation experience.

[0198] Above, the operation interface provided in the embodiment of the present application has been described. The touch screen (402, 412) provided in the embodiment of the present application can display the operation interface and receive the user's operation command. The user can control the vehicle and / or the in-vehicle device by performing operations on the touch screen (402, 412). The following describes the operation interface display method provided in the embodiment of the present application.

[0199] In a possible implementation form, as shown in FIG. 6, the display method provided in this embodiment of the present application may include the following steps:

[0200] S110: Status information is acquired.

[0201] S120: A scenario is obtained based on the state information.

[0202] S130: Obtain an operation interface that matches the scenario.

[0203] S140: Display an operation interface that matches the scenario.

[0204] According to the operation interface display method provided in this embodiment of the present application, a current scenario can be obtained based on the current state information, and a convenient operation interface and an intelligent driving experience can be provided to the user. In the following, the aforementioned scenario, state information, etc. will first be described in detail.

[0205] A "scenario" as described herein in this application may be understood as a combination of specific constraints that need to be met. A "scenario" may be, for example, a specific spatial condition that needs to be met on a highway, a gas station, a home parking lot, or a charging station. A "scenario" may include a highway scenario, a gas station scenario, a home parking lot scenario, a charging scenario, etc. As another example, a "scenario" may be a specific time condition that needs to be met, for example, in a morning peak / evening peak period, a holiday, or an anniversary. A "scenario" may include a commute peak scenario, a holiday scenario, an anniversary scenario, etc. As another example, a "scenario" may be another condition that needs to be met, for example, a scenario of heating in a vehicle in winter, a scenario of audio and video entertainment in a vehicle, a scenario of resting and napping in a vehicle, or a scenario of entering a track after the vehicle has been adjusted to a track racing mode.

[0206] More examples of scenario types may be shown in the table below: Please note that the scenarios in the table below are only used as examples for illustration, and are not intended to limit the protection scope of the present application. [Table 1] TIFF2024541197000027.tif255169 TIFF2024541197000028.tif189170

[0207] The state information described in the specification of this application may be input information that may affect interface switching.

[0208] In a possible implementation, the state information may include environmental information. The environmental information provided in this embodiment of the present application may include at least one of location information, road information, weather information, and accident information. The road information may include at least one of the following:

[0209] (1) Traffic participant information: motorized vehicles, non-motorized vehicles, pedestrians, animals, and special vehicles.

[0210] (2) Road information: road marking information, road indication information, road type information, gradient information, road adhesion coefficient information, obstacle information, exit / entrance information (e.g., highway exit / entrance and elevated road exit / entrance), and road construction and maintenance information.

[0211] (3) Traffic facility information, which may include the location and status of traffic facilities, such as traffic lights, speed bumps, speed test points, cameras, noise detectors, and horn detectors.

[0212] (4) Traffic command information, which may include, for example, signal light instruction information and traffic manager instruction information.

[0213] (5) Infrastructure information: energy refueling point information (e.g., the location, usage status, and billing rates of gas stations, charging stations, battery exchange stations, hydrogen refueling stations, and natural gas stations), parking information, maintenance and repair point information, and emergency rescue point information.

[0214] In addition to the road information, the environmental information may further include weather information, accident information, etc. The weather information may include temperature, humidity, brightness, rainfall, air pollution levels, etc. The accident information may include traffic accident information obtained via Vehicle to Everything (V2X) or may include traffic accident information recognized by a vehicle by using a sensing system.

[0215] In a possible implementation, the status information may include vehicle information.

[0216] It should be noted that the vehicle information provided in this embodiment of the present application indicates the status of the vehicle. For example, the vehicle information may include at least one of driving status information and usage status information.

[0217] The driving condition information may include at least one of the following:

[0218] (1) Driving mode information: The driving modes may be classified based on the degree of involvement of manual driving or autonomous driving. For example, the driving modes may be classified into manual driving, autonomous-assisted driving, and autonomous driving based on the reduction of the degree of manual involvement. The driving modes may also be classified based on the change of vehicle output and / or chassis control parameters, may be classified based on the operation experience, or may be classified based on driving economy, for example, into a conventional driving mode, a comfortable driving mode, an economical driving mode, a sports driving mode, and an off-road driving mode.

[0219] (2) Gear information, which may include, for example, drive gear, neutral gear, reverse gear, and parking gear.

[0220] (3) Sports state information, which may include, for example, vehicle position, attitude, speed, acceleration, yaw angular velocity, and yaw angular acceleration.

[0221] (4) Drive system status information, which may include, for example, drive motor temperature and drive system power.

[0222] (5) Chassis system status information: braking system status, steering system status, and suspension system status.

[0223] (6) Energy system status information, which may include, for example, power battery output power, remaining battery charge, and temperature.

[0224] (7) Lighting system status information, which may include, for example, turn signal status, hazard warning signal status, clearance lamp status, headlamp status, driving light status, fog lamp status, reverse light status, and brake light status.

[0225] (8) Vehicle malfunction information, which may include, for example, drive system malfunction information, braking system malfunction information, and battery system malfunction information.

[0226] The usage status information may include at least one of the following:

[0227] (1) Infotainment system usage, which may include, for example, time information, schedule information, contact information, call status information, screen brightness, and speaker volume.

[0228] (2) Use of comfort devices, which may include, for example, temperature control mode, air circulation mode, seat posture state, seat ventilation and heating system state, and seat massage device state.

[0229] (3) Light and Ambience System Status: Light status, Reading Light status, Ambience Light status, and Odor Control System status.

[0230] (4) Use of other accessories: for example, window state, sunroof state, door state, movable vehicle roof state, wiper state, front trunk state, rear trunk state, and car refrigerator state.

[0231] Those skilled in the art may understand that the above only uses the environmental information and vehicle information as examples, and does not limit this embodiment of the present application.

[0232] In the following, the display method provided in this application will be described in detail with reference to a specific scenario.

[0233] Optionally, in a possible implementation, the state information may include environmental information, and the operation interface may be displayed based on the environmental information. As shown in FIG. 5-a, when it is detected that the vehicle is located in a parking lot based on the environmental information, for example, based on the location information, the vehicle may be identified as being located in a parking lot, or through environmental sensing, when it is identified that the vehicle is located in a parking lot, it is found that the current scenario is a parking scenario in the parking lot. The touch screen may display an operation interface corresponding to the parking scenario, for example, a gear switching interface, so that the user can switch between the drive gear and the reverse gear when parking the vehicle. As shown in FIG. 5-c, when it is detected that the ambient temperature or the interior temperature is excessively high, it is found that the current scenario is a cooling scenario, and the touch screen may display an air conditioning adjustment operation interface to facilitate the user to adjust the interior temperature. As shown in FIG. 5-d, when there is a traffic accident on the road ahead, the touch screen may display an accident report operation interface.

[0234] Optionally, in a possible implementation, the status information may include vehicle information, and an operation interface may be displayed based on the vehicle information. As shown in FIG. 5-a, when it is found that the vehicle is in a driving scenario based on the vehicle information, an operation interface corresponding to the driving scenario may be displayed. For example, when it is detected that the vehicle speed is excessively high, for example, exceeds the speed limit of 60 km / h, the touch screen may display a vehicle speed adjustment interface to help the user quickly set the cruise vehicle speed, the manual driving vehicle speed, the assisted driving vehicle speed, the autonomous driving vehicle speed, etc. As shown in FIG. 5-b, when it is found that the vehicle is in a meeting / call scenario based on the vehicle information, an operation interface corresponding to the meeting / call scenario may be displayed. For example, when the user receives an incoming call or a video call invitation, the touch screen may display an incoming call operation interface or a video call operation interface, so that the user can start a voice call or a video call or disconnect the voice call or video call with one tap. As shown in FIG. 5-d, when it is detected that the braking system in the vehicle is faulty, it is found that the vehicle is currently in a fault scenario, and the display unit displays an operation interface corresponding to the fault scenario. For example, the touch screen may display fault alarm information, and display an emergency rescue interface or an emergency call operation interface to ensure the user's safety.

[0235] Optionally, in a possible implementation, the state information may include environmental information and vehicle information, so that the operation interface is displayed after the vehicle information and the environmental information are taken into consideration jointly.

[0236] For example, in a possible implementation, if it is detected that the gear information is a drive gear, the time information is a morning peak period, e.g., 8:00 to 9:00 in the morning, and the environment information includes a city road, the driving scenario enters an urban commute scenario. In the urban commute scenario, a vehicle speed control interface may be displayed, and a following distance adjustment interface may also be displayed. In the urban commute scenario, the vehicle speed and distance can be adjusted by using the vehicle speed control interface and the following distance adjustment interface to adapt to different road conditions.

[0237] As another example, in a possible implementation, as shown in FIG. 5-a, when it is detected that the current driving mode is manual driving and the current environmental information satisfies the autonomous driving conditions, for example, the vehicle is driving on a road where autonomous driving is possible, the current vehicle self-detection is normal, and the autonomous driving mode activation conditions are also met, the touch screen may display a driving mode setting interface and provide the user with a button to activate the autonomous driving mode, so that the user can activate the autonomous driving mode with one tap.

[0238] As another example, in a possible implementation, as shown in FIG. 5-c, when it is detected that the external ambient temperature is high and the air pollution degree is serious, the touch display unit may display an air conditioner temperature adjustment interface and an air circulation adjustment interface to facilitate the user to set the temperature and air circulation mode. For example, the temperature may be set to 23° C., and the air circulation mode of the cockpit is set to internal circulation, thereby reducing the impact of external air pollution.

[0239] As another example, in a possible implementation, if the environmental information detects that the road ahead is bumpy, the vehicle's suspension state is adjustable, and the chassis height is detected to be low, a suspension height adjustment operation interface may be displayed so that the user can raise the chassis with one tap to reduce the risk of the chassis being hit and damaged.

[0240] As another example, in a possible implementation, when the in-vehicle device is in a call state, a call scenario is entered. In the call scenario, a voice area control operation interface may be displayed so that the user can conveniently adjust the volume of each area in the passenger compartment, thereby reducing the interference to passengers who are resting.

[0241] It should be noted that for each scenario, the operation interface corresponding to the scenario may be an operation interface provided by the system by default, or may be preset by the user. The user may preset the operation interface in each scenario. When there are multiple display devices in one scenario, the operation interface of each display device may be set to the scenario. When the scenario is switched, all display devices may be switched to the preset operation interface.

[0242] According to the control method provided in this embodiment of the present application, the user can be provided with an adaptive operation interface. When the state information changes, the touch screen can adaptively display different operation interfaces. For example, the operation interface display method provided in this embodiment of the present application can implement the following steps: A step of acquiring first state information; a step of acquiring a first scenario based on the first state information; a step of acquiring a first operation interface that matches the first scenario; a step of displaying the first operation interface.

[0243] It should be noted that according to the display method provided in this application, the operation interface can be switched in real time based on the change of the scenario. When the scenario changes, different operation interfaces matching different scenarios can be displayed, providing the user with a more intelligent driving experience and a more efficient operation and control experience.

[0244] When the scenario is switched from the first scenario to a second scenario after the first scenario is acquired, the display method can adapt to the change of the scenario, and an operation interface consistent with the second scenario is displayed. The above steps may be performed repeatedly. For example, the method may include: A step of acquiring second state information; a step of acquiring a second scenario based on the second state information; a step of acquiring a second operation interface corresponding to the second scenario; a step of displaying the second operation interface.

[0245] For example, in a possible implementation, the process of a user driving home from work may involve switching between multiple scenarios.

[0246] Before the user drives into a community parking lot, the vehicle gear information is drive gear, the environment information includes city road, and the scenario is identified as an "urban commute" scenario. In this case, the touch screen may display a vehicle speed control operation interface or a gear control operation interface, so that the user can know about the gear and vehicle speed information, and provide quick control buttons for the user to adjust the vehicle speed and gear.

[0247] Then, when the user drives into a local parking lot and prepares to park, if it is detected that the gear information changes from "drive gear" to "reverse gear" and the environmental information includes the location information of the local parking lot, the scenario information is identified as a parking scenario, and the operation interface is switched to an operation interface that matches the parking scenario, or if it is detected that the environmental information includes parking space information, the scenario can be identified as a "parking scenario". In the parking scenario, the touch screen may display an automatic parking activation operation interface so that the user can activate the automatic parking function with one tap. Alternatively, the touch screen may display surrounding environment information sensed by the vehicle sensor so that the user can control the vehicle to park smoothly. This improves parking safety.

[0248] Subsequently, when the gear information is detected to be parking gear and the environmental information includes that the vehicle is currently located in a home parking lot, the vehicle may enter the "leisure and relaxation scenario". The operation interface may be switched to an operation interface that matches the "leisure and relaxation scenario". In the "leisure and relaxation scenario", the touch screen may display a window control operation interface so that the user can easily open the window for ventilation. This can avoid oxygen shortage in the passenger compartment caused by keeping the window closed for a long time. Alternatively, in the "leisure and relaxation scenario", a temperature adjustment operation interface, an air circulation control operation interface, etc. may be displayed. In the "relaxation and leisure scenario", a seat posture adjustment interface may also be displayed so that the user can adjust the seat posture to an optimal one, for example, half lying, lying flat, or sitting.

[0249] The display method provided in this embodiment of the present application can be applied to the above-mentioned steering wheel. For example, in a possible implementation, the touch display unit (402, 412) provided in the embodiment of the present application can support a scenario adaptation function. For example, the displayed multi-level menu can be intelligently switched based on the scenario in which the vehicle is located, so as to better match the user's driving scenario.

[0250] As another example, in a possible implementation, the touch display units (402, 412) provided in the embodiments of the present application may support a driving mode adaptation function. For example, the displayed multi-level menu may be intelligently switched based on the driving mode of the vehicle to better match the driving condition of the vehicle.

[0251] As another example, in a possible implementation, the handle (400, 410) provided in the embodiment of the present application may have one or more touch display units (402, 412). The number of the touch display units (402, 412) is not limited in the present application. In addition, the touch display units attached to the handle (400, 410) provided in the embodiment of the present application may be specially designed or may be a mobile phone terminal or another touch display device.

[0252] In this way, in the process of switching between different scenarios, the vehicle can provide a target operation interface that matches the scenario, which brings a more intelligent driving experience and a more efficient operation interface to the user.

[0253] As shown in Fig. 7, in a possible implementation, when the second scenario is different from the first scenario, the vehicle may display a second operation interface that is consistent with the second scenario. In Fig. 7, the first operation interface is also called an initial operation interface, and the second scenario is also called a current scenario. Optionally, request information may be sent to a user, and the request information is used to request the user to confirm whether to switch to the second operation interface, and a first user instruction is obtained. The first user instruction indicates whether to switch to the second operation interface.

[0254] (1) If a first user command instructs the user to select to switch to the second operation interface, the second operation interface is displayed. Alternatively, if the user does not make a selection within a first time period, for example, if the user's selection operation is not received within 5 seconds, the user may select to switch to the second operation interface by default. In a possible implementation form, the second operation interface may be displayed first when a scenario changes, and a prompt is sent to the user to inquire whether to return to the initial operation interface. The prompt may be in the form of a picture prompt, a sound prompt, a voice prompt, etc. If the user does not instruct to return to the initial operation interface within a certain time period, the user accepts the switching of the current operation interface by default.

[0255] (2) When the first user command instructs the user to select not to switch to the first operation interface, in a possible implementation, the user can select to return to the first operation interface, and in another possible implementation, the user can select to switch to another operation interface. For example, in a possible implementation, when a scenario is switched from a first scenario to a second scenario, and the user finds that the preset operation interface in the second scenario is inappropriate and wants to change the operation interface, the display method includes the steps of obtaining a second user command, 2 The user instruction further includes a step of instructing to select a third operation interface as the operation interface conforming to the second scenario, where the third operation interface is an operation interface newly selected by the user and conforming to the second scenario.

[0256] It should be noted that the user command in the specification of this application may be an operation command input by a user by performing a touch operation on a touch screen, may be an operation command input by a user by using voice, may be an operation command input by a user by using a physical button, a virtual button, a gesture / posture operation, etc.

[0257] Therefore, according to the control method provided in this embodiment of the present application, a more suitable operation interface may be displayed by using the touch screen in different scenarios, so that the user can control the vehicle more conveniently. The scenarios provided in the embodiment of the present application include a driving scenario, a parking scenario, an energy replenishment scenario, an entertainment scenario, etc. Adjusting the operation interface of the touch screen based on the scenario has multiple advantages. For example, the case where the operation interface of the touch screen is frequently switched due to frequent changes in vehicle information and environmental information, etc., can be alleviated. As another example, during scenario switching, an information prompt of scenario switching can be provided to the user, and a smooth transition can be brought to the user. In addition, more options can be provided to the user, and when the user does not want to switch scenarios, the user can modify the operation interface of the original scenario or another operation interface selected by the user.

[0258] 8, in a possible implementation, the method further includes the steps of acquiring user identity information, and acquiring user setting information based on the user identity information, where the user setting information includes at least one scenario, at least one operation interface, and information about the correspondence between the scenario and the operation interface. The step of acquiring the operation interface corresponding to the scenario in step S130 specifically includes the step of acquiring the operation interface corresponding to the scenario based on the user setting information.

[0259] The user's identity information can be obtained by using an identity recognition unit. The identity recognition can be implemented by fingerprint recognition, face recognition, iris recognition, palm print recognition, voice recognition, etc. This is not limited in this application.

[0260] When a new user uses the vehicle, the user can create a user account and save related user setting information. In a possible implementation, a method for creating a user account may include creating a user account, where the user account is linked to user identity information, and saving the user setting information. If the user wants to change the pre-set operation interface, the user may select an appropriate operation interface by performing an operation on the touch screen.

[0261] It should be noted that the interface displayed by the touch display unit provided in this embodiment of the present application can be adaptively adjusted based on scenario changes or user settings. In a possible implementation, the operation interface can further be displayed based on user identity information. For example, if a user sets his / her preferred operation interface, the operation interface will not be changed even if the vehicle status information or environmental information changes. Alternatively, in a possible implementation, after the user sets a preferred operation interface, the user may be prompted whether to update the current operation interface when the vehicle status information or environmental information changes.

[0262] In a possible implementation, the touch display unit (402, 412) provided in the embodiment of the present application may support a user preference memory function and a user account synchronization function. For example, according to the touch display unit provided in the embodiment of the present application, the settings such as the style, button arrangement, and function menu sequence of the control interface of the touch display unit may be associated with a user account, and the driving settings preferred by different users are switched based on different user identities. In a possible implementation, after identifying the user identity, the touch display unit synchronizes the user's preference settings with the vehicle side, so that different users can switch to the settings familiar to the user at any time.

[0263] Therefore, different users may have different operation interface settings on the same vehicle, or the same user may enjoy the same or similar operation interface settings on different vehicles. The display method provided in the present application can bring about a more personalized driving experience.

[0264] In addition, it should be noted that other information of the user may also affect the display of the operation interface. In a possible implementation, for example, the user setting information may include contact information, user schedule, or memory reminder information. The user's memory reminder may be a reminder set based on a specific time point, for example, a reminder sent to the user when a specific time point arrives. The user's memory reminder may be a reminder set based on geographic location information, for example, a reminder sent to the user when a specific location is reached. In addition, the user's memory reminder may be a reminder set based on a specific trigger event, for example, a reminder sent to the user when an action occurs to get into the vehicle and open the multimedia operation interface, as another example, a reminder sent to the user when the user turns on the air conditioner, plays music, and completes the action of adjusting the seat to a certain angle. In a possible implementation, the trigger event may be selected as follows: the vehicle and any in-vehicle device performs an action, completes an action, or reaches a state. In addition, when the aforementioned reminder is sent, the user may further switch to the reminder operation interface, or switch to another pre-set operation interface. In the present application, a variety of settings are provided to provide users with richer control effects.

[0265] Optionally, as shown in FIG. 9, the display method provided in the present application further includes detecting whether the current operation interface is the same as the preset operation interface. For example, when the second user command (the 2After the user command (instructs to select the third operation interface as the operation interface corresponding to the second scenario) is obtained, if the third operation interface is different from the second operation interface, the user setting information is updated. After the user setting information is updated, the third operation interface is displayed when the second scenario is next switched from another scenario. It should be noted that the second operation interface in this specification is the operation interface corresponding to the second scenario in the user setting information before the user modifies the operation interface corresponding to the second scenario. In addition, optionally, in the first scenario, the user may also select another operation interface as the pre-set operation interface corresponding to the first scenario. The principle is the same as above, and the details will not be described again.

[0266] It should be noted that detecting whether the current operation interface is the same as the preset operation interface does not mean that each pixel of the current picture matches each pixel of the preset picture. This is because the same operation interface may have different states. For example, a virtual button may be turned on and off. In this case, the pictures are different, but the pictures still belong to the same operation interface. If the functions of the two operation interfaces are different, for example, if a function page for controlling the vehicle speed is switched to a function page for controlling the temperature of the air conditioner, in this case, it can be understood that the two operation interfaces are different. Of course, the user may customize the operation interface, and the button for controlling the vehicle speed and the button for controlling the temperature of the air conditioner may be displayed in the same operation interface. In this case, it should be understood that the customized operation interface is not simply the same operation interface as the operation interface for controlling the vehicle speed.

[0267] It should be noted that the first scenario provided in some embodiments of this specification of the present application may be an initial scenario of the vehicle, for example, a scenario after the vehicle is started. The first operation interface corresponding to the first scenario may be an operation interface after the vehicle is started. As another example, the first scenario may be a scenario in which the vehicle is running. The second scenario provided in some embodiments of this specification of the present application may be a scenario in which the vehicle is running. It should be noted that the second scenario provided in some embodiments of this specification of the present application appears after the first scenario. This sequence may be chronological, or may be a difference in sequence in spatial locations, for example, first in a parking lot, then on a highway. Alternatively, this sequence may be a difference in other settings, for example, first in a rest and sleep scenario, then in a movie scenario. Scenario switching usually involves moving the vehicle position, changing the vehicle settings, changing the time, etc. In a possible scenario switching process, the initial scenario of the vehicle is the first scenario, for example, a power recharge scenario in which the vehicle is charged at a home parking lot. After 10 minutes, the scenario changes. For example, when the vehicle enters a highway and enters an urban commute scenario, the second scenario may be an urban commute scenario. As another example, when the first scenario is an urban commute scenario, when the vehicle prepares for automatic parking after entering a company parking lot, the second scenario may be an automatic parking scenario. For example, when the vehicle automatically drives on a highway, the first operation interface may be an operation interface used to control the driving speed range of the vehicle. Then, when the vehicle leaves the highway and enters a service area for a break, the second operation interface may be an audiovisual entertainment operation interface, and the displayed audiovisual entertainment operation interface may be shown in FIG. 5-b.

[0268] The specific content of the first scenario or the second scenario is not limited in this application. With the continuous emergence of new scenarios, the vehicle may also adaptively adjust the operation interface to be displayed based on the changes of the scenario to improve operation efficiency and bring the user a better driving experience.

[0269] Optionally, manual correction may be performed when an error occurs in the vehicle's recognition of the scenario. In a possible implementation, after obtaining the second scenario based on the state information, the method further includes obtaining a third user instruction, the third user instruction instructing whether to switch to the second scenario, and if the third user instruction instructs to switch to the second scenario, obtaining a second operation interface corresponding to the second scenario, or if the third user instruction instructs not to switch to the second scenario, optionally continuing to maintain the first scenario and displaying an operation interface corresponding to the first scenario. Optionally, the method includes obtaining a fourth user instruction, the fourth user instruction instructs to switch to the third scenario, obtaining a fourth operation interface corresponding to the third scenario, and displaying the fourth operation interface.

[0270] According to the display method provided in the embodiment of the present application, a scenario switching can be implemented. The scenario switching can be implemented by using an operation performed by a user on a touch screen, a voice command of the user, a gesture command, etc. For example, in a possible implementation form, a user can implement a scenario switching by performing a slide operation on a touch screen.

[0271] A user can switch from one scenario type to another, or switch from a sub-scenario of one scenario type to a sub-scenario of a different scenario type. The difference between the two cases lies in the classification of the scenario layers. In this embodiment of the present application, the scenario division layer is not limited, and a scenario may be divided into one layer, two layers, or more layers. When switching from one scenario type to another, for example, when a user switches from a "driving scenario" to a "leisure and relaxation scenario", or when a user switches from an "urban commute scenario" in a "driving scenario" to a "rest and sleep" scenario in a "leisure and relaxation scenario", the touch screen will 5 -From the operation interface shown in Figure a 5 -b) to switch to the multimedia control operation interface.

[0272] In addition, a user can switch between different sub-scenarios within the same scenario type. As another example, a user can switch from an "urban commute scenario" within a "driving scenario" to a "business comfort scenario" within a "driving scenario".

[0273] It should be noted that the control method provided in the embodiments of the present application has high flexibility: the operation interfaces displayed by the touch screen in the same scenario type can remain unified or associated with each other, or different operation interfaces can be displayed by the touch screen in different sub-scenarios in the same scenario type.

[0274] In a possible implementation, for example, when a user switches from the "urban commute scenario" to the "business comfort scenario", the touch screen may display the same operation interface in both of the aforementioned two scenarios, for example, the operation interface may be a vehicle speed information operation interface and an associated gear information operation interface. If there are multiple touch display devices, multiple associated operation interfaces may also be displayed simultaneously. For example, FIG. 5 As shown in -a, the gear control operation interface and the vehicle speed control operation interface can be displayed simultaneously on two touch screens.

[0275] It should be noted that the "scenario type" provided in some embodiments of the present application can also be understood as an "overall scenario". For example, a "driving scenario" or a "leisure and relaxation scenario" may each be expressed as a type of scenario or may be used as an overall scenario. For example, a "driving scenario" has more specific sub-scenarios, for example, a "driving scenario" may be an "urban commute" scenario, a "long distance travel" scenario, or a "track race" scenario. As another example, a "leisure and relaxation" scenario type further includes sub-scenarios such as "rest and sleep" and "massage and relaxation". The specific scenario division is not limited in the present application and is used merely as an example for explanation.

[0276] In addition, the display method provided in the present application further includes a step of obtaining a feedback mode that matches the scenario based on a scenario. The method can be applied to the display device and the steering wheel provided in the present application. The feedback mode includes a feedback manner and a feedback intensity. The feedback manner includes at least one of vibration feedback, audio feedback, and brightness feedback. The feedback intensity includes at least one of vibration amplitude, vibration frequency, volume, and brightness.

[0277] When switching scenarios, for example, when entering an urban commute scenario, the feedback intensity may be strong, the feedback manner may be vibration feedback, and the feedback volume and vibration amplitude may be large. However, when entering a rest and sleep scenario, the feedback intensity may be weak, the feedback manner may be voice feedback or brightness feedback, the brightness may be low, and the volume may be low. When switching scenarios, the feedback mode that matches the scenario may also be switched.

[0278] In this case, feedback can be provided based on user operation. Vibration, sound, picture or brightness feedback can improve the user's operation experience, and bring the user more realistic touch, sound and picture. In addition, the feedback intensity and feedback method can be adaptively adjusted to effectively reduce the probability of erroneous operation, and improve driving safety.

[0279] The present application provides a display device, which may include a display unit and a storage unit. The display device may perform the aforementioned display method. Based on the display device, the embodiment of the present application further provides a data in-migration and out-migration method.

[0280] In a possible implementation, the touch display unit (402, 412) provided in the embodiment of the present application further includes a storage unit. The storage unit is configured to store data such as vehicle data and user privacy data generated when the user uses the vehicle. When the user gets off the vehicle, the user can take out the touch display unit from the vehicle to avoid loss of user data in the event of vehicle theft. In addition, the storage unit included in the touch display unit can be further configured to store the user's vehicle settings. The user can store information such as all personal data of the original vehicle and the vehicle settings preferred by the user in the touch display unit provided in the embodiment of the present application. When the user changes vehicles, the user may attach the touch display unit of the original vehicle to the touch display unit of the new vehicle to implement synchronization of user preferences and migration of personal data.

[0281] In a possible implementation, as shown in Fig. 10, when a user needs to migrate data out, the user may activate the out-migration function by performing an operation on the touch screen. After obtaining the user's data out-migration command, the device may first perform self-detection, for example, detect the current installation status of the device. If the current device is not installed correctly, a warning may be sent to the user to prompt the user to re-install the device configured to store the to-be-migrated-out data, for example, the device including the touch screen provided in this application.

[0282] Optionally, vehicle identification information may be further detected. The recognition information may include vehicle identity recognition information to ensure user and vehicle authorization and protect user privacy. The recognition information may also include vehicle type or function information to determine the type of data that can be stored in the vehicle and the type of setting parameters that can be stored in the vehicle. In this way, the relevant setting information or data can be loaded the next time the current vehicle is used.

[0283] Optionally, the data outmigration process may further include obtaining user information. In this way, user permission can be determined based on user account information, and the user's data or setting information in the vehicle can be associated with the user account and conveniently uploaded to the cloud or synchronized to each terminal.

[0284] Optionally, if at least one user account is stored in the vehicle, the user account with which the data to be synchronized is associated may be determined based on a user selection, for example, data of only one user account may be transferred, or data of all user accounts with authorization control may be transferred.

[0285] Optionally, the user may further select an out-migration mode. In the process of migrating data in the vehicle to the electronic device, the user's selection of the data out-migration manner and the data storage manner may be determined based on the out-migration mode information. For example, the out-migration mode may be that the local data of the vehicle is deleted after the data is migrated to the electronic device. As another example, the out-migration mode may be that the local out-migration data of the vehicle is retained after the out-migration data is stored in the electronic device. As another example, the out-migration mode may be that the data stored locally in the vehicle is deleted, and the data is centrally uploaded to the cloud. As another example, after the data is migrated, the factory settings of the vehicle may be restored, or all data of the current user account in the vehicle may be cleared. In a car sharing scenario, the leakage of personal privacy information can be effectively avoided. Here, the out-migration mode may be of another type. This is merely an example and should not be construed as a limitation on this embodiment of the present application.

[0286] Similarly, an embodiment of the present application further provides a data migration method. As shown in Fig. 11, the method may include steps of detecting the installation state of the device, detecting vehicle identification information, obtaining user account information, selecting a migration mode, restoring the vehicle to factory settings, writing the user's selected data to the vehicle, initializing user settings, etc. These steps are similar to the data migration method, and the description of the migration mode may be referred to. Regarding the data migration method, the migration mode may be that the data in the electronic device is retained and the user's setting information and data are imported to the vehicle, or the migration mode may be that the data in the electronic device is deleted and only the data to be migrated in the vehicle is stored, or the migration data may be stored in the cloud and may be accessed and updated at any time by a mobile phone, a computer, a vehicle, etc.

[0287] It should be noted that, compared with the method for synchronizing user's data by using the cloud, the method of using the touch display unit provided in the embodiment of the present application is used, so that the user can complete the steps of data migration and preference setting by only performing a simple installation step. This solution not only has the advantages of simple operation and short time consumption, but also can save the user a large amount of network traffic fees, guarantee user data security, and reduce the risk of personal privacy data leakage.

[0288] The present application further provides a vehicle, which includes the above-mentioned display device or steering wheel, or which can execute the display method, feedback method, or data in-migration / out-migration method provided in the embodiments of the present application.

[0289] In conclusion, the display method, display device, steering wheel, and vehicle provided in this application can provide users with a rich and personalized operation interface, and the operation interface has an adaptive switching function, and provides the most convenient operation input for users at any time. This not only ensures driving safety and collision safety, but also improves user operation efficiency and reduces the risk of erroneous operation. In addition, the steering wheel, electronic device, and vehicle provided in this application can further make hardware upgrades more convenient, simplify upgrade steps and installation requirements, and bring more possibilities for users' personalized configurations.

[0290] In addition, an embodiment of the present application further provides a computer program product, which includes computer program code, which, when executed on a computer, enables the computer to perform the aforementioned method provided in the embodiment of the present application.

[0291] An embodiment of the present application further provides a computer-readable medium. The computer-readable medium stores program code. . When the program code is executed on a computer, the computer is enabled to execute the aforementioned methods provided in the embodiments of the present application.

[0292] In the implementation process, the steps in the aforementioned method can be completed by using integrated logic circuits of hardware in a processor or by using instructions in the form of software. The communication method disclosed with reference to the embodiments of the present application may be directly executed by a hardware processor, or may be executed by using a combination of hardware and software modules in a processor. The software modules may be located in a mature storage medium in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, or a register. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps in the aforementioned method in combination with the hardware of the processor. To avoid repetition, the details will not be described again here.

[0293] It should be understood that in this embodiment of the present application, the memory may include read-only memory and random access memory to provide instructions and data to the processor.

[0294] It should be noted that in the embodiments of the present application, the terms "first", "second", and various numerical values ​​are only used for distinction for ease of description, and are not used to limit the scope of the embodiments of the present application, for example, to distinguish different scenarios and operation interfaces.

[0295] It should be understood that the term "and / or" in this specification only describes a correlation between related objects and represents that three relationships may exist. For example, A and / or B may represent three cases: only A exists, both A and B exist, and only B exists. In addition, the character " / " in this specification generally indicates an "or" relationship between related objects.

[0296] It should be understood that the sequence numbers of the above processes do not mean the execution sequence in various embodiments of the present application. The execution order of the processes should be determined based on the functions and internal logic of the processes, and should not be construed as any limitation on the implementation process of the embodiments of the present application.

[0297] Those skilled in the art may recognize that the units and algorithm steps in the examples described with reference to the embodiments disclosed herein may be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether a function is performed by hardware or software depends on the design constraints of a specific application and technical solution. Those skilled in the art may use different methods to implement the functions described for each specific application, but the implementation form should not be considered to go beyond the scope of this application.

[0298] For the sake of convenience and concise description, the detailed operation processes of the above-mentioned systems, devices and units may be clearly understood by those skilled in the art by referring to the corresponding processes in the above-mentioned method embodiments, and the details will not be described again here.

[0299] In some embodiments provided in the present application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the described device embodiment is merely an example. For example, the division of units is merely a logical division of functions, and may be other divisions in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not implemented. In addition, the shown or discussed mutual couplings or direct couplings or communication connections may be implemented through some interfaces. Indirect couplings or communication connections between devices or units may be implemented in electronic, mechanical, or other forms.

[0300] The units described as separate parts may or may not be physically separate, and the parts shown as units may or may not be physical units, may be located in one place, or may be distributed over multiple network units. Some or all of the units may be selected based on actual requirements to achieve the objectives of the solutions of the embodiments.

[0301] In addition, the functional units in the embodiments of the present application may be integrated into one processing unit, and each of the units may exist physically alone, or two or more units may be integrated into one unit.

[0302] When the function is implemented in the form of a software functional unit and sold or used as an independent product, the function may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application essentially contributes to the prior art, or some of the technical solutions may be implemented in the form of a software product. The computer software product is stored in a storage medium and includes some instructions for instructing a computer device (which may be a personal computer, a server, a network device, etc.) to execute all or some of the steps of the method described in the embodiments of the present application. The aforementioned storage medium includes any medium that can store program code, such as a USB flash drive, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0303] The above description is merely a specific implementation form of the present application, and is not intended to limit the protection scope of the present invention. Any variation or replacement that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present invention shall fall within the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. 1. A method for displaying a vehicle operation interface, comprising: acquiring state information, the state information including environmental information; obtaining a first scenario based on the state information; obtaining a first operation interface corresponding to the first scenario; displaying the first operation interface; The method includes:

2. obtaining user identity information; obtaining user setting information based on the user identity information, the user setting information including at least one scenario, at least one operation interface, and information about a correspondence between the scenario and the operation interface; Further comprising: The step of obtaining a first operation interface corresponding to the first scenario specifically includes: obtaining the first operation interface that corresponds to the first scenario based on the user setting information; The method of claim 1 , comprising:

3. The method comprises: Obtaining a first user instruction, the first user instruction instructing to select the first operation interface as an operation interface that matches the first scenario; updating the user setting information if the first operation interface is different from the second operation interface; Further comprising: The second operation interface is an operation interface that is in the user setting information and currently corresponds to the first scenario; The method of claim 2.

4. The method according to claim 1 , wherein the environmental information includes at least one of location information, road information, weather information, and accident information.

5. The state information further includes vehicle information, the vehicle information including at least one of driving state information and usage state information; The driving state information includes at least one of driving mode information, gear information, motion state information, drive system state information, energy system state information, lighting system state information, and vehicle fault information; The usage status information includes at least one of call status information, screen brightness, speaker volume, temperature control mode, air circulation mode, seat status, window status, and atmosphere light status.

5. The method according to any one of claims 1 to 4.

6. After the step of obtaining a first scenario based on the state information, the method further comprises: obtaining a feedback mode that corresponds to the first scenario based on the first scenario; Further comprising: The feedback mode includes a feedback manner and a feedback intensity, the feedback manner includes at least one of vibration feedback, audio feedback, and brightness feedback, and the feedback intensity includes at least one of vibration amplitude, vibration frequency, volume, and brightness.

6. The method according to any one of claims 1 to 5.

7. The vehicle displays the first operation interface by using a steering wheel, and the method further comprises: Obtaining a steering angle; adjusting a display angle of the first operating interface based on the steering wheel angle; The method of claim 1 , further comprising:

8. The vehicle includes a first display device and a second display device, and the first operation interface includes a first sub-interface and a second sub-interface; The step of displaying the first operation interface specifically includes: displaying the first sub-interface by using the first display device and displaying the second sub-interface by using the second display device. The method of any one of claims 1 to 7, comprising:

9. 1. An apparatus for displaying a vehicle operation interface, comprising: an acquisition unit configured to acquire state information, the state information including environmental information; a processing unit configured to obtain a first scenario based on the state information, a processing unit further configured to obtain a first operation interface corresponding to the first scenario; and a display unit configured to display the first operation interface; An apparatus comprising:

10. An identity information obtaining unit configured to obtain user identity information Further equipped with The processing unit is further configured to obtain user setting information based on the user identity information, the user setting information including at least one scenario, at least one operation interface, and information about a correspondence between the scenario and the operation interface; The processing unit is further configured to obtain the first operation interface corresponding to the first scenario based on the user setting information.

10. The apparatus of claim 9.

11. a receiving unit configured to receive a first user instruction, the first user instruction instructing the receiving unit to select the first operation interface as an operation interface that matches the first scenario; Further equipped with The processing unit is further configured to update the user setting information when the first operation interface is different from the second operation interface; The second operation interface is an operation interface that is in the user setting information and currently corresponds to the first scenario; 11. The apparatus of claim 10.

12. The device according to claim 9 , wherein the environmental information includes at least one of location information, road information, weather information, and accident information.

13. The state information further includes vehicle information, the vehicle information including at least one of driving state information and usage state information; The driving state information includes at least one of driving mode information, gear information, motion state information, drive system state information, energy system state information, lighting system state information, and vehicle fault information; The usage status information includes at least one of call status information, screen brightness, speaker volume, temperature control mode, air circulation mode, seat status, window status, and atmosphere light status.

13. Apparatus according to any one of claims 9 to 12.

14. The processing unit is further configured to obtain, based on the first scenario, a feedback mode that corresponds to the first scenario; The feedback mode includes a feedback manner and a feedback intensity, the feedback manner includes at least one of vibration feedback, audio feedback, and brightness feedback, and the feedback intensity includes at least one of vibration amplitude, vibration frequency, volume, and brightness.

14. Apparatus according to any one of claims 9 to 13.

15. The vehicle displays the first operation interface by using a steering wheel, and the device: The acquisition unit is further configured to acquire a steering wheel angle; the processing unit further configured to adjust a display angle of the first operating interface based on the steering wheel angle; 15. The apparatus of claim 9, further comprising:

16. The display unit includes a first display sub-unit and a second display sub-unit, and the first operation interface includes a first sub-interface and a second sub-interface; the first display subunit is configured to display the first sub-interface, and the second display subunit is configured to display the second sub-interface; 16. Apparatus according to any one of claims 9 to 15.

17. A handle, A first operation unit configured to display an operation interface and receive a user command, the operation interface being obtained based on state information, the state information including environmental information; and a first mounting portion to which the first operation unit is detachably mounted; A handle comprising:

18. The handle of claim 17, wherein the first operating unit is magnetically fixedly attached to the first mounting portion.

19. 19. The handle of claim 17 or 18, wherein the first operating unit further comprises a first connecting portion, the first mounting portion further comprises a second connecting portion, and the first operating unit is fixed to the first connecting portion by using the first connecting portion and the second connecting portion.

20. 20. The handle according to claim 17, wherein the first operating unit includes a wireless charging receiving end, the first mounting portion includes a wireless charging transmitting end, and the first mounting portion supplies power to the first operating unit via the wireless charging transmitting end and the wireless charging receiving end.

21. 21. The handle according to any one of claims 17 to 20, wherein the handle comprises a first interface, and the first operating unit establishes a communication connection with the handle via the first interface.

22. The handle according to any one of claims 17 to 20, wherein the first operating unit further comprises a wireless communication unit, the wireless communication unit configured to establish a wireless communication connection with an on-board device of a vehicle.

23. 23. The steering wheel according to claim 17, further comprising an airbag accommodation portion, the airbag accommodation portion not overlapping with a projection of the first operating unit onto a rotation plane of the steering wheel.

24. 24. The handle of any one of claims 17 to 23, wherein the handle further comprises an identity recognition unit, the identity recognition unit comprising at least one of a fingerprint recognition unit, a voice recognition unit, and a face recognition unit.

25. 25. The handle according to any one of claims 17 to 24, wherein the handle further comprises a second operating unit, the handle further comprises a second mounting portion, the second operating unit configured to display an operating interface and receive user commands, and the second operating unit is removably attached to the second mounting portion.

26. 1. An electronic device comprising: an operation unit configured to display an operation interface and receive a user command, the operation interface being obtained based on state information, the state information including environmental information; a first connection portion configured to removably secure the electronic device; An electronic device comprising:

27. 27. The apparatus of claim 26, wherein the first connection comprises at least one of a magnetic attraction unit and a snap-fit ​​unit.

28. 28. The device of claim 26 or 27, further comprising a wireless charging receiving end, the wireless charging receiving end configured to transmit electrical energy.

29. 28. The apparatus of claim 26 or 27, further comprising a communications interface, the communications interface configured to establish a communications connection with an in-vehicle device.

30. 28. The apparatus of claim 26 or 27, further comprising a wireless communication unit, the wireless communication unit configured to establish a wireless communication connection with an on-board device of a vehicle.

31. Further comprising a feedback unit, the feedback unit comprising at least one of a vibration feedback unit, an audio feedback unit, and a picture feedback unit; the vibration feedback unit is configured to output a vibration signal according to the user command; the audio feedback unit is configured to output an audio signal according to the user command; the picture feedback unit is configured to output a picture effect according to the user instruction; 31. Apparatus according to any one of claims 26 to 30.

32. A computer readable storage medium, the computer readable storage medium storing code or instructions which, when executed, perform the method of any one of claims 1 to 8.

33. A vehicle comprising a device according to any one of claims 9 to 16 or comprising a handle according to any one of claims 17 to 25.

Citation Information

Patent Citations

  • Electric control system for automatic driving electric automobile

    CN106774291A

  • Intelligent networking electric sightseeing vehicle and control method

    CN108656962A

  • Interaction method and device based on automatic driving

    CN113147745A

  • Methods and systems for generating adaptive instructions

    US20190375426A1

  • Application interface display method, apparatus and electronic device

    US20200133446A1