Control methods, storage media, display devices, and vehicles

Abstract

This application relates to a control method, storage medium, display device, and vehicle, which acquires in-vehicle environment information and controls the display device based on the in-vehicle environment information, thereby ensuring the display effect of the floating display device in the narrow space of the vehicle and improving the user experience.

Description

Technical Field

[0001] This application relates to the field of vehicle control, and more particularly to a control method, storage medium, display device, and vehicle. Background Technology

[0002] With the development of autonomous driving technology and the acceleration of vehicle intelligence, there is an increasing amount of information to be displayed in vehicles, leading to a proliferation of display screens. One related technology provides a solution for projecting display content into the air using levitation display technology.

[0003] However, existing in-vehicle equipment can interfere with the operation of the display device. Summary of the Invention

[0004] This application provides a control method, a storage medium, a display device, and a vehicle method to at least partially solve the above-mentioned problems.

[0005] To achieve the above objectives, according to a first aspect of this application, a control method is provided, applicable to a vehicle, the vehicle including a display device, the control method comprising:

[0006] Obtain information about the in-vehicle environment;

[0007] The display device is controlled based on the in-vehicle environment information.

[0008] Optionally, the in-vehicle environment information includes the status information of at least one vehicle device.

[0009] Optionally, the status information includes the open and / or closed status of the vehicle device.

[0010] Optionally, controlling the display device based on the in-vehicle environment information includes:

[0011] If the vehicle device is in the open state, control the vehicle device to close.

[0012] After the vehicle device is in the off state, the display device is turned on.

[0013] Optionally, the vehicle device includes at least one of a door, a window, and a light-shielding structure. Optionally, the status information includes the bright light status and / or dark light status of the vehicle device.

[0014] Optionally, controlling the display device based on the in-vehicle environment information includes:

[0015] If the vehicle device is in a bright state, the control will switch the state of the vehicle device to a dark state;

[0016] After the vehicle device is in a dark state, the display device is turned on.

[0017] Optionally, the vehicle device includes at least one of a dimming module and a lighting assembly.

[0018] Optionally, the status information includes the vehicle device's obstruction / non-obstruction status of the display device.

[0019] Optionally, controlling the display device based on the in-vehicle environment information includes:

[0020] If the vehicle device is blocking the display device, then control the vehicle device to move.

[0021] After the vehicle device is in a non-obstructive state towards the display device, the display device is controlled to turn on.

[0022] Optionally, the vehicle device includes a seat.

[0023] Optionally, the vehicle device includes multiple components; controlling the display device based on the in-vehicle environment information includes:

[0024] The control operation is determined based on the status information of each of the vehicle devices;

[0025] Once the status information or updated status information of each vehicle device meets the preset conditions, the display device is controlled.

[0026] Optionally, determining the control operation based on the state information of each of the vehicle devices includes:

[0027] In response to the first control command, control operations for each of the vehicle devices are determined based on the status information of each of the vehicle devices.

[0028] Optionally, the method further includes:

[0029] In response to the second control command, the control operation is determined based on the status information of the first vehicle device in the vehicle device;

[0030] Once the status information or updated status information of the first vehicle device meets the preset conditions, the display device is controlled to turn on.

[0031] Optionally, determining the control operation based on the state information of the first vehicle device in the vehicle device includes:

[0032] If the first vehicle device is in a state of obstructing the display device, then the vehicle device is controlled to move.

[0033] The step of controlling the display device after the status information or updated status information of the first vehicle device meets preset conditions includes:

[0034] After the vehicle device is in a non-obstructive state towards the display device, the display device is controlled to turn off.

[0035] Optionally, after controlling the display device, the method further includes:

[0036] Output a prompt message;

[0037] If a response to the prompt is detected, a control operation is performed on the second vehicle device in the vehicle device.

[0038] Optionally, obtaining the in-vehicle environment information includes:

[0039] Respond to the third control command and obtain information about the in-vehicle environment.

[0040] According to a second aspect of this application, a display device is provided, controlled by the control method described in any of the preceding claims, the display device comprising:

[0041] Display module;

[0042] Imaging components; and

[0043] A rotating structure, connected to the imaging component, is used to control the movement of the imaging component;

[0044] The display module is used to output display information so that the image can be displayed in a preset area through the imaging component.

[0045] Optionally, the display device further includes a light-shielding mechanism connected to the imaging component;

[0046] The rotating structure, while controlling the movement of the imaging component, also drives the light-shielding mechanism so that the light-shielding mechanism creates a light-shielding effect on the imaging component.

[0047] Optionally, the display device further includes a sensor; the sensor is connected to the rotating structure;

[0048] The sensor is used to detect operation commands and send the detected operation commands to the display module so that the display module can perform corresponding operations.

[0049] The rotating structure is also used to control the movement of the sensor.

[0050] According to a third aspect of this application, a computer-readable storage medium is provided that stores a computer program thereon, which, when executed by a processor, implements the steps of any of the methods described above.

[0051] According to a fourth aspect of this application, a computer program product is also provided, the computer program product comprising a computer program, which, when executed by a processor, causes the computer program product to perform the steps of the method as described in any of the preceding claims.

[0052] According to a fifth aspect of this application, a vehicle is also provided, which is equipped with the display device as described above.

[0053] In summary, this application obtains in-vehicle environment information to control the display device based on the in-vehicle environment information, avoiding interference from the in-vehicle environment on the display device, ensuring the display effect of the display device in the narrow space of the vehicle, and is especially suitable for floating display devices using floating display technology, thus improving the user experience.

[0054] Other features and advantages of this application will be described in detail in the following detailed description section. Attached Figure Description

[0055] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0056] To gain a more complete understanding of this application and its beneficial effects, the following description will be provided in conjunction with the accompanying drawings, wherein the same reference numerals in the following description denote the same parts.

[0057] Figure 1 This is a schematic diagram of the structure of a floating display device provided in an embodiment of this application;

[0058] Figure 2 This is a flowchart illustrating the steps of a control method provided in an embodiment of this application;

[0059] Figure 3 A schematic diagram illustrating the complete process of controlling the activation of a floating display device according to an embodiment of this application;

[0060] Figure 4 A complete flowchart illustrating the process of controlling the shutdown of a floating display device is provided in this application embodiment;

[0061] Figure 5 A schematic diagram of the architecture of an electronic device provided in an embodiment of this application;

[0062] Explanation of reference numerals in the attached figures:

[0063] Display module 11, imaging component 12, sensor 13, rotating structure 14, fixed frame 15, transmission structure 16, light-shielding mechanism 17. Detailed Implementation

[0064] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the protection scope of this application.

[0065] Based on the problems mentioned in the background section, a solution for projecting display content into the air using levitation display technology has been proposed in related technologies. Specifically, levitation display technology utilizes a levitation display device to display content. For a clearer understanding of this solution, please refer to [link to relevant documentation]. Figure 1 , Figure 1 A schematic diagram of a floating display device provided in an embodiment of this application is described in detail below.

[0066] In the embodiments of this application, the floating display device typically includes a display module 11, an imaging component 12, a sensor 13, and a rotating structure 14.

[0067] The display module 11 is typically integrated on the roof of the vehicle. When the function is activated, it generates corresponding optical signals based on the control commands input by the user, which are then projected onto a designated location by the imaging component 12 to display the corresponding content.

[0068] The imaging component 12 is mainly used to project the optical signal generated by the display module 11 onto a specified position. Specifically, the imaging component 12 can usually be an imaging glass.

[0069] Furthermore, considering that the imaging component 12 typically needs to maintain a certain tilt angle with the vehicle roof when projecting optical signals to a designated location for viewing, for example, when the projection surface is vertically set in the vehicle interior, the imaging component 12 is usually set at a tilt angle of approximately 35° to 45° with the vehicle roof to facilitate better viewing of the displayed content by the user. However, in the non-operating state, such a setting would occupy too much interior space, affecting the user experience and posing a risk of collision. Therefore, in this embodiment, the imaging component 12 can also be connected to the rotating structure 14. In the non-operating state, the imaging component 12 is integrated with the display module 11 and set on the vehicle roof. When the floating display function needs to be activated, the imaging component 12 will rotate to a predetermined angle to a designated position under the transmission of the rotating structure 14 so that the user can view the content displayed on the imaging component 12.

[0070] Furthermore, to better control the floating display device, such as controlling the content or display effect displayed by the display module 11, the floating display device can also collect user input commands through the sensor 13 when in operation. For example, a common and feasible implementation is that the sensor 13 can also collect user gesture control commands, such as virtual touch operations on the projection surface to control the display module 11 accordingly. Of course, similar to the imaging component 12, in order to reduce the occupation of vehicle interior space and reduce the risk of collision, the sensor 13 can also be connected to the rotating structure 14 so that after the floating display function is enabled, it can be rotated to a preset angle to a specified position through the transmission of the rotating structure 14. For example, under normal circumstances, the sensor 13 can be set in the vertical plane where the projection surface is located.

[0071] Of course, the above is merely an example of the most basic structural controls used to implement the floating display function in a floating display device. For further details, please refer to... Figure 1 The floating display device may also include a fixing frame 15 for fixing the imaging component 12, a transmission structure 16, and a light-shielding mechanism 17.

[0072] Specifically, the fixing frame 15 can be used to fix the imaging component 12 during projection imaging. Similarly, in the floating display device, the fixing frame 15 can be set in the light-shielding structure 17. After the floating display function is activated, the fixing frame 15 is pulled out of the light-shielding mechanism 17 to a set position through the transmission structure 16, and the fixing of the imaging component 12 is completed after the imaging component 12 rotates to that position. In addition, the fixing frame 15 can also be connected to the light-shielding component in the light-shielding mechanism 17, such as a light-shielding curtain. When the transmission structure 16 pulls the fixing frame 15 out of the light-shielding mechanism 17, it will simultaneously drive the light-shielding curtain to be pulled out, so that when the imaging component 12 moves to the designated position, the light-shielding curtain can just form the effect of blocking the windshield incident light on the imaging component 12, thereby improving the imaging effect.

[0073] Of course, the aforementioned embodiments are merely schematic diagrams of a feasible structure for a floating display device. In fact, a floating display device can include more components based on actual needs. This application does not limit the structure of the floating display device. Any device that can achieve an in-vehicle floating display effect through floating display technology is within the scope of protection claimed in this application.

[0074] As can be seen, in the aforementioned solutions, when the aforementioned floating display device is configured in the vehicle interior, the limited space often leads to a risk of collision between the floating display device and other components within the vehicle. Furthermore, the difficulty in controlling the ambient light inside the vehicle affects the display effect of the floating display device. Therefore, this application provides a control method aimed at ensuring the display effect of the floating display device within the vehicle space through coordinated control of the floating display device and vehicle components. For details, please refer to... Figure 2 , Figure 2 This application provides a flowchart illustrating the steps of a control method, specifically including steps S210 to S220:

[0075] S210, obtains information about the in-vehicle environment.

[0076] S220, control the display device according to the in-vehicle environment information.

[0077] For ease of description, this application uses a floating display device as an example. The control states of a floating display device typically include various functions, such as controlling the floating display device to turn on or off, or adjusting the display effect and position of the floating display device while it is in operation. However, to reduce the influence of the in-vehicle environment or vehicle equipment on the control operations of the floating display device, in this embodiment, the floating display device is not directly controlled in response to its control state. Instead, in-vehicle environmental information is acquired, and the display device is controlled based on this information.

[0078] Furthermore, the acquisition of in-vehicle environmental information can typically be triggered in response to control commands to the display device. In other words, the acquisition of in-vehicle environmental information includes:

[0079] Respond to the third control command and obtain information about the in-vehicle environment.

[0080] The third control command here refers to the command to control on-board equipment, such as cameras, millimeter-wave radar, etc., to acquire information about the in-vehicle environment. This includes commands to activate the camera's image acquisition function or the millimeter-wave radar's detection function. These commands are typically triggered by user input on the in-vehicle infotainment system or other external devices; this application does not impose any restrictions on this. Please provide examples.

[0081] To facilitate understanding of the solutions provided in the embodiments of this application, the following will take the control command for opening the floating display device as an example to specifically explain the control method provided in this application. Other control commands will only be briefly described. Those skilled in the art can determine other control commands for the floating display device without any doubt by combining the flow of the control command for opening the floating display device, such as the control method for controlling the process of closing the floating display device.

[0082] Specifically, the in-vehicle environment information can include information that directly or indirectly affects the operation of the floating display device. For example, as a common and feasible implementation, the in-vehicle environment information typically includes the status information of at least one vehicle device. Here, the vehicle device can typically be a structure or component that is associated with the vehicle space and the floating display device. It is understandable that different status information of the vehicle device will have different effects on the floating display device.

[0083] For example, as a feasible implementation, the status information of vehicle devices typically includes an on / off state. In this case, the control operation includes turning off or on these vehicle devices. Controlling the display device based on the in-vehicle environment information includes:

[0084] If the vehicle device is in the open state, control the vehicle device to close.

[0085] After the vehicle device is in the off state, the display device is turned on.

[0086] The vehicle device includes at least one of a door, a window, and a sunshade structure.

[0087] For example, in one feasible implementation, taking a vehicle device including a door as an example, the control method includes:

[0088] If the car door is open, control the door to close.

[0089] Specifically, when it is necessary to control the floating display device to open or close, or to perform other operations, in order to create a closed space inside the vehicle for better control of the floating display device, in this embodiment of the application, the vehicle door is controlled to close when it is in the open state, that is, when the vehicle door is opened. Of course, in order to remind the user and improve safety, prompt information can also be output simultaneously during the process of controlling the door to close, such as outputting warning lights or warning voices to remind the user that the door needs to be closed or that the user is closing the door.

[0090] Of course, if the car door is already closed, it can be assumed that the door will not affect the operation of the floating display device, meaning that the floating display device can be controlled, for example, by controlling the floating display device to turn on. Therefore, the control method provided in this application also includes:

[0091] If the car door is closed, the floating display device is controlled.

[0092] In addition, similar to the vehicle door, as another feasible implementation of this application, the vehicle device may also include a window. In this case, the control method may further include:

[0093] If the car window is open, control the window to close.

[0094] Similarly, to create a closed space within the vehicle for better control of the floating display device, this embodiment also controls the closing of the windows when they are open. Furthermore, similar to door control, to alert the user and improve safety, prompts can be simultaneously output during window closing, such as warning lights or voice alerts, to remind the user that the windows need to be closed or that the window is being closed.

[0095] Of course, if the car window is already closed, it can be assumed that the window will not affect the operation of the floating display device, meaning that the floating display device can be controlled, for example, by controlling the floating display device to turn on. Therefore, the control method provided in this application also includes:

[0096] If the car window is closed, the floating display device is controlled.

[0097] Furthermore, in addition to the aforementioned vehicle devices such as doors and windows for creating a closed space within the vehicle to better control the holographic display device, the ambient light within the vehicle space can also be controlled to improve the display effect of the holographic display device in the vehicle space. That is, as another feasible implementation of this application, the vehicle device can also include a light-shielding structure. Specifically, the light-shielding structure can typically be a light-shielding panel, a sunshade, or other structures that can block light. Specifically, when the light-shielding structure is in the open state, it does not block ambient light from outside the vehicle; conversely, when the light-shielding structure is in the closed state, it blocks ambient light from outside the vehicle, thereby improving the display effect of the holographic display device in the vehicle space. In other words, in the embodiments of this application, the vehicle device can also include a light-shielding structure, and the control method can further include:

[0098] If the light-shielding structure is in the open state, then control the light-shielding structure to close.

[0099] In this embodiment, to better block interference from external ambient light and improve the display effect of the floating display device in the vehicle space, the floating display device or the light-shielding structure is controlled by detecting the state of the light-shielding structure. Specifically, when the light-shielding structure is in the open state, that is, when the light-shielding structure does not block external ambient light, the light-shielding structure is controlled to close in order to improve the display effect.

[0100] Furthermore, with the light-shielding structure in the closed state, meaning it has blocked external ambient light, the floating display device can be normally controlled to perform corresponding control operations. That is, the control method provided in this application may further include:

[0101] If the light-shielding structure is in the closed state, the floating display device is controlled.

[0102] Of course, it is understandable that the aforementioned solutions are only illustrative examples of vehicle devices with open and / or closed states, such as doors, windows, and light-blocking structures. In reality, based on actual scenario needs, vehicle devices can also include more different types of vehicle devices that can affect the floating display effect within the vehicle space. For example, in another feasible implementation, the status information can also include the bright and / or dark states of the vehicle devices. In this case, the control operation of the vehicle devices can include dimming the vehicle devices. Controlling the display device based on the in-vehicle environment information includes:

[0103] If the vehicle device is in a bright state, the control will switch the state of the vehicle device to a dark state;

[0104] After the vehicle device is in a dark state, the display device is turned on.

[0105] Specifically, to facilitate understanding of the above, taking a vehicle device including a dimming module as an example, the control method includes:

[0106] If the dimming module is in bright light mode, the control will switch the dimming module to dark light mode.

[0107] In this embodiment, by switching the dimming module to dark light, the floating display effect within the vehicle space can be guaranteed, thereby controlling the floating display device to activate for display. That is, the control method further includes:

[0108] If the dimming module is in a dimming state, then the floating display device is controlled.

[0109] Of course, in addition to the dimming module mentioned above, the vehicle device may also include lighting components, such as breathing lights and indicator lights on the vehicle's instruments. The state of these lighting components will also affect the ambient light environment inside the vehicle.

[0110] Furthermore, as can be seen from the foregoing description, during the control operation of the floating display device, it is often necessary to control the transmission or rotation of some structural components in the floating display device. For example, the fixed frame 15 can be pulled out of the light-shielding mechanism 17 to a set position through the transmission structure 16, or the imaging component 12 and sensor 13 can be rotated to a specified position through the transmission of the rotation structure 14. In other words, the control operation of the floating display device may include controlling the displacement of the floating display device. Due to space constraints within the vehicle, the floating display device may collide with other vehicle components during its movement. For example, if the floating display device is mounted on the roof and the vehicle has a sunroof, it may collide with the sunroof during movement. Alternatively, if the floating display device is positioned behind the front seats for rear passengers to view the content, it may collide with the rearward-moving front seats during movement. Therefore, in another feasible implementation, the state information may include the obstruction / non-obstruction status of the vehicle components on the floating display device. In this case, the control operation includes the relocation operation of the corresponding vehicle components. In other words, controlling the display device based on the in-vehicle environment information includes:

[0111] If the vehicle device is blocking the display device, then control the vehicle device to move.

[0112] After the vehicle device is in a non-obstructive state towards the display device, the display device is controlled to turn on.

[0113] Specifically, as a feasible embodiment of this application, taking a vehicle device including a seat, particularly a front seat, as an example, the control method includes:

[0114] If the seat is blocking the floating display device, the seat is controlled to move.

[0115] In this embodiment, before controlling the floating display device in response to its control state, the position information of the front seats is further detected to determine whether the seats are obstructing the floating display device. Specifically, since the floating display device's relative position is relatively fixed after it is installed in the vehicle, a series of three-dimensional coordinates describing the vehicle space can be used to record the position information required by the floating display device when performing control operations. By comparing this position information with the position information of currently detected vehicle devices, such as seats and sunroof components, the state information of the vehicle devices, i.e., whether they are obstructing the floating display device, can be determined. For example, if the seats are obstructing the floating display device, performing control operations on the floating display device may cause a collision between the floating display device and the seats. In this case, the seats will be moved to ensure the safety of controlling the floating display device.

[0116] Of course, if the seat is in a non-obstructive state towards the floating display device, meaning the seat will not interfere with or affect the control operation of the floating display device, then the floating display device can be controlled normally in response to the control status, for example, controlling the floating display device to turn on. That is, controlling the floating display device and / or the vehicle device based on the aforementioned status information also includes:

[0117] If the seat is in a non-obstructive state towards the floating display device, then the floating display device is controlled.

[0118] Of course, the foregoing descriptions of control methods for each vehicle device in different states are presented separately. In reality, a complete control process typically involves the detection of state information for multiple vehicle devices, such as doors, windows, sunshades, dimming modules, or vehicle seats. Therefore, as another feasible embodiment of this application, when there are multiple vehicle devices, the control method includes:

[0119] The control operation is determined based on the status information of each of the vehicle devices;

[0120] Once the status information or updated status information of each vehicle device meets the preset conditions, the display device is controlled to turn on.

[0121] In this embodiment, to control the floating display device, it is necessary to confirm whether the status information of each vehicle device is in a specified state. The control operation is then determined based on the status information of each vehicle device, and the display device is activated once the status information or updated status information of each vehicle device meets preset conditions. For example, taking the aforementioned various vehicle devices as examples, the complete control method specifically includes:

[0122] If the car door is open, control the door to close;

[0123] If the car door is closed, check the status information of the car window;

[0124] If the car window is open, control the window to close;

[0125] If the windows are closed, the status information of the light-blocking structure is detected;

[0126] If the light-shielding structure is in the open state, then control the light-shielding structure to close;

[0127] If the light-shielding structure is in the closed state, the status information of the dimming module is detected;

[0128] If the dimming module is in bright light mode, then control the dimming module to switch to dim light mode;

[0129] If the dimming module is in a dimming state, the seat status information is detected;

[0130] If the seat is blocking the floating display device, the seat is controlled to move.

[0131] If the seat is in a non-obstructive state towards the floating display device, the floating display device is turned on.

[0132] Of course, it should be noted that the aforementioned method involves sequentially detecting the status information of different devices within the vehicle system, namely, sequentially detecting the status information of the doors, windows, light-shielding structure, dimming module, and seats. In reality, in actual control logic, there is no given order for detecting the status of different vehicle devices. That is, by separately detecting the status information of the doors, windows, light-shielding structure, dimming module, and seats, it can be determined whether control of the corresponding vehicle device is required. Control of the floating display device is then implemented when it is determined that no control of the corresponding vehicle device is needed. In other words, the control method includes:

[0133] If the car door is open, control the door to close;

[0134] If the car window is open, control the window to close;

[0135] If the light-shielding structure is in the open state, then control the light-shielding structure to close;

[0136] If the dimming module is in bright light mode, the control will switch the dimming module to dim light mode;

[0137] If the seat is blocking the floating display device, control the seat to move;

[0138] If the car door is closed, the car window is closed, the sunshade is closed, the dimming mode is in dim light mode, and the seat is not obstructing the floating display device, then control the floating display device to turn on.

[0139] Of course, it should be noted that the aforementioned illustrative example of the holographic display device's activation command is used for explanation. Regarding the holographic display device's deactivation command, it can be understood that it is only necessary to ensure that the holographic display device is not obstructed by vehicle devices during the deactivation process, without any restrictions on the vehicle's interior environment. Therefore, as a further feasible implementation of this application, the control operation is determined based on the status information of each vehicle device, including:

[0140] In response to the first control command, control operations for each of the vehicle devices are determined based on the status information of each of the vehicle devices.

[0141] The first control command can be understood as an activation command, meaning that during the control of the display device, the control operation for each vehicle device needs to be determined based on the status information of each vehicle device. For example, when a vehicle device is in the activated state, it needs to be controlled to perform a deactivation operation, or when a vehicle device is in a bright state, it needs to be controlled to switch to a dim state.

[0142] For a clearer understanding of the above, please refer to [link / reference]. Figure 3 , Figure 3 This application provides a schematic diagram of a complete process for controlling the activation of a floating display device, which typically includes the following steps:

[0143] (1) After the floating display device is activated, a floating display device activation signal will be sent. The car controller will first check whether the sunroof, rear doors and windows are closed. If they are not closed, a first prompt signal will be sent to prompt them to close them.

[0144] (2) After confirming that the sunroof, rear doors and windows are closed, determine whether the dimming module is in the dark state and whether the light-blocking structure, such as the sunshade, is closed. If not, issue a second prompt signal to prompt for closure, and then issue a dimming module dimming signal and a sunshade closing signal.

[0145] (3) After dimming the dimming module and closing the sunshade, check whether the front seat will block the movement of the floating display device. If it does, move the front seat forward 3cm and check again whether it blocks the movement. If it blocks the movement again, continue to move the seat forward until it no longer blocks the movement of the floating display device.

[0146] (4) After completing all the checks, the imaging structure in the floating display device is moved to the set working position. During this process, the light-blocking structure in the floating display device, such as the sunshade, will be pulled out to block the ambient light coming in through the windshield.

[0147] (5) After the imaging structure moves to the working position, the display module and sensor are turned on. After the display module on the roof is turned on, the display image will be projected onto the vertical plane of the vehicle space through the imaging structure. At the same time, the sensor is also in the vertical plane, that is, the sensor's sensing surface is on the same vertical plane. At this time, through the sensor's sensing of the signal, such as user gesture recognition, or virtual touch operation on the virtual projection surface, non-contact touch control of the floating display device can be realized.

[0148] In another feasible implementation, the control method during the shutdown process of the floating display device also includes:

[0149] In response to the second control command, the control operation is determined based on the status information of the first vehicle device in the vehicle device;

[0150] Once the status information or updated status information of the first vehicle device meets the preset conditions, the display device is controlled to turn off.

[0151] The second control command can be understood as a shutdown command for the floating display device. That is, during the control of the display device, it is not required that the state information of each vehicle device be in a predetermined state. For example, when controlling the floating display device to shut down, it is only necessary to ensure that the vehicle device is not in a state of obstruction of the floating display device, and there are no restrictions on the open / closed state or the bright / dark state of the vehicle device. Therefore, the control operation can be determined based on the state information of a specific first vehicle device in the vehicle system, and the display device can be controlled after the state information of the first vehicle device or the updated state information meets the preset conditions. For example, if the first vehicle device is not in a state of obstruction of the floating display device, the display device can be controlled to shut down. In other words, determining the control operation based on the state information of the first vehicle device in the vehicle system includes:

[0152] If the first vehicle device is in a state of obstructing the display device, then the vehicle device is controlled to move.

[0153] The step of controlling the display device after the status information or updated status information of the first vehicle device meets preset conditions includes:

[0154] After the vehicle device is in a non-obstructive state towards the display device, the display device is controlled to turn off.

[0155] Of course, after controlling the display device, in order to achieve rapid reset of other vehicle devices, the control method may also include:

[0156] Output a prompt message;

[0157] If a response to the prompt is detected, a control operation is performed on the second vehicle device in the vehicle device.

[0158] Specifically, prompts refer to a type of information that can be used to prompt users to actively control vehicle devices, such as voice prompts like "Please confirm whether to reset the sunshade mechanism, doors and windows to their original state." Of course, prompts can also be made in other ways.

[0159] Specifically, a prompt tone is emitted to indicate whether to reset to the previous viewing state. At this time, the system detects the response to the prompt. If a response is detected, the system will control the windows, doors, dimming module, light shield, and seats to reset to the previous viewing state. If no response is detected within a preset period, the system will stop directly without resetting the windows, doors, dimming module, light shield, and seats.

[0160] For a clearer understanding of the above, please refer to [link / reference]. Figure 4 , Figure 4 A complete flowchart illustrating the process of controlling the shutdown of a floating display device, as provided in this application embodiment, typically includes the following steps:

[0161] (1) When the floating display device is turned off, a signal to turn off the floating display device is first sent, and then the display module and sensor of the floating display device are controlled to turn off;

[0162] (2) Check whether the front seat will block the closing movement path of the imaging structure in the floating display device. If it does, move the seat forward 3cm and check again whether it blocks the movement. If it blocks the movement again, continue to move the seat forward until it no longer blocks the movement of the floating display device.

[0163] (3) Then retract the imaging structure and sensor to the default position. During this process, the light-shielding mechanism in the floating display device, such as the sunshade, will retract with the movement of the imaging structure.

[0164] (4) If the front seats have been moved, return the seats to their original positions and simultaneously issue a closing completion prompt tone and issue a voice confirmation to confirm whether to return to the viewing state.

[0165] (5) If a positive response is received within a preset period, such as 1 minute, control the seat, door, window, dimming module and light shielding structure to return to the state before viewing; otherwise, no operation is performed and the floating display device is turned off directly.

[0166] In summary, this application obtains in-vehicle environment information to control the display device based on the in-vehicle environment information, avoiding interference from the in-vehicle environment on the display device, ensuring the display effect of the display device in the narrow space of the vehicle, and is especially suitable for floating display devices using floating display technology, thus improving the user experience.

[0167] Figure 5 This is a block diagram illustrating an electronic device 500 according to an exemplary embodiment. For example... Figure 5 As shown, the electronic device 500 may include a processor 501 and a memory 502. The electronic device 500 may also include one or more of a multimedia component 503, an input / output (I / O) component 504, and a communication component 505. In this embodiment, the electronic device 500 may be a device integrated into a vehicle to interact with the aforementioned floating display device and thus implement the control method provided in this embodiment.

[0168] The processor 501 controls the overall operation of the electronic device 500 to complete all or part of the steps in the control method described above. The memory 502 stores various types of data to support the operation of the electronic device 500. This data may include, for example, instructions for any application or method operating on the electronic device 500, and application-related data such as contact data, sent and received messages, pictures, audio, video, etc. The memory 502 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The multimedia component 503 may include a screen and audio components. The screen may be, for example, a touchscreen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signals may be further stored in memory 502 or transmitted via communication component 505. The audio component also includes at least one speaker for outputting audio signals. I / O component 504 provides an interface between processor 501 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual or physical buttons. Communication component 505 is used for wired or wireless communication between the electronic device 500 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IoT, eMTC, or other 5G technologies, or combinations thereof, is not limited here. Therefore, the corresponding communication component 505 may include: a Wi-Fi module, a Bluetooth module, an NFC module, etc.

[0169] In an exemplary embodiment, the electronic device 500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the control method described above.

[0170] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the control method provided in any of the above embodiments.

[0171] This application also provides a vehicle equipped with the floating display device provided in any of the above embodiments.

[0172] In one embodiment, the vehicle can be configured for fully or partially autonomous driving. For example, the vehicle can control itself while in autonomous driving mode, and can determine the current state of the vehicle and its surrounding environment through human intervention, determine the possible behaviors of at least one other vehicle in the surrounding environment, and determine the confidence level corresponding to the probability of that other vehicle performing a possible behavior, and control the vehicle based on the determined information. When the vehicle is in autonomous driving mode, it can be configured to operate without human interaction.

[0173] The vehicle may also include various subsystems, such as a driving system, sensor system control system, one or more peripheral devices, as well as power supply, computer system, and user interface. Optionally, the vehicle may include more or fewer subsystems, and each subsystem may include multiple components, such as multiple ECUs (electronic control units, i.e., vehicle computers) per subsystem.

[0174] In addition, each subsystem and component of the vehicle can be interconnected via wired or wireless means.

[0175] A propulsion system may include components that provide powered motion to the vehicle. In one embodiment, the propulsion system may include an engine, an energy source, a transmission, and wheels / tires. The engine may be an internal combustion engine, an electric motor, an air-compressed engine, or a combination of other types of engines, such as a hybrid engine consisting of a gasoline engine and an electric motor, or a hybrid engine consisting of an internal combustion engine and an air-compressed engine. The engine converts energy into mechanical energy.

[0176] Examples of energy sources include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electricity. Energy sources can also power other systems in the vehicle.

[0177] A transmission system can transmit mechanical power from an engine to the wheels. The transmission system may include a gearbox, a differential, and a drive shaft. In one embodiment, the transmission system may also include other components, such as a clutch. The drive shaft may include one or more axles that can be coupled to one or more wheels.

[0178] A sensor system may include several sensors that sense information about the vehicle's surrounding environment. For example, a sensor system may include a positioning system (which could be GPS, BeiDou, or another positioning system), an inertial measurement unit (IMU), radar, a laser rangefinder, and cameras. The sensor system may also include sensors from the vehicle's internal systems being monitored (e.g., an in-vehicle air quality monitor, fuel gauge, oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, orientation, speed, etc.). This detection and identification is a critical function for the safe operation of autonomous vehicles.

[0179] A positioning system can be used to estimate a vehicle's geographical location. An IMU is used to sense changes in the vehicle's position and orientation based on inertial acceleration. In one embodiment, the IMU can be a combination of an accelerometer and a gyroscope.

[0180] Radar can use radio signals to sense objects in the vehicle's surrounding environment. In some embodiments, in addition to sensing objects, radar can also be used to sense the speed and / or direction of travel of objects.

[0181] A laser rangefinder can use lasers to sense objects in the environment in which a vehicle is located. In some embodiments, a laser rangefinder may include one or more laser sources, a laser scanner, one or more processing modules, and other system components.

[0182] The camera can be used to capture multiple images of the vehicle's surroundings. The camera can be a still camera or a video camera.

[0183] A control system controls the operation of a vehicle and its components. Control systems can include various elements, including steering systems, throttles, braking units, computer vision systems, route control systems, and obstacle avoidance systems.

[0184] The steering system is operable to adjust the vehicle's direction of travel. For example, in one embodiment, it can be a steering wheel system.

[0185] The throttle is used to control the engine's operating speed and, consequently, the vehicle's speed.

[0186] The braking unit is used to control the deceleration of the vehicle. The braking unit uses friction to slow down the wheels.

[0187] In other embodiments, the braking unit can convert the kinetic energy of the wheels into electrical current. The braking unit may also take other forms to slow down the wheel rotation speed, thereby controlling the vehicle speed.

[0188] Computer vision systems can be operated to process and analyze images captured by cameras to identify objects and / or features in the environment surrounding a vehicle. These objects and / or features may include traffic signals, road boundaries, and obstacles. Computer vision systems may use object recognition algorithms, structure from motion (SFM) algorithms, video tracking, and other computer vision techniques. In some embodiments, computer vision systems may be used to map the environment, track objects, estimate object velocities, and so on.

[0189] A route control system is used to determine the driving route of a vehicle. In some embodiments, the route control system may combine data from GPS and one or more predetermined maps to determine the driving route for the vehicle.

[0190] Obstacle avoidance systems are used to identify, assess, and avoid or otherwise traverse potential obstacles in the environment in which a vehicle is located.

[0191] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0192] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0193] The embodiments, implementation methods, and related technical features of this application can be combined and substituted for each other without conflict.

[0194] The above are merely preferred embodiments of this application and are not intended to limit this application in any way. Any simple modifications, equivalent changes, and alterations made to the above embodiments based on the technical essence of this application without departing from the scope of the technical solution of this application shall still fall within the scope of the technical solution of this application.

Claims

1. A control method, characterized in that, Applicable to a vehicle, the vehicle including a display device, the control method includes: Obtain information about the in-vehicle environment; The display device is controlled based on the in-vehicle environment information.

2. The method according to claim 1, characterized in that, The in-vehicle environment information includes the status information of at least one vehicle device.

3. The method according to claim 2, characterized in that, The status information includes the open and / or closed status of the vehicle device.

4. The method according to claim 3, characterized in that, Controlling the display device based on the in-vehicle environment information includes: If the vehicle device is in the open state, control the vehicle device to close. After the vehicle device is in the off state, the display device is turned on.

5. The method according to claim 3 or 4, characterized in that, The vehicle device includes at least one of a door, a window, and a sunshade structure.

6. The method according to claim 2, characterized in that, The status information includes the bright light status and / or dark light status of the vehicle device.

7. The method according to claim 6, characterized in that, Controlling the display device based on the in-vehicle environment information includes: If the vehicle device is in a bright state, the control will switch the state of the vehicle device to a dark state; After the vehicle device is in a dark state, the display device is turned on.

8. The method according to claim 6 or 7, characterized in that, The vehicle device includes at least one of a dimming module and a lighting assembly.

9. The method according to claim 2, characterized in that, The status information includes the vehicle device's blocking / non-blocking status of the display device.

10. The method according to claim 9, characterized in that, Controlling the display device based on the in-vehicle environment information includes: If the vehicle device is blocking the display device, then control the vehicle device to move. After the vehicle device is in a non-obstructive state towards the display device, the display device is controlled to turn on.

11. The method according to claim 9 or 10, characterized in that, The vehicle equipment includes at least a seat.

12. The method according to any one of claims 1 to 11, characterized in that, The vehicle device includes multiple components; controlling the display device based on the in-vehicle environment information includes: The control operation is determined based on the status information of each of the vehicle devices; Once the status information or updated status information of each vehicle device meets the preset conditions, the display device is controlled to turn on.

13. The method according to claim 12, characterized in that, The step of determining the control operation based on the status information of each vehicle device includes: In response to the first control command, control operations for each of the vehicle devices are determined based on the status information of each of the vehicle devices.

14. The method according to claim 9, characterized in that, The method further includes: In response to the second control command, the control operation is determined based on the status information of the first vehicle device in the vehicle device; Once the status information or updated status information of the first vehicle device meets the preset conditions, the display device is controlled.

15. The method according to claim 14, characterized in that, The step of determining the control operation based on the status information of the first vehicle device in the vehicle device includes: If the first vehicle device is in a state of obstructing the display device, then the vehicle device is controlled to move. The step of controlling the display device after the status information or updated status information of the first vehicle device meets preset conditions includes: After the vehicle device is in a non-obstructive state towards the display device, the display device is controlled to turn off.

16. The method according to claim 15, characterized in that, After controlling the display device, the method further includes: Output a prompt message; If a response to the prompt is detected, a control operation is performed on the second vehicle device in the vehicle device.

17. The method according to any one of claims 1 to 16, characterized in that, The acquisition of in-vehicle environment information includes: Respond to the third control command and obtain information about the in-vehicle environment.

18. A display device, characterized in that, The display device is controlled by the control method according to any one of claims 1 to 17, and includes: Display module; Imaging components; and A rotating structure, connected to the imaging component, is used to control the movement of the imaging component; The display module is used to output display information so that the image can be displayed in a preset area through the imaging component.

19. The apparatus according to claim 18, characterized in that, The display device further includes a light-shielding mechanism connected to the imaging component; The rotating structure, while controlling the movement of the imaging component, also drives the light-shielding mechanism so that the light-shielding mechanism creates a light-shielding effect on the imaging component.

20. The apparatus according to claim 18, characterized in that, The display device further includes a sensor; the sensor is connected to the rotating structure. The sensor is used to detect operation commands and send the detected operation commands to the display module so that the display module can perform corresponding operations. The rotating structure is also used to control the movement of the sensor.

21. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the computer program performs the steps of the method described in any one of claims 1 to 17.

22. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, causes the computer program product to perform the steps of the control method as described in any one of claims 1-17.

23. A vehicle, characterized in that, The device is provided with the display device as described in claims 18-20.

Images