Method, apparatus and mobile carrier for controlling display
By displaying QR code information on the car window, the problem of comfort and safety being affected by keeping the car window open for extended periods of time is solved. This enables contactless information verification, improves the safety and comfort of drivers and passengers, and enhances traffic efficiency and user interaction experience.
Patent Information
- Application Number
- CN202210961076.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-11
- Publication Date
- 2026-01-02
- Estimated Expiration
- 2042-08-11
AI Technical Summary
Displaying QR codes in a vehicle while keeping the windows open for extended periods can negatively impact the comfort and safety of passengers, especially in inclement weather or when a negative pressure environment is required.
By using car windows as a medium to display QR code information, image information can be generated through voice commands, in-vehicle screen input, or physical function key operation. The display on the car windows can be controlled according to the user's location and device location to achieve contactless information verification.
Information verification can be performed without opening car windows, improving the comfort and safety of drivers and passengers, reducing the risk of epidemic transmission, and enhancing traffic efficiency and user interaction experience.
Smart Images

Figure CN115534822B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application applies to the field of intelligent cockpit, and more particularly, relates to a method and device for controlling display and a mobile carrier. BACKGROUND
[0002] In more and more scenarios, the driver or passenger in a vehicle needs to show a two-dimensional code (such as a payment code or a health code) to the outside, and the driver or passenger often needs to open the window for a long time during the process of showing the two-dimensional code. When the weather is bad outside, or in the context of the epidemic, opening the window for a long time may affect the comfort of the driver or passenger, and even lack a certain safety. SUMMARY
[0003] The embodiments of the present application provide a method and device for controlling display and a mobile carrier, which can display information to the outside through the window, realize contactless information verification, and help improve the comfort and safety of the driver or passenger.
[0004] The mobile carrier in the present application can include a road vehicle, a water vehicle, an air vehicle, an industrial device, an agricultural device, or an entertainment device, etc. For example, the mobile carrier can be a vehicle, which is a general concept of a vehicle, and can be a vehicle (such as a commercial vehicle, a passenger vehicle, a motorcycle, a flying vehicle, a train, etc.), an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), an agricultural device (such as a mower, a harvester, etc.), an entertainment device, a toy vehicle, etc. The embodiments of the present application do not specifically limit the type of vehicle. For another example, the mobile carrier can be an airplane or a ship.
[0005] In a first aspect, a method for controlling display is provided, which includes: generating first image information according to received first instructions and identity information of a first user in a cockpit of a vehicle; and controlling a first window of the vehicle to display the first image information.
[0006] Exemplarily, the first image information is used for verification by a machine or a person outside the vehicle.
[0007] In the technical solution, the vehicle window can be used as a medium to display information externally, and contactless information verification is achieved, which helps to improve the comfort and safety of the driver and passengers. In a scenario, when the epidemic is more serious, a negative pressure environment is maintained in the cabin, or the exchange of air in the cabin and the air outside is minimized, which can significantly reduce the risk of epidemic transmission. Based on the above technical solution, contactless first image information verification is achieved without opening the window, which can effectively protect the health and safety of the driver and passengers in the cabin and / or the health and safety of the staff outside the cabin. In another scenario, the external environment of the vehicle is harsh, for example, there is a lot of wind and sand, or the temperature is too high or too low, or it is raining or snowing. If the window is opened for a long time, the wind and sand outside may enter the cabin, or the air with unsuitable temperature outside may enter the cabin, or rain or snow may enter the cabin. In any of the above cases, the comfort of the driver and passengers will be affected. Based on the above technical solution, contactless first image information verification is achieved without opening the window, which can effectively protect the comfort of the driver and passengers in the cabin.
[0008] With reference to the first aspect, in some implementations of the first aspect, the first instruction includes at least one of the following: a voice instruction, an instruction generated according to an input to a vehicle screen of the vehicle, an instruction generated according to an operation of a physical function key of the vehicle, and an instruction generated according to an image recognition result. Exemplarily, the physical function key can be a dial lever, or a button, or another physical function key.
[0009] With reference to the first aspect, in some implementations of the first aspect, the first image information includes a two-dimensional code image.
[0010] With reference to the first aspect, in some implementations of the first aspect, the control of the first window of the vehicle to display the first image information includes: controlling the first window to display the first image information according to a first position of the first user in the cabin, the first position corresponding to the first window.
[0011] In the technical solution, the display position of the first image information can be adaptively adjusted according to the position of the first user in the cabin. When there are multiple users in the vehicle, the personnel or equipment outside the vehicle can clearly know which user the image information on the window corresponds to.
[0012] With reference to the first aspect, in some implementations of the first aspect, the control of the first window of the vehicle to display the first image information includes: controlling the first window to display the first image information according to a second position of a device that detects or recognizes the first image information, the second position corresponding to the first window.
[0013] Exemplarily, the device detecting or recognizing the first image can be a handheld device of an off-vehicle person; or can also be a device automatically detecting or recognizing the first image information, for example, a device recognizing or detecting a two-dimensional code arranged at a barrier lever support of a barrier gate.
[0014] Exemplarily, if the device is arranged at the left side of the vehicle, the first image information is displayed through at least one of the left side windows of the vehicle; if the device is arranged at the right side of the vehicle, the first image information is displayed through at least one of the right side windows of the vehicle; if the device is arranged at the front of the vehicle, the first image information is displayed through the front windshield of the vehicle.
[0015] In some possible implementation manners, the first window can also be controlled to display the first image information according to a position of a person detecting or recognizing the first image information, the position corresponding to the first window.
[0016] In some possible implementation manners, the first window can be controlled to display the first image information according to a first position of the first user in the cabin and a second position of a device detecting or recognizing the first image information. Exemplarily,
[0017] In the above technical solution, the first image information is displayed through the window on the side of the device or the person detecting or recognizing the first image information, which helps to improve the verification efficiency of the first image information and further improve the passing efficiency.
[0018] With reference to the first aspect, in some implementation manners of the first aspect, the control of the first window of the vehicle to display the first image information comprises: control of a first area of the first window to display the first image information, the first area corresponding to a third position of the first user in the cabin.
[0019] With reference to the first aspect, in some implementation manners of the first aspect, the control of the first window of the vehicle to display the first image information comprises: control of the first image information to be displayed on the first window by a head-up display (HUD).
[0020] With reference to the first aspect, in some implementation manners of the first aspect, the method further comprises: prompting the position of the first window and / or the content of the first image information.
[0021] In some possible implementation manners, the content of the first image information can be prompted by displaying text on the first window. For example, when the first image information comprises a payment code, the content of the first image information can be prompted by the text “Please scan the payment code here”.
[0022] In some possible implementation manners, the position of the first window and / or the content of the first image information can be prompted in a voice broadcast manner. For example, the first image information includes a payment code, and when the first image information is displayed on the left front window (the first window), the position of the first window and the content of the first image information can be prompted in a voice "please scan the left front window payment code for collection".
[0023] In the technical solution described above, when the first image information is verified or identified, the out-of-vehicle staff or device can not know the function and / or position of the two-dimensional code, and therefore the out-of-vehicle staff can be prompted in a text or voice prompt manner to scan the two-dimensional code, thereby improving the communication efficiency between inside and outside the vehicle and the verification efficiency of the first image information.
[0024] With reference to the first aspect, in some implementation manners of the first aspect, the first window includes at least one of the following: a front windshield, a rear windshield, a driver-side window, a front passenger-side window, a rear left window of the rear seat of the vehicle, and a rear right window of the rear seat of the vehicle.
[0025] For example, in a 5-seat vehicle, the "rear seat" can be the second row of the vehicle, and in a 7-seat vehicle, the "rear seat" can be the second row and / or the third row. For other multi-seat vehicles, the rear seat can also include other rear seats in addition to the driver area and the front passenger area.
[0026] With reference to the first aspect, in some implementation manners of the first aspect, the method further includes: in response to the first input of the first user, controlling the first window to switch to a second window of the vehicle to display the first image information.
[0027] For example, the first input can be a voice instruction, for example, "display the first image information on the left front window", or the first input can be a physical function key input, for example, the physical function key is a dial lever, and a relationship between the direction of dialing the dial lever and the window is preset, for example: dialing the dial lever upward displays the image information on the driver-side window, dialing the dial lever downward displays the image information on the front passenger-side window, dialing the dial lever leftward displays the image information on the left window of the second row, and dialing the dial lever rightward displays the image information on the right window of the second row. Further, when the first input is a physical function key input, the window on which the image information is displayed is determined according to the direction in which the dial lever is dialed. For example, the image information includes the first image information.
[0028] In the technical solution described above, the vehicle occupant is provided with a way to control the window on which the image information is displayed, which helps to improve the interactive experience of the user when using the vehicle cabin.
[0029] In a second aspect, an apparatus for controlling display is provided, the apparatus comprising: a generating unit configured to generate first image information according to a received first instruction and identity information of a first user in a cabin of a vehicle; and a processing unit configured to control a first window of the vehicle to display the first image information.
[0030] With reference to the second aspect, in some implementations of the second aspect, the processing unit is configured to control the first window to display the first image information according to a first position of the first user in the cabin, the first position corresponding to the first window.
[0031] With reference to the second aspect, in some implementations of the second aspect, the processing unit is configured to control the first window to display the first image information according to a second position of a device detecting or recognizing the first image information, the second position corresponding to the first window.
[0032] With reference to the second aspect, in some implementations of the second aspect, the processing unit is configured to control a first area of the first window to display the first image information, the first area corresponding to a third position of the first user in the cabin.
[0033] With reference to the second aspect, in some implementations of the second aspect, the processing unit is configured to control the first window to display the first image information by a head-up display (HUD).
[0034] With reference to the second aspect, in some implementations of the second aspect, the apparatus further comprises a prompting unit configured to prompt a position of the first window and / or content of the first image information.
[0035] With reference to the second aspect, in some implementations of the second aspect, the processing unit is configured to control the first window to switch to a second window of the vehicle to display the first image information in response to a first input of the first user.
[0036] With reference to the second aspect, in some implementations of the second aspect, the first window comprises at least one of: a front windshield, a rear windshield, a driver-side window, a front passenger-side window, a rear left window of the cabin, and a rear right window of the cabin.
[0037] With reference to the second aspect, in some implementations of the second aspect, the first image information comprises a two-dimensional code image.
[0038] With reference to the second aspect, in some implementations of the second aspect, the first instruction comprises at least one of: a voice instruction, an instruction generated according to an input of a vehicle-mounted screen of the vehicle, an instruction generated according to an operation of a physical function key of the vehicle, and an instruction generated according to an image recognition result.
[0039] In a third aspect, a device for controlling display is provided, which comprises a memory for storing a program, and a processor for executing the program stored in the memory, and when the program stored in the memory is executed, the processor is configured to execute the method in any possible implementation manner of the first aspect.
[0040] In a fourth aspect, a mobile carrier is provided, which comprises the device in any possible implementation manner of the second aspect or the third aspect.
[0041] In combination with the fourth aspect, in some implementation manners of the fourth aspect, the mobile carrier is a vehicle.
[0042] In a fifth aspect, a computer program product is provided, which comprises computer program codes, and when the computer program codes are executed on a computer, the computer is caused to execute the method in any possible implementation manner of the first aspect.
[0043] It should be noted that the computer program codes can be stored in the first storage medium in whole or in part, and the first storage medium can be packaged together with the processor or packaged separately from the processor, and the embodiments of the present application do not make a specific limitation in this regard.
[0044] In a sixth aspect, a computer readable medium is provided, which stores instructions, and when the instructions are executed by a processor, the processor is caused to implement the method in any possible implementation manner of the first aspect.
[0045] In a seventh aspect, a chip is provided, which comprises a processor, and the processor is configured to invoke computer programs or computer instructions stored in a memory, so as to cause the processor to execute the method in any possible implementation manner of the first aspect.
[0046] In combination with the seventh aspect, in a possible implementation manner, the processor is coupled with the memory through an interface.
[0047] In combination with the seventh aspect, in a possible implementation manner, the chip system further comprises the memory, and the memory stores the computer programs or computer instructions. BRIEF DESCRIPTION OF DRAWINGS
[0048] Figure 1 is a functional block diagram of a vehicle provided by the embodiments of the present application;
[0049] Figure 2 is a schematic diagram of a cockpit scene of a vehicle provided by the embodiments of the present application;
[0050] Figure 3 is a schematic diagram of a system architecture for controlling display provided by the embodiments of the present application;
[0051] Figure 4 is a schematic flowchart of a method for controlling display provided by an embodiment of the present application;
[0052] Figure 5 is a schematic diagram of an application scenario of a method for controlling display provided by an embodiment of the present application;
[0053] Figure 6 is a schematic diagram of an application scenario of a method for controlling display provided by an embodiment of the present application;
[0054] Figure 7 is a schematic diagram of an application scenario of a method for controlling display provided by an embodiment of the present application;
[0055] Figure 8 is a schematic block diagram of a device for controlling display provided by an embodiment of the present application;
[0056] Figure 9 is another schematic block diagram of a device for controlling display provided by an embodiment of the present application. DETAILED DESCRIPTION
[0057] The technical solutions in the embodiments of the present application will be described below with reference to the drawings.
[0058] Figure 1 is a functional block diagram of a vehicle 100 provided by an embodiment of the present application. The vehicle 100 can include a perception system 120, a display device 130 and a computing platform 150, wherein the perception system 120 can include one or more sensors for sensing information about the environment around the vehicle 100. For example, the perception system 120 can include a positioning system, which can be a global positioning system (GPS), a Beidou system or other positioning system, an inertial measurement unit (IMU). For another example, the perception system 120 can also include one or more of a laser radar, a millimeter wave radar, an ultrasonic radar, a pressure sensor, a sound sensor, a vision sensor and a camera. In some possible implementation manners, the vehicle 100 can also include a sound emitting device, such as a loudspeaker, for outputting audio to a user of the vehicle 100. In some possible implementation manners, the vehicle 100 can also perform voice interaction with the user through other external devices, such as a Bluetooth headset, and the present application does not make a specific limitation in this regard.
[0059] The display device 130 in the cabin is mainly divided into two categories, the first category is a vehicle display screen; the second category is a projection display screen, for example, a head up display (HUD), through which projection display can be performed on the vehicle window. The vehicle display screen is a physical display screen, and is an important component of the in-vehicle infotainment system. Multiple display screens can be provided in the cabin, such as a digital instrument display screen, a central control screen, a display screen in front of a passenger (also referred to as a front passenger) at a co-driver position, a display screen in front of a left rear passenger, and a display screen in front of a right rear passenger. The head up display is also referred to as a head-up display system. For example, used for displaying driving information such as speed, navigation, etc. on a display device (such as a windshield glass) in front of a driver. To reduce the time of visual line shift of the driver, avoid pupil changes caused by visual line shift of the driver, and improve driving safety and comfort. The HUD includes, for example, a combiner-HUD (C-HUD) system, a windshield-HUD (W-HUD) system, and an augmented reality HUD (AR-HUD).
[0060] Some or all functions of the vehicle 100 can be controlled by the computing platform 150. The computing platform 150 can include one or more processors, such as processors 151 through 15n (n being a positive integer), which are circuits having a processing capability for signals. In one implementation, the processors can be circuits having an instruction reading and running capability, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a kind of microprocessor), a digital signal processor (DSP), and the like. In another implementation, the processors can be circuits having a certain function implemented by a fixed or reconfigurable logic relationship of hardware circuits, such as an application-specific integrated circuit (ASIC) or a programmable logic device (PLD) implemented hardware circuit, such as a field programmable gate array (FPGA). In the reconfigurable hardware circuit, the processor loads a configuration document to implement the hardware circuit configuration, which can be understood as the process of the processor loading instructions to implement the functions of the above part or all units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as a kind of ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), and the like. In addition, the computing platform 150 can further include a memory for storing instructions, and some or all of the processors 151 through 15n can call the instructions in the memory and execute the instructions to implement corresponding functions.
[0061] In the embodiments of the present application, the processor can process the vehicle surrounding environment information obtained from the perception system 120, or the processor can process the voice information of the driver and passenger obtained from the perception system 120, and determine to acquire the two-dimensional code information and generate the two-dimensional code. Further, the processor can also control the two-dimensional code to be displayed on the vehicle window. In some possible implementation manners, the above two-dimensional code information and two-dimensional code can also be stored in the memory in the computing platform 150 in the form of data.
[0062] It should be understood that the above operations can be performed by the same processor, or can also be performed by multiple processors, and the embodiments of the present application do not make specific limitations.
[0063] It should be understood that the above components are only an example, and in the specific implementation process, the components in each module can be added or deleted according to actual needs, Figure 1 It should not be understood as a limitation on the embodiments of the present application.
[0064] Figure 2 A schematic diagram of a vehicle cabin scene is provided in the embodiments of the present application. One or more cameras can be installed inside or outside the intelligent cabin to capture images inside or outside the cabin, for example, the camera of the driver monitoring system (DMS), the camera of the cabin monitoring system (CMS), and the camera of the dashcam, Figure 2 Take the camera arranged at the A-pillar as an example. The camera for capturing images inside and outside the cabin can be the same camera or different cameras. In addition, a vehicle display screen is arranged inside the cabin, Figure 2 Take the display screen arranged in the center control area as an example, the vehicle display screen can be used to display relevant information. It should be understood that the position of the camera for collecting image information in the cabin in the embodiments of the present application is not specifically limited. The camera can be located Figure 2 as shown in the A-pillar, or below the steering wheel, or on the B-pillar, or near the rearview mirror, etc.
[0065] As described above, in more and more scenarios, the driver and passenger in the vehicle need to display a two-dimensional code (such as a payment code or a health code) to the outside. In the process of displaying the two-dimensional code by the driver and passenger, the vehicle window needs to be opened for a long time. In poor weather outside, or in the context of the epidemic, opening the window for a long time may affect the comfort of the driver and passenger, and even lack a certain safety. In particular, when the cabin of the vehicle needs to maintain a negative pressure environment, the window cannot be opened to display information such as a two-dimensional code. In view of this, the embodiments of the present application provide a method, device and mobile carrier for controlling display, which can use the vehicle window as a medium to display two-dimensional code information, realize contactless two-dimensional code verification, and help to improve the comfort and safety of the driver and passenger.
[0066] Figure 3 A schematic diagram of a system framework for controlling display is shown in the embodiments of the present application. As Figure 3As shown, the system includes a perception module, a two-dimensional code generation module, an optical projection module, a display module, and a payment code generator, a health code generator, and an account application device. Among them, the perception module sends the obtained instructions or information to the two-dimensional code generation module to trigger it to generate a two-dimensional code. Exemplarily, the two-dimensional code generation module obtains two-dimensional code information from at least one of the payment code generator, the health code generator, and the account application device according to the instructions or information obtained from the perception module, and then generates a two-dimensional code and sends it to the optical projection module. The optical projection module projects the two-dimensional code into the display module, such as the front windshield, the rear windshield, the driver's side window (also known as the left front window), the passenger's side window (also known as the right front window), the second row left side window (also known as the left rear window), the second row right side window (also known as the right rear window), etc. In an example, the perception module can include Figure 1 As shown in the perception system 120, the perception module can include a sound sensor, and the instructions obtained by the perception module can include voice instructions in the cabin of the vehicle; or the perception module can include a touch screen sensor, and the instructions obtained by the perception module can include Figure 2 As shown, the vehicle display screen or the human machine interface (HMI) detects a click signal; or the perception module can include a physical function key, and the instructions obtained by the perception module can include a signal detected by the physical function key, such as a steering wheel dial signal. In some possible implementations, the perception module can include Figure 1 As shown, the perception system 120 includes one or more cameras, and then the camera obtains an image and sends it to the two-dimensional code generation device. The two-dimensional code generation device performs text recognition on the picture to obtain the instruction "please show the two-dimensional code". In another example, the two-dimensional code generation module can include Figure 1 As shown, the one or more processors in the computing platform 150, the optical projection module can include Figure 1 As shown, the one or more processors in the computing platform 150, the display module can also include Figure 1 As shown, the one or more display devices in the display device 130.
[0067] It should be understood that the above-mentioned modules and devices are only one example, and in actual application, the above-mentioned modules and devices can be added or deleted according to actual needs.
[0068] Figure 4 A schematic flowchart of a method for controlling display provided by an embodiment of the present application is shown. The method 400 can be applied to Figure 1 As shown in the vehicle 100 or Figure 2 As shown in the cabin, the method can also be executed by Figure 3 As shown, the system. The method includes:
[0069] S410, generate first image information according to the received first instruction and identity information of the first user in the cabin of the vehicle.
[0070] Exemplarily, the vehicle can include the vehicle 100 in the above-mentioned embodiments. The first user can be a primary driver or a user at another position in the cabin of the vehicle. The identity information can include, but is not limited to, biometric information stored in the vehicle, and an account, etc. The biometric information can include, but is not limited to, fingerprint, palmprint, voice information, face information, iris information, gait information, etc. The account can include account information for logging into a vehicle system, etc. The first image information can include a two-dimensional code (such as a payment code, a health code) associated with the first user; or can also include other images or information that need to be displayed to machines or personnel outside the vehicle, such as relevant access certificates, etc.; or the first image information can also include an interface image containing a two-dimensional code, for example, an interface containing a health code that pops up on a mobile terminal after the first user scans a site code using the mobile terminal.
[0071] In some possible implementations, the identity information of one or more users is stored in the vehicle, and if the identity information of the first user matches the identity information of the one or more users, the first image information can be generated according to the received first instruction and the identity information of the first user.
[0072] Exemplarily, the first instruction can include, but is not limited to, a voice instruction, an instruction generated according to an input to a vehicle screen, an instruction generated according to an operation on a physical function key (such as a dial lever, a button, etc.), and an instruction generated according to an image recognition result.
[0073] Firstly, a voice instruction of a user, for example, the vehicle can acquire audio of the voice instruction through a sound sensor, and analyze the voice semantics of "please display the first image information" through a processing device.
[0074] Secondly, an instruction generated according to an input to a vehicle screen, for example, when the vehicle screen is in a main desktop page, a right sliding signal on the screen of an electronic device is detected by a touch sensor, and then an instruction for controlling the vehicle to generate the first image information is generated according to the right sliding signal.
[0075] Thirdly, an instruction generated according to an operation on a physical function key, for example, when a pressing signal is collected by a pressure sensor at a dial lever of the vehicle, a processing device (such as a processor) of the vehicle can process the pressing signal and perform corresponding control, for example, the processing device of the vehicle can generate an instruction for controlling the vehicle to generate the first image information according to the pressing signal.
[0076] Fourthly, the instruction generated according to the image recognition result, for example, the vehicle's camera shoots the flat of the vehicle's surrounding environment, the image is recognized by the processing device, the text information of "please display the first image information" is obtained, and then the instruction of controlling the vehicle to generate the first image information is generated according to the text information.
[0077] S420, the first window of the vehicle displays the first image information.
[0078] Exemplarily, the first window can include at least one of the front windshield, the left front window, the right front window, the left rear window, and the right rear window.
[0079] Optionally, the first window displays the first image information according to the first position of the first user in the cabin corresponding to the first window.
[0080] Exemplarily, "the first position corresponding to the first window" can include: the first position can be a main driving position, and the first window can be the window at the main driving position and / or the front windshield in the above-mentioned embodiments, that is, the main driving position corresponds to the window at the main driving position; the first position can be a co-driver position, and the first window can be the window at the co-driver position and / or the front windshield in the above-mentioned embodiments, that is, the co-driver position corresponds to the window at the co-driver position; the first position can be a second-row left position of the vehicle, and the first window can be the second-row left window in the above-mentioned embodiments, that is, the second-row left position corresponds to the second-row left window; the first position can be a second-row right position of the vehicle, and the first window can be the second-row right window in the above-mentioned embodiments, that is, the second-row right position corresponds to the second-row right window.
[0081] Exemplarily, the method for determining the first position of the first user in the cabin includes but is not limited to: determining the first position of the first user by a sound wave sensor; determining the first position of the first user by a camera or an in-cabin visual sensor; determining the first position of the first user by a pressure sensor arranged at a seat.
[0082] Exemplarily, the vehicle can determine the actual position of the first user in the cabin according to the audio information obtained by the sound wave sensor. The audio information can be obtained by excluding various invalid audio information from the collected audio information in the vehicle, and the invalid audio information can be audio information with too low volume. The sound source position can be the position of the sound source corresponding to the audio information, which can be the relative position of the vehicle screen based on the sound source positioning, or a specific position coordinate.
[0083] Exemplarily, the position of the sound source can be determined based on the audio information collected by multiple sound wave sensors according to the time difference of arrival (TDOA) principle. For example, sound wave sensors A and B respectively detect that audio is emitted from the sound source S, where the time at which the sound source signal of the sound source S arrives at the sound wave sensor A is t1, and the time at which the sound source signal of the sound source S arrives at the sound wave sensor B is t2, then the time difference dt = |t1-t2|, assuming that the distance between the sound source S and the sound wave sensor A is AS, the distance between the sound source S and the sound wave sensor B is BS, and the speed of sound is c, then dt = t1-t2 = AS / c-BS / c can be obtained, and then the position of the sound source can be determined according to the distance a between the two sound wave sensors and by selecting one of the sensors as a reference point.
[0084] Exemplarily, the first position of the first user is determined by a camera or an in-cabin visual sensor, specifically, the facial information of the user obtained by the camera or the in-cabin visual sensor is used to determine the actual position of the user in the cabin. The camera or the in-cabin visual sensor includes but is not limited to a camera sensor integrated or installed on a vehicle screen or a camera sensor installed inside a vehicle cabin, for example, a red green blue (RGB) camera, a red green blue-infrared radiation (RGB-IR) camera, or a time of flight (TOF) camera.
[0085] In some possible implementations, whether a user is seated at a seat can also be detected by a laser radar integrated or installed on a vehicle screen or a laser radar installed inside a vehicle cabin, a radio transceiver (including but not limited to a millimeter wave radar or a centimeter wave radar) on a vehicle screen or at the edge of a vehicle screen, an infrared sensing device (including but not limited to an infrared range finder or a laser range finder) integrated on a vehicle screen or at the edge of a vehicle screen, an eye tracker, and the like, and then the actual position of the user in the cabin is determined.
[0086] Exemplarily, the first position of the first user is determined by a pressure sensor arranged at a seat, specifically, when the pressure at a seat is greater than or equal to a preset threshold, it is determined that a user is seated at the seat. Exemplarily, the preset threshold can be 100 Newton (N), or 200 N, or other values.
[0087] Optionally, the first window displays the first image information according to a second position of a device for detecting or identifying the first image information, and the second position corresponds to the first window.
[0088] Exemplarily, when the second position is a position in front of the vehicle, the first window can be the front windshield; when the second position is a position on the left side of the vehicle, the first window can be the driver-side window and / or the second-row left-side window; when the second position is a position on the right side of the vehicle, the first window can be the passenger-side window and / or the second-row right-side window.
[0089] In some possible implementation manners, the first window is controlled to display the first image according to a first position of the first user in the cabin and a second position of the device detecting or recognizing the first image information. In an example, when the first position is the driver position, it is preliminarily determined to display the first image on the front windshield and / or the left front window. Further, when the second position is a position on the left side of the vehicle, it is determined to display the first image on the left front window, i.e., the first window is the left front window.
[0090] Optionally, the first window of the vehicle displays the first image information, including: controlling a first area of the first window to display the first image information, the first area corresponding to a third position of the first user in the cabin.
[0091] Exemplarily, the first window includes the front windshield, and the front windshield can include a first area, a second area and a third area. The first area is a left-side area of the front windshield, corresponding to the driver position; the second area is a right-side area of the front windshield, corresponding to the passenger position; and the third area is a middle area of the front windshield, corresponding to the rear-row position.
[0092] It should be understood that the above-mentioned correspondence between the "position" and the "first window" or the "first area of the first window" is only exemplary, and the correspondence between them can be in other forms in the specific implementation process.
[0093] Optionally, the control of the first window of the vehicle to display the first image information includes: controlling the first image information to be displayed on the first window by the HUD.
[0094] In some possible implementation manners, the first image information can be displayed on the first vehicle window by a thin film transistor liquid crystal display (TFT) technology, that is, information is projected after light emitted by a light emitting diode (LED) passes through a liquid crystal unit; or the first image information can be displayed on the first vehicle window by a digital light processing (DLP) technology; or the first image information can be projected on the first vehicle window by using a laser scanning micro-electro-mechanical system (MEMS) projection system, where the laser scanning MEMS projection system takes a red, green and blue (RGB) single-color laser with high power as a light source, and the laser is projected on a display screen after being integrated and scanned by corresponding optical elements and processing chips.
[0095] Optionally, after the first vehicle window is controlled to display the first image information, a position of the first vehicle window and / or content of the first image information is prompted.
[0096] Optionally, in response to the first input of the first user, the first vehicle window is controlled to switch to a second vehicle window of the vehicle to display the first image information.
[0097] For example, the first input can be a voice instruction input, or a voice instruction input by a physical function key, or an input to a vehicle-mounted screen.
[0098] For example, the second vehicle window can include at least one vehicle window different from the first vehicle window in a front windshield, a rear windshield, a driver's seat vehicle window, a front passenger seat vehicle window, a rear left vehicle window of the cabin, and a rear right vehicle window of the cabin.
[0099] The method for controlling display provided in the embodiments of the present application can display information externally by taking a vehicle window as a medium, implement contactless information verification, and help improve the comfort and safety of a driver and a passenger.
[0100] The following will be described in detail Figures 5 to 7 The method 400 will be described in detail in different application examples.
[0101] In an example, when a vehicle wants to enter a certain community or a certain parking lot, the vehicle can be prompted to display a QR code on a vehicle window, and a user can scan the QR code by using a mobile phone to verify information of the vehicle. Figure 5As shown in (a), when a vehicle approaches a barrier gate (or vehicle stop), the gate arm support displays "Please show your health code" as shown in 501. The vehicle can then use a camera to capture images of its exterior and extract the "Please show your health code" message from the captured images. Based on the identity information of the first user in the vehicle, the vehicle can then obtain the first user's health code information. Alternatively, after seeing the content shown in 501, the first user can issue a voice command, "Please display your health code on the windshield." Upon receiving the voice command, the vehicle can then obtain the first user's health code information based on their identity information.
[0102] In another example, when a vehicle is about to leave a parking lot, such as Figure 5 As shown in (b), when a vehicle approaches the barrier gate (or parking barrier), the gate arm bracket displays the message "You have been parked for 6 hours and 22 minutes, a payment of 21 yuan is required. Please show your payment code." The vehicle can then use a camera to capture images of its exterior and extract the "Please show your payment code" message. Based on the identity information of the first user in the vehicle, the vehicle can then retrieve the first user's payment code. Alternatively, after seeing the message displayed in image (502), the first user can issue a voice command, "Please display the payment code on the windshield." Upon receiving the voice command, the vehicle can then retrieve the first user's payment code based on their identity information.
[0103] For example, if the first user's health code information or payment code information is stored in the vehicle, the vehicle can search for and determine the first user's health code information or payment code information in the vehicle based on the first user's identity information; or, if the first user's health code information or payment code information is stored in the first user's mobile terminal, the vehicle can obtain the first user's health code information or payment code information from the first user's mobile terminal based on the first user's identity information.
[0104] For example, before obtaining the first user's health code or payment code information based on the first user's identity information, the first user's identity information can be verified first. For instance, the first user's identity can be identified based on voice commands or captured facial images.
[0105] Furthermore, the vehicle control displays the first image information generated based on the first user's health code information or payment code information on the first vehicle window.
[0106] In one example, the vehicle controls the display of a first image on the windshield, for example, in the area of the windshield corresponding to the driver's side. This first image information can be displayed in response to a "Please show payment code" instruction, such as... Figure 6The (a) in FIG. 6A shows the view angle in the vehicle cabin, and the first image information can include the payment code 601, or can also include the payment code 601 and the prompt text "Please scan the payment code here" 602. The prompt text is used to prompt the person outside the vehicle that the two-dimensional code displayed on the vehicle window is a payment code. Figure 6 The (b) in FIG. 6A shows the view angle outside the vehicle, and the two-dimensional code 603 and the text 604 are the display effects of the payment code 601 and the prompt text 602 in the view angle outside the vehicle.
[0107] In another example, the first image information can be displayed in response to the instruction "Please show the health code", as shown in Figure 6 The (c) in FIG. 6B shows the view angle in the vehicle cabin, and the first image information can include the health code 605, or can also include the health code 605 and the name information of the user to which the health code belongs "*Kai" 606. Figure 6 The (d) in FIG. 6B shows the view angle outside the vehicle, and the two-dimensional code 607 and the text 608 are the display effects of the health code 605 and the text 606 in the view angle outside the vehicle.
[0108] In another example, the first vehicle window displaying the first image information can be determined according to the location of the prompt board. As shown in Figure 6 The (c) in FIG. 6C shows that the prompt board requiring to show the two-dimensional code information or other information required for passing through is located on the left side of the vehicle, and the left front window and / or the left rear window can be controlled to display the first image information.
[0109] In another example, the first vehicle window displaying the first image information can be determined according to the voice instruction of the first user. As shown in Figure 6 The (e) in FIG. 6D shows that the first user includes the user at the driver's seat, and when the voice instruction "Please display the health code on the left front window" issued by the user at the driver's seat is detected, the left front window is controlled to display the first image information, as shown in the (f) in FIG. 6D. Figure 6 Alternatively, the first vehicle window can be determined according to the region where the voice instruction "Please display the two-dimensional code on the vehicle window" is detected. For example, if the voice instruction comes from the driver's area, the vehicle window at the driver's seat (i.e., the left front window in the above embodiment) is determined as the first vehicle window; or if the voice instruction comes from the co-driver's area, the vehicle window at the co-driver's seat (i.e., the right front window in the above embodiment) is determined as the first vehicle window. Further, the first image information is controlled to be displayed on the first vehicle window.
[0110] In another example, when there are two or more users in the vehicle, the first vehicle window can be controlled to display the information of the two or more users. For example, there are users "*Kai", "*Qi", "*Fan", and "*Tian" in the vehicle, which are located at the driver's seat, the co-driver's seat, the right side of the second row, and the left side of the second row, respectively. In some possible implementation manners, as shown inFigure 6 As shown in (g) of FIG. 26, the front windshield is controlled to display the health codes of “*empty”, “*meal”, “*weather”, and “*Qi” in turn. In some possible implementation manners, the two or more users’ information can be displayed on multiple vehicle windows. As shown in (h) of FIG. 26, the health codes of the users located at the driver seat, the front passenger seat, the second-row right seat, and the second-row left seat are displayed on the left front window, the right front window, the right rear window, and the left rear window respectively. Figure 6
[0111] In some possible implementation manners, when there are two or more users in the vehicle, after obtaining the two-dimensional code information of each of the two or more users according to the identity information of the two or more users, a two-dimensional code is synthesized according to the two-dimensional code information of the two or more users, and the vehicle window is controlled to display the two-dimensional code.
[0112] In some possible implementation manners, when there are two or more users in the vehicle, only the two-dimensional code associated with the driver user can be displayed. For example, after generating the two-dimensional code according to the identity information of the driver user, the vehicle window is controlled to display the two-dimensional code.
[0113] In some possible implementation manners, when entering a certain place, a specific two-dimensional code can be scanned by staff or machines for registration (or verification). Exemplarily, the “specific two-dimensional code” is a two-dimensional code specific to the place, which identifies information such as the location and name of the place, and after the user scans the specific two-dimensional code, the information of the person entering or leaving the place can be automatically registered. In some implementations, the “specific two-dimensional code” can be referred to as a “place code”. In the above scenario, after scanning the specific two-dimensional code, a two-dimensional code or other registration code with time information is generated for verification by the machines or staff of the place. In the embodiments of this application, the user in the vehicle scans the specific two-dimensional code using the mobile terminal, and after the mobile terminal generates a two-dimensional code or other registration code with time information, the vehicle can control to display the two-dimensional code or other registration code with time information. As shown in (a) of FIG. 27, the vehicle drives to a barrier (or barrier), and the barrier rod support of the barrier displays “please scan the two-dimensional code” as shown in 701. Further, as shown in (b) of FIG. 27, the user in the vehicle scans the two-dimensional code using the mobile terminal according to the prompt of 701, and jumps to the interface as shown in (c) of FIG. 27. In this embodiment, the interface as shown in (c) of FIG. 27 is a two-dimensional code interface, and the two-dimensional code interface displays the two-dimensional code with time information as shown in 702. Figure 7 Figure 7 Figure 7 Figure 7 The interface shown in (c) includes the health code 702, the user's name information (null) 703, the health code status information (green code) 704, the time information (xxxx.xx.xx xx:xx:xx) 705, and the place name information (xx mall) 706. Further, the mobile terminal sends the information contained in the interface to the vehicle. Further, as shown in (d), the vehicle controls the display of the health code shown in 702 on the vehicle window. In some possible implementations, the vehicle can also control the display of the interface shown in (c) on the vehicle window. Figure 7 The interface shown in (c) includes the health code 702, the user's name information (null) 703, the health code status information (green code) 704, the time information (xxxx.xx.xx xx:xx:xx) 705, and the place name information (xx mall) 706. Further, the mobile terminal sends the information contained in the interface to the vehicle. Further, as shown in (d), the vehicle controls the display of the health code shown in 702 on the vehicle window. In some possible implementations, the vehicle can also control the display of the interface shown in (c) on the vehicle window. Figure 7 The interface shown in (c) includes the health code 702, the user's name information (null) 703, the health code status information (green code) 704, the time information (xxxx.xx.xx xx:xx:xx) 705, and the place name information (xx mall) 706. Further, the mobile terminal sends the information contained in the interface to the vehicle. Further, as shown in (d), the vehicle controls the display of the health code shown in 702 on the vehicle window. In some possible implementations, the vehicle can also control the display of the interface shown in (c) on the vehicle window.
[0114] It should be understood that the method of controlling the display in the above embodiments is described by taking the 5-seater vehicle shown in Figure 2 as an example, and the embodiments of the present application are not limited thereto. For example, for a 7-seater sport / suburban utility vehicle (SUV), a vehicle with more than 7 seats, the first vehicle window can further include more vehicle windows.
[0115] In each of the embodiments of the present application, the terms and / or descriptions between the embodiments are consistent and can be mutually referred to if there is no special description and logical conflict, and the technical features in different embodiments can be combined to form a new embodiment according to their inherent logical relationship.
[0116] The method provided by the embodiments of the present application is described in detail above. The device provided by the embodiments of the present application will be described in detail below. Figures 4 to 7 The method provided by the embodiments of the present application is described in detail above. The device provided by the embodiments of the present application will be described in detail below. Figure 8 The method provided by the embodiments of the present application is described in detail above. The device provided by the embodiments of the present application will be described in detail below. Figure 9 It should be understood that the description of the device embodiments corresponds to the description of the method embodiments, and therefore, the content not described in detail can be referred to the method embodiments described above, and will not be described here again for the sake of brevity.
[0117] Figure 8 A schematic block diagram of a device 2000 for controlling display provided by an embodiment of the present application is shown, which includes a generating unit 2010 and a processing unit 2020.
[0118] Optionally, the device 2000 can further include a storage unit, which can be used to store instructions and / or data, and the processing unit 2020 can read the instructions and / or data in the storage unit, so that the device realizes the foregoing method embodiments.
[0119] The device 2000 can include units for performing the methods in the embodiments of the present application. And each unit in the device 2000 and the other operations and / or functions described above are respectively arranged to implement the corresponding flows of the method embodiments in the embodiments of the present application. Figure 4 The device 2000 can include units for performing the methods in the embodiments of the present application. And each unit in the device 2000 and the other operations and / or functions described above are respectively arranged to implement the corresponding flows of the method embodiments in the embodiments of the present application. Figure 4 The device 2000 can include units for performing the methods in the embodiments of the present application. And each unit in the device 2000 and the other operations and / or functions described above are respectively arranged to implement the corresponding flows of the method embodiments in the embodiments of the present application.
[0120] The apparatus 2000 includes: a generating unit 2010 configured to generate first image information according to a received first instruction and identity information of a first user in a cabin of a vehicle; and a processing unit 2020 configured to control a first window of the vehicle to display the first image information.
[0121] Optionally, the processing unit 2020 is configured to control the first window to display the first image information according to a first position of the first user in the cabin, the first position corresponding to the first window.
[0122] Optionally, the processing unit 2020 is configured to control the first window to display the first image information according to a second position of a device detecting or recognizing the first image information, the second position corresponding to the first window.
[0123] Optionally, the processing unit 2020 is configured to control a first area of the first window to display the first image information, the first area corresponding to a third position of the first user in the cabin.
[0124] Optionally, the processing unit 2020 is configured to control the first image information to be displayed on the first window by a HUD.
[0125] Optionally, the apparatus further includes a prompting unit configured to prompt a position of the first window and / or content of the first image information.
[0126] Optionally, the processing unit 2020 is configured to control the first image information to be displayed on a second window of the vehicle by switching from the first window in response to a first input of the first user.
[0127] Optionally, the first window includes at least one of: a front windshield, a rear windshield, a driver-side window, a front passenger-side window, a rear left window of the cabin, and a rear right window of the cabin.
[0128] Optionally, the first instruction includes at least one of: a voice instruction, an instruction generated according to an input to an in-vehicle screen of the vehicle, an instruction generated according to an operation of a physical function key of the vehicle, and an instruction generated according to an image recognition result.
[0129] Optionally, the first image information includes a two-dimensional code image.
[0130] It should be understood that the division of units in the above apparatus is only a logical functional division, and all or part of the units can be integrated into a physical entity, or can be physically separated. In addition, the units in the apparatus can be implemented in the form of processor calling software; for example, the apparatus includes a processor, the processor is connected with a memory, the memory stores instructions, and the processor calls the instructions stored in the memory to implement any one of the above methods or to realize the functions of the units of the apparatus, wherein the processor is, for example, a general processor such as a CPU or a microprocessor, and the memory is a memory in the apparatus or a memory outside the apparatus. Alternatively, the units in the apparatus can be implemented in the form of hardware circuit, and the functions of part or all of the units can be realized by the design of the hardware circuit, which can be understood as one or more processors; for example, in one implementation, the hardware circuit is an ASIC, and the functions of part or all of the units are realized by the design of the logical relationship of elements in the circuit; for example, in another implementation, the hardware circuit is a PLD, and taking FPGA as an example, it can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured by a configuration file, so as to realize the functions of part or all of the units. All units of the above apparatus can be implemented in the form of processor calling software, or all units can be implemented in the form of hardware circuit, or part of the units are implemented in the form of processor calling software, and the remaining part is implemented in the form of hardware circuit.
[0131] In the embodiments of the present application, the processor is a circuit with signal processing capability. In one implementation, the processor can be a circuit with instruction reading and running capability, such as CPU, microprocessor, GPU, or DSP, etc. In another implementation, the processor can realize certain functions through the logical relationship of hardware circuit, and the logical relationship of the hardware circuit is fixed or can be reconfigured, such as ASIC or PLD implemented hardware circuit, such as FPGA. In the reconfigurable hardware circuit, the processor loads the configuration document to realize the hardware circuit configuration process, which can be understood as the process of the processor loading instructions to realize the functions of part or all of the units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as a kind of ASIC, such as NPU, TPU, DPU, etc.
[0132] It can be seen that each unit in the above apparatus can be one or more processors (or processing circuits) configured to implement the above methods, such as CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.
[0133] Furthermore, the units in the above devices can be integrated in whole or in part, or they can be implemented independently. In one implementation, these units are integrated together as a system-on-a-chip (SOC). The SOC may include at least one processor for implementing any of the above methods or implementing the functions of the units in the device. The at least one processor may be of different types, such as CPU and FPGA, CPU and artificial intelligence processor, CPU and GPU, etc.
[0134] In practical implementation, the operations performed by the generation unit 2010 and the processing unit 2020 can be executed by the same processor, or they can be executed by different processors, for example, by multiple processors respectively. As an example, one or more processors can... Figure 1 The system connects to one or more sensors in the perception system 120 to acquire and process user facial or voice information. Alternatively, one or more processors generate first image information based on the user's facial or voice information; or, one or more processors can be connected to one or more windows in the display device 130 to control the windows to display the first image information. Exemplarily, in a specific implementation, the aforementioned one or more processors can be processors installed in the vehicle's infotainment system, or processors installed in other in-vehicle terminals. Exemplarily, in a specific implementation, the aforementioned device 2000 can be a chip installed in the vehicle's infotainment system or other in-vehicle terminals. Exemplarily, in a specific implementation, the aforementioned device 2000 can be a chip installed in the vehicle's infotainment system or other in-vehicle terminals. Exemplarily, in a specific implementation, the aforementioned device 2000 can be a chip installed in a vehicle, such as... Figure 1 The computing platform 150 shown.
[0135] This application also provides an apparatus comprising a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to cause the apparatus to perform the methods or steps described in the above embodiments.
[0136] Figure 9 This is a schematic block diagram of a display control device according to an embodiment of this application. Figure 9 The control and display device 2100 shown may include a processor 2110, a transceiver 2120, and a memory 2130. The processor 2110, transceiver 2120, and memory 2130 are connected via internal interconnection. The memory 2130 stores instructions, and the processor 2110 executes the instructions stored in the memory 2130 to receive / send certain parameters via the transceiver 2120. Optionally, the memory 2130 may be coupled to the processor 2110 via an interface or integrated with the processor 2110.
[0137] It should be noted that the transceiver 2120 described above can include, but is not limited to, a transceiver device such as an input / output interface to realize the communication between the device 2100 and other devices or communication networks.
[0138] In the implementation process, the steps of the above method can be completed by the integrated logic circuit of hardware in the processor 2110 or the instructions in the form of software. The method disclosed in combination with the embodiments of the present application can be directly embodied as hardware processor execution completion, or executed by a combination of hardware and software modules in the processor. The software module can be located in a mature storage medium in the art such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, register, etc. The storage medium is located in the storage 2130, and the processor 2110 reads the information in the storage 2130, and combines the hardware to complete the steps of the above method. To avoid repetition, it will not be described in detail here.
[0139] The processor 2110 can adopt a general-purpose CPU, microprocessor, ASIC, GPU or one or more integrated circuits for executing related programs to realize the method of the method embodiment of the present application. The processor 2110 can also be an integrated circuit chip with signal processing capability. In the specific implementation process, the steps of the method of the present application can be completed by the integrated logic circuit of hardware in the processor 2110 or the instructions in the form of software. The above processor 2110 can also be a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component. The disclosed methods, steps and logic block diagrams in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as hardware decoding processor execution completion, or executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the art such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, register, etc. The storage medium is located in the storage 2130, and the processor 2110 reads the information in the storage 2130, and combines the hardware to execute the method of the method embodiment of the present application.
[0140] The storage 2130 can be a read only memory (ROM), a static storage device, a dynamic storage device or a random access memory (RAM).
[0141] The transceiver 2120 uses a transceiving device such as, but not limited to, a transceiver, to enable communication between the device 2100 and other devices or communication networks.
[0142] The embodiment of the present application further provides a mobile carrier, which can include the device 2000 or the device 2100.
[0143] Exemplarily, the mobile carrier can be the vehicle in the above embodiment.
[0144] The embodiment of the present application further provides a computer program product, which includes computer program codes, when the computer program codes are executed on a computer, the computer is caused to execute the method in the above Figure 4 .
[0145] The embodiment of the present application further provides a computer readable storage medium, which stores program codes or instructions, when the computer program codes or instructions are executed by a processor of a computer, the processor is caused to execute the method in the above Figure 4 .
[0146] The embodiment of the present application further provides a chip, which includes at least one processor and a memory, the at least one processor is coupled with the memory, and is used to read and execute instructions in the memory, so as to execute the method in the above Figure 4 .
[0147] It should be understood that, for the convenience and brevity of description, the specific working processes and beneficial effects of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be described herein.
[0148] In the implementation process, each step of the above method can be completed by integrated logic circuits of hardware in the processor or instructions in the form of software. The method disclosed in the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software modules in the processor for execution. The software module can be located in a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, or other mature storage media in the art. The storage medium is located in the memory, and the processor reads the information in the memory and combines the hardware to complete the steps of the above method. To avoid repetition, it will not be described in detail here.
[0149] It should be understood that, in the embodiment of the present application, the memory can include a read-only memory (ROM), a random access memory (RAM), and provide instructions and data to the processor.
[0150] The terminology used in the description of the embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the description of the embodiments and the appended claims herein, the singular forms "a", "an" and "the" are intended to include both singular and plural forms, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items. As used herein, the term "at least one of' is intended to mean one or more of the listed items can be present and does not require that one or more of the listed items be present.
[0151] Reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" or "in other embodiments" or "in still other embodiments" in various places throughout this specification are not necessarily all referring to the same embodiment, unless otherwise specifically stated. The terms "including," "comprising," "having" and variations thereof herein are meant to be open-ended terms that can cover the presence of subs tants of one or more features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0152] Those skilled in the art can clearly understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.
[0153] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the system, device and unit described above can refer to the corresponding processes in the foregoing method embodiments, which will not be described here.
[0154] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other manners. For example, the described device embodiments are merely schematic. For example, the division of the units is only a logical function division. There can be another division manner for the actual implementation, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections between the units can be indirect couplings or communication connections through some interfaces, devices or units, and can be electrical, mechanical or in other forms.
[0155] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., can be located in one place, or can be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
[0156] In addition, each functional unit in the various embodiments of the present application can be integrated into a processing unit, or each unit can be a physically independent unit, or two or more units can be integrated into a unit.
[0157] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of a software product in essence or part of the technical solutions. The computer software product is stored in a storage medium, and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk, and various program codes that can be stored in the medium.
[0158] The above is merely specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A method of controlling a display, characterized by, The method comprises: generating first image information according to a received first instruction and identity information of a first user in a cabin of a vehicle; determining a first window of the vehicle for carrying information according to a position correspondence relationship between a second position where a device for detecting or recognizing the first image information is located and a position between a window of the vehicle; controlling a projection device of the vehicle to project the first image information on the first window of the vehicle; wherein the first window corresponds to the second position where the device for detecting or recognizing the first image information is located.
2. The method of claim 1, wherein, The control of the projection device of the vehicle to project the first image information on the first window of the vehicle comprises: controlling the projection device of the vehicle to project the first image information on a first area of the first window, the first area corresponding to a third position of the first user in the cabin.
3. The method according to claim 1 or 2, characterized in that, The method further comprises: prompting a position of the first window and / or content of the first image information.
4. The method according to any one of claims 1 to 3, characterized in that, The method further comprises: in response to a first input of the first user, controlling the projection device of the vehicle to switch from the first window to a second window of the vehicle to project the first image information.
5. The method according to any one of claims 1 to 4, characterized in that, The first window comprises at least one of: a front windshield, a rear windshield, a driver's side window, a front passenger's side window, a rear left side window of the cabin, and a rear right side window of the cabin.
6. The method according to any one of claims 1 to 5, characterized in that, The first instruction comprises at least one of: a voice instruction, an instruction generated according to an input to an on-board screen of the vehicle, and an instruction generated according to an operation of a physical function key of the vehicle.
7. The method according to any one of claims 1 to 6, characterized in that, The first image information comprises a two-dimensional code image.
8. An apparatus for controlling display, characterized by comprising: The method comprises: generating first image information according to a received first instruction and identity information of a first user in a cabin of a vehicle; determining a first window of the vehicle for carrying information according to a position correspondence relationship between a second position where a device for detecting or recognizing the first image information is located and a position between a window of the vehicle; The processing unit is further configured to control a projection device of the vehicle to project the first image information on the first window of the vehicle.
9. The apparatus of claim 8, wherein, The processing unit is configured to: control the projection device of the vehicle to project the first image information on a first area of the first window, the first area corresponding to a third position of the first user in the cabin.
10. The apparatus of claim 8 or 9, wherein, The device further comprises a prompting unit configured to: prompt a position of the first window and / or content of the first image information.
11. The apparatus of any one of claims 8-10, wherein, The processing unit is configured to: in response to a first input of the first user, control the projection device of the vehicle to switch from the first window to a second window of the vehicle to project the first image information.
12. The apparatus of any one of claims 8-11, wherein, The first window comprises at least one of: a front windshield, a rear windshield, a driver's side window, a front passenger's side window, a rear left side window of the cabin, and a rear right side window of the cabin.
13. The apparatus of any one of claims 8-12, wherein, The first instruction comprises at least one of: a voice instruction, an instruction generated according to an input to an on-board screen of the vehicle, and an instruction generated according to an operation of a physical function key of the vehicle.
14. The apparatus of any one of claims 8-13, wherein, The first image information comprises a two-dimensional code image.
15. An apparatus for controlling display, characterized by comprising: The method comprises: a memory for storing a computer program; a processor for executing the computer program stored in the memory to cause the apparatus to perform the method of any one of claims 1 to 7.
16. A mobile carrier, characterized in that an apparatus comprising any one of claims 8 to 15.
17. The mobile carrier of claim 16, wherein, the mobile carrier is a vehicle.
18. A computer-readable storage medium, characterized in that, instructions stored thereon that, when executed by a processor, cause the processor to implement the method of any one of claims 1 to 7.
19. A chip, characterized by the chip comprises a processor and a data interface, the processor reading instructions stored on a memory through the data interface to execute the method of any one of claims 1 to 7.
Citation Information
Patent Citations
Screen projection method and device
CN112861638A
Intelligent vehicle window display system based on V2N
CN216268696U
Display device for vehicle
JP2019184972A