Control method and device applied to vehicle-mounted projection system, and vehicle-mounted projection system

Abstract

The present disclosure provides a control method and device applied to a vehicle-mounted projection system, an electronic device, a vehicle-mounted projection system, a vehicle, a computer readable storage medium and a computer program product, relating to the technical field of intelligent vehicles, in particular to the technical field of vehicle-mounted audio-visual equipment. The control method comprises: in response to the projector being turned on, controlling the front windshield to be in a fogging state and to be in a target pose; and in response to the projector being turned off, controlling the front windshield to be in a transparent state and to be in an initial pose. The technical scheme of the embodiment of the present disclosure utilizes the front windshield in the target pose and in the fogging state as a projection screen, which can provide passengers with a better viewing experience, thereby improving the passenger's ride experience.

Description

Technical Field

[0001] This disclosure relates to the field of intelligent vehicle technology, and more particularly to the field of in-vehicle audio-visual equipment technology, specifically to a control method and device for an in-vehicle projection system, electronic equipment, an in-vehicle projection system, a vehicle, a computer-readable storage medium, and a computer program product. Background Technology

[0002] As vehicles become increasingly intelligent, the audio-visual equipment they are equipped with is also becoming more abundant. How to provide passengers with a better viewing experience is an important research direction for those skilled in the art.

[0003] The technical means described in this section are not necessarily those previously conceived or employed. Unless otherwise specified, no technical means described in this section should be assumed to be prior art simply because it is included in this section. Similarly, unless otherwise specified, the issues mentioned in this section should not be considered to be generally accepted in any prior art. Summary of the Invention

[0004] This disclosure provides a control method and apparatus for vehicle-mounted projection systems, electronic devices, vehicle-mounted projection systems, vehicles, computer-readable storage media, and computer program products.

[0005] According to one aspect of this disclosure, a control method for an in-vehicle projection system is provided, comprising: controlling the windshield to be in a fogged state and in a target pose in response to the projector being turned on; and controlling the windshield to be in a transparent state and in an initial pose in response to the projector being turned off.

[0006] According to one aspect of this disclosure, a control device for an in-vehicle projection system is provided, comprising: a first control unit configured to control the windshield to be in a fogged state and in a target pose in response to the projector being turned on; and a second control unit configured to control the windshield to be in a transparent state and in an initial pose in response to the projector being turned off.

[0007] According to one aspect of this disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the control method described in the foregoing aspect.

[0008] According to one aspect of this disclosure, an in-vehicle projection system is provided, comprising: a windshield capable of switching between a transparent state and a fogged state; an adjustment mechanism for adjusting the windshield to a target pose or an initial pose; a projector for projecting an image onto the windshield; and an electronic device according to the foregoing aspect.

[0009] According to one aspect of this disclosure, a vehicle is provided, including the aforementioned vehicle-mounted projection system.

[0010] According to one aspect of this disclosure, a computer-readable storage medium is provided storing computer instructions configured to cause a computer to perform the control method described in the foregoing aspect.

[0011] According to one aspect of this disclosure, a computer program product is provided, comprising a computer program, wherein the computer program, when executed by a processor, implements the control method described in the foregoing aspect.

[0012] According to one or more embodiments of this disclosure, a windshield in a target position and in a fogged state can be used as a projection screen to provide passengers with a better viewing experience and enhance their riding experience.

[0013] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0014] The accompanying drawings exemplify embodiments and form part of the specification, serving together with the textual description to explain exemplary implementations of the embodiments. The illustrated embodiments are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0015] Figure 1 A schematic diagram of an exemplary system in which various methods described herein may be implemented according to some embodiments of the present disclosure is shown;

[0016] Figure 2 A schematic diagram illustrating the structure and working principle of an in-vehicle projection system according to some embodiments of the present disclosure is shown;

[0017] Figure 3 A flowchart is shown showing a control method applied to an in-vehicle projection system according to some embodiments of the present disclosure;

[0018] Figure 4A A schematic diagram showing the adjustment of the angle between the windshield and the center console in some embodiments of this disclosure is shown;

[0019] Figure 4B A schematic diagram is shown of the facial pose angles that can be recognized by facial detection devices in related technologies;

[0020] Figure 5 A schematic diagram illustrating the adjustment of the projection angle of the projector is shown in some embodiments of this disclosure;

[0021] Figure 6 A schematic diagram illustrating the adjustment of the distance between the windshield and the center console in some embodiments of this disclosure is shown;

[0022] Figure 7 A structural block diagram of a control device applied to an in-vehicle projection system according to some embodiments of the present disclosure is shown;

[0023] Figure 8 A schematic diagram of the adjustment mechanism of an in-vehicle projection system according to some embodiments of the present disclosure is shown; and

[0024] Figure 9 A structural block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure is shown. Detailed Implementation

[0025] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding, and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0026] In this disclosure, unless otherwise stated, the use of terms such as "first," "second," etc., to describe various elements is not intended to limit the positional, temporal, or importance relationships of these elements; such terms are merely used to distinguish one element from another. In some examples, the first element and the second element may refer to the same instance of that element, while in other cases, based on the context, they may refer to different instances.

[0027] The terminology used in the description of the various examples in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context explicitly indicates otherwise, an element may be one or more unless the number of elements is specifically limited. Furthermore, the term "and / or" as used in this disclosure covers any one of the listed items and all possible combinations thereof.

[0028] In related technologies, the in-vehicle audio-visual equipment equipped in vehicles is mainly a multimedia display set on the center console or the back of the seat. Its screen is, for example, an LCD screen or an OLED (Organic Light-Emitting Diode) screen. Due to the limitations of installation space and screen display performance, the viewing effect provided to passengers is not ideal. For example, the screen is too small, so rear passengers cannot see clearly, or the screen viewing angle is limited, so some passengers cannot see properly. These situations often occur.

[0029] Based on this, the present disclosure provides a control method and apparatus, electronic device, vehicle projection system, vehicle, computer-readable storage medium and computer program product for use in vehicle projection systems, in order to provide passengers with a better audio-visual viewing experience and thereby enhance the passenger's riding experience.

[0030] The embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0031] Figure 1 A schematic diagram of an exemplary system 100 in which the various methods and apparatus described herein can be implemented according to embodiments of this disclosure is shown. Reference Figure 1 The system 100 includes a motor vehicle 110, a server 120, and one or more communication networks 130 that couple the motor vehicle 110 to the server 120.

[0032] In embodiments of this disclosure, the motor vehicle 110 may include a computing device according to embodiments of this disclosure and / or be configured to perform a method according to embodiments of this disclosure.

[0033] Server 120 may run one or more services or software applications that enable the communication control methods for the vehicles disclosed herein. In some embodiments, server 120 may also provide other services or software applications, which may include non-virtual environments and virtual environments. Figure 1 In the configuration shown, server 120 may include one or more components that implement the functions performed by server 120. These components may include software components, hardware components, or combinations thereof that can be executed by one or more processors. A user of motor vehicle 110 may sequentially interact with server 120 using one or more client applications to utilize the services provided by these components. It should be understood that various different system configurations are possible and may differ from system 100. Therefore, Figure 1 This is an example of a system used to implement the various methods described herein, and is not intended to be limiting.

[0034] Server 120 may include one or more general-purpose computers, special-purpose server computers (e.g., PC (personal computer) servers, UNIX servers, mid-range servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and / or combination. Server 120 may include one or more virtual machines running a virtual operating system, or other computing architectures involving virtualization (e.g., one or more flexible pools of logical storage devices that can be virtualized to maintain virtual storage devices for servers). In various embodiments, server 120 may run one or more services or software applications that provide the functionality described below.

[0035] The computing unit in server 120 can run one or more operating systems, including any of the aforementioned operating systems and any commercially available server operating system. Server 120 can also run any of a variety of additional server applications and / or middleware applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, etc.

[0036] In some implementations, server 120 may include one or more applications to analyze and merge data feeds and / or event updates received from vehicle 110. Server 120 may also include one or more applications to display data feeds and / or real-time events via one or more display devices of vehicle 110.

[0037] Network 130 can be any type of network well known to those skilled in the art, and can support data communication using any of a variety of available protocols (including, but not limited to, TCP / IP, SNA, IPX, etc.). By way of example only, one or more networks 130 can be satellite communication networks, local area networks (LANs), Ethernet-based networks, token ring networks, wide area networks (WANs), the Internet, virtual networks, virtual private networks (VPNs), intranets, extranets, blockchain networks, public switched telephone networks (PSTNs), infrared networks, wireless networks (including, for example, Bluetooth, WiFi), and / or any combination of these with other networks.

[0038] System 100 may also include one or more databases 150. In some embodiments, these databases may be used to store data and other information. For example, one or more of the databases 150 may be used to store information such as audio files and video files. The data repository 150 may reside in various locations. For example, a data repository used by server 120 may be local to server 120, or it may be located away from server 120 and may communicate with server 120 via a network-based or dedicated connection. The data repository 150 may be of different types. In some embodiments, the data repository used by server 120 may be a database, such as a relational database. One or more of these databases may store, update, and retrieve data from and from the database in response to commands.

[0039] In some embodiments, one or more of the databases 150 may also be used by an application to store application data. The databases used by the application may be of different types, such as key-value stores, object stores, or regular stores supported by a file system.

[0040] Motor vehicle 110 may include sensors 111 for sensing the surrounding environment. Sensors 111 may include one or more of the following sensors: a visual camera, an infrared camera, an ultrasonic sensor, a millimeter-wave radar, and a lidar (LiDAR). Different sensors can provide different detection accuracy and range. Cameras may be mounted in front of, behind, or at other locations on the vehicle. Visual cameras can capture the situation inside and outside the vehicle in real time and present it to the driver and / or passengers. In addition, by analyzing the images captured by the visual cameras, information such as traffic light indications, intersection conditions, and the operating status of other vehicles can be obtained. Infrared cameras can capture objects in night vision conditions. Ultrasonic sensors may be mounted around the vehicle to measure the distance of objects outside the vehicle using the strong directionality of ultrasound. Millimeter-wave radar may be mounted in front of, behind, or at other locations on the vehicle to measure the distance of objects outside the vehicle using the characteristics of electromagnetic waves. LiDAR may be mounted in front of, behind, or at other locations on the vehicle to detect the edges and shape information of objects, thereby performing object recognition and tracking. Due to the Doppler effect, the radar device can also measure the speed changes of the vehicle and moving objects.

[0041] The motor vehicle 110 may also include a communication device 112. The communication device 112 may include a satellite positioning module capable of receiving satellite positioning signals (e.g., BeiDou, GPS, GLONASS, and GALILEO) from satellite 141 and generating coordinates based on these signals. The communication device 112 may also include a module for communicating with a mobile communication base station 142. The mobile communication network can implement any suitable communication technology, such as current or emerging wireless communication technologies (e.g., 5G technology) like GSM / GPRS, CDMA, and LTE. The communication device 112 may also have a vehicle-to-everything (V2X) module, configured to enable vehicle-to-the-world communication, for example, vehicle-to-vehicle (V2V) communication with other vehicles 143 and vehicle-to-infrastructure (V2I) communication with infrastructure 144. Furthermore, the communication device 112 may also have a module configured to communicate with a user terminal 145 (including but not limited to smartphones, tablets, or wearable devices such as watches) via, for example, a wireless local area network conforming to the IEEE 802.11 standard or Bluetooth. Using the communication device 112, the motor vehicle 110 can also access the server 120 via the network 130.

[0042] The motor vehicle 110 may also include a control unit 113. The control unit 113 may include a processor, such as a central processing unit (CPU) or a graphics processing unit (GPU), or other dedicated processors, that communicates with various types of computer-readable storage devices or media. The control unit 113 may include an autonomous driving system for automatically controlling various actuators in the vehicle. The autonomous driving system is configured to control the powertrain, steering system, and braking system of the motor vehicle 110 (not shown) via multiple actuators in response to inputs from multiple sensors 111 or other input devices to control acceleration, steering, and braking respectively, without human intervention or with limited human intervention. Some processing functions of the control unit 113 can be implemented via cloud computing. For example, some processing can be performed using an onboard processor while other processing can be performed using cloud computing resources. The control unit 113 may be configured to perform methods according to this disclosure. Furthermore, the control unit 113 may be implemented as an example of a computing device on the motor vehicle side (client) according to this disclosure.

[0043] Figure 1 The system 100 can be configured and operated in various ways to enable the application of the various methods and apparatus described in this disclosure.

[0044] This disclosure provides a control method for an in-vehicle projection system, with some embodiments thereof. The in-vehicle projection system is configured on a vehicle, and the specific type of vehicle is not limited; for example, it can be an autonomous vehicle or a non-autonomous vehicle. Furthermore, this disclosure does not limit the specific vehicle model; for example, the vehicle can be a sedan, a sport utility vehicle (SUV), a multi-purpose vehicle (MPV), a van, etc.

[0045] like Figure 2 The diagram illustrates the structure and operating principle of an in-vehicle projection system 200 according to some embodiments of the present disclosure. The in-vehicle projection system 200 includes a windshield 210 capable of switching between a transparent state and a fogged state (transparent state in the left image, fogged state in the right image), an adjustment mechanism 220 for adjusting the windshield 210 to a target pose or an initial pose (initial pose in the left image, target pose in the right image), a projector 230 for projecting images onto the windshield 210, and an electronic device 240 for controlling the windshield 210 and the adjustment mechanism 220 and for performing the control methods described below.

[0046] Electronic device 240 may be independent of projector 230. In some embodiments, electronic device 240 may also be integrated into projector 230. This disclosure does not limit this.

[0047] The placement of the projector 230 within the vehicle is not limited. In some embodiments, such as Figure 2 As shown, the projector 230 is mounted on the center console 250, and the lens of the projector 230 is positioned on the top side. To save space and make the center console 250 more streamlined, the projector 230 can be positioned as follows: Figure 2 As shown, it is partially or fully embedded in the center console 250.

[0048] In some other embodiments of this disclosure, the projector may also be located in the center armrest of the vehicle and the lens of the projector may be located in front of it.

[0049] In some other embodiments, the projector may also be mounted on the ceiling of the vehicle's interior, with the projector's lens positioned in front of it.

[0050] Combination Figure 2 and Figure 3 As shown, some embodiments of this disclosure provide a control method 300 for an in-vehicle projection system, including the following steps S301 and S302.

[0051] In step S301, in response to the projector 230 being turned on, the windshield 210 is controlled to be in a fogged state and in the target pose.

[0052] In step S302, in response to the projector 230 being turned off, the windshield 210 is controlled to be in a transparent state and in an initial pose.

[0053] like Figure 2 As shown, in this embodiment of the disclosure, the windshield 210 can switch between a transparent state and a fogged state, and can switch between an initial pose and a target pose. Figure 2 As shown in the middle right image, when the windshield 210 is in a frosted state and in the target position, it can act as a projection screen to provide passengers with a large-screen and comfortable viewing experience, thereby enhancing the passenger's riding experience. Figure 2 As shown in the middle left figure, when the windshield 210 is in a transparent state and in its initial position, it does not affect the driver's visibility as a transparent windshield and also has low wind resistance.

[0054] Therefore, by adopting the technical solution of the present disclosure embodiment, the windshield 210 can switch between a transparent state and a fogged state and can switch between an initial pose and a target pose. Thus, the windshield 210 in the target pose and in a fogged state can be used as a projection screen to provide passengers with a better viewing experience, thereby improving the passenger's riding experience.

[0055] like Figure 2 As shown, in some embodiments of this disclosure, the windshield 210 includes a glass panel 211 and a dimming layer 212 disposed on the inner side of the glass panel 211. The dimming layer 212 is transparent when the power is off and fogged when the power is on. The inner side of the glass panel 211 refers to the side closer to the interior space of the vehicle compartment.

[0056] In other embodiments of this disclosure, the structure of the windshield may also be designed to include a first glass plate, a second glass plate, and a dimming layer sandwiched between the first glass plate and the second glass plate, wherein the dimming layer is transparent when the power is off and atomized when the power is on.

[0057] The specific implementation method of switching between the fogged state and the transparent state of the dimming layer 212 is not limited. For example, in some embodiments, the dimming layer adopts electrically conductive fogging glass, which has a liquid crystal layer or a polymer layer sandwiched between two glass substrates. When current flows through the electrically conductive fogging glass, the liquid crystal layer or polymer layer changes its conformation, thereby changing the transparency and realizing the switching between the fogged state and the transparent state.

[0058] In some embodiments of this disclosure, such as Figure 2 As shown, the angle between the windshield 210 and the center console 250 in the target pose is the target angle θ1, which is greater than the angle θ0 between the windshield 210 and the center console 250 in the initial pose (i.e., the initial angle θ0).

[0059] In practice, the windshield 210 and the center console 250 may be planar or curved. In some embodiments of this disclosure, the curved windshield can be equivalent to a planar surface according to certain geometric rules, and / or the curved center console can be equivalent to a planar surface according to certain geometric rules. Then, the included angle between the two planes, which is no more than 90 degrees, is taken as the included angle between the windshield and the center console.

[0060] Taking a sedan or SUV as an example, in order to reduce wind resistance, the angle between the windshield and the center console is usually designed to be 70 degrees. This angle is beneficial to reduce wind resistance, but it is not suitable for passengers in the vehicle to use the windshield as a projection screen in a normal sitting position. Therefore, in this embodiment, the target angle θ1 is designed to be greater than the initial angle θ0, so that passengers can comfortably view the windshield 210 as a projection screen.

[0061] In some embodiments, the target included angle θ1 is designed to be greater than 70 degrees and not greater than 90 degrees, such as 75 degrees, 80 degrees, 85 degrees or 90 degrees, so as to facilitate passengers to view the front windshield 210, which serves as a projection screen, in a comfortable sitting posture and viewing angle.

[0062] like Figure 4A As shown, in some embodiments of this disclosure, in step S201, controlling the windshield 210 to be in a target pose includes:

[0063] Obtain the face pitch angle of passenger 420 who is seated in target seat 410;

[0064] Based on the face tilt angle, determine the target angle θ1 mentioned above; and

[0065] Based on the target angle θ1, adjust the angle between the windshield 210 and the center console 250. Figure 4A (The pose of the windshield 210, indicated by the dashed box, before adjustment based on this embodiment).

[0066] The target seat 410 can be any seat within the vehicle, such as the front left seat, front right seat, rear left seat, rear middle seat, or rear right seat. In some embodiments of this disclosure, the target seat 410 can be a fixed seat. In other embodiments of this disclosure, the target seat 410 is not fixed and can be set or switched as needed.

[0067] The face pitch angle can be understood as the angle through which the face rotates relative to the horizontal axis (x-axis), where the horizontal axis is orthogonal to the vehicle's longitudinal direction in the horizontal plane. Face detection equipment can identify the face image captured by its camera based on face recognition technology, thereby obtaining the face pitch angle. For example... Figure 4BAs shown, in related technologies, face detection devices can identify the pose angles of a face 430, including the pitch angle around the x-axis, the yaw angle around the y-axis, and the roll angle around the z-axis.

[0068] like Figure 4A As shown, passenger 420 may adjust the angle of the seat back for comfort, potentially resulting in a backward or forward-looking position. This embodiment allows passengers to view the fogged windshield, which acts as a projection screen, from a comfortable angle after adjusting their seats, thus achieving a better viewing experience.

[0069] like Figure 5 As shown, in some embodiments of this disclosure, the control method applied to an in-vehicle projection system further includes:

[0070] Obtain the face pitch angle of passenger 420 sitting in target seat 410;

[0071] Based on the face's tilt angle, determine the target projection angle of the projector 230; and

[0072] Adjust the projection angle of the projector 230 based on the target projection angle.

[0073] The definitions of the target seat 410 and the face tilt angle are similar to those in the aforementioned embodiments, and will not be repeated here.

[0074] The projection angle of projector 230 can be understood as the angle between the optical axis of projector 230's lens and the x, y, and z axes of a Cartesian coordinate system, not exceeding 90 degrees. Different projection angles of projector 230 result in different projection coverage areas on the screen. Figure 5 The dashed triangle region S1 indicates the projection coverage area of ​​the projector 230 before the projection angle is adjusted, and the solid triangle region S2 indicates the projection coverage area of ​​the projector 230 after the projection angle is adjusted.

[0075] like Figure 5 As shown, passenger 420 may adjust the angle of the seat back for comfort inside the vehicle, potentially resulting in a backward or forward-looking posture. In this embodiment, the projection angle of the projector 230 can be appropriately adjusted to match the tilt angle of the passenger's face, allowing the passenger to view the fogged-up windshield, which acts as a projection screen, from a comfortable angle after adjusting the seat, thus achieving a better viewing experience.

[0076] In some embodiments of this disclosure, the projection angle of the projector and the angle between the windshield and the center console can be automatically adjusted so that passengers can view the windshield in a fogged state, which serves as a projection screen, from a more comfortable angle.

[0077] In some embodiments of this disclosure, such as Figure 6 As shown, the windshield 210 is in the target pose (e.g.) Figure 6 (As shown in the middle right figure) The target distance S1 is shifted forward relative to the center console 250 in the longitudinal direction of the vehicle.

[0078] That is, with the angle between the windshield 210 and the center console 250 remaining unchanged, the windshield 210 extends forward a certain distance relative to the center console 250 in the target position.

[0079] The farther the projection screen is from the projector lens, the larger the size of the projected image displayed on the projection screen. In this embodiment of the disclosure, when the windshield 210 is used as a projection screen, it extends forward relative to the center console 250 by a certain distance, which can obtain a larger projected image, thereby providing passengers with a more immersive viewing experience.

[0080] In some embodiments of this disclosure, step S201, controlling the windshield to be in a target pose, includes:

[0081] Obtain the distance between the face of the passenger sitting in the target seat and the center console in the longitudinal direction of the vehicle;

[0082] Based on the distance between the face and the center console in the longitudinal direction of the vehicle, the target distance S1 is determined; and

[0083] Based on the target distance S1, adjust the distance between the windshield and the center console in the longitudinal direction of the vehicle.

[0084] The understanding of the target seat is similar to that in the aforementioned embodiments, and will not be repeated here. The face monitoring device can identify the face images captured by its camera based on face recognition technology, and thus, combined with the vehicle's inherent parameters, obtain the distance between the face and the center console in the longitudinal direction of the vehicle.

[0085] Passengers may adjust the position of their seats for comfort while inside the vehicle. This embodiment allows passengers to view the fogged-up windshield, which acts as a projection screen, from an appropriate distance after adjusting their seats, thus achieving a better viewing experience.

[0086] In some other embodiments of this disclosure, step S201, controlling the windshield to be in a target pose, includes:

[0087] Obtain the distance between the target seat and the center console in the longitudinal direction of the vehicle;

[0088] Based on the distance between the target seat and the center console in the longitudinal direction of the vehicle, the aforementioned target distance S1 is determined; and

[0089] Based on the target distance S1, adjust the distance between the windshield and the center console in the longitudinal direction of the vehicle.

[0090] The understanding of the target seat is similar to that in the previous embodiment, and will not be repeated here. In this embodiment, sensors can be used to detect the distance between the target seat and the center console in the longitudinal direction of the vehicle. Based on this distance, the distance between the windshield and the center console in the longitudinal direction of the vehicle can be adjusted so that after adjusting the seat, the passenger can view the fogged windshield, which acts as a projection screen, from an appropriate distance, thereby obtaining a better viewing effect.

[0091] In the embodiments described above, the center console is used as a fixed reference to determine the positional parameters of the windshield. In other embodiments of this disclosure, other fixed structures of the vehicle (such as the front pillar) may also be used as fixed references to determine the positional parameters of the windshield, and this disclosure does not specifically limit this method.

[0092] In some embodiments of this disclosure, one or more of the following—the projection angle of the projector, the angle between the windshield and the center console, and the distance between the windshield and the center console in the longitudinal direction of the vehicle—can be adjusted according to actual conditions (such as vehicle parameters, passenger seating posture, and seating position) to allow passengers to view the windshield in a more comfortable, atomized state as a projection screen. For example, for some vehicle models, the initial angle between the windshield and the center console is approximately 90 degrees; therefore, the control method may not include adjusting the aforementioned "angle between the windshield and the center console."

[0093] like Figure 7 As shown in the embodiments of this disclosure, a control device 700 for use in an in-vehicle projection system is also provided, comprising:

[0094] The first control unit 701 is configured to, in response to the projector being turned on, control the windshield to be in a frosted state and in a target pose; and

[0095] The second control unit 702 is configured to control the windshield to be in a transparent state and in an initial pose in response to the projector being turned off.

[0096] In some embodiments, the first control unit 701 includes:

[0097] The first acquisition unit is configured to acquire the face pitch angle of a passenger sitting in the target seat;

[0098] The first determining unit is configured to determine the target angle based on the face's tilt angle; and

[0099] The first adjustment unit is configured to adjust the angle between the windshield and the center console based on the target angle.

[0100] In some embodiments, the first control unit 701 includes:

[0101] The second acquisition unit is configured to acquire the face pitch angle of a passenger sitting in the target seat;

[0102] The second determining unit is configured to determine the target projection angle of the projector based on the face tilt angle; and

[0103] The second adjustment unit is configured to adjust the projection angle of the projector based on the target projection angle.

[0104] In some embodiments, the windshield in the target position is translated forward a target distance relative to the center console in the longitudinal direction of the vehicle, and the first control unit 701 includes:

[0105] The third acquisition unit is configured to acquire the distance between the face of the passenger sitting in the target seat and the center console in the longitudinal direction of the vehicle.

[0106] The third determining unit is configured to determine the target distance based on the distance between the face and the center console in the longitudinal direction of the vehicle; and

[0107] The third adjustment unit is configured to adjust the distance between the windshield and the center console in the longitudinal direction of the vehicle based on the target distance.

[0108] In some embodiments, the windshield in the target position is translated forward a target distance relative to the center console in the longitudinal direction of the vehicle, and the first control unit 701 includes:

[0109] The fourth acquisition unit is configured to acquire the distance between the target seat and the center console in the longitudinal direction of the vehicle;

[0110] The fourth determining unit is configured to determine the target distance based on the distance between the target seat and the center console in the longitudinal direction of the vehicle; and

[0111] The fourth adjustment unit is configured to adjust the distance between the windshield and the center console in the longitudinal direction of the vehicle based on the target distance.

[0112] Using the control device of the above embodiments of this disclosure, the windshield can switch between a transparent state and a fogged state and can switch between an initial position and a target position. Thus, the windshield in the target position and in the fogged state can be used as a projection screen to provide passengers with a better viewing experience and enhance their riding experience.

[0113] According to embodiments of the present disclosure, an electronic device is also provided, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the control method of the foregoing embodiments.

[0114] The electronic device controls the windshield and adjustment mechanism based on certain control logic, so that the windshield can switch between transparent and fogged states and can switch between initial and target positions. Thus, the windshield in the target position and in the fogged state can be used as a projection screen to provide passengers with a better viewing experience and enhance their riding experience.

[0115] like Figure 2 As shown in the illustration, this disclosure also provides an in-vehicle projection system 200, including a windshield 210, an adjustment mechanism 220, a projector 230, and the electronic device 240 described in the previous embodiment. The windshield 210 can switch between a transparent state and a fogged state. The adjustment mechanism 220 is used to adjust the windshield 210 to a target pose or an initial pose. The projector 230 is used to project images onto the windshield 210. The electronic device 240 controls the windshield 210 and the adjustment mechanism 220 based on certain control logic, so that the windshield 210 can switch between a transparent state and a fogged state and can switch between an initial pose and a target pose.

[0116] In some embodiments, the in-vehicle projection system further includes a face detection device (not shown) configured to acquire the tilt angle of the face of a passenger seated in the target seat and / or the distance between the face and the center console in the longitudinal direction of the vehicle. This allows passengers to view the fogged windshield, which acts as a projection screen, from a comfortable angle and / or an appropriate distance after adjusting their seats, thus achieving a better viewing experience.

[0117] In some embodiments, the adjustment mechanism 220 includes two linkage mechanisms, which are correspondingly disposed within the two front pillars of the vehicle (i.e., the two A-pillars of the vehicle, not shown in the figure). The specific form of the linkage mechanism is not limited; for example, it can be a hydraulic linkage mechanism, a pneumatic linkage mechanism, or an electrically driven linkage mechanism, etc. In some embodiments, such as... Figure 8 As shown, the linkage mechanism 221 adopts a hydraulic linkage mechanism, which may include one or more telescopic hydraulic rods 2210.

[0118] The available structural forms of the windshield 210 and the available installation positions of the projector 230 are as described in the aforementioned embodiments, and will not be repeated here.

[0119] This disclosure also provides a vehicle including the aforementioned in-vehicle projection system 200. The in-vehicle projection system 200 uses a windshield 210 in a target position and in a frosted state as a projection screen, which can provide passengers with a better viewing experience, thereby enhancing the passenger's riding experience.

[0120] The specific type of vehicle is not limited; for example, it can be an autonomous vehicle or a non-autonomous vehicle. Furthermore, this disclosure does not limit the specific model of the vehicle; for example, the vehicle can be a sedan, a sports utility vehicle, a multi-purpose vehicle, a van, etc.

[0121] refer to Figure 9 The present invention describes a structural block diagram of an electronic device 900 that can serve as a server or client of the present disclosure, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0122] like Figure 9 As shown, the electronic device 900 includes a computing unit 901, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 902 or a computer program loaded into a random access memory (RAM) 903 from a storage unit 908. The RAM 903 may also store various programs and data required for the operation of the electronic device 900. The computing unit 901, ROM 902, and RAM 903 are interconnected via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0123] Multiple components in electronic device 900 are connected to I / O interface 905, including: input unit 906, output unit 907, storage unit 908, and communication unit 909. Input unit 906 can be any type of device capable of inputting information to electronic device 900. Input unit 906 can receive input digital or character information and generate key signal inputs related to user settings and / or function control of electronic device, and can include, but is not limited to, a mouse, keyboard, touchscreen, trackpad, trackball, joystick, microphone, and / or remote control. Output unit 907 can be any type of device capable of presenting information, and can include, but is not limited to, a monitor, speaker, video / audio output terminal, vibrator, and / or printer. Storage unit 908 can include, but is not limited to, hard disk and optical disk. Communication unit 909 allows electronic device 900 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks, and can include, but is not limited to, modems, network cards, infrared communication devices, wireless communication transceivers and / or chipsets, such as Bluetooth devices, 1302.11 devices, WiFi devices, WiMax devices, cellular communication devices, and / or the like.

[0124] The computing unit 901 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 901 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 901 performs the various methods and processes described above. For example, some embodiment methods can be implemented as computer software programs tangibly contained in a machine-readable medium, such as storage unit 908. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 900 via ROM 902 and / or communication unit 909. When the computer program is loaded into RAM 903 and executed by the computing unit 901, one or more steps of the embodiment methods described above can be performed. Alternatively, in other embodiments, the computing unit 901 can be configured to perform the embodiment methods described above by any other suitable means (e.g., by means of firmware).

[0125] This disclosure also provides a computer-readable storage medium storing computer instructions configured to cause a computer to perform the steps of any of the methods described in the foregoing embodiments.

[0126] Furthermore, this disclosure also provides a computer program product, including a computer program, wherein when the computer program is executed by a processor, it implements the steps of the methods of any of the foregoing embodiments.

[0127] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0128] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0129] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0130] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0131] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0132] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0133] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0134] While embodiments or examples of this disclosure have been described with reference to the accompanying drawings, it should be understood that the methods, systems, and devices described above are merely exemplary embodiments or examples, and the scope of the invention is not limited by these embodiments or examples, but only by the granted claims and their equivalents. Various elements in the embodiments or examples may be omitted or replaced by their equivalents. Furthermore, the steps may be performed in a different order than that described in this disclosure. Further, various elements in the embodiments or examples may be combined in various ways. Importantly, as the technology evolves, many elements described herein can be replaced by equivalents that appear after this disclosure.

Claims

1. A control method for an in-vehicle projection system, comprising: In response to the projector being turned on, the windshield is controlled to be in a fogged state and in the target pose. as well as In response to the projector being turned off, the windshield is controlled to be in a transparent state and in its initial pose. Wherein, the windshield, in the target pose, is moved forward a target distance relative to the center console in the longitudinal direction of the vehicle, and wherein controlling the windshield to be in the target pose includes: Obtain the distance between the face of the passenger sitting in the target seat and the center console in the longitudinal direction of the vehicle; The target distance is determined based on the distance between the face and the center console in the longitudinal direction of the vehicle; and Based on the target distance, the distance between the windshield and the center console in the longitudinal direction of the vehicle is adjusted to obtain a larger projected image.

2. The control method according to claim 1, wherein, The angle between the windshield and the center console in the target pose is the target angle, which is greater than the angle between the windshield and the center console in the initial pose.

3. The control method according to claim 2, wherein, The included angle of the target is greater than 70 degrees and not greater than 90 degrees.

4. The control method according to claim 2, wherein, Controlling the windshield to the target position includes: Obtain the face tilt angle of the passenger seated in the target seat; Based on the face tilt angle, determine the target angle; and Based on the target angle, adjust the angle between the windshield and the center console.

5. The control method according to claim 1, comprising: Obtain the face tilt angle of the passenger seated in the target seat; Based on the face tilt angle, the target projection angle of the projector is determined; as well as The projection angle of the projector is adjusted based on the target projection angle.

6. The control method according to claim 1, wherein, Controlling the windshield to the target position includes: Obtain the distance between the target seat and the center console in the longitudinal direction of the vehicle; The target distance is determined based on the distance between the target seat and the center console in the longitudinal direction of the vehicle; and Based on the target distance, adjust the distance between the windshield and the center console in the longitudinal direction of the vehicle.

7. A control device for an in-vehicle projection system, comprising: The first control unit is configured to control the windshield to be in a fogged state and in a target pose in response to the projector being turned on. as well as The second control unit is configured to, in response to the projector being turned off, control the windshield to be in a transparent state and in an initial pose. Wherein, the windshield, in the target pose, is moved forward a target distance relative to the center console in the longitudinal direction of the vehicle, and wherein controlling the windshield to be in the target pose includes: Obtain the distance between the face of the passenger sitting in the target seat and the center console in the longitudinal direction of the vehicle; The target distance is determined based on the distance between the face and the center console in the longitudinal direction of the vehicle; and Based on the target distance, the distance between the windshield and the center console in the longitudinal direction of the vehicle is adjusted to obtain a larger projected image.

8. An electronic device, comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the control method according to any one of claims 1 to 6.

9. A vehicle-mounted projection system, comprising: The windshield can switch between a transparent state and a fogged state; Adjustment mechanism, used to adjust the windshield to a target position or an initial position; Projector, used to project images onto the windshield; and The electronic device according to claim 8.

10. The vehicle-mounted projection system according to claim 9, further comprising: The face detection device is configured to collect the tilt angle of the face of a passenger sitting in the target seat and / or the distance between the face and the center console in the longitudinal direction of the vehicle.

11. The vehicle-mounted projection system according to claim 9, wherein, The adjustment mechanism includes two linkage mechanisms that are correspondingly located in the two front pillars of the vehicle.

12. The vehicle-mounted projection system according to claim 9, wherein, The windshield includes a glass panel and a dimming layer disposed on the inner side of the glass panel, wherein the dimming layer is transparent when power is off and fogged up when power is on; or The windshield includes a first glass panel, a second glass panel, and a dimming layer sandwiched between the first glass panel and the second glass panel, wherein the dimming layer is transparent when the power is off and atomized when the power is on.

13. The vehicle-mounted projection system according to any one of claims 9 to 12, wherein, The projector is located on the central control panel, and the lens of the projector is located on its top side; or The projector is located in the center armrest of the vehicle, and the lens of the projector is located in front of it. or The projector is installed on the ceiling of the vehicle's interior, and the lens of the projector is located on its front side.

14. A vehicle comprising: The vehicle-mounted projection system according to any one of claims 9 to 13.

15. A computer-readable storage medium storing computer instructions, wherein, The computer instructions are configured to cause the computer to execute the control method according to any one of claims 1 to 6.

16. A computer program product comprising a computer program, wherein, When the computer program is executed by a processor, it implements the control method according to any one of claims 1 to 6.

Images