System and method for providing three-dimensional projection images for passengers in rear row of vehicle
By combining a 3D projection system in the vehicle with horizontal and vertical screens and using cameras to identify the passenger's viewpoint coordinates to adjust the projected content, the problem of insufficient immersion in existing two-dimensional vehicle display technology is solved, achieving a more realistic three-dimensional projection effect and improving the user experience.
Patent Information
- Application Number
- CN202410963416.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-17
- Publication Date
- 2026-01-20
AI Technical Summary
The existing two-dimensional display technology of in-vehicle entertainment systems cannot meet users' needs for a higher level of immersion and interactivity.
The system employs an in-vehicle 3D projection system. By combining first and second projectors with horizontal and vertical screens, and using an in-vehicle camera to identify the passenger's viewpoint coordinates, the system adjusts the projection content to achieve dual-screen projection image fusion and provide a three-dimensional projection effect.
It significantly improves the immersive projection image experience for rear-seat passengers, enhancing the user's entertainment and interactive experience.
Smart Images
Figure CN121367764A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to a vehicle, and more particularly, to a system and method for providing a three-dimensional projection image for rear passengers of a vehicle. BACKGROUND
[0002] With the rapid development of technology, the vehicle interior entertainment and information system is gradually evolving towards digitization and intelligence. In the existing vehicle interior entertainment system, although there are various forms of display screens for displaying information or providing entertainment content, most systems still remain on traditional two-dimensional display technology. This display method has obvious deficiencies in providing immersion and interactivity, and cannot meet the needs of users for higher level driving experience.
[0003] Accordingly, there is a need in the art for a technology for providing a three-dimensional projection image in a vehicle. SUMMARY
[0004] This summary is provided to introduce some concepts of what will be further described in the detailed description below. This summary does not necessarily identify key or essential features of the claimed subject matter and nor does it necessarily delineate the scope of the claimed subject matter.
[0005] In view of the defects of the prior art, the purpose of the present application is to solve the deficiencies of the prior art and provide a more realistic and immersive entertainment and interactive experience for passengers through an in-vehicle 3D projection system.
[0006] According to an aspect of the present application, a system for providing a three-dimensional projection image for rear passengers of a vehicle can include: a first projector installed in a rear row area of the vehicle; a second projector installed in the rear row area of the vehicle; a horizontal screen; a vertical screen; an in-vehicle camera configured to identify a viewpoint coordinate of the rear passengers; a control device configured to: determine a distance parameter from a viewpoint position of the rear passengers to edges of the horizontal screen and the vertical screen based on the viewpoint coordinate; adjust projection content assigned to the first projector and the second projector based on the distance parameter; and control the first projector to project the projection content assigned to the first projector onto the horizontal screen and control the second projector to project the projection content assigned to the second projector onto the vertical screen, thereby realizing a double-fold screen projection picture fusion.
[0007] In one embodiment, the first projector can be installed on a rear luggage compartment shelf, wherein in the projection work, the first projector can be projected onto the horizontal screen through a rear seat middle backrest side hole.
[0008] In one embodiment, the second projector can be installed on a rear end support of the roof.
[0009] In one embodiment, the horizontal curtain can be a sunroof shade that is capable of moving back and forth with the skeleton.
[0010] In one embodiment, the vertical curtain is capable of being retracted within the front end skeleton of the sunroof shade.
[0011] In one embodiment, the retraction can be performed by a motor.
[0012] In one embodiment, at the junction of the horizontal curtain and the vertical curtain, the gap between the edge of the horizontal curtain and the edge of the vertical curtain can be less than 2mm.
[0013] According to another aspect of the present application, there is provided a method for providing a three-dimensional projection image for rear passengers of a vehicle, which can include: identifying a viewpoint coordinate of the rear passengers; sliding a horizontal curtain to an optimal position and lowering a vertical curtain; determining a distance parameter of a viewpoint position of the rear passengers to edges of the horizontal curtain and the vertical curtain based on the viewpoint coordinate; adjusting projection content assigned to a first projector and a second projector based on the distance parameter; and projecting the projection content assigned to the first projector onto the horizontal curtain and projecting the projection content assigned to the second projector onto the vertical curtain, thereby realizing a double-fold curtain projection picture fusion.
[0014] According to yet another aspect of the present application, there is provided a vehicle including a system for providing a three-dimensional projection image for rear passengers of a vehicle according to the present application.
[0015] Through the system and method of the present application, a 3D immersive projection image can be provided for rear passengers of a vehicle, thereby significantly improving user experience.
[0016] These and other features and advantages will be apparent from a reading of the following detailed description and a review of the associated drawings. It is to be understood that both the foregoing general description and the following detailed description are meant only to illustrate and not to limit the various aspects claimed. BRIEF DESCRIPTION OF DRAWINGS
[0017] So that the above-recited features and advantages of the present application can be understood in detail, a more particular description will be rendered by reference to example embodiments thereof which are illustrated in the drawings. It is to be noted, however, that the appended drawings represent only typical aspects of this application and are therefore not to be considered limiting, as the description can admit to other equally effective aspects.
[0018] Figure 1 A schematic diagram illustrating a system for providing a three-dimensional projection image for rear passengers of a vehicle according to one embodiment of the present application is shown.
[0019] Figure 2A diagram illustrating a passenger sitting in the back row according to one embodiment of the present invention.
[0020] Figure 3 A diagram illustrating an effect of a system according to the present invention.
[0021] Figure 4 A diagram illustrating a mounting position of a first projector and a second projector according to one embodiment of the present invention.
[0022] Figure 5 A diagram illustrating a mounting position of a first projector and a second projector according to one embodiment of the present invention.
[0023] Figure 6 A diagram illustrating a mounting position of a first projector according to one embodiment of the present invention.
[0024] Figure 7 A diagram illustrating a mounting position of a second projector according to one embodiment of the present invention.
[0025] Figure 8 A diagram illustrating a horizontal screen and a vertical screen according to one embodiment of the present invention.
[0026] Figure 9 A diagram illustrating a horizontal screen and a vertical screen according to one embodiment of the present invention.
[0027] Figure 10 A diagram illustrating a viewpoint position and a viewpoint position to edges of a horizontal screen and a vertical screen according to one embodiment of the present invention.
[0028] Figure 11 A diagram illustrating a flowchart of a method for providing a three-dimensional projection image for a back row passenger of a vehicle according to one embodiment of the present invention.
[0029] Figure 12 A diagram illustrating a block diagram of an exemplary control device according to one embodiment of the present invention. DETAILED DESCRIPTION
[0030] In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the exemplary embodiments described. However, it will be apparent to one skilled in the art that the described embodiments can be practiced without some or all of these specific details. In other instances, well known structures or process steps have not been described in detail in order to avoid unnecessarily obscuring the concepts of the present disclosure.
[0031] Figure 1A schematic diagram of a system 100 for providing three-dimensional projection images for rear passengers of a vehicle according to one embodiment of the present application is illustrated. The system 100 can be arranged in a vehicle. The vehicle can include front seats (e.g., seat 150) and rear seats (e.g., seat 160). It should be noted that the system 100 is for illustrative purposes only and is not limiting, which can include more or less components than those shown in Figure 1
[0032] The system 100 can include a first projector 110 mounted in a rear area of the vehicle and a second projector 120 mounted in the rear area of the vehicle. The specific mounting positions of the first projector 110 and the second projector 120 are described in detail below with reference to Figures 4-7
[0033] The system 100 can further include a horizontal curtain 130 and a vertical curtain 140. The horizontal curtain 130 and the vertical curtain 140 can be made of any suitable material in the prior art (including but not limited to white plastic curtain, metal curtain, fiberglass curtain, glass bead curtain, PVC curtain, etc.). The vertical curtain 140 can be kept in a vertical position by gravity and mechanism, and the included angle with the horizontal curtain 130 can be 90 degrees (or slightly deviated, e.g., 90±5 degrees). In one embodiment, the first projector 110 can be used to project images onto the horizontal curtain 130, and the second projector 120 can be used to project images onto the vertical curtain 140. The specific implementation of the horizontal curtain 120 and the vertical curtain 120 are described in detail below with reference to Figures 8-9
[0034] The system 100 can further include an in-vehicle camera (not shown in Figure 1 ). The in-vehicle camera can be mounted at any suitable position in the vehicle, for example, to identify the viewpoint coordinates of the rear passengers. In this context, the viewpoint coordinates of the rear passengers refer to the positions of the eyes of the rear passengers in the vehicle coordinate system, and can be used to determine the viewpoint positions thereof.
[0035] The system 100 can further include a control device (not shown in Figure 1 ). In one example, the control device can be an example of the control device 1200 described below with reference to Figure 12 In one embodiment, the control device can be configured to: determine distance parameters from the viewpoint positions of the rear passengers to the edges of the horizontal curtain and the vertical curtain based on the viewpoint coordinates of the rear passengers; adjust the projection contents assigned to the first projector and the second projector based on the distance parameters; and control the first projector to project the projection contents assigned to the first projector onto the horizontal curtain, and control the second projector to project the projection contents assigned to the second projector onto the vertical curtain, thereby realizing the double anamorphic screen projection picture fusion.
[0036] Figure 2 A schematic diagram illustrating a passenger sitting in the back row according to an embodiment of the present application. Figure 3 A schematic diagram illustrating the effect of the system according to the present application. As Figure 2 and Figure 3 Illustrated is that when a passenger sits in the back row seat of the vehicle, the system (e.g., system 100) for providing a three-dimensional projection image for the back row passenger of the vehicle according to the present application can be started, by calculating the distance parameters from the viewpoint position of the passenger to the edges of the horizontal curtain and the vertical curtain, the projection content assigned to the first projector and the second projector can be adjusted appropriately to project the corresponding projection content onto the horizontal curtain and the vertical curtain, thereby realizing the double-curtain projection picture fusion (e.g., the three-dimensional projection effect shown in Figure 3 ).
[0037] Figure 4 and Figure 5 respectively illustrate the installation position schematic diagram of the first projector and the second projector according to an embodiment of the present application. It should be noted that, Figure 4 and Figure 5 for illustrative purposes only and not by way of limitation, in addition to the installation positions shown in Figure 4 and Figure 5 , the first projector and the second projector can also be installed at any other suitable position in the back row area of the vehicle as long as the projection content projected onto the horizontal curtain and the vertical curtain from the position can realize the double-curtain projection picture fusion with three-dimensional projection effect.
[0038] As Figure 4 and Figure 5 shown, the first projectors 410 and 510 can be installed on the rear luggage compartment shelf. In the projection working state, the back row seat central armrest is lowered, and the first projectors 410 and 510 can project through the rear row seat middle backrest square hole to the horizontal curtain (e.g., the horizontal curtain 530 shown in Figure 5 ). In the projection non-working state, the central armrest is retracted to cover the hole on the seat backrest. In addition, the second projectors 420 and 520 can be installed on the rear end support of the ceiling, which is part of the ceiling. In the projection working state, the second projectors 420 and 520 can project images to the vertical curtain (e.g., the vertical curtain 540 shown in Figure 5 ).
[0039] Figure 6 A schematic diagram illustrating the installation position of the first projector according to an embodiment of the present application. As Figure 6As shown, the first projector 610 can be mounted on the rear luggage compartment shelf, specifically, on the first projector support 620 located on the rear luggage compartment shelf. The rear seat can have a center armrest 630 and a backrest 640 with a hole (e.g., a round hole, a square hole, etc.). During projection work, the center armrest 630 can be lowered, and the first projector 610 can project onto the horizontal curtain through the hole in the middle backrest of the rear seat. During non-projection work, the center armrest 630 is retracted to cover the hole on the seat backrest 640.
[0040] Figure 7 A schematic diagram of a mounting position of a second projector according to an embodiment of the present application is illustrated. As shown, the second projector 710 can be mounted on a support 720 at the rear end of the roof, which can be part of the vehicle roof 730. Thus, during projection work, the second projector 710 can project appropriate projection content onto the vertical curtain 740. Figure 7
[0041] Figure 8 A schematic diagram of a horizontal curtain and a vertical curtain according to an embodiment of the present application is illustrated. In a preferred embodiment, the horizontal curtain 810 can be a sun visor curtain, which can move back and forth along the skeleton 830. The vertical curtain 820 can be retracted in the front end skeleton 830 of the sun visor curtain and can be retracted by the motor 840. The overall curtain system is fixed on the sunroof rail through the connectors at both ends of the sun visor skeleton and can slide back and forth.
[0042] Thus, during the start of projection work, by moving the sun visor curtain and in turn lowering the vertical curtain 820 by the motor 840, the horizontal curtain 810 and the vertical curtain 820 can be brought into working mode to realize the fusion of the double-fold curtain projection picture.
[0043] In a preferred embodiment, at the junction of the horizontal curtain 810 and the vertical curtain 820, the gap between the edge of the horizontal curtain 810 and the edge of the vertical curtain 820 is preferably less than 2 mm, thereby enabling better three-dimensional projection effect.
[0044] Figure 9 A schematic diagram of a horizontal curtain and a vertical curtain according to an embodiment of the present application is illustrated. As shown, the horizontal curtain 910 can be fixed on the sunroof rail through the connectors at both ends of the sun visor skeleton 920. The vertical curtain 930 can be retracted by default in the sun visor skeleton 920 and can be lowered during the start of projection work and retracted during the stop of projection work. Figure 9
[0045] Figure 10 A schematic diagram of a viewpoint position and the viewpoint position to the edges of the horizontal curtain and the vertical curtain according to an embodiment of the present application is illustrated. As shown, the horizontal curtain 1010 can be fixed on the sunroof rail through the connectors at both ends of the sun visor skeleton 1020. The vertical curtain 1030 can be retracted by default in the sun visor skeleton 1020 and can be lowered during the start of projection work and retracted during the stop of projection work.Figure 10 As shown, the viewpoint coordinates of the back row passenger (e.g., in the vehicle coordinate system) can be identified by the in-vehicle camera. Based on the viewpoint coordinates, the distance parameters of the viewpoint position of the back row passenger to the edges of the horizontal curtain and the vertical curtain can be determined, which can include distances x1, x2, y1, y2, z1, z2 in three directions of the viewpoint position to the respective edges of the horizontal curtain and the vertical curtain. Based on these distances, the viewable angle of the back row passenger can be calculated, by which the projection contents assigned to the first projector and the second projector can be adjusted to achieve the dual-curtain projection picture fusion. As known by those skilled in the art, the dual-curtain projection picture fusion can be achieved based on the above distance parameters and the viewable angle by using commercially available commercial software, and thus will not be described herein.
[0046] Figure 11 A flowchart illustrating a method 1100 for providing a three-dimensional projection image for a back row passenger of a vehicle according to one embodiment of the present application is shown. In one embodiment, the method 1100 can be implemented by the system for providing a three-dimensional projection image for a back row passenger of a vehicle of the present application. In another embodiment, the method 1100 can be implemented by any other suitable device or system.
[0047] At block 1110, the method 1100 can include identifying viewpoint coordinates of the back row passenger. For example, the viewpoint coordinates of the back row passenger can be identified using an in-vehicle camera.
[0048] At block 1120, the method 1100 can include sliding the horizontal curtain to an optimal position and lowering the vertical curtain. In one embodiment, the horizontal curtain can be a sunroof sunshade curtain capable of moving back and forth with the skeleton, and the vertical curtain can be rolled up in the front end skeleton of the sunroof sunshade curtain. For example, as shown, when the projection work is started, the horizontal curtain 810 and the vertical curtain 820 can be brought into the working mode by moving the sunroof sunshade curtain and in turn by the motor 840 lowering the vertical curtain 820. Figure 8
[0049] At block 1130, the method 1100 can include determining distance parameters of the viewpoint position of the back row passenger to the edges of the horizontal curtain and the vertical curtain based on the viewpoint coordinates. For example, as shown, the distance parameters can include distances x1, x2, y1, y2, z1, z2 in three directions of the viewpoint position to the respective edges of the horizontal curtain and the vertical curtain. Figure 10
[0050] At block 1140, the method 1100 can include adjusting the projection contents assigned to the first projector and the second projector based on the distance parameters. For example, based on the distance parameters, the viewable angle of the back row passenger can be calculated, by which the projection contents assigned to the first projector and the second projector can be adjusted.
[0051] At block 1150, the method 1100 can include controlling the first projector to project the projection content assigned to the first projector onto the horizontal screen and controlling the second projector to project the projection content assigned to the second projector onto the vertical screen, thereby achieving a double-fold screen projection picture fusion with a three-dimensional projection effect.
[0052] Figure 12 A block diagram of an exemplary control device 1200 according to one embodiment of the present application is illustrated, which is one example of a control device applicable to aspects of the present application.
[0053] Reference Figure 12 A control device 1200 will now be described, which is one example of a control device (e.g., user equipment, cloud server, in-vehicle control unit, etc.) applicable to aspects of the present application. The control device 1200 can be any machine configured to implement processes and / or computations, can be, but is not limited to, a workstation, a server, a desktop computer, a laptop computer, a tablet computer, a personal digital assistant, a smart phone, an in-vehicle computer, or any combination thereof. The various methods / apparatuses / servers / user equipment described above can all or at least partially be implemented by the control device 1200 or similar devices or systems.
[0054] The control device 1200 can include components that can be connected or communicate via one or more interfaces and buses 1202. For example, the control device 1200 can include a bus 1202, one or more processors 1204, one or more input devices 1206, and one or more output devices 1208. The one or more processors 1204 can be any type of processors and can include, but are not limited to, one or more general-purpose processors and / or one or more special-purpose processors (e.g., specialized processing chips). The input devices 1206 can be any type of devices capable of inputting information to the control device and can include, but are not limited to, a mouse, a keyboard, a touchscreen, a microphone, and / or a remote control device. The output devices 1208 can be any type of devices capable of presenting information and can include, but are not limited to, a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. The control device 1200 can also include or be connected with a non-transitory storage device 1210, which can be any storage device that is non-transitory and capable of implementing data storage, and which can include, but is not limited to, a disk drive, an optical storage device, a solid-state memory, a floppy disk, a flexible disk, a hard disk, a magnetic tape or any other magnetic medium, an optical disk or any other optical medium, a ROM (read only memory), a RAM (random access memory), a cache memory and / or any other memory chip or cartridge, and / or any other medium from which a computer can read data, instructions, and / or code. The non-transitory storage device 1210 can be detachable from the interface. The non-transitory storage device 1210 can have data / instructions / code for implementing the above-described methods and steps. The control device 1200 can also include a communication device 1212. The communication device 1212 can be any type of device or system capable of implementing communication with internal devices and / or with a network and can include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication device, and / or a chipset, such as a Bluetooth device, an IEEE 1302.11 device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.
[0055] When the control device 1200 is used as an in-vehicle device, it can also be connected with external devices (e.g., a GPS receiver, sensors for sensing different environmental data such as acceleration sensors, wheel speed sensors, gyroscopes, etc.). In this way, the control device 1200 can receive, for example, positioning data and sensor data indicative of the driving conditions of the vehicle. When the control device 1200 is used as an in-vehicle device, it can also be connected with other devices for controlling the driving and operation of the vehicle (e.g., an engine system, a wiper, an anti-lock braking system, a vehicle light control system, etc.).
[0056] In addition, the non-transitory storage device 1210 can have map information and software components so that the processor 1204 can implement a route guidance process. In addition, the output device 1206 can include a display for displaying a map, displaying a positioning marker of the vehicle, and displaying an image indicating a driving condition of the vehicle. The output device 1206 can also include a speaker or a headphone interface for audio guidance.
[0057] The bus 1202 can include, but is not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus. In particular, for an in-vehicle device, the bus 1202 can also include a Control Area Network (CAN) bus or other architecture designed for automotive applications.
[0058] The control device 1200 can also include a working memory 1214, which can be any type of memory that is capable of storing instructions and / or data that are useful for the working of the processor 1204 and can include, but is not limited to, a random access memory and / or a read-only memory device.
[0059] Software components can be located within the working memory 1214, which include, but are not limited to, an operating system 1216, one or more application programs 1218, drivers, and / or other data and code. Instructions for implementing the methods and steps described above can be contained within the one or more application programs 1218, and the modules / units / components of the various apparatuses / servers / user equipment described above can be implemented by the processor 1204 reading and executing the instructions of the one or more application programs 1218.
[0060] It should also be appreciated that variations can be made in accordance with specific requirements. For example, custom hardware might also be used, and / or particular components can be implemented in hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. Further, connection to other control devices, such as network input / output devices, can be employed. For example, portions or all of the disclosed methods and devices can be implemented using logic and algorithms according to the present application with programmed hardware, such as programmable logic circuits including field-programmable gate arrays (FPGA) and / or programmable logic arrays (PLA), in assembly language or hardware programming languages, such as VERILOG, VHDL, C++.
[0061] While aspects of the present application have been described thus far with reference to the drawings, the methods, systems, and devices described above are merely examples and the scope of the present application is not limited to these aspects, but is only defined by the claims and their equivalents. Various components can be omitted or replaced by equivalent components. Also, the steps can be implemented in a different order from that described in the present application. Furthermore, the various components can be combined in various ways. Also important is that as technology evolves, many of the components described can be replaced by equivalent components that later emerge.
Claims
1. A system for providing three-dimensional projection images for rear-seat passengers in a vehicle, the system comprising: The first projector installed in the rear passenger area of the vehicle; A second projector installed in the rear passenger area of the vehicle; Horizontal screen; Vertical screen; An in-vehicle camera, configured to identify the viewpoint coordinates of rear-seat passengers; Control device, the control device being configured to: The distance parameters from the rear passenger's viewpoint position to the edges of the horizontal and vertical screens are determined based on the viewpoint coordinates. The projection content allocated to the first projector and the second projector is adjusted based on the distance parameter; as well as The first projector is controlled to project the content allocated to the first projector onto the horizontal screen, and the second projector is controlled to project the content allocated to the second projector onto the vertical screen, thereby achieving dual-screen projection image fusion.
2. The system of claim 1, wherein the first projector is mounted on the rear trunk shelf, wherein during projection, the first projector projects onto the horizontal screen through a square hole in the center backrest of the rear seat.
3. The system of claim 1, wherein the second projector is mounted on a support at the rear end of the ceiling.
4. The system of claim 1, wherein the horizontal curtain is a skylight sunshade curtain, which is capable of moving back and forth with the frame.
5. The system of claim 4, wherein the vertical curtain is retractable into the front frame of the skylight sunshade.
6. The system of claim 5, wherein the winding is performed by a motor.
7. The system of claim 5, wherein at the junction of the horizontal screen and the vertical screen, the gap between the edge of the horizontal screen and the edge of the vertical screen is less than 2 mm.
8. A method for providing a three-dimensional projection image for rear-seat passengers in a vehicle, the method comprising: Identify the viewpoint coordinates of rear-seat passengers; Slide the horizontal screen to the optimal position and pull down the vertical screen; The distance parameters from the rear passenger's viewpoint position to the edges of the horizontal and vertical screens are determined based on the viewpoint coordinates. The projection content allocated to the first and second projectors is adjusted based on the distance parameters. as well as The content allocated to the first projector is projected onto the horizontal screen, and the content allocated to the second projector is projected onto the vertical screen, thereby achieving dual-screen projection image fusion.
9. The method of claim 8, wherein the first projector is mounted on the rear trunk shelf, wherein during projection, the first projector projects onto the horizontal screen through a square hole in the center backrest of the rear seat.
10. The method of claim 8, wherein the second projector is mounted on a rear end bracket of the ceiling.
11. The method of claim 8, wherein the horizontal curtain is a skylight sunshade curtain, which is capable of moving back and forth with the frame.
12. The system of claim 11, wherein the vertical curtain is retractable into the front frame of the skylight sunshade.
13. The system of claim 12, wherein the winding is performed by a motor.
14. The system of claim 12, wherein at the junction of the horizontal screen and the vertical screen, the gap between the edge of the horizontal screen and the edge of the vertical screen is less than 2 mm.
15. A vehicle comprising a system for providing three-dimensional projected images for rear-seat passengers as claimed in any one of claims 1-7.