Automobile cabin entertainment mode control method
By projecting images onto the car's cabin windows and combining them with surround sound and vehicle control, the problem of the limited functionality of traditional screen controls is solved, enabling a multi-mode immersive entertainment experience.
Patent Information
- Application Number
- CN202411883197.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-19
- Publication Date
- 2025-11-18
- Estimated Expiration
- 2044-12-19
AI Technical Summary
Current in-car entertainment systems primarily rely on the limited touchscreen controls of screen-based devices, lacking diverse and immersive entertainment experiences.
By projecting images onto the windshield, sunroof, and door windows, combined with surround sound and vehicle control components, multi-mode entertainment content can be presented, including image penetration, suspension control, and dynamic sound fields, enhancing the entertainment experience.
It significantly enhances the diversity and immersion of the entertainment experience in the car cabin, providing an innovative way of entertainment that differs from traditional screen control.
Smart Images

Figure CN119550923B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of intelligent cockpit technology, and in particular to a method for controlling automotive cockpit entertainment modes. Background Technology
[0002] Currently, in-car entertainment systems are generally controlled via touchscreens or gamepads on the driver and passenger side screens. Meanwhile, the car cabin is a relatively enclosed environment with good sound quality and sound insulation, providing excellent basic conditions for entertainment. Therefore, there is significant potential for expanding entertainment options within the car cabin that rely solely on touchscreen controls. Summary of the Invention
[0003] In view of the above, the present invention aims to provide a method for controlling the entertainment mode in an automotive cabin to solve the aforementioned technical problems.
[0004] The technical solution adopted in this invention is as follows:
[0005] This invention provides a method for controlling automotive cockpit entertainment modes, including:
[0006] Switch modes based on the user's entertainment requests;
[0007] When switching to the first mode, images are projected onto the windshield, sunroof and / or door windows to simulate the scene environment, and the projected images are displayed continuously between different windows, while the audio of the corresponding entertainment content is output with surround sound effects.
[0008] When switching to the second mode, images are projected onto the windshield, sunroof, and / or door windows, and at least the following control methods are combined: the projected images are continuously displayed and the corresponding entertainment content is executed in conjunction with the control of the first vehicle operating component in the cockpit and the vehicle suspension; or, the corresponding entertainment content is executed by connecting to entertainment peripherals and using spatial relationship algorithms and the continuous display of projected images.
[0009] When switching to the third mode, based on the entertainment content or preset values, several speakers in the cabin are controlled to form a dynamic sound field in the cabin, and / or the opening and closing of the second vehicle operating components are controlled to assist in enhancing the entertainment content.
[0010] In at least one of the possible implementations, the first mode includes a screen penetration function: creating visual interference within the cabin by presenting the screen on different glass surfaces in a synchronized and / or switched manner, combined with a projection flicker effect.
[0011] In at least one of the possible implementations, when playing a competitive game in the second mode: the vehicle is in the starting state, the first vehicle operating component is disconnected from the driving power system, and the electrical signal of the first vehicle operating component is associated with the content of the competitive game through the intelligent driving control system, and the electrical signal of the first vehicle operating component is associated with the height control of the air suspension.
[0012] In at least one of the possible implementations, when playing a shooting game in the second mode: the game's accompanying sensor gun is connected, and the trajectory direction presented in the projected image is determined by a three-point-one-line algorithm using the front and rear reference points on the sensor gun.
[0013] Based on the game content, the projected image is displayed and the ballistic direction calculation is performed simultaneously, and the shooting effect is presented in the projected image after fusion.
[0014] In at least one of the possible implementations, the formation of a dynamic sound field within the cabin by the plurality of speakers in the control cockpit includes: controlling the output sequence and volume of each speaker in the vehicle to form at least one of the following sound effects: surround sound, penetrating sound, gradually approaching sound, or directional sound.
[0015] In at least one of the possible implementations, the first vehicle operating component includes at least one of the following: a steering wheel, a brake pedal, a power pedal, and a gear shift mechanism;
[0016] The second vehicle operating components include at least one of the following: door locks, glass, seat belts, seats, air conditioning, windshield wipers, interior lights, and power supply.
[0017] Compared with existing technologies, the main design concept of this invention lies in switching modes based on the user's entertainment requests: In the first mode, entertainment images are displayed on the car door windows, with image continuity and surround sound effects; in the second mode, entertainment content is executed by displaying entertainment images on the car door windows and combining image continuity with the control of the first vehicle operating components and suspension, or by connecting to external devices and utilizing mature spatial algorithms and image continuity to execute corresponding entertainment content; in the third mode, multiple speakers can be controlled to form a dynamic sound field in the cabin and / or the opening and closing of the second vehicle operating components can be controlled based on the entertainment content or preset values to assist in enhancing the entertainment content. This invention makes full use of the configuration and space in the car cabin as a place to fully display entertainment content, which can significantly improve the entertainment experience to a more diverse and distinctly different level from traditional scenarios. Attached Figure Description
[0018] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described below with reference to the accompanying drawings, wherein:
[0019] Figure 1This is a schematic diagram of a car cabin entertainment mode control method provided in an embodiment of the present invention. Detailed Implementation
[0020] Embodiments of the present invention are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.
[0021] This invention proposes an embodiment of a method for controlling automotive cockpit entertainment modes, specifically, as follows: Figure 1 As shown, it includes:
[0022] Step S1: Switch modes based on the user's entertainment requests;
[0023] Step S2: When switching to the first mode, images are projected onto the windshield and / or door glass to simulate the scene environment. In the first mode, the projected images are continuously displayed between different glass surfaces, while the audio of the corresponding entertainment content is output with surround sound effects.
[0024] The first mode can be understood as the experience mode required for travel exploration or regular movie watching. For example, the cabin space inside the car can be regarded as a mobile vehicle cabin such as an aircraft, submarine, or exploration vehicle, and the external environment can be simulated by projecting images onto the windshield and front and rear door windows. The main technical means used throughout the process include: image tracking, surround sound, and sound penetration.
[0025] To elaborate, the image disappears at the edge of the windshield and continues to appear through the adjacent door windows, thus achieving a continuous and immersive overall visual effect. Furthermore, unlike watching a movie at home, a car cabin has a larger number of speakers, allowing for coordinated playback throughout the vehicle to create a surround sound effect.
[0026] In addition, in the first mode, techniques such as image penetration and / or sound penetration can be used to achieve this.
[0027] (1) Regarding image penetration: This is applicable to visual effects where objects such as arrows, birds, or meteors appear to penetrate the cabin. For example, birds or other penetrating objects are displayed from a distance to near in the left-side window. When the entertainment content (not limited to games, movies, etc.) pre-installed in the intelligent driving system requires the bird penetration effect to be displayed at this time, the image can be simultaneously displayed in the left and right side door windows. At the same time, the projector generates a flicker effect, creating visual interference to the passengers' line of sight in the cabin. The interference time can be preset to 0.1-0.24 seconds. During this period, the image effect is that the bird in the left-side door window image disappears, while the visual effect of the bird leaving in the right-side door window image is retained.
[0028] (2) Regarding sound penetration: Generally speaking, it can be used in conjunction with the predetermined entertainment content and the visual penetration. For example, when an auditory penetration effect is required, sound is emitted from the left speaker located in the cockpit, then switched to the dual speakers, while resonance is added in the bass and treble ranges on both sides. After that, the sound is switched to the right speaker alone, and the resonance disappears simultaneously. This completes the sound penetration process.
[0029] Continuing from the previous text, in step S3, when switching to the second mode, images are projected onto the windshield and / or door glass, and at least the following control methods are combined: the projected images are continuously displayed and the corresponding entertainment content is executed in conjunction with the control of the first vehicle operating component in the cockpit and the vehicle suspension; or, the corresponding entertainment content is executed by connecting to entertainment peripherals and using spatial relationship algorithms and the projected images to continuously display.
[0030] The second mode can be understood as an experience mode for certain specific types of games, such as competitive games and shooting games. For competitive games, the technical implementation methods that can be adopted include at least: screen following (as explained above, it will not be elaborated here), disconnection operation, and suspension control.
[0031] (1) Regarding disconnection operation: When the vehicle is in the starting state during entertainment, it is necessary to disconnect the vehicle control components in the cockpit from the actual vehicle driving / power system, and associate the signals of the vehicle control hardware with the program content of the competitive game. For example, the association between the steering wheel and the vehicle rotation mechanism is shielded by electrical signals, and after the steering wheel is unlocked, its angle detection signal is input as a variable signal into the control module of the intelligent driving system equipped with the competitive game, while the actual vehicle is in a stationary state. The first vehicle control component mentioned here may include, but is not limited to: steering wheel, brake pedal, power pedal, gear shift mechanism, etc.
[0032] (2) Regarding suspension control: Furthermore, the height control of the air suspension can be connected to the steering wheel after disconnection. The suspension height will change with the steering wheel angle. Of course, the specific height value can be adjusted according to the vehicle size to simulate the effect of centrifugal force felt during cornering in racing games. This can be explained as follows: In the natural state of the steering wheel, the suspension is horizontal. For every 30° rotation of the steering wheel, the height of the outer cornering side suspension can decrease by 1.5-2mm, while the height of the inner side suspension can increase by 1.5-2mm. For example, when a car turns left in a racing game, it will generate centrifugal force to the right. At this time, the left side suspension of this vehicle is higher, causing the human body to tilt to the right. The user will unconsciously generate a supporting force to the right to maintain balance, which is the same as the force exerted when turning in real driving.
[0033] For shooting games, the technical means that can be used include at least: sensor gun connection, ballistic algorithm, and screen tracking and ballistic coupling algorithm.
[0034] (1) Regarding the connection of the sensor gun: The external sensor gun device for gaming can be connected to the control module of the intelligent driving system via a wireless network. In some embodiments, sensors are provided at the front and rear of the sensor gun barrel to obtain the physical coordinates of the gaming device in the vehicle cabin.
[0035] (2) Regarding the ballistic algorithm: On the one hand, the shooting direction can be calculated using the principle of three points in a line. For example, by combining the coordinates of the front and rear sensors of the sensor gun, the coordinates of the third point on the screen can be extended and calculated, which is the direction in which the bullet is fired in the game screen. On the other hand, the distance between the bullet and the character is mainly related to the ballistic angle. In the traditional game mode, the character's view is rotated by the mouse, and then the bullet is fired straight forward. However, the ballistic algorithm in the car cabin cannot be applied. Therefore, after the sensor gun is triggered to fire, the bullet can only be displayed as being fired straight forward on the screen when the extension line of the front and rear sensors on the gun is perpendicular to the screen. If the extension line of the front and rear sensors is not perpendicular to the screen, the bullet will be fired at an angle on the screen. It can be seen that only in the specific environment of the car cabin can the three-dimensional coordinate scanning be realized based on the sensor of the sensor gun, thereby creating the game effect of oblique shooting. This is difficult to achieve in the home entertainment environment.
[0036] (3) Regarding the mention of screen following, it can be coupled with the aforementioned ballistic calculation results: there is a certain time interval between the bullet being fired and hitting the target. If the ballistics after the firing indicates that the bullet is fired at the edge of the screen (such as the windshield), and the target is hit on another screen (such as the front door window on one side), the ballistic calculation and screen following can be carried out simultaneously. That is, the bullet is fired at the edge of the windshield, while the effect of the target being hit is shown in the screen of the door glass.
[0037] Finally, in step S4, when switching to the third mode, based on the entertainment content or preset settings, control several speakers in the cabin to form a dynamic sound field in the cabin, and / or control the opening and closing of the second vehicle operating components to assist in enhancing the entertainment content.
[0038] This can be broken down into two parts: First, by editing in the background or based on the recognition of entertainment content (videos, games, etc.), the speakers in the car can be controlled to create a loop sound (such as the surround sound effect and sound penetration mentioned above), so that the speakers in the car cabin emit sound in sequence, thereby creating the effect of sound rotating around the occupants; In addition, the speakers can be controlled to create a gradual sound, for example, the speakers located in the corners of the cabin emit sound first, and the sound gradually increases, and then the surrounding speakers begin to emit sound and conduct it in a certain direction, eventually creating a resonance sound in the car or the sound moving away and disappearing in a certain direction.
[0039] Secondly, the intelligent driving system can control the functions of various secondary vehicle operating components, such as door locks, window raising and lowering, seat belt pretensioning, seat adjustment, air conditioning, windshield wipers, interior light brightness, and simulated power outage. It can be edited in the background or autonomously activated or deactivated based on the recognition of entertainment content (audio, video, games, etc.) to create an atmosphere that matches the current entertainment content and enhance the entertainment effect.
[0040] In summary, the main design concept of this invention lies in switching modes based on the user's entertainment requests: In the first mode, entertainment images are displayed on the car door windows, featuring image continuity and surround sound effects; in the second mode, entertainment content is executed by displaying entertainment images on the car door windows, combined with image continuity and control of the first vehicle operating component and suspension, or by connecting to external devices and utilizing mature spatial algorithms and image continuity to execute corresponding entertainment content; in the third mode, multiple speakers can be controlled to form a dynamic sound field within the cabin and / or the opening and closing of the second vehicle operating component can be controlled based on the entertainment content or preset values to enhance the entertainment content. This invention fully utilizes the configuration and space within the car cabin as a venue for fully showcasing entertainment content, significantly enhancing a more diverse and distinctly different entertainment experience from traditional scenarios.
[0041] In this invention, when directional terms are mentioned, they are relative concepts based on the embodiments. Furthermore, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, A and B simultaneously, or B alone. A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects have an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, and c can represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple.
[0042] The above description of the structure, features, and effects of the present invention is based on the embodiments shown in the figures. However, the above are only preferred embodiments of the present invention. It should be noted that the technical features involved in the above embodiments and their preferred methods can be reasonably combined and matched by those skilled in the art to form a variety of equivalent solutions without departing from or changing the design concept and technical effects of the present invention. Therefore, the present invention is not limited to the scope of implementation shown in the figures. Any changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments, that do not exceed the spirit covered by the specification and figures, should be within the protection scope of the present invention.
Claims
1. A method for controlling automotive cockpit entertainment modes, characterized in that, include: Switch modes based on the user's entertainment requests; When switching to the first mode, images are projected onto the windshield, sunroof and / or door windows to simulate the scene environment, and the projected images are displayed continuously between different windows, while the audio of the corresponding entertainment content is output with surround sound effects. When switching to the second mode, images are projected onto the windshield, sunroof, and / or door windows, and at least the following control methods are combined: the projected images are continuously displayed and the corresponding entertainment content is executed in conjunction with the control of the first vehicle operating component in the cockpit and the vehicle suspension; or, the corresponding entertainment content is executed by connecting to entertainment peripherals and using spatial relationship algorithms and the continuous display of projected images. When switching to the third mode, based on the entertainment content or preset values, several speakers in the cabin are controlled to form a dynamic sound field in the cabin, and / or the opening and closing of the second vehicle operating components are controlled to assist in enhancing the entertainment content; In the second mode, when playing competitive games: the vehicle is in the started state, the first vehicle operating component is disconnected from the driving power system, and the electrical signal of the first vehicle operating component is associated with the content of the competitive game through the intelligent driving control system, and the electrical signal of the first vehicle operating component is associated with the height control of the air suspension; specifically including: When the vehicle is running during entertainment, the vehicle control components in the cockpit are disconnected from the actual vehicle driving and power system, and the signals of the vehicle control hardware are associated with the program content of the competitive game; in addition, the height control of the air suspension is connected to the steering wheel after disconnection, so that the height of the suspension changes with the angle of the steering wheel.
2. The automotive cockpit entertainment mode control method according to claim 1, characterized in that, The first mode includes a screen penetration function: by presenting images on different glass surfaces in a synchronized and / or switched manner, combined with the projection flicker effect, visual interference is created inside the cabin.
3. The automotive cockpit entertainment mode control method according to claim 1, characterized in that, When playing shooting games in the second mode: connect the game's matching sensor gun, and use the front and rear reference points on the sensor gun to determine the trajectory direction presented in the projected image using a three-point alignment algorithm; Based on the game content, the projected image is displayed and the ballistic direction calculation is performed simultaneously, and the shooting effect is presented in the projected image after fusion.
4. The automotive cockpit entertainment mode control method according to claim 1, characterized in that, The control of the cockpit's multiple speakers to form a dynamic sound field includes controlling the output sequence and volume of each speaker in the vehicle to create at least one of the following sound effects: surround sound, penetrating sound, gradually approaching sound, or directional sound.
5. The automotive cockpit entertainment mode control method according to any one of claims 1 to 4, characterized in that, The first vehicle operating components include at least one of the following: a steering wheel, a brake pedal, a power pedal, and a gear shift mechanism; The second vehicle operating components include at least one of the following: door locks, glass, seat belts, seats, air conditioning, windshield wipers, interior lights, and power supply.
Citation Information
Patent Citations
Vehicle control system and method
CN112406893A
Vehicle-mounted entertainment system coupled with open world exploration game and vehicle
CN116674479A