Double-screen interaction method for in-vehicle game

Abstract

The invention relates to the technical field of vehicle-mounted application, and provides a vehicle game double-screen interaction method which comprises the following steps: S1, starting a game: running a game body App on a main driving vehicle; s2, initializing double-screen interaction: notifying a rear-row vehicle machine to open an interaction channel, and establishing local area network connection; s3, rendering a game picture: rendering and displaying the game picture on the main driving vehicle machine; s4, audio and video acquisition: acquiring game audios and videos running on the main driver; s5, audio and video coding: acquiring audio and video data codes and game video data through the GPU and the CPU; and S6, pushing the game audio and video: transmitting the coded data to a rear-row vehicle machine system through RTMP (Real Time Messaging Protocol). According to the invention, data transmission can be carried out by using the local area network in the vehicle without depending on the vehicle-mounted internet, so that the data transmission delay is effectively reduced, and the fluency of double-screen game interaction and the user experience are improved.

Description

Technical Field

[0001] The present invention relates to the field of vehicle-mounted application technology, and in particular to a dual-screen interaction method for vehicle-mounted games. Background Art

[0002] With the continuous development of electric vehicles with large screens, multiple screens and networking, the in-vehicle screen has become an important part of the smart car cockpit. The in-vehicle screen is one of the most important parts of the smart car cockpit. With the continuous development of electric vehicles with large screens, multiple screens and networking, the in-vehicle screen is also constantly upgrading. Existing brands have launched large-screen and multi-screen car models, and the size of the in-vehicle screen has gradually increased.

[0003] The current dual-screen interactive solution for car-machine interaction is to transmit video data from the first screen of the car-machine end to the second screen of the instrument panel end. The first screen and the second screen are the same host. The same host hardware is used, and the instrument panel screen displays the video image generated by the host. The dual-screen solution for car-machine interaction is a dual-screen linkage between the car-machine end and the instrument panel end. The content displayed on the instrument panel end at the main driving position is the video stream data of the main driving host.

[0004] Most of the dual-screen interaction solutions in the existing technology are limited to screen interaction within the same host, and cannot achieve dual-screen game interaction across hosts and locations. They also have high requirements on the adaptability of game content, which limits the user experience and range of choices. Summary of the invention

[0005] In view of the above problems, the present invention provides a dual-screen interactive method for car games.

[0006] To solve the above problems, the technical solution adopted by the present invention is:

[0007] A dual-screen interactive method for a car game comprises the following steps:

[0008] S1. Start the game: Run the game app on the main driving computer;

[0009] S2. Initialize dual-screen interaction: notify the rear car computer to open the interactive channel and establish a LAN connection;

[0010] S3, rendering the game screen: rendering and displaying the game screen on the main driving vehicle computer;

[0011] S4, audio and video acquisition: collect the audio and video of the game running on the main driver's car computer;

[0012] S5, audio and video encoding: obtain audio and video data encoding and game video data through GPU and CPU;

[0013] S6, push game audio and video: transmit the encoded data to the rear car system through RTMP;

[0014] S7, audio and video decoding: the rear car system decodes the game audio and video data;

[0015] S8, transmitting the control command of player 2: the game control module of player 2 on the main driving vehicle computer virtualizes a handle channel, and the channel transmits the control command stream data of player 2;

[0016] S9, transmitting the control instruction of player 1: player 1 adds a physical handle to the game control module, and uniformly transmits the control instruction stream to the game control module;

[0017] S10, merging the control instruction stream: the game control module merges the control instructions of player 1 and player 2, and sends them to the game body App of the cloud game in the main driver's car computer.

[0018] Preferably, in step S4, the original data of the game screen and the game audio are obtained by obtaining the display chip and the sound chip in Android.

[0019] Preferably, in step S5, the obtained audio and video data encoding and the game video data are encoded using the h264 / h265 encoding format, the game audio data are encoded using the AAC encoding format, and are encapsulated into the MP4 format.

[0020] Preferably, in step S6, RTMP pushes the encoded audio and video streams to the back-end host via the RTMP protocol.

[0021] Preferably, in step S2, the rear vehicle computer realizes two-way transmission of audio and video streams and control commands with the main driver vehicle computer through the vehicle-mounted local area network.

[0022] Preferably, in step S8, player 2 combines the control instructions received by the rear vehicle computer system with the control instructions of the main driver vehicle computer through the virtual handle channel and sends them to the game body App.

[0023] The beneficial effects of the present invention are:

[0024] 1. Reduce latency and improve experience: Use the in-car LAN for data transmission without relying on the in-car Internet, which effectively reduces data transmission latency and improves the smoothness of dual-screen game interaction and user experience.

[0025] 2. Cross-host interaction and expanded application scenarios: It realizes dual-screen interaction between different host systems, not only limited to single-host dual-screen interaction, breaking the limitations of traditional technology and expanding the application scenarios of game interaction.

[0026] 3. No need for additional hardware support: The present invention implements the dual-screen interactive function through software, without the need for additional hardware support, thus reducing system costs and improving the universality and scalability of the system.

[0027] 4. Enrich family and parent-child interaction: In the smart cockpit, users in the front and rear rows can interact with the same game in different positions, providing a new way for family and child interaction and enhancing communication and interaction between family members.

[0028] 5. Improve the richness of game content: The present invention does not rely on the specific adaptation of the game App, and realizes dual-screen interaction by simulating handle input, so that more games can support dual-screen play, enriching the choice of game content.

[0029] 6. Enhance system stability and reliability: By transmitting audio and video streams and control commands within the local area network, the interference of external network factors is reduced, and the stability and reliability of the system are improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 It is a system scenario diagram of the present invention;

[0031] Figure 2 It is a system flow chart of the present invention. DETAILED DESCRIPTION

[0032] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0033] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0034] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, "multiple" means two or more, unless otherwise clearly and specifically defined. In addition, the terms "installed", "connected" and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal connection of two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0035] Reference Figure 1-2 , a dual-screen interactive method for a car game, comprising the following steps:

[0036] S1. Start the game: Run the game app on the main driving computer;

[0037] S2. Initialize dual-screen interaction: notify the rear car computer to open the interactive channel and establish a LAN connection;

[0038] S3, rendering the game screen: rendering and displaying the game screen on the main driving vehicle computer;

[0039] S4, audio and video acquisition: collect the audio and video of the game running on the main driver's car computer;

[0040] S5, audio and video encoding: obtain audio and video data encoding and game video data through GPU and CPU;

[0041] S6, push game audio and video: transmit the encoded data to the rear car system through RTMP;

[0042] S7, audio and video decoding: the rear car system decodes the game audio and video data;

[0043] S8, transmitting the control command of player 2: the game control module of player 2 on the main driving vehicle computer virtualizes a handle channel, and the channel transmits the control command stream data of player 2;

[0044] S9, transmitting the control instruction of player 1: player 1 adds a physical handle to the game control module, and uniformly transmits the control instruction stream to the game control module;

[0045] S10, merging the control instruction stream: the game control module merges the control instructions of player 1 and player 2, and sends them to the game body App of the cloud game in the main driver's car computer.

[0046] Furthermore, in step S4, the original data of the game screen and the game audio are obtained by obtaining the display chip and the sound chip in Android.

[0047] Further, in step S5, the obtained audio and video data encoding and the game video data are encoded by the h264 / h265 encoding format, the game audio data are encoded by the AAC encoding format, and are encapsulated into the MP4 format.

[0048] Furthermore, in step S6, RTMP pushes the encoded audio and video streams to the back-end host through the RTMP protocol.

[0049] Furthermore, in step S2, the rear vehicle computer realizes two-way transmission of audio and video streams and control commands with the main driver vehicle computer through the vehicle-mounted local area network.

[0050] Furthermore, in step S8, player 2 combines the control instructions received by the rear vehicle computer system with the control instructions of the main driver vehicle computer through the virtual handle channel and sends them to the game body App.

[0051] To sum up the above, when the front and rear rows of the smart cockpit need to play a game at the same time, the main driver's car computer opens the game App, and the main driver's car computer simultaneously collects the game screen and game sound displayed on the screen, and simultaneously pushes the stream to the rear car computer through the in-car LAN wifi network. The handle connected to the main driver's car computer serves as player 1, and the main driver's car computer will simulate the event of another handle being inserted, simulating the game user player 2. The handle connected to the rear car computer is transmitted to the main driver's car computer through the in-car LAN wifi, forming a game interaction between the front and rear rows. The software realizes the game interaction between the front and rear rows without the need for additional hardware support and network traffic, which improves the smart cockpit gaming experience and provides a family parent-child interaction solution. In the case of poor 5G signal or no signal in a specific place, dual-screen game interaction support can also be provided.

[0052] At present, the dual-screen interactive solution for vehicle-machine interaction is realized by transmitting video data from the first screen on the vehicle-machine end to the second screen on the instrument end. The first screen and the second screen are the same host. The method proposed in this patent can solve the dual-screen game interaction solution between different hosts in the front and rear positions of the vehicle-machine. The dual-screen interaction between different hosts can realize the interaction between different host systems, and is not limited to the dual-screen interaction of a single host. The dual screens not only interact with video stream data, but also with control data, which can realize the dual-screen interactive gameplay of stand-alone games.

[0053] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A dual-screen interactive method for car games. It is characterized in that The following steps are involved: S1. Start the game: Run the game app on the main driving computer; S2. Initialize dual-screen interaction: notify the rear car computer to open the interactive channel and establish a LAN connection; S3, rendering the game screen: rendering and displaying the game screen on the main driving vehicle computer; S4, audio and video acquisition: collect the audio and video of the game running on the main driver's car computer; S5, audio and video encoding: obtain audio and video data encoding and game video data through GPU and CPU; S6, push game audio and video: transmit the encoded data to the rear car system through RTMP; S7, audio and video decoding: the rear car system decodes the game audio and video data; S8, transmitting the control command of player 2: the game control module of player 2 on the main driving vehicle computer virtualizes a handle channel, and the channel transmits the control command stream data of player 2; S9, transmitting the control instruction of player 1: player 1 adds a physical handle to the game control module, and uniformly transmits the control instruction stream to the game control module; S10, merging the control instruction stream: the game control module merges the control instructions of player 1 and player 2, and sends them to the game body App of the cloud game in the main driver's car computer.

2. A dual-screen interactive method for car games according to claim 1, It is characterized in that In step S4, the original data of the game screen and the game audio are obtained by obtaining the display chip and the sound chip in Android.

3. A dual-screen interactive method for car games according to claim 1, It is characterized in that In step S5, the audio and video data encoding is obtained, the game video data is encoded using the h264 / h265 encoding format, the game audio data is encoded using the AAC encoding format, and encapsulated into the MP4 format.

4. A dual-screen interactive method for car games according to claim 1, It is characterized in that In step S6, RTMP pushes the encoded audio and video streams to the back-end host through the RTMP protocol.

5. According to claim 1, a method for dual-screen interaction of a car game, It is characterized in that In step S2, the rear vehicle computer realizes two-way transmission of audio and video streams and control commands with the main driver's vehicle computer through the vehicle-mounted local area network.

6. A vehicle-computer game dual-screen interactive method according to claim 1, It is characterized in that In step S8, player 2 combines the control instructions received by the rear vehicle computer system with the control instructions of the main driver vehicle computer through the virtual handle channel and sends them to the game body App.

Images