Game control method, device, vehicle-mounted terminal and vehicle based on human-vehicle interaction

Abstract

The present application discloses a game control method, device, vehicle-mounted terminal and vehicle based on human-vehicle interaction. After receiving the game start command from the user, the game application is run to obtain the game screen of the game application and generate an imaging signal containing the game screen. An imaging signal is sent to the vehicle's headlight module so that the headlight module projects the imaging content in a preset area according to the imaging signal. Game instructions for operating the game application are determined based on the acquired user's gestures. The game application is controlled to execute the game instructions to obtain a changed game screen corresponding to the game instructions, so that the game screen in the imaging content is changed to a changed game screen. Compared with the prior art in which users can only operate smart terminals to control game applications, based on the solution shown in the present application, users can achieve fun control of the game application running on the vehicle-mounted terminal by performing any gesture, thereby meeting users' expectations for a higher interactive experience in smart cars.

Description

Technical Field

[0001] The present application relates to the field of intelligent automobile technology, and in particular to a game control method, device, vehicle-mounted terminal, and vehicle based on human-vehicle interaction. Background Art

[0002] With the advancement of technology, cars are no longer just traditional means of transportation; they now also offer gaming and entertainment functions. Traditionally, users have engaged in gaming in cars primarily through interaction between smart terminals and the vehicle's onboard system. For example, users could use their smartphone as a game controller and the vehicle's onboard system as a game console, or control the car's lights to flash at a preset rhythm using the smart terminal.

[0003] Obviously, the game interaction method in the existing technology requires that the human-vehicle interaction process completely relies on the smart terminal for game control, which cannot reflect the intelligent effect of the vehicle and cannot meet users' expectations for a higher interactive experience of smart cars. Summary of the Invention

[0004] The present application provides a game control method, device, vehicle-mounted terminal and vehicle based on human-vehicle interaction, aiming to meet users' expectations for a higher interactive experience in smart cars and enrich the gaming and entertainment experience of smart cars.

[0005] In order to achieve the above objectives, this application provides the following technical solutions:

[0006] A game control method based on human-vehicle interaction, applied to a vehicle-mounted terminal, includes:

[0007] After receiving a game start command from a user, running a game application, obtaining a game screen of the game application, and generating an imaging signal containing the game screen; the game application is pre-saved;

[0008] Sending the imaging signal to a headlight module of the vehicle, so that the headlight module projects imaging content within a preset area according to the imaging signal; the imaging content includes the game screen;

[0009] Determining a game instruction for operating the game application according to the acquired gesture of the user;

[0010] The game application is controlled to execute the game instruction to obtain a changed game screen corresponding to the game instruction, so that the game screen in the imaging content is changed to the changed game screen.

[0011] Optionally, determining a game instruction for operating the game application based on the acquired gesture of the user includes:

[0012] Obtaining the time when at least three positioning anchor points preset on the vehicle receive positioning signals, wherein the positioning signals are sent by the mobile terminal held by the user;

[0013] Determining the position coordinates of the mobile terminal in a preset spatial coordinate system based on the time when the at least three positioning anchor points receive the positioning signal;

[0014] Determining a gesture of the user based on the position coordinates;

[0015] A game instruction corresponding to the gesture action is obtained from a preset instruction library as a game instruction for operating the game application.

[0016] Optionally, the acquiring of the time when at least three positioning anchor points preset on the vehicle receive positioning signals further includes:

[0017] The mobile terminal is authenticated in advance, and a communication connection is established between the positioning anchor point and the mobile terminal.

[0018] Optionally, determining the user's gesture based on the position coordinates includes:

[0019] In the case where the position coordinates are within a preset coordinate range, the position coordinates are marked as valid coordinates; the preset coordinate range includes: the position coordinates of the preset area in the preset space coordinate system;

[0020] generating a motion trajectory of the mobile terminal based on the multiple valid coordinates obtained within a preset time period;

[0021] The gesture action corresponding to the motion trajectory is obtained from a preset gesture action library as the gesture action of the user.

[0022] Optionally, determining a game instruction for operating the game application based on the acquired gesture of the user includes:

[0023] Acquiring a human body image captured by a camera pre-installed on the vehicle;

[0024] Performing human posture recognition on the human body image to obtain the user's posture action;

[0025] A game instruction corresponding to the gesture action is obtained from a preset instruction library as a game instruction for operating the game application.

[0026] Optionally, after sending the imaging signal to the vehicle's headlight module so that the headlight module projects imaging content within a preset area according to the imaging signal, the method further includes:

[0027] Determine game instructions for operating the game application based on the acquired location of the user.

[0028] Optionally, the imaging content further includes a plurality of preset key patterns;

[0029] The determining, based on the acquired location of the user, a game instruction for operating the game application includes:

[0030] Obtaining the time when at least three positioning anchor points preset on the vehicle receive positioning signals, wherein the positioning signals are sent by the mobile terminal held by the user;

[0031] Obtaining the user's location based on the time when the at least three positioning anchor points receive the positioning signal;

[0032] When the position is located in the area of ​​any key pattern and is maintained for a preset time, a game instruction corresponding to the key pattern at the position is obtained from a preset instruction library as a game instruction for operating the game application.

[0033] A game control device based on human-vehicle interaction, comprising:

[0034] a game running unit, configured to run a game application after receiving a game start command from a user, obtain a game screen of the game application, and generate an imaging signal containing the game screen; the game application is pre-saved;

[0035] A screen projection unit, configured to send the imaging signal to a headlight module of the vehicle, so that the headlight module projects imaging content within a preset area according to the imaging signal; the imaging content includes the game screen;

[0036] an instruction determining unit, configured to determine a game instruction for operating the game application based on the acquired gesture of the user;

[0037] The screen changing unit is used to control the game application to execute the game instruction and obtain a changed game screen corresponding to the game instruction, so that the game screen in the imaging content is changed to the changed game screen.

[0038] A vehicle-mounted terminal includes a stored program, wherein the program executes the game control method based on human-vehicle interaction.

[0039] A vehicle comprises a stored program, wherein the game control method based on human-vehicle interaction is executed when the program is run.

[0040] The technical solution provided by the present application runs the game application after receiving the game start command from the user, obtains the game screen of the game application, and generates an imaging signal containing the game screen. An imaging signal is sent to the vehicle's headlight module so that the headlight module projects the imaging content in a preset area according to the imaging signal. Based on the acquired user's gestures and movements, the game instructions for operating the game application are determined. The game application is controlled to execute the game instructions, and a changing game screen corresponding to the game instructions is obtained, so that the game screen in the imaging content is changed to a changing game screen. Compared with the prior art in which users can only operate smart terminals to control game applications, based on the solution shown in the present application, users can achieve fun control of the game application running on the vehicle by performing any gesture (such as hand movement and body movement), and can project the changing game screen corresponding to the game instructions through the headlight module, thereby meeting users' expectations for a higher interactive experience in smart cars and enriching the gaming and entertainment experience of smart cars. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0042] Figure 1a A schematic diagram of the architecture of a game control system based on human-vehicle interaction provided in an embodiment of the present application;

[0043] Figure 1b A schematic diagram of an interaction process provided in an embodiment of the present application;

[0044] Figure 1c A schematic diagram of an interaction process provided in an embodiment of the present application;

[0045] Figure 1d A schematic diagram of an application scenario provided in an embodiment of the present application;

[0046] Figure 2 A flowchart of a game control method based on human-vehicle interaction provided in an embodiment of the present application;

[0047] Figure 3 A flowchart of another game control method based on human-vehicle interaction provided in an embodiment of the present application;

[0048] Figure 4 A schematic diagram of the architecture of a game control device based on human-vehicle interaction provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0050] like Figure 1a FIG. 1 is a schematic diagram of the architecture of a game control system based on human-vehicle interaction provided by an embodiment of the present application, including:

[0051] The mobile terminal 100 and the vehicle-mounted terminal 200 are both pre-installed with an UltraWide Band (UWB) module in the vehicle, thereby ensuring UWB communication between the mobile terminal 100 and the vehicle. In this embodiment of the present application, the UWB module pre-installed on the vehicle is considered to be the positioning anchor point. In addition, the mobile terminal 100 is held by the user by default.

[0052] It should be noted that the information interaction process between the mobile terminal 100 and the vehicle terminal 200 is as follows: Figure 1b and Figure 1c As shown, the following steps are included:

[0053] S101: The vehicle-mounted terminal 200 sends an identity search signal to the mobile terminal 100.

[0054] The signal transmission method for the vehicle-mounted terminal 200 to send the identity search signal to the mobile terminal 100 includes but is not limited to: Bluetooth transmission, WiFi transmission, etc.

[0055] S102 : After receiving the identity search signal, the mobile terminal 100 sends an identity signal to the vehicle terminal 200 .

[0056] Among them, after receiving the identity search signal, the mobile terminal 100 will display a prompt to enter the password through a preset interface. After receiving the password entered by the holder of the mobile terminal 100, it generates an identity signal containing the password and sends the identity signal to the vehicle.

[0057] S103: The vehicle-mounted terminal 200 analyzes the identity signal to obtain the identity information of the mobile terminal 100.

[0058] S104: The vehicle-mounted terminal 200 verifies the identity information of the mobile terminal 100 and obtains a verification result.

[0059] S105 : When the verification result indicates that the mobile terminal 100 has the communication authority, the vehicle-mounted terminal 200 establishes a UWB communication connection between the positioning anchor point preset on the vehicle and the mobile terminal 100 .

[0060] The process shown in S101-S105 is essentially: the vehicle-mounted terminal 200 authenticates the mobile terminal 100, and when it is determined that the mobile terminal 100 has passed the authentication, establishes a communication connection between the positioning anchor point and the mobile terminal 100.

[0061] It should be noted that there are at least three positioning anchor points pre-installed on the vehicle, and each positioning anchor point is installed at a different location. The so-called UWB communication means that the positioning anchor points and the mobile terminal 100 can send and receive UWB signals sent by each other.

[0062] S106: After receiving the game start command from the user, the vehicle-mounted terminal 200 runs the game application and obtains the game screen of the game application.

[0063] Among them, the game application is pre-stored in the vehicle-mounted terminal 200, and the user can select the game application to be run by sending a game start command.

[0064] S107: The vehicle-mounted terminal 200 generates a game screen signal corresponding to the game screen.

[0065] S108: The vehicle-mounted terminal 200 processes the game screen signal to obtain an imaging signal containing the game screen.

[0066] The imaging signal is transmitted via a bus, and the bus type includes but is not limited to a CAN bus or a LIN bus.

[0067] S109: The vehicle-mounted terminal 200 sends an imaging signal to the vehicle's headlight module, so that the headlight module projects imaging content within a preset area according to the imaging signal.

[0068] The headlight module includes a digital light processing device and a projection lens. Specifically, after receiving an imaging signal, the headlight module processes the imaging signal via the digital light processing device to generate projection light containing the imaging content. The projection light is then reflected into the projection lens, which then projects the projection light onto the ground, so that the imaging content is presented within a predetermined area (including but not limited to the area illuminated by the headlight module). In the embodiment of the present application, the so-called headlight module can specifically be a pixel headlight including a digital light processing device and a projection lens.

[0069] It should be noted that the so-called imaging content includes: game screen, and multiple preset key patterns. In the embodiment of the present application, the number and area of ​​the key patterns can be set by technicians according to actual conditions. Specifically, the headlight module projects the game screen and key patterns on the ground in front of the vehicle (here the ground in front of the vehicle is regarded as a preset area), which can be seen in the specific scene. Figure 1d shown.

[0070] S110: The mobile terminal 100 sends a positioning signal to a positioning anchor point at a preset time interval.

[0071] The execution order of S110 includes but is not limited to the order shown in the embodiment of the present application. Specifically, the mobile terminal 100 can also keep sending the positioning signal to the positioning anchor point after starting itself.

[0072] S111: The vehicle-mounted terminal 200 obtains the time when at least three positioning anchor points preset on the vehicle receive positioning signals.

[0073] If the three-dimensional spatial coordinates of the mobile terminal 100 are to be located, a vertical distance must exist between each positioning anchor point.

[0074] S112: The vehicle-mounted terminal 200 calculates the position coordinates of the mobile terminal 100 in the preset spatial coordinate system based on the time when the at least three positioning anchor points receive the positioning signals.

[0075] Specifically, in the process of calculating the position coordinates of the mobile terminal 100 in the preset spatial coordinate system based on the time when the at least three positioning anchor points receive the positioning signals, the specific algorithms used include, but are not limited to, wireless positioning algorithms such as the TOA algorithm, the TDOA algorithm, the AOA algorithm, the TOA & AOA algorithm, and the TDOA & AOA algorithm. Generally speaking, wireless positioning algorithms such as the TOA algorithm, the TDOA algorithm, the AOA algorithm, the TOA & AOA algorithm, and the TDOA & AOA algorithm are common knowledge familiar to those skilled in the art and will not be described in detail here.

[0076] It should be noted that the so-called preset spatial coordinate system includes but is not limited to: a spatial rectangular coordinate system established based on any positioning anchor point as the coordinate origin, an existing geodetic coordinate system, etc.

[0077] S113: The vehicle-mounted terminal determines whether the location coordinates are within a preset coordinate range.

[0078] If the position coordinates are within the preset coordinate range, execute S114; otherwise, execute S117.

[0079] It should be noted that the preset coordinate range includes the position coordinates of the preset area in the preset spatial coordinate system. Specifically, assuming the preset area is the ground area illuminated by the headlights, the preset coordinate range includes the position coordinates of the ground area illuminated by the headlights in the preset spatial coordinate system (using the geodetic coordinate system as an example), as well as the coordinates of various positions above the ground area illuminated by the headlights, all of which fall within the preset coordinate range.

[0080] S114: The vehicle-mounted terminal 200 identifies the location coordinates as valid coordinates.

[0081] After executing S114 , continue to execute S115 .

[0082] S115: The vehicle-mounted terminal 200 generates a motion trajectory of the mobile terminal 100 based on the multiple valid coordinates obtained within a preset time period.

[0083] Among them, the motion trajectory of the mobile terminal 100 includes but is not limited to: the user holding the mobile terminal 100 moves from one position to another (i.e., the trajectory of human body movement), the user's hand holding the mobile terminal 100 moves from one position to another (i.e., the trajectory of hand movement), etc.

[0084] Specifically, based on the multiple valid coordinates obtained within the preset time period, the motion trajectory of the mobile terminal 100 is generated, including but not limited to: linking the multiple valid coordinates generated within the preset time period in order from early to late, to obtain the motion trajectory of the mobile terminal 100 within the preset time period.

[0085] It should be noted that the multiple valid coordinates within the preset time period include but are not limited to: the position coordinates generated when the user holding the mobile terminal 100 moves a certain distance within the preset area within the preset time period, or the position coordinates generated when the user's hand holding the mobile terminal 100 moves a certain distance, etc.

[0086] S116: The vehicle-mounted terminal 200 obtains the gesture action corresponding to the motion trajectory from a preset gesture action library as the user's gesture action.

[0087] After executing S116 , continue executing S118 .

[0088] The preset gesture library includes various motion trajectories and gestures corresponding to each motion trajectory. The so-called gestures include, but are not limited to: hand (i.e., the hand holding the mobile terminal 100) movement (e.g., left swipe, right swipe, up swipe, down swipe), human body (i.e., the human body holding the mobile terminal 100) movement (e.g., left swipe, right swipe, forward swipe, backward swipe), etc.

[0089] Optionally, in addition to obtaining the gestures and movements corresponding to the motion trajectories from the gesture and movement library as the user's gestures and movements, the vehicle-mounted terminal 200 can also obtain human body images taken by a camera pre-installed on the vehicle, and perform human gesture recognition on the human body images to obtain the user's gestures and movements.

[0090] It should be noted that the specific implementation process of human posture recognition is a technical means familiar to those skilled in the art and will not be described in detail here.

[0091] S117: The vehicle-mounted terminal 200 marks the location coordinates as invalid coordinates and deletes the invalid coordinates.

[0092] S118: The vehicle-mounted terminal 200 obtains game instructions corresponding to the gesture action from a preset instruction library as game instructions for operating the game application.

[0093] The preset instruction library includes various gestures and actions and game instructions corresponding to each gesture and action.

[0094] It should be noted that the process shown in S112-S118 above essentially involves the vehicle-mounted terminal 200 determining game commands for operating the game application based on the acquired user gestures. Furthermore, in addition to utilizing the user's gestures to determine game commands for operating the game application, the vehicle-mounted terminal 200 may also utilize the user's location to determine game commands for operating the game application.

[0095] Specifically, the process of using the user's location to determine the game instructions for operating the game application is as follows:

[0096] 1. Obtain the time when at least three positioning anchor points preset on the vehicle receive positioning signals.

[0097] 2. Obtain the user's location based on the time when at least three positioning anchor points receive positioning signals.

[0098] Generally speaking, the user's location is actually the location of the mobile terminal 100 , and its calculation process can refer to the steps shown in S112 above and the explanation of the steps.

[0099] 3. When the user's position is within the area of ​​any key pattern and remains there for a preset period of time, a game instruction corresponding to the key pattern at the position is obtained from a preset instruction library as a game instruction for operating the game application.

[0100] It should be noted that, since the key pattern is a planar image, the area where the key pattern is located shown in this embodiment specifically refers to the three-dimensional space area where the key pattern is on the ground, which can be simply understood as the space area located above the key pattern.

[0101] S119: The vehicle-mounted terminal 200 controls the game application to execute the game instruction, and obtains a changed game screen corresponding to the game instruction, so that the game screen in the imaging content is changed to the changed game screen.

[0102] To sum up, compared with the prior art in which users can only operate smart terminals to control game applications, based on the solution shown in this embodiment, users can achieve fun control of the game applications running on the vehicle-mounted terminal 200 by performing any gestures (such as hand movements and body movements), and can use the car light module to project changing game screens corresponding to game instructions, thereby meeting users' expectations for a higher interactive experience in smart cars and enriching the gaming and entertainment experience of smart cars.

[0103] Based on the information interaction process shown in the above embodiment, the embodiment of the present application also provides a game control method based on human-vehicle interaction.

[0104] like Figure 2 FIG. 1 is a flow chart of a game control method based on human-vehicle interaction provided in an embodiment of the present application, which is applied to a vehicle-mounted terminal 200 and includes the following steps:

[0105] S201: Authenticate the mobile terminal 100 held by the user in advance, and establish a communication connection between the positioning anchor point preset on the vehicle and the mobile terminal 100.

[0106] The number of positioning anchor points is at least three.

[0107] S202: After receiving a game start command from the user, the game application is run to obtain a game screen of the game application and generate an imaging signal containing the game screen.

[0108] S203: Sending an imaging signal to the vehicle's headlight module, so that the headlight module projects imaging content within a preset area according to the imaging signal.

[0109] The imaging content includes the game screen and multiple preset key patterns.

[0110] S204: Acquire the time when at least three positioning anchor points preset on the vehicle receive positioning signals.

[0111] The positioning signal is sent by the mobile terminal 100 held by the user.

[0112] S205: Determine the position coordinates of the mobile terminal 100 in the preset space coordinate system based on the time when the at least three positioning anchor points receive the positioning signals.

[0113] S206: When the position coordinates are within the preset coordinate range, the position coordinates are marked as valid coordinates.

[0114] The preset coordinate range includes: the position coordinates of the preset area in the preset space coordinate system.

[0115] S207: Generate a motion trajectory of the mobile terminal 100 based on the multiple valid coordinates obtained within a preset time period.

[0116] S208: Acquire the gesture action corresponding to the motion trajectory from a preset gesture action library as the user's gesture action.

[0117] S209: Obtaining game instructions corresponding to the user's gestures and movements from a preset instruction library as game instructions for operating the game application.

[0118] S210: Controlling the game application to execute the game instruction, obtaining a changed game screen corresponding to the game instruction, so that the game screen in the imaging content is changed to the changed game screen.

[0119] To sum up, compared with the prior art in which users can only operate smart terminals to control game applications, based on the solution shown in this embodiment, users can achieve fun control of the game applications running on the vehicle-mounted terminal 200 by performing any gestures (such as hand movements and body movements), and can use the car light module to project changing game screens corresponding to game instructions, thereby meeting users' expectations for a higher interactive experience in smart cars and enriching the gaming and entertainment experience of smart cars.

[0120] It should be noted that S201 mentioned in the above embodiment is an optional implementation of the game control method based on human-vehicle interaction described in this application. In addition, S208 mentioned in the above embodiment is also an optional implementation of the game control method based on human-vehicle interaction described in this application. Therefore, the process described in the above embodiment can be summarized as follows: Figure 3 The method shown.

[0121] like Figure 3 FIG. 1 is a flow chart of another game control method based on human-vehicle interaction provided in an embodiment of the present application, comprising the following steps:

[0122] S301: After receiving a game start command from a user, the game application is run to obtain a game screen of the game application and generate an imaging signal containing the game screen.

[0123] Among them, the game application is pre-saved.

[0124] S302: Sending an imaging signal to a headlight module of the vehicle, so that the headlight module projects imaging content within a preset area according to the imaging signal.

[0125] Among them, the imaging content includes game screens.

[0126] S303: Determine a game instruction for operating a game application based on the acquired user's gestures and actions.

[0127] S304: Control the game application to execute the game instruction, and obtain a changed game screen corresponding to the game instruction, so that the game screen in the imaging content is changed to the changed game screen.

[0128] To sum up, compared with the existing technology in which users can only operate smart terminals to control game applications, based on the solution shown in this embodiment, users can achieve interesting control of the game applications running on the vehicle side by performing any gestures (such as hand movements and body movements), and can use the car light module to project changing game screens corresponding to game instructions, thereby meeting users' expectations for a higher interactive experience in smart cars and enriching the gaming and entertainment experience of smart cars.

[0129] Corresponding to the game control method based on human-vehicle interaction provided in the above-mentioned embodiment of the present application, the embodiment of the present application also provides a game control device based on human-vehicle interaction.

[0130] like Figure 4 FIG. 1 is a schematic diagram of the architecture of a game control device based on human-vehicle interaction provided by an embodiment of the present application, including:

[0131] The game running unit 401 is used to run the game application after receiving the user's game start command, obtain the game screen of the game application, and generate an imaging signal containing the game screen; the game application is pre-saved.

[0132] The screen projection unit 402 is used to send an imaging signal to the vehicle's headlight module, so that the headlight module projects imaging content in a preset area according to the imaging signal; the imaging content includes a game screen.

[0133] The instruction determination unit 403 is configured to determine a game instruction for operating a game application based on the acquired user gestures.

[0134] Among them, the instruction determination unit 403 is specifically used to: obtain the time when at least three positioning anchor points preset on the vehicle receive the positioning signal; the positioning signal is sent by the mobile terminal held by the user; based on the time when at least three positioning anchor points receive the positioning signal, determine the position coordinates of the mobile terminal in the preset spatial coordinate system; based on the position coordinates, determine the user's posture action; obtain game instructions corresponding to the posture action from the preset instruction library as game instructions for operating the game application.

[0135] The instruction determining unit 403 is further configured to: authenticate the mobile terminal in advance and establish a communication connection between the positioning anchor point and the mobile terminal.

[0136] The instruction determination unit 403 is specifically used to: identify the position coordinates as valid coordinates when the position coordinates are within a preset coordinate range; the preset coordinate range includes: the position coordinates of the preset area in the preset spatial coordinate system; generate a motion trajectory of the mobile terminal based on multiple valid coordinates obtained within a preset time period; obtain the gesture action corresponding to the motion trajectory from the preset gesture action library as the user's gesture action.

[0137] The instruction determination unit 403 is specifically used to: obtain a human body image taken by a camera preset on the vehicle; perform human posture recognition on the human body image to obtain the user's posture movements; obtain game instructions corresponding to the posture movements from a preset instruction library as game instructions for operating the game application.

[0138] The instruction determination unit 403 is further configured to determine a game instruction for operating the game application according to the acquired user location.

[0139] The instruction determination unit 403 is specifically used to: obtain the time when at least three positioning anchor points preset on the vehicle receive positioning signals; the positioning signal is sent by the mobile terminal held by the user; based on the time when at least three positioning anchor points receive positioning signals, obtain the user's position; when the position is located in the area where any key pattern is located and maintains a preset time length, obtain the game instructions corresponding to the key pattern where the position is located from the preset instruction library as game instructions for operating the game application.

[0140] The screen changing unit 404 is used to control the game application to execute the game instruction and obtain the changed game screen corresponding to the game instruction, so that the game screen in the imaging content is changed to the changed game screen.

[0141] To sum up, compared with the existing technology in which users can only operate smart terminals to control game applications, based on the solution shown in this embodiment, users can achieve interesting control of the game applications running on the vehicle side by performing any gestures (such as hand movements and body movements), and can use the car light module to project changing game screens corresponding to game instructions, thereby meeting users' expectations for a higher interactive experience in smart cars and enriching the gaming and entertainment experience of smart cars.

[0142] The present application also provides a vehicle-mounted terminal, which includes a stored program, wherein the program executes the game control method based on human-vehicle interaction provided by the present application.

[0143] The present application also provides a vehicle, which includes a stored program, wherein when the program is run, the game control method based on human-vehicle interaction provided by the present application is executed.

[0144] If the functions described in the method of the embodiment of the present application are implemented in the form of a software functional unit and sold or used as an independent product, they can be stored in a storage medium readable by a computing device. Based on this understanding, the part of the embodiment of the present application that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computing device (which can be a personal computer, server, mobile computing device or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.

[0145] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0146] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present application. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A game control method based on human-vehicle interaction, characterized in that: Applied to vehicle terminals, including: After receiving a game start command from a user, running a game application, obtaining a game screen of the game application, and generating an imaging signal including the game screen; the game application is pre-saved; Sending the imaging signal to a headlight module of the vehicle, so that the headlight module projects imaging content within a preset area according to the imaging signal; the imaging content includes the game screen; Determining a game instruction for operating the game application based on the acquired gesture of the user; the process of determining the game instruction includes: obtaining a time when at least three positioning anchor points preset on the vehicle receive a positioning signal; the positioning signal is sent by a mobile terminal held by the user; determining the position coordinates of the mobile terminal in a preset spatial coordinate system based on the time when the at least three positioning anchor points receive the positioning signal; determining the gesture of the user based on the position coordinates; and obtaining a game instruction corresponding to the gesture from a preset instruction library as the game instruction for operating the game application; The game application is controlled to execute the game instruction to obtain a changed game screen corresponding to the game instruction, so that the game screen in the imaging content is changed to the changed game screen.

2. The method according to claim 1, characterized in that The acquiring of the time when the at least three positioning anchor points preset on the vehicle receive positioning signals further includes: The mobile terminal is authenticated in advance, and a communication connection is established between the positioning anchor point and the mobile terminal.

3. The method according to claim 1, characterized in that The determining the user's gesture based on the position coordinates includes: In the case where the position coordinates are within a preset coordinate range, the position coordinates are marked as valid coordinates; the preset coordinate range includes: the position coordinates of the preset area in the preset space coordinate system; generating a motion trajectory of the mobile terminal based on the multiple valid coordinates obtained within a preset time period; The gesture action corresponding to the motion trajectory is obtained from a preset gesture action library as the gesture action of the user.

4. The method according to claim 1, wherein The determining, based on the acquired gesture of the user, a game instruction for operating the game application includes: Acquiring a human body image captured by a camera pre-installed on the vehicle; Performing human posture recognition on the human body image to obtain the user's posture action; A game instruction corresponding to the gesture action is obtained from a preset instruction library as a game instruction for operating the game application.

5. The method according to claim 1, wherein After sending the imaging signal to the vehicle's headlight module so that the headlight module projects imaging content within a preset area according to the imaging signal, the method further includes: Determine game instructions for operating the game application based on the acquired location of the user.

6. The method according to claim 5, characterized in that The imaging content also includes a plurality of preset key patterns; The determining, based on the acquired location of the user, a game instruction for operating the game application includes: Obtaining the time when at least three positioning anchor points preset on the vehicle receive positioning signals, wherein the positioning signals are sent by the mobile terminal held by the user; Obtaining the user's location based on the time when the at least three positioning anchor points receive the positioning signal; When the position is located in the area of ​​any key pattern and is maintained for a preset time, a game instruction corresponding to the key pattern at the position is obtained from a preset instruction library as a game instruction for operating the game application.

7. A game control device based on human-vehicle interaction, characterized in that: include: a game running unit, configured to run a game application after receiving a game start command from a user, obtain a game screen of the game application, and generate an imaging signal containing the game screen; The game application is pre-saved; A screen projection unit, configured to send the imaging signal to a headlight module of the vehicle, so that the headlight module projects imaging content within a preset area according to the imaging signal; the imaging content includes the game screen; an instruction determining unit, configured to determine a game instruction for operating the game application based on the acquired gesture of the user; The process of determining the game instructions includes: obtaining the time when at least three positioning anchor points preset on the vehicle receive positioning signals; the positioning signals are sent by the mobile terminal held by the user; determining the position coordinates of the mobile terminal in a preset spatial coordinate system based on the time when the at least three positioning anchor points receive the positioning signals; determining the user's gesture based on the position coordinates; and obtaining game instructions corresponding to the gesture from a preset instruction library as game instructions for operating the game application; The screen changing unit is used to control the game application to execute the game instruction and obtain a changed game screen corresponding to the game instruction, so that the game screen in the imaging content is changed to the changed game screen.

8. A vehicle-mounted terminal, characterized in that: The vehicle-mounted terminal includes a stored program, wherein the program executes the game control method based on human-vehicle interaction as described in any one of claims 1-6.

9. A vehicle, characterized in that: The vehicle includes a stored program, wherein the program, when running, executes the game control method based on human-vehicle interaction according to any one of claims 1 to 6.

Images