Vehicle-mounted game control method and device, computer equipment, readable storage medium and program product
By integrating the head-up display and eye tracking sensor in the on-board system, game operation instructions are generated based on the vehicle status and user eye movement, entertainment and safety issues during autonomous driving or parking waiting periods are solved, and safety and entertainment are achieved.
Patent Information
- Application Number
- CN202411764288.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-03
- Publication Date
- 2025-03-18
AI Technical Summary
In autonomous driving or parking waiting states, it is difficult for drivers or passengers to enjoy effective leisure and entertainment during driving, and regular games may lead to distraction and affect safety.
A car game control method is provided, using a head-up display and eye tracking sensor to generate game operation instructions based on the vehicle's driving status and user's eye movement, and to control game characters to perform actions in the game screen.
It realizes a safe and entertaining gaming experience during driving, controls game characters through eye movements, avoids distraction and ensures driving safety.
Smart Images

Figure CN119633364A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of autonomous driving technology, and in particular to a method, device, computer equipment, computer-readable storage medium and computer program product for controlling an in-vehicle game. Background Art
[0002] With the rapid advancement and increasingly widespread application of intelligent driving technology, users' demand for leisure and entertainment experience while driving in highly automated or even fully autonomous driving modes is gradually becoming one of the important criteria for measuring the comprehensive performance of intelligent driving systems and user satisfaction.
[0003] When people are waiting for a car to park or the car is in autonomous driving mode, simply waiting can easily make people feel bored and irritated. In the parking and waiting scenario, the driver or passenger needs to stay focused at all times to cope with possible changes in the surrounding environment. Using conventional devices to play games will cause distraction and may not be able to detect potential dangers in time, such as vehicles coming from behind or pedestrians approaching. Summary of the invention
[0004] Based on this, it is necessary to provide a vehicle-mounted game control method, device, computer equipment, computer-readable storage medium and computer program product that can balance safety and entertainment in order to address the above technical problems.
[0005] In a first aspect, the present application provides a method for controlling an in-vehicle game, comprising:
[0006] In response to a trigger operation of the in-vehicle game application by a user, detecting a driving state of the vehicle;
[0007] If the vehicle driving state meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the eye tracking sensor is used to detect the user's eye movement;
[0008] The processing unit is used to process the eye movement, generate a game operation instruction, and control the game character in the game screen to perform corresponding actions according to the game operation instruction.
[0009] In one embodiment, the processing unit processes the eye movement to generate a game operation instruction, including:
[0010] When the eyeball turns to the left, an instruction for the game character to move left is generated;
[0011] When the eyeball turns to the left, an instruction for the game character to move left is generated;
[0012] When the eyeball rotates downward, a game character evasion instruction is generated;
[0013] When the eyeball rotates upward, a jump instruction of the game character is generated;
[0014] When the eyeball gazes at the preset area for more than a preset time, a skill release instruction for the game character is generated.
[0015] In one embodiment, before displaying the game screen of the in-vehicle game application on the head-up display, the method further includes:
[0016] Playing an eye calibration voice prompt, wherein the voice prompt is used to instruct the user to look at a preset calibration point in the head-up display;
[0017] Using the eye tracking sensor to collect the user's eye information;
[0018] Analyzing the eye information using a processing unit to perform eye calibration on the user;
[0019] If the eye calibration fails, the process returns to the step of playing the eye calibration voice prompt.
[0020] In one embodiment, it also includes:
[0021] If the vehicle driving state is a parking state or an automatic driving state, determining that the vehicle driving state meets a preset game entry condition;
[0022] If the vehicle driving state is a manual driving state, it is determined that the vehicle driving state does not meet the preset game entry conditions.
[0023] In one embodiment, it also includes:
[0024] If the vehicle driving status does not meet the preset game entry conditions, a voice reminder that the game cannot be run is played.
[0025] In one embodiment, the method further comprises:
[0026] When it is detected that the vehicle driving state changes from satisfying the preset game entry conditions to not satisfying them, the game progress is automatically saved and the game is exited, and a safe driving voice reminder is played.
[0027] In a second aspect, the present application also provides an in-vehicle game control system, including: an in-vehicle game application, a head-up display, an eye tracking sensor, and a processing unit; wherein,
[0028] The in-vehicle game application is used to detect the driving state of the vehicle in response to a trigger operation of the in-vehicle game application by a user;
[0029] The head-up display is used to display the game screen of the in-vehicle game application if the driving state of the vehicle meets the preset game entry conditions;
[0030] The eye tracking sensor is used to detect the user's eye movement data;
[0031] The processing unit is used to process the eye movement data, generate game operation instructions, and control the game character in the game screen to perform corresponding actions according to the game operation instructions.
[0032] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:
[0033] In response to a trigger operation of the in-vehicle game application by a user, detecting a driving state of the vehicle;
[0034] If the vehicle driving state meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the eye tracking sensor is used to detect the user's eye movement;
[0035] The processing unit is used to process the eye movement, generate a game operation instruction, and control the game character in the game screen to perform corresponding actions according to the game operation instruction.
[0036] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:
[0037] In response to a trigger operation of the in-vehicle game application by a user, detecting a driving state of the vehicle;
[0038] If the vehicle driving state meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the eye tracking sensor is used to detect the user's eye movement;
[0039] The processing unit is used to process the eye movement, generate a game operation instruction, and control the game character in the game screen to perform corresponding actions according to the game operation instruction.
[0040] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:
[0041] In response to a trigger operation of the in-vehicle game application by a user, detecting a driving state of the vehicle;
[0042] If the vehicle driving state meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the eye tracking sensor is used to detect the user's eye movement;
[0043] The processing unit is used to process the eye movement, generate a game operation instruction, and control the game character in the game screen to perform corresponding actions according to the game operation instruction.
[0044] The above-mentioned in-vehicle game control method, device, computer equipment, computer-readable storage medium and computer program product first detect the driving state of the vehicle in response to the user's triggering operation on the in-vehicle game application; if the driving state of the vehicle meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the user's eye movement is detected by using an eye tracking sensor; then the eye movement is processed by a processing unit to generate game operation instructions, and the game character in the game screen is controlled to perform corresponding actions according to the game operation instructions. By controlling the movement of the game character in the game screen displayed on the head-up display through the rotation of the eyeball, both driving safety and entertainment can be taken into account. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0046] Figure 1 A schematic diagram of a flow chart of a method for controlling an in-vehicle game in one embodiment;
[0047] Figure 2 is a detailed flow chart of a method for controlling an in-vehicle game in one embodiment;
[0048] Figure 3 is a structural block diagram of a vehicle-mounted game control system in one embodiment;
[0049] Figure 4 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0050] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0051] In one embodiment, Figure 1 As shown, a method for controlling an in-vehicle game is provided. This embodiment takes the method applied to a terminal as an example for explanation. It is understandable that the method can also be applied to a server, and can also be applied to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server. In this embodiment, the method includes the following steps:
[0052] Step 102 , in response to a user triggering operation on the in-vehicle game application, detecting the driving state of the vehicle.
[0053] Optionally, the in-car game may be a parkour game.
[0054] Optionally, the trigger operation may be a click operation, a double-click operation, or a long press operation.
[0055] Optionally, the vehicle's driving status may be parking, automatic driving, manual driving, etc.
[0056] Exemplarily, after receiving a click operation from the user on the in-vehicle game application, the current driving state of the vehicle is detected.
[0057] Step 104: If the vehicle driving state meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the eye tracking sensor is used to detect the user's eye movement.
[0058] Optionally, after detecting the vehicle's driving state, it can be determined whether the vehicle's driving state meets preset game entry conditions. For example, it can be determined whether the vehicle's driving state is a preset state. If so, it is determined that the vehicle's driving state meets the preset game entry conditions. The preset state can be a parking state, an automatic driving state, etc., which is not limited to the embodiments of the present application.
[0059] Exemplarily, when the vehicle's driving state meets the preset game entry conditions, if the head-up display is in the on-state, the game screen of the in-vehicle game application is directly displayed; if the head-up display is in the off-state, the head-up display is turned on first, and then the game screen of the in-vehicle game application is displayed on the head-up display; thereafter, the eye tracking sensor is initialized, and the eye tracking sensor is used to detect the user's eye movement in real time.
[0060] Optionally, an eye tracking sensor may be used to detect the direction of eye movement, gaze area, etc. of the user.
[0061] Step 106: Process the eye movement using a processing unit to generate a game operation instruction, and control the game character in the game screen to perform corresponding actions according to the game operation instruction.
[0062] Exemplarily, a processing unit is used to process the user's eye movement detected by an eye tracking sensor; corresponding game operation instructions are generated according to the eye movement; and a game character in the game screen is controlled to perform corresponding actions according to the game operation instructions.
[0063] The above-mentioned in-vehicle game control method, device, computer equipment, computer-readable storage medium and computer program product first detect the driving state of the vehicle in response to the user's triggering operation on the in-vehicle game application; if the driving state of the vehicle meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the user's eye movement is detected by using an eye tracking sensor; then the eye movement is processed by a processing unit to generate game operation instructions, and the game character in the game screen is controlled to perform corresponding actions according to the game operation instructions. By controlling the movement of the game character in the game screen displayed on the head-up display through the rotation of the eyeball, both driving safety and entertainment can be taken into account.
[0064] In an exemplary embodiment, the processing of the eye movement by a processing unit to generate a game operation instruction includes:
[0065] When the eyeball rotates to the left, an instruction for the game character to move to the left is generated; when the eyeball rotates to the right, an instruction for the game character to move to the right is generated; when the eyeball rotates downward, an instruction for the game character to dodge is generated; when the eyeball rotates upward, an instruction for the game character to jump is generated; when the eyeball gazes at a preset area for more than a preset time, an instruction for the game character to release a skill is generated.
[0066] Optionally, the preset area may be the lower right corner area of the head-up display, and the preset time may be 3 seconds.
[0067] Exemplarily, when the user's eyeballs turn to the left, the processing unit will generate an instruction for the game character to move to the left; when the user's eyeballs turn to the right, the processing unit will generate an instruction for the game character to move to the right; when the user's eyeballs turn downward, the processing unit will generate an instruction for the game character to dodge; when the user's eyeballs turn upward, the processing unit will generate an instruction for the game character to jump; when the user's eyes are fixed on the lower right corner area of the head-up display for more than 3 seconds, the processing unit will generate an instruction for the game character to release a skill.
[0068] In this embodiment, the corresponding game character operation instructions are generated through the movement of the user's eyeballs and the character is moved accordingly, which can free the user's hands so that the user can always keep both hands on the steering wheel and respond to unexpected situations around him in time.
[0069] In an exemplary embodiment, before displaying the game screen of the in-vehicle game application on the head-up display, the method further includes:
[0070] Play an eye calibration voice prompt, wherein the voice prompt is used to instruct the user to look at a preset calibration point in the head-up display; use the eye tracking sensor to collect the user's eye information; use the processing unit to analyze the eye information and perform eye calibration on the user; if the eye calibration fails, return to the step of playing the eye calibration voice prompt.
[0071] Optionally, the preset calibration point may be the middle point of the head-up display.
[0072] Exemplarily, an eye calibration voice prompt is played to prompt the user to look at the middle point of the head-up display, and the eye tracking sensor is used to collect the user's eye information; the processing unit is used to analyze the eye information and perform eye calibration on the user; the direction of the user's eye movement is determined based on the user's eye position at this time; if the eye calibration fails, the process returns to the step of playing the eye calibration voice prompt.
[0073] In this embodiment, by calibrating the user's eyes and generating the initial eye position, the user's eye rotation direction can be accurately captured, so as to sensitively generate corresponding game character operation instructions and control the movement of the game character.
[0074] In an exemplary embodiment, the method further comprises:
[0075] If the vehicle driving state is a parking state or an automatic driving state, it is determined that the vehicle driving state meets the preset game entry conditions; if the vehicle driving state is a manual driving state, it is determined that the vehicle driving state does not meet the preset game entry conditions.
[0076] Exemplarily, if the current vehicle driving state is a parking state or an automatic driving state, the user does not need to concentrate on driving at this time, and it is determined that the vehicle driving state meets the preset game entry conditions; if the vehicle driving state is a manual driving state, the user needs to concentrate on driving the car at this time, and it is determined that the vehicle driving state does not meet the preset game entry conditions.
[0077] In this embodiment, whether the game entry condition is met is determined based on whether the user needs to concentrate on driving the car. The user can relax by playing games when he needs to relax, and concentrate on driving when he needs to concentrate on driving.
[0078] In an exemplary embodiment, the method further comprises:
[0079] If the vehicle driving status does not meet the preset game entry conditions, a voice reminder that the game cannot be run is played.
[0080] For example, if the vehicle driving status does not meet the preset game entry conditions, the game screen will not be opened and a voice reminder that the game cannot be run will be played.
[0081] In this embodiment, when the vehicle is not in parking state or automatic driving state, even if the user clicks on the game application, the game will not be opened and the user will be reminded to concentrate on driving, thereby ensuring the user's driving safety.
[0082] In an exemplary embodiment, the method further comprises:
[0083] When it is detected that the vehicle driving state changes from satisfying the preset game entry conditions to not satisfying them, the game progress is automatically saved and the game is exited, and a safe driving voice reminder is played.
[0084] For example, when it is detected that the vehicle's driving state is changed from an automatic driving state or a parking state to a manual driving state, the game progress is automatically saved and the game screen is exited, and a safe driving voice reminder is played.
[0085] In this embodiment, when it is detected that the vehicle driving state does not meet the game entry conditions, the game progress will be automatically saved and the game will be exited to prevent the user from playing games while driving and causing safety hazards.
[0086] In an exemplary embodiment, Figure 2As shown, in response to the user's click operation on the in-vehicle game application, the vehicle driving state is detected. If the current vehicle driving state is a parking state or an automatic driving state, and the user does not need to concentrate on driving at this time, it is determined that the vehicle driving state meets the preset game entry conditions; if the vehicle driving state is a manual driving state, and the user needs to concentrate on driving the car at this time, it is determined that the vehicle driving state does not meet the preset game entry conditions. If the vehicle driving state does not meet the preset game entry conditions, the game screen is not opened and a voice reminder that the game cannot be run is played. When the vehicle meets the preset game entry conditions, if the head-up display is in an on state, the in-vehicle game is directly opened; if the head-up display is in an off state, the head-up display is turned on first, and then the in-vehicle game is started; an eye calibration voice prompt is played to prompt the user to look at the middle point of the head-up display, and the user's eye information is collected using the eye tracking sensor; the processing unit is used to analyze the eye information and perform eye calibration on the user; the user's eye rotation direction is determined based on the user's eye position at this time; if the eye calibration fails, the step of playing the eye calibration voice prompt is returned. After that, the eye tracking sensor is initialized, and the eye tracking sensor is used to detect the user's eye movement in real time. The processing unit is used to process the user's eye movement detected by the eye tracking sensor; when the user's eye turns to the left, the processing unit will generate a command for the game character to move to the left; when the user's eye turns to the right, the processing unit will generate a command for the game character to move to the right; when the user's eye turns downward, the processing unit will generate a command for the game character to dodge; when the user's eye turns upward, the processing unit will generate a command for the game character to jump; when the user's eye gazes at the lower right corner of the head-up display for more than 3 seconds, the processing unit will generate a command for the game character to release a skill; the game character in the game screen is controlled to perform the corresponding action according to the game operation command. When it is detected that the vehicle's driving state does not meet the game entry conditions, the game progress will be automatically saved and the game will be exited to prevent the user from playing games while driving and causing safety hazards.
[0087] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0088] In an exemplary embodiment, Figure 3 As shown, a vehicle-mounted game control system is provided, including: a vehicle-mounted game application, a head-up display, an eye tracking sensor and a processing unit; wherein,
[0089] The in-vehicle game application is used to detect the driving state of the vehicle in response to a trigger operation of the in-vehicle game application by a user;
[0090] The head-up display is used to display the game screen of the in-vehicle game application if the driving state of the vehicle meets the preset game entry conditions;
[0091] The eye tracking sensor is used to detect the user's eye movement data;
[0092] The processing unit is used to process the eye movement data, generate game operation instructions, and control the game character in the game screen to perform corresponding actions according to the game operation instructions.
[0093] In an exemplary embodiment, the processing unit is further configured to:
[0094] When the eyeball turns to the left, an instruction for the game character to move left is generated;
[0095] When the eyeball rotates to the right, an instruction for the game character to move to the right is generated; when the eyeball rotates downward, an instruction for the game character to dodge is generated; when the eyeball rotates upward, an instruction for the game character to jump is generated; when the eyeball gazes at a preset area for more than a preset time, an instruction for the game character to release a skill is generated.
[0096] In an exemplary embodiment, the in-vehicle game control system further includes: an eye calibration module;
[0097] The eye calibration module is used to play the eye calibration voice prompt, and the voice prompt is used to instruct the user to look at the preset calibration point in the head-up display; the eye tracking sensor is also used to collect the user's eye information; the processing unit is also used to analyze the eye information and perform eye calibration on the user; if the eye calibration fails, the process returns to the step of playing the eye calibration voice prompt.
[0098] In an exemplary embodiment, the processing unit is further configured to:
[0099] If the vehicle driving state is a parking state or an automatic driving state, it is determined that the vehicle driving state meets the preset game entry conditions; if the vehicle driving state is a manual driving state, it is determined that the vehicle driving state does not meet the preset game entry conditions.
[0100] In an exemplary embodiment, the processing unit is further configured to:
[0101] If the vehicle driving status does not meet the preset game entry conditions, a voice reminder that the game cannot be run is played.
[0102] In an exemplary embodiment, the processing unit is further configured to:
[0103] When it is detected that the vehicle driving state changes from satisfying the preset game entry conditions to not satisfying them, the game progress is automatically saved and the game is exited, and a safe driving voice reminder is played.
[0104] Each module in the above-mentioned vehicle-mounted game control system can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.
[0105] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 4 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store game progress data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for controlling a vehicle-mounted game is implemented.
[0106] Those skilled in the art will understand that Figure 4 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0107] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:
[0108] In response to a trigger operation of the in-vehicle game application by a user, detecting a driving state of the vehicle;
[0109] If the vehicle driving state meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the eye tracking sensor is used to detect the user's eye movement;
[0110] The processing unit is used to process the eye movement, generate a game operation instruction, and control the game character in the game screen to perform corresponding actions according to the game operation instruction.
[0111] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0112] When the eyeball rotates to the left, an instruction for the game character to move to the left is generated; when the eyeball rotates to the right, an instruction for the game character to move to the right is generated; when the eyeball rotates downward, an instruction for the game character to dodge is generated; when the eyeball rotates upward, an instruction for the game character to jump is generated; when the eyeball gazes at a preset area for more than a preset time, an instruction for the game character to release a skill is generated.
[0113] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0114] Play an eye calibration voice prompt, wherein the voice prompt is used to instruct the user to look at a preset calibration point in the head-up display; use the eye tracking sensor to collect the user's eye information; use the processing unit to analyze the eye information and perform eye calibration on the user; if the eye calibration fails, return to the step of playing the eye calibration voice prompt.
[0115] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0116] If the vehicle driving state is a parking state or an automatic driving state, it is determined that the vehicle driving state meets the preset game entry conditions; if the vehicle driving state is a manual driving state, it is determined that the vehicle driving state does not meet the preset game entry conditions.
[0117] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0118] If the vehicle driving status does not meet the preset game entry conditions, a voice reminder that the game cannot be run is played.
[0119] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0120] When it is detected that the vehicle driving state changes from satisfying the preset game entry conditions to not satisfying them, the game progress is automatically saved and the game is exited, and a safe driving voice reminder is played.
[0121] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
[0122] In response to a trigger operation of the in-vehicle game application by a user, detecting a driving state of the vehicle;
[0123] If the vehicle driving state meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the eye tracking sensor is used to detect the user's eye movement;
[0124] The processing unit is used to process the eye movement, generate a game operation instruction, and control the game character in the game screen to perform corresponding actions according to the game operation instruction.
[0125] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0126] When the eyeball rotates to the left, an instruction for the game character to move to the left is generated; when the eyeball rotates to the right, an instruction for the game character to move to the right is generated; when the eyeball rotates downward, an instruction for the game character to dodge is generated; when the eyeball rotates upward, an instruction for the game character to jump is generated; when the eyeball gazes at a preset area for more than a preset time, an instruction for the game character to release a skill is generated.
[0127] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0128] Play an eye calibration voice prompt, wherein the voice prompt is used to instruct the user to look at a preset calibration point in the head-up display; use the eye tracking sensor to collect the user's eye information; use the processing unit to analyze the eye information and perform eye calibration on the user; if the eye calibration fails, return to the step of playing the eye calibration voice prompt.
[0129] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0130] If the vehicle driving state is a parking state or an automatic driving state, it is determined that the vehicle driving state meets the preset game entry conditions; if the vehicle driving state is a manual driving state, it is determined that the vehicle driving state does not meet the preset game entry conditions.
[0131] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0132] If the vehicle driving status does not meet the preset game entry conditions, a voice reminder that the game cannot be run is played.
[0133] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0134] When it is detected that the vehicle driving state changes from satisfying the preset game entry conditions to not satisfying them, the game progress is automatically saved and the game is exited, and a safe driving voice reminder is played.
[0135] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:
[0136] In response to a trigger operation of the in-vehicle game application by a user, detecting a driving state of the vehicle;
[0137] If the vehicle driving state meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the eye tracking sensor is used to detect the user's eye movement;
[0138] The processing unit is used to process the eye movement, generate a game operation instruction, and control the game character in the game screen to perform corresponding actions according to the game operation instruction.
[0139] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0140] When the eyeball rotates to the left, an instruction for the game character to move to the left is generated; when the eyeball rotates to the right, an instruction for the game character to move to the right is generated; when the eyeball rotates downward, an instruction for the game character to dodge is generated; when the eyeball rotates upward, an instruction for the game character to jump is generated; when the eyeball gazes at a preset area for more than a preset time, an instruction for the game character to release a skill is generated.
[0141] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0142] Play an eye calibration voice prompt, wherein the voice prompt is used to instruct the user to look at a preset calibration point in the head-up display; use the eye tracking sensor to collect the user's eye information; use the processing unit to analyze the eye information and perform eye calibration on the user; if the eye calibration fails, return to the step of playing the eye calibration voice prompt.
[0143] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0144] If the vehicle driving state is a parking state or an automatic driving state, it is determined that the vehicle driving state meets the preset game entry conditions; if the vehicle driving state is a manual driving state, it is determined that the vehicle driving state does not meet the preset game entry conditions.
[0145] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0146] If the vehicle driving status does not meet the preset game entry conditions, a voice reminder that the game cannot be run is played.
[0147] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0148] When it is detected that the vehicle driving state changes from satisfying the preset game entry conditions to not satisfying them, the game progress is automatically saved and the game is exited, and a safe driving voice reminder is played.
[0149] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.
[0150] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.
[0151] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A method for controlling an in-vehicle game, characterized in that: The method comprises: In response to a trigger operation of the in-vehicle game application by a user, detecting a driving state of the vehicle; If the vehicle driving state meets the preset game entry conditions, the game screen of the in-vehicle game application is displayed on the head-up display, and the eye tracking sensor is used to detect the user's eye movement; The processing unit is used to process the eye movement, generate a game operation instruction, and control the game character in the game screen to perform corresponding actions according to the game operation instruction.
2. The method according to claim 1, characterized in that The processing unit is used to process the eye movement to generate a game operation instruction, including: When the eyeball turns to the left, an instruction for the game character to move left is generated; When the eyeball rotates to the right, an instruction for the game character to move to the right is generated; When the eyeball rotates downward, a game character evasion instruction is generated; When the eyeball rotates upward, a jump instruction of the game character is generated; When the eyeball gazes at the preset area for more than a preset time, a skill release instruction for the game character is generated.
3. The method according to claim 1, characterized in that Before displaying the game screen of the in-vehicle game application on the head-up display, the method further includes: Playing an eye calibration voice prompt, wherein the voice prompt is used to instruct the user to look at a preset calibration point in the head-up display; Using the eye tracking sensor to collect the user's eye information; Analyzing the eye information using a processing unit to perform eye calibration on the user; If the eye calibration fails, the process returns to the step of playing the eye calibration voice prompt.
4. The method according to claim 1, characterized in that: The method further comprises: If the vehicle driving state is a parking state or an automatic driving state, determining that the vehicle driving state meets a preset game entry condition; If the vehicle driving state is a manual driving state, it is determined that the vehicle driving state does not meet the preset game entry conditions.
5. The method according to claim 1, characterized in that The method further comprises: If the vehicle driving status does not meet the preset game entry conditions, a voice reminder that the game cannot be run is played.
6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: When it is detected that the vehicle driving state changes from satisfying the preset game entry conditions to not satisfying them, the game progress is automatically saved and the game is exited, and a safe driving voice reminder is played.
7. A vehicle-mounted game control system, characterized in that: include: In-car gaming applications, head-up displays, eye-tracking sensors and processing units; among them, The in-vehicle game application is used to detect the driving state of the vehicle in response to a trigger operation of the in-vehicle game application by a user; The head-up display is used to display the game screen of the in-vehicle game application if the driving state of the vehicle meets the preset game entry conditions; The eye tracking sensor is used to detect the user's eye movement data; The processing unit is used to process the eye movement data, generate game operation instructions, and control the game character in the game screen to perform corresponding actions according to the game operation instructions.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.