Vehicle state control method, device and equipment and storage medium

Abstract

The invention discloses a vehicle state control method, device and equipment and a storage medium, and relates to the technical field of intelligent driving. The method is executed by a vehicle, the vehicle comprises a main control unit and an automatic driving unit connected with the main control unit, and the method comprises the steps that under the condition that an instruction for starting a virtual game is received, the vehicle is controlled to enter a virtual game mode through the main control unit; in the virtual game mode, the vehicle starts an automatic driving function; in the running process of the virtual game, controlling the vehicle to run along a specified route through an automatic driving unit; interaction operation of internal personnel of the vehicle is received through the main control unit; under the condition that the interaction operation is matched with the operation corresponding to the specified task, the main control unit updates the upper limit of the running speed of the vehicle controlled by the automatic driving unit; and controlling the vehicle to run according to the speed upper limit through the automatic driving unit. On the premise of ensuring the driving safety of the vehicle, the interaction degree between the user and the vehicle can be improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and in particular to a vehicle state control method, device, equipment and storage medium. Background Art

[0002] With the improvement of computing power, the maturity of sensor technology and the development of artificial intelligence algorithms, intelligent driving is gradually moving from theory to market application. Among them, autonomous driving technology is gradually changing the way people travel.

[0003] Among the related technologies, autonomous driving vehicles use artificial intelligence, visual computing, radar, positioning and other technologies to automatically and safely drive without the need for active operation by passengers, providing passengers with a convenient and comfortable riding experience.

[0004] However, during the automatic driving of the vehicle, the passengers lack interaction with the vehicle, resulting in poor interaction between the passengers and the vehicle. Summary of the invention

[0005] The embodiments of the present application provide a vehicle state control method, device, equipment and storage medium, which can improve the degree of interaction between the user and the vehicle while ensuring the safety of vehicle driving; the technical solutions proposed in the present application are as follows:

[0006] According to one aspect of an embodiment of the present application, a vehicle state control method is provided, the method being executed by a vehicle, the vehicle comprising a main control unit and an automatic driving unit connected to the main control unit, the method comprising:

[0007] When receiving an instruction to start a virtual game, the main control unit controls the vehicle to enter a virtual game mode; in the virtual game mode, the vehicle starts an automatic driving function;

[0008] During the running of the virtual game, the vehicle is controlled by the automatic driving unit to travel along a specified route;

[0009] Receiving interactive operations of an internal person of the vehicle through the main control unit;

[0010] When the interactive operation matches an operation corresponding to a designated task, the main control unit updates the upper limit of the speed of the vehicle controlled by the automatic driving unit; the designated task is a task provided by the virtual game;

[0011] The vehicle is controlled to travel according to the speed limit through the automatic driving unit.

[0012] According to one aspect of an embodiment of the present application, a vehicle state control device is provided, the device comprising:

[0013] A first control module is used to control the vehicle to enter a virtual game mode when receiving an instruction to start a virtual game; in the virtual game mode, the vehicle starts an automatic driving function;

[0014] A second control module is used to control the vehicle to travel along a specified route during the running of the virtual game;

[0015] A receiving module, used for receiving an interactive operation of an internal person of the vehicle;

[0016] an updating module, configured to update an upper limit of a speed of the vehicle controlled by the automatic driving unit when the interactive operation matches an operation corresponding to a specified task; the specified task is a task provided by the virtual game;

[0017] A speed control module is used to control the vehicle to travel according to the speed upper limit.

[0018] In some embodiments, the vehicle further comprises a screen unit connected to the main control unit; the first control module is used to display the matching information of the virtual game when the vehicle moves to a specified position and receives an instruction to start the virtual game; the matching information is used to indicate at least one opponent vehicle competing with the vehicle;

[0019] The first control module is used to control the vehicle to enter a multi-party game mode in the virtual game mode if the virtual game is successfully matched;

[0020] The first control module is used to display the first identification information of the vehicle, the second identification information of the opponent vehicle, and the track route of the competition between the vehicle and the opponent vehicle when the vehicle enters the multi-party game mode.

[0021] In some embodiments, the vehicle state control device further includes: a third control module, configured to control the vehicle to enter a single-player game mode in the virtual game mode when the virtual game fails to match;

[0022] The vehicle state control device also includes: a first display module, which is used to display the first identification information of the vehicle and the track route where the vehicle is located when the vehicle enters the single-player game mode.

[0023] In some embodiments, the vehicle state control device further includes: a second display module, for displaying real-time information of the vehicle in the virtual game when controlling the vehicle to travel along the designated route;

[0024] The vehicle state control device further includes: a third display module, configured to display end information of the vehicle in the virtual game when the vehicle reaches the end point of the designated route.

[0025] In some embodiments, the vehicle state control device further includes: a fourth display module, configured to display the designated task when the vehicle enters the virtual game mode.

[0026] In some embodiments, the vehicle state control device further includes: a fifth display module, configured to display the designated task when the vehicle is controlled to travel along the designated route and the conditions for issuing the designated task are met.

[0027] According to one aspect of an embodiment of the present application, a computer device is provided, which includes a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the above-mentioned vehicle state control method.

[0028] According to one aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is loaded and executed by a processor to implement the above-mentioned vehicle state control method.

[0029] According to one aspect of an embodiment of the present application, a computer program product is provided, wherein the computer program product includes a computer program, and the computer program is loaded and executed by a processor to implement the above-mentioned vehicle state control method.

[0030] The technical solution provided in the embodiments of the present application can bring the following beneficial effects:

[0031] A virtual game is created through the vehicle's automatic driving function. After the user starts the virtual game, the vehicle turns on the automatic driving function, so that the vehicle automatically drives along the specified route without the need for the user's driving operation during the virtual game. Afterwards, the user can adjust the speed of the vehicle's automatic driving by completing the interactive operations specified in the virtual game, so as to extend or shorten the time it takes for the vehicle to complete the specified route. This solution expands a new way of interaction between users and vehicles, and can improve the interactive effect between users and vehicles. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0033] Figure 1 It is a schematic diagram of an implementation environment provided by an embodiment of the present application;

[0034] Figure 2 is a flow chart of a vehicle state control method provided by an exemplary embodiment of the present application;

[0035] Figure 3 is a schematic diagram of display content of a screen unit provided by an exemplary embodiment of the present application;

[0036] Figure 4 is a schematic diagram of display content of a screen unit provided by an exemplary embodiment of the present application;

[0037] Figure 5 is a schematic diagram of display content of a screen unit provided by an exemplary embodiment of the present application;

[0038] Figure 6 is a flow chart of a method for implementing an in-vehicle game of a racing competition based on automatic driving provided by an exemplary embodiment of the present application;

[0039] Figure 7 is a block diagram of a vehicle state control device provided by an exemplary embodiment of the present application;

[0040] Figure 8 It is a structural block diagram of a computer device provided by an embodiment of the present application.

[0041] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application. DETAILED DESCRIPTION

[0042] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0043] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0044] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0045] In the embodiments of this application, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, user behaviors such as interactive operations involved in this application are all obtained with full authorization.

[0046] It should be understood that although the terms first, second, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first tab may also be referred to as the second tab, and similarly, the second tab may also be referred to as the first tab. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0047] First, several terms involved in this application are introduced and explained:

[0048] 1) Autonomous driving technology: It combines advanced technologies such as artificial intelligence (AI), sensors, computer vision, radar, monitoring devices and global positioning systems to enable vehicles to complete driving tasks autonomously without driver intervention. The core process of autonomous driving technology can be divided into three main parts:

[0049] Environmental perception and positioning: refers to obtaining information about the vehicle's surroundings through a variety of sensors such as cameras, lidar, millimeter-wave radar, ultrasonic sensors, etc., and accurately positioning the vehicle in combination with high-precision maps and GPS; these sensors can help the vehicle identify road signs, pedestrians, other vehicles, and other obstacles;

[0050] Decision-making and planning: Based on the collected information, the decision-maker needs to make reasonable judgments and plan the best driving route; the decision-maker also needs to consider factors such as safety, comfort and efficiency to ensure that each operation is the optimal solution;

[0051] Execution control: It converts decisions into actual actions, that is, controlling the vehicle's acceleration, deceleration, steering and other activities; this part of the work is completed by the wire control system, which uses electrical signals instead of traditional mechanical connections to achieve more precise and smooth operation.

[0052] 2) Virtual games: Through scene reconstruction technology and perception restoration technology, sensor groups, lidar, millimeter-wave radar and other technologies are used to scan the vehicle and its surrounding environment. The three-dimensional picture of the actual road is reconstructed into the track route of the virtual game based on the surrounding image information and 3D point cloud information, allowing different vehicles with automatic driving functions turned on to participate in racing and other games on real roads.

[0053] Please refer to Figure 1 , which shows a schematic diagram of an implementation environment provided by an embodiment of the present application. Figure 1 As shown, the implementation environment may include: a vehicle 110 and a server 120. The vehicle 110 and the server 120 communicate with each other via a network. Optionally, the vehicle 110 and the server 120 are directly or indirectly connected via wired or wireless communication, which is not limited in this application.

[0054] The vehicle 110 includes a main control unit 110a, an automatic driving unit 110b and a screen unit 110c connected to the main control unit 110a. Exemplarily, the main control unit 110a collects information from different sources, including but not limited to vehicle status, user instructions and other external factors, and transmits the information to the automatic driving unit 110b for analysis and processing. Afterwards, based on the results obtained, the main control unit 110a will issue corresponding control commands to the actuator (such as a motor, a brake, etc.), and also update the content on the screen unit 110c to provide the user with the latest driving status and other relevant information.

[0055] The main control unit 110a is used to coordinate and manage the operation of the automatic driving unit 110b, the screen unit 110c, etc. For example, the main control unit 110a may be a vehicle control unit (VCU).

[0056] The autonomous driving unit 110b is used to process data from various sensors and perform complex computing tasks to perceive the environment, plan paths, and make driving decisions. The autonomous driving unit 110b and the main control unit 110a exchange information through a high-speed communication protocol to ensure efficient collaboration between the two.

[0057] Among them, the screen unit 110c refers to the human-machine interface (Human Machine Interface, HMI), which provides visual feedback and support for drivers and passengers. The screen unit 110c is not limited to the traditional dashboard display, but also includes in-car screens, head-up displays (Head-up Display, HUD), smart phones, smart watches, tablet computers, laptops, desktop computers, game consoles, e-book readers, multimedia playback devices, head-mounted devices, smart TVs and other electronic devices, but is not limited to this. The specific category of the screen unit 110c is not limited in the embodiment of the present application. The client for running a virtual game can be installed in the electronic device corresponding to the screen unit 110c, and the virtual game can be a racing game. The present application does not limit the form of the virtual game, including but not limited to applications (Application, App) installed in electronic devices, applets, etc., and can also be in the form of a web page.

[0058] The server 120 is used to provide background services for the vehicle 110. Optionally, the server 120 is a server, or a server cluster or distributed system composed of multiple servers, or a cloud computing service center, or a cloud server, cloud database, cloud computing, cloud function, cloud storage, network service, cloud communication, middleware service, domain name service, security service, content delivery network (CDN) that provides cloud computing services. Optionally, the server 120 provides background services for multiple vehicles 110 at the same time.

[0059] For example, the screen unit 110c of the vehicle 110 is an in-vehicle screen. A racing game client is running in the in-vehicle terminal corresponding to the in-vehicle screen, and the icon of the racing game is displayed on the in-vehicle screen. The user clicks the icon of the racing game to start the racing game; accordingly, the in-vehicle screen displays the user interface of the racing game, which includes a virtual road scene reconstructed through scenes. The user can hand over the steering wheel to the vehicle, and let the self-vehicle and other vehicles start automatic driving on the real road to participate in the racing game.

[0060] Exemplarily, when the vehicle 110 stops at a designated location (such as the starting point of a race track) and receives a user instruction to start a racing game, the screen unit 110c displays matching information of the racing game, where the matching information is used to indicate at least one opponent vehicle competing with the vehicle 110.

[0061] When the racing game is matched successfully, the main control unit 110a controls the vehicle 110 to enter the multi-party game mode in the virtual game mode. In the virtual game mode, the vehicle 110 starts the automatic driving function; thereafter, the screen unit displays the first identification information of the vehicle 110, the second identification information of the opponent vehicle, and the track route on which the vehicle 110 competes with the opponent vehicle.

[0062] During the running of the racing game, the automatic driving unit 110b controls the vehicle 110 to travel along the specified route; wherein, the main control unit 110a receives the interactive operation of the internal personnel of the vehicle 110, and when the interactive operation matches the operation corresponding to the specified task, the main control unit 110a updates the upper limit of the speed at which the automatic driving unit 110b controls the vehicle 110 to travel; thereafter, the automatic driving unit 110b controls the vehicle to travel according to the above-mentioned speed upper limit.

[0063] After the racing game is over, the screen unit 110 c displays the racing results, racing videos, etc. corresponding to the vehicle 110 and the opponent vehicle, respectively. The racing results and racing videos can be uploaded to the server 120 .

[0064] Please refer to Figure 2 , which shows a flow chart of a vehicle state control method provided by an exemplary embodiment of the present application. The execution subject of each step of the method can be a vehicle, the vehicle includes a main control unit and an automatic driving unit connected to the main control unit, and optionally, the vehicle is Figure 1 The vehicle 110 in the system shown. Figure 2 As shown, the method may include steps 210 to 250.

[0065] Step 210: When receiving an instruction to start a virtual game, the vehicle is controlled by the main control unit to enter a virtual game mode; in the virtual game mode, the vehicle starts the automatic driving function.

[0066] In the embodiment of the present application, the above virtual game is run in the electronic device corresponding to the vehicle (such as the vehicle terminal). Optionally, the above virtual game is an application pre-installed in the electronic device corresponding to the vehicle; or an application downloaded and run by the user from a server through an application store or a designated website.

[0067] Exemplarily, the virtual game is displayed in the form of an icon on a designated interface of an electronic device corresponding to the vehicle. Optionally, the instruction to start the virtual game is a trigger operation of the icon of the virtual game by the user, for example, the trigger operation is a click operation. Alternatively, the instruction to start the virtual game is a start command operation of the virtual game by the user, for example, the user sends a voice command such as "open xx" to the vehicle terminal indicating the intention to start the application.

[0068] The main control unit is a high-performance computing platform integrated inside the vehicle. When the virtual game is started, the main control unit sends a wake-up signal to the autonomous driving unit to start the autonomous driving function.

[0069] Optionally, upon receiving an instruction to start a virtual game, the main control unit controls the vehicle computer's large screen to display a user interface of the virtual game.

[0070] Step 220: During the running of the virtual game, the vehicle is controlled by the automatic driving unit to travel along the specified route.

[0071] In an embodiment of the present application, the autonomous driving unit uses high-precision map data and real-time sensor information to accurately control the vehicle to move along a predetermined trajectory.

[0072] Exemplarily, the designated route is an exclusive route for the virtual game. For example, the designated route is located in a pre-planned designated area, specifically, the designated route is located in a designated closed area or an area with less traffic. The closed area corresponds to at least one race track route. Optionally, the designated route is a race track route designated by the main control unit; or a race track route customized by the user in the closed area.

[0073] Optionally, the total mileage of the above-mentioned designated route is 2km, or 5-10km, or it can be other mileage information, which is not limited in this application.

[0074] Exemplarily, the autonomous driving unit scans the vehicle and the surrounding environment based on the sensor group, lidar, millimeter-wave radar and other technologies, and reconstructs the three-dimensional image of the actual road into a track route of the virtual game based on the surrounding image information and 3D point cloud information as the above-mentioned designated route.

[0075] Exemplarily, a server corresponding to the vehicle pre-stores a plurality of racetrack routes, and the designated route is a racetrack route corresponding to the position of the vehicle among the plurality of racetrack routes. For example, the main control unit of the vehicle sends the current position of the vehicle to the server, and requests the server to provide the racetrack route corresponding to the current position of the vehicle as the designated route.

[0076] During the running of the virtual game, the autonomous driving unit can not only identify and avoid static obstacles, but also intelligently handle emergencies such as vehicle collisions to ensure the safety and smoothness of the entire process.

[0077] Step 230: Receive interactive operations from the internal personnel of the vehicle through the main control unit.

[0078] In the embodiment of the present application, in order to increase the fun and participation of the virtual game, the internal personnel of the vehicle can interact with the virtual game through a variety of interactive operations. For example, the internal personnel of the vehicle can use gestures, voice commands, etc. to interact, and the main control unit is responsible for capturing these input signals and converting them into corresponding game events. For example, the internal personnel of the vehicle can interact with the virtual game by shouting in the car, and the main control unit can control the speed of the vehicle according to the decibel level within a specified time.

[0079] Among them, the internal personnel of the above-mentioned vehicles include the driver and passengers of the vehicle.

[0080] Step 240: When the interactive operation matches the operation corresponding to the designated task, the main control unit updates the upper speed limit of the vehicle controlled by the automatic driving unit; the designated task is a task provided by the virtual game.

[0081] In an embodiment of the present application, in order to enhance the interaction between the user and the vehicle, the virtual game interacts with the user in the form of issuing designated tasks.

[0082] Among them, the above-mentioned designated tasks include at least one of the following: audio recording task, video shooting task, picture shooting task, location marking task, and social interaction task.

[0083] For example, the audio recording task requires the user to record an audio clip. For example, the user is required to imitate the voice of a specified character to record an audio clip; another example, the user is required to sing a specified song or read a specified text; another example, the user is required to record an audio clip with a specified decibel level.

[0084] For example, the video shooting task requires the user to shoot a video containing specified content, such as requiring the user to shoot a video containing a specified object, requiring the user to shoot a video containing a specified person, or requiring the user to shoot a video containing specified background music.

[0085] For example, the picture shooting task requires the user to shoot pictures containing specified content, such as requiring the user to shoot pictures containing specified objects, requiring the user to shoot pictures containing specified people, or requiring the user to shoot pictures containing specified scenery.

[0086] For example, a location marking task requires a user to check in at a designated location to complete the marking task. For example, a user is required to check in near a designated building.

[0087] For example, the social interaction task requires the user to complete a specified task with a specified person. For example, the user is required to complete a joint check-in task with users in other vehicles at a specified location; or the user is required to complete a group photo task with people outside the vehicle.

[0088] Optionally, the audio recording task, video shooting task, picture shooting task, location marking task, and social interaction task in the above-mentioned designated tasks can be combined arbitrarily. For example, the combination of the video shooting task and the location marking task requires the user to shoot a video at a designated location.

[0089] Among them, the above-mentioned interactive operation matches the operation corresponding to the specified task, which means that the interactive operation performed by the internal personnel of the vehicle matches the requirements of a task in the virtual game. At this time, the main control unit sends an instruction corresponding to the task to the automatic driving unit to adjust the upper limit of the vehicle's speed.

[0090] Exemplarily, the main control unit can compare the matching degree between the interactive operation and the specified task, and different matching degrees correspond to different speed limits. Specifically, for example, the main control unit pre-stores the corresponding relationship between each matching degree and each speed limit; accordingly, after the main control unit obtains the matching degree between the interactive operation and the specified task, it can query the above corresponding relationship to obtain the corresponding speed limit.

[0091] Optionally, the above-mentioned updating of the upper speed limit of the vehicle controlled by the automatic driving unit through the main control unit is to increase the upper speed limit of the vehicle controlled by the automatic driving unit through the main control unit, or to reduce the upper speed limit of the vehicle controlled by the automatic driving unit through the main control unit. In other words, the above-mentioned interactive operation can increase or reduce the upper speed limit of the vehicle controlled by the automatic driving unit.

[0092] It should be noted that the upper speed limit for the above-mentioned vehicles must comply with local laws and regulations as well as the vehicle's own performance parameters.

[0093] Step 250: Control the vehicle's travel according to the speed limit through the automatic driving unit.

[0094] In an embodiment of the present application, after updating the upper speed limit of the vehicle, the automatic driving unit will adjust the engine output power and the working status of other related components accordingly, so that the vehicle can smoothly reach the new speed level.

[0095] It should be noted that in order to ensure the safety of autonomous driving, the autonomous driving unit will continue to monitor changes in the vehicle's external environment and flexibly adjust the vehicle's driving speed. For example, if an emergency is detected ahead, the autonomous driving unit will immediately take deceleration measures until the vehicle stops completely, regardless of the current set speed.

[0096] To summarize, the technical solution provided in the embodiment of the present application creates a virtual game through the automatic driving function of the vehicle. After the user starts the virtual game, the vehicle turns on the automatic driving function, so that the vehicle can automatically drive along the designated route without the need for the user's driving operation during the virtual game. Afterwards, the user can adjust the speed of the vehicle during automatic driving by completing the interactive operations specified in the virtual game, so as to extend or shorten the time it takes for the vehicle to complete the designated route. This solution expands a new way of interaction between users and vehicles, and can improve the interactive effect between users and vehicles.

[0097] Based on the above Figure 2 In the solution in the illustrated embodiment, in a possible implementation manner, the vehicle further includes a screen unit connected to the main control unit.

[0098] The screen unit refers to a display screen of an electronic device connected to the main control unit of the vehicle. Exemplarily, the electronic device includes a smart phone, a smart watch, a tablet computer, a laptop computer, a desktop computer, a head-mounted device, a vehicle terminal, a HUD, etc., and may also include other electronic devices, which are not limited in this application.

[0099] Exemplarily, the screen unit and the main control unit of the vehicle-mounted terminal can be designed in an integrated manner. For example, the main control unit corresponds to the vehicle-mounted system, and the vehicle-mounted system includes a large vehicle-mounted screen, that is, the screen unit of the vehicle-mounted terminal.

[0100] The above step 210 can be implemented as step 210a, step 210b and step 210c.

[0101] Step 210a: When the vehicle moves to a designated position and receives an instruction to start a virtual game, matching information of the virtual game is displayed through the screen unit; the matching information is used to indicate at least one opponent vehicle competing with the vehicle.

[0102] The vehicle moving to the designated location means that the vehicle drives and stops at the designated location. Exemplarily, the designated location is the starting point of the designated route or a preparation area for a virtual game.

[0103] For example, when the vehicle moves to the designated location, the screen unit may display the vehicle and the road where the vehicle is located. Figure 3 As shown in part (a) of FIG. 1 , a vehicle 301 and a road 302 on which the vehicle is located are displayed in the screen unit; Figure 3 As shown in part (b) of FIG. 3 , when the vehicle 301 stops at the starting point, the screen unit displays the racing starting point 303 of the virtual game; accordingly, the matching information of the virtual game is displayed in the screen unit, such as Figure 3 As shown in part (c) of the figure, the opponent is being matched at this time.

[0104] Among them, the above-mentioned opponent vehicles include at least one of the following: other vehicles that have currently arrived at the designated location, vehicles that have completed the race on the track route corresponding to the designated location in the past, vehicles controlled by the system, etc. Other vehicles can also be listed in parallel, and this application does not limit this.

[0105] Step 210b: When the virtual game is successfully matched, the vehicle is controlled by the main control unit to enter a multi-party game mode in the virtual game mode.

[0106] Among them, the above-mentioned multi-party game mode refers to that there are at least two participating vehicles currently participating in the same competition.

[0107] In an embodiment of the present application, when the vehicle enters a multi-party virtual game mode, a wake-up signal is sent to the automatic driving unit through the main control unit to start the automatic driving function of the vehicle.

[0108] Step 210c: When the vehicle enters the multi-player game mode, the first identification information of the vehicle, the second identification information of the opponent vehicle, and the track route on which the vehicle competes with the opponent vehicle are displayed through the screen unit.

[0109] In an embodiment of the present application, the main control unit sends instruction information to the screen unit so that the screen unit displays the first identification information of the vehicle, the second identification information of the opponent vehicle, and the track route on which the vehicle competes with the opponent vehicle.

[0110] Among them, the first identification information of the above-mentioned vehicle includes the first virtual model of the vehicle and the appearance information (such as skin) of the first virtual model; the second identification information of the above-mentioned opponent vehicle includes the second virtual model of the opponent vehicle and the appearance information (such as skin) of the second virtual model.

[0111] The track route for the vehicle to compete with the opponent vehicle refers to the route that the vehicle and the opponent vehicle will automatically drive. For example, the track route can be in the form of a dynamic map, which is updated in real time as the position of the vehicle changes, marking important locations such as the starting point, the end point, the checkpoint or the reward area.

[0112] Optionally, the screen unit can also display some auxiliary information, such as remaining time, current speed, fuel consumption, etc., so that users can better manage resources and optimize driving strategies.

[0113] For example, taking one opponent vehicle as an example, based on the above Figure 3 ,like Figure 4As shown, the screen unit displays a first virtual model of the vehicle 301, a second virtual model of the opponent vehicle 304, and a track route 305 on which the vehicle 301 competes with the opponent vehicle 304, so that the user corresponding to the vehicle can clearly know the next competition route.

[0114] The embodiment of the present application provides a matching mechanism for virtual games. Through the matching mechanism, the present solution can improve the sense of interaction between users corresponding to different vehicles and ensure the professionalism and fun of the virtual game. In addition, by presenting key information in a visual manner, the present solution can also enhance the transparency of the virtual game.

[0115] Based on the solutions in the above-mentioned embodiments of the present application, in a possible implementation, the above-mentioned vehicle state control method may also include the following steps 210d and 210e.

[0116] Step 210d: When the virtual game matching fails, the vehicle is controlled by the main control unit to enter the unilateral game mode in the virtual game mode.

[0117] Exemplarily, the above matching information corresponds to a time limit. If the opponent vehicle is matched within the specified time period, the matching is successful; otherwise, if the opponent vehicle is not matched within the specified time period, the matching fails.

[0118] In the embodiment of the present application, the main control unit will automatically control the vehicle to switch to the unilateral game mode in the virtual game mode. In this mode, the user can enjoy the fun of the virtual game alone without waiting for other users to join.

[0119] Step 210e: When the vehicle enters the single-player game mode, the first identification information of the vehicle and the track route where the vehicle is located are displayed through the screen unit.

[0120] In an embodiment of the present application, the main control unit sends instruction information to the screen unit so that the screen unit displays the first identification information of the vehicle and the track route on which the vehicle competes with the opponent vehicle.

[0121] The embodiment of the present application provides a corresponding game mechanism when matching fails, that is, a one-sided game mode, and the user can participate in the virtual game alone. This solution can improve the flexibility of the virtual game.

[0122] Based on the solutions in the above-mentioned embodiments of the present application, in a possible implementation, the above-mentioned vehicle state control method may also include the following steps 260 and 270.

[0123] Step 260: When the vehicle is controlled by the automatic driving unit to travel along a designated route, real-time information of the vehicle in the virtual game is displayed through the screen unit.

[0124] The above real-time information includes but is not limited to the vehicle's speed, real-time location, driving direction, current score or current ranking, remaining time, and other key indicators related to the progress of the game, which are not limited in this application. Figure 4 For example, the screen unit displays real-time ranking information 306 so that the user can grasp his or her own ranking in real time.

[0125] Exemplarily, in a multi-player game mode, the real-time position of the opponent's vehicle may also be displayed via the screen unit.

[0126] By displaying the real-time information of the vehicle in the virtual game through the screen unit, the game status can be updated in time so that the user can grasp the game performance of the vehicle at any time and adjust the game strategy in time, such as performing different interactive operations.

[0127] Step 270: When the vehicle reaches the end of the designated route, the screen unit displays the end information of the vehicle in the virtual game.

[0128] In the embodiment of the present application, when the vehicle reaches the end point of the designated route, it means that the vehicle has completed the above-mentioned virtual game.

[0129] The above-mentioned ending information includes but is not limited to the final ranking, total score, rewards obtained, game videos, game highlights and other information related to the game results, which is not limited in this application. Figure 4 ,like Figure 5 As shown, the screen unit displays a final ranking 307 and a game video 308, and the user can click on the game video 308 to review the game process.

[0130] By displaying the ending information of the vehicle in the virtual game through the screen unit, the result of the game can be clearly displayed, satisfying the user's sense of achievement in the virtual game, especially when the user achieves a personal best record or defeats a strong opponent.

[0131] In an embodiment of the present application, during the virtual game and at the end of the virtual game, the screen unit can respectively display information related to the game process and game results to enrich the display content of the screen unit.

[0132] Based on the solutions in the above embodiments of the present application, in a possible implementation manner, the above vehicle state control method may further include the following steps:

[0133] When the vehicle enters the virtual game mode, the designated tasks are displayed through the screen unit.

[0134] In the case where the vehicle enters the virtual game mode, it means that the virtual game has not officially started. At this time, the screen unit can pre-display the designated task corresponding to the track route where the vehicle is located.

[0135] For example, when the specified task is displayed through the screen unit, the information of the specified task is presented in an intuitive and easy-to-understand manner, such as using icons, short text descriptions, and animation demonstrations, to ensure that the user can quickly understand.

[0136] Exemplarily, in an embodiment of the present application, the user may also be provided with the authority to select part or all of the candidate tasks from a plurality of candidate tasks. Specifically, for example, the above-mentioned vehicle state control method may further include: when the vehicle enters the virtual game mode, displaying at least one candidate task through the screen unit; when receiving a selection operation for the candidate task, adding the candidate task to the designated task. In other words, the screen unit can display a plurality of candidate tasks, from which the user can select the candidate tasks of interest as the designated tasks to be completed. Accordingly, the main control unit can send the designated task to the user according to the designated task selected by the user while the virtual game is in progress.

[0137] The embodiment of the present application provides a solution for displaying designated tasks before the virtual game officially starts, so that the user can know in advance which tasks can affect the driving speed of the vehicle, thereby improving the strategy of the virtual game.

[0138] Based on the solutions in the above embodiments of the present application, in a possible implementation manner, the above vehicle state control method may further include the following steps:

[0139] When the vehicle is controlled by the automatic driving unit to travel along a designated route and reaches the conditions for issuing a designated task, the designated task is displayed through the screen unit.

[0140] Among them, the above-mentioned situation in which the vehicle is controlled to travel along a designated route by the automatic driving unit represents that a virtual game is in progress.

[0141] Among them, the conditions for issuing the above-mentioned designated tasks may include but are not limited to the time of issuing the designated tasks, the location of the vehicle, the distance between the vehicle and the destination, etc., and may also include other conditions, which are not limited in this application.

[0142] Exemplarily, when the designated task is displayed by the screen unit, the information of the designated task may be related to the current position of the vehicle. For example, when the vehicle approaches a landmark building, the designated task displayed by the screen unit is to take a photo of the landmark building. Accordingly, the user can take a photo of the landmark building and upload the photo to the server. If the photo meets the requirements, the server sends an adjustment instruction to the vehicle. According to the adjustment instruction, the main control unit of the vehicle updates the speed limit of the automatic driving unit to control the vehicle.

[0143] In a possible implementation, the vehicle further includes a broadcast unit connected to the main control unit, and the vehicle state control method may further include the following steps: when the vehicle is controlled by the automatic driving unit to travel along a designated route and reaches the conditions for issuing a designated task, the designated task is played by the broadcast unit. In other words, the vehicle may also send the designated task to the user by playing the broadcast unit, further optimizing the interaction effect between the user and the vehicle.

[0144] The embodiment of the present application provides a solution for displaying designated tasks at irregular intervals during the virtual game, which can enhance the randomness of the designated tasks and improve the unpredictability of the virtual game.

[0145] Based on the solutions shown in the above embodiments, this application proposes a method for realizing a car game based on automatic driving. This method provides a game service based on automatic driving function to realize competition between vehicles. Please refer to Figure 6 , which shows a flowchart of a method for implementing a car game based on automatic driving for a racing competition provided by an exemplary embodiment of the present application. Figure 6 As shown, the method for realizing the in-vehicle game of racing competition based on automatic driving comprises the following steps:

[0146] Step 601: The vehicle needs to drive to the starting station of the track route. After arriving, it needs to match with other vehicles through the cloud server. After the match is successful, the vehicle data and the matching vehicle data are synchronized and updated in real time on the vehicle system. Before starting the race, the self-driving function of the vehicle and the opponent vehicle needs to be turned on.

[0147] The above-mentioned racing route can be a virtual route reconstructed by the official scene built in advance, or it can be a virtual track route created by the user. For example, the construction of the virtual route can be achieved through scene reconstruction and perception restoration technology, using sensor groups, laser radar, millimeter wave radar and other technologies to scan the vehicle and the surrounding environment, and reconstruct the three-dimensional picture of the actual road into the track route of the virtual game based on the surrounding image information and 3D point cloud information, and project it on the screen device corresponding to the vehicle.

[0148] Among them, the vehicle needs to be matched with other vehicles through the cloud server. After the match is successful, the car model skin, vehicle data and driving trajectory of the vehicle and the opponent's vehicle will be updated synchronously in real time on their respective screen devices (including but not limited to: mobile phones, watches, tablets, computers, HUD, in-car screens, head-mounted devices, etc.), and the real-time camera will record and save the game scene screen.

[0149] For example, before starting a race, the system can remind the users of the own vehicle and the opponent's vehicle to turn on the automatic driving function and release their hands.

[0150] Step 602: After the race begins, the vehicle and the opponent's vehicle drive to the set road route terminal by themselves. The user needs to sit in the car to experience the autonomous driving process. Under the premise of driving safety, some tasks can be performed to help the car speed up, and finally assist the autonomous driving to complete the race on the set route.

[0151] During the competition, the system needs to ensure driving safety through technologies such as sensor groups, lidar, millimeter-wave radar, cameras, and real-time navigation.

[0152] During the competition, users need to sit in the car to experience the autonomous driving process and be ready to take over the vehicle at any time. Under the premise of driving safety, they can perform some special tasks transmitted by the system to help the car speed up autonomously.

[0153] Step 603: The system will announce the competition results and various vehicle driving data of the users participating in the competition so that the users can enjoy the unique technological experience brought by autonomous driving.

[0154] Among them, after finally assisting the autonomous driving to complete the race on the designated route, the system will announce the competition results and various vehicle driving data of the users participating in the competition, and simultaneously upload the car model skin, vehicle data, driving trajectory, camera recording, and game scene images of the vehicle and the opponent's vehicle to the cloud, participate in the ranking, and can also view and share the competition video (including real road and game scene images) for a second time. The uploaded data can also be used as a virtual racing car to compete with other users.

[0155] Optionally, in the absence of real opponent vehicles, you can compete in the autonomous driving racing game alone and create your own record. During and after the competition, you can upload your car model skin, vehicle data, driving trajectory, camera recordings, and game scene images to the cloud to participate in the ranking. You can also view and share the competition video (including images of real roads and game scenes) for a second time. The uploaded data can be used as a virtual racing car to compete with other users.

[0156] Optionally, the user can use the screen device to select a game user who has uploaded data on a certain track route to compete (the virtual car is virtually driven based on the data uploaded by the user), or choose to compete with a computer racing car (the computer racing car is virtually driven based on actual road conditions). During the competition, the virtual vehicle sends the car model skin, vehicle data and driving trajectory to the user's screen device through the game cloud, and competes with the user's own car in an automatic driving competition. During and after the competition, the user needs to synchronously upload the car model skin, vehicle data, driving trajectory, camera recording, and game scene screen of the user's own car and virtual vehicle to the cloud to participate in the ranking. The user can also view and share the competition video (including real road and game scene screen) for a second time.

[0157] In summary, this method reconstructs a virtual road scene through scenes, hands over the steering wheel to the vehicle, and allows the self-vehicle and other vehicles to start automatic driving on real roads and participate in racing game competitions. In other words, drivers and passengers can use the automatic driving function to experience the automatic racing competition between vehicles while sitting in the car, and feel the novel experience and fun brought by the unknown results.

[0158] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0159] Please refer to Figure 7 , which shows a block diagram of a tab content loading device provided by an exemplary embodiment of the present application. The device has the functions of implementing the above examples, and the functions can be implemented by hardware or by hardware executing corresponding software. Figure 7 As shown, the device may include: a first control module 701 , a second control module 702 , a receiving module 703 , an updating module 704 and a speed control module 705 .

[0160] The first control module 701 is used to control the vehicle to enter a virtual game mode when receiving an instruction to start a virtual game; in the virtual game mode, the vehicle starts an automatic driving function;

[0161] The second control module 702 is used to control the vehicle to travel along a specified route during the running of the virtual game;

[0162] The receiving module 703 is used to receive the interactive operation of the internal personnel of the vehicle;

[0163] An updating module 704 is used to update the upper speed limit of the vehicle controlled by the automatic driving unit when the interactive operation matches the operation corresponding to the specified task; the specified task is a task provided by the virtual game;

[0164] The speed control module 705 is used to control the vehicle to travel according to the upper speed limit.

[0165] In some embodiments, the vehicle further comprises a screen unit connected to the main control unit; a first control module 701, configured to display matching information of the virtual game when the vehicle moves to a designated position and receives an instruction to start the virtual game; the matching information is used to indicate at least one opponent vehicle competing with the vehicle;

[0166] The first control module is used to control the vehicle to enter a multi-party game mode in the virtual game mode when the virtual game is successfully matched;

[0167] The first control module is used to display the first identification information of the vehicle, the second identification information of the opponent vehicle, and the track route of the vehicle and the opponent vehicle when the vehicle enters the multi-party game mode.

[0168] In some embodiments, the vehicle state control device further includes: a third control module, configured to control the vehicle to enter a unilateral game mode in the virtual game mode when the virtual game matching fails;

[0169] The vehicle state control device also includes: a first display module, which is used to display the first identification information of the vehicle and the track route of the vehicle when the vehicle enters the single-player game mode.

[0170] In some embodiments, the vehicle state control device further includes: a second display module for displaying real-time information of the vehicle in the virtual game when the vehicle is controlled to travel along a specified route;

[0171] The vehicle state control device also includes: a third display module, which is used to display the end information of the vehicle in the virtual game when the vehicle reaches the end point of the designated route.

[0172] In some embodiments, the vehicle state control device further includes: a fourth display module, used to display a designated task when the vehicle enters a virtual game mode.

[0173] In some embodiments, the vehicle state control device further includes: a fifth display module, which is used to display the designated task when the vehicle is controlled to travel along the designated route and the conditions for issuing the designated task are met.

[0174] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the content structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0175] Please refer to Figure 8 , which shows a block diagram of a computer device provided in one embodiment of the present application. The computer device 800 can be any electronic device with data calculation, processing and storage capabilities. The computer device 800 can be used to implement the tab content loading method provided in the above embodiment.

[0176] Typically, the computer device 800 includes a processor 801 and a memory 802 .

[0177] The processor 801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 801 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). The processor 801 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 801 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 801 may also include an artificial intelligence (AI) processor, which is used to process computing operations related to machine learning.

[0178] The memory 802 may include one or more computer-readable storage media, which may be non-transitory. The memory 802 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 802 is used to store a computer program, which is configured to be executed by one or more processors to implement the above-mentioned tab content loading method.

[0179] Those skilled in the art will understand that Figure 8 The structure shown in the figure does not constitute a limitation on the computer device 800, and the computer device 800 may include more or less components than those shown in the figure, or combine some components, or adopt a different arrangement of components.

[0180] In an exemplary embodiment, a computer-readable storage medium is also provided, in which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned tab content loading method is implemented. Optionally, the computer-readable storage medium may include: ROM (Read-Only Memory), RAM (Random Access Memory), SSD (Solid State Drives) or optical disks, etc. Among them, the random access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).

[0181] In an exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the above-mentioned tab content loading method.

[0182] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application are not limited to this.

[0183] The above description is only an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A vehicle state control method, characterized in that: The method is performed by a vehicle, the vehicle comprising a main control unit and an automatic driving unit connected to the main control unit, and the method comprises: When receiving an instruction to start a virtual game, the main control unit controls the vehicle to enter a virtual game mode; in the virtual game mode, the vehicle starts an automatic driving function; During the running of the virtual game, the vehicle is controlled by the automatic driving unit to travel along a specified route; Receiving interactive operations of an internal person of the vehicle through the main control unit; When the interactive operation matches an operation corresponding to a designated task, the main control unit updates the upper limit of the speed of the vehicle controlled by the automatic driving unit; the designated task is a task provided by the virtual game; The vehicle is controlled to travel according to the speed limit through the automatic driving unit.

2. The method according to claim 1, characterized in that: The vehicle further comprises a screen unit connected to the main control unit; and when receiving an instruction to start a virtual game, controlling the vehicle to enter a virtual game mode through the main control unit comprises: When the vehicle moves to a designated position and receives an instruction to start a virtual game, matching information of the virtual game is displayed through the screen unit; the matching information is used to indicate at least one opponent vehicle competing with the vehicle; When the virtual game is successfully matched, the vehicle is controlled by the main control unit to enter a multi-party game mode in the virtual game mode; When the vehicle enters the multi-player game mode, the first identification information of the vehicle, the second identification information of the opponent vehicle, and the track route on which the vehicle competes with the opponent vehicle are displayed through the screen unit.

3. The method according to claim 2, characterized in that The method further comprises: In the case where the virtual game fails to match, controlling the vehicle to enter a unilateral game mode in the virtual game mode through the main control unit; When the vehicle enters the single-player game mode, the first identification information of the vehicle and the track route where the vehicle is located are displayed through the screen unit.

4. The method according to claim 2 or 3, characterized in that: The method further comprises: In a case where the vehicle is controlled to travel along the designated route by the automatic driving unit, real-time information of the vehicle in the virtual game is displayed by the screen unit; When the vehicle reaches an end point of the designated route, end information of the vehicle in the virtual game is displayed through the screen unit.

5. The method according to claim 2 or 3, characterized in that: The method further comprises: In a case where the vehicle enters the virtual game mode, the designated task is displayed through the screen unit.

6. The method according to claim 2 or 3, characterized in that: The method further comprises: When the vehicle is controlled by the automatic driving unit to travel along the designated route and the issuance condition of the designated task is reached, the designated task is displayed by the screen unit.

7. A vehicle state control device, characterized in that: The device comprises: A first control module is used to control the vehicle to enter a virtual game mode when receiving an instruction to start a virtual game; in the virtual game mode, the vehicle starts an automatic driving function; A second control module is used to control the vehicle to travel along a specified route during the running of the virtual game; A receiving module, used for receiving an interactive operation of an internal person of the vehicle; an updating module, configured to update an upper limit of a speed of the vehicle controlled by the automatic driving unit when the interactive operation matches an operation corresponding to a specified task; the specified task is a task provided by the virtual game; A speed control module is used to control the vehicle to travel according to the speed upper limit.

8. A computer device, characterized in that: The computer device includes a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the vehicle state control method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which is loaded and executed by a processor to implement the vehicle state control method as described in any one of claims 1 to 6.

10. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a computer-readable storage medium. A processor reads and executes the computer program from the computer-readable storage medium to implement the vehicle state control method according to any one of claims 1 to 6.

Images