Method and device for controlling vehicle based on mobile terminal and storage medium

Abstract

The invention discloses a method for controlling a vehicle based on a mobile terminal, electronic equipment and a computer readable storage medium. The method for controlling the vehicle based on the mobile terminal comprises the following steps: presenting a three-dimensional virtual model of the vehicle to a user at the mobile terminal; determining a part selected by the user on the three-dimensional virtual model, and determining equipment corresponding to the selected part based on a mapping relation between the three-dimensional virtual model and the vehicle; and communicating with the vehicle to obtain related information of the equipment or control the equipment.

Description

Technical Field

[0001] This application relates to the technical field of automobiles, and specifically, to a method, an electronic device, and a computer-readable storage medium for controlling a vehicle based on a mobile terminal. Background Art

[0002] In the traditional solution for controlling in-vehicle devices, the driver or passenger needs to manually operate the buttons on the in-vehicle devices to control the in-vehicle devices. However, with the continuous iteration and update of vehicle technologies, the functions of in-vehicle devices have become increasingly diverse, which has led to an increasing number of buttons for controlling different functions of in-vehicle devices. Too many buttons on in-vehicle devices directly affect the convenience of the driver or passenger operating the in-vehicle devices.

[0003] With the rapid development of vehicle networking technology, the interaction methods between users and vehicles have become more and more diversified. Users hope to interact with vehicles in a more convenient way, such as using a mobile terminal, to control the vehicle or achieve information interaction. Summary of the Invention

[0004] One object of this application is to provide a method, an electronic device, and a computer-readable storage medium for controlling a vehicle based on a mobile terminal. By presenting a three-dimensional virtual model of the vehicle to the user on the mobile terminal, the user can intuitively browse and select the corresponding devices on the vehicle based on the three-dimensional virtual model to obtain relevant information of the corresponding devices or control the corresponding devices, so as to realize the convenient operation of the vehicle devices by the user.

[0005] Another object of this application is to provide a vehicle control method, an electronic device, and a computer-readable storage medium. By setting different user levels for the mobile terminal and allowing the mobile terminal with the user level of the vehicle owner level to remotely control the vehicle devices or query the information of the vehicle devices, a convenient and fast vehicle device control experience can be provided for, for example, vehicle owners.

[0006] Another object of this application is to provide a vehicle control method, an electronic device, and a computer-readable storage medium. By setting different user levels for the mobile terminal and allowing the mobile terminal of a specific level to closely control the vehicle devices or query the information of the vehicle devices, a convenient and fast vehicle device control experience can be provided for, for example, vehicle owners and passengers.

[0007] According to a first aspect of the present application, there is provided a method for controlling a vehicle based on a mobile terminal, the method comprising: presenting a three-dimensional virtual model of the vehicle on the mobile terminal; determining a selected part on the three-dimensional virtual model by the user and determining a device corresponding to the selected part based on a mapping relationship between the three-dimensional virtual model and the vehicle; and communicating with the vehicle to obtain relevant information of the device or control the device.

[0008] In some embodiments, presenting the three-dimensional virtual model of the vehicle on the mobile terminal includes: determining that the mobile terminal is within a predetermined distance range of the vehicle and the mobile terminal is outside the vehicle, providing a user interface for the user to enter an interface for displaying the three-dimensional virtual model; and in response to the user clicking on the user interface, presenting the three-dimensional virtual model of the outside of the vehicle to the user.

[0009] In some embodiments, presenting the three-dimensional virtual model of the vehicle on the mobile terminal further includes: in response to determining that the mobile terminal moves from the outside of the vehicle to the inside of the vehicle, switching the presented three-dimensional virtual model from the three-dimensional virtual model of the outside of the vehicle to the three-dimensional virtual model of the inside of the vehicle.

[0010] In some embodiments, presenting the three-dimensional virtual model of the vehicle on the mobile terminal includes: determining that the mobile terminal is within a predetermined distance range of the vehicle and the mobile terminal is inside the vehicle, providing a user interface for the user to enter an interface for displaying the three-dimensional virtual model; and in response to the user clicking on the user interface, presenting the three-dimensional virtual model of the inside of the vehicle to the user.

[0011] In some embodiments, presenting the three-dimensional virtual model of the vehicle on the mobile terminal further includes: in response to determining that the mobile terminal moves from the inside of the vehicle to the outside of the vehicle, switching the presented three-dimensional virtual model from the three-dimensional virtual model of the inside of the vehicle to the three-dimensional virtual model of the outside of the vehicle.

[0012] In some embodiments, communicating with the vehicle to obtain relevant information of the device or control the device includes: communicating with the vehicle through a near-field connection technology to obtain relevant information of the device or control the device, wherein the near-field connection technology includes at least one of Bluetooth connection technology, UwB connection technology, and wi-Fi connection technology.

[0013] In some embodiments, presenting the three-dimensional virtual model of the vehicle to the user includes: receiving an instruction from the user and presenting the three-dimensional virtual model of the vehicle to the user according to the instruction, where the three-dimensional virtual model includes at least one of an external three-dimensional virtual model and an internal three-dimensional virtual model of the vehicle.

[0014] In some embodiments, communicating with the vehicle to obtain relevant information about the device or control the device includes: connecting to a cloud server through a wireless network to establish a communication link between the mobile terminal and the vehicle through the cloud server; and obtaining relevant information about the device or controlling the device via the communication link.

[0015] In some embodiments, presenting the three-dimensional virtual model of the vehicle on the mobile terminal to the user further includes: adjusting or changing the display angle of the three-dimensional virtual model based on the user's operation on the three-dimensional virtual model, where the operation includes at least one of rotation, sliding, zooming in, and zooming out.

[0016] According to a second aspect of the present application, there is also provided an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; where the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method of the first aspect of the present application.

[0017] According to a third aspect of the present application, there is also provided a non-transitory computer-readable storage medium, on which machine-executable instructions are stored, and the machine-executable instructions, when executed, cause the machine to execute the method of the first aspect of the present application.

[0018] According to a fourth aspect of the present application, there is also provided a vehicle control method, the method including: receiving a query instruction or a control instruction from a user mobile terminal via a cloud server; determining the user level of the user mobile terminal; and in response to determining that the user level of the user mobile terminal is the owner level, providing relevant information obtained based on the query instruction to the user mobile terminal or controlling the vehicle to perform corresponding operations according to the control instruction.

[0019] According to a fifth aspect of the present application, there is also provided a vehicle control method, the method including: detecting a user mobile terminal within a predetermined distance range of the vehicle; determining the position of the detected user mobile terminal relative to the vehicle and the user level of the user mobile terminal; and based on the determined position and user level, determining whether to send a notification message to the user mobile terminal to enable the user mobile terminal to provide a user interface to the user.

[0020] In some embodiments, detecting a user mobile terminal within a predetermined distance range of the vehicle includes: detecting a user mobile terminal within a predetermined distance range of the vehicle based on near-field connection technology or GNSS high-precision positioning technology, wherein the near-field connection technology includes at least one of Bluetooth connection technology, UWB connection technology, and Wi-Fi connection technology.

[0021] In some embodiments, determining whether to send a notification message to the user mobile terminal based on the determined position and user level, so that the user mobile terminal provides a user interface to the user includes: in response to determining that the user mobile terminal is outside the vehicle and the user level is the owner level, sending a notification message to the user mobile terminal, so that the user mobile terminal provides a user interface for the user to enter an interface for displaying an external three-dimensional virtual model of the vehicle.

[0022] In some embodiments, the method further includes: receiving a query instruction or a control instruction input by the user after entering the interface for displaying the external three-dimensional virtual model of the vehicle through the user interface; and providing relevant information obtained based on the query instruction or controlling the vehicle to perform corresponding operations according to the control instruction to the user mobile terminal based on the query instruction or the control instruction.

[0023] In some embodiments, determining whether to send a notification message to the user mobile terminal based on the determined position and user level, so that the user mobile terminal provides a user interface to the user includes: in response to determining that the user mobile terminal is outside the vehicle and the user level is not the owner level, interrupting communication with the user mobile terminal.

[0024] In some embodiments, determining whether to send a notification message to the user mobile terminal based on the determined position and user level, so that the user mobile terminal provides a user interface to the user includes: in response to determining that the user mobile terminal is inside the vehicle and the user level is the owner level or the passenger level, sending a notification message to the user mobile terminal, so that the user mobile terminal provides a user interface for the user to enter an interface for displaying an internal three-dimensional virtual model of the vehicle.

[0025] In some embodiments, the method further includes: receiving a query instruction or a control instruction input by the user after entering the interface for displaying the internal three-dimensional virtual model of the vehicle through the user interface, and providing relevant information obtained based on the query instruction or controlling the vehicle to perform corresponding operations according to the control instruction to the user mobile terminal based on the query instruction or the control instruction.

[0026] In some embodiments, the method further includes: providing an in-vehicle display user interface to the user through a display device of the vehicle; in response to the user clicking on the in-vehicle display user interface, displaying a three-dimensional virtual model of the interior of the vehicle; and based on a query instruction or a control instruction input by the user on the interface displaying the three-dimensional virtual model of the interior of the vehicle, providing feedback to the user with relevant information obtained based on the query instruction, or performing a corresponding operation according to the control instruction.

[0027] According to a sixth aspect of the present application, there is also provided an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor is enabled to execute the method according to the fourth aspect or the fifth aspect of the present application.

[0028] According to a seventh aspect of the present application, there is also provided a non-transitory computer-readable storage medium, on which machine-executable instructions are stored, and when the machine-executable instructions are executed, the machine is enabled to execute the method according to the fourth aspect or the fifth aspect of the present application.

[0029] It should be understood that the content described in this part is not intended to identify the key features or important features of the embodiments of the present application, nor is it used to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Through the following detailed description with reference to the accompanying drawings, the above and other advantages of the embodiments of the present application will become apparent. The drawings are intended to illustrate exemplary embodiments of the present application rather than limit it. In the drawings:

[0031] Figure 1A and Figure 1B respectively schematically show exemplary system architectures applicable to the method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application;

[0032] Figures 2 to 3D respectively schematically show flowcharts of the method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application;

[0033] Figure 4 schematically shows a flowchart of a vehicle control method according to an exemplary embodiment of the present application;

[0034] Figures 5 to 6D schematically shows a flowchart of a vehicle control method according to an exemplary embodiment of the present application;

[0035] Figure 7A block diagram schematically showing an electronic device suitable for implementing the exemplary embodiments of the present application; and

[0036] Figures 8A to 8C Interface diagrams of a mobile terminal according to the exemplary embodiments of the present application are respectively schematically shown. Detailed implementation manners

[0037] To better understand the present application, more detailed descriptions of various aspects of the present application will be made with reference to the accompanying drawings. It should be understood that these detailed descriptions are only descriptions of the exemplary embodiments of the present application and do not limit the scope of the present application in any way. Additionally, for greater clarity and conciseness, descriptions of features well-known in the art may be omitted.

[0038] Throughout the drawings and the detailed implementation manners, the same reference numerals refer to the same elements. For the purposes of clarity, illustration, and convenience, the drawings may not be drawn to scale, and the relative sizes, proportions, and depictions of elements in the drawings may be exaggerated.

[0039] It should also be understood that the terms "include", "include having", "have", "contain", and / or "contain having", when used in this specification, indicate the presence of the stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or groups thereof. In addition, when an expression such as "at least one of..." appears after a list of listed features, it modifies the entire list of listed features rather than individual elements in the list. Further, when describing the embodiments of the present application, the use of "may" means "one or more embodiments of the present application". And the term "exemplary" is intended to refer to an example or illustration.

[0040] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention pertains. It should also be understood that terms (such as those defined in a common dictionary) should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

[0041] More detailed descriptions of various aspects of the present application will be made hereinafter with reference to the accompanying drawings.

[0042] In some related technologies, there have been instances of using smartphones to control different devices on a vehicle. For example, the control of different devices on a vehicle is achieved through mobile remote control or the "one-finger connection" technology of the mobile phone. Although the mobile remote control solution allows the vehicle owner to control some devices on the vehicle, due to the limitation of the unintuitive operation interface, the vehicle owner cannot remotely control more devices on the vehicle. In addition, the remote control solution can only authorize the vehicle owner with the control authority of the vehicle, and passengers cannot control or read information of different devices on the vehicle through relevant applications. The "one-finger connection" technology solution of the mobile phone can achieve the positioning and directivity of the mobile phone to the remotely controlled device by using the UWB multi-antenna positioning of the mobile phone itself. However, this solution requires the mobile phone to have a special UWB multi-antenna structure, which greatly limits its standard application and popularity. In addition, the "one-finger connection" technology of the mobile phone can only be used within a short-range, resulting in relatively limited usage scenarios.

[0043] To at least partially solve one or more of the above problems and other potential problems, an exemplary embodiment of the present application proposes a solution for controlling a vehicle based on a mobile terminal. In this solution, by presenting a three-dimensional virtual model of the vehicle to the user on the mobile terminal, the user can intuitively browse and select the corresponding device on the vehicle based on the three-dimensional virtual model to obtain relevant information of the corresponding device or control the corresponding device, thereby enabling the user to conveniently operate the vehicle device. According to the solution for controlling a vehicle based on a mobile terminal provided by the exemplary embodiment of the present application, it can provide the driver and passengers with the ability to quickly and conveniently control the vehicle device. The driver and passengers do not need to use the physical buttons on the vehicle or the virtual buttons on the screen, but can directly select the vehicle device to be controlled on the three-dimensional virtual model of the vehicle presented on the mobile terminal to control the vehicle device or query relevant information of the vehicle device.

[0044] Figure 1A and Figure 1B respectively show exemplary system architectures 100a and 100b suitable for applying the method for controlling a vehicle based on a mobile terminal according to the exemplary embodiment of the present application.

[0045] As Figure 1A and Figure 1B shown, the system architecture may include a mobile terminal 110 and a vehicle 120. The mobile terminal 110 may include but is not limited to a smart phone, a smart watch, a portable computer, a personal digital assistant, etc. Various client applications may be installed on the mobile terminal 110, such as a vehicle control application, a news application, a web browser application, a search application, etc.

[0046] The mobile terminal 110 can communicate with the vehicle 120 via various wired or wireless communication links. The communication method between the mobile terminal 110 and the vehicle 120 can, to some extent, depend on the distance between the mobile terminal 110 and the vehicle 120.

[0047] In the scenario as Figure 1A shown, when the distance between the mobile terminal 110 and the vehicle 120 exceeds the available distance of the near-field connection technology, the mobile terminal 110 can communicate with the vehicle 120 via the wireless network 140. The wireless network 140 can include, but is not limited to, 2G network, 3G network, 4G network, 5G network, and so on. In some examples, both the mobile terminal 110 and the vehicle 120 can be connected to the cloud server 130 via the wireless network 140, so that the communication link between the mobile terminal 110 and the vehicle 120 can be established through the cloud server 130.

[0048] The cloud server 130 can be a computing device that provides various services. The cloud server 130 can have one or more processing units, including dedicated processing units such as GPUs, FPGAs, and ASICs (Application Specific Integrated Circuits) and general-purpose processing units such as CPUs. In some examples, the cloud server 130 can be implemented as a distributed server cluster composed of multiple cloud servers 130, or can be implemented as a single cloud server 130.

[0049] In the scenario as Figure 1B shown, when the distance between the mobile terminal 110 and the vehicle 120 does not exceed the available distance of the near-field connection technology, the mobile terminal 110 can communicate with the vehicle through the near-field connection technology. At this time, the mobile terminal 110 can directly interact with the in-vehicle server (for example, the in-vehicle T-BOX (Telematics BOX)). The near-field connection technology can include, for example, wireless near-field connection technologies such as Bluetooth connection technology, UWB (Ultra Wide Band) connection technology, and Wi-Fi connection technology, as well as wired near-field connection technologies such as USB (Universal Serial Bus) connection technology, but the present application is not limited thereto.

[0050] It should be noted that when the distance between the mobile terminal 110 and the vehicle 120 is not greater than the available distance of the near-field connection technology, the mobile terminal 110 can communicate with the vehicle 120 either through the near-field connection technology or by using the wireless network 140. In some examples, when the distance between the mobile terminal 110 and the vehicle 120 is not greater than the available distance of the near-field connection technology, the mobile terminal 110 can communicate with the vehicle 120 through both the near-field connection technology and the wireless network 140 simultaneously.

[0051] In some examples, the available distance of the near-field connection technology can be, for example, 10 meters. When the distance between the mobile terminal 110 and the vehicle 120 exceeds 10 meters, the mobile terminal 110 communicates with the vehicle 120 through the wireless network 140 via the cloud server 130; when the distance between the mobile terminal 110 and the vehicle 120 does not exceed 10 meters, the mobile terminal 110 can communicate with the vehicle 120 through the near-field connection technology and / or through the wireless network 140. It should be understood that the available distance of the near-field connection technology here is only exemplary. In actual applications, the available distance of the near-field connection technology depends on the effective distance of the specific near-field connection technology used. As an example, the available distance of the near-field connection technology can be, for example, 1 meter, 2 meters, 5 meters, 15 meters, 20 meters, 25 meters, or 30 meters, etc.

[0052] It should be understood that Figure 1A and Figure 1B the numbers of the mobile terminal 110, the vehicle 120, and the cloud server 130 in

[0053] are merely illustrative. According to actual needs, the system architecture can have any number of mobile terminals 110, vehicles 120, and cloud servers 130.

[0053] The following will describe the method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application in conjunction with Figures 2 to 3D the method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application. Figures 2 to 3D Flowcharts of methods 200, 200-1, 200-2, 200-3, and 200-4 for controlling a vehicle based on a mobile terminal according to exemplary embodiments of the present application are respectively shown. Methods 200, 200-1, 200-2, 200-3, and 200-4 can be executed, for example, at the mobile terminal 110 described in FIG. 1, or can be executed, for example, at the Figure 7 electronic device 700 described in Figure 7 . The following will take the mobile terminal 110 as an example for illustration. It should be understood that methods 200, 200-1, 200-2, 200-3, and 200-4 may also include additional steps not shown and / or may omit the steps shown. The scope of the present application is not limited in this regard.

[0054] At step S210, the mobile terminal 110 presents a three-dimensional virtual model of the vehicle 120 to the user.

[0055] Depending on the distance between the mobile terminal 110 and the vehicle 120 and the relative positional relationship between the mobile terminal 110 and the vehicle 120, the specific implementation of the mobile terminal 110 presenting the three-dimensional virtual model of the vehicle 120 to the user is different. Specifically, it can be divided into two cases: the mobile terminal 110 is within the predetermined distance range of the vehicle and the mobile terminal 110 is outside the predetermined distance range of the vehicle 120. Among them, the case where the mobile terminal 110 is within the predetermined distance range of the vehicle 120 can be further refined into two cases: the mobile terminal 110 is outside the vehicle 120 and the mobile terminal 110 is inside the vehicle 120. The predetermined distance range of the vehicle may refer to the distance range that allows the use of near-field connection technology between the vehicle and the mobile terminal, that is, the effective distance range for establishing a near-field connection centered on the vehicle. Various implementation manners of the mobile terminal 110 presenting the three-dimensional virtual model of the vehicle 120 to the user will be described in detail below.

[0056] In some embodiments, step S210 may specifically include steps S211 and S212, as Figure 3A shown. At step S211, when it is determined that the mobile terminal 110 is within the predetermined distance range of the vehicle 120 and the mobile terminal 110 is outside the vehicle 120, the mobile terminal 110 may provide a user interface for the user to enter the interface for displaying the three-dimensional virtual model of the vehicle 120 (see Figure 8A ). As an example, the user interface may be, for example, a pop-up window of a small program or a microservice, but the present application is not limited thereto. At step S212, in response to the user clicking the user interface provided by the mobile terminal 110, the mobile terminal 110 may present an out-of-vehicle three-dimensional virtual model of the vehicle 120 to the user (see Figure 8B ). The three-dimensional virtual model presented by the mobile terminal 110 to the user may change with the relative position of the mobile terminal 110 with respect to the vehicle 120. That is, when the mobile terminal 110 is outside the vehicle 120, it may present an out-of-vehicle three-dimensional virtual model of the vehicle 110 to the user, and when the mobile terminal 110 is inside the vehicle 120, it may present an in-vehicle three-dimensional virtual model of the vehicle 110 to the user. In some examples, step S210 may further include step S213. When it is determined that the mobile terminal 110 moves from the outside of the vehicle 120 to the inside of the vehicle 120, the three-dimensional virtual model presented by the mobile terminal 110 to the user will be switched from the out-of-vehicle three-dimensional virtual model of the vehicle 120 to the in-vehicle three-dimensional virtual model of the vehicle 120.

[0057] In some embodiments, step S210 may specifically include steps S214 and S215, as Figure 3BAs shown. At step S214, when it is determined that the mobile terminal 110 is within a predetermined distance range of the vehicle 120 and the mobile terminal 110 is inside the vehicle 120, the mobile terminal 110 can provide a user interface for the user to enter an interface for displaying a three-dimensional virtual model of the vehicle 120 (see Figure 8A ). At step S215, in response to the user clicking on the user interface provided by the mobile terminal 110, the mobile terminal 110 can present a three-dimensional virtual model of the interior of the vehicle 120 to the user (see Figure 8C ). In some examples, step S210 may further include step S216. When it is determined that the mobile terminal 110 moves from the inside of the vehicle 120 to the outside of the vehicle 120, the three-dimensional virtual model presented by the mobile terminal 110 to the user will be switched from the three-dimensional virtual model of the interior of the vehicle 120 to the three-dimensional virtual model of the exterior of the vehicle 120.

[0058] It should be understood that the three-dimensional virtual model presented by the mobile terminal 110 to the user may include a three-dimensional virtual model of the exterior of the vehicle and a three-dimensional virtual model of the interior of the vehicle, and may change accordingly as the state of the mobile terminal 110 changes from inside the vehicle to outside the vehicle or from outside the vehicle to inside the vehicle.

[0059] In an exemplary embodiment, it can be confirmed whether the mobile terminal 110 is within a predetermined distance range of the vehicle 120 by whether the mobile terminal 110 establishes a connection with the vehicle 120 through a near-field connection technology. The near-field connection technology may include, for example, at least one of Bluetooth connection technology, UWB connection technology, and Wi-Fi connection technology. Additionally, it can also be confirmed whether the mobile terminal 110 is within a predetermined distance range of the vehicle 120 through GNSS (Global Navigation Satellite System) high-precision positioning technology. Further, the position of the mobile terminal 110 relative to the vehicle 120 can be determined by GNSS high-precision positioning, Bluetooth, or UWB and other positioning technologies. For example, the mobile terminal 110 is outside the vehicle 120 or the mobile terminal 110 is inside the vehicle 120.

[0060] In some embodiments, step S210 may be specifically implemented as step S217, as Figure 3C shown. At step S217, the mobile terminal 110 receives an instruction from the user and presents a three-dimensional virtual model of the vehicle 120 to the user according to the instruction (see Figure 8B and Figure 8C ). The user's instruction may include enabling a vehicle control application on the mobile terminal 110 and selecting to present a three-dimensional virtual model of the exterior of the vehicle or a three-dimensional virtual model of the interior of the vehicle.

[0061] As Figure 3DAs shown, step S217 may include sub-step S2171 or sub-step S2172. When the user is outside the predetermined distance range of the vehicle 120, querying or controlling the relevant devices of the vehicle 120 can be achieved by actively enabling the vehicle control application on the mobile terminal 110. In some embodiments, when the user enables the vehicle control application on the mobile terminal 110 and selects to view the out-of-vehicle three-dimensional virtual model, the mobile terminal 110 receives the instruction from the user to view the out-of-vehicle three-dimensional virtual model and presents the out-of-vehicle three-dimensional virtual model to the user. In some other examples, when the user enables the vehicle control application on the mobile terminal 110 and selects to view the in-vehicle three-dimensional virtual model, the mobile terminal 110 receives the instruction from the user to view the in-vehicle three-dimensional virtual model and presents the in-vehicle three-dimensional virtual model to the user.

[0062] In some embodiments, based on the user's operations on the three-dimensional virtual model, the display angle of the three-dimensional virtual model can be adjusted or changed, so as to achieve querying or controlling the devices located at various positions of the vehicle. The user's operations may include, but are not limited to, rotation, sliding, zooming in, and zooming out.

[0063] For the interface examples of the mobile terminal 110 providing the user interface and presenting the out-of-vehicle three-dimensional virtual model and the in-vehicle three-dimensional virtual model, reference can be made to Figures 8A to 8C the interface 800a providing the user interface 820, the interface 800b presenting the out-of-vehicle three-dimensional virtual model 830, and the interface 800c presenting the in-vehicle three-dimensional virtual model 840 respectively shown. The user interface 820 may be a pop-up window that pops up on the display area 810 of the mobile terminal 110. The display form of the pop-up window is not limited to Figure 8A the form shown, but may have various shapes and may be located at any position of the display area 810. The user can customize the shape of the pop-up window and its display position in the display area. By clicking on the user interface 820, the user can enter the interface for displaying the vehicle three-dimensional virtual model, such as the interface 800b for displaying the out-of-vehicle three-dimensional virtual model 830 or the interface 800c for displaying the in-vehicle three-dimensional virtual model 840. At the interface 800b for presenting the out-of-vehicle three-dimensional virtual model 830 and the interface 800c for presenting the in-vehicle three-dimensional virtual model 840, the user can adjust the display angle of the three-dimensional virtual model through operations such as rotation, sliding, zooming in, and zooming out.

[0064] At step S220, determine the part selected by the user on the three-dimensional virtual model and determine the device corresponding to the selected part based on the mapping relationship between the three-dimensional virtual model and vehicle 120. The three-dimensional virtual model can be modeled based on the actual situation of vehicle 120, and it has a preset mapping relationship with vehicle 120. When the user makes a selection on the three-dimensional virtual model, the mobile terminal 110 can confirm the vehicle device actually corresponding to the part selected by the user based on the preset mapping relationship. The vehicle control method provided by the exemplary embodiment of the present application displays the vehicle by applying the three-dimensional virtual model, enabling the user to perform intuitive and convenient operations, effectively avoiding the user from selecting and switching between multiple menus or tabs, and providing the user with a fast and convenient vehicle device control experience.

[0065] In some embodiments, after the user makes a selection on the three-dimensional virtual model, the mobile terminal 110 can pop up a relevant window for the user to make further selections, such as selecting what specific control to perform on the device or requesting what specific information of the device.

[0066] At step S230, the mobile terminal 110 can communicate with vehicle 120 to obtain relevant information about the selected device or control the selected device. The mobile terminal 110 can communicate with vehicle 120 to send the user request to vehicle 120. After receiving the relevant request, vehicle 120 can feedback the relevant information requested by the user to the mobile terminal 110 or operate the corresponding device based on the user request. In some examples, vehicle 120 can feedback the operating state information of the corresponding device to the mobile terminal 110 after performing relevant operations for the user to present.

[0067] In some embodiments, when the mobile terminal 110 is within the predetermined distance range of vehicle 120, the mobile terminal 110 can directly communicate with vehicle 120 through near-field connection technology to obtain relevant information about the selected device or control the selected device. Alternatively, when the mobile terminal 110 is within the predetermined distance range of vehicle 120, the mobile terminal 110 can also connect to the cloud server 130 through the wireless network 140 to establish a communication link between the mobile terminal 110 and vehicle 120 through the cloud server 130, so as to obtain relevant information about the selected device or control the selected device via the communication link.

[0068] In some embodiments, when the mobile terminal 110 is outside the predetermined distance range of vehicle 120, the mobile terminal 110 can connect to the cloud server 130 through the wireless network 140 to establish a communication link between the mobile terminal 110 and vehicle 120 through the cloud server 130, so as to obtain relevant information about the selected device or control the selected device via the communication link.

[0069] By using the method for controlling a vehicle based on a mobile terminal provided according to an exemplary embodiment of the present application, a fast and convenient vehicle control experience can be provided for users. For example, when a user is at a relatively long distance from the vehicle (e.g., the distance from the vehicle exceeds the predetermined distance of the vehicle), the user can view the three-dimensional virtual models inside and outside the vehicle through the vehicle control application on the mobile terminal, and can, for example, click on the corresponding parts of the three-dimensional virtual models to understand the equipment conditions inside and outside the vehicle or control the equipment inside and outside the vehicle. When the user approaches the vehicle (e.g., the distance from the vehicle is less than the predetermined distance of the vehicle), the mobile terminal can provide a user interface for viewing the three-dimensional virtual model of the vehicle to the user, and the user can click on the corresponding parts of the three-dimensional virtual models to understand the conditions of the vehicle equipment or control the vehicle equipment. As an example, the user can click on the virtual tire to view the tire pressure of the vehicle, or click on the virtual charging port to view the battery power of the vehicle, etc. When the user is inside the vehicle, the user can control or view the information of the in-vehicle equipment by clicking on the virtual equipment on the three-dimensional virtual model. Especially when there is no corresponding button on the vehicle equipment, the information of the equipment can be quickly and conveniently viewed or the equipment can be controlled through this method.

[0070] To implement the query or control function of the mobile terminal for the equipment on a specific vehicle, it is necessary to pre-obtain the authentication of the specific vehicle for the mobile terminal. When authenticating the mobile terminal, the mobile terminal needs to be within the predetermined distance range of the specific vehicle. The mobile terminal communicates with the vehicle through wireless connection methods such as Bluetooth or UwB, or through a wired connection method such as USB to obtain the authentication of the vehicle. In this way, when the mobile terminal communicates with the specific vehicle again, the vehicle can determine whether to continue communicating with the mobile terminal by identifying whether the mobile terminal is an authenticated mobile terminal. If the vehicle identifies that the mobile terminal is an authenticated mobile terminal, it will authorize continued communication with the mobile terminal; otherwise, the vehicle will interrupt communication with the mobile terminal. It should be noted that the authentication of the vehicle for the mobile terminal can include multiple user levels, such as the owner level or the passenger level. According to different authentication levels, the permissions granted by the vehicle to the mobile terminal will be different, which will be specifically described below.

[0071] The following will be combined with Figure 4 Describe the vehicle control method according to an exemplary embodiment of the present application. Figure 4 FIG. shows a flowchart of a vehicle control method 400 according to an exemplary embodiment of the present application. The method 400 can be executed, for example, at the in-vehicle server of the vehicle 120 described in FIG. 1, or can also be, for example, at Figure 7Execute at the described electronic device 700. Hereinafter, the on-vehicle server of the vehicle 120 will be taken as an example for illustration. It should be understood that the method 400 may further include additional steps not shown and / or the steps shown may be omitted, and the scope of the present application is not limited in this regard.

[0072] At step S410, the vehicle 120 receives a query instruction or a control instruction from the user mobile terminal 110 via the cloud server 140. As described above, when the user is outside the predetermined distance range of the vehicle 120, the user can query or control the relevant devices of the vehicle 120 by actively enabling the vehicle control application on the mobile terminal 110. After the user enables the vehicle control application on the mobile terminal 110, the user can select to present an out-of-vehicle stereoscopic virtual model or an in-vehicle stereoscopic virtual model. The user mobile terminal 110 presents an in-vehicle or out-of-vehicle stereoscopic virtual model based on the user's selection. The user can query or control the vehicle devices by selecting or choosing the stereoscopic virtual model.

[0073] At step S420, the vehicle 120 determines the user level of the user mobile terminal 110.

[0074] As described above, the authentication of the vehicle to the mobile terminal may include multiple user levels, such as the owner level and the passenger level. It should be understood that the authentication of the vehicle to the mobile terminal is not limited to the owner level and the passenger level, and may also include other levels. For mobile terminals with different user levels, the permissions granted by the vehicle are different. For example, the vehicle may grant high-level permissions to the mobile terminal with the owner level, and grant general permissions to the mobile terminal with the passenger level. The high-level permissions may include, but are not limited to, allowing the mobile terminal to query or control the in-vehicle and out-of-vehicle devices through the vehicle control application outside the predetermined distance range of the vehicle, allowing the mobile terminal to query or control the in-vehicle and out-of-vehicle devices through the vehicle control application when outside the vehicle within the predetermined distance range of the vehicle, and allowing the mobile terminal to query or control the in-vehicle and out-of-vehicle devices through the vehicle control application when inside the vehicle within the predetermined distance range of the vehicle. The general permissions may include allowing the mobile terminal to query or control the in-vehicle devices through the vehicle control application when inside the vehicle within the predetermined distance range of the vehicle, but not allowing the mobile terminal to query or control the vehicle devices through the vehicle control application when outside the vehicle.

[0075] At step S430, in response to determining that the user level of the user mobile terminal 110 is the owner level, provide the relevant information obtained based on the query instruction to the user mobile terminal 110 or control the vehicle to perform corresponding operations according to the control instruction. Alternatively, at step S430, in response to determining that the user level of the user mobile terminal 110 is not the owner level, the vehicle 120 may interrupt the communication with the user mobile terminal 110.

[0076] The following will be described in conjunction with Figures 5 to 6D a vehicle control method according to an exemplary embodiment of the present application. Figures 5 to 6D Flowcharts of vehicle control methods 500, 500-1, 500-2, 500-3, and 500-4 according to exemplary embodiments of the present application are respectively shown. The methods 500, 500-1, 500-2, 500-3, and 500-4 can be executed, for example, at the in-vehicle server of the vehicle 120 described in FIG. 1, or can be executed, for example, at Figure 7 the electronic device 700 described. The following will be described by taking the in-vehicle server of the vehicle 120 as an example. It should be understood that the methods 500, 500-1, 500-2, 500-3, and 500-4 may also each include additional steps not shown and / or may omit the steps shown, and the scope of the present application is not limited in this regard.

[0077] At step S510, a user mobile terminal 110 within a predetermined distance range of the vehicle 120 is detected. The in-vehicle server mounted on the vehicle 120 can detect the user mobile terminal 110 within a predetermined distance range of the vehicle 120 based on, for example, near-field connection technology. For example, the connection state between the user mobile terminal 110 and the vehicle 120 is used to determine whether the user mobile terminal 110 is within a predetermined distance range of the vehicle 120. Exemplarily, the near-field connection technology may include at least one of Bluetooth connection technology, UWB connection technology, and Wi-Fi connection technology. Additionally, the in-vehicle server mounted on the vehicle 120 can also confirm whether the mobile terminal 110 is within a predetermined distance range of the vehicle 120 through GNSS high-precision positioning technology.

[0078] At step S520, the position of the detected user mobile terminal 110 relative to the vehicle 120 and the user level of the user mobile terminal 110 are determined. In an exemplary embodiment, the in-vehicle server mounted on the vehicle 120 can determine the position of the mobile terminal 110 relative to the vehicle 120 through positioning technologies such as GNSS high-precision positioning, Bluetooth, or UWB. For example, the mobile terminal 110 is outside the vehicle 120 or the mobile terminal 110 is inside the vehicle 120. For example, through the high-precision positioning of the vehicle 120 and the high-precision positioning of the mobile terminal 110, it is determined whether the mobile terminal 110 is inside or outside the vehicle 120 within a predetermined distance range. Additionally, the in-vehicle server can confirm the user level of the user mobile terminal 110 by obtaining the authentication information of the user mobile terminal 110.

[0079] At step S530, based on the determined location and the user level, it is determined whether to send a notification message to the user mobile terminal 110 so that the user mobile terminal 110 provides a user interface to the user. The in-vehicle server mounted on the vehicle 120 can determine whether to continue communicating with the user mobile terminal 110 based on the determined location information and the obtained user level information.

[0080] In some embodiments, step S530 can be specifically implemented as step S531, as Figure 6A shown. At step S531, in response to determining that the user mobile terminal 110 is outside the vehicle 120 and the user level of the user mobile terminal 110 is the owner level, a notification message is sent to the user mobile terminal 110 so that the user mobile terminal 110 provides a user interface for the user to enter an interface for displaying the out-of-vehicle three-dimensional virtual model (for example Figure 8A shown in 820 of ). The notification message can include notification information authorizing the user mobile terminal 110 to provide a user interface to the user. With the user's pre-authorization, the mobile terminal 110 can automatically pop up the user interface after receiving the notification message from the vehicle 120 for the user to select.

[0081] In some embodiments, the vehicle control method according to the exemplary embodiments of the present application may further include steps S540 and S550. At step S540, a query instruction or a control instruction input by the user after entering the interface for displaying the out-of-vehicle three-dimensional virtual model through the user interface is received. Specifically, after the user mobile terminal 110 provides a user interface to the user, the user can view the out-of-vehicle three-dimensional virtual model by clicking on the user interface and make a selection on the out-of-vehicle three-dimensional virtual model, that is, input a query instruction or a control instruction. The query instruction or control instruction input by the user can be fed back to the vehicle 120 through the communication link between the user mobile terminal 110 and the vehicle 120 so that the vehicle 120 receives the query instruction or control instruction. At step S550, the in-vehicle server mounted on the vehicle 120 provides relevant information obtained based on the query instruction or controls the vehicle 110 to perform corresponding operations according to the control instruction to the user mobile terminal 110.

[0082] In some embodiments, step S530 can be specifically implemented as step S532, as Figure 6B shown. In step S532, in response to determining that the user mobile terminal 110 is outside the vehicle 120 and the user level is not the owner level, the communication with the user mobile terminal 110 is interrupted. For security reasons, different permissions are granted to user mobile terminals with different user levels, so that users with non-owner levels cannot query relevant devices of the vehicle or control the vehicle outside the vehicle.

[0083] In some embodiments, step S530 may be specifically implemented as step S533, as Figure 6C shown. At step S533, in response to determining that the user mobile terminal 110 is inside the vehicle 120 and the user level of the user mobile terminal 110 is the owner level or the passenger level, a notification message is sent to the user mobile terminal 110, enabling the user mobile terminal 110 to provide a user interface for the user to enter an interface for displaying the in-vehicle stereoscopic virtual model (e.g., Figure 8A as shown in 820 of). The notification message may include notification information authorizing the user mobile terminal 110 to provide the user interface to the user. In the case of obtaining the user's pre-authorization, the mobile terminal 110 may automatically pop up the user interface after receiving the notification message from the vehicle 120 for the user to select.

[0084] In some embodiments, the vehicle control method according to the exemplary embodiments of the present application may further include steps S560 and S570. At step S560, a query instruction or a control instruction input by the user after entering the interface for displaying the in-vehicle stereoscopic virtual model through the user interface is received. Specifically, after the user mobile terminal 110 provides the user interface to the user, the user can view the in-vehicle stereoscopic virtual model by clicking on the user interface and make a selection on the in-vehicle stereoscopic virtual model, that is, input a query instruction or a control instruction. The query instruction or the control instruction input by the user may be fed back to the vehicle 120 through the communication link between the user mobile terminal 110 and the vehicle 120, so that the vehicle 120 receives the query instruction or the control instruction. At step S550, the in-vehicle server mounted on the vehicle 120 provides relevant information obtained based on the query instruction or controls the vehicle 110 to perform corresponding operations according to the control instruction to the user mobile terminal 110 based on the query instruction or the control instruction.

[0085] In some embodiments, the vehicle control method according to the exemplary embodiments of the present application may further include a step S534 parallel to step S533, as Figure 6D shown. After determining that the user mobile terminal 110 is inside the vehicle 120 and the user level of the user mobile terminal 110 is the owner level or the passenger level, the vehicle 120 may send a notification message to the user mobile terminal 110, enabling the user mobile terminal 110 to provide a user interface for the user to enter an interface for displaying the in-vehicle stereoscopic virtual model. At the same time, the vehicle 120 may provide an in-vehicle display user interface to the user through its own display device, as shown in step S534. It should be understood that in some cases, for example, when the user does not authorize the function of automatically popping up the vehicle control application on the mobile terminal 110, the control method according to the present application may provide only the in-vehicle display user interface to the user at the display device of the vehicle 120.

[0086] At step S580, in response to a user clicking on the in-vehicle display user interface, the display device of vehicle 120 can display a three-dimensional virtual model of the interior of the vehicle to the user. At step S590, based on a query instruction or a control instruction input by the user on the interface displaying the three-dimensional virtual model of the interior of the vehicle, vehicle 120 can provide feedback to the user of relevant information obtained based on the query instruction through the display device, or vehicle 120 can perform corresponding operations according to the control instruction. In the example, the query instruction or control instruction input by the user on the interface displaying the three-dimensional virtual model of the interior of the vehicle can be embodied as a selection or choosing operation performed by the user on the three-dimensional virtual model of the interior of the vehicle.

[0087] The vehicle control method according to an exemplary embodiment of the present application can grant a user mobile terminal inside the vehicle and with a user level of owner level or passenger level the permission to view in-vehicle device information or control in-vehicle devices by viewing a three-dimensional virtual model of the interior of the vehicle, thereby meeting the needs of the driver and passengers to query or control in-vehicle devices inside the vehicle. The vehicle control method according to an exemplary embodiment of the present application enables the passengers to view in-vehicle device information or control in-vehicle devices by clicking on virtual devices of the vehicle inside the vehicle through the mobile terminal, providing convenience for the passengers to control vehicle devices inside the vehicle.

[0088] The vehicle control method according to an exemplary embodiment of the present application does not require the user mobile terminal to have a UWB multi-antenna structure, thus not restricting the popularity of its application due to the need for the mobile terminal to have a UWB multi-antenna structure.

[0089] Figure 7 A block diagram schematically showing an electronic device (or computing device) 700 suitable for implementing exemplary embodiments of the present application is shown. Device 700 may be a device for implementing each of the methods described Figures 2 to 6C herein. As Figure 7 shown, device 700 includes a processor 701, which can execute various appropriate steps and processes according to computer program instructions stored in a read-only memory (ROM) 702 or computer program instructions loaded from a storage unit 708 into a random access memory (RAM) 703. In RAM 703, various programs and data required for the operation of device 700 can also be stored. Processor 701, ROM 702, and RAM 703 are connected to each other through a bus 704. An input / output (I / O) interface 705 is also connected to bus 704.

[0090] Multiple components in device 700 are connected to I / O interface 705, including: an input unit 706, such as a keyboard, a mouse, etc.; an output unit 707, such as various types of displays, speakers, etc.; a memory 708, such as a disk, an optical disc, etc.; and a communication unit 709, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 709 allows device 700 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0091] Processor 701 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 701 include but are not limited to a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 701 can execute the various methods and processes described above, such as executing method 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500-2, 500-3, 500-4. For example, in some embodiments, methods 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500-2, 500-3, 500-4 can be implemented as computer software programs, which are stored in a machine-readable medium, such as storage unit 708. In some embodiments, part or all of the computer program can be loaded and / or installed onto device 700 via ROM 702 and / or communication unit 709. When the computer program is loaded into RAM 703 and executed by processor 701, one or more steps of the methods 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500-2, 500-3, 500-4 described above can be executed. Alternatively, in other embodiments, processor 701 can be configured to execute one or more steps of methods 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500-2, 500-3, 500-4 in any other suitable manner (e.g., by means of firmware).

[0092] It should be further noted that this application may include methods, devices, systems, and / or computer program products. The computer program product may include a computer-readable storage medium having computer-readable program instructions thereon for performing various aspects of this application.

[0093] A computer-readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. A computer-readable storage medium can be, for example, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disc (DVD), a memory stick, a floppy disk, a mechanically encoded device such as a punch card or raised structures in grooves having instructions stored thereon, and any suitable combination of the foregoing. The computer-readable storage medium as used herein is not construed to be a transitory signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., an optical pulse through an optical fiber cable), or an electrical signal transmitted through a wire.

[0094] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to respective computing / processing devices, or can be downloaded to an external computer or an external storage device through a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include a copper transmission cable, an optical fiber transmission, a wireless transmission, a router, a firewall, a switch, a gateway computer, and / or an edge server. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing / processing device.

[0095] The computer program instructions for performing the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine - related instructions, microcode, firmware instructions, state - setting data, or source code or object code written in any combination of one or more programming languages, including object - oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as C or similar programming languages. The computer - readable program instructions may be executed entirely on the user's computer, partially on the user's computer, executed as a stand - alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider). In some embodiments, by using the state information of the computer - readable program instructions to customize an electronic circuit, such as a programmable logic circuit, a field - programmable gate array (FPGA), or a programmable logic array (PLA), the electronic circuit can execute the computer - readable program instructions to implement various aspects of this application.

[0096] Aspects of the present application are described herein with reference to the flowcharts and / or step diagrams of methods, apparatus (systems), and computer program products according to exemplary embodiments of the present application. It should be understood that each step of the flowchart and / or step diagram, as well as combinations of steps in the flowchart and / or step diagram, can be implemented by computer - readable program instructions.

[0097] These computer - readable program instructions can be provided to the processing unit of a processor, general - purpose computer, special - purpose computer, or other programmable data - processing apparatus in a voice interaction device, thereby producing a machine such that when these instructions are executed by the processing unit of the computer or other programmable data - processing apparatus, a device is produced that implements the functions / steps specified in one or more of the steps of the flowchart and / or step diagram. These computer - readable program instructions can also be stored in a computer - readable storage medium, and these instructions cause the computer, programmable data - processing apparatus, and / or other devices to work in a specific manner. Thus, the computer - readable medium storing the instructions includes a manufactured article that includes instructions for implementing various aspects of the functions / steps specified in one or more of the steps of the flowchart and / or step diagram.

[0098] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices, causing a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other devices to generate a computer-implemented process such that the instructions executed on the computer, other programmable data processing apparatus, or other devices implement the functions / steps specified in one or more of the steps of the flowchart and / or block diagram.

[0099] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of devices, methods, and computer program products according to various embodiments of the present application. In this regard, each step in the flowchart or block diagram may represent a module, a segment of code, or a portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions noted in the steps may occur in a different order than noted in the figures. For example, two consecutive steps may in fact be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each step in the block diagram and / or flowchart, and combinations of steps in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or by a combination of dedicated hardware and computer instructions.

[0100] The above description is only a preferred embodiment of the present application and an explanation of the technical principles applied. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by the specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the inventive concept. For example, the technical solutions formed by mutually replacing the above features with the (but not limited to) technical features having similar functions disclosed in the present application.

Claims

1. A method for controlling a vehicle based on a mobile terminal, characterized in that The method includes: Presenting a three-dimensional virtual model of the vehicle to the user on the mobile terminal, where the three-dimensional virtual model changes according to the relative position of the mobile terminal with respect to the vehicle; Determining the part selected by the user on the three-dimensional virtual model and determining the device corresponding to the selected part based on the mapping relationship between the three-dimensional virtual model and the vehicle; and Communicating with the vehicle to obtain relevant information about the device or control the device.

2. The method according to claim 1, wherein The three-dimensional virtual model presented by the mobile terminal to the user may include an external three-dimensional virtual model of the vehicle and an internal three-dimensional virtual model of the vehicle, and the three-dimensional virtual model changes accordingly with the state change of the mobile terminal from inside the vehicle to outside the vehicle or from outside the vehicle to inside the vehicle.

3. The method according to claim 2, wherein, Presenting the three-dimensional virtual model of the vehicle to the user on the mobile terminal includes: Determining that the mobile terminal is within a predetermined distance range of the vehicle and the mobile terminal is outside the vehicle, providing a user interface for the user to enter an interface for displaying the three-dimensional virtual model, and in response to the user clicking the user interface, presenting the external three-dimensional virtual model of the vehicle to the user; or Determining that the mobile terminal is within a predetermined distance range of the vehicle and the mobile terminal is inside the vehicle, providing a user interface for the user to enter an interface for displaying the three-dimensional virtual model, and in response to the user clicking the user interface, presenting the internal three-dimensional virtual model of the vehicle to the user.

4. The method according to claim 3, wherein the user interface includes a mini program or a microservice pop-up window.

5. The method according to claim 3, wherein, Presenting the three-dimensional virtual model of the vehicle to the user on the mobile terminal further includes: In response to determining that the mobile terminal moves from outside the vehicle to inside the vehicle, the three-dimensional virtual model presented to the user is switched from the external three-dimensional virtual model of the vehicle to the internal three-dimensional virtual model of the vehicle, or In response to determining that the mobile terminal moves from inside the vehicle to outside the vehicle, the three-dimensional virtual model presented to the user is switched from the internal three-dimensional virtual model of the vehicle to the external three-dimensional virtual model of the vehicle.

6. The method according to any one of claims 1-5, wherein, Communicating with the vehicle to obtain relevant information about the device or control the device includes: Communicating with the vehicle through near-field connection technology to obtain relevant information about the device or control the device.

7. The method according to claim 1, wherein, Presenting the three-dimensional virtual model of the vehicle to the user further includes: Receiving an instruction from the user and presenting the three-dimensional virtual model of the vehicle to the user according to the instruction.

8. The method according to claim 7, wherein Communicating with the vehicle to obtain relevant information about the device or control the device includes: Connecting to a cloud server through a wireless network to establish a communication link between the mobile terminal and the vehicle through the cloud server; and Obtaining relevant information about the device or controlling the device via the communication link.

9. The method according to claim 8, wherein The method includes: Receiving a query instruction or a control instruction from a user mobile terminal via the cloud server; Determining the user level of the user mobile terminal; and In response to determining that the user level of the user mobile terminal is the vehicle owner level, provide the relevant information obtained based on the query instruction to the user mobile terminal or control the vehicle to perform corresponding operations according to the control instruction.

10. A vehicle control method, characterized in that, The method includes: Detect a user mobile terminal within a predetermined distance range of the vehicle; Determine the position of the detected user mobile terminal relative to the vehicle; Based on the determined position, determine whether to send a notification message to the user mobile terminal, so that the mobile terminal presents a three-dimensional virtual model of the vehicle to the user, where the three-dimensional virtual model changes with the relative position of the mobile terminal relative to the vehicle.

11. The method according to claim 10, further comprising determining the user level of the user mobile terminal, and determining whether to send a notification message to the user mobile terminal based on the determined position and the user level.

12. The method according to claim 10, wherein, Detecting a user mobile terminal within a predetermined distance range of the vehicle includes: Detecting a user mobile terminal within a predetermined distance range of the vehicle based on near-field connection technology or GNSS high-precision positioning technology.

13. The method according to claim 11, wherein, Determining whether to send a notification message to the user mobile terminal based on the determined position and user level includes: In response to determining that the user mobile terminal is outside the vehicle and the user level is the vehicle owner level, send a notification message to the user mobile terminal, so that the user mobile terminal provides a user interface for the user to enter an interface for displaying the three-dimensional virtual model outside the vehicle.

14. The method according to claim 13, wherein, The method further includes: Receiving a query instruction or a control instruction input by the user after entering the interface for displaying the three-dimensional virtual model outside the vehicle through the user interface; and Based on the query instruction or the control instruction, provide the relevant information obtained based on the query instruction to the user mobile terminal, or control the vehicle to perform corresponding operations according to the control instruction.

15. The method according to claim 11, wherein, Determining whether to send a notification message to the user mobile terminal based on the determined position and user level includes: In response to determining that the user mobile terminal is outside the vehicle and the user level is not the vehicle owner level, interrupt communication with the user mobile terminal.

16. The method according to claim 11, wherein, Determining whether to send a notification message to the user mobile terminal based on the determined position and user level includes: In response to determining that the user mobile terminal is inside the vehicle and the user level is the vehicle owner level or the passenger level, send a notification message to the user mobile terminal, so that the user mobile terminal provides a user interface for the user to enter an interface for displaying the three-dimensional virtual model inside the vehicle.

17. The method according to claim 16, wherein The method further includes: Receiving a query instruction or a control instruction input by the user after entering the interface for displaying the three-dimensional virtual model inside the vehicle through the user interface, and Based on the query instruction or the control instruction, provide the relevant information obtained based on the query instruction to the user mobile terminal or control the vehicle to perform corresponding operations according to the control instruction.

18. The method according to claim 16, the method further includes: Providing an in-vehicle display user interface to the user through the display device of the vehicle; In response to the user clicking the in-vehicle display user interface, display a three-dimensional virtual model of the interior of the vehicle; and Based on the query instruction or control instruction input by the user on the interface displaying the three-dimensional virtual model of the interior of the vehicle, feedback relevant information obtained based on the query instruction to the user, or perform corresponding operations according to the control instruction.

19. An electronic device, comprising: At least one processor; And A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method according to any one of claims 1-9 or the method according to any one of claims 10-18.

20. A non-transitory computer-readable storage medium, having stored thereon machine-executable instructions, which when executed cause the machine to execute the method according to any one of claims 1-9 or the method according to any one of claims 10-18.

Images