Method, device and storage medium for controlling vehicle based on mobile terminal

Abstract

The present application discloses a method for controlling a vehicle based on a mobile terminal, an electronic device, and a computer-readable storage medium. The method for controlling a vehicle based on a mobile terminal includes: presenting a three-dimensional virtual model of the vehicle to a user on the mobile terminal; determining a part selected by the user on the three-dimensional virtual model and determining a device corresponding to the selected part based on a mapping relationship between the three-dimensional virtual model and the vehicle; and communicating with the vehicle to obtain relevant information of the device or controlling the device.

Description

Technical Field

[0001] The present application relates to the field of automobile technology, and in particular, to a method for controlling a vehicle based on a mobile terminal, an electronic device, and a computer-readable storage medium. Background Art

[0002] In the traditional solution of controlling vehicle-mounted devices, the driver or passengers need to manually operate the buttons on the vehicle-mounted devices to control the vehicle-mounted devices. However, with the continuous iteration and update of vehicle technology, the functions of vehicle-mounted devices are becoming increasingly diversified, which results in an increasing number of buttons for controlling vehicle-mounted devices to achieve different functions. Too many buttons on vehicle-mounted devices directly affect the convenience of drivers or passengers in operating vehicle-mounted devices.

[0003] With the rapid development of Internet of Vehicles technology, the ways of interaction between users and vehicles are becoming more and more diversified. Users hope to interact with vehicles in a more convenient way such as using mobile terminals to control the vehicle or exchange information. Summary of the invention

[0004] One purpose of the present application is to provide a method for controlling a vehicle based on a mobile terminal, an electronic device and a computer-readable storage medium, by presenting a three-dimensional virtual model of the vehicle to a user on a mobile terminal, so that the user can intuitively browse and select corresponding equipment on the vehicle based on the three-dimensional virtual model to obtain relevant information of the corresponding equipment or control the corresponding equipment, thereby enabling the user to conveniently operate the vehicle equipment.

[0005] Another object of the present application is to provide a vehicle control method, an electronic device and a computer-readable storage medium, which can provide, for example, a car owner with a convenient and fast vehicle equipment control experience by setting different user levels for the mobile terminal and allowing the mobile terminal with a user level of the car owner to remotely control the vehicle equipment or query the information of the vehicle equipment.

[0006] Another object of the present application is to provide a vehicle control method, an electronic device and a computer-readable storage medium, which can provide a convenient and fast vehicle equipment control experience for example, car owners and passengers by setting different user levels for mobile terminals and allowing mobile terminals of a specific level to control vehicle equipment at close range or query information of vehicle equipment.

[0007] According to a first aspect of the present application, a method for controlling a vehicle based on a mobile terminal is provided, the method comprising: presenting a three-dimensional virtual model of the vehicle to a user on the mobile terminal; determining a part selected by the user on the three-dimensional virtual model and determining a device corresponding to the selected part based on a mapping relationship between the three-dimensional virtual model and the vehicle; and communicating with the vehicle to obtain relevant information of the device or to control the device.

[0008] In some embodiments, presenting the stereoscopic virtual model of the vehicle to the user on the mobile terminal includes: determining that the mobile terminal is within a predetermined distance range of the vehicle and that the mobile terminal is outside the vehicle, providing the user with a user interface for entering an interface displaying the stereoscopic virtual model; and in response to the user clicking on the user interface, presenting the user with a stereoscopic virtual model of the outside of the vehicle.

[0009] In some embodiments, presenting the stereoscopic virtual model of the vehicle to the user at the mobile terminal also includes: in response to determining that the mobile terminal moves from the outside of the vehicle to the inside of the vehicle, the stereoscopic virtual model presented to the user is switched from the stereoscopic virtual model outside the vehicle to the stereoscopic virtual model inside the vehicle.

[0010] In some embodiments, presenting the stereoscopic virtual model of the vehicle to the user at the mobile terminal includes: determining that the mobile terminal is within a predetermined distance range of the vehicle and that the mobile terminal is inside the vehicle, providing the user with a user interface for entering an interface displaying the stereoscopic virtual model; and in response to the user clicking on the user interface, presenting the stereoscopic virtual model of the interior of the vehicle to the user.

[0011] In some embodiments, presenting the stereoscopic virtual model of the vehicle to the user at the mobile terminal also includes: in response to determining that the mobile terminal moves from the interior of the vehicle to the exterior of the vehicle, the stereoscopic virtual model presented to the user is switched from the stereoscopic virtual model inside the vehicle to the stereoscopic virtual model outside the vehicle.

[0012] In some embodiments, communicating with the vehicle to obtain relevant information of the device or controlling the device includes: communicating with the vehicle through near-field connection technology to obtain relevant information of the device or controlling the device, wherein the near-field connection technology includes at least one of Bluetooth connection technology, UWB connection technology and Wi-Fi connection technology.

[0013] In some embodiments, presenting the stereoscopic virtual model of the vehicle to the user includes: receiving an instruction from the user, and presenting the stereoscopic virtual model of the vehicle to the user according to the instruction, wherein the stereoscopic virtual model includes at least one of a stereoscopic virtual model outside the vehicle and a stereoscopic virtual model inside the vehicle.

[0014] In some embodiments, communicating with the vehicle to obtain relevant information of the device or controlling the device includes: connecting to a cloud server via a wireless network to establish a communication link between the mobile terminal and the vehicle through the cloud server; and obtaining relevant information of the device or controlling the device via the communication link.

[0015] In some embodiments, presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal also includes: adjusting or changing the display angle of the three-dimensional virtual model based on the user's operation on the three-dimensional virtual model, wherein the operation includes at least one of rotation, sliding, zooming in and out.

[0016] According to the second aspect of the present application, an electronic device is also provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method of the first aspect of the present application.

[0017] According to a third aspect of the present application, a non-transitory computer-readable storage medium is also provided, on which machine-executable instructions are stored. When the machine-executable instructions are executed, the machine executes the method of the first aspect of the present application.

[0018] According to the fourth aspect of the present application, a vehicle control method is also provided, which includes: receiving a query instruction or a control instruction from a user mobile terminal via a cloud server; determining the user level of the user mobile terminal; and in response to determining that the user level of the user mobile terminal is the car owner level, providing the user mobile terminal with relevant information obtained based on the query instruction or controlling the vehicle to perform corresponding operations according to the control instruction.

[0019] According to the fifth aspect of the present application, a vehicle control method is also provided, which includes: detecting a user mobile terminal within a predetermined distance range of the vehicle; determining the position of the detected user mobile terminal relative to the vehicle and the user level of the user mobile terminal; and based on the determined position and user level, determining whether to send a notification message to the user mobile terminal so that the user mobile terminal provides a user interface to the user.

[0020] In some embodiments, detecting a user mobile terminal within a predetermined distance range of the vehicle includes: detecting a user mobile terminal within a predetermined distance range of the vehicle based on near field connection technology or GNSS high-precision positioning technology, wherein the near field connection technology includes at least one of Bluetooth connection technology, UWB connection technology, and Wi-Fi connection technology.

[0021] In some embodiments, based on the determined location and user level, determining whether to send a notification message to the user mobile terminal so that the user mobile terminal provides a user interface to the user includes: in response to determining that the user mobile terminal is outside the vehicle and the user level is the owner level, sending a notification message to the user mobile terminal so that the user mobile terminal provides the user with a user interface for entering an interface displaying a three-dimensional virtual model outside the vehicle.

[0022] In some embodiments, the method also includes: receiving a query instruction or a control instruction input by the user after entering the interface displaying the three-dimensional virtual model outside the vehicle through the user interface; and based on the query instruction or the control instruction, providing the user mobile terminal with relevant information obtained based on the query instruction, or controlling the vehicle to perform corresponding operations according to the control instruction.

[0023] In some embodiments, based on the determined location and user level, determining whether to send a notification message to the user mobile terminal so that the user mobile terminal provides a user interface to the user includes: in response to determining that the user mobile terminal is outside the vehicle and the user level is not the owner level, interrupting communication with the user mobile terminal.

[0024] In some embodiments, based on the determined location and user level, determining whether to send a notification message to the user mobile terminal so that the user mobile terminal provides a user interface to the user includes: in response to determining that the user mobile terminal is located inside the vehicle and the user level is the owner level or the passenger level, sending a notification message to the user mobile terminal so that the user mobile terminal provides the user with a user interface for entering an interface displaying a three-dimensional virtual model of the interior of the vehicle.

[0025] In some embodiments, the method also includes: receiving a query instruction or a control instruction input by the user after entering the interface displaying the three-dimensional virtual model of the vehicle through the user interface, and based on the query instruction or the control instruction, providing the user mobile terminal with relevant information obtained based on the query instruction or controlling the vehicle to perform corresponding operations according to the control instruction.

[0026] In some embodiments, the method also includes: providing an in-vehicle display user interface to the user through a display device of the vehicle; displaying a three-dimensional virtual model of the interior of the vehicle in response to the user clicking on the in-vehicle display user interface; and based on a query instruction or a control instruction input by the user on the interface displaying the three-dimensional virtual model of the interior of the vehicle, feeding back to the user relevant information obtained based on the query instruction, or performing a corresponding operation according to the control instruction.

[0027] According to the sixth aspect of the present application, an electronic device is also provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method of the fourth aspect or the fifth aspect of the present application.

[0028] According to the seventh aspect of the present application, a non-volatile computer-readable storage medium is also provided, on which machine-executable instructions are stored, and when the machine-executable instructions are executed, the machine executes the method of the fourth aspect or the fifth aspect of the present application.

[0029] It should be understood that the content described in this section is not intended to identify the key features or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The above and other advantages of the embodiments of the present application will become apparent through the detailed description made with reference to the following drawings, which are intended to illustrate exemplary embodiments of the present application rather than to limit them. In the drawings:

[0031] Figure 1A and Figure 1B Schematically illustrate exemplary system architectures suitable for applying the method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application;

[0032] Figures 2 to 3D Schematically showing a flow chart of a method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application;

[0033] Figure 4 A flow chart schematically shows a vehicle control method according to an exemplary embodiment of the present application;

[0034] Figures 5 to 6D A flow chart schematically shows a vehicle control method according to an exemplary embodiment of the present application;

[0035] Figure 7A block diagram schematically shows an electronic device suitable for implementing the exemplary embodiments of the present application; and

[0036] FIG. 8A to FIG. 8C Interface diagrams of a mobile terminal according to exemplary embodiments of the present application are schematically shown respectively. DETAILED DESCRIPTION

[0037] In order to better understand the present application, various aspects of the present application will be described in more detail with reference to the accompanying drawings. It should be understood that these detailed descriptions are only descriptions of exemplary embodiments of the present application, and are not intended to limit the scope of the present application in any way. In addition, for greater clarity and brevity, descriptions of features well known in the art may be omitted.

[0038] Throughout the drawings and detailed description, the same reference numerals refer to the same elements. For purposes of clarity, illustration, and convenience, the drawings may not be drawn to scale, and the relative sizes, proportions, and depictions of elements in the drawings may be exaggerated.

[0039] It should also be understood that the terms "comprises", "including", "having", "includes" and / or "comprising", when used in this specification, indicate the presence of the stated features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or groups thereof. In addition, when expressions such as "at least one of..." appear after a list of listed features, they modify the entire listed features rather than modifying the individual elements in the list. In addition, when describing embodiments of the present application, "may" is used to mean "one or more embodiments of the present application". And, the term "exemplary" is intended to refer to an example or illustration.

[0040] Unless otherwise defined, all terms (including technical terms and scientific terms) used in this article have the same meaning as commonly understood by ordinary technicians in the field to which the present invention belongs. It should also be understood that terms (such as terms defined in commonly used dictionaries) should be interpreted as having the same meaning as their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined in this article.

[0041] The various aspects of the present application will be described in more detail below with reference to the accompanying drawings.

[0042] In some related technologies, there are examples of using smartphones to control different devices on the vehicle, for example, through mobile phone remote control or mobile phone "one-finger connection" technology to control different devices on the vehicle. Although the mobile phone remote control solution allows car owners to control some devices on the vehicle, it is limited by the non-intuitive operation interface, which makes it impossible for car owners to remotely control more devices on the vehicle. In addition, the remote control solution can only authorize the owner to control the vehicle, and passengers cannot control different devices on the vehicle or read information through related applications. The mobile phone "one-finger connection" technical solution can realize the positioning and directionality of the remotely controlled device by the mobile phone by using the mobile phone's own UWB multi-antenna positioning. However, this solution requires the mobile phone to have a special UWB multi-antenna structure, which greatly limits its standard application and popularity. In addition, the mobile phone "one-finger connection" technology can only be used in the near field range, which makes the usage scenario relatively limited.

[0043] In order to at least partially solve the above-mentioned problems and one or more of other potential problems, the exemplary embodiment of the present application proposes a solution for controlling a vehicle based on a mobile terminal. In this solution, by presenting a three-dimensional virtual model of the vehicle to the user on the mobile terminal, the user can intuitively browse and select the corresponding equipment on the vehicle based on the three-dimensional virtual model to obtain relevant information of the corresponding equipment or control the corresponding equipment, thereby enabling the user to conveniently operate the vehicle equipment. According to the solution for controlling a vehicle based on a mobile terminal provided in the exemplary embodiment of the present application, the driver and passengers can be provided with the ability to quickly and conveniently control vehicle equipment. Instead of using physical buttons on the vehicle or virtual buttons on the screen, the driver and passengers can directly select the vehicle equipment to be controlled on the three-dimensional virtual model of the vehicle presented on the mobile terminal to control the vehicle equipment or query relevant information of the vehicle equipment.

[0044] Figure 1A and Figure 1B Exemplary system architectures 100a and 100b are respectively shown, which are suitable for applying the method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application.

[0045] like Figure 1A and Figure 1B As shown, the system architecture may include a mobile terminal 110 and a vehicle 120. The mobile terminal 110 may include but is not limited to a smart phone, a smart watch, a portable computer, a personal digital assistant, etc. Various client applications may be installed on the mobile terminal 110, such as a vehicle control application, a news application, a web browser application, a search application, etc.

[0046] The mobile terminal 110 may communicate with the vehicle 120 via various wired or wireless communication links. The communication method between the mobile terminal 110 and the vehicle 120 may depend to some extent on the distance between the mobile terminal 110 and the vehicle 120.

[0047] In such Figure 1A In the scenario shown, when the distance between the mobile terminal 110 and the vehicle 120 exceeds the available distance of the near field connection technology, the mobile terminal 110 can communicate with the vehicle 120 via the wireless network 140. The wireless network 140 may include, but is not limited to, a 2G network, a 3G network, a 4G network, a 5G network, etc. In some examples, both the mobile terminal 110 and the vehicle 120 may be connected to the cloud server 130 via the wireless network 140, so that a communication link between the mobile terminal 110 and the vehicle 120 may be established through the cloud server 130.

[0048] The cloud server 130 may be a computing device that provides various services. The cloud server 130 may have one or more processing units, including dedicated processing units such as GPU, FPGA, and ASIC (Application Specific Integrated Circuit) and general processing units such as CPU. In some examples, the cloud server 130 may be implemented as a distributed server cluster consisting of multiple cloud servers 130, or may be implemented as a single cloud server 130.

[0049] In such Figure 1B In the scenario shown, when the distance between the mobile terminal 110 and the vehicle 120 does not exceed the available distance of the near-field connection technology, the mobile terminal 110 can communicate with the vehicle through the near-field connection technology. At this time, the mobile terminal 110 can directly interact with the vehicle server (for example, the vehicle-mounted T-BOX (Telematics BOX)) for data. Near-field connection technology may include wireless near-field connection technology such as Bluetooth connection technology, UWB (Ultra Wide Band) connection technology, and Wi-Fi connection technology, as well as wired near-field connection technology such as USB (Universal Serial Bus) connection technology, but the present application is not limited thereto.

[0050] It should be noted that when the distance between the mobile terminal 110 and the vehicle 120 is not greater than the available distance of the near field connection technology, the mobile terminal 110 can communicate with the vehicle 120 through the near field connection technology, and can also choose to communicate with the vehicle 120 through the wireless network 140. In some examples, when the distance between the mobile terminal 110 and the vehicle 120 is not greater than the available distance of the near field connection technology, the mobile terminal 110 can communicate with the vehicle 120 through the near field connection technology and the wireless network 140 at the same time.

[0051] In some examples, the available distance of the near-field connection technology may be, for example, 10 meters. When the distance between the mobile terminal 110 and the vehicle 120 exceeds 10 meters, the mobile terminal 110 communicates with the vehicle 120 via the cloud server 130 through the wireless network 140; and when the distance between the mobile terminal 110 and the vehicle 120 does not exceed 10 meters, the mobile terminal 110 may communicate with the vehicle 120 through the near-field connection technology and / or communicate with the vehicle 120 through the wireless network 140. It should be understood that the available distance of the near-field connection technology here is only exemplary. In actual applications, the available distance of the near-field connection technology depends on the effective distance of the near-field connection technology used. As an example, the available distance of the near-field connection technology may be, for example, 1 meter, 2 meters, 5 meters, 15 meters, 20 meters, 25 meters or 30 meters, etc.

[0052] It should be understood that Figure 1A and Figure 1B The number of mobile terminals 110, vehicles 120 and cloud servers 130 in the embodiment is only for illustration. According to actual needs, the system architecture may have any number of mobile terminals 110, vehicles 120 and cloud servers 130.

[0053] The following will be combined Figures 2 to 3D A method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application is described. Figures 2 to 3D Flowcharts of methods 200, 200-1, 200-2, 200-3 and 200-4 of controlling a vehicle based on a mobile terminal according to exemplary embodiments of the present application are shown respectively. Methods 200, 200-1, 200-2, 200-3 and 200-4 may be executed, for example, at the mobile terminal 110 described in FIG. 1 , or may be executed, for example, at the mobile terminal 110 described in FIG. Figure 7 The electronic device 700 is described as being executed. The mobile terminal 110 is used as an example for illustration. It should be understood that the methods 200, 200-1, 200-2, 200-3 and 200-4 may also include additional steps not shown and / or may omit the steps shown, and the scope of the present application is not limited in this respect.

[0054] In step S210 , a three-dimensional virtual model of the vehicle 120 is presented to the user at the mobile terminal 110 .

[0055] Depending on the distance between the mobile terminal 110 and the vehicle 120 and the relative positional relationship between the mobile terminal 110 and the vehicle 120, the specific implementation method of the mobile terminal 110 presenting the three-dimensional virtual model of the vehicle 120 to the user is different. Specifically, it can be divided into two situations: the mobile terminal 110 is within the predetermined distance range of the vehicle and the mobile terminal 110 is outside the predetermined distance range of the vehicle 120. Among them, the situation that the mobile terminal 110 is within the predetermined distance range of the vehicle 120 can be further refined into two situations: the mobile terminal 110 is outside the vehicle 120 and the mobile terminal 110 is inside the vehicle 120. The predetermined distance range of the vehicle may refer to the distance range that allows the use of the near field connection technology between the vehicle and the mobile terminal, that is, the effective distance range for establishing a near field connection with the vehicle as the center. Various implementation methods of the mobile terminal 110 presenting the three-dimensional virtual model of the vehicle 120 to the user will be described in detail below.

[0056] In some implementations, step S210 may specifically include steps S211 and S212. Figure 3A At step S211, when it is determined that the mobile terminal 110 is within the predetermined distance range of the vehicle 120 and the mobile terminal 110 is outside the vehicle 120, the mobile terminal 110 may provide the user with a user interface for entering an interface for displaying a stereoscopic virtual model of the vehicle 120 (see Fig. 8A As an example, the user interface may be a pop-up window of a small program or microservice, but the present application is not limited thereto. At step S212, in response to the user clicking on the user interface provided by the mobile terminal 110, the mobile terminal 110 may present a three-dimensional virtual model of the exterior of the vehicle 120 to the user (see Figure 8B ). The stereoscopic virtual model presented to the user by the mobile terminal 110 may change with the relative position of the mobile terminal 110 with respect to the vehicle 120, that is, when the mobile terminal 110 is outside the vehicle 120, it may present the user with a stereoscopic virtual model of the outside of the vehicle 110, and when the mobile terminal 110 is inside the vehicle 120, it may present the user with a stereoscopic virtual model of the inside of the vehicle 110. In some examples, step S210 may further include step S213, where, when it is determined that the mobile terminal 110 moves from the outside of the vehicle 120 to the inside of the vehicle 120, the stereoscopic virtual model presented to the user by the mobile terminal 110 is switched from the stereoscopic virtual model of the outside of the vehicle 120 to the stereoscopic virtual model of the inside of the vehicle 120.

[0057] In some implementations, step S210 may specifically include steps S214 and S215, such as Figure 3BAt step S214, when it is determined that the mobile terminal 110 is within the predetermined distance range of the vehicle 120 and the mobile terminal 110 is inside the vehicle 120, the mobile terminal 110 may provide the user with a user interface for entering an interface for displaying a stereoscopic virtual model of the vehicle 120 (see Fig. 8A ). In step S215, in response to the user clicking on the user interface provided by the mobile terminal 110, the mobile terminal 110 may present the user with a three-dimensional virtual model of the interior of the vehicle 120 (see Figure 8C In some examples, step S210 may further include step S216, where, when it is determined that the mobile terminal 110 moves from the interior of the vehicle 120 to the exterior of the vehicle 120, the stereoscopic virtual model presented to the user by the mobile terminal 110 is switched from the stereoscopic virtual model inside the vehicle 120 to the stereoscopic virtual model outside the vehicle 120.

[0058] It should be understood that the three-dimensional virtual model presented to the user by the mobile terminal 110 may include a three-dimensional virtual model outside the vehicle and a three-dimensional virtual model inside the vehicle, and may change accordingly as the state of the mobile terminal 110 changes from inside the vehicle to outside the vehicle or from outside the vehicle to inside the vehicle.

[0059] In an exemplary embodiment, whether the mobile terminal 110 is within a predetermined distance range of the vehicle 120 can be confirmed by whether the mobile terminal 110 establishes a connection with the vehicle 120 through a near-field connection technology. The near-field connection technology may include, for example, at least one of a Bluetooth connection technology, a UWB connection technology, and a Wi-Fi connection technology. In addition, whether the mobile terminal 110 is within a predetermined distance range of the vehicle 120 can also be confirmed by GNSS (Global Navigation Satellite System) high-precision positioning technology. Further, the position of the mobile terminal 110 relative to the vehicle 120 can be determined by GNSS high-precision positioning, Bluetooth, or UWB positioning technologies, for example, the mobile terminal 110 is outside the vehicle 120 or the mobile terminal 110 is inside the vehicle 120.

[0060] In some implementations, step S210 may be specifically implemented as step S217, such as Figure 3C At step S217, the mobile terminal 110 receives an instruction from the user and presents the three-dimensional virtual model of the vehicle 120 to the user according to the instruction (see Figure 8B and Figure 8C ). The user's instruction may include activating a vehicle control application on the mobile terminal 110 and selecting to present a three-dimensional virtual model outside the vehicle or a three-dimensional virtual model inside the vehicle.

[0061] like Figure 3DAs shown, step S217 may include sub-step S2171 or sub-step S2172. When the user is outside the predetermined distance range of the vehicle 120, the query or control of the relevant equipment of the vehicle 120 can be realized by actively enabling the vehicle control application on the mobile terminal 110. In some embodiments, the user enables the vehicle control application on the mobile terminal 110 and chooses to view the three-dimensional virtual model outside the vehicle. The mobile terminal 110 receives the instruction of the user to select to view the three-dimensional virtual model outside the vehicle and presents the three-dimensional virtual model outside the vehicle to the user. In other examples, the user enables the vehicle control application on the mobile terminal 110 and chooses to view the three-dimensional virtual model inside the vehicle. The mobile terminal 110 receives the instruction of the user to select to view the three-dimensional virtual model inside the vehicle and presents the three-dimensional virtual model inside the vehicle to the user.

[0062] In some embodiments, the display angle of the three-dimensional virtual model can be adjusted or changed based on the user's operation on the three-dimensional virtual model, so that the devices located at various positions of the vehicle can be queried or controlled. The user's operation may include but is not limited to rotation, sliding, zooming in and out.

[0063] For example, the mobile terminal 110 provides a user interface to the user and presents a three-dimensional virtual model outside the vehicle and a three-dimensional virtual model inside the vehicle, see FIG. 8A to FIG. 8C The interface 800a for providing the user with a user interface 820, the interface 800b for presenting a three-dimensional virtual model 830 outside the vehicle, and the interface 800c for presenting a three-dimensional virtual model 840 inside the vehicle are shown respectively. The user interface 820 may be a pop-up window that pops up on the display area 810 of the mobile terminal 110. The presentation form of the pop-up window is not limited to Fig. 8A , but may have various shapes and may be located at any position of the display area 810. The user may customize the shape of the pop-up window and its display position in the display area. The user may enter an interface for displaying a three-dimensional virtual model of the vehicle by clicking on the user interface 820, such as an interface 800b for displaying a three-dimensional virtual model 830 outside the vehicle or an interface 800c for displaying a three-dimensional virtual model 840 inside the vehicle. At the interface 800b for presenting the three-dimensional virtual model 830 outside the vehicle and the interface 800c for presenting the three-dimensional virtual model 840 inside the vehicle, the user may adjust the display angle of the three-dimensional virtual model by, for example, rotating, sliding, zooming in and out.

[0064] At step S220, the part selected by the user on the three-dimensional virtual model is determined and the equipment corresponding to the selected part is determined based on the mapping relationship between the three-dimensional virtual model and the vehicle 120. The three-dimensional virtual model can be modeled based on the actual situation of the vehicle 120, and it has a preset mapping relationship with the vehicle 120. When the user makes a selection on the three-dimensional virtual model, the mobile terminal 110 can confirm the vehicle equipment actually corresponding to the part selected by the user based on the preset mapping relationship. The vehicle control method provided in accordance with the exemplary embodiment of the present application displays the vehicle by applying a three-dimensional virtual model, so that the user can perform intuitive and convenient operations, which can effectively avoid the user from selecting and switching between multiple menus or tabs, and provide the user with a quick and convenient vehicle equipment control experience.

[0065] In some implementations, after the user makes a selection on the three-dimensional virtual model, the mobile terminal 110 may pop up a related window for the user to make further selections, such as selecting what specific control to perform on the device or requesting what specific information of the device to provide.

[0066] At step S230, the mobile terminal 110 may communicate with the vehicle 120 to obtain relevant information of the selected device or control the selected device. The mobile terminal 110 may communicate with the vehicle 120 to send the user request to the vehicle 120, and the vehicle 120 may feed back the relevant information requested by the user to the mobile terminal 110 or operate the corresponding device based on the user request after receiving the relevant request. In some examples, the vehicle 120 may feed back the operating status information of the corresponding device to the mobile terminal 110 after performing the relevant operation, so as to present it to the user.

[0067] In some embodiments, when the mobile terminal 110 is within a predetermined distance range of the vehicle 120, the mobile terminal 110 can directly communicate with the vehicle 120 through a near field connection technology to obtain relevant information of the selected device or control the selected device. Alternatively, when the mobile terminal 110 is within a predetermined distance range of the vehicle 120, the mobile terminal 110 can also connect to the cloud server 130 through the wireless network 140 to establish a communication link between the mobile terminal 110 and the vehicle 120 through the cloud server 130, thereby obtaining relevant information of the selected device or controlling the selected device via the communication link.

[0068] In some embodiments, when the mobile terminal 110 is outside a predetermined distance range of the vehicle 120, the mobile terminal 110 can be connected to the cloud server 130 via the wireless network 140 to establish a communication link between the mobile terminal 110 and the vehicle 120 through the cloud server 130, thereby obtaining relevant information of the selected device or controlling the selected device via the communication link.

[0069] By using the method for controlling a vehicle based on a mobile terminal provided according to an exemplary embodiment of the present application, a quick and convenient vehicle control experience can be provided to the user. For example, when the user is at a distance from the vehicle (for example, the distance from the vehicle exceeds the predetermined distance of the vehicle), the user can view the three-dimensional virtual model inside and outside the vehicle through the vehicle control application on the mobile terminal, and can, for example, click on the corresponding part of the three-dimensional virtual model to understand the equipment inside and outside the vehicle or control the equipment inside and outside the vehicle. When the user is close to the vehicle (for example, the distance from the vehicle is less than the predetermined distance of the vehicle), the mobile terminal can provide the user with a user interface for viewing the three-dimensional virtual model of the vehicle, and the user can click on the corresponding part of the three-dimensional virtual model to understand the situation of the vehicle equipment or control the vehicle equipment. As an example, the user can view the tire pressure of the vehicle by clicking on the virtual tire, or view the battery power of the vehicle by clicking on the virtual charging port, etc. When the user is inside the vehicle, the virtual device on the three-dimensional virtual model can be controlled or viewed by clicking on the virtual device to view the information of the in-vehicle device, especially when there is no corresponding button on the vehicle device, the device information can be quickly and quickly viewed or controlled by this method.

[0070] In order to realize the query or control function of the mobile terminal on the equipment on the specific vehicle, it is necessary to obtain the authentication of the specific vehicle for the mobile terminal in advance. When authenticating the mobile terminal, it is necessary to make the mobile terminal within the predetermined distance range of the specific vehicle, and the mobile terminal communicates with the vehicle through a wireless connection method such as Bluetooth or UWB or a wired connection method such as USB to obtain the authentication of the vehicle. In this way, when the mobile terminal communicates with the specific vehicle again, the vehicle can determine whether to continue communicating with the mobile terminal by identifying whether the mobile terminal is an authenticated mobile terminal. If the vehicle recognizes that the mobile terminal is an authenticated mobile terminal, it will authorize to continue communicating with the mobile terminal; otherwise, the vehicle will interrupt the communication with the mobile terminal. It should be noted that the authentication of the vehicle to the mobile terminal can include multiple user levels, such as the owner level or the passenger level. According to different authentication levels, the permissions granted by the vehicle to the mobile terminal will be different, which will be explained in detail below.

[0071] The following will be combined Figure 4 A vehicle control method according to an exemplary embodiment of the present application is described. Figure 4 FIG. 4 is a flow chart of a vehicle control method 400 according to an exemplary embodiment of the present application. The method 400 may be executed, for example, at an onboard server of the vehicle 120 described in FIG. 1 , or may be executed, for example, at a Figure 7The electronic device 700 is described as being executed. The following description is made by taking the vehicle-mounted server of the vehicle 120 as an example. It should be understood that the method 400 may also include additional steps not shown and / or may omit the steps shown, and the scope of the present application is not limited in this respect.

[0072] At step S410, the vehicle 120 receives a query instruction or a control instruction from the user's mobile terminal 110 via the cloud server 140. As described above, when the user is outside the predetermined distance range of the vehicle 120, the user can query or control the relevant equipment of the vehicle 120 by actively enabling the vehicle control application on the mobile terminal 110. After the user enables the vehicle control application on the mobile terminal 110, a three-dimensional virtual model outside the vehicle or a three-dimensional virtual model inside the vehicle can be selected to be presented. The user's mobile terminal 110 presents a three-dimensional virtual model inside or outside the vehicle based on the user's selection. The user can query or control the vehicle equipment by selecting or choosing the three-dimensional virtual model.

[0073] At step S420 , the vehicle 120 determines a user level of the user mobile terminal 110 .

[0074] As described above, the authentication of the vehicle to the mobile terminal may include multiple user levels, such as the owner level and the passenger level. It should be understood that the authentication of the vehicle to the mobile terminal is not limited to the owner level and the passenger level, and may also include other levels. The permissions granted by the vehicle are different for mobile terminals with different user levels. For example, the vehicle may grant advanced permissions to mobile terminals with owner levels, and grant general permissions to mobile terminals with passenger levels. Advanced permissions may include, but are not limited to, allowing the mobile terminal to query or control the internal and external devices of the vehicle through the vehicle control application outside the predetermined distance range of the vehicle, allowing the mobile terminal to query or control the internal and external devices of the vehicle through the vehicle control application when it is within the predetermined distance range of the vehicle and outside the vehicle, and allowing the mobile terminal to query or control the internal and external devices of the vehicle through the vehicle control application when it is within the predetermined distance range of the vehicle and inside the vehicle. General permissions may include allowing the mobile terminal to query or control the internal devices of the vehicle through the vehicle control application when it is within the predetermined distance range of the vehicle and inside the vehicle, but not allowing the mobile terminal to query or control the vehicle equipment through the vehicle control application when it is outside the vehicle.

[0075] At step S430, in response to determining that the user level of the user mobile terminal 110 is the vehicle owner level, the user mobile terminal 110 is provided with relevant information obtained based on the query instruction or the vehicle is controlled to perform a corresponding operation according to the control instruction. Alternatively, at step S430, in response to determining that the user level of the user mobile terminal 110 is not the vehicle owner level, the vehicle 120 may interrupt communication with the user mobile terminal 110.

[0076] The following will be combined Figures 5 to 6D A vehicle control method according to an exemplary embodiment of the present application is described. Figures 5 to 6D Flowcharts of vehicle control methods 500, 500-1, 500-2, 500-3 and 500-4 according to exemplary embodiments of the present application are shown respectively. Methods 500, 500-1, 500-2, 500-3 and 500-4 may be executed, for example, at an onboard server of the vehicle 120 described in FIG. 1 , or may be executed, for example, at a server on the vehicle 120 described in FIG. Figure 7 The electronic device 700 is described. The following is described by taking the vehicle-mounted server of the vehicle 120 as an example. It should be understood that the methods 500, 500-1, 500-2, 500-3 and 500-4 may also include additional steps not shown and / or may omit the steps shown, and the scope of the present application is not limited in this respect.

[0077] At step S510, the user mobile terminal 110 is detected within a predetermined distance range of the vehicle 120. The vehicle-mounted server carried by the vehicle 120 can detect the user mobile terminal 110 within the predetermined distance range of the vehicle 120 based on, for example, near-field connection technology. For example, whether the user mobile terminal 110 is within the predetermined distance range of the vehicle 120 is determined by the connection state between the user mobile terminal 110 and the vehicle 120. Exemplarily, the near-field connection technology may include at least one of Bluetooth connection technology, UWB connection technology, and Wi-Fi connection technology. In addition, the vehicle-mounted server carried by the vehicle 120 can also confirm whether the mobile terminal 110 is within the predetermined distance range of the vehicle 120 through GNSS high-precision positioning technology.

[0078] At step S520, the position of the detected user mobile terminal 110 relative to the vehicle 120 and the user level of the user mobile terminal 110 are determined. In an exemplary embodiment, the vehicle-mounted server mounted on the vehicle 120 can determine the position of the mobile terminal 110 relative to the vehicle 120 through positioning technologies such as GNSS high-precision positioning, Bluetooth or UWB, for example, the mobile terminal 110 is outside the vehicle 120 or the mobile terminal 110 is inside the vehicle 120. For example, through the high-precision positioning of the vehicle 120 and the high-precision positioning of the mobile terminal 110, it is determined whether the mobile terminal 110 is inside or outside the vehicle within a predetermined distance range of the vehicle 120. In addition, the vehicle-mounted server can confirm the user level of the user mobile terminal 110 by obtaining the authentication information of the user mobile terminal 110.

[0079] At step S530, based on the determined location and user level, it is determined whether to send a notification message to the user mobile terminal 110 so that the user mobile terminal 110 provides a user interface to the user. The vehicle server mounted on the vehicle 120 can determine whether to continue communicating with the user mobile terminal 110 based on the determined location information and the acquired user level information.

[0080] In some implementations, step S530 may be specifically implemented as step S531, such as Fig. 6A At step S531, in response to determining that the user mobile terminal 110 is outside the vehicle 120 and the user level of the user mobile terminal 110 is the vehicle owner level, a notification message is sent to the user mobile terminal 110, so that the user mobile terminal 110 provides the user with a user interface (e.g., Fig. 8A 820 in FIG. 8). The notification message may include notification information for authorizing the user mobile terminal 110 to provide the user with a user interface. In the case of obtaining user pre-authorization, the mobile terminal 110 may automatically pop up the user interface after receiving the notification message from the vehicle 120 for the user to select.

[0081] In some embodiments, the vehicle control method according to the exemplary embodiment of the present application may also include steps S540 and S550. At step S540, a query instruction or a control instruction input by a user after entering the interface displaying the three-dimensional virtual model outside the vehicle through a user interface is received. Specifically, after the user mobile terminal 110 provides the user with a user interface, the user can view the three-dimensional virtual model outside the vehicle by clicking on the user interface, and select on the three-dimensional virtual model outside the vehicle, that is, input a query instruction or a control instruction. The query instruction or the control instruction input by the user can be fed back to the vehicle 120 through the communication link between the user mobile terminal 110 and the vehicle 120, so that the vehicle 120 receives the query instruction or the control instruction. At step S550, the vehicle-mounted server carried on the vehicle 120 provides the user mobile terminal 110 with relevant information obtained based on the query instruction, or controls the vehicle 110 to perform corresponding operations according to the control instruction based on the query instruction or the control instruction.

[0082] In some implementations, step S530 may be specifically implemented as step S532, such as Figure 6B In step S532, in response to determining that the user mobile terminal 110 is outside the vehicle 120 and the user level is not the vehicle owner level, the communication with the user mobile terminal 110 is interrupted. For security reasons, different permissions are granted to user mobile terminals with different user levels, so that users with non-vehicle owner levels cannot query the relevant equipment of the vehicle or control the vehicle outside the vehicle.

[0083] In some implementations, step S530 may be specifically implemented as step S533, such as Figure 6C At step S533, in response to determining that the user mobile terminal 110 is inside the vehicle 120 and the user level of the user mobile terminal 110 is the vehicle owner level or the passenger level, a notification message is sent to the user mobile terminal 110, so that the user mobile terminal 110 provides the user with a user interface (e.g., Fig. 8A 820 in FIG. 8). The notification message may include notification information for authorizing the user mobile terminal 110 to provide the user with a user interface. In the case of obtaining user pre-authorization, the mobile terminal 110 may automatically pop up the user interface after receiving the notification message from the vehicle 120 for the user to select.

[0084] In some embodiments, the vehicle control method according to the exemplary embodiment of the present application may also include steps S560 and S570. At step S560, a query instruction or a control instruction input by a user after entering the interface displaying the three-dimensional virtual model in the vehicle through a user interface is received. Specifically, after the user mobile terminal 110 provides the user with a user interface, the user can view the three-dimensional virtual model in the vehicle by clicking on the user interface and select the three-dimensional virtual model in the vehicle, that is, input a query instruction or a control instruction. The query instruction or the control instruction input by the user can be fed back to the vehicle 120 through the communication link between the user mobile terminal 110 and the vehicle 120, so that the vehicle 120 receives the query instruction or the control instruction. At step S550, the vehicle-mounted server carried on the vehicle 120 provides the user mobile terminal 110 with relevant information obtained based on the query instruction based on the query instruction, or controls the vehicle 110 to perform corresponding operations according to the control instruction.

[0085] In some embodiments, the vehicle control method according to the exemplary embodiment of the present application may further include step S534 in parallel with step S533, such as Fig.6D As shown. After determining that the user mobile terminal 110 is inside the vehicle 120 and the user level of the user mobile terminal 110 is the owner level or the passenger level, the vehicle 120 can send a notification message to the user mobile terminal 110, so that the user mobile terminal 110 provides the user with a user interface for entering the interface displaying the three-dimensional virtual model inside the vehicle. At the same time, the vehicle 120 can provide the user with an in-vehicle display user interface through its own display device, as shown in step S534. It should be understood that in some cases, such as when the user does not authorize the function of the vehicle control application automatically popping up on the mobile terminal 110, the control method according to the present application can provide the user with an in-vehicle display user interface only at the display device of the vehicle 120.

[0086] At step S580, in response to the user clicking on the in-vehicle display user interface, the display device of the vehicle 120 may display the in-vehicle stereoscopic virtual model of the vehicle to the user. At step S590, based on the query instruction or control instruction input by the user on the interface displaying the in-vehicle stereoscopic virtual model, the vehicle 120 may feedback the relevant information obtained based on the query instruction to the user through the display device, or the vehicle 120 may perform a corresponding operation according to the control instruction. In the example, the query instruction or control instruction input by the user on the interface displaying the in-vehicle stereoscopic virtual model may be embodied as a selection or selection operation performed by the user on the in-vehicle stereoscopic virtual model.

[0087] According to the vehicle control method of the exemplary embodiment of the present application, the user mobile terminal which is in the vehicle and whose user level is the owner level or the passenger level can be granted the authority to view the in-vehicle device information or control the in-vehicle device by viewing the in-vehicle three-dimensional virtual model, thereby meeting the needs of the driver and passengers to query or control the in-vehicle device in the vehicle. According to the vehicle control method of the exemplary embodiment of the present application, the passengers can view the in-vehicle device information or control the in-vehicle device by clicking the vehicle virtual device through the mobile terminal in the vehicle, which provides convenience for the passengers to control the vehicle devices in the vehicle.

[0088] The vehicle control method according to the exemplary embodiment of the present application does not require the user's mobile terminal to have a UWB multi-antenna structure, so the popularity of its application is not restricted by requiring the mobile terminal to have a UWB multi-antenna structure.

[0089] Figure 7 The block diagram of an electronic device (or computing device) 700 suitable for implementing the exemplary embodiments of the present application is schematically shown. The device 700 may be a device for implementing the execution Figures 2 to 6C The apparatus for each method described in Figure 7 As shown, the device 700 includes a processor 701, which can perform various appropriate steps and processes according to computer program instructions stored in a read-only memory (ROM) 702 or computer program instructions loaded from a storage unit 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 can also be stored. The processor 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0090] A number of components in the device 700 are connected to the I / O interface 705, including: an input unit 706, such as a keyboard, a mouse, etc.; an output unit 707, such as various types of displays, speakers, etc.; a memory 708, such as a disk, an optical disk, etc.; and a communication unit 709, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 709 allows the device 700 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0091] Processor 701 can be various general and / or special processing components with processing and computing capabilities. Some examples of processor 701 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. Processor 701 can perform the various methods and processes described above, such as executing methods 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500-2, 500-3, 500-4. For example, in some embodiments, methods 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500-2, 500-3, 500-4 can be implemented as computer software programs, which are stored in machine-readable media, such as storage unit 708. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 700 via the ROM 702 and / or the communication unit 709. When the computer program is loaded into the RAM 703 and executed by the processor 701, one or more steps of the methods 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500-2, 500-3, 500-4 described above may be performed. Alternatively, in other embodiments, the processor 701 may be configured to perform one or more steps of the methods 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500-2, 500-3, 500-4 in any other appropriate manner (e.g., by means of firmware).

[0092] It should be further noted that the present application may include methods, devices, systems and / or computer program products. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for executing various aspects of the present application.

[0093] Computer readable storage medium can be a tangible device that can hold and store instructions used by an instruction execution device. Computer readable storage medium can be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (non-exhaustive list) of computer readable storage medium include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, for example, a punch card or a convex structure in a groove on which instructions are stored, and any suitable combination thereof. The computer readable storage medium used herein is not interpreted as a transient signal itself, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagated by a waveguide or other transmission medium (for example, a light pulse by an optical fiber cable), or an electrical signal transmitted by a wire.

[0094] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0095] The computer program instructions for performing the operation of the present application can be assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as C language or similar programming languages. Computer-readable program instructions can be executed completely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on the remote computer, or completely on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer by any type of network including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect to the Internet). In certain embodiments, by using the state information of computer-readable program instructions to customize electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs) or programmable logic arrays (PLAs), the electronic circuits can execute computer-readable program instructions, thereby realizing various aspects of the present application.

[0096] Various aspects of the present application are described herein with reference to the flow chart and / or step diagram of the method, device (system), and computer program product according to the exemplary embodiments of the present application. It should be understood that each step of the flow chart and / or step diagram and the combination of each step in the flow chart and / or step diagram can be implemented by computer-readable program instructions.

[0097] These computer-readable program instructions can be provided to a processor in a voice interaction device, a general-purpose computer, a special-purpose computer, or a processing unit of other programmable data processing devices, thereby producing a machine, so that when these instructions are executed by a processing unit of a computer or other programmable data processing device, a device that implements the functions / steps specified in one or more steps in a flowchart and / or a step diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions enable a computer, a programmable data processing device, and / or other devices to work in a specific manner, so that a computer-readable medium storing instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / steps specified in one or more steps in a flowchart and / or a step diagram.

[0098] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / steps specified in one or more steps in the flowchart and / or step diagram.

[0099] The flow chart and step diagram in the accompanying drawings show the possible architecture, function and operation of the equipment, method and computer program product according to multiple embodiments of the present application. In this regard, each step in the flow chart or step diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the steps can also occur in a sequence different from that marked in the accompanying drawings. For example, two consecutive steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each step in the step diagram and / or flow chart, and the combination of the steps in the step diagram and / or flow chart, can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0100] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the inventive concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other.

Claims

1. A method for controlling a vehicle based on a mobile terminal, characterized in that: The method comprises: Presenting a three-dimensional virtual model of the vehicle to a user at the mobile terminal, wherein the three-dimensional virtual model includes a three-dimensional virtual model outside the vehicle and a three-dimensional virtual model inside the vehicle; Determining a part selected by the user on the three-dimensional virtual model and determining a device corresponding to the selected part based on a mapping relationship between the three-dimensional virtual model and the vehicle; and communicating with the vehicle to obtain relevant information of the device or to control the device; Presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal includes: In response to determining that the mobile terminal moves from the outside of the vehicle to the inside of the vehicle, the stereoscopic virtual model presented to the user is switched from the stereoscopic virtual model outside the vehicle to the stereoscopic virtual model inside the vehicle; or, In response to determining that the mobile terminal moves from the interior of the vehicle to the exterior of the vehicle, the stereoscopic virtual model presented to the user is switched from the in-vehicle stereoscopic virtual model to an exterior stereoscopic virtual model of the vehicle.

2. The method according to claim 1, wherein: Presenting the three-dimensional virtual model of the vehicle to the user on the mobile terminal includes: Determining that the mobile terminal is within a predetermined distance range of the vehicle and that the mobile terminal is outside the vehicle, providing the user with a user interface for entering an interface displaying the stereoscopic virtual model; and In response to the user clicking on the user interface, a three-dimensional virtual model outside the vehicle is presented to the user.

3. The method according to claim 1, wherein: Presenting the three-dimensional virtual model of the vehicle to the user on the mobile terminal includes: Determining that the mobile terminal is within a predetermined distance range of the vehicle and that the mobile terminal is inside the vehicle, providing the user with a user interface for entering an interface displaying the three-dimensional virtual model; and In response to the user clicking on the user interface, a three-dimensional virtual model of the interior of the vehicle is presented to the user.

4. The method according to any one of claims 1 to 3, wherein: Communicating with the vehicle to obtain relevant information of the device or controlling the device includes: Communicate with the vehicle via near field connection technology to obtain relevant information of the device or control the device, wherein the near field connection technology includes at least one of Bluetooth connection technology, UWB connection technology and Wi-Fi connection technology.

5. The method according to claim 1, wherein: Presenting the three-dimensional virtual model of the vehicle to the user includes: An instruction from the user is received, and a three-dimensional virtual model of the vehicle is presented to the user according to the instruction.

6. The method according to claim 5, wherein: Communicating with the vehicle to obtain relevant information of the device or controlling the device includes: connecting to a cloud server via a wireless network to establish a communication link between the mobile terminal and the vehicle via the cloud server; and Relevant information of the device is obtained or the device is controlled via the communication link.

7. The method according to claim 1, wherein: Presenting the three-dimensional virtual model of the vehicle to the user on the mobile terminal also includes: Based on the user's operation on the stereoscopic virtual model, the display angle of the stereoscopic virtual model is adjusted or changed, wherein the operation includes at least one of rotation, sliding, zooming in and out.

8. An electronic device, comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 7.

9. A non-transitory computer-readable storage medium having machine-executable instructions stored thereon, wherein when the machine-executable instructions are executed, the machine is enabled to perform the method according to any one of claims 1 to 8.

Images