Method for controlling vehicle equipment, electronic equipment and storage medium

Abstract

The present application provides a method, electronic device and storage medium for controlling vehicle equipment. The method for controlling vehicle equipment includes: obtaining direction information of a terminal and direction information of a vehicle based on the horizontal direction of the earth's magnetic field; obtaining relative position information between the terminal and the vehicle; determining the relative direction information between the terminal and the vehicle based on the direction information of the terminal and the direction information of the vehicle; determining the device pointed to by the terminal based on the relative position information and the relative direction information, as well as the position information of the device of the vehicle relative to the vehicle; and controlling the pointed device through the terminal; or displaying information of the pointed device on the terminal. The method for controlling vehicle equipment provided by the present application can improve the accuracy of the determined controlled object.

Description

Technical Field

[0001] The present application relates to the field of control technology, and more specifically, to a method for controlling vehicle equipment, an electronic device, and a storage medium. Background Art

[0002] The rapid development of smart cars has made the interaction between vehicles and people more and more diversified. People hope to enter the car and realize the command control or information interaction of the vehicle's equipment through natural voice recognition, or realize the command control or information interaction of the vehicle's equipment through terminals such as mobile phones.

[0003] However, in the process of realizing command control or information interaction of vehicle equipment through terminals such as mobile phones, the problem of inaccurate controlled objects often occurs. Summary of the invention

[0004] The present application provides a method for controlling vehicle equipment, an electronic device and a storage medium that can at least partially solve the above-mentioned problems existing in the prior art.

[0005] On the one hand, the present application provides a method for controlling vehicle equipment, including: obtaining direction information of a terminal and direction information of a vehicle based on the horizontal direction of the earth's magnetic field; obtaining relative position information between the terminal and the vehicle; determining the relative direction information between the terminal and the vehicle based on the direction information of the terminal and the direction information of the vehicle; determining the device to which the terminal is pointing based on the relative position information and the relative direction information, as well as the position information of the vehicle's equipment relative to the vehicle; and controlling the pointed device through the terminal; or, displaying information of the pointed device on the terminal.

[0006] In one embodiment of the present application, the step of determining the device to which the terminal is pointing includes: obtaining motion information of the terminal; in response to the motion information of the terminal meeting preset requirements, determining the device to which the terminal is pointing based on relative position information and relative direction information, as well as the position information of the vehicle's device relative to the vehicle.

[0007] In one embodiment of the present application, the movement information of the terminal includes a moving distance of the terminal relative to the vehicle, and the preset requirement includes: the moving distance is greater than a preset threshold.

[0008] In one embodiment of the present application, the step of controlling the pointed device through the terminal includes: displaying an interactive interface of the pointed device on the terminal; and controlling the pointed device through the interactive interface.

[0009] In one embodiment of the present application, the step of displaying the information of the pointed device on the terminal includes: displaying the interactive interface of the pointed device on the terminal; and displaying the information of the pointed device via the interactive interface.

[0010] In one embodiment of the present application, the step of displaying the interactive interface of the pointed device on the terminal includes: displaying the interactive interface of the pointed device on the terminal in the form of a floating window.

[0011] In one embodiment of the present application, the step of displaying the interactive interface of the pointed device on the terminal includes: in response to the number of the pointed devices being greater than 1, displaying the interactive interfaces of all the pointed devices on the terminal.

[0012] In one embodiment of the present application, the step of displaying the interactive interface of the pointed device on the terminal includes: in response to the number of pointed devices being greater than 1, selecting a device from the pointed devices and displaying the interactive interface of the selected device; and in response to a switching instruction, displaying the interactive interfaces of other devices among the pointed devices except the selected device on the terminal.

[0013] In one embodiment of the present application, the step of selecting a device from the pointed devices includes: determining the priority of each pointed device; and selecting the pointed device with the highest priority as the selected device.

[0014] In one embodiment of the present application, the step of displaying the interactive interface of the pointed device on the terminal includes: in response to the pointed device being an in-vehicle device, determining whether the terminal is located inside the vehicle based on relative position information; if it is determined that the terminal is located inside the vehicle, displaying the interactive interface of the pointed device on the terminal.

[0015] In one embodiment of the present application, the step of acquiring the direction information of the vehicle includes: acquiring the direction information of the vehicle at least through an angular velocity sensor and a magnetic sensor of the vehicle.

[0016] In one embodiment of the present application, the step of obtaining the direction information of the vehicle includes: obtaining the direction information of the vehicle through multiple positioning modules of the vehicle.

[0017] In one embodiment of the present application, the step of acquiring the direction information of the terminal includes: acquiring the direction information of the terminal at least through an angular velocity sensor of the terminal and a magnetic sensor of the terminal.

[0018] In one embodiment of the present application, the step of obtaining relative position information includes: obtaining relative position information through a positioning anchor point on the vehicle and a positioning module of the terminal that matches the positioning anchor point, wherein the positioning module includes an ultra-wideband UWB module or a Bluetooth module.

[0019] In one embodiment of the present application, the step of obtaining relative position information includes: obtaining the absolute position information of the terminal through the positioning anchor point of the parking lot and the positioning module of the terminal matching the positioning anchor point; obtaining the absolute position information of the vehicle through the positioning anchor point of the parking lot and the positioning module of the vehicle matching the positioning anchor point; determining the relative position information based on the absolute position information of the terminal and the absolute position information of the vehicle.

[0020] In one embodiment of the present application, the step of obtaining relative position information includes: obtaining the absolute position information of the terminal through the positioning module of the terminal; obtaining the absolute position information of the vehicle through the positioning module of the vehicle; and determining the relative position information based on the absolute position information of the terminal and the absolute position information of the vehicle.

[0021] On the other hand, the present application provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores processor-executable instructions, and the processor-executable instructions are executed by the at least one processor so that the at least one processor executes the method for controlling vehicle equipment as mentioned in the above embodiment.

[0022] On the other hand, the present application provides a computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, the method for controlling a vehicle device as mentioned in the above embodiment is implemented.

[0023] According to a method for controlling vehicle equipment, an electronic device, and a storage medium provided by an embodiment of the present application, the electronic device uses the horizontal direction of the earth's magnetic field as a reference, obtains relative direction information between the terminal and the vehicle based on the direction information of the terminal and the direction information of the vehicle, and determines the device pointed to by the terminal based on the relative direction information to control or interact with the vehicle equipment. Compared with determining the device pointed to by the terminal based only on the direction information of the terminal, the relative direction information takes into account the problem of the change in the direction of the vehicle itself, so that the device pointed to by the terminal is determined more accurately, and thus the control or information interaction of the vehicle equipment can be more accurately achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings, in which:

[0025] Figure 1 is a flow chart of a method for controlling a vehicle device according to an embodiment of the present application;

[0026] Figure 2 is a schematic diagram of the positions of a UWB module and a UWB positioning anchor point of a terminal according to an embodiment of the present application;

[0027] Figure 3 is a schematic diagram of a terminal movement process according to an embodiment of the present application;

[0028] Figure 4 is a schematic diagram of the relative positions of a terminal and a vehicle according to an embodiment of the present application;

[0029] Figure 5 is a schematic diagram of an interactive interface according to an embodiment of the present application;

[0030] Figure 6 is a schematic diagram of relative positions of a terminal and a vehicle according to another embodiment of the present application;

[0031] Figure 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

[0032] Figure 8 is a schematic structural diagram of an electronic device according to another embodiment of the present application. DETAILED DESCRIPTION

[0033] In order to better understand the present application, a more detailed description will be made of various aspects of the present application with reference to the accompanying drawings. It should be understood that these detailed descriptions are only descriptions of exemplary embodiments of the present application, and are not intended to limit the scope of the present application in any way. Throughout the specification, the same reference numerals refer to the same elements. The expression "and / or" includes any and all combinations of one or more of the associated listed items.

[0034] It should be understood that expressions such as "include", "including", "have", "contain" and / or "including" in this specification are open rather than closed expressions, which indicate the presence of the stated features, elements and / or components, but do not exclude the presence of one or more other features, elements, components and / or combinations thereof. In addition, when expressions such as "at least one of..." appear after a list of listed features, they modify the entire list of features rather than just the individual elements in the list. In addition, when describing embodiments of the present application, "may" is used to mean "one or more embodiments of the present application". And, the term "exemplary" is intended to refer to an example or illustration.

[0035] Unless otherwise specified, all words (including engineering terms and scientific and technological terms) used in this article have the same meaning as those commonly understood by ordinary technicians in the field to which this application belongs. It should also be understood that, unless clearly stated in this application, words defined in common dictionaries should be interpreted as having the same meaning as their meaning in the context of the relevant technology, and should not be interpreted in an idealized or overly formal sense.

[0036] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. In addition, unless explicitly limited or contradictory to the context, the specific steps included in the method described in the present application are not necessarily limited to the order described, but can be performed in any order or in parallel. The present application will be described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.

[0037] Figure 1 1 is a flow chart of a method for controlling a vehicle device according to an embodiment of the present application, wherein the method for controlling a vehicle device can be executed by an electronic device, and the electronic device can be, for example, a terminal itself, a server connected to the terminal in communication, etc. Figure 1 As shown, a method for controlling a vehicle device provided by the present application may include, for example:

[0038] S101, obtaining relative position information between the terminal and the vehicle.

[0039] S102, obtaining direction information of the terminal and the vehicle based on the horizontal direction of the earth's magnetic field.

[0040] S103, determining relative direction information between the terminal and the vehicle according to the direction information of the terminal and the direction information of the vehicle.

[0041] S104, determining the device to which the terminal is pointing based on the relative position information and the relative direction information, as well as the position information of the device of the vehicle relative to the vehicle.

[0042] S105, controlling the pointed device through the terminal; or displaying information of the pointed device on the terminal.

[0043] According to a method for controlling vehicle equipment provided by an embodiment of the present application, the electronic device uses the horizontal direction of the earth's magnetic field as a reference, obtains relative direction information between the terminal and the vehicle based on the direction information of the terminal and the direction information of the vehicle, and determines the device pointed to by the terminal based on the relative direction information to control or interact with the vehicle equipment. Compared with determining the device pointed to by the terminal based only on the direction information of the terminal, the relative direction information takes into account the problem of the change in the direction of the vehicle itself, so that the device pointed to by the terminal is determined more accurately, and thus the control or information interaction of the vehicle equipment can be more accurately achieved.

[0044] Step S101

[0045] In one embodiment of the present application, the electronic device acquires the relative position information between the terminal and the vehicle in the following ways, including but not limited to way 1, way 2 and way 3.

[0046] Method 1:

[0047] The electronic device obtains the relative position information between the terminal and the vehicle through the positioning anchor point on the vehicle and the positioning module of the terminal that matches the positioning anchor point. Specifically, if a positioning anchor point is installed on the vehicle, the electronic device can obtain the relative position information between the terminal and the vehicle through the positioning anchor point and the matching positioning module.

[0048] For example, the positioning module includes an ultra-wideband UWB module. The relative position information between the terminal and the vehicle is determined through the UWB module of the terminal and the UWB positioning anchor point on the vehicle. For example, when the terminal is equipped with one UWB module and the vehicle is equipped with four UWB positioning anchor points, the position diagram of the UWB module of the terminal and the UWB positioning anchor point is as follows: Figure 2 As shown. Based on the formula: distance = pulse flight time * speed of light / 2, the pulse flight time (TOF) between the UWB module 201 of the terminal and each UWB positioning anchor point 202 is used to measure the distance (r1, r2, r3 and r4) between each UWB positioning anchor point 202 and the UWB module 201. According to the distance between each UWB positioning anchor point and the UWB module, the relative position between the UWB module and the UWB positioning anchor point can be determined, that is, the relative position relationship between the terminal and the vehicle. Since the positioning accuracy of UWB can reach the centimeter level, it can provide electronic devices with higher-precision relative position information.

[0049] For another example, the positioning module includes a Bluetooth module. The relative position information between the terminal and the vehicle is determined through the Bluetooth module of the terminal and the Bluetooth positioning anchor point on the vehicle.

[0050] It should be understood that, without departing from the teachings of the present application, other modules may also be used as positioning modules to obtain relative position information between the terminal and the vehicle, and the present application does not impose any limitation on this.

[0051] Method 2:

[0052] The electronic device obtains the absolute position information of the terminal through the positioning module of the terminal; obtains the absolute position information of the vehicle through the positioning module of the vehicle; and determines the relative position information based on the absolute position information of the terminal and the absolute position information of the vehicle. The positioning module of the terminal may be, for example, a high-precision positioning module such as the global positioning system (GPS) and the global navigation satellite system (GNSS), and the positioning module of the vehicle may be, for example, a high-precision positioning module such as the GPS and the GNSS.

[0053] Method 3:

[0054] The electronic device obtains the absolute position information of the terminal through the positioning anchor point of the parking lot and the positioning module of the terminal that matches the positioning anchor point; obtains the absolute position information of the vehicle through the positioning anchor point of the parking lot and the positioning module of the vehicle that matches the positioning anchor point; determines the relative position information according to the absolute position information of the terminal and the absolute position information of the vehicle. Specifically, when the vehicle is parked in the parking lot, if the positioning anchor point is not installed on the vehicle, or the positioning anchor point is installed inside the vehicle and the terminal is located outside the vehicle, or the positioning anchor point is installed outside the vehicle and the terminal is located inside the vehicle, the electronic device can locate the terminal and the vehicle respectively through the positioning anchor point installed in the parking lot, and then calculate the relative position information between the terminal and the vehicle according to the absolute position information of the terminal and the absolute position information of the vehicle. Since the positioning anchor point is installed in the parking lot, the electronic device can obtain the relative position information between the terminal and the vehicle through the positioning anchor point of the parking lot when the signal of the high-precision positioning module such as the global positioning system of the terminal or the vehicle is not good.

[0055] For example, multiple UWB modules are installed in the parking lot as positioning anchor points. The terminal and the vehicle are each equipped with a UWB module. The terminal and the vehicle can communicate with multiple UWB modules in the parking lot through their own installed UWB modules, and use the pulse flight time between the UWB modules to calculate the absolute position information of the terminal and the absolute position information of the vehicle. Based on the absolute position information of the terminal and the absolute position information of the vehicle, the relative position information between the terminal and the vehicle can be obtained.

[0056] Step S102

[0057] In one embodiment of the present application, the step of the electronic device acquiring the direction information of the terminal may, for example, include: acquiring the direction information of the terminal at least through an angular velocity sensor of the terminal and a magnetic sensor of the terminal.

[0058] In one embodiment, the direction information of the terminal may include, for example, a horizontal offset angle of the terminal relative to the horizontal direction of the earth's magnetic field and a pitch angle of the terminal relative to the horizontal direction of the earth's magnetic field. The angular velocity sensor of the terminal may be used to measure information such as the moving angle and moving direction of the terminal, and the magnetic sensor of the terminal may be used to obtain the magnetic field direction around the terminal. Based on the data detected by the angular velocity sensor and the magnetic sensor, the direction information of the terminal may be inferred.

[0059] As an option, the electronic device can also obtain the direction information of the terminal through the acceleration sensor, angular velocity sensor and magnetic sensor of the terminal. Among them, the acceleration sensor of the terminal can be used to obtain information such as the movement acceleration, acceleration direction, velocity direction and movement distance of the terminal. The data detected by the acceleration sensor of the terminal is also used as a reference for calculating the direction information of the terminal, so that the calculation result is more accurate.

[0060] For example, Figure 3 As shown, during the user's operation of the terminal, the moving distance calculated by the acceleration sensor is d, the horizontal offset angle among the three-axis offset angles δ measured by the angular velocity sensor is θ, and the direction of the horizontal magnetic field of the earth is t. The electronic device can calculate the direction information of the terminal relative to the horizontal direction of the earth's magnetic field based on the above parameters.

[0061] It should be understood that without violating the teachings of this application, the direction information of the terminal may be obtained by other means, and this application does not limit this.

[0062] In one embodiment, the magnetic sensor of the terminal may, for example, include an electronic compass. The electronic compass of the terminal may, for example, be used to measure the strength and direction of the magnetic field around the terminal to locate the orientation of the terminal, such as the angle between the terminal and the four directions of southeast, northwest, and northeast, and its function is similar to that of a compass. Therefore, the electronic device may, for example, obtain the horizontal direction of the earth's magnetic field of the terminal through an electronic compass. It should be understood that other magnetic sensors may also be selected to detect the horizontal direction of the earth's magnetic field of the terminal, and this application does not limit this.

[0063] In one embodiment of the present application, the electronic device obtains the direction information of the vehicle in a manner including but not limited to manner 1 and manner 2.

[0064] Method 1:

[0065] The electronic device obtains the direction information of the vehicle at least through the angular velocity sensor and the magnetic sensor of the vehicle. Among them, the horizontal direction of the earth's magnetic field can be, for example, the horizontal direction of the earth's magnetic field, and the direction information of the vehicle can include, for example, the horizontal offset angle of the vehicle relative to the horizontal direction of the earth's magnetic field and the pitch angle of the vehicle relative to the horizontal direction of the earth's magnetic field. The angular velocity sensor of the vehicle can be used to measure information such as the moving angle and moving direction of the vehicle, and the magnetic sensor of the vehicle can be used to obtain the direction of the magnetic field around the vehicle. Based on the data detected by the angular velocity sensor and the magnetic sensor, the direction information of the vehicle can be inferred.

[0066] As an option, the electronic device can also obtain the direction information of the vehicle through the vehicle's acceleration sensor, angular velocity sensor and magnetic sensor. Among them, the vehicle's acceleration sensor can be used to obtain information such as the vehicle's moving acceleration, acceleration direction, speed direction and moving distance. The data detected by the vehicle's acceleration sensor is also used as a reference for calculating the vehicle's direction information, making the calculation result more accurate.

[0067] It should be understood that without violating the teachings of this application, the vehicle's direction information may be obtained by other means, and this application does not limit this.

[0068] In one embodiment, the magnetic sensor of the vehicle may include, for example, an electronic compass. The electronic compass of the vehicle may be used, for example, to measure the strength and direction of the magnetic field around the vehicle to locate the orientation of the vehicle, such as the angle between the vehicle and the four directions of east, south, west and north, and its function is similar to that of a compass. Therefore, the electronic device may obtain the horizontal direction of the earth's magnetic field of the vehicle, for example, through an electronic compass. It should be understood that other magnetic sensors may also be selected to detect the horizontal direction of the earth's magnetic field of the vehicle, and the present application does not limit this.

[0069] Method 2:

[0070] The electronic device can obtain the direction information of the vehicle through multiple positioning modules of the vehicle. Specifically, positioning modules are installed at different positions of the vehicle, and the vehicle can calculate the absolute direction information of the vehicle based on the position information detected by each positioning module. The direction information of the vehicle is calculated based on the absolute direction information of the vehicle and the horizontal direction information of the earth's magnetic field at the location of the vehicle.

[0071] It should be understood that in this embodiment, the horizontal direction of the earth's magnetic field is used as the reference direction, the direction information of the terminal includes the horizontal offset angle and pitch angle of the terminal relative to the horizontal direction of the earth's magnetic field, and the direction information of the vehicle includes the horizontal offset angle and pitch angle of the vehicle relative to the horizontal direction of the earth's magnetic field. Without departing from the teaching of this application, the horizontal south, horizontal east, horizontal west and other directions determined based on the horizontal direction of the earth's magnetic field can also be used as reference directions, the direction information of the terminal includes the horizontal offset angle and pitch angle of the terminal relative to the reference direction, and the direction information of the vehicle includes the horizontal offset angle and pitch angle of the vehicle relative to the reference direction. This application does not limit the reference direction.

[0072] Step S103

[0073] In one embodiment of the present application, considering that a terminal is equipped with a positioning module (see Figure 2 ), no matter how the terminal is oriented, the distance between its UWB module and each UWB positioning anchor point will not change, so it is impossible to obtain the relative direction information between the terminal and the vehicle based on the positioning module. In the implementation of the present application, the direction information of the terminal and the direction information of the vehicle are obtained with reference to the horizontal direction of the earth's magnetic field, and the relative direction information between the terminal and the vehicle is obtained.

[0074] In one embodiment, the direction information of the terminal includes the horizontal offset angle of the terminal relative to the horizontal direction of the geomagnetic field and the pitch angle of the terminal relative to the horizontal direction of the geomagnetic field, and the direction information of the vehicle may include, for example, the horizontal offset angle of the vehicle relative to the horizontal direction of the geomagnetic field and the pitch angle of the vehicle relative to the horizontal direction of the geomagnetic field. In step S103, according to the direction information of the terminal and the direction information of the vehicle, determining the relative direction information between the terminal and the vehicle may include, for example: calculating the horizontal offset angle of the terminal relative to the vehicle according to the horizontal offset angle of the terminal relative to the horizontal direction of the geomagnetic field and the horizontal offset angle of the vehicle relative to the horizontal direction of the geomagnetic field; calculating the pitch angle of the terminal relative to the vehicle according to the pitch angle of the terminal relative to the horizontal direction of the geomagnetic field and the pitch angle of the vehicle relative to the horizontal direction of the geomagnetic field. It is worth mentioning that in the implementation of the present application, a magnetic sensor is added to the vehicle to obtain the direction information of the vehicle, and the relative direction information between the terminal and the vehicle is calculated with reference to the horizontal direction of the geomagnetic field, so that the electronic device can obtain the relative direction information between the terminal and the vehicle when only one positioning module is installed in the terminal, and determine the device pointed to by the terminal, thereby improving its universality.

[0075] For example, if the horizontal offset angle of the terminal relative to the horizontal direction of the geomagnetic field is 25 degrees, and the horizontal offset angle of the vehicle relative to the horizontal direction of the geomagnetic field is 30 degrees, then the horizontal offset angle of the terminal relative to the vehicle is 5 degrees. The pitch angle of the terminal relative to the horizontal direction of the geomagnetic field is 5 degrees (i.e., 5 degrees upward), and the pitch angle of the vehicle relative to the horizontal direction of the geomagnetic field is -5 degrees (i.e., 5 degrees downward), the pitch angle of the terminal relative to the vehicle is 10 degrees.

[0076] Step S104

[0077] In one embodiment of the present application, the step of determining the device to which the terminal points includes: obtaining the motion information of the terminal; in response to the motion information of the terminal meeting the preset requirements, determining the device to which the terminal points based on the relative position information and the relative direction information, as well as the position information of the vehicle's equipment relative to the vehicle. Specifically, in order to reduce the problem that the electronic device erroneously triggers the execution of the method for controlling the vehicle equipment mentioned in the present application when the user has no need to control the vehicle's equipment, the electronic device monitors the motion information of the terminal, and when the motion information of the terminal indicates that it meets the preset requirements, triggers operations such as determining the device to which the terminal points. Setting trigger conditions for the electronic device to execute the method for controlling the vehicle equipment mentioned in the present application can reduce the situation of false triggering, thereby reducing the waste of computing resources and reducing the impact on the user's normal use of the terminal.

[0078] As an option, the motion information of the terminal includes the moving distance of the terminal relative to the vehicle, and the preset requirement includes: the moving distance is greater than a preset threshold. Specifically, when the user needs to control the device of the vehicle through the terminal, it is usually necessary to move the terminal. Therefore, the electronic device can determine whether the user intends to control the device of the vehicle based on the moving distance of the terminal relative to the vehicle.

[0079] It should be understood that other preset requirements may be set without departing from the teachings of this application to more accurately determine whether the user intends to control the vehicle's equipment, and this application does not limit this.

[0080] It should be understood that without departing from the teachings of this application, the vehicle's equipment may include, for example, the vehicle's air conditioner, tires, rear cover, charging port, and other types of equipment installed on the vehicle, and this application does not limit this.

[0081] Step S105

[0082] In one embodiment of the present application, the electronic device controls the pointed device through the terminal including but not limited to the following method 1 and method 2.

[0083] Method 1:

[0084] The electronic device displays the interactive interface of the pointed device on the terminal, and controls the pointed device via the interactive interface. Specifically, when the terminal points to a device of the vehicle, the terminal may pop up the interactive interface of the device on the screen, prompting the user to operate the corresponding device. Among them, the interactive interface of the device may, for example, include the control button and status display window of the device. Among them, the status display window can be used to display the information of the device. The information of the device may, for example, include the status information of the device. When the user triggers the control button, the terminal sends the operation instruction corresponding to the control button to the vehicle, so that the vehicle controls the pointed device to execute the operation instruction.

[0085] As an option, the electronic device can collect the user's operation behavior through the terminal. If the user's operation behavior indicates to close the interactive interface, the terminal is controlled to close the interactive interface. When the user no longer needs to control the device, the user can exit the control mode of the vehicle device by sliding the interactive interface or clicking the close button. When the user needs to control the device again, the user can continue to point the terminal at the device to enter the control mode of the device again.

[0086] Method 2:

[0087] The electronic device obtains information such as user operation gestures collected from the terminal, determines the operation instructions corresponding to the user operation gestures, and transmits the determined operation instructions to the vehicle. The vehicle controls the device pointed to to execute the determined operation instructions.

[0088] For example, if the device pointed to is an air conditioner, the user operation gesture collected by the terminal is swiping the screen to the right or moving the terminal to the right, and the operation instruction corresponding to the user operation gesture is to increase the temperature by 1 degree, then the electronic device sends the operation instruction of increasing the temperature by 1 degree to the vehicle, so that the vehicle increases the temperature of the air conditioner by 1 degree.

[0089] It should be understood that, without departing from the teachings of this application, the electronic device may also achieve the purpose of controlling the device pointed to by the terminal in other ways, and this application does not limit this.

[0090] In one embodiment of the present application, the electronic device may be, for example, a terminal, and the positioning modules of the terminal and the vehicle both include a UWB module, and a communication connection is established between the terminal and the vehicle via the UWB module so that the terminal can send an operation instruction to the vehicle. Since the communication mode of the UWB module is short-distance communication, the theft of the vehicle due to relay attacks can be reduced.

[0091] It should be understood that without departing from the teachings of this application, the operation instructions may be transmitted in other ways, and this application does not limit this.

[0092] In one embodiment of the present application, the step of displaying the information of the pointed device on the terminal may, for example, include: displaying the interactive interface of the pointed device on the terminal; and, displaying the information of the pointed device via the interactive interface. The information of the pointed device may include status information of the pointed device. For example, if the pointed device is a tire, the information of the pointed device may include tire pressure, etc. If the pointed device is an air conditioner, the information of the pointed device may include air conditioner operating mode and temperature, etc. If the pointed device is a charging port, the information of the pointed device may include the battery level of the vehicle, etc. They are not listed here one by one.

[0093] It should be understood that, without departing from the teaching of the present application, the information of the pointed device may be displayed in other ways, and the present application does not limit this.

[0094] In one embodiment of the present application, the electronic device can display the interactive interface of the pointed device on the terminal in the form of a floating window. Specifically, the terminal can display the interactive interface of the pointed device in a specified area of ​​its display screen in the form of a floating window. The user can choose whether to click on the interactive interface as needed to subsequently control the pointed device or view the information of the pointed device. Compared with directly displaying the interactive interface of the pointed device in the display area of ​​the terminal, the floating window occupies a smaller display area on the display screen, which can reduce the impact of the interactive interface displayed in the event of a false trigger on the user's current operation interface.

[0095] In one embodiment of the present application, taking into account the errors caused by the user operation process, the errors in the relative position information and the errors in the relative direction information, in the process of determining the device at which the terminal is pointing, the pointing line of the terminal is determined based on the relative position information and the relative direction information. The device at which the terminal is pointing can be determined in combination with the pointing line of the terminal, the position information of the vehicle's device relative to the vehicle and the error adjustment range.

[0096] In one embodiment, the area information pointed to by the terminal can be determined according to the error adjustment range and the intersection of the pointing line and the vehicle; the device in the area pointed to by the terminal can be determined according to the area information pointed to by the terminal and the position information of the device of the vehicle relative to the vehicle; the device in the area pointed to by the terminal is used as the device pointed to by the terminal. For example, the position point of the intersection of the pointing line and the vehicle is (10, 15, 17), and the error adjustment range can be, for example, ±10, then the area where the cube with (0, 5, 7), (20, 5, 7), (20, 25, 7), (0, 25, 7), (0, 5, 27), (20, 5, 27), (20, 25, 27), (0, 25, 27) as vertices is located is used as the area pointed to by the terminal, and the device located in the area is the pointed device.

[0097] In another embodiment, the extended area information of the device of the vehicle relative to the vehicle can be obtained according to the error adjustment range and the position information of the device of the vehicle relative to the vehicle; for each device, according to the extended area information of the device of the vehicle relative to the vehicle, it is determined whether the intersection of the pointing line and the vehicle is located in the extended area of ​​the device of the vehicle relative to the vehicle, and if it is determined to be, the device is used as the device pointed to by the terminal. For example, the position point of the intersection of the pointing line and the vehicle is (10, 15, 17), and the position information of a device relative to the vehicle is (20, 23, 25). The error adjustment range can be, for example, the area where the cube of (10, 13, 15), (30, 13, 15), (30, 33, 15), (10, 33, 15), (10, 13, 35), (30, 13, 35), (30, 33, 35), (10, 33, 55) is located. Since (10, 15, 17) is located in the area where the cube is located, the device belongs to the pointed device.

[0098] It should be understood that without departing from the teaching of the present application, the impact of the error may be reduced by other means, and the present application does not limit this.

[0099] In one embodiment of the present application, there may be a situation where multiple devices are stacked in the direction of the pointing line of the terminal relative to the vehicle, resulting in more than one pointed device, or, after taking into account error factors, more than one pointed device is determined. In this case, after determining the pointed device, methods of displaying the interactive interface of the pointed device on the terminal include but are not limited to method 1 and method 2.

[0100] Method 1:

[0101] In response to the number of the pointed devices being greater than 1, the electronic device displays the interaction interfaces of all the pointed devices on the terminal.

[0102] Method 2:

[0103] In response to the number of pointed devices being greater than 1, the electronic device selects a device from the pointed devices and displays an interactive interface of the selected device; in response to a switching instruction, the terminal displays the interactive interfaces of other devices among the pointed devices except the selected device.

[0104] For example, if the electronic device determines that the devices pointed to include an air conditioner and a stereo, the interactive interface of the air conditioner can be displayed on the terminal first. If the device that the user actually needs to operate is not the air conditioner, the switching command can be triggered by swiping the screen. After detecting the switching command, the electronic device closes the interactive interface of the air conditioner and displays the interactive interface of the stereo.

[0105] As an option, the step of selecting a device from the pointed devices may, for example, include: determining the priority of each pointed device; and selecting the pointed device with the highest priority as the selected device.

[0106] For example, if the electronic device determines that the devices it is pointing to include an air conditioner and a stereo, the priority of the air conditioner is 1 and the priority of the stereo is 2, then the interactive interface of the air conditioner can be displayed first on the terminal. If the device that the user actually needs to operate is not the air conditioner, the switching command can be triggered by swiping the screen. After detecting the switching command, the electronic device closes the interactive interface of the air conditioner and displays the interactive interface of the stereo.

[0107] It should be understood that, without departing from the teachings of the present application, the priority of each device can be determined based on the frequency of use of the device or the location information of the device relative to the vehicle, and the present application does not impose any limitations on this.

[0108] In one embodiment of the present application, the electronic device may be, for example, a terminal. During the interaction between the terminal and the vehicle, the terminal is first verified, and after determining that the terminal is an authorized user, the vehicle transmits data such as vehicle direction information to the terminal, responding to various operation instructions transmitted by the terminal.

[0109] In one embodiment of the present application, the step of displaying the interactive interface of the pointed device on the terminal may, for example, include: obtaining permission information of the terminal, wherein the permission information of the terminal indicates the permission level of the terminal determined based on the relative position information, or the permission information of the terminal indicates the permission level pre-set for the terminal; and in response to the permission information of the terminal meeting the permission requirements of the pointed device, displaying the interactive interface of the pointed device on the terminal.

[0110] For example, if the device being pointed to is the window on the driver's side, and its permission requirement is the first level, if the relative position information between the terminal and the vehicle indicates that the user of the terminal is in the driver's seat, and the permission level of the driver's seat is the first level, then the terminal can display the interactive interface of the window on the driver's side to control the window switch. If the relative position information between the terminal and the vehicle indicates that the user of the terminal is in the passenger seat, and the permission level of the passenger seat is the second level, then the terminal cannot display the interactive interface of the window on the driver's side, that is, it cannot obtain the control permission of the window on the driver's side.

[0111] It should be understood that without departing from the teachings of this application, the authority level of the terminal at different locations in the vehicle and the authority level requirements of each device in the vehicle can be set as needed, that is, the in-vehicle devices that can be controlled by the user at different locations in the vehicle can be set as needed, and this application does not impose any restrictions on this.

[0112] In one embodiment of the present application, in order to improve vehicle safety, the step of displaying the interactive interface of the pointed device on the terminal may include, for example: in response to the pointed device being an in-vehicle device, judging whether the terminal is located inside the vehicle according to the relative position information; if it is determined that the terminal is located inside the vehicle, displaying the interactive interface of the pointed device on the terminal. In other words, when the relative position information between the terminal and the vehicle shows that the terminal is located outside the vehicle, the terminal cannot operate the in-vehicle device.

[0113] It should be understood that without departing from the teachings of this application, in-vehicle equipment may include, for example, air conditioning, audio, windows, doors, etc., and external equipment may include, for example, tires, front covers, rear covers, etc. In-vehicle equipment and external equipment may be divided as needed, and this application does not impose any restrictions on this.

[0114] The following uses an electronic device as a terminal to illustrate how the electronic device controls vehicle equipment in two situations where the terminal is located inside the vehicle and outside the vehicle.

[0115] If the terminal is located in the vehicle, Figure 4As shown, the terminal 301 can interact with the UWB module of the terminal 302 through the UWB positioning anchor point 3021 inside the vehicle 302 to obtain the relative position information of the terminal 301 and the vehicle 302. If the UWB positioning anchor point 3021 is not set inside the vehicle 302, the absolute position information of the terminal 301 can also be determined through the high-precision positioning module of the terminal 301 itself, and the absolute position information of the vehicle 302 can be obtained to determine the relative position information. For details, please refer to the above description, which will not be repeated here. The terminal 301 obtains the direction information α1 of the terminal 301 relative to the horizontal direction of the earth's magnetic field through its own acceleration sensor, angular velocity sensor and magnetic sensor. The direction information β1 of the vehicle 302 relative to the horizontal direction of the earth's magnetic field determined by the vehicle 302 according to the acceleration sensor, angular velocity sensor and magnetic sensor of the vehicle 302 is obtained. According to the direction information α1 and the direction information β1, the relative direction information γ1 of the terminal 301 and the vehicle 302 is obtained. The device pointed to by the terminal 301, such as an air conditioner, can be determined based on the relative position information and the relative direction information. The terminal 301 pops up an interactive interface of the pointed device on the display screen, such as Figure 5 as shown, so as to control the pointed device or display information of the pointed device.

[0116] If the terminal is located outside the vehicle, Figure 6 As shown, the terminal 301 can interact with the UWB module of the terminal 302 through the UWB positioning anchor point 3021 outside the vehicle 302 to obtain the relative position information of the terminal 301 and the vehicle 302. If the UWB positioning anchor point 3021 is not set outside the vehicle 302, the absolute position information of the terminal 301 can also be determined through the high-precision positioning module of the terminal 301 itself or the UWB positioning anchor point installed in the parking lot, and the absolute position information of the vehicle 302 can be obtained (see the relevant description above) to determine the relative position information. For details, please refer to the above description, which will not be repeated here. The terminal 301 obtains the direction information α2 of the terminal 301 relative to the horizontal direction of the earth's magnetic field through its own acceleration sensor, angular velocity sensor and magnetic sensor. The direction information β2 of the vehicle 302 relative to the horizontal direction of the earth's magnetic field determined by the vehicle 302 according to the acceleration sensor, angular velocity sensor and magnetic sensor of the vehicle 302 is obtained. According to the direction information α2 and the direction information β2, the relative direction information γ2 of the terminal 301 and the vehicle 302 is obtained. The device pointed to by the terminal 301 can be determined based on the relative position information and the relative direction information, such as an air conditioner. The terminal 301 pops up an interactive interface of the pointed device on the display screen (see Figure 5 ) to control the device you are pointing at or to display information about the device you are pointing at.

[0117] The step division of the above methods is only for the purpose of clear description. When implemented, they can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent; adding insignificant modifications to the algorithm or process or introducing insignificant designs without changing the core design of the algorithm and process are all within the scope of protection of this patent.

[0118] The embodiment of the present application also provides an electronic device, such as Figure 7 As shown, the electronic device includes: at least one processor 401; and a memory 402 that is communicatively connected to the at least one processor 401; wherein the memory stores instructions that can be executed by the at least one processor 401, and the instructions are executed by the at least one processor 401 so that the at least one processor 401 can execute the method of controlling the vehicle equipment mentioned in the above embodiment. Wherein, the electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0119] In one embodiment of the present application, Figure 8 As shown, the electronic device may also include, for example: an I / O interface 403, an input unit 404, an output unit 405, a communication unit 406, a read-only memory (ROM) 407, and a random access memory (RAM) 408. Specifically, the processor 401 may perform various appropriate actions and processes according to a computer program stored in the ROM 407 or a computer program loaded from the memory 402 to the RAM 408. In the RAM 408, various programs and data required for the operation of the electronic device may also be stored. The processor 401, the ROM 407, and the RAM 408 are connected to each other via a bus 409. The I / O interface (input / output interface) 403 is also connected to the bus 408.

[0120] Multiple components in the electronic device are connected to the I / O interface 403, including: an input unit 404, such as a keyboard, a mouse, etc.; an output unit 405, such as various types of displays, speakers, etc.; a memory 402, such as a disk, an optical disk, etc.; and a communication unit 406, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 406 allows the electronic device to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0121] Processor 401 can be various general and / or special processing components with processing and computing capabilities. Some examples of processor 401 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. Processor 401 performs the various methods and processes described above, such as methods for controlling vehicle equipment. For example, in some embodiments, the method for controlling vehicle equipment can be implemented as a computer software program, which is tangibly contained in a computer-readable storage medium, such as memory 402. In some embodiments, part or all of the computer program can be loaded and / or installed on an electronic device via ROM 407 and / or communication unit 406. When the computer program is loaded into RAM 408 and executed by processor 401, one or more steps of the method for controlling vehicle equipment described above can be performed. Alternatively, in other embodiments, processor 401 can be configured to perform a method for controlling vehicle equipment in any other appropriate manner (e.g., by means of firmware).

[0122] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0123] The program code for implementing the method of the present application can be written in any combination of one or more programming languages. The above program code can be packaged into a computer program product. These program codes or computer program products can be provided to a processor or controller of a general-purpose computer, a special-purpose computer or other programmable data processing device, so that the program code, when executed by the processor 401, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code can be executed entirely on a computer, partially on a computer, partially on a computer as an independent software package and partially on a remote computer or completely on a remote computer or server.

[0124] The embodiment of the present application further provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the application program control method of the vehicle-mounted device mentioned in the above embodiment is implemented.

[0125] Computer readable storage medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. Computer readable storage medium can be a computer readable signal storage medium or a computer readable storage medium. Computer readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the above. More specific examples of computer readable storage mediums can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0126] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0127] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0128] The above description is only an implementation method of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of protection involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the technical concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in this application.

Claims

1. A method for controlling a vehicle device, comprising: Based on the horizontal direction of the earth's magnetic field, obtain the terminal's direction information and the vehicle's direction information; Acquiring relative position information between the terminal and the vehicle; Determining relative direction information between the terminal and the vehicle according to the direction information of the terminal and the direction information of the vehicle; Determine the device to which the terminal is pointing based on the relative position information and the relative direction information, and the position information of the device of the vehicle relative to the vehicle; and controlling the pointed device through the terminal; Alternatively, information of the pointed device is displayed on the terminal; The device for determining the direction to which the terminal is pointed comprises: Determine a direction line of the terminal according to the relative position information and the relative direction information; According to the error adjustment range and the intersection of the pointing line and the vehicle, determine the area information pointed to by the terminal, the area information being the area where the cube around the intersection is located; Determine, according to the area information and the location information, a device within the area pointed to by the terminal; The device is multiple.

2. The method according to claim 1, wherein: The step of determining the device pointed to by the terminal comprises: Acquiring movement information of the terminal; In response to the movement information of the terminal meeting a preset requirement, the device to which the terminal is pointing is determined according to the relative position information and the relative direction information, and the position information of the device of the vehicle relative to the vehicle.

3. The method according to claim 2, wherein: The movement information of the terminal includes a moving distance of the terminal relative to the vehicle, and the preset requirement includes: the moving distance is greater than a preset threshold.

4. The method according to claim 1, wherein: The step of controlling the pointed device by the terminal comprises: Displaying an interactive interface of the pointed device on the terminal; and The pointed device is controlled via the interactive interface.

5. The method according to claim 1, wherein: The step of displaying the information of the pointed device on the terminal comprises: Displaying an interactive interface of the pointed device on the terminal; and The information of the pointed device is displayed via the interactive interface.

6. The method according to claim 4 or 5, wherein: The step of displaying the interactive interface of the pointed device on the terminal includes: The interactive interface of the pointed device is displayed on the terminal in the form of a floating window.

7. The method according to claim 4 or 5, wherein: The step of displaying the interactive interface of the pointed device on the terminal includes: In response to the number of the pointed devices being greater than 1, selecting one device from the pointed devices and displaying an interactive interface of the selected device; and In response to the switching instruction, the terminal displays the interactive interfaces of other devices among the pointed devices except the selected device.

8. The method according to claim 7, wherein: The step of selecting a device from the pointed devices comprises: Determining the priority of each of the directed devices; and The pointed device with the highest priority is selected as the selected device.

9. The method according to claim 4 or 5, wherein: The step of displaying the interactive interface of the pointed device on the terminal includes: In response to the pointed device being an in-vehicle device, determining whether the terminal is located inside the vehicle according to the relative position information; If it is determined that the terminal is located inside the vehicle, an interactive interface of the pointed device is displayed on the terminal.

10. The method according to claim 4 or 5, wherein: The step of displaying the interactive interface of the pointed device on the terminal includes: Acquiring permission information of the terminal, wherein the permission information of the terminal indicates a permission level of the terminal determined based on the relative location information, or the permission information of the terminal indicates a permission level pre-set for the terminal; and In response to the permission information of the terminal meeting the permission requirement of the pointed device, an interactive interface of the pointed device is displayed on the terminal.

11. The method according to any one of claims 1 to 5, wherein: The step of obtaining the direction information of the vehicle comprises: The direction information of the vehicle is obtained at least through an angular velocity sensor and a magnetic sensor of the vehicle.

12. The method according to any one of claims 1 to 5, wherein: The step of obtaining the direction information of the vehicle comprises: The direction information of the vehicle is obtained through multiple positioning modules of the vehicle.

13. The method according to any one of claims 1 to 5, wherein: The step of obtaining the direction information of the terminal comprises: The direction information of the terminal is acquired at least through an angular velocity sensor of the terminal and a magnetic sensor of the terminal.

14. The method according to any one of claims 1 to 5, wherein: The step of obtaining the relative position information comprises: Obtaining the absolute position information of the terminal through the positioning anchor point of the parking lot and the positioning module of the terminal matching the positioning anchor point; Obtaining the absolute position information of the vehicle through the positioning anchor point of the parking lot and the positioning module of the vehicle matching the positioning anchor point; and The relative position information is determined according to the absolute position information of the terminal and the absolute position information of the vehicle.

15. An electronic device, in, include: at least one processor; as well as, A memory communicatively connected to the at least one processor; wherein the memory stores the processor-executable instructions, and the processor-executable instructions are executed by the at least one processor to enable the at least one processor to execute the method for controlling a vehicle device as described in any one of claims 1 to 14.

16. A computer-readable storage medium storing a computer program, wherein: When the computer program is executed by a processor, the method for controlling a vehicle device according to any one of claims 1 to 14 is implemented.

Images