Vehicle equipment control method and system, medium and remote controller

Abstract

The invention discloses a vehicle equipment control method and system, a medium and a remote controller, and relates to the technical field of vehicle interaction, and the vehicle equipment control method comprises the steps that in response to pointing operation of the remote controller, the current orientation of the remote controller is determined, and a target operation area where the remote controller is located in a plurality of vehicle control operation areas contained in a vehicle is determined; according to the current orientation, determining a target device in a plurality of controllable devices included in the vehicle; judging whether the remote controller is controllable for the target equipment according to the target operation area; under the condition that the remote controller is controllable for the target equipment, controlling the remote controller to carry out equipment controllable feedback; and controlling the target equipment to respond to an equipment control instruction under the condition that the equipment control instruction sent by the remote controller is received. According to the invention, the control convenience of the vehicle equipment is improved, and the user experience is enhanced.

Description

Technical Field

[0001] The present application relates to the field of vehicle interaction technology, and in particular to a vehicle equipment control method, system and medium, and a remote controller. Background Art

[0002] With the rapid development of automobile technology, vehicles are gradually moving towards a new era of electrification, networking, intelligence and sharing. This transformation not only requires the vehicle power system to be efficient and environmentally friendly, but also greatly promotes the innovation of in-vehicle control systems.

[0003] Conventional vehicle equipment control methods mainly rely on mechanical operating elements such as physical levers and buttons, or touch screens integrated in the front of the cockpit. These methods meet basic driving and entertainment needs to a certain extent. However, a single physical button is often designed to perform a single function, which makes it incapable of dealing with the complex and diverse remote controls and functions in modern vehicles, limiting the user's comprehensive and flexible control over the vehicle. Although the touch screen provides a richer interactive interface, its fixed position (usually located in the front of the cockpit) limits the convenient access of rear passengers, seriously affecting the riding experience and the convenience of equipment control.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of this application is to provide a vehicle equipment control method, system, medium, and remote controller, aiming to improve the control convenience of vehicle equipment.

[0006] To achieve the above-mentioned purpose, an embodiment of the present application proposes a vehicle equipment control method, which is applied to a control terminal and includes:

[0007] In response to the pointing operation of the remote controller, determining the current orientation of the remote controller and determining a target operation zone where the remote controller is located among a plurality of vehicle control operation zones included in the vehicle;

[0008] Determine a target device among a plurality of controllable devices included in the vehicle according to the current orientation;

[0009] According to the target operation area, determining whether the remote controller can control the target device;

[0010] When the remote controller is controllable for the target device, controlling the remote controller to provide feedback that the device is controllable;

[0011] When receiving the device control instruction sent by the remote controller, the target device is controlled to respond to the device control instruction.

[0012] In one embodiment, the vehicle is provided with a plurality of ultra-wideband UWB anchor points, the remote controller is provided with at least one UWB antenna, and the step of determining a target operation zone where the remote controller is located among a plurality of vehicle control operation zones included in the vehicle comprises:

[0013] Based on the UWB anchor point, obtaining position information of the UWB antenna;

[0014] The target operation area is determined according to the position information.

[0015] In one embodiment, the vehicle control operation area corresponds to each cockpit area of ​​the vehicle, and a boundary operation area is provided between the vehicle control operation areas arranged side by side in the vehicle, and the step of determining the target operation area according to the position information includes:

[0016] When it is determined that the remote controller is in the boundary control area according to the position information, identifying a holding hand holding the remote controller;

[0017] A vehicle control operation area that is arranged side by side with the target interface control area and located on the opposite side of the corresponding direction of the holding hand is determined as the target operation area, wherein the target interface control area is the interface control area where the remote control is located.

[0018] In one embodiment, the step of identifying a holding hand with which the remote control is held comprises:

[0019] The hand whose corresponding direction is the same as the current direction is determined as the holding hand.

[0020] In one embodiment, the step of determining a target device among a plurality of controllable devices included in the vehicle according to the current orientation comprises:

[0021] Generate a heading ray towards the current heading direction;

[0022] Determine a target spatial projection surface that the directional ray passes through and is closest to the starting point of the directional ray, wherein each of the controllable devices corresponds to a spatial projection surface based on its spatial position in the vehicle;

[0023] The controllable device corresponding to the projection surface of the target space is determined as the target device.

[0024] In one embodiment, the step of determining whether the remote controller is controllable over the target device according to the target operation area includes:

[0025] Identifying the control authority level of the target operation area;

[0026] If the control authority level of the target operation area meets the authority control condition of the target device, determining that the remote controller can control the target device; or

[0027] When the control authority level of the target operation area does not satisfy the authority control condition of the target device, it is determined that the remote controller cannot control the target device.

[0028] In one embodiment, after the step of determining whether the remote controller is controllable for the target device according to the target operation area, the step further includes:

[0029] In a case where the remote controller is uncontrollable for the target device, the remote controller is controlled to provide feedback indicating that the device is uncontrollable.

[0030] In one embodiment, before the step of determining the current orientation of the remote controller in response to the pointing operation of the remote controller, the method further includes:

[0031] Dynamically acquiring motion state data of the remote controller;

[0032] When the motion state data is greater than a preset motion threshold, it is determined that the remote controller triggers a pointing operation.

[0033] In addition, to achieve the above-mentioned purpose, the embodiment of the present application further proposes a vehicle equipment control system, the vehicle equipment control system includes a remote controller and a control terminal, the remote controller is communicatively connected with the control terminal, and the vehicle equipment control system includes:

[0034] The remote controller is used for pointing operation, device controllable feedback, and the control terminal sends device control instructions;

[0035] The control terminal is used to determine the current orientation of the remote control in response to the pointing operation of the remote control, and determine the target operation area where the remote control is located among multiple vehicle control operation areas included in the vehicle; determine the target device among multiple controllable devices included in the vehicle according to the current orientation; judge whether the remote control is controllable for the target device according to the target operation area; control the remote control to provide controllable device feedback when the remote control is controllable for the target device; and control the target device to respond to the device control instruction when a device control instruction sent by the remote control is received.

[0036] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes a remote control, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, and the computer program is configured to implement the steps of the vehicle equipment control method as described above.

[0037] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the vehicle equipment control method described above are implemented.

[0038] One or more technical solutions proposed in the embodiments of the present application have at least the following technical effects: by responding to the pointing operation of the remote control, the current orientation of the remote control is determined, and the target operation area where the remote control is located in the multiple vehicle control operation areas contained in the vehicle is determined; then according to the current orientation, the target device is determined among the multiple controllable devices contained in the vehicle; then according to the target operation area, it is determined whether the remote control is controllable for the target device; then, when the remote control is controllable for the target device, the remote control is controlled to provide device controllable feedback; then, when the device control command sent by the remote control is received, the target device is controlled to respond to the device control command. The embodiments of the present application ensure that passengers at all positions in the vehicle can easily realize comprehensive control of the controllable devices inside the vehicle through the setting of the remote control, greatly improving the convenience of vehicle equipment control, accurately meeting the equipment use needs of passengers at different positions, and significantly enhancing the user's riding experience. Further, in the process of controlling vehicle equipment, the embodiments of the present application can accurately identify the cabin position of the remote control user according to the area where the remote control is located in the vehicle (i.e., the target operation area), and judge whether the remote control has the control authority over the target device matched to it. By limiting the device control permissions of remote controllers located in different vehicle control operation areas, the potential driving safety hazards caused by improper remote control operation are effectively avoided, ensuring that the user's device usage needs are fully met while also providing a solid guarantee for driving safety. Furthermore, when the remote controller can control the target device, the remote controller is controlled to provide feedback on the device controllability, giving the user timely and appropriate feedback, further improving the convenience of vehicle device control and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0041] Figure 1 A flow chart of the first embodiment of the vehicle equipment control method of the present application;

[0042] Figure 2 Scenario diagram for the vehicle equipment control method embodiment of the present application Figure 1 ;

[0043] Figure 3 Scenario diagram for the vehicle equipment control method embodiment of the present application Figure 2 ;

[0044] Figure 4 Scenario diagram for the vehicle equipment control method embodiment of the present application Figure 3 ;

[0045] Figure 5 Scenario diagram for the vehicle equipment control method embodiment of the present application Figure 4 ;

[0046] Figure 6 Scenario diagram for the vehicle equipment control method embodiment of the present application Figure 5 ;

[0047] Figure 7 This is a flow chart of a more complete embodiment of the present application;

[0048] Figure 8 Schematic diagram of the device structure of the hardware operating environment of the remote controller involved in the vehicle device control method in the embodiment of the present application.

[0049] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0050] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0051] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0052] In conventional technology, vehicle equipment control mainly relies on mechanical operating elements such as physical levers and buttons, or touch screens integrated in the front of the cockpit, which meet basic driving and entertainment needs to a certain extent. However, a single physical button is often designed to perform a single function, which makes it incapable of dealing with the complex and diverse remote controls and functions in modern vehicles, limiting the user's comprehensive and flexible control over the vehicle. Although the touch screen provides a richer interactive interface, its fixed position (usually located in the front of the cockpit) limits the convenient access of rear passengers, seriously affecting the riding experience and the convenience of equipment control.

[0053] The embodiment of the present application provides a solution. Through the setting of the remote control, it is ensured that passengers at all positions in the vehicle can easily realize comprehensive control of the controllable devices inside the vehicle, which greatly improves the convenience of vehicle equipment control, accurately meets the equipment use needs of passengers in different positions, and significantly enhances the user's riding experience. Further, in the process of controlling vehicle equipment, the embodiment of the present application can accurately identify the cockpit position of the remote control user according to the area where the remote control is located in the vehicle (i.e., the target operation area), and judge whether the remote control has the control authority of the target device matched to it. By restricting the device control authority of the remote control located in different vehicle control operation areas of the vehicle, the driving safety hazards that may be caused by improper operation of the remote control are effectively avoided, and while ensuring that the user's equipment use needs are fully met, it also provides a solid guarantee for driving safety. Further, when the remote control is controllable for the target device, the remote control is controlled to provide controllable feedback for the device, giving the user timely and appropriate feedback, further improving the convenience of vehicle equipment control and user experience.

[0054] Reference Figure 1 , Figure 1 This is a flow chart of the first embodiment of the vehicle equipment control method of the present application.

[0055] It should be noted that the execution subject of the vehicle equipment control method may be a remote control, which may be a separate newly added physical device, or a device that adds corresponding software and hardware modules to an existing electronic device (for example, a car key, a mobile phone, etc.). The execution subject of the vehicle equipment control method may also be a control terminal, which may be a local device, such as the vehicle's central control system, an electronic control unit (ECU, Electronic Control Unit), etc., or a mobile terminal such as a mobile phone or a notebook, or a local device installed on the vehicle. The execution subject of the vehicle equipment control method may also be a network device, which is not limited in this embodiment. For ease of description, the following description of each embodiment of the execution subject is omitted. The vehicle equipment control method includes:

[0056] Step S10, in response to the pointing operation of the remote controller, determining the current orientation of the remote controller, and determining the target operation area where the remote controller is located among a plurality of vehicle control operation areas included in the vehicle;

[0057] In a feasible embodiment, when a pointing operation of the remote controller is detected, in response to the operation, the current direction of the remote controller is identified, and the area where the remote controller is currently located (i.e., the target operation area) is determined from multiple vehicle control operation areas included in the vehicle; wherein the pointing operation may be an operation when the user holds the remote controller and points it at any device in the vehicle. By monitoring the pointing operation of the remote controller, the user's potential vehicle device control needs can be detected, so that corresponding feedback can be given in a timely manner to improve the user experience.

[0058] It should be understood that the embodiments of the present application are applicable to various types of vehicles, including but not limited to: fuel vehicles, new energy vehicles, passenger cars, commercial vehicles, etc.

[0059] In one feasible implementation, in response to the pointing operation of the remote controller, the current orientation of the remote controller is determined; if the target device determined according to the current orientation is an uncontrollable device, the remote controller is controlled to provide feedback indicating that the device is uncontrollable. The uncontrollable device may be a device in the vehicle that does not have a remote control function.

[0060] Step S20, determining a target device from a plurality of controllable devices included in the vehicle according to the current orientation;

[0061] In a feasible embodiment, the target device that the remote control is expected to control is determined from the controllable devices that the current direction is pointing to.

[0062] The controllable devices are various functional devices installed in the vehicle, such as air conditioning, audio and video entertainment system (multimedia), seats, trunk, sunroof, windows, etc., which are not limited in this embodiment.

[0063] Step S30, judging whether the remote controller can control the target device according to the target operation area;

[0064] In a feasible embodiment, each vehicle control operation area has its own device control authority, and the device control authority can be used to determine whether the remote control can control the target device.

[0065] Step S40, when the remote controller is controllable for the target device, controlling the remote controller to provide feedback that the device is controllable;

[0066] In a feasible embodiment, when the remote controller is controllable for the target device, the remote controller is controlled to provide feedback that the device is controllable.

[0067] Exemplarily, when the remote controller is controllable for the target device, a controllable feedback instruction is sent to the remote controller, so that the remote controller responds to the controllable feedback instruction and performs a controllable feedback operation corresponding to the controllable feedback instruction.

[0068] Exemplarily, the feedback of the remote controller may include: one or more of: vibration feedback, indicator light feedback, sound feedback and display feedback; or no feedback response may be performed as a feedback method.

[0069] In a feasible implementation manner, after the step of determining whether the remote controller can control the target device according to the target operation area in step S30, the method further includes:

[0070] Step A10: When the remote controller cannot control the target device, the remote controller is controlled to provide feedback indicating that the device cannot be controlled.

[0071] In a feasible embodiment, when the remote control is uncontrollable for the target device, it indicates that the user cannot control the device through the remote control at this time. It may be because the target operation area where the remote control and its user are located does not have the authority to control the target device, or it may be that the target device itself is not a remotely controllable device, and the control remote control provides feedback that the device is uncontrollable.

[0072] Exemplarily, when the remote control is uncontrollable for the target device, an uncontrollable feedback instruction is sent to the remote control, so that the remote control responds to the uncontrollable feedback instruction and performs an uncontrollable feedback operation corresponding to the uncontrollable feedback instruction.

[0073] For example, controllable feedback and uncontrollable feedback may be distinguished by short vibration and long vibration; or by indicator light feedback of different colors; or by different sounds.

[0074] Step S50: upon receiving a device control instruction sent by the remote controller, controlling the target device to respond to the device control instruction.

[0075] In a feasible embodiment, the user may issue a device control instruction by triggering a button on the remote controller; and then, upon receiving the device control instruction sent by the remote controller, the target device is controlled to respond to the device control instruction.

[0076] Exemplarily, the control of the target device may be stopped when the remote controller is pointed at a new target device, or enters a sleep state or a power-off state.

[0077] In one feasible implementation, the step of controlling the target device to respond to the device control instruction includes:

[0078] Step S51, obtaining a device function mapping relationship matching the target device, wherein the device function mapping relationship is a mapping relationship between a key signal triggered by a remote controller and a device function of a controllable device;

[0079] Exemplarily, the remote control of the present application is a "universal remote control" that sends device control commands to any controllable device in the vehicle. The remote control is provided with universal function buttons, and corresponding specific function buttons can also be set according to specific controllable devices.

[0080] Step S52, obtaining the target key signal in the device control instruction, and determining the target device function pointed to by the target key signal according to the device function mapping relationship, so as to control the target device to execute the target device function. The key signal is the key value sent after the key on the remote control is triggered.

[0081] Exemplarily, the device function is a function that can be performed by the controllable device of the vehicle. For example, when the target controllable device is an air conditioner, the target device function may be: increasing or decreasing the air conditioner temperature; when the target controllable device is a seat back, the target device function may be the adjustment of the seat back tilt angle, including increasing or decreasing the tilt angle, etc.

[0082] In this embodiment, through the setting of the remote control, it is ensured that passengers at all positions in the vehicle can easily realize comprehensive control of the controllable devices inside the vehicle, which greatly improves the convenience of vehicle equipment control, accurately meets the equipment use needs of passengers in different positions, and significantly enhances the user's riding experience. Further, in the process of controlling vehicle equipment, the embodiment of the present application can accurately identify the cockpit position of the remote control user according to the area where the remote control is located in the vehicle (i.e., the target operation area), and judge whether the remote control has the control authority of the target device matched to it. By restricting the device control authority of the remote control located in different vehicle control operation areas of the vehicle, the driving safety hazards that may be caused by improper operation of the remote control are effectively avoided, while ensuring that the user's equipment use needs are fully met, it also provides a solid guarantee for driving safety. Further, when the remote control is controllable for the target device, the remote control is controlled to provide controllable feedback for the device, giving the user timely and appropriate feedback, further improving the convenience of vehicle equipment control and user experience.

[0083] Based on the above first embodiment, a second embodiment of the vehicle equipment control method of the present application is proposed. In this embodiment, the vehicle is provided with multiple ultra-wideband UWB anchor points, and the remote controller is provided with at least one UWB antenna. Step S10, the step of determining the target operation area where the remote controller is located among the multiple vehicle control operation areas included in the vehicle includes:

[0084] Step S11, obtaining the position information of the UWB antenna based on the UWB anchor point;

[0085] In a feasible embodiment, a plurality of UWB (Ultra Wide Band) anchor points are provided in the vehicle associated with the remote controller, and at least one UWB antenna is provided in the remote controller for transmitting UWB signals. The UWB signal transmitted by the remote controller's UWB antenna can be dynamically acquired through each UWB anchor point on the vehicle, and the signal arrival time is recorded; then, according to the signal arrival time, the phase difference between the UWB signal reaching each UWB anchor point is determined; then, according to the position of each UWB anchor point in the vehicle and the phase difference, the incident angle of the UWB signal when it reaches each UWB anchor point is determined; according to the incident angle of the UWB signal when it reaches each UWB anchor point and the position of each UWB anchor point in the vehicle, the position information of the UWB antenna in the vehicle is determined to represent the position information of the remote controller.

[0086] Step S12: determining the target operation area according to the position information.

[0087] In a feasible embodiment, since the UWB antenna is disposed on the remote controller, the position information of the UWB antenna can represent the position information of the remote controller, thereby determining the target operation zone where the remote controller is located among multiple vehicle control operation zones.

[0088] For example, refer to Figure 2 , the vehicle includes multiple cockpit areas, and each cockpit area corresponds to a vehicle control operation area, including A1 to A5; the vehicle is also provided with 4 UWB anchor points, including P1 to P4, for receiving UWB signals; the remote controller 100 for vehicle equipment control is located in the vehicle, and is provided with a UWB antenna for transmitting UWB signals. Based on each UWB anchor point (P1 to P4), the position information of the UWB antenna can be obtained to represent the position information of the remote controller 100, thereby determining the target operation area (i.e. A2) where the remote controller 100 is located in the multiple vehicle control operation areas (A1 to A5) of the vehicle.

[0089] In this embodiment, by setting up the UWB anchor point in the vehicle and the UWB antenna in the remote control, accurate identification of the remote control position information is achieved, thereby determining the target operation area of ​​the remote control and its user, thereby improving the convenience and accuracy of vehicle equipment control.

[0090] In a feasible implementation manner, the vehicle control operation area corresponds to each cockpit area of ​​the vehicle, and a boundary control area is provided between the vehicle control operation areas arranged side by side in the vehicle. In step S12, the step of determining the target operation area according to the position information includes:

[0091] Step S121, when it is determined based on the position information that the remote control is in the boundary control area, identifying the holding hand of the remote control;

[0092] In a feasible embodiment, the vehicle control operation area corresponds to each cabin area of ​​the vehicle; for example, when the cabin area of ​​the vehicle includes: the main driving area, the co-pilot area, and the rear passenger area, the vehicle control operation area may include the corresponding main driving operation area, co-pilot operation area, and rear passenger operation area. Since the junction between the various cabin areas of the vehicle (for example, the central control armrest box or the vicinity of the geometric center in the vehicle) belongs to the position where users of the adjacent cabin areas may be located, when the remote control is at the junction, it may be difficult to accurately identify the area where the remote control user is located based on the position information of the remote control alone; and in order to further improve the recognition accuracy of the area where the remote control is located, that is, the area where the remote control user is located, a junction control area is set between the vehicle control operation areas arranged side by side in the vehicle. According to the position information, it is determined whether the remote control is in the junction control area; and then, when it is determined that the remote control is in the junction control area according to the position information, the holding hand of the remote control is identified, that is, whether the remote control user is holding the remote control with the right hand or the left hand.

[0093] Exemplarily, when the rear passenger area of ​​the vehicle can be further divided into: a first rear left passenger area, a first rear middle passenger area, and a first rear right passenger area, the vehicle control operation area can also be adaptively increased, including: a first rear left passenger operation area, a first rear middle passenger operation area, and a first rear right passenger operation area; that is, the vehicle control operation area can be set according to the actual cabin area division in the vehicle, and the embodiments of the present application are not limited to this.

[0094] For example, refer to Figure 3 The vehicle control operation area includes: the main driver operation area A11, the co-driver operation area A12 and the rear passenger operation area A13, and then the interface control area B1 can be set between the vehicle control operation areas (i.e. A11 and A12) arranged side by side in the vehicle, and the interface control area B1 does not overlap with the main driver operation area A11 and the co-driver operation area A12. It should be understood that if the rear passenger operation area A13 is further divided according to the direction, the interface control area can also be set between each adjacent rear passenger operation area.

[0095] For example, refer to Figure 4 The vehicle control operation area includes: the main driver operation area A21, the co-driver operation area A22 and the rear passenger operation area A23, and then a junction control area B1 can be set between the vehicle control operation areas (i.e. A21 and A22) arranged side by side in the vehicle, and the junction control area B1 partially overlaps with the main driver operation area A21 and the co-driver operation area A22.

[0096] In one feasible implementation, sensors may be provided on the left and right sides of the remote control, respectively, and then the blocked surface of the remote control is determined based on the signals collected by the sensors; and then the holding hand of the remote control is determined based on the blocked surface, wherein the direction of the holding hand is the same as the direction of the blocked surface. When the user holds the remote control, whether using the right hand or the left hand, one side of the remote control is usually blocked due to the natural position of the palm and fingers. Specifically, when the user holds the remote control with the right hand, the palm and fingers of the right hand will naturally cover the right side of the remote control, so the right part of the remote control (from the user's perspective) is usually blocked. Correspondingly, when the user holds the remote control with the left hand, the palm and fingers of the left hand will cover the left side of the remote control, causing the left part of the remote control to be blocked.

[0097] Exemplarily, when the blocked surface of the remote control is the right side, the holding hand is determined to be the right hand; when the blocked surface of the remote control is the left side, the holding hand is determined to be the left hand.

[0098] In one feasible implementation, step S121, the step of identifying the holding hand of the remote control includes:

[0099] Step B10, determining the hand whose corresponding direction is the same as the current direction as the holding hand.

[0100] In a feasible embodiment, the corresponding direction of the right hand is the right, and the corresponding direction of the left hand is the left; then when the current direction is the right, the holding hand is determined to be the right hand; when the current direction is the left, the holding hand is determined to be the left hand.

[0101] Exemplarily, the spatial pointing angle of the remote control relative to the front direction of the vehicle can be determined based on the current orientation of the remote control, and then when the spatial pointing angle is within a preset first angle range, the right direction is determined; when the spatial pointing angle is within a preset second angle range, the current orientation is determined to be the left, wherein the minimum value of the first angle range is greater than or equal to 0°, and the maximum value is less than 180°, and the minimum value of the second angle range is greater than or equal to 180°, and the maximum value is less than 360°.

[0102] For example, refer to Figure 5 , the spatial pointing angle α=35° of the remote controller relative to the front direction of the vehicle can be determined according to the current orientation of the remote controller 100; when the first angle range is [0°, 180°) and the second angle range is [180°, 360°), the spatial pointing angle α=35° belongs to the first angle range, so it is determined that the current orientation of the remote controller is to the right, that is, the holding hand is the right hand.

[0103] In one feasible implementation, the step of identifying the holding hand of the remote control includes: determining the spatial pointing angle of the remote control relative to the front direction of the vehicle according to the current orientation, and determining that the holding hand is the right hand when the spatial pointing angle is within a preset first angle range and the front direction of the vehicle is the front side; determining that the holding hand is the left hand when the spatial pointing angle is within a preset second angle range and the front direction of the vehicle is the front side, wherein the first angle range is [30°, 90°] and the second angle range is [270°, 330°]. When the spatial pointing angle is within a preset third angle range, the front direction of the vehicle is the front side, and the target interface control area is located in the rear row of the vehicle, determining that the target operation area is the middle area of ​​the rear row of the vehicle, wherein the third angle range is (270°, 30°).

[0104] Step S122, determining the vehicle control operation area which is arranged side by side with the target boundary control area and located on the opposite side of the corresponding direction of the holding hand as the target operation area, wherein the target boundary control area is the boundary control area where the remote controller is located.

[0105] In a feasible embodiment, according to hand-holding habits and the spatial layout of the vehicle interior, from the front of the vehicle, if the user of the remote control is holding the remote control with the right hand, the user is usually located on the left side of the remote control (i.e., the left cockpit area); correspondingly, if the user of the remote control is holding the remote control with the left hand, the user is usually located on the right side of the remote control (i.e., the right cockpit area). Then, the vehicle control operation area that is arranged side by side with the target interface control area and is located on the opposite side of the corresponding direction of the holding hand is determined as the target operation area.

[0106] For example, refer to Figure 3 , the remote controller is in the front-row boundary control area B1, and when it is determined that the hand holding the remote controller is the right hand, the left-side vehicle control operation area A12 arranged side by side with the boundary control area B1 is determined as the target operation area. When it is determined that the hand holding the remote controller is the left hand, the right-side vehicle control operation area A11 arranged side by side with the boundary control area B1 is determined as the target operation area.

[0107] In this embodiment, when the remote control is in the boundary control area, the target operation area where the remote control user is actually located can be accurately identified through the holding hand of the remote control, thereby improving the convenience and accuracy of vehicle equipment control.

[0108] Based on the above first and / or second embodiments, a third embodiment of the vehicle device control method of the present application is proposed. In this embodiment, step S20, the step of determining a target device from a plurality of controllable devices included in the vehicle according to the current orientation includes:

[0109] Step S21, generating a heading ray in the current heading direction;

[0110] In a feasible embodiment, a virtual heading ray is generated toward the current heading direction.

[0111] Step S22, determining a target spatial projection surface that the directional ray passes through and is closest to the starting point of the directional ray, wherein each controllable device corresponds to a spatial projection surface based on its spatial position in the vehicle;

[0112] In a feasible embodiment, each controllable device included in the vehicle corresponds to a spatial projection surface based on its spatial position in the vehicle; and then the target spatial projection surface that the directional ray passes through and is closest to the starting point of the directional ray is determined.

[0113] Step S23: determine the controllable device corresponding to the projection surface of the target space as the target device.

[0114] In a feasible embodiment, the controllable device corresponding to the projection surface of the target space is determined as the target device that the remote controller intends to control.

[0115] For example, refer to Figure 6 , each controllable device included in the vehicle has a corresponding spatial projection surface based on its spatial position in the vehicle, including: a first window projection surface 201 corresponding to the first window, a second window projection surface 202 corresponding to the second window, and a third window projection surface 203 corresponding to the third window. A heading ray is generated in the current heading direction of the remote controller 100, wherein the target spatial projection surface that the heading ray passes through and is closest to the starting point of the heading ray is the second window projection surface 202, thereby determining that the target device is the second window.

[0116] In this embodiment, through the setting of the remote control and the accurate identification of the target device for the intended control based on the current direction of the remote control, it is ensured that passengers in all positions in the vehicle can easily achieve comprehensive control over the controllable devices inside the vehicle, greatly improving the convenience of vehicle equipment control, accurately meeting the equipment usage needs of passengers in different positions, and significantly enhancing the user's riding experience.

[0117] In one feasible implementation, step S30, judging whether the remote controller can control the target device according to the target operation area, includes:

[0118] Step S31, identifying the control authority level of the target operation area;

[0119] Step S32, when the control authority level of the target operation area meets the authority control condition of the target device, determining that the remote control can control the target device; or

[0120] Step S33: When the control authority level of the target operation area does not satisfy the authority control condition of the target device, it is determined that the remote control is not controllable for the target device.

[0121] In one feasible embodiment, the control authority level of the target operation area is identified, and it is determined whether the control authority level of the target operation area satisfies the authority control conditions of the target device; then, if the control authority level of the target operation area satisfies the authority control conditions of the target device, it is determined that the remote control is controllable over the target device; and if the control authority level of the target operation area does not satisfy the authority control conditions of the target device, it is determined that the remote control is not controllable over the target device.

[0122] In this embodiment, by setting the control authority level, the driving safety hazards that may be caused by improper operation of the remote control are effectively avoided. For example, it is prevented that the passengers in the back row control the vehicle rearview mirrors through the remote control during driving, which increases the driving risk. While ensuring that the user's device usage needs are fully met, it also provides a solid guarantee for driving safety.

[0123] In a feasible implementation manner, before the step of determining the current orientation of the remote controller in response to the pointing operation of the remote controller in step S10, the method further includes:

[0124] Step C10, dynamically acquiring the motion state data of the remote controller;

[0125] Step C20: When the motion state data is greater than a preset motion threshold, it is determined that the remote controller triggers a pointing operation.

[0126] In a feasible embodiment, the motion state data of the remote control is dynamically acquired, and it is determined whether the motion state data is greater than a preset motion threshold. Although the motion state data (e.g., acceleration) of the remote control will fluctuate with the shaking of the vehicle during driving, the fluctuation will be within a certain range. When the user picks up the remote control and points it at the controllable device, the motion state data of the remote control will change significantly. Therefore, the motion state of the remote control can be determined by the motion threshold. Furthermore, when the motion state data is greater than the preset motion threshold, it indicates that the user picks up the remote control and moves, and it is determined that the remote control triggers the pointing operation.

[0127] For example, an inertial measurement unit (IMU) may be provided in the remote controller, and the acceleration of the remote controller may be dynamically acquired through the IMU as its motion state data.

[0128] In this embodiment, the motion status data of the remote control can be used to automatically determine whether the remote control triggers a pointing operation, thereby further determining whether the user has a need to control the vehicle equipment, and then providing the user with more timely feedback, thereby improving the convenience of vehicle equipment control and user experience.

[0129] In order to assist in understanding the above technical solution, the following is a more complete embodiment of the vehicle equipment control method. Figure 7 , step B101, the user picks up the remote control in the vehicle; and the control terminal dynamically obtains the motion state data of the remote control, and determines that the remote control triggers the pointing operation when the motion state data is greater than the preset motion threshold. Step A101, the control terminal determines the current orientation of the remote control, and determines the target operation area where the remote control is located in the multiple vehicle control operation areas contained in the vehicle. Step A102, the control terminal generates an orientation ray in the direction of the current orientation of the remote control, and then determines the target space projection surface that the orientation ray passes through and is closest to the starting point of the orientation ray, and determines the controllable device corresponding to the target space projection surface as the target device. Step A103, the control terminal determines whether the target device itself is controllable, that is, whether the target device has the remote control control function. Step A104, when the control terminal determines that the target device itself is not controllable, the control terminal controls the remote control to perform uncontrollable feedback. Step A105, when the control terminal determines that the target device itself is controllable, it identifies the control authority level of the target operation area as the control authority level of the remote control; and then determines whether the control authority level of the remote control meets the authority control condition of the target device. Step A106: If the control authority level of the target operation area does not meet the authority control conditions of the target device, determine that the remote control is uncontrollable for the target device, and control the remote control to provide uncontrollable feedback. Step A107: If the control authority level of the target operation area meets the authority control conditions of the target device, determine that the remote control is controllable for the target device, and control the remote control to provide controllable feedback. Step B102: The user presses a button on the remote control to issue a device control instruction. Step A108: Upon receiving the device control instruction sent by the remote control, the control terminal controls the target device to respond to the device control instruction. Convenient control of vehicle equipment is achieved.

[0130] The embodiment of the present application provides a vehicle equipment control system, the vehicle equipment control system includes a remote controller and a control terminal, the remote controller is communicatively connected with the control terminal, and the vehicle equipment control system includes:

[0131] Remote controller, used for pointing operation, device controllable feedback, and control terminal to send device control instructions;

[0132] A control terminal is used to determine the current orientation of the remote control in response to the pointing operation of the remote control, and determine the target operation area where the remote control is located among multiple vehicle control operation areas included in the vehicle; determine the target device among multiple controllable devices included in the vehicle according to the current orientation; determine whether the remote control is controllable for the target device according to the target operation area; control the remote control to provide controllable device feedback when the remote control is controllable for the target device; and control the target device to respond to the device control instruction when a device control instruction sent by the remote control is received.

[0133] The vehicle equipment control system provided in the embodiment of the present application adopts the vehicle equipment control method in the above embodiment, which can improve the control convenience of the vehicle equipment. Compared with conventional technology, the beneficial effects of the vehicle equipment control system provided in the embodiment of the present application are the same as the beneficial effects of the vehicle equipment control method provided in the above embodiment, and other technical features in the vehicle equipment control system are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0134] An embodiment of the present application provides a remote control, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the vehicle equipment control method in the above-mentioned embodiment one.

[0135] Reference below Figure 8 , respectively show the structural schematic diagrams of the remote controller suitable for implementing the embodiments of the present application. The remote controller in the embodiments of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 8 The remote control shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0136] like Figure 8As shown, the remote controller may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. Various programs and data required for the operation of the remote controller are also stored in the RAM 1004. The processing device 1001, the ROM 1002, and the RAM 1004 are connected to each other via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems may be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the remote controller to communicate with other devices wirelessly or by wire to exchange data. Although the remote controller with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0137] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0138] The remote controller provided in the embodiment of the present application adopts the vehicle equipment control method in the above embodiment, which can improve the control convenience of the vehicle equipment. Compared with conventional technology, the beneficial effects of the remote controller provided in the embodiment of the present application are the same as the beneficial effects of the vehicle equipment control method provided in the above embodiment, and the other technical features in the remote controller are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0139] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0140] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0141] An embodiment of the present application provides a computer-readable storage medium having computer-readable program instructions (ie, a computer program) stored thereon, wherein the computer-readable program instructions are used to execute the vehicle equipment control method in the above-mentioned embodiment.

[0142] The computer-readable storage medium provided in the embodiment of the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium that includes or stores a program that can be used by or in combination with an instruction execution system, system or device. The program code included on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0143] The computer-readable storage medium may be included in the remote controller, or may exist independently without being assembled into the remote controller.

[0144] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the remote control, the remote control: determines the current direction of the remote control in response to the pointing operation of the remote control, and determines the target operation area where the remote control is located among the multiple vehicle control operation areas contained in the vehicle; determines the target device among the multiple controllable devices contained in the vehicle according to the current direction; determines whether the remote control is controllable for the target device according to the target operation area; controls the remote control to provide controllable device feedback when the remote control is controllable for the target device; and controls the target device to respond to the device control instruction when receiving the device control instruction sent by the remote control.

[0145] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0146] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code includes one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0147] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0148] The readable storage medium provided in the embodiment of the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned vehicle equipment control method, and can improve the control convenience of vehicle equipment. Compared with conventional technologies, the beneficial effects of the computer-readable storage medium provided in the embodiment of the present application are the same as the beneficial effects of the vehicle equipment control method provided in the above-mentioned embodiment, and will not be repeated here.

[0149] The above are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect application in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A vehicle equipment control method, characterized in that: The method is applied to a control terminal, and the method comprises: In response to the pointing operation of the remote controller, determining the current orientation of the remote controller and determining a target operation zone where the remote controller is located among a plurality of vehicle control operation zones included in the vehicle; Determine a target device among a plurality of controllable devices included in the vehicle according to the current orientation; According to the target operation area, determining whether the remote controller can control the target device; When the remote controller is controllable for the target device, controlling the remote controller to provide feedback that the device is controllable; When receiving the device control instruction sent by the remote controller, the target device is controlled to respond to the device control instruction.

2. The method according to claim 1, characterized in that The vehicle is provided with a plurality of ultra-wideband (UWB) anchor points, the remote controller is provided with at least one UWB antenna, and the step of determining a target operation zone where the remote controller is located among a plurality of vehicle control operation zones included in the vehicle comprises: Based on the UWB anchor point, obtaining the position information of the UWB antenna; The target operation area is determined according to the position information.

3. The method according to claim 2, characterized in that The vehicle control operation area corresponds to each cockpit area of ​​the vehicle, and a boundary operation area is provided between the vehicle control operation areas arranged side by side in the vehicle. The step of determining the target operation area according to the position information includes: When it is determined that the remote controller is in the boundary control area according to the position information, identifying the holding hand of the remote controller; A vehicle control operation area that is arranged side by side with the target interface control area and located on the opposite side of the corresponding direction of the holding hand is determined as the target operation area, wherein the target interface control area is the interface control area where the remote control is located.

4. The method according to claim 3, characterized in that The step of identifying a holding hand of the remote controller comprises: The hand whose corresponding direction is the same as the current direction is determined as the holding hand.

5. The method according to claim 1, characterized in that The step of determining a target device among a plurality of controllable devices included in the vehicle according to the current orientation comprises: Generate a heading ray towards the current heading direction; Determine a target spatial projection surface that the directional ray passes through and is closest to the starting point of the directional ray, wherein each of the controllable devices corresponds to a spatial projection surface based on its spatial position in the vehicle; The controllable device corresponding to the projection surface of the target space is determined as the target device.

6. The method according to claim 1, characterized in that The step of determining whether the remote controller is controllable for the target device according to the target operation area includes: Identifying the control authority level of the target operation area; If the control authority level of the target operation area meets the authority control condition of the target device, determining that the remote controller can control the target device; or When the control authority level of the target operation area does not satisfy the authority control condition of the target device, it is determined that the remote controller cannot control the target device.

7. The method according to claim 1, characterized in that After the step of determining whether the remote controller is controllable for the target device according to the target operation area, the method further includes: In a case where the remote controller is uncontrollable for the target device, the remote controller is controlled to provide feedback indicating that the device is uncontrollable.

8. The method according to claim 1, characterized in that Before the step of determining the current orientation of the remote controller in response to the pointing operation of the remote controller, the method further includes: Dynamically acquiring motion state data of the remote controller; When the motion state data is greater than a preset motion threshold, it is determined that the remote controller triggers a pointing operation.

9. A vehicle equipment control system, characterized in that: The vehicle equipment control system includes a remote controller and a control terminal, wherein the remote controller is in communication connection with the control terminal, and the vehicle equipment control system includes: The remote controller is used for pointing operation, device controllable feedback, and the control terminal sends device control instructions; The control terminal is used to determine the current orientation of the remote control in response to the pointing operation of the remote control, and determine the target operation area where the remote control is located among multiple vehicle control operation areas included in the vehicle; determine the target device among multiple controllable devices included in the vehicle according to the current orientation; judge whether the remote control is controllable for the target device according to the target operation area; control the remote control to provide controllable device feedback when the remote control is controllable for the target device; and control the target device to respond to the device control instruction when a device control instruction sent by the remote control is received.

10. A remote controller, characterized in that: The remote controller includes: a memory, a processor, and a vehicle equipment control program stored in the memory and executable on the processor, wherein the vehicle equipment control program is configured to implement the steps of the vehicle equipment control method according to any one of claims 1 to 8.

11. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the vehicle equipment control method according to any one of claims 1 to 8 are implemented.

Images