Interaction method, terminal and computer readable storage medium

Abstract

The present invention belongs to the field of terminal technology, and relates to an interactive method, a terminal and a computer-readable storage medium, which are applied to a vehicle-mounted terminal, wherein the interactive method comprises: entering an air control mode, collecting air actions or gestures in a control detection area by establishing a connection with a passenger's mobile terminal to obtain control information; responding according to the control information; wherein the step of responding according to the control information comprises: when a target object in a display interface is selected according to the control information, a sensing feedback command is sent to an associated wearable terminal, so that the wearable terminal performs a selection prompt operation, and / or, when the vehicle driving status information is obtained, a corresponding control operation is performed according to the control information, and voice prompt information about the control operation is output. Therefore, the present invention can achieve the purpose of improving the accuracy of air control, thereby improving the user experience.

Description

Technical Field

[0001] The present invention relates to the field of terminal technology, and in particular to an interaction method, a terminal and a computer-readable storage medium. Background Art

[0002] With the rapid development of computer application technology, especially the popularization of various intelligent terminals, the emerging technology of human-computer interaction has begun to change people's lives. Among them, the use of mouse in human-computer interaction is the most basic means of operation, which builds a bridge for communication between people and computers. However, with the innovation of technology, the application component of mouse has been replaced by screen touch interaction.

[0003] However, the screen touch interaction method requires touching the terminal screen. Therefore, when it is inconvenient for the user to touch the terminal screen (for example, the user's hands are dirty or the user is a certain distance away from the terminal), human-computer interaction cannot be achieved to control the terminal. Therefore, the concept of air interaction came into being. However, operating the terminal through the air may not be able to achieve accurate operation due to the display size problem on the terminal screen (for example, the object displayed on the screen is not large enough), resulting in a poor user experience.

[0004] In view of the above problems, those skilled in the art have been seeking solutions.

[0005] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention

[0006] The technical problem to be solved by the present invention is that, in response to the defects of the above-mentioned prior art, an interactive method, a terminal and a computer-readable storage medium are provided to intelligently adjust the size of the displayed object in the display interface when the air control mode is turned on, so as to improve the accuracy of the air control and further enhance the user experience.

[0007] The present invention is achieved in that:

[0008] The present invention provides an interaction method, which includes: entering an air control mode; adjusting the display size of a preset object displayed in a display interface according to preset display size information; collecting air actions or gestures in a control detection area through a mobile terminal of a connected passenger to obtain control information, wherein the mobile terminal of the passenger is placed in a terminal fixing part in a vehicle to automatically establish a connection with the vehicle-mounted terminal; and responding according to the control information.

[0009] Furthermore, the preset object includes at least one of a control, display content, and an input box.

[0010] Further, the manipulation detection area is a detection area of ​​the camera device. The step of collecting the air motion or gesture in the manipulation detection area to obtain manipulation information by establishing a connection with the passenger's mobile terminal includes: detecting objects in the manipulation detection area by the passenger's mobile terminal. Performing 3D modeling operations on the objects to obtain manipulation information, the manipulation information including the position information and / or motion information of the objects.

[0011] Furthermore, the step of responding according to the control information includes: when the vehicle driving state information is acquired, performing corresponding control operations according to the control information, and outputting voice prompt information about the control operation.

[0012] Furthermore, the step of responding according to the control information includes: when an exit command is obtained according to the control information, exiting the air control mode.

[0013] Furthermore, after the step of adjusting the display size of the preset object displayed in the display interface according to the preset display size information, it includes: projecting the adjusted display interface to a preset position in the vehicle, the preset position including at least one of the roof and the window.

[0014] Further, the manipulation detection area is a detection area of ​​a camera device. The step of acquiring manipulation information in the manipulation detection area includes: acquiring the manipulation information through a corresponding camera device at a preset position.

[0015] Furthermore, the step of responding according to the manipulation information includes: when a target object in the display interface is selected according to the manipulation information, a sensing feedback command is sent to the associated wearable terminal, so that the wearable terminal performs a selection prompt operation.

[0016] The present invention also provides a terminal, comprising a memory and a processor. The processor is used to execute a computer program stored in the memory to implement the steps of the interaction method described above.

[0017] The present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the interaction method described above are implemented.

[0018] The interactive method, terminal and computer-readable storage medium provided by the present invention, wherein the interactive method comprises: entering into an air control mode. Adjusting the display size of a preset object displayed in a display interface according to preset display size information. Obtaining control information in a control detection area. Responding according to the control information. Thus, when the air control mode is turned on, the present invention can intelligently adjust the display size of a preset object displayed in a display interface, so that the control target can be accurately identified and located according to the control information in the control detection area, and then the control target can be controlled. Therefore, the present invention can achieve the purpose of improving the accuracy of air control, thereby improving the user experience.

[0019] In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 is a flowchart of an interactive method provided by a first embodiment of the present invention;

[0021] Figure 2 is a schematic diagram of the structure of an interactive system provided by a second embodiment of the present invention;

[0022] Figure 3 It is a schematic diagram of the structure of a terminal provided by the third embodiment of the present invention. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical scheme and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0024] The embodiments of the present invention are further described in detail below with reference to the accompanying drawings.

[0025] First embodiment:

[0026] Figure 1 is a flowchart of the interaction method provided by the first embodiment of the present invention. In order to clearly describe the interaction method provided by the first embodiment of the present invention, please refer to Figure 1 .

[0027] The first embodiment of the present invention provides an interactive method, including:

[0028] S11: Enter the air control mode.

[0029] In one embodiment, in step S11: entering the air control mode, it may include but is not limited to: receiving start operation information or start voice information for the air control mode, and entering the air control mode. The start operation information may be but is not limited to at least one of touch gesture operation information, air gesture operation information, etc. For example, when the start operation information is air gesture operation information, that is, the user can make a gesture in the air to enter the air control mode.

[0030] S12: adjusting the display size of the preset object displayed in the display interface according to the preset display size information.

[0031] In one embodiment, the preset object may include but is not limited to at least one of a control, display content, and an input box. The control may include, for example, an application control in the main display interface, a function control in the application (such as a setting function control, an editing function control, a sharing function control, a like function control, etc.), etc. The input box may include but is not limited to a text input box or a search input box, etc.

[0032] In one embodiment, the preset display size information may include but is not limited to at least one of a preset size of a control, preset size information of displayed content (e.g., a preset size of displayed text, a preset size of a displayed image), a preset size of an input box, and the like.

[0033] In one implementation, the preset display size information may be a system default setting, or may be acquired after a user performs a setting operation.

[0034] In one embodiment, specifically, after entering the air control mode, this embodiment can automatically perform intelligent display adjustment operations to adjust the display size of the preset objects in the display interface, so as to facilitate the user's subsequent accurate and precise air control of the preset objects.

[0035] S13: Obtaining manipulation information in the manipulation detection area.

[0036] In one embodiment, the manipulation detection area is a detection area of ​​a camera device. In step S13: obtaining manipulation information in the manipulation detection area, it may include but is not limited to: detecting an object in the manipulation detection area by a camera device. Performing a 3D modeling operation on the object to obtain manipulation information, and the manipulation information may include but is not limited to the position information and / or action information of the object.

[0037] In one embodiment, the object may be a human body. In the step of detecting the object in the manipulation detection area by using a camera device, it may include, but is not limited to: detecting the body movements or gestures of the human body in the manipulation detection area by using a camera device. Therefore, the interaction method provided in this embodiment can obtain manipulation information according to the user's body movements or gestures in the air.

[0038] In other embodiments, the object may be a human body. In the step of detecting the object in the manipulation detection area by using a camera device, it may include, but is not limited to: detecting the eye movement and / or head movement of the human body in the manipulation detection area by using a camera device. Therefore, the interaction method provided in this embodiment can obtain manipulation information according to the eye movement and / or head movement of the user.

[0039] In one embodiment, the camera device may be a three-dimensional camera device.

[0040] In one implementation, the interaction method provided in this embodiment can be applied to a vehicle-mounted terminal. The vehicle-mounted terminal can be installed on a center console, and the screen of the vehicle-mounted terminal can be a center console screen. The camera device can be installed under the screen of the vehicle-mounted terminal, but is not limited to being installed.

[0041] In one implementation, the interactive method provided in this embodiment can be applied to a vehicle-mounted terminal. In step S12: after adjusting the display size of the preset object displayed in the display interface according to the preset display size information, it may include but is not limited to: projecting the adjusted display interface to a preset position in the vehicle, and the preset position may include but is not limited to at least one of the roof and the window. Therefore, the interactive method provided in this embodiment can share the display interface of the vehicle-mounted terminal with passengers in the vehicle by means of projection, so that passengers can also see the display content of the vehicle-mounted terminal, and physical screen projection projection or optical projection can be used for projection, wherein the use of optical projection can save the cost of installing a physical screen.

[0042] In one embodiment, the vehicle window may be, but is not limited to, a vehicle window with a display function.

[0043] In one embodiment, the manipulation detection area is a detection area of ​​a camera device. In step S13: obtaining manipulation information in the manipulation detection area, it may include but is not limited to: obtaining manipulation information through a camera device corresponding to a preset position. Among them, the camera device corresponding to the preset position, for example, a camera device at a window position that displays the projection content, and a camera device at a roof projection position. Therefore, the interactive method provided in this embodiment enables passengers to face the projection and also operate the vehicle terminal remotely. Therefore, the user can operate the vehicle terminal remotely in front of the center console, and the passenger can also operate the vehicle terminal in front of the projection.

[0044] In one embodiment, the camera device corresponding to the preset position may be, but is not limited to, a passenger's mobile terminal with a motion capture function or a 3D camera function. Furthermore, the passenger can place his or her mobile terminal into the corresponding terminal fixing part at the preset position to automatically establish a communication connection with the vehicle-mounted terminal and capture the air motion or gesture.

[0045] S14: Respond according to the control information.

[0046] In one embodiment, in step S14: responding according to the manipulation information, it may include but is not limited to: moving the selection icon in the display interface to select the target object according to the position information in the manipulation information. The selected target object is controlled accordingly according to the action information in the manipulation information. For example, the WeChat control in the display interface is selected according to the position information in the manipulation information, and the action information in the manipulation information is a double-click gesture, then WeChat is selected and started according to the manipulation information.

[0047] In one embodiment, in step S14: responding according to the control information, it may include but is not limited to: when the vehicle driving state information is obtained, performing corresponding control operations according to the control information, and outputting voice prompt information about the control operation. Therefore, the interactive method provided in this embodiment can perform blind operations through voice prompt information when the user is driving, so as to ensure that the user drives safely without looking at the display interface or display screen.

[0048] In one embodiment, in step S14: responding according to the control information, it may include but is not limited to: when an exit command is obtained according to the control information, exiting the air control mode. Therefore, after entering the air control mode, the user can exit the air control mode through air movements or gestures.

[0049] In one embodiment, in step S14: responding according to the manipulation information, it may include but is not limited to: when the target object in the display interface is selected according to the manipulation information, a sensing feedback command is sent to the associated wearable terminal so that the wearable terminal performs a selection prompt operation. Among them, the wearable terminal may be but is not limited to a smart bracelet, a smart watch, a smart ring, etc. Among them, the selection prompt operation may include but is not limited to a vibration prompt operation and / or a sound prompt operation, etc. Therefore, the interaction method provided in this embodiment can perform selection feedback through the wearable terminal, so that the user has a better remote manipulation experience.

[0050] The interaction method provided by the first embodiment of the present invention may include, but is not limited to: S11: Entering the air control mode. S12: Adjusting the display size of the preset object displayed in the display interface according to the preset display size information. S13: Obtaining the control information in the control detection area. S14: Responding according to the control information. Therefore, when the air control mode is turned on, the interaction method provided by the first embodiment of the present invention can intelligently adjust the display size of the preset object displayed in the display interface, so that the control target can be accurately identified and located according to the control information in the control detection area, and then the control target can be controlled. Therefore, the interaction method provided by the first embodiment of the present invention can achieve the purpose of improving the accuracy of air control, thereby improving the user experience.

[0051] Second embodiment:

[0052] Figure 2 is a schematic diagram of the structure of the interactive system provided by the second embodiment of the present invention. In order to clearly describe the interactive system provided by the second embodiment of the present invention, please refer to Figure 2 .

[0053] The interactive system provided by the second embodiment of the present invention includes an opening module M1, a display adjustment module M2, a control acquisition module M3 and a response module M4.

[0054] Among them, the opening module M1 is used to enter the remote control mode.

[0055] In one embodiment, the opening module M1 can also be used to receive opening operation information or opening voice information for the air control mode to enter the air control mode. The opening operation information can be but is not limited to at least one of touch gesture operation information, air gesture operation information, etc.

[0056] Among them, the display adjustment module M2 is used to adjust the display size of the preset object displayed in the display interface according to the preset display size information after entering the air control mode.

[0057] In one embodiment, the preset object may include but is not limited to at least one of a control, display content, and an input box. The control may include, for example, an application control in the main display interface, a function control in an application, etc. The input box may include but is not limited to a text input box or a search input box, etc.

[0058] The manipulation acquisition module M3 is used to acquire manipulation information in the manipulation detection area.

[0059] In one embodiment, the manipulation acquisition module M3 may include, but is not limited to, a detection unit and a manipulation acquisition unit. The detection unit may be used to detect an object in a manipulation detection area through a camera device. The manipulation acquisition unit may be used to perform a 3D modeling operation on the object to obtain manipulation information, and the manipulation information may include, but is not limited to, position information and / or action information of the object.

[0060] In one implementation, the detection unit in the manipulation acquisition module M3 may be used to detect body movements or gestures of a person in the manipulation detection area through a camera device.

[0061] In other embodiments, the detection unit in the manipulation acquisition module M3 may be used to detect eye movements and / or head movements of a person in the manipulation detection area through a camera device.

[0062] In one embodiment, the control acquisition module M3 can be used to acquire the control information through the camera device corresponding to the preset position after the display adjustment module M2 projects the adjusted display interface to the preset position in the vehicle. The preset position can include but is not limited to at least one of the roof and the window.

[0063] The response module M4 is used to respond according to the control information.

[0064] In one embodiment, the response module M4 may include, but is not limited to, a selection unit and a control unit. The selection unit may be used to move the selection icon in the display interface according to the position information in the manipulation information to select the target object. The control unit may be used to perform corresponding control on the selected target object according to the action information in the manipulation information.

[0065] In one embodiment, the response module M4 may further include a voice prompt unit, which is used to perform corresponding control operations according to the control information when the vehicle driving state information is acquired, and output voice prompt information about the control operation.

[0066] In one embodiment, the response module M4 may include an exit unit for exiting the remote control mode when an exit command is obtained according to the control information.

[0067] In one embodiment, the response module M4 may include a prompt unit for sending a sensing feedback command to the associated wearable terminal when a target object in the display interface is selected according to the manipulation information, so that the wearable terminal performs a selection prompt operation.

[0068] In one implementation, the specific implementation and beneficial effects of the interactive system provided in this embodiment can refer to the interactive method provided in the first embodiment of the present invention, and will not be described in detail here.

[0069] The interactive system provided by the second embodiment of the present invention includes an opening module M1, a display adjustment module M2, a control acquisition module M3 and a response module M4. Among them, the opening module M1 is used to enter the air control mode. Among them, the display adjustment module M2 is used to adjust the display size of the preset object displayed in the display interface according to the preset display size information after entering the air control mode. Among them, the control acquisition module M3 is used to obtain the control information in the control detection area. Among them, the response module M4 is used to respond according to the control information. Therefore, when the interactive system provided by the second embodiment of the present invention turns on the air control mode, it can intelligently adjust the display size of the preset object displayed in the display interface, so it can accurately identify and locate the control target according to the control information in the control detection area, and then can control the control target. Therefore, the interactive system provided by the second embodiment of the present invention can achieve the purpose of improving the accuracy of air control, thereby improving the user's experience.

[0070] Third embodiment:

[0071] Figure 3 1 is a schematic diagram of the structure of a terminal provided in the third embodiment of the present invention. Figure 3 .

[0072] The terminal 1 provided in the third embodiment of the present invention includes: a processor A101 and a memory A201, wherein the processor A101 is used to execute a computer program A6 stored in the memory A201 to implement the steps of the interaction method described in the first embodiment.

[0073] In one implementation, the terminal 1 provided in this embodiment may include at least one processor A101 and at least one memory A201. The at least one processor A101 may be referred to as a processing unit A1, and the at least one memory A201 may be referred to as a storage unit A2. Specifically, the storage unit A2 stores a computer program A6. When the computer program A6 is executed by the processing unit A1, the terminal 1 provided in this embodiment implements the steps of the interaction method described above, for example, Figure 1 Step S11 shown in: entering the air control mode; step S12: adjusting the display size of the preset object displayed in the display interface according to the preset display size information; step S13: obtaining the control information in the control detection area; step S14: responding according to the control information.

[0074] In one implementation, the terminal 1 provided in this embodiment may include multiple memories A201 (referred to as storage units A2 for short), and the storage units A2 may include, for example, random access memory (RAM) and / or cache memory and / or read-only memory (ROM), etc.

[0075] In one embodiment, the terminal 1 further includes a bus connecting different components (eg, the processor A101 and the memory A201 , the touch screen A3 , etc.).

[0076] In one implementation, the terminal 1 in this embodiment may further include a communication interface (eg, I / O interface A4), which may be used to communicate with an external device.

[0077] In one implementation, the terminal 1 provided in this embodiment may further include a communication device A5.

[0078] The terminal 1 provided in the third embodiment of the present invention includes a memory A101 and a processor A201, and the processor A101 is used to execute the computer program A6 stored in the memory A201 to implement the steps of the interaction method described in the first embodiment. Therefore, the terminal 1 provided in this embodiment can achieve the purpose of improving the accuracy of air control, thereby improving the user's experience.

[0079] The third embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program A6. When the computer program A6 is executed by the processor A101, the steps of the interactive method in the first embodiment are implemented, for example Figure 1 The steps shown are step S11 to step S14.

[0080] In one implementation, the computer-readable storage medium provided by this embodiment may include any entity or device, recording medium capable of carrying computer program code, such as ROM, RAM, magnetic disk, optical disk, flash memory, etc.

[0081] The computer program A6 stored in the computer-readable storage medium provided in the third embodiment of the present invention can achieve the purpose of improving the accuracy of air control when executed by the processor A101, thereby improving the user experience.

[0082] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0083] In this document, the terms "comprises," "comprising," or any other variations thereof, are intended to cover a non-exclusive inclusion of elements other than those listed and may also include additional elements not expressly listed.

[0084] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions or improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. An interactive method, characterized in that: Applied to a vehicle-mounted terminal, the interaction method includes: Enter the remote control mode, collect remote actions or gestures in the control detection area through the mobile terminal of the connected passenger to obtain control information; Responding according to the manipulation information; wherein the step of responding according to the manipulation information includes: When a target object in the display interface is selected according to the control information, a sensing feedback command is sent to the associated wearable terminal so that the wearable terminal performs a selection prompt operation, and / or, When the vehicle driving state information is acquired, corresponding control operations are performed according to the control information, and voice prompt information about the control operations is output.

2. The interactive method according to claim 1, characterized in that: The manipulation detection area is a detection area of ​​the camera device; The step of collecting the air motion or gesture of the control detection area to obtain the control information by establishing a connection with the mobile terminal of the passenger includes: Detecting objects within the manipulation detection area through the passenger's mobile terminal; A 3D modeling operation is performed on the object to obtain the manipulation information, where the manipulation information includes position information and / or action information of the object.

3. The interactive method according to claim 1, characterized in that: The step of responding according to the manipulation information includes: When an exit command is obtained according to the control information, the air control mode is exited.

4. The interactive method according to claim 1, characterized in that: After the step of adjusting the display size of the preset object displayed in the display interface according to the preset display size information, the method further comprises: The adjusted display interface is projected to a preset position in the vehicle, wherein the preset position includes at least one of a roof and a window.

5. The interactive method according to claim 1, characterized in that: Also includes: The display size of a preset object displayed in a display interface is adjusted according to preset display size information, wherein the preset object includes at least one of a control, display content, and an input box.

6. The interactive method according to claim 1, characterized in that: The passenger's mobile terminal is placed in a terminal fixing part in the vehicle to automatically establish a connection with the vehicle-mounted terminal.

7. A terminal, characterized in that: including memory and processor; The processor is configured to execute the computer program stored in the memory to implement the steps of the interaction method according to any one of claims 1 to 6.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the interaction method according to any one of claims 1 to 6 are implemented.

Images