Control method, system, device and storage medium for intelligent terminal application operation

Abstract

The invention discloses a control method, a system, a device and a storage medium for the application operation of an intelligent terminal based on augmented reality. The present invention combines AR technology and action recognition to perform operations such as application selection, entry and exit, without the need for users to manually click, eliminates the hidden danger of finger cartilage damage, and solves the problem of high mechanical degree and finger manipulation during the operation process. The technical problem of the blind area; from the perspective of experience perception, the virtual and reality are fully integrated, and the operation mode of the intelligent terminal application program is convenient to operate, saying goodbye to the boring mechanized operation, which is more in line with the user's habits and life characteristics, and the operation is simple, easy to use and convenient Spread, improve user experience. The invention can be widely applied to various intelligent terminal application program control systems.

Description

technical field

[0001] The invention relates to the field of intelligent control, in particular to a control method, system, device and storage medium for application operation of an intelligent mobile terminal. Background technique

[0002] In the prior art, the user's operation on the smart device is mostly carried out by finger sliding operation, such as switching between the screens of the mobile phone, and clicking on the desktop ICON (desktop icon) to enter the APP (application). From a medical point of view, tapping the screen with fingers for a long time may damage the finger cartilage; at the same time, the user's finger tapping operation is boring, the overall experience process is highly mechanical, and the virtual and reality are completely separated; and as the mobile phone screen gradually increases, The difficulty of clicking increases, it is not easy to control with one hand, and the blind area of ​​finger clicking increases.

[0003] In summary, the technol...

Examples

Embodiment 1

[0051] Such as Figure 4 to Figure 6 As shown, the interface icon classification and environmental mode presetting steps: scan multiple target scenes in sequence, and obtain user setting instructions to set interface icons and corresponding environmental modes based on each target scene.

[0052] AR display step: scan the target scene, and present an AR display interface on the display screen of the smart terminal after the scanning is successful, and the AR display interface presents interface icons in an augmented reality based on the target scene.

[0053] Step of determining selection: acquiring a first user operation instruction, and selecting one of the interface icons in the AR display interface according to the first user operation instruction.

[0054] Step of entering the application program: obtaining a second user operation instruction, and entering the application program corresponding to the selected interface icon according to the second user operation instructi...

Embodiment 2

[0070] refer to Figure 7 , this embodiment provides a control system for smart terminal application operation based on augmented reality, including:

[0071] The interface icon classification and environment mode preset module is used to scan multiple target scenes in sequence, and obtain user setting instructions to set the environment mode corresponding to each target scene after the scanning is successful. The interface icon classification and environmental mode preset modules can be realized by including but not limited to mobile phone cameras, gyroscopes, light sensors, and touch screens. Specifically, first use the camera to scan the first target scene (such as the desktop of the workbench). After the scan is successful, the mobile phone reads the user's installed application program (APP), and the interface presents category tags for the user to choose. Click to set (such as classifying the interface icon as: working environment mode); after the setting is completed, ...

Embodiment 3

[0076] This embodiment also provides a control device based on an augmented reality smart terminal application operation, including:

[0077] at least one processor; and,

[0078] a memory communicatively coupled to the at least one processor; wherein,

[0079] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can perform a control method based on an augmented reality smart terminal application operation .

[0080] It should be noted that since the control system for smart terminal application operation based on augmented reality in this embodiment is based on the same inventive concept as the control method for smart terminal application operation based on augmented reality in the first embodiment above, the method implements The corresponding content in Example 1 is also applicable to this system embodiment, and will not be described in detai...

technical field

[0001] The invention relates to the field of intelligent control, in particular to a control method, system, device and storage medium for application operation of an intelligent mobile terminal. Background technique

[0002] In the prior art, the user's operation on the smart device is mostly carried out by finger sliding operation, such as switching between the screens of the mobile phone, and clicking on the desktop ICON (desktop icon) to enter the APP (application). From a medical point of view, tapping the screen with fingers for a long time may damage the finger cartilage; at the same time, the user's finger tapping operation is boring, the overall experience process is highly mechanical, and the virtual and reality are completely separated; and as the mobile phone screen gradually increases, The difficulty of clicking increases, it is not easy to control with one hand, and the blind area of ​​finger clicking increases.

[0003] In summary, the technol...

Examples

Embodiment 1

[0051] Such as Figure 4 to Figure 6 As shown, the interface icon classification and environmental mode presetting steps: scan multiple target scenes in sequence, and obtain user setting instructions to set interface icons and corresponding environmental modes based on each target scene.

[0052] AR display step: scan the target scene, and present an AR display interface on the display screen of the smart terminal after the scanning is successful, and the AR display interface presents interface icons in an augmented reality based on the target scene.

[0053] Step of determining selection: acquiring a first user operation instruction, and selecting one of the interface icons in the AR display interface according to the first user operation instruction.

[0054] Step of entering the application program: obtaining a second user operation instruction, and entering the application program corresponding to the selected interface icon according to the second user operation instructi...

Embodiment 2

[0070] refer to Figure 7 , this embodiment provides a control system for smart terminal application operation based on augmented reality, including:

[0071] The interface icon classification and environment mode preset module is used to scan multiple target scenes in sequence, and obtain user setting instructions to set the environment mode corresponding to each target scene after the scanning is successful. The interface icon classification and environmental mode preset modules can be realized by including but not limited to mobile phone cameras, gyroscopes, light sensors, and touch screens. Specifically, first use the camera to scan the first target scene (such as the desktop of the workbench). After the scan is successful, the mobile phone reads the user's installed application program (APP), and the interface presents category tags for the user to choose. Click to set (such as classifying the interface icon as: working environment mode); after the setting is completed, ...

Embodiment 3

[0076] This embodiment also provides a control device based on an augmented reality smart terminal application operation, including:

[0077] at least one processor; and,

[0078] a memory communicatively coupled to the at least one processor; wherein,

[0079] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can perform a control method based on an augmented reality smart terminal application operation .

[0080] It should be noted that since the control system for smart terminal application operation based on augmented reality in this embodiment is based on the same inventive concept as the control method for smart terminal application operation based on augmented reality in the first embodiment above, the method implements The corresponding content in Example 1 is also applicable to this system embodiment, and will not be described in detai...

Images