Interaction method and related equipment
By obtaining user interaction gestures in extended real-life devices and matching them with preset gestures, the problem of low long-distance interaction efficiency is solved, and more efficient screening and operation convenience is achieved.
Patent Information
- Application Number
- CN202311161141.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-08
- Publication Date
- 2025-03-11
AI Technical Summary
In existing extended real-life devices, long-distance interaction methods are inefficient and difficult to meet users' fast selection needs.
By obtaining the user's first interactive gesture, matching it with the preset gestures of each first target object, the response matching is successful, and the corresponding first target object is determined as the second target object, thereby improving screening efficiency and operation convenience.
It greatly improves the efficiency of screening, reduces the difficulty of operation, and allows users to rely on intuitive operations, making interaction more convenient.
Smart Images
Figure CN119597138A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the technical field of extended reality, and in particular to an interaction method and related equipment. Background Art
[0002] Extended Reality (XR) refers to the combination of reality and virtuality through computers to create a virtual environment for human-computer interaction. It is also a general term for multiple technologies such as augmented reality (AR), virtual reality (VR), and mixed reality (MR).
[0003] For extended reality devices, such as VR devices, the mainstream interaction method is long-distance interaction. In some scenarios, long-distance interaction through ray operation is inefficient and difficult to meet user needs. Summary of the invention
[0004] In view of this, the purpose of the present disclosure is to provide an interaction method and related devices.
[0005] Based on the above objectives, in a first aspect, an embodiment of the present disclosure provides an interaction method, including:
[0006] Get the user's first interaction gesture;
[0007] Matching the first interactive gesture with a preset gesture of each first target object; wherein the first target object corresponds to at least one preset gesture;
[0008] In response to a successful match, the corresponding first target object is determined to be the second target object.
[0009] In a second aspect, an embodiment of the present disclosure provides an interactive device, including:
[0010] An acquisition module is configured to: acquire a first interaction gesture of a user;
[0011] A screening module is configured to: match the first interactive gesture with a preset gesture of each first target object; wherein the first target object corresponds to at least one preset gesture;
[0012] The determination module is configured to: in response to a successful match, determine that the corresponding first target object is the second target object.
[0013] In a third aspect, an embodiment of the present disclosure provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the interaction method as described in the first aspect is implemented.
[0014] In a fourth aspect, an embodiment of the present disclosure provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the interaction method described in the first aspect.
[0015] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, comprising computer program instructions, which, when executed on a computer, enable the computer to execute the interaction method as described in the first aspect.
[0016] From the above, it can be seen that the present disclosure provides an interactive method and related devices provided by an embodiment, by obtaining a first interactive gesture of a user; matching the first interactive gesture with a preset gesture of each first target object; based on the matching result of the first interactive gesture and the preset gesture, filtering the first target object to obtain a second target object, the first interactive gesture can greatly improve the efficiency of filtering and reduce the difficulty of operation. At the same time, the setting of the preset gesture can be close to the real world, and the user can rely on intuitive operation, making the interaction more convenient. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the technical solutions in the present disclosure or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0018] Figure 1 A schematic diagram of a display screen provided in an embodiment of the present disclosure;
[0019] Figure 2A A schematic diagram of a display screen provided in an embodiment of the present disclosure;
[0020] Figure 2B for Figure 2A A stereoscopic visual diagram of a display screen;
[0021] Figure 3 A schematic diagram of another display screen provided in an embodiment of the present disclosure;
[0022] Figure 4 A schematic diagram of another display screen provided in an embodiment of the present disclosure;
[0023] Figure 5 A flowchart of an interactive method provided by an embodiment of the present disclosure;
[0024] Fig. 6A A schematic diagram of another interaction scenario provided by an embodiment of the present disclosure;
[0025] Figure 6B A schematic diagram of another interaction scenario provided by an embodiment of the present disclosure;
[0026] Fig. 7A A schematic diagram of an interactive gesture provided by an embodiment of the present disclosure;
[0027] Figure 7B A schematic diagram of another interactive gesture provided by an embodiment of the present disclosure;
[0028] Figure 7C A schematic diagram of the effect of the target operation provided by the embodiment of the present disclosure;
[0029] Figure 8 A schematic diagram of the structure of an interactive device provided in an embodiment of the present disclosure;
[0030] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0031] In order to make the objectives, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.
[0032] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present disclosure should be understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the embodiments of the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprising" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects.
[0033] As mentioned in the background technology section, the mainstream interaction method of extended reality devices is long-distance interaction. For example, Figure 1 A display screen 100 is shown, and the display screen 100 includes a tool box 101. After the user triggers the instruction to open the tool box 101, the device will display a display screen 200, such as Figure 2A and Figure 2B As shown, Figure 2A is the display screen 200 that the user is looking at, Figure 2B The depth of field effect presented by the display screen 200 is shown. The display screen 200 includes an interactive sub-screen 204, and the interactive sub-screen 204 includes a plurality of objects to be selected, such as a mug 201 and a pistol 202. The user selects a target object from the objects to be selected by controlling the ray 203.
[0034] like Figure 2BAs shown, for long-distance interaction, there is a certain distance between the interactive sub-screen 204 and the user. When the user controls the ray 203, the user's gesture or the small movement L2 of the handle corresponds to the interactive sub-screen 204, which can produce a large offset L1, resulting in frequent user misoperations and low efficiency. In addition, when there are many objects to be selected and it is difficult to display them all at the same time in the display screen 300, the user needs to use the up page 301 and the down page 302 to display the objects to be selected in pages (such as Figure 3 Alternatively, the search box 401 is used to search for the selected object, such as Figure 4 As shown in the display screen 400. This undoubtedly further increases the difficulty of selecting the target object and is difficult to meet the user's demand for quick operation.
[0035] In view of this, the embodiment of the present disclosure provides an interaction method, which obtains a first interaction gesture of a user; matches the first interaction gesture with a preset gesture of each first target object; and based on the matching result of the first interaction gesture and the preset gesture, screens the first target object to obtain a second target object, and the first interaction gesture can greatly improve the efficiency of screening and reduce the difficulty of operation. At the same time, the setting of the preset gesture is close to the real world, and the user can rely on intuition to operate, making the interaction more convenient.
[0036] like Figure 5 As shown, the interaction method specifically includes:
[0037] Step S501: In response to a user's triggering operation, a first interactive interface is displayed (see 6A); wherein the first interactive interface shows a plurality of first targets, such as Fig. 6A Eight first targets are shown.
[0038] As mentioned above, the display device here can be a head-mounted display device, glasses, etc. in an XR (such as VR, MR) system. The display screen of the display device can be a virtual screen, or a combination of a virtual screen and a real screen, which is not limited here.
[0039] It should be understood that the first interactive interface is a part of the display screen. The first target object is a virtual object.
[0040] Here, the specific scenario for triggering the operation may be any scenario that requires selecting a virtual object, such as opening a toolbox, a treasure chest, etc., and the present disclosure does not specifically limit this.
[0041] It should be noted that the specific method of triggering the operation is set according to the scene and is not limited here, such as a designated button on the handle, a trigger gesture, and the first interaction gesture and the second interaction gesture described below.
[0042] Optionally, the first interactive interface includes a screening mark 601, and the screening mark 601 is used to remind the user to screen the first target object.
[0043] Step S503: Acquire the user's first interaction gesture (eg Fig. 7A , Figure 7B ); Here, the first interactive gesture is used to screen the first target object. The first interactive gesture is determined by the user's hand posture information.
[0044] In some embodiments, the step of obtaining the user's first interaction gesture specifically includes:
[0045] Obtain the user's hand posture information; illustratively, the hand posture information can be obtained through an image acquisition device or through a sensor on a smart glove.
[0046] Those skilled in the art understand that the image acquisition device can be set on a head-mounted display device, on smart glasses, or in a real environment where the extended reality device is used, such as a game room, studio, living room, etc., and the present disclosure does not make specific limitations on this.
[0047] The first interactive gesture is obtained according to the hand posture information using a posture recognition model; wherein the posture recognition model is a machine learning model.
[0048] It should be noted that the posture recognition model is a pre-trained machine learning model. Exemplarily, the machine learning model can be based on a deep neural network, a convolutional neural network, etc. Exemplarily, the training of the posture recognition model can adopt supervised learning, semi-supervised learning or unsupervised learning, which is not limited.
[0049] Those skilled in the art will appreciate that the posture recognition model may adopt a single algorithm or a combination of multiple algorithms, which is not limited in the present disclosure.
[0050] Of course, those skilled in the art may also adopt mature models in the prior art that are known to the public, which is not limited here.
[0051] Step S505: Match the first interactive gesture with a preset gesture of each first target object; wherein the first target object corresponds to at least one preset gesture.
[0052] Here, the preset gesture corresponds to the gesture of the user operating the first target object in the real scene.
[0053] Of course, those skilled in the art may also set a targeted preset gesture that is unrelated to the operation action for the first target object, and the present disclosure does not limit this. It should be noted that for the targeted preset gesture, the user needs to be trained so that the user understands the preset gesture in order to complete the corresponding first interaction gesture. In contrast, the preset gesture determined based on the real scene does not require special training, and the user can operate according to intuition.
[0054] Here combined Fig. 7A and Figure 7B For example, the first target object is a mug, and the operation can be to pick up the mug or to grab the mug. In a real scene, the user can use the gesture of picking up the mug as follows: Fig. 7A As shown, grabbing a mug can be done as follows Figure 7B As shown. Therefore, there can be two preset gestures corresponding to the mug, as follows: Fig. 7A or Figure 7B As another example, the first target object is a pistol, and the operation may be to hold the pistol. In a real scene, the user may also hold the pistol with the gesture as shown in FIG. Fig. 7A As shown. Therefore, the preset gesture corresponding to the pistol can be one, such as Fig. 7A shown.
[0055] Here, the number of preset gestures for the first target object can be 1, 2, 3 or even more, and there is no limitation on this. It should be understood that the more preset gestures for the first target object, the more conducive it is for the user to screen, and the user can quickly select the first target object through multiple interactive gestures.
[0056] Step S507: In response to successful matching, determining that the corresponding first target object is the second target object.
[0057] Exemplarily, if the first interaction gesture and Fig. 7A If the preset gesture shown in FIG. 1 is matched successfully, the corresponding mug and pistol are selected as the second target object, and the result can be as follows: Figure 6B shown.
[0058] Optionally, the method further comprises displaying the second target object.
[0059] It should be noted that the first interactive gesture can not only Fig. 6A The first target object shown in the first interactive interface can be filtered, and the first target objects not shown in the first interactive interface can also be filtered, especially when there are many first targets and they cannot be displayed on the same screen. The first interactive gesture satisfies the preset gesture of the first target object, that is, the first target object can be determined as the second target object. In other words, the first interactive gesture of the technical solution of the present disclosure combines the operations of searching and selecting, omitting the page turning or searching operations, and the operation is more convenient.
[0060] It should be understood that if the second target is unique, subsequent interactive actions can be performed. If there are multiple second targets, screening can continue.
[0061] In some embodiments, the number of the second targets is multiple and at least one second target corresponds to multiple preset gestures. Figure 6B , the mug in the second target object corresponds to two preset gestures, and the pistol in the second target object corresponds to one preset gesture.
[0062] The interaction method further comprises:
[0063] The second interaction gesture of the user is obtained. The method for obtaining the second interaction gesture is as described above and will not be repeated here.
[0064] Matching the second interaction gesture with a preset gesture of the second target object;
[0065] In response to successful matching, the corresponding second object is determined to be the third object.
[0066] It should be noted that some second targets have multiple preset gestures, and the second interactive gesture can be used to further screen the second targets. In other words, only targets that meet both the first interactive gesture and the second interactive gesture can be determined as the third target.
[0067] For example, the second interaction gesture is Figure 7B As shown, the mug is determined to be the third target object.
[0068] It should be understood that the technical solution of the present disclosure does not limit the number of acquired interaction gestures. That is to say, by using more interaction gestures, such as the third interaction gesture, the fourth interaction gesture..., the user can continue to screen the third target object until the needs are met, which will not be elaborated here.
[0069] In some alternative embodiments, the number of the second target objects is multiple; the interaction method further includes:
[0070] The user's serial number interaction gesture is obtained; the method for obtaining the serial number interaction gesture is as described above and will not be repeated here.
[0071] In response to the correspondence between the serial number represented by the serial interaction gesture and the order of the second targets, the corresponding second target is determined to be the third target; wherein the order refers to the position order of the plurality of second targets.
[0072] like Figure 6B As shown, the pistol is ranked second among the second target objects, so when the sequence interaction gesture represents 2, the pistol is determined to be the third target object.
[0073] Through such a technical solution, the second target object can be selected if there is only one preset gesture or if there are still multiple targets that cannot be further screened after multiple rounds of screening. Of course, such a screening method can also be used for the second target object with multiple preset gestures.
[0074] It should be noted that the first interaction gesture, the second interaction gesture, the third interaction gesture, etc. do not overlap with the serial number interaction gesture, thereby ensuring that the corresponding matching method is directly selected based on the gesture without the need for user selection.
[0075] Of course, according to the scene requirements, subsequent interactive actions can also be performed on multiple second targets.
[0076] In some alternative embodiments, the interaction method further comprises:
[0077] In response to obtaining a confirmation gesture from the user, it is determined that the second target object meets a preset selection condition.
[0078] Here, the preset selection conditions include but are not limited to the uniqueness of the target object and obtaining the user's confirmation gesture.
[0079] By means of the confirmation gesture, the selection confirmation of the plurality of second objects can be realized. As can be understood by those skilled in the art, the application scenario of this solution can be to transfer the plurality of second objects to other tool boxes, etc.
[0080] Due to issues such as the angle of the user's hand movements, the target object obtained based on the interactive gesture may not meet the user's needs, or the user may change his mind and need to reselect the target object. The embodiments of the present disclosure provide a further solution.
[0081] In some embodiments, the interaction method further comprises:
[0082] In response to obtaining the user's return gesture, the previous interactive interface is returned. Such a technical solution facilitates the user to reselect.
[0083] Those skilled in the art can understand that the method of determining the return gesture and the confirmation gesture based on the user's hand posture information belongs to the prior art, and the present disclosure does not make any specific limitation on this.
[0084] In some embodiments, the interaction method further comprises:
[0085] In response to determining that the second object or the third object satisfies a preset selection condition, a corresponding target operation is performed on the second object or the third object.
[0086] Here, the target operation may be different depending on the application scenario of the second target object or the third target object. For example, if the application scenario is to open a treasure box to take an item, the target operation may be to grab the target object. If the application scenario is to open a tool box to exchange items, the target operation may be to give the target object.
[0087] Furthermore, the second target object or the third target object is unique; in response to determining that the target operation is to grasp the target object, the second target object or the third target object is moved to a target position; wherein the target position matches the position of the interaction gesture (e.g., the first interaction gesture, the second interaction gesture, the serial number interaction gesture) for determining the second target object or the third target object in the display screen, thereby achieving a technical effect of simulating a real grasping target object, and the grasping efficiency is high (e.g., Figure 7C shown).
[0088] It should be understood that the first interaction gesture or the second interaction gesture can be a virtual screen or a real screen, and no specific limitation is made here.
[0089] It should be noted that the method of the embodiment of the present disclosure can be performed by a single device, such as a computer or a server. The method of the present embodiment can also be applied in a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present disclosure, and the multiple devices will interact with each other to complete the described method.
[0090] It should be noted that the above describes some embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0091] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present disclosure also provides an interaction device.
[0092] refer to Figure 8 , the interaction device comprises:
[0093] The acquisition module 801 is configured to: acquire a first interaction gesture of a user;
[0094] The screening module 803 is configured to: match the first interactive gesture with a preset gesture of each first target object; wherein the first target object corresponds to at least one preset gesture;
[0095] The determination module 805 is configured to: in response to a successful match, determine that the corresponding first target object is the second target object.
[0096] In some embodiments, the invention further includes a trigger module configured to:
[0097] Responding to a triggering operation by a user;
[0098] A first interaction interface is displayed; wherein the first interaction interface shows a plurality of the first targets.
[0099] In some embodiments, the acquisition module 801 is further configured to:
[0100] Get the user's hand posture information;
[0101] The first interactive gesture is obtained according to the hand posture information using a posture recognition model; wherein the posture recognition model is a machine learning model.
[0102] In some embodiments, the number of the second targets is multiple and at least one second target corresponds to multiple preset gestures; the device is further configured to:
[0103] Obtain the user's second interaction gesture;
[0104] Matching the second interaction gesture with a preset gesture of the second target object;
[0105] In response to successful matching, the corresponding second object is determined to be the third object.
[0106] In some embodiments, the number of the second target is multiple; the device is further configured to:
[0107] Get the user's serial interaction gesture;
[0108] In response to the correspondence between the serial number represented by the serial interaction gesture and the order of the second targets, the corresponding second target is determined to be the third target; wherein the order refers to the position order of the plurality of second targets.
[0109] In some embodiments, the apparatus is further configured to:
[0110] In response to obtaining a confirmation gesture from the user, it is determined that the second target object meets a preset selection condition.
[0111] In some embodiments, the apparatus is further configured to:
[0112] In response to obtaining a return gesture from the user, return to the previous interaction interface.
[0113] In some embodiments, the apparatus further comprises an operation module configured to:
[0114] In response to determining that the second object or the third object satisfies a preset selection condition, a corresponding target operation is performed on the second object or the third object.
[0115] In some embodiments, the number of the second target or the third target is one, and the operation module is further configured to:
[0116] In response to determining that the target operation is grabbing a target object, the second target object or the third target object is moved to a target position; wherein the target position matches a position of an interaction gesture for determining the second target object or the third target object in a display screen.
[0117] In some embodiments, the preset gesture corresponds to a gesture of a user operating a first target object in a real scene.
[0118] For the convenience of description, the above device is described by dividing it into various modules according to its functions. Of course, when implementing the present disclosure, the functions of each module can be implemented in the same or multiple software and / or hardware.
[0119] The device of the above embodiment is used to implement the corresponding interaction method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.
[0120] The present disclosure provides an interactive method, which includes:
[0121] Get the user's first interaction gesture;
[0122] Matching the first interactive gesture with a preset gesture of each first target object; wherein the first target object corresponds to at least one preset gesture;
[0123] In response to a successful match, the corresponding first target object is determined to be the second target object.
[0124] In some embodiments, before the step of acquiring the user's first interaction gesture, the interaction method further includes:
[0125] Responding to a triggering operation by a user;
[0126] A first interaction interface is displayed; wherein the first interaction interface shows a plurality of the first targets.
[0127] In some embodiments, the step of obtaining the user's first interaction gesture specifically includes:
[0128] Get the user's hand posture information;
[0129] The first interactive gesture is obtained according to the hand posture information using a posture recognition model; wherein the posture recognition model is a machine learning model.
[0130] In some embodiments, the number of the second targets is multiple and at least one second target corresponds to multiple preset gestures;
[0131] The interaction method further comprises:
[0132] Obtain the user's second interaction gesture;
[0133] Matching the second interaction gesture with a preset gesture of the second target object;
[0134] In response to successful matching, the corresponding second object is determined to be the third object.
[0135] In some embodiments, the number of the second target objects is multiple;
[0136] The interaction method further comprises:
[0137] Get the user's serial interaction gesture;
[0138] In response to the correspondence between the serial number represented by the serial interaction gesture and the order of the second targets, the corresponding second target is determined to be the third target; wherein the order refers to the position order of the plurality of second targets.
[0139] In some embodiments, the interaction method further comprises:
[0140] In response to obtaining a confirmation gesture from the user, it is determined that the second target object meets a preset selection condition.
[0141] In some embodiments, the interaction method further comprises:
[0142] In response to obtaining a return gesture from the user, return to the previous interaction interface.
[0143] In some embodiments, the interaction method further comprises:
[0144] In response to determining that the second object or the third object satisfies a preset selection condition, a corresponding target operation is performed on the second object or the third object.
[0145] In some embodiments, the number of the second target object or the third target object is one, and the interaction method further includes: in response to determining that the target operation is to grab the target object, moving the second target object or the third target object to a target position; wherein the target position matches the position of the interaction gesture for determining the second target object or the third target object in the display screen.
[0146] In some embodiments, the preset gesture corresponds to a gesture of a user operating a first target object in a real scene.
[0147] The present disclosure also provides an interactive device, including:
[0148] An acquisition module is configured to: acquire a first interaction gesture of a user;
[0149] A screening module is configured to: match the first interactive gesture with a preset gesture of each first target object; wherein the first target object corresponds to at least one preset gesture;
[0150] The determination module is configured to: in response to a successful match, determine that the corresponding first target object is the second target object.
[0151] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the interaction method described in any of the above embodiments is implemented.
[0152] Fig. 9 A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.
[0153] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.
[0154] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.
[0155] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0156] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).
[0157] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).
[0158] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.
[0159] The electronic device of the above embodiment is used to implement the corresponding interaction method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.
[0160] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present disclosure also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the interactive method described in any of the above embodiments.
[0161] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0162] The computer instructions stored in the storage medium of the above embodiments are used to enable the computer to execute the interactive method described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.
[0163] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure further provides a computer program product, which includes a computer program. In some embodiments, the computer program is executed by one or more processors so that the processors execute the interaction method described in the above-mentioned embodiments.
[0164] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples. Based on the concept of the present disclosure, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present disclosure as described above, which are not provided in detail for the sake of simplicity.
[0165] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present disclosure difficult to understand, the known power / ground connections to the integrated circuit (IC) chips and other components may or may not be shown in the provided figures. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present disclosure difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present disclosure will be implemented (that is, these details should be fully within the scope of understanding of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present disclosure, it is apparent to those skilled in the art that the embodiments of the present disclosure can be implemented without these specific details or with changes in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.
[0166] Although the present disclosure has been described in conjunction with specific embodiments of the present disclosure, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
[0167] The embodiments of the present disclosure are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present disclosure should be included in the scope of protection of the present disclosure.
Claims
1. An interactive method, characterized in that: include: Get the user's first interaction gesture; Matching the first interactive gesture with a preset gesture of each first target object; wherein the first target object corresponds to at least one preset gesture; In response to a successful match, the corresponding first target object is determined to be the second target object.
2. The interactive method according to claim 1, characterized in that: Before the step of acquiring the first interaction gesture of the user, the interaction method further includes: Responding to a triggering operation by a user; A first interaction interface is displayed; wherein the first interaction interface shows a plurality of the first targets.
3. The interactive method according to claim 1, characterized in that: The step of obtaining the user's first interaction gesture specifically includes: Get the user's hand posture information; The first interactive gesture is obtained according to the hand posture information using a posture recognition model; wherein the posture recognition model is a machine learning model.
4. The interactive method according to claim 1, characterized in that: The number of the second targets is multiple and at least one second target corresponds to multiple preset gestures; The interaction method further comprises: Obtain the user's second interaction gesture; Matching the second interaction gesture with a preset gesture of the second target object; In response to a successful match, the corresponding second object is determined to be the third object.
5. The interactive method according to claim 1, characterized in that: The number of the second targets is multiple; The interaction method further comprises: Get the user's serial interaction gesture; In response to the correspondence between the serial number represented by the serial interaction gesture and the order of the second targets, the corresponding second target is determined to be the third target; wherein the order refers to the position order of the plurality of second targets.
6. The interactive method according to claim 1, characterized in that: The interaction method further comprises: In response to obtaining a confirmation gesture from the user, it is determined that the second target object meets a preset selection condition.
7. The interactive method according to claim 1, characterized in that: The interaction method further comprises: In response to obtaining a return gesture from the user, return to the previous interaction interface.
8. The interactive method according to claim 1, characterized in that: The interaction method further comprises: In response to determining that the second target object meets a preset selection condition, performing a corresponding target operation on the second target object; In response to determining that the target operation is grabbing a target object and the number of the second target objects is one, moving the second target object to a target position; wherein the target position matches a position of an interaction gesture for determining the second target object in a display screen.
9. The interactive method according to claim 4 or 5, characterized in that: The interaction method further comprises: In response to determining that the third target object satisfies a preset selection condition, performing a corresponding target operation on the third target object; In response to determining that the target operation is grabbing a target object and the number of the third target object is one, moving the third target object to a target position; wherein the target position matches a position of an interaction gesture for determining the third target object in a display screen.
10. The interactive method according to claim 1, characterized in that: The preset gesture corresponds to a gesture of a user operating the first target object in a real scene.
11. An interactive device, characterized in that: include: An acquisition module is configured to: acquire a first interaction gesture of a user; A screening module is configured to: match the first interactive gesture with a preset gesture of each first target object; wherein the first target object corresponds to at least one preset gesture; The determination module is configured to: in response to a successful match, determine that the corresponding first target object is the second target object.
12. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the interaction method according to any one of claims 1 to 10 is implemented.
13. A non-transitory computer-readable storage medium, characterized in that: The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the interactive method according to any one of claims 1 to 10.
14. A computer program product, characterized in that The method comprises computer program instructions, which, when executed on a computer, enable the computer to execute the interactive method according to any one of claims 1 to 10.