An interaction method, device, computer device and storage medium

Abstract

The present disclosure provides an interaction method and device, computer device and storage medium, wherein the method comprises: acquiring a real scene picture shot by a terminal; based on the real scene picture, determining and displaying an augmented reality (AR) picture in which a first virtual object and a plurality of second virtual objects are integrated into the real scene picture; the second virtual objects are objects to be grabbed by the first virtual object; the plurality of second virtual objects include second virtual objects with different attribute characteristics, and the grabbing difficulty corresponding to different attribute characteristics is different; in response to a target triggering operation, determining a target second virtual object to be grabbed from the plurality of second virtual objects; and displaying an AR picture in which the first virtual object grabs the target second virtual object.

Description

Technical Field

[0001] This disclosure relates to the field of augmented reality technology, and more specifically, to an interaction method, apparatus, computer device, and storage medium. Background Technology

[0002] For some object-grabbing interactive activities, the traditional approach is generally based on a two-dimensional interaction, and there is only one frontal view during the interaction process. Users cannot switch the view during the interaction, resulting in a poor user immersion experience.

[0003] With the increasing popularity of Augmented Reality (AR) technology, how to achieve immersive interactive processes based on AR technology has become a problem worthy of research. Summary of the Invention

[0004] This disclosure provides at least one interactive method, apparatus, computer device, and storage medium.

[0005] In a first aspect, embodiments of this disclosure provide an interaction method, including:

[0006] Acquire real-world scene images captured by the terminal;

[0007] Based on the real-world scene, an augmented reality (AR) image is determined and displayed after a first virtual object and multiple second virtual objects are integrated into the real-world scene; the second virtual object is the object to be grabbed by the first virtual object; the multiple second virtual objects include second virtual objects with different attribute characteristics, and the grabbing difficulty is different for different attribute characteristics.

[0008] In response to a target-triggered operation, determine the target second virtual object to be captured from multiple second virtual objects;

[0009] An AR scene is displayed showing the first virtual object grabbing the target second virtual object.

[0010] Based on the above embodiments, by integrating a first virtual object and multiple second virtual objects into a real-world scene captured by the terminal, and by including second virtual objects with different attributes and characteristics, each with varying grasping difficulties, an AR scene can be presented to the user after the target second virtual objects with different grasping difficulties are integrated into the real-world scene. Furthermore, based on the different grasping difficulties, the target second virtual object can be triggered from among the multiple second virtual objects. This AR-based object grasping interaction method allows users to immerse themselves in a three-dimensional real world by adjusting the real-world scene in real time and simultaneously presenting the corresponding virtual objects, enabling them to observe AR scene objects (including real-world and virtual objects) from various perspectives. Additionally, by presenting second virtual objects with different attributes and characteristics and configuring corresponding grasping difficulties, the diversity of interactive activities can be increased. This provides users with an immersive experience of truly performing related interactive processes in the real world, while also allowing for more interactive thinking, making object grasping interactive activities richer and more diverse.

[0011] In one optional implementation, the response target triggering operation, determining the target second virtual object to be captured from a plurality of second virtual objects, includes:

[0012] In response to the target trigger operation, the target second virtual object to be captured is determined based on the current shooting orientation of the terminal and the position information of each second virtual object in the real scene.

[0013] Here, the terminal's shooting orientation reflects the user's current orientation. Therefore, the second virtual object that the terminal's shooting orientation is aimed at can be considered as the second virtual object that the user intends to capture. Thus, the second virtual object whose location matches the terminal's shooting orientation can be used as the target second virtual object to be captured.

[0014] In one optional implementation, determining the target second virtual object to be captured based on the current shooting orientation of the terminal and the position information of each second virtual object in the real scene includes:

[0015] Based on the current shooting orientation of the terminal and the position information of each of the second virtual objects in the real scene, at least one candidate second virtual object matching the shooting orientation is determined;

[0016] If there is only one candidate second virtual object, then the candidate second virtual object shall be used as the target second virtual object;

[0017] When there are multiple candidate second virtual objects, the candidate second virtual object whose location in the real scene is closest to the terminal among the multiple candidate second virtual objects is taken as the target second virtual object.

[0018] In this implementation, if there are multiple candidate second virtual objects facing the terminal, that is, if there is an occlusion relationship between the multiple candidate second virtual objects, then the candidate second virtual object that is not currently occluded, that is, the candidate second virtual object whose position in the real scene is closest to the terminal, can be taken as the target second virtual object. This grasping and selection method conforms to the interaction rules in the real world.

[0019] In one optional implementation, determining and displaying the augmented reality (AR) image after the first virtual object and multiple second virtual objects are integrated into the real-world scene includes:

[0020] Based on the location information of the first virtual object and the plurality of second virtual objects in the real scene, and the capture scores that match the attribute features of each of the second virtual objects, the AR screen after the first virtual object and the plurality of second virtual objects are integrated into the real scene is determined and displayed;

[0021] The location of the first virtual object in the real-world scene matches the location of the terminal in the real-world scene.

[0022] This implementation allows users to intuitively experience the spatial stereoscopic effect of the first and second virtual objects in the AR screen, as well as the scoring of grabbing the second virtual object.

[0023] In one optional implementation, the step of displaying the AR screen showing the first virtual object grasping the target second virtual object includes:

[0024] An AR scene is displayed showing the first virtual object capturing the target second virtual object by launching a third virtual object.

[0025] This implementation method, by having a first virtual object launch a third virtual object to grab a target second virtual object, provides a way to perform the grabbing interaction process with the help of a third-party tool, thus enriching the interaction methods.

[0026] In one optional implementation, the augmented reality (AR) display of the first virtual object and multiple second virtual objects integrated into the real-world scene includes:

[0027] An AR image is displayed after the first virtual object and the plurality of second virtual objects are integrated into the real scene. An aiming mark is displayed in the AR image according to the current shooting orientation of the terminal. The aiming mark is used to indicate the grabbing direction of the first virtual object currently being aimed at.

[0028] In response to a change in the shooting orientation of the terminal, the aiming marker is moved to a different position in the AR image.

[0029] In this embodiment, while displaying the AR screen after the first virtual object and multiple second virtual objects are integrated into the real scene, an aiming mark is displayed in the AR screen according to the current shooting orientation of the terminal. Since the aiming mark is used to indicate the grabbing direction of the first virtual object currently being aimed, in the process of responding to the change of the terminal's shooting orientation, by displaying the aiming mark in the AR screen, that is, indicating the current aiming position of the first virtual object, a reference can be provided for the user to decide whether to adjust the shooting orientation and how to adjust the shooting orientation.

[0030] In one optional implementation, determining and displaying the augmented reality (AR) image after the first virtual object and multiple second virtual objects are integrated into the real-world scene image, based on the real-world scene image, includes:

[0031] Based on the real-world scene image, determine whether the real-world scene image matches the target scene type;

[0032] If a match is found, then based on the real-world scene, an AR image is determined and displayed showing the first virtual object and the plurality of second virtual objects integrated into the real-world scene.

[0033] In this implementation, the AR screen showing the first virtual object and multiple second virtual objects integrated into the real scene will only be displayed when the real scene screen matches the target scene type. That is, by limiting the scene type in which the AR screen is generated, the above process limits the interaction process to the matching scene type, thereby enabling the above interactive activities to be integrated into a more reasonable real scene and improving the sense of realism.

[0034] In one optional implementation, determining and displaying the augmented reality (AR) image after the first virtual object and multiple second virtual objects are integrated into the real-world scene image, based on the real-world scene image, includes:

[0035] Based on the real-world scene, determine and display the AR image after the first part of the second virtual objects in the first and second virtual object sets are integrated into the real-world scene;

[0036] In response to changes in the terminal's shooting posture, based on the updated real-world scene image, the AR image after the second part of the second virtual objects in the second virtual object set is integrated into the real-world scene image is determined and updated; there are at least some differences between the first part of the second virtual objects and the second part of the second virtual objects.

[0037] This implementation, based on a real-world scene, can display an AR image showing the integration of a first portion of the second virtual objects from the second set into the real-world scene; that is, a portion of the second virtual objects is displayed in the AR image. Subsequently, in response to changes in the terminal's shooting posture, such as when the user adjusts the terminal's shooting angle, the currently captured real-world scene is updated, thereby updating the second virtual objects displayed in the AR image. In this way, AR technology transforms a planar interaction process into a spatial interaction process, allowing users to perform mobile interaction within space, further enhancing the user's immersive interactive experience.

[0038] Secondly, embodiments of this disclosure also provide an interactive device, including:

[0039] The acquisition module is used to acquire images of the real-world scene captured by the terminal.

[0040] The first display module is used to determine and display an augmented reality (AR) image after a first virtual object and multiple second virtual objects are integrated into the real-world scene image, based on the real-world scene image; the second virtual object is an object to be captured by the first virtual object; the multiple second virtual objects include second virtual objects with different attribute characteristics, and the capture difficulty is different for different attribute characteristics;

[0041] The determination module is used to respond to target triggering operations and determine the target second virtual object to be captured from multiple second virtual objects;

[0042] The second display module is used to display an AR scene of the first virtual object grabbing the target second virtual object.

[0043] In one optional implementation, the determining module is configured to respond to a target triggering operation and determine the target second virtual object to be captured based on the current shooting orientation of the terminal and the position information of each second virtual object in the real scene.

[0044] In one optional implementation, the determining module is configured to determine at least one candidate second virtual object that matches the shooting orientation based on the current shooting orientation of the terminal and the position information of each second virtual object in the real scene;

[0045] If there is only one candidate second virtual object, then the candidate second virtual object shall be used as the target second virtual object;

[0046] When there are multiple candidate second virtual objects, the candidate second virtual object whose location in the real scene is closest to the terminal among the multiple candidate second virtual objects is taken as the target second virtual object.

[0047] In one optional implementation, the first display module is used to determine and display an AR image of the first virtual object and the plurality of second virtual objects integrated into the real scene based on the location information of the first virtual object and the plurality of second virtual objects in the real scene, and the capture score that matches the attribute features of each of the second virtual objects respectively.

[0048] The location of the first virtual object in the real-world scene matches the location of the terminal in the real-world scene.

[0049] In one optional implementation, the second display module is used to display an AR scene of the first virtual object capturing the target second virtual object by emitting a third virtual object.

[0050] In one optional implementation, the first display module is used to display an AR image after the first virtual object and the plurality of second virtual objects are integrated into the real scene, and to display an aiming mark in the AR image according to the current shooting orientation of the terminal, wherein the aiming mark is used to indicate the grabbing direction of the first virtual object currently being aimed at;

[0051] In response to a change in the shooting orientation of the terminal, the aiming marker is moved to a different position in the AR image.

[0052] In one optional implementation, the first display module is used to determine whether the real-world scene image matches the target scene type based on the real-world scene image;

[0053] If a match is found, then based on the real-world scene, an AR image is determined and displayed showing the first virtual object and the plurality of second virtual objects integrated into the real-world scene.

[0054] In one optional implementation, the first display module is used to determine and display an AR image of a first portion of the second virtual objects in the first set of virtual objects and the second set of virtual objects after they have been integrated into the real scene image, based on the real scene image.

[0055] In response to changes in the terminal's shooting posture, based on the updated real-world scene image, the AR image after the second part of the second virtual objects in the second virtual object set is integrated into the real-world scene image is determined and updated; there are at least some differences between the first part of the second virtual objects and the second part of the second virtual objects.

[0056] Thirdly, embodiments of this disclosure also provide a computer device, including: a processor, a memory, and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor communicates with the memory via the bus, and when the machine-readable instructions are executed by the processor, they perform the steps of the first aspect above, or any possible interaction method in the first aspect.

[0057] Fourthly, embodiments of this disclosure also provide a computer-readable storage medium storing a computer program that, when executed by a processor, performs the steps of the first aspect or any possible interaction method described in the first aspect.

[0058] For a description of the effects of the aforementioned interactive device, computer equipment, and storage medium, please refer to the description of the interactive method above; it will not be repeated here.

[0059] To make the above-mentioned objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0060] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings used in the embodiments will be briefly described below. These drawings are incorporated in and constitute a part of this specification. They illustrate embodiments conforming to this disclosure and, together with the specification, serve to explain the technical solutions of this disclosure. It should be understood that the following drawings only show some embodiments of this disclosure and should not be considered as limiting the scope. Those skilled in the art can obtain other related drawings based on these drawings without creative effort.

[0061] Figure 1 A flowchart of an interaction method provided by an embodiment of this disclosure is shown;

[0062] Figure 2 A schematic diagram of an interactive activity page for object crawling provided in an embodiment of this disclosure is shown;

[0063] Figure 3 A schematic diagram illustrating an AR image showing the captured score and weight, provided in an embodiment of this disclosure, is shown.

[0064] Figure 4 This illustration shows a flowchart of a specific implementation of the AR screen provided in this disclosure, which determines and displays an AR screen after a first virtual object and multiple second virtual objects are integrated into a real-world scene.

[0065] Figure 5 A schematic diagram of an interactive device provided in an embodiment of this disclosure is shown;

[0066] Figure 6 A schematic diagram of the structure of a computer device provided in an embodiment of this disclosure is shown. Detailed Implementation

[0067] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. The components of the embodiments of this disclosure described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure.

[0068] Furthermore, the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than that illustrated or described herein.

[0069] In this article, "multiple or several" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0070] With the gradual popularization of AR technology, the interactive forms of augmented reality content have become more diversified. How to make reasonable use of the unique interactive forms of augmented reality to create an immersive interactive experience is an urgent problem to be solved.

[0071] This disclosure presents an AR interaction method for "object grabbing" activities. Traditional interaction methods for object grabbing are planar and offer only a single frontal view, preventing players from switching perspectives during gameplay. The AR-based object grabbing interaction method proposed in this disclosure adjusts the real-world scene in real-time and simultaneously presents corresponding virtual objects, immersing users in a three-dimensional real-world environment to perform the interaction and observe AR scene objects (including real-world and virtual objects) from various perspectives. Furthermore, by presenting second virtual objects with different attributes and configuring corresponding grabbing difficulty, users are given more interactive thinking time, making object grabbing interactions richer and more diverse.

[0072] The shortcomings of the above solutions are the result of the inventor's practical experience and careful research. Therefore, the discovery process of the above problems and the solutions proposed in this disclosure below should be considered as the inventor's contribution to this disclosure.

[0073] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0074] The interactive method provided in this invention can be applied to object-grabbing interactive activities, such as activities where users grab virtual items to accumulate points. During the interaction, users can grab virtual items by adjusting the grabbing direction of the virtual grabber in the AR screen. For example, users can adjust the current shooting orientation of the terminal to aim at the virtual item. In response to the grabbing operation, the user can use the virtual grabber to grab the targeted virtual item. The grabbing process is displayed in the game screen based on the difficulty of grabbing the virtual item.

[0075] The following provides a detailed description of an interaction method disclosed in this embodiment. The execution subject of the interaction method provided in this embodiment is generally a computer device with certain computing capabilities. This computer device may include, for example, a terminal device or other processing device. The terminal device may be a user equipment (UE), mobile device, user terminal, handheld device, computing device, vehicle-mounted device, wearable device, etc. In some possible implementations, this interaction method can be implemented by a processor calling computer-readable instructions stored in memory.

[0076] The following describes the interaction method provided in the embodiments of this disclosure, taking the terminal device as the execution subject as an example.

[0077] See Figure 1The diagram shows a flowchart of an interaction method provided in an embodiment of this disclosure. The method includes steps S101 to S104, wherein:

[0078] S101: Acquire real-world scene images captured by the terminal.

[0079] In this step, the terminal can be any of the aforementioned terminal devices capable of supporting AR image display, such as mobile phones, tablets, and other devices with camera functions. During the execution of this embodiment, the terminal's camera (primarily referring to the rear camera capturing the scene) needs to be activated to acquire real-time information about the real-world scene. The real-world scene image is the actual image of the user's current location captured by the handheld terminal.

[0080] S102: Based on the real-world scene, determine and display the augmented reality (AR) scene after the first virtual object and multiple second virtual objects are integrated into the real-world scene; the second virtual object is the object to be captured by the first virtual object; the multiple second virtual objects contain second virtual objects with different attribute characteristics, and the capture difficulty is different for different attribute characteristics.

[0081] The first virtual object can be an object used to grasp the second virtual object; the position of the first virtual object in the real scene can be matched with the position of the terminal in the real scene. Multiple second virtual objects can include second virtual objects with different attributes and characteristics. These attributes and characteristics can include information about the second virtual object that can be intuitively perceived by observing it in the AR screen, such as its shape, color, size, and special effects. Attributes and characteristics can also include feature information of the second virtual object presented in digital form in the AR screen; this type of feature information is usually not obtainable by observing the second virtual object, such as its weight, grasping distance, and grasping duration.

[0082] Regarding the shape attribute, the second virtual object can include virtual objects of any preset shape, such as spheres, cubes, cuboids, and irregular shapes. Regarding the color attribute, the second virtual object can include virtual objects of any preset color, such as red, yellow, and blue. Regarding the size attribute, taking a sphere as an example, the second virtual object can include spheres of different sizes. Regarding the special effects attribute, the second virtual object can include virtual objects with different flashing frequencies. Attributes such as weight, gripping distance, and gripping duration can be represented using pre-set parameter information, which will not be detailed here.

[0083] Based on the aforementioned attributes, different attributes correspond to different grasping difficulties, which can be reflected in the time and / or speed at which the first virtual object grasps the second virtual object. For example, the larger the volume and / or the heavier the second virtual object, the longer the grasping time. Alternatively, second virtual objects with pre-set target shapes, pre-set target effects, or pre-set target colors will have longer grasping times compared to those with other attributes.

[0084] See Figure 2 The diagram illustrates an interactive activity page for object grasping. The first virtual object can be a virtual grasper, and the second virtual object can be spherical ores of different sizes. The position of the first virtual object in the real-world scene corresponds to the position of the terminal in the real-world scene. As the user adjusts the terminal's shooting posture in the real-world scene—for example, changing the shooting angle—the terminal's current shooting orientation can be changed (it should be noted that changing the current shooting orientation here refers to changing the shooting orientation under a different shooting angle, not changing from rear-camera shooting to front-camera shooting). Under this shooting orientation, combined with the position of the virtual grasper in the real-world scene, the virtual grasper can aim at the corresponding position in the real-world scene (specifically, it can be a ray range, such as...). Figure 2 (as shown by the dotted line) is a virtual ore to be grabbed. When grabbing a virtual ore, the grabbing difficulty can be determined based on the attribute characteristics of the virtual ore. Then, the virtual ore is grabbed at the grabbing speed corresponding to the grabbing difficulty. The grabbing time or the interaction time of the entire grabbing process is matched with the grabbing difficulty and grabbing speed.

[0085] The system integrates first and second virtual objects into a real-world scene. Specifically, it loads a pre-stored virtual scene based on the real-world scene. This virtual scene can include a first virtual object matching the terminal's position in the real-world scene, and multiple second virtual objects with fixed relative positions in the real-world scene. The positions of these multiple second virtual objects form a position array. This position array can include the position information of each second virtual object in the virtual scene, representing the relative positional relationships between them. Then, the first virtual object is loaded into the real-world scene according to the terminal's position, and the second virtual objects are loaded according to the position array. This allows the AR image after the first virtual object and multiple second virtual objects are integrated into the real-world scene to be determined and displayed.

[0086] S103: In response to the target trigger operation, determine the target second virtual object to be captured from multiple second virtual objects.

[0087] Target triggering operations can include, but are not limited to, clicks, double clicks (including double and triple clicks and above), swipes, etc. Target triggering operations can include the user triggering any location on the AR screen displayed on the terminal, or the user clicking on a first virtual object displayed on the terminal screen to request the first virtual object to grab a target second virtual object.

[0088] In practice, in response to the target trigger operation, the target second virtual object to be captured is determined based on the current shooting orientation of the terminal and the position information of each second virtual object in the real scene.

[0089] The target second virtual object can be the second virtual object pointed to by the terminal's current shooting orientation. The terminal's current shooting orientation can refer to the orientation of the rear camera within the terminal, which can be detected using a motion detection device installed inside the terminal. This motion detection device can include a gyroscope-based isoangular motion detection device, which can detect changes in the device's shooting angle to determine the terminal's current shooting orientation.

[0090] In practical implementation, after loading a virtual scene into the real-world scene, multiple second virtual objects are distributed within the real-world scene. The position information of each second virtual object in the real-world scene is fixed. The position information of each second virtual object from the current shooting perspective of the terminal can be directly obtained based on the loaded scene information. If the position of the first virtual object in the real-world scene matches the position of the terminal in the real-world scene, the terminal's current shooting orientation can be the grasping orientation of the first virtual object in the real-world scene. Then, based on the position information of each second virtual object in the real-world scene and the grasping orientation of the first virtual object, the target second virtual object to be grasped can be determined. For example, the second virtual object indicating the grasping orientation can be used as the target second virtual object to be grasped. See [link to relevant documentation]. Figure 2 As shown, the second virtual object to be grasped, which is the orientation indicator, includes the second virtual object A and the second virtual object B.

[0091] Here, the terminal's shooting orientation reflects the user's current orientation. Therefore, the second virtual object that the terminal's shooting orientation is aimed at can be considered as the second virtual object that the user intends to capture. Thus, the second virtual object whose location matches the terminal's shooting orientation can be used as the target second virtual object to be captured.

[0092] The second virtual object can have a certain spatial range, and the position information of each second virtual object can be a three-dimensional position range. At this time, there may be occlusion relationships between multiple candidate second virtual objects. That is, the grabbing orientation of the first virtual object in the real scene may correspond to one or more second virtual objects. Based on this, the target second virtual object is determined. In some embodiments, at least one candidate second virtual object matching the shooting orientation can be determined according to the current shooting orientation of the terminal and the position information of each second virtual object in the real scene. When there is only one candidate second virtual object, the candidate second virtual object is taken as the target second virtual object. When there are multiple candidate second virtual objects, the candidate second virtual object whose position in the real scene is closest to the terminal is taken as the target second virtual object.

[0093] Here, if there are multiple candidate second virtual objects facing the terminal, that is, if there is an occlusion relationship between the multiple candidate second virtual objects, then the candidate second virtual object that is not currently occluded, that is, the candidate second virtual object whose position in the real scene is closest to the terminal, can be taken as the target second virtual object. This grasping and selection method conforms to the interaction rules in the real world.

[0094] In practical implementation, the current shooting orientation of the terminal can be used as the grasping direction of the first virtual object. Along this grasping direction, a second virtual object located along the grasping direction can be considered as a candidate second virtual object. For example, it can be understood as using the position of the first virtual object in the real-world scene as a reference, and drawing a ray along the grasping direction; the second virtual object hit by this ray is considered a candidate second virtual object. Figure 2 The virtual object A and the second virtual object B are shown in the figure.

[0095] If there is only one candidate second virtual object, that candidate second virtual object can be used as the target second virtual object. If there are multiple candidate second virtual objects, one target second virtual object can be selected from among them. One selection method is to determine the distance between each candidate second virtual object and the terminal in the real scene based on the corresponding positions of each second virtual object and the terminal in the real scene; the candidate second virtual object with the closest distance between its corresponding position in the real scene and the terminal is selected as the target second virtual object, i.e., the candidate second virtual object that is closest to the screen. Another selection method is to select the candidate second virtual object with the largest display area in the AR screen as the target second virtual object.

[0096] S104: Display the AR screen of the first virtual object grabbing the target second virtual object.

[0097] In a specific implementation, the first virtual object can leave its original position. That is, the first virtual object starts from the current position of the terminal in the AR screen, moves along the grasping direction to the position of the target second virtual object, and grasps the target second virtual object. After that, the first virtual object can return to its original position in the opposite direction of the original grasping direction.

[0098] During the process of the first virtual object grasping the target second virtual object and returning, the grasping difficulty can be determined based on the attribute characteristics of the grasped target second virtual object, such as shape, color, size, special effects, and weight. Based on the corresponding grasping difficulty, an AR scene of the first virtual object grasping the target second virtual object is displayed. For example, for a target second virtual object that is larger and heavier, the grasping difficulty is greater, and the AR scene can show the user a longer grasping time and slower return process.

[0099] Here, you can pre-set the grasping difficulty corresponding to different attributes and characteristics, and you can pre-set the effect displayed in the AR screen for different grasping difficulties, that is, the duration and / or speed. For example, if the grasping difficulty level is level 1, the corresponding grasping time is 3 seconds; if the grasping difficulty level is level 2, the corresponding grasping time is 8 seconds; if the grasping difficulty level is level 3, the corresponding grasping time is 13 seconds; if the grasping difficulty level is level 4, the corresponding grasping time is 18 seconds, and so on.

[0100] Alternatively, you can directly set the effect of the second virtual object with different attributes and characteristics in the AR screen during the grabbing process.

[0101] The aforementioned method of using a first virtual object to grab a second virtual object, besides grabbing the target second virtual object from its original position, can also grab the target second virtual object by launching a third virtual object. This provides a way to perform the grabbing interaction process using a third-party tool, enriching the interaction methods. In some embodiments, an AR scene is displayed showing the first virtual object grabbing the target second virtual object by launching a third virtual object.

[0102] Here, the third virtual object can include special effects emitted by the first virtual object, such as capturing the target second virtual object by launching a net-like object; or hitting and dragging the target second virtual object by firing a ray. Alternatively, the third virtual object can also include an object with grasping capabilities, such as a virtual sub-grabber, by which the first virtual object captures the target second virtual object. The above-mentioned methods of performing the grasping interaction process with the help of third-party tools can enrich the user's interaction methods and thus improve the user's interactive experience.

[0103] Here, for the process from the original position to the position corresponding to the second virtual object, the movement duration and / or speed can be a pre-set standard duration and / or standard speed; for the grasping and returning process, if the grasping difficulty corresponding to the second virtual object is relatively high, the return grasping duration is longer than the standard duration, and / or the grasping speed is slower than the standard uniform speed.

[0104] In steps S101 to S104 above, a first virtual object and multiple second virtual objects are integrated into the real-world scene captured by the terminal. These multiple second virtual objects contain second virtual objects with different attributes and characteristics, and the grasping difficulty varies for each attribute and characteristic. Based on this, during AR interaction, the real-world scene can be adjusted in real time to synchronously present the corresponding virtual objects, allowing users to immerse themselves in the three-dimensional real world to perform related interactive processes and observe AR scene objects (including real-world and virtual objects) from various perspectives. In addition, by presenting second virtual objects with different attributes and characteristics and configuring corresponding grasping difficulty for them, users can have more interactive thinking processes, increasing the diversity of interactive activities.

[0105] For S102, determine and display the AR screen after the first virtual object and multiple second virtual objects are integrated into the real scene. The AR screen can also display grabbing interaction information for the second virtual objects, such as the grabbing score after grabbing the second virtual object.

[0106] In addition, the attributes of the second virtual object can be displayed, such as some attributes that characterize the difficulty of grasping the second virtual object, such as weight, grasping time and grasping distance.

[0107] For example, the aforementioned capture duration can be matched with the attribute characteristics presented by the second attribute object. For instance, the larger the size of the second virtual object, the longer the capture duration; the longer the capture duration of the second virtual object with target effects, or different target effects have corresponding capture durations; the longer the capture duration of the second virtual object with target color, or different target colors have corresponding capture durations; different shapes are set to correspond to different capture durations, and so on.

[0108] In some embodiments, the AR image after the first virtual object and multiple second virtual objects are integrated into the real scene can be determined and displayed based on the location information of the first virtual object and multiple second virtual objects in the real scene, as well as the capture scores that are matched with the attribute features of each second virtual object.

[0109] The location of the first virtual object in the real scene can be matched with the location of the terminal in the real scene; in the AR screen, the capture score corresponding to each second virtual object is displayed at the location corresponding to that second virtual object.

[0110] The position of the terminal in the real scene can be determined using a motion detection device, and the position of the first virtual object in the real scene can be the position of the terminal in the real scene.

[0111] Based on the attribute characteristics of each second virtual object, a capture score can be set separately to match each second virtual object. The capture scores corresponding to different attribute characteristics can be different.

[0112] For example, the larger the size, the heavier the weight, and the farther the grabbing distance of the second virtual object, the higher the grabbing score; the second virtual object with target effects has a high grabbing score, or different target effects are set with corresponding grabbing scores; the second virtual object with target color has a high grabbing score, or different target colors are set with corresponding grabbing scores; different shapes are set with different grabbing scores, and so on.

[0113] Based on the real-world scene, a pre-stored virtual scene is loaded. The first virtual object can be displayed in the real-world scene according to the position of the terminal in the real-world scene, and the second virtual object can be displayed in the real-world scene according to the position array. The corresponding capture score and preset attribute features (such as weight, capture time, etc.) are displayed at the corresponding positions of each second virtual object.

[0114] The location corresponding to the second virtual object mentioned above can be the second virtual object itself, or an information box near the location of the second virtual object, etc. Any way that can display information on the page should fall within the technical scope to be protected by the embodiments of this disclosure, and the above-mentioned information display methods will not be listed one by one.

[0115] See Figure 3 As shown, it is a schematic diagram of an AR screen displaying the score and weight of the captured object. Figure 3The dataset includes second virtual objects with various attributes and characteristics. For example, there might be a second virtual object C with the same size and weight; or a second virtual object D with the same size and weight but different target effects. Therefore, the capture scores of the second virtual object D and the second virtual object E can be preset to be different. Here, the target effects are represented by different colors, meaning that the second virtual object D with a darker color scores higher than the second virtual object E with a lighter color.

[0116] By displaying the score and weight of the second virtual object, users can intuitively feel the score and difficulty of grasping the second virtual object, thus enhancing their immersive AR game interaction experience.

[0117] For S102, an AR screen is displayed showing the first virtual object and multiple second virtual objects integrated into a real-world scene. This AR screen can also display an aiming marker used by the first virtual object for aiming and launching. This aiming marker can be used to indicate the current grabbing direction of the first virtual object.

[0118] In some embodiments, an AR screen is displayed after the first virtual object and multiple second virtual objects are integrated into the real scene, and an aiming marker is displayed in the AR screen according to the current shooting orientation of the terminal; in response to changes in the shooting orientation of the terminal, the position of the aiming marker in the AR screen is moved.

[0119] In practice, the current shooting orientation of the terminal can be used as the grabbing direction of the first virtual object in the AR screen. Based on the position of the first virtual object in the real scene, the position information of the aiming mark in the real scene can be determined along the grabbing direction. In response to the change of the terminal's shooting orientation, the position information of the aiming mark in the real scene along the grabbing direction will change, that is, the position of the moving aiming mark in the AR screen will change.

[0120] In other embodiments, an AR screen is displayed after the first virtual object and multiple second virtual objects are integrated into the real scene, and an aiming marker is displayed at the target position on the screen; in response to changes in the shooting orientation of the terminal, the captured real scene is updated, and then the updated AR screen corresponding to the current real scene is determined. At this time, the aiming marker can indicate the position in the updated AR screen at the target position on the screen, that is, the position that the aiming marker aims at in the updated AR screen after moving.

[0121] While displaying the AR screen showing the first virtual object and multiple second virtual objects integrated into the real-world scene, the AR screen also displays an aiming marker based on the current shooting orientation of the terminal. Since the aiming marker is used to indicate the grabbing direction of the first virtual object currently being aimed at, displaying the aiming marker in the AR screen, that is, indicating the current aiming position of the first virtual object, can provide a reference for the user to decide whether to adjust the shooting orientation and how to adjust the shooting orientation in response to changes in the terminal's shooting orientation.

[0122] For S102, based on the real-world scene, determining and displaying the AR image after the first virtual object and multiple second virtual objects are integrated into the real-world scene can include the following determination methods.

[0123] Method 1: Virtual scenes and real scenes do not have a fixed correspondence; that is, a virtual scene can be loaded into any real scene corresponding to any captured real scene image.

[0124] In this case, the relative three-dimensional position information corresponding to the above-mentioned position array of each second virtual object in the virtual scene to be loaded can be preset. The relative three-dimensional position information here can be the relative three-dimensional position information relative to the target real scene position presented at a certain fixed position on the screen (such as the upper left corner of the screen or the center point of the screen). Based on the world coordinate position information corresponding to the target real scene position and the relative three-dimensional position information, the world coordinate position information of each second virtual object can be obtained, that is, the position information of each second virtual object integrated into the real scene screen can be obtained, so that each second virtual object integrated into the real scene screen can be presented.

[0125] Method 2: The scene types of virtual scenes and real-world scenes can have a fixed correspondence, meaning that virtual scenes can only be loaded within real-world scene footage of the target scene type. Here, the target scene type can be the real-world scene type used to pre-build the virtual scene.

[0126] In practice, based on the real-world scene, it is determined whether the real-world scene matches the target scene type; if it matches, then based on the real-world scene, the AR scene after the first virtual object and multiple second virtual objects are integrated into the real-world scene is determined and displayed.

[0127] Target scene types can include real-world scene types such as tourist attractions, streets, parks, shopping malls, and AR game experience centers.

[0128] The system can extract image features from real-world scenes and use visual detection technology to determine if a target scene type matches the image features. If a match is found, the real-world scene corresponding to the image can be identified as belonging to the target scene type. At this point, a virtual scene matching the target scene type can be obtained and directly loaded into the real-world scene corresponding to the target scene type. Specifically, multiple second virtual objects can be loaded into the real-world scene according to the position array in the virtual scene, and the first virtual object can be loaded into the real-world scene according to the position of the terminal in the real-world scene. The system can then determine and display the AR image after the first virtual object and multiple second virtual objects are integrated into the real-world scene corresponding to the target scene type.

[0129] Here, when the scene types of virtual scenes and real scenes have a fixed correspondence, the specific positional relationship between virtual scenes and real scenes can be either a fixed correspondence or a relatively fixed one.

[0130] Fixed correspondence means that the world coordinate position information of the virtual scene and the world coordinate position information of the real scene have a fixed correspondence relationship (that is, each second virtual object in the virtual scene has a unique world coordinate position in the real scene). For example, the virtual scene can be a virtual space that restores the real scene one-to-one, and the shape and size of the virtual space are the same as the real scene. Based on the above fixed correspondence relationship, loading the virtual scene, specifically, can directly obtain the position array of each second virtual object in the virtual scene to be loaded. Based on the world coordinate position information of the real scene corresponding to the currently captured real scene image, the position array of each second virtual object, and the fixed correspondence relationship between the virtual scene and the real scene (specifically, the world coordinate position of any second virtual object in the virtual scene in the real scene can be preset, so that, combined with the relative position relationship between each second virtual object indicated in the position array, the world coordinate position of each second virtual object in the real scene can be obtained), the world coordinate position information of each second virtual object can be obtained, that is, the position information of each second virtual object integrated into the real scene image, so that each second virtual object integrated into the real scene can be presented.

[0131] "Relatively fixed" means that although the virtual scene and the target scene type are bound, the specific display position of the virtual scene does not have to be fixed in a specific position in the real scene corresponding to the target scene type, allowing for a certain degree of flexibility. With this flexibility, the position information of each second virtual object in the virtual scene within the real scene can refer to the method described above for determining the position when there is no fixed correspondence between the virtual scene and the real scene. If the specific display position of each second virtual object in the virtual scene is fixed in a specific position in the real scene corresponding to the target scene type, then the second virtual object corresponding to that specific position can only be displayed when that specific position in the real scene corresponding to the target scene type is captured.

[0132] Whether it is a fixed correspondence or a relatively fixed one, when the first virtual object is presented in the real scene, it can be presented in a way that integrates into the real scene according to the position of the terminal in the real scene. After the first virtual object is loaded, it remains unchanged, that is, it will not disappear from the AR screen.

[0133] As mentioned above, the AR screen showing the first virtual object and multiple second virtual objects integrated into the real-world scene will only be displayed if the real-world scene matches the target scene type. In other words, by limiting the scene type in which the AR screen is generated, the interaction process is restricted to the matching scene type, thereby allowing the interactive activities to be integrated into a more reasonable real-world scene and improving the sense of realism.

[0134] Regarding S102, in some embodiments, due to the limited real-world scene images captured by the terminal, the second virtual object after the virtual scene is loaded may not be fully displayed in the real-world scene image. Subsequently, as the terminal's shooting posture changes, the user can capture different real-world scene images with the handheld terminal, and different AR images will be displayed on the screen.

[0135] For details, please refer to [link / reference]. Figure 4 As shown, it is a flowchart illustrating the specific implementation process of AR screen displaying the first virtual object and multiple second virtual objects integrated into the real-world scene.

[0136] S401: Based on the real-world scene, determine and display the AR image after the first part of the second virtual object in the first and second virtual object sets is integrated into the real-world scene.

[0137] The first part of the second virtual object may include a portion of the second virtual objects in the set of second virtual objects.

[0138] In practice, a pre-stored virtual scene can be loaded based on the real-world scene, which in turn loads multiple second virtual objects within a position array set in that virtual scene. After loading according to the position array, the AR image after the multiple second virtual objects are integrated into the real-world scene can be determined and displayed.

[0139] In some embodiments, virtual scenes and real-world scenes may not have a fixed correspondence; that is, virtual scenes can be loaded into any real-world scene captured in a photograph.

[0140] In this case, the relative position information corresponding to the aforementioned position array of each second virtual object in the pre-set second virtual object set can be directly obtained. This relative position information can be the relative three-dimensional position information relative to the target real-world scene position presented at a fixed location on the screen. Based on the world coordinate position information corresponding to the target real-world scene position, and the relative three-dimensional position information, the world coordinate position information of the first part of the second virtual object to be presented on the screen can be obtained, that is, the position information of the first part of the second virtual object integrated into the real-world scene. Loading the first part of the second virtual object according to this position information allows the first part of the second virtual object to be presented in the real-world scene. Simultaneously, the position of the terminal in the real-world scene is used as the position of the first virtual object in the real-world scene. Then, according to the position of the first virtual object in the real-world scene, the first virtual object integrated into the real-world scene is presented, thereby determining and displaying the AR screen after the first part of the second virtual object in the first and second virtual object sets is integrated into the real-world scene.

[0141] In other embodiments, the virtual scene and the real-world scene type can have a fixed correspondence; that is, the virtual scene can only be loaded when the real-world scene type corresponding to the captured real-world scene image matches the target scene type. Here, the real-world scene under the target scene type can be a real-world scene used to pre-build the virtual scene.

[0142] In practice, based on the real-world scene, it is determined whether the real-world scene matches the target scene type; if it matches, then based on the real-world scene, the AR screen after the first part of the second virtual object in the first and second virtual object sets is integrated into the real-world scene is determined and displayed.

[0143] Here, when there is a fixed correspondence between virtual and real scene types, the positional relationship between virtual and real scenes can be either fixed or relatively fixed.

[0144] Taking the fixed correspondence between the virtual scene and the real scene as an example, given that the real scene is a game experience hall, and the captured image of the real scene is a part of the game experience hall, this part of the image can be identified to determine the world coordinate position information of the game experience hall captured at the moment, that is, the spatial range of the game experience hall that can be displayed on the current screen. The position array of each second virtual object in the second set of virtual objects in the virtual scene is obtained. According to the position correspondence between the virtual scene and the game experience hall, the world coordinate position information of the first part of the second virtual objects that can be displayed on the current screen is determined, that is, the position information of the first part of the second virtual objects. The first part of the second virtual objects is loaded according to this position information, and the first part of the second virtual objects can be displayed in the real scene image. At the same time, the position of the terminal in the real scene is used as the position of the first virtual object in the real scene. Then, according to the position of the first virtual object in the real scene, the first virtual object integrated into the real scene image is displayed, and thus the AR image after the first part of the second virtual objects in the first set of virtual objects and the second set of virtual objects are integrated into the real scene image is determined and displayed.

[0145] Since the second virtual object has a certain spatial range, within the space of the game experience hall that the current screen can display, it is possible to display part of the second virtual object in the first part, while the remaining part of the second virtual object is obscured. The full display of the second virtual object can be achieved by adjusting the position of the real scene image captured.

[0146] S402: In response to changes in the terminal's shooting posture, based on the updated real-world scene image, determine and update the AR image of the second part of the second virtual object set after it is integrated into the real-world scene image.

[0147] Among them, there may be at least some differences between the second virtual object in the first part and the second virtual object in the second part.

[0148] Here, the change in the terminal's shooting posture can be caused by the user changing the shooting angle while holding the terminal, or by performing actions such as moving forward, backward, turning left, or turning right in different positions and postures.

[0149] The motion detection device built into the terminal device can be used to determine whether the terminal is moving. If it is moving, it means that the shooting posture has changed; if it is not moving, it means that the shooting posture has not changed. Here, the motion detection device can include devices such as gyroscopes and odometers. For example, if the gyroscope detects a change in the terminal angle and / or the odometer records a displacement of the terminal, it can be determined that the terminal's shooting posture has changed, and thus it can be determined that the real scene image captured by the terminal has been updated, and the updated real scene image can be obtained.

[0150] Based on the updated real-world scene, determine and update the AR screen showing the second part of the second virtual objects in the second set of virtual objects integrated into the real-world scene. Alternatively, refer to the above implementation method for determining the initial AR screen.

[0151] In some embodiments, if there is no fixed correspondence between the virtual scene and the real scene, and the virtual scene has already been loaded into the real scene, the position information of the second part of the second virtual object to be displayed in the real scene after the update can be determined based on the relative three-dimensional position information of the second part of the second virtual object and the position information of the first part of the second virtual object displayed in the AR screen before the update being integrated into the real scene. The second part of the second virtual object is loaded according to the position information of the second part of the second virtual object, and the second part of the second virtual object integrated into the real scene can be presented. At the same time, the position of the terminal in the real scene is used as the position of the first virtual object in the real scene. Then, according to the position of the first virtual object in the real scene, the first virtual object integrated into the real scene is presented, thereby determining and updating the AR screen after the second part of the second virtual object in the second virtual object set is integrated into the real scene.

[0152] In other embodiments, if the positional relationship between the virtual scene and the real scene is fixed and the virtual scene has already been loaded into the real scene, the world coordinate position information corresponding to the updated real scene image can be determined based on the updated real scene image, that is, the spatial range of the real scene that can be presented on the current screen. The position array of each second virtual object in the virtual scene can be obtained. According to the positional correspondence between the virtual scene and the real scene, the world coordinate position information of the second part of the second virtual object that can be presented on the current screen can be determined, that is, the position information of the second part of the second virtual object. The second part of the second virtual object is loaded according to the position information of the second part of the second virtual object. The second part of the second virtual object can be presented in a specific real scene image. At the same time, the position of the terminal in the real scene is used as the position of the first virtual object in the real scene. Then, according to the position of the first virtual object in the real scene, the first virtual object integrated into the real scene image is presented. Then, the AR image after the second part of the second virtual object in the second virtual object set is integrated into the real scene image is determined and updated.

[0153] As described above, based on the real-world scene, it can display an AR image showing the first part of the second virtual objects in the second virtual object set integrated into the real-world scene; that is, it displays a portion of the second virtual objects in the AR image. Then, in response to changes in the terminal's shooting posture, such as when the user adjusts the terminal's shooting angle, the currently captured real-world scene image is updated, thereby updating the second virtual objects displayed in the AR image. In this way, AR technology transforms a planar interaction process into a spatial interaction process, allowing users to perform mobile interaction within space, further enhancing the user's immersive interactive experience.

[0154] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0155] Based on the same inventive concept, this disclosure also provides an interactive device corresponding to the interactive method. Since the principle of the device in this disclosure for solving the problem is similar to the interactive method described above in this disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be described again.

[0156] Reference Figure 5 The diagram shown is a schematic representation of an interactive device provided in an embodiment of this disclosure. The device includes: an acquisition module 501, a first display module 502, a determination module 503, and a second display module 504; wherein,

[0157] The acquisition module 501 is used to acquire images of the real-world scene captured by the terminal.

[0158] The first display module 502 is used to determine and display an augmented reality (AR) image after a first virtual object and multiple second virtual objects are integrated into the real scene image based on the real scene image; the second virtual object is an object to be captured by the first virtual object; the multiple second virtual objects include second virtual objects with different attribute characteristics, and the capture difficulty is different for different attribute characteristics;

[0159] The determination module 503 is used to respond to the target trigger operation and determine the target second virtual object to be captured from multiple second virtual objects;

[0160] The second display module 504 is used to display an AR screen showing the first virtual object grabbing the target second virtual object.

[0161] In one optional implementation, the determining module 503 is used to respond to a target triggering operation and determine the target second virtual object to be captured based on the current shooting orientation of the terminal and the position information of each second virtual object in the real scene.

[0162] In one optional implementation, the determining module 503 is used to determine at least one candidate second virtual object that matches the shooting orientation based on the current shooting orientation of the terminal and the position information of each second virtual object in the real scene.

[0163] If there is only one candidate second virtual object, then the candidate second virtual object shall be used as the target second virtual object;

[0164] When there are multiple candidate second virtual objects, the candidate second virtual object whose location in the real scene is closest to the terminal among the multiple candidate second virtual objects is taken as the target second virtual object.

[0165] In one optional implementation, the first display module 502 is used to determine and display an AR image of the first virtual object and the plurality of second virtual objects after they have been integrated into the real scene, based on the location information of the first virtual object and the plurality of second virtual objects in the real scene, and the capture scores that are matched with the attribute features of each of the second virtual objects respectively.

[0166] The location of the first virtual object in the real-world scene matches the location of the terminal in the real-world scene.

[0167] In one optional implementation, the second display module 504 is used to display an AR screen showing the first virtual object capturing the target second virtual object by emitting a third virtual object.

[0168] In one optional implementation, the first display module 502 is used to display an AR image after the first virtual object and the plurality of second virtual objects are integrated into the real scene, and to display an aiming mark in the AR image according to the current shooting orientation of the terminal, wherein the aiming mark is used to indicate the grabbing direction of the first virtual object currently being aimed at;

[0169] In response to a change in the shooting orientation of the terminal, the aiming marker is moved to a different position in the AR image.

[0170] In one optional implementation, the first display module 502 is used to determine whether the real scene image matches the target scene type based on the real scene image;

[0171] If a match is found, then based on the real-world scene, an AR image is determined and displayed showing the first virtual object and the plurality of second virtual objects integrated into the real-world scene.

[0172] In one optional implementation, the first display module 502 is used to determine and display an AR image of a first part of the second virtual objects in the first set of virtual objects and the second set of virtual objects after they have been integrated into the real scene image, based on the real scene image.

[0173] In response to changes in the terminal's shooting posture, based on the updated real-world scene image, the AR image after the second part of the second virtual objects in the second virtual object set is integrated into the real-world scene image is determined and updated; there are at least some differences between the first part of the second virtual objects and the second part of the second virtual objects.

[0174] The processing flow of each module in the device and the interaction flow between each module can be referred to the relevant descriptions in the above method embodiments, and will not be detailed here.

[0175] Based on the same technical concept, embodiments of this application also provide a computer device. (Refer to...) Figure 6 The diagram shown is a structural schematic of a computer device provided in an embodiment of this application, including:

[0176] The system includes a processor 61, a memory 62, and a bus 63. The memory 62 stores machine-readable instructions executable by the processor 61. The processor 61 executes these machine-readable instructions, performing the following steps: S101: Acquire a real-world scene image captured by the terminal; S102: Based on the real-world scene image, determine and display an augmented reality (AR) image showing a first virtual object and multiple second virtual objects integrated into the real-world scene; the second virtual object is the object to be captured by the first virtual object; the multiple second virtual objects include second virtual objects with different attributes and characteristics, each corresponding to a different capture difficulty; S103: Respond to a target trigger operation, determine the target second virtual object to be captured from the multiple second virtual objects; S104: Display the AR image of the first virtual object capturing the target second virtual object.

[0177] The aforementioned memory 62 includes a main memory 621 and an external memory 622. The main memory 621, also known as internal memory, is used to temporarily store the computational data in the processor 61, as well as the data exchanged with external memory such as a hard disk. The processor 61 exchanges data with the external memory 622 through the main memory 621. When the computer device is running, the processor 61 and the memory 62 communicate through the bus 63, so that the processor 61 executes the execution instructions mentioned in the above method embodiments.

[0178] This disclosure also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps of the interactive method described in the above-described method embodiments. The storage medium may be a volatile or non-volatile computer-readable storage medium.

[0179] This disclosure also provides a computer program product, including computer instructions, which, when executed by a processor, implement the steps of the above-described interaction method. The computer program product can be any product capable of implementing the above-described interaction method. Part or all of the solutions contributing to the prior art in the computer program product can be embodied in the form of a software product (e.g., a software development kit, SDK), which can be stored in a storage medium. The included computer instructions cause a relevant device or processor to execute part or all of the steps of the above-described interaction method.

[0180] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the device described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here. In the several embodiments provided in this disclosure, it should be understood that the disclosed device and method can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of modules is only a logical functional division; in actual implementation, there may be other division methods. Furthermore, multiple modules or components can be combined, or some features can be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection can be through some communication interfaces; the indirect coupling or communication connection of devices or modules can be electrical, mechanical, or other forms.

[0181] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0182] In addition, the functional modules in the various embodiments of this disclosure can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module.

[0183] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0184] Finally, it should be noted that the above-described embodiments are merely specific implementations of this disclosure, used to illustrate the technical solutions of this disclosure, and not to limit it. The protection scope of this disclosure is not limited thereto. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this disclosure. Such modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this disclosure, and should all be covered within the protection scope of this disclosure. Therefore, the protection scope of this disclosure should be determined by the protection scope of the claims.

Claims

1. An interaction method, characterized in that, The method comprises: acquiring a real scene picture taken by a terminal; based on the real scene picture, determining and displaying an augmented reality (AR) picture in which a first virtual object and a plurality of second virtual objects are integrated into the real scene picture; the second virtual objects are objects to be grabbed by the first virtual object; the plurality of second virtual objects include second virtual objects with different attribute features, and the different attribute features correspond to different grabbing difficulties; in response to a target triggering operation, determining a target second virtual object to be grabbed from the plurality of second virtual objects; displaying an AR picture in which the first virtual object grabs the target second virtual object; wherein the operation of determining the target second virtual object to be grabbed from the plurality of second virtual objects in response to the target triggering operation comprises: in response to the target triggering operation, determining the target second virtual object to be grabbed according to a current shooting orientation of the terminal and position information of each second virtual object in the real scene.

2. The method of claim 1, wherein, the operation of determining the target second virtual object to be grabbed according to the current shooting orientation of the terminal and the position information of each second virtual object in the real scene comprises: determining at least one candidate second virtual object that matches the shooting orientation according to the current shooting orientation of the terminal and the position information of each second virtual object in the real scene; in a case where the at least one candidate second virtual object is one, taking the candidate second virtual object as the target second virtual object; in a case where the at least one candidate second virtual object is a plurality, taking a candidate second virtual object that corresponds to the closest distance between the position in the real scene and the terminal from the plurality of candidate second virtual objects as the target second virtual object.

3. The method according to claim 1 or 2, characterized in that, the operation of determining and displaying the AR picture in which the first virtual object and the plurality of second virtual objects are integrated into the real scene picture comprises: determining and displaying the AR picture in which the first virtual object and the plurality of second virtual objects are integrated into the real scene picture according to corresponding position information of the first virtual object and the plurality of second virtual objects in the real scene and grabbing scores respectively matched with attribute features of each second virtual object; wherein the corresponding position of the first virtual object in the real scene matches a position of the terminal in the real scene.

4. The method of claim 1, wherein, the operation of displaying the AR picture in which the first virtual object grabs the target second virtual object comprises: displaying the AR picture in which the first virtual object grabs the target second virtual object by emitting a third virtual object.

5. The method of claim 1, wherein, the operation of displaying the AR picture in which the first virtual object and the plurality of second virtual objects are integrated into the real scene picture comprises: displaying the AR picture in which the first virtual object and the plurality of second virtual objects are integrated into the real scene picture, and displaying a targeting identifier in the AR picture according to the current shooting orientation of the terminal, the targeting identifier being used to indicate a grabbing direction of the currently targeted first virtual object; in response to a change in the shooting orientation of the terminal, moving the position of the targeting identifier in the AR picture.

6. The method of claim 1, wherein, The step of determining and displaying an augmented reality (AR) image based on the real-world scene image, after the first virtual object and multiple second virtual objects are integrated into the real-world scene image, includes: Based on the real-world scene image, determine whether the real-world scene image matches the target scene type; If a match is found, then based on the real-world scene, an AR image is determined and displayed showing the first virtual object and the plurality of second virtual objects integrated into the real-world scene.

7. The method of claim 1, wherein, The step of determining and displaying an augmented reality (AR) image based on the real-world scene image, after the first virtual object and multiple second virtual objects are integrated into the real-world scene image, includes: Based on the real-world scene, determine and display the AR image after the first part of the second virtual objects in the first and second virtual object sets are integrated into the real-world scene; In response to changes in the terminal's shooting posture, based on the updated real-world scene image, the AR image after the second part of the second virtual objects in the second virtual object set is integrated into the real-world scene image is determined and updated; there are at least some differences between the first part of the second virtual objects and the second part of the second virtual objects.

8. An interactive device, characterized by include: The acquisition module is used to acquire images of the real-world scene captured by the terminal. The first display module is used to determine and display an augmented reality (AR) image after a first virtual object and multiple second virtual objects are integrated into the real-world scene image, based on the real-world scene image; the second virtual object is an object to be captured by the first virtual object; the multiple second virtual objects include second virtual objects with different attribute characteristics, and the capture difficulty is different for different attribute characteristics; The determination module is used to respond to target triggering operations and determine the target second virtual object to be captured from multiple second virtual objects; The second display module is used to display an AR scene of the first virtual object grasping the target second virtual object; The determining module is used to: respond to a target triggering operation and determine the target second virtual object to be captured based on the current shooting orientation of the terminal and the position information of each second virtual object in the real scene.

9. A computer device, comprising: include: The computer device includes a processor, a memory, and a bus, wherein the memory stores machine-readable instructions executable by the processor, and the processor communicates with the memory via the bus when the computer device is running, and the machine-readable instructions, when executed by the processor, perform the steps of the interaction method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, performs the steps of the interactive method as described in any one of claims 1 to 7.

Images