Object interaction method and device, electronic equipment and computer readable storage medium

Abstract

The invention discloses an object interaction method and device, electronic equipment and a computer readable storage medium, and relates to the field of meta universe. The method comprises the steps that click operation based on a display interface is received, click coordinates are carried in the click operation, and the display interface displays a virtual space; determining a virtual coordinate range corresponding to the click coordinate in a virtual space; according to the virtual coordinate range and a boundary coordinate range corresponding to the target object, determining an interaction result of whether to interact with the target object, the target object being located in the virtual space, and the coordinates in the virtual coordinate range being the same as the depth coordinates of the coordinates in the boundary coordinate range; and displaying an interaction action corresponding to the click operation on the display interface under the condition that the interaction result is interaction with the target object. According to the method and the device, the technical problem of poor user interaction experience caused by incapability of clicking when a user clicks a tiny object in the prior art is solved.

Description

Technical Field

[0001] This invention relates to the metaverse field, and more specifically, to an object interaction method, apparatus, electronic device, and computer-readable storage medium. Background Technology

[0002] In today's digital world, Virtual Reality (VR), Augmented Reality (AR), and various interactive applications based on three-dimensional (3D) environments are becoming increasingly popular. These technologies provide users with immersive experiences, but they also bring new challenges, especially when dealing with tiny or densely packed virtual objects. For example, in AR games, users may need to interact with tiny props in virtual space to complete specific tasks or challenges. However, when these props are only a few millimeters in size or even smaller, user clicks using input devices such as touchscreens or mice are often difficult to accurately hit due to the physical limitations of the devices. This not only reduces user efficiency but can also lead to frequent interaction failures, severely impacting the user experience and the game's immersion.

[0003] There is currently no effective solution to the above problems. Summary of the Invention

[0004] This invention provides an object interaction method, apparatus, electronic device, and computer-readable storage medium to at least solve the technical problem in the related art where users may not be able to click on small objects, resulting in a poor user interaction experience.

[0005] According to one aspect of the present invention, an object interaction method is provided, comprising: receiving a click operation based on a display interface, wherein the click operation carries click coordinates, and the display interface displays a virtual space; determining a virtual coordinate range in the virtual space corresponding to the click coordinates; determining an interaction result of whether to interact with the target object based on the boundary coordinate range of the virtual coordinate range and the boundary coordinate range corresponding to the target object, wherein the target object is located in the virtual space, the target object is an object whose current display area is less than a predetermined threshold, and the depth coordinates of the coordinates within the virtual coordinate range are the same as the depth coordinates of the coordinates within the boundary coordinate range; and, if the interaction result is interaction with the target object, displaying an interaction action corresponding to the click operation on the display interface.

[0006] Optionally, determining the interaction result of whether to interact with the target object based on the boundary coordinate range corresponding to the virtual coordinate range and the target object includes: determining the boundary coordinate range of the target object; determining the expansion parameter corresponding to the boundary coordinate range; expanding the boundary coordinate range according to the expansion parameter to obtain an expanded coordinate range; determining whether there is an intersection point between the virtual coordinate range and the expanded coordinate range; and determining the interaction result based on the intersection point.

[0007] Optionally, determining the interaction result of whether to interact with the target object based on the virtual coordinate range and the boundary coordinate range corresponding to the target object includes: determining the target distance between the first coordinate within the virtual coordinate range and the second coordinate within the boundary coordinate range, wherein the target distance is the shortest distance among the distances formed by any coordinate within the virtual coordinate range and any coordinate within the boundary coordinate range; and determining the interaction result based on the target distance and a predetermined threshold.

[0008] Optionally, before determining the interaction result based on the target distance and the predetermined threshold, determining the predetermined threshold includes: if the target object is a mobile object, determining the movement direction and movement speed of the target object, and determining the predetermined threshold based on the movement direction and movement speed; and / or, determining the predetermined threshold based on the scaling ratio of the display interface and the virtual space.

[0009] Optionally, if the interaction result is an interaction with the target object, the display interface shows the interaction action corresponding to the click operation, including: if there are M target objects, determining the center coordinates of the objects corresponding to the M target objects respectively; determining the priority of the M target objects based on the distance between the center coordinates of the M objects and the virtual coordinate range; if the interaction result includes an interaction with an interactive object, based on the priority of the M target objects, sequentially based on the corresponding interaction results until an interaction result with the corresponding interactive object is determined, and displaying the interaction action between the click operation and the interactive object on the display interface.

[0010] Optionally, determining the expansion parameter corresponding to the boundary coordinate range includes: determining expansion index items, wherein the expansion index items include at least one of the following: object type item, neighboring object influence item, object display ratio item; and determining the expansion parameter based on the expansion index value corresponding to the expansion index item.

[0011] Optionally, determining the virtual coordinate range corresponding to the click coordinates includes: determining the click pixel corresponding to the click coordinates; and determining the virtual coordinate range corresponding to the click coordinates based on the click pixel size of the click pixel.

[0012] According to one aspect of the present invention, an object interaction device is provided, comprising: a receiving module, configured to receive a click operation based on a display interface, wherein the click operation carries click coordinates, and the display interface displays a virtual space; a first determining module, configured to determine a virtual coordinate range in the virtual space corresponding to the click coordinates; a second determining module, configured to determine an interaction result of whether to interact with the target object based on the boundary coordinate range corresponding to the virtual coordinate range and the boundary coordinate range corresponding to the target object, wherein the target object is located in the virtual space, the target object is an object whose current display area is less than a predetermined threshold, and the depth coordinates of the coordinates within the virtual coordinate range are the same as the depth coordinates of the coordinates within the boundary coordinate range; and a display module, configured to display an interaction action corresponding to the click operation on the display interface when the interaction result is interaction with the target object.

[0013] According to one aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium including a stored executable program, wherein, when the executable program is executed, it controls the device where the computer-readable storage medium is located to perform the method described in any of the above-described embodiments.

[0014] According to one aspect of the present invention, an electronic device is provided, comprising: a memory storing an executable program; and a processor for running the program, wherein the program, when running, performs the method described in any one of the preceding embodiments.

[0015] According to one aspect of the present invention, a computer program product is provided, including computer instructions that, when executed by a processor, implement the steps of the method described in any one of the above embodiments.

[0016] In this embodiment of the invention, a click operation based on a display interface is received, wherein the click operation carries click coordinates, and the display interface displays a virtual space. The range of virtual coordinates corresponding to the click coordinates in the virtual space is determined. Based on the range of virtual coordinates and the boundary coordinate range corresponding to the target object, an interaction result is determined, indicating whether interaction with the target object has occurred. The target object is located in the virtual space, and the depth coordinates of the coordinates within the virtual coordinate range and the coordinates within the boundary coordinate range are the same. If the interaction result indicates interaction with the target object, the interactive action corresponding to the click operation is displayed on the display interface. By determining the relationship between the virtual range of the click coordinates and the boundary range of the target object, even if the user fails to precisely click on a small object, as long as the coordinates of the two reach a certain relationship, it is considered a valid interaction. This significantly improves the success rate of user interaction with small objects, enhances the interactive experience, and solves the technical problem in related technologies where users often fail to click on small objects, resulting in a poor user experience. Attached Figure Description

[0017] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0018] Figure 1 This is a flowchart of the object interaction method provided in the embodiments of the present invention;

[0019] Figure 2 This is a structural block diagram of an object interaction device according to an embodiment of the present invention. Detailed Implementation

[0020] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0021] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0022] It should also be noted that the information collected in this application (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) are information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, storage, use, processing, transmission, provision, disclosure, and application of related data all comply with relevant laws, regulations, and standards, necessary confidentiality measures have been taken, and they do not violate public order and good morals. Corresponding operation entry points are provided for users to choose to authorize or refuse. For example, interfaces are set up between this system and relevant users or organizations, providing users with corresponding operation entry points for them to choose to agree to or refuse automated decision results; if the user chooses to refuse, the process proceeds to the expert decision-making stage.

[0023] Example 1

[0024] According to an embodiment of the present invention, an embodiment of an object interaction method is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0025] Figure 1 This is a flowchart of the object interaction method provided in the embodiments of the present invention, such as... Figure 1 As shown, the method includes the following steps:

[0026] Step S102: Receive a click operation based on the display interface, wherein the click operation carries click coordinates and the display interface displays a virtual space;

[0027] In step S102 of this application, a click operation based on the display interface is received.

[0028] This involves the display interface, which refers to the visual interface through which users interact with a computer system, such as a computer monitor, mobile phone screen, or VR / AR headset display, which can display information and elements from virtual space.

[0029] This involves virtual space, a digitally constructed environment that can be a scene in a game, a world in virtual reality, or a three-dimensional space within a software application. Objects, characters, and other interactive elements can be created within virtual space.

[0030] This involves click operations, which refer to the act of a user tapping a target on a computer interface using an input device (such as a mouse, touchscreen, gamepad, etc.).

[0031] This involves click coordinates. When a click operation is performed, the input device will generate a specific positioning point on the display interface. The position of this point is represented by a set of coordinates, which are usually (x, y) coordinates in a two-dimensional coordinate system with the upper left corner of the display interface as the origin.

[0032] Step S104: Determine the range of virtual coordinates in the virtual space corresponding to the clicked coordinates;

[0033] In step S104 of this application, the range of virtual coordinates corresponding to the click coordinates in the virtual space is determined.

[0034] This involves virtual coordinate ranges, which include multiple virtual coordinates within a corresponding range. Virtual coordinates differ from actual coordinates in the physical world; they are a reference system used to represent position in virtual space. When developing applications for virtual environments, it is common practice to establish a custom coordinate system to adapt to different scenarios and needs.

[0035] In this step, when processing user-input clicks, the system needs to perform coordinate transformation, converting the two-dimensional click coordinates on the display screen into three-dimensional coordinates in virtual space. This determines the exact location of the user's interaction in virtual space. Considering that different users may operate on different devices, relying solely on two-dimensional click positions could lead to inaccurate coordinate recognition in virtual space. Therefore, by converting click coordinates to virtual space coordinates, the system can more accurately determine where the user clicked in virtual space and which virtual object they intended to interact with.

[0036] Step S106: Based on the virtual coordinate range and the boundary coordinate range corresponding to the target object, determine the interaction result of whether to interact with the target object. The target object is located in the virtual space, the target object is an object whose current display area is less than a predetermined threshold, and the depth coordinates of the coordinates within the virtual coordinate range and the coordinates within the boundary coordinate range are the same.

[0037] In step S106 provided in this application, in the virtual space, the system will determine whether the user really wants to interact with the target object and whether the user is able to interact with the target object based on the virtual coordinate range converted by the user's click and the boundary coordinate range of the target object.

[0038] It should be noted that consistent depth serves two purposes: firstly, to avoid consuming computing power; and secondly, to ensure that the coordinate ranges of both coordinate systems are on the same depth plane, meaning that both coordinate ranges are on the same plane, which is consistent with the plane of the display interface. This also avoids inaccurate interaction recognition caused by angular rotation.

[0039] It should also be noted that the target object is an object whose current display area is less than a predetermined threshold. This is because when displaying a 3D object on the interface, the displayed object area varies depending on the viewing angle. From some viewing angles, the object area may be large, eliminating the need for this judgment, and the user can accurately click on the object. However, from other viewing angles, the object area may be too small, making it difficult for the user to accurately click on the object. Therefore, the method involved in this application is required to determine whether an interactive process is needed.

[0040] This involves the concept of a target object, which is an entity in the virtual space that the user wishes to interact with, such as characters, items, or buildings in a game. Optionally, the target object can be an object with a volume smaller than a predetermined threshold.

[0041] This involves depth coordinates, which in a three-dimensional coordinate system indicate the distance or depth of an object relative to the observer. Coordinates that can be displayed on the same screen are those with the same depth coordinates.

[0042] Step S108: If the interaction result is an interaction with the target object, display the interaction action corresponding to the click operation on the display interface.

[0043] In step S108 provided in this application, when the system determines that the user's click operation is indeed intended to interact with a target object in the virtual space, the system will present a series of visual feedbacks corresponding to the click operation on the display interface to reflect the interaction process between the user and the target object.

[0044] This involves interactive actions, which are a series of animations, special effects, or other visual feedbacks that the system displays on the screen when responding to a user's click, indicating that the target object has received the user's instruction and is performing the corresponding action.

[0045] Through steps S102-S108 above, a click operation based on the display interface is received, wherein the click operation carries click coordinates, and the display interface displays a virtual space. The virtual coordinate range corresponding to the click coordinates in the virtual space is determined. Based on the boundary coordinate range of the virtual coordinate range and the target object, an interaction result is determined, indicating whether interaction with the target object has occurred. The target object is located in the virtual space, and the depth coordinates of the coordinates within the virtual coordinate range and the coordinates within the boundary coordinate range are the same. If the interaction result is interaction with the target object, the interactive action corresponding to the click operation is displayed on the display interface. By determining the relationship between the virtual range of the click coordinates and the boundary range of the target object, even if the user fails to precisely click on a small object, as long as the coordinates of the two reach a certain relationship, it is considered a valid interaction. This significantly improves the success rate of user interaction with small objects, enhances the interactive experience, and solves the technical problem in related technologies where users often cannot click on small objects, resulting in a poor user experience.

[0046] As an optional embodiment, the interaction result of whether to interact with the target object is determined based on the boundary coordinate range corresponding to the virtual coordinate range and the target object, including: determining the boundary coordinate range of the target object; determining the expansion parameter corresponding to the boundary coordinate range; expanding the boundary coordinate range according to the expansion parameter to obtain the expanded coordinate range; determining whether there is an intersection point between the virtual coordinate range and the expanded coordinate range; and determining the interaction result based on the intersection point result.

[0047] In this embodiment, the sensitivity to user clicks and the success rate of user clicks are improved by expanding the interactive area of ​​the target object.

[0048] This involves scaling parameters, which are numerical values ​​or rules used to adjust the size of the target object's boundary coordinate range. The purpose is to create a larger interactive area for the target object without changing its appearance, making it easier for users to click on it.

[0049] This involves expanding the coordinate range. The new coordinate range obtained by expanding the boundary coordinate range of the target object covers the original target object and also includes the surrounding extra space, providing a larger "safety net" for users to click.

[0050] This involves intersection coordinates, which are the coordinate points of the overlapping part of the virtual coordinate range and the expanded coordinate range when they intersect. These coordinates are used to determine whether a user's click is valid.

[0051] This involves the intersection result. The system determines whether there is an intersection between the virtual coordinate range and the expanded coordinate range. If there is at least one intersection, the intersection result is true, indicating that the user's click may interact with the target object.

[0052] In the above steps, firstly, the system needs to know the position and size of the target object in virtual space, i.e., its boundary coordinate range. Next, based on the target object's characteristics (such as size, shape, and importance) and user experience requirements, the system calculates or sets a reasonable expansion parameter to extend the boundary coordinate range. Using this expansion parameter increases the spatial range around the target object, generating an expanded coordinate range, which is equivalent to creating a virtual "click buffer" for the small object. When the user clicks, the system converts the click coordinates into a coordinate range in virtual space and then checks whether this range intersects with the expanded coordinate range, i.e., whether there is an intersection point. If an intersection point is detected, it means the user's click at least touched the expanded interaction area of ​​the target object, and the system considers this a valid interaction; otherwise, it is considered invalid.

[0053] By expanding the interactive area, the probability of users missing tiny targets due to slight finger or cursor misalignment is reduced, making click operations more forgiving and user-friendly, thus improving the user experience. Users no longer need to aim at tiny objects with excessive precision; they only need to point roughly to interact with them. This greatly simplifies operation, especially for touch operations on mobile devices. Moreover, when setting up the virtual space, smaller and more complex objects can be freely placed and designed without worrying about user interaction difficulties, opening up new possibilities for creative design in the virtual space.

[0054] As an optional embodiment, the interaction result of whether to interact with the target object is determined based on the virtual coordinate range and the boundary coordinate range corresponding to the target object, including: determining the target distance between the first coordinate within the virtual coordinate range and the second coordinate within the boundary coordinate range, wherein the target distance is the shortest distance among the distances formed by any coordinate within the virtual coordinate range and any coordinate within the boundary coordinate range; and determining the interaction result based on the target distance and a predetermined threshold.

[0055] This embodiment illustrates the process of determining whether a user's click operation interacts with a target object in the virtual space.

[0056] This involves the first coordinate and the second coordinate. The "first coordinate" refers to the coordinate within the virtual coordinate range that can form the aforementioned shortest distance, and the "second coordinate" refers to the coordinate within the boundary coordinate range of the target object that can form the aforementioned shortest distance. Both of them exist in the three-dimensional coordinate system of the virtual space.

[0057] This involves the target distance, which is the minimum of all possible distances formed between the first coordinate (coordinates within the virtual coordinate range) and the second coordinate (coordinates within the target object's boundary coordinate range) in three-dimensional space. The target distance is used to determine whether a user's click is close enough to the target object to classify it as a valid interaction.

[0058] This involves a predetermined threshold, which is a set distance value used to determine whether the target distance meets the conditions for interaction with the target object. If the target distance is less than or equal to the predetermined threshold, the system considers the user's click to be within the valid interaction range of the target object.

[0059] In this step, the system first calculates the distance between the nearest point in the virtual coordinate range (virtual coordinate range) after the user clicks and the boundary coordinate range of the target object, i.e., the target distance. Next, the system compares the calculated target distance with a preset threshold. If the target distance is less than or equal to the preset threshold, the system determines that the user's click operation has made a valid interaction with the target object; otherwise, it is determined to be invalid.

[0060] By comparing the shortest distance (target distance) with a threshold, the system maintains high accuracy while providing a degree of operational tolerance through flexible threshold settings. This avoids accidental clicks and improves the success rate of user interactions. For tiny objects, users do not need to click precisely on the object; as long as the shortest distance between the click location and the object does not exceed the threshold, the system considers it a valid click, reducing operational difficulty and enhancing the user experience. Different virtual scenes or target objects of different sizes may require different thresholds to achieve the best interactive effect. The system can dynamically adjust the threshold based on the object's size, shape, and even user feedback to adapt to various scenarios and needs.

[0061] It should be noted that when there are multiple target objects in the virtual space, the system should simultaneously calculate the shortest distance between the click location and each object, and then determine whether the user should interact with a certain object and the order of priority interaction based on the comparison of these distances with their respective thresholds.

[0062] As an optional embodiment, before determining the interaction result based on the target distance and the predetermined threshold, the predetermined threshold is determined, including: if the target object is a moving object, determining the moving direction and moving speed of the target object, and determining the predetermined threshold based on the moving direction and moving speed; and / or, determining the predetermined threshold based on the scaling ratio of the display interface and the virtual space.

[0063] In this embodiment, the method for determining the threshold is described.

[0064] This involves mobile objects, which refer to target objects that move in virtual space, such as characters or aircraft in games.

[0065] This involves movement direction and movement speed, which describe the direction and speed of movement of a mobile object in virtual space, respectively.

[0066] This involves the scaling ratio between the display interface and the virtual space. This scaling ratio refers to the proportional relationship when a user observes the virtual space on the display interface. Different scaling ratios will affect the user's perception of the actual size of objects, and thus affect the accuracy of click operations.

[0067] This step describes how to determine the direction and speed of movement of a moving object. First, the current direction and speed of movement of the moving object are acquired; this is crucial information for assessing the object's future position and movement trend. Based on the direction and speed of movement, a predetermined threshold is determined. The system dynamically adjusts the predetermined threshold according to the object's direction and speed to anticipate and compensate for click difficulties caused by object movement. For example, if the object is moving towards the user at high speed, the system may increase the threshold to allow an upcoming click to be recognized as valid.

[0068] This step also explains how to determine a predetermined threshold based on the scaling ratio between the display interface and the virtual space. When the user zooms in or out of the virtual space view on the display interface, the system adjusts the predetermined threshold accordingly to ensure that the user can accurately click on the target object regardless of the scaling ratio. This is because a larger scaling ratio may make a tiny object appear larger on the display interface, and vice versa.

[0069] Optionally, the system can build a motion model of the object to predict its movement position in the next few frames, incorporating the boundaries of the predicted position into the threshold calculation to improve the accuracy of click prediction. Furthermore, considering the potential differences in visual acuity and operating habits among users, the system can provide personalized threshold adjustment options, allowing users to manually set thresholds according to their needs, further optimizing their individual interactive experience. Moreover, for specific types of virtual environments or application scenarios, the system can pre-set a set of threshold ranges to adapt to different scenario requirements. For example, the threshold setting for enemies in a shooting game might be stricter than the threshold for treasure in a treasure hunt game, allowing for more precise control over the sensitivity of the interaction.

[0070] As an optional embodiment, when the interaction result is an interaction with a target object, the interactive action corresponding to the click operation is displayed on the display interface, including: when there are M target objects, determining the center coordinates of the objects corresponding to the M target objects respectively; determining the priority of the M target objects based on the distance between the center coordinates of the M objects and the virtual coordinate range respectively; when there is an interaction result with an interactive object, according to the priority of the M target objects, the corresponding interaction results are sequentially determined until an interaction result with the corresponding interactive object is determined, and the interactive action of the click operation with the interactive object is displayed on the display interface.

[0071] This embodiment illustrates how the system processes user clicks in a virtual environment with multiple interactive target objects to determine which object to interact with and displays the corresponding interactive action on the display interface.

[0072] This involves M target objects, which refer to multiple objects in the virtual space that can interact with the user simultaneously.

[0073] This involves the center coordinates of the object, which is the position of the center point of each target object in its three-dimensional virtual space coordinate system.

[0074] This involves prioritization, which means that when multiple interactive objects exist, each target object is assigned a ranking based on certain rules (such as distance, importance, etc.) to determine which object the system should prioritize for interaction when responding to user clicks.

[0075] This involves interactive actions, which are the visual reactions or animations displayed on the system's screen when a user interacts with a target object in the virtual space by clicking. These actions are used to intuitively demonstrate the effects of the user's operation, such as highlighting, deforming, moving, or disappearing the object.

[0076] In this step, the system first calculates the center coordinates of interactive target objects in the virtual space, which serve as the basis for subsequent distance calculations. Next, the system measures the distance between the center coordinates of each object and the range of virtual coordinates formed after the user clicks. Based on the distance (or other preset rules such as object importance), the system assigns a priority to each of the M target objects. Generally, the closer the object, the higher its priority. The system checks each target object in priority order to see if a valid interaction has occurred, until a suitable target object is found. Once the highest-priority target object that has been validly clicked by the user is identified, the system displays a visual action of interacting with that object on the screen, providing intuitive feedback to the user.

[0077] By prioritizing objects, the system can clearly define which object a user clicks on in complex multi-object scenarios, effectively interacting with the user and avoiding confusion and uncertainty. The system processes the closest or highest-priority object first, reducing unnecessary computational burden and ensuring fast and smooth interaction responses.

[0078] As an optional embodiment, determining the expansion parameters corresponding to the boundary coordinate range includes: determining expansion index items, wherein the expansion index items include at least one of the following: object type item, neighboring object influence item, object display ratio item; and determining the expansion parameters based on the expansion index value corresponding to the expansion index item.

[0079] This embodiment illustrates how, in a virtual environment, the virtual volume of an object can be dynamically adjusted based on its characteristics and its surrounding environment to make it easier for the user to click.

[0080] This includes expansion metrics, which define the key factors that determine the size of virtual objects. The degree of expansion can be determined based on the different values ​​of these factors. These mainly include object type, influence of neighboring objects, and object display ratio.

[0081] This includes the object type category, which refers to the attribute classification of virtual objects, such as buttons and decorations. Different types of objects may require different click tolerances due to their different functions and intended uses.

[0082] This includes a neighboring object influence factor, which considers the distribution density of objects in the virtual space, i.e., the presence of other objects around an existing object. If there are other objects around an existing object, especially when these objects are very close together, an appropriate clickable area may be needed to avoid accidentally clicking on other objects.

[0083] This includes the object display scale, which reflects the ratio between the visual size of an object on a display interface (such as a screen) and its actual size in virtual space. If an object appears small on the display interface, its virtual volume may need to be increased to improve clickability.

[0084] This involves the amplification index value. For each amplification index item, a numerical value is defined to quantify the degree of influence of the index item on the amplification parameter. For example, when neighboring objects are close, the amplification index value of the neighboring object influence item may be higher.

[0085] In this step, expansion metrics are determined, taking into account three dimensions: object type, the influence of surrounding objects, and display scale. Then, based on the expansion index value corresponding to each metric, a specific expansion parameter is determined through a comprehensive evaluation using some calculation logic (such as weighted average, function mapping, etc.). This parameter will guide the degree of expansion of the virtual object's virtual volume.

[0086] By dynamically adjusting the virtual volume of objects, even in crowded or small-sized virtual environments, the accuracy and efficiency of clicks can be improved, thereby enhancing the interactivity and user experience of the entire system. Different weights can be assigned to different object types, the influence of neighboring objects, and the object display ratio, allowing for more precise adjustment of scaling parameters to adapt to more diverse scene requirements. Especially in virtual scenes with dense and diverse objects, increasing the virtual spacing between neighboring objects can help prevent accidental touches, reduce unnecessary operational errors, and improve the accuracy of interaction.

[0087] As an optional embodiment, determining the virtual coordinate range corresponding to the click coordinates includes: determining the click pixel corresponding to the click coordinates; and determining the virtual coordinate range corresponding to the click coordinates based on the click pixel size.

[0088] This embodiment illustrates how, after a user performs a click operation, the clicked pixels on the display interface are converted into a three-dimensional coordinate range within the virtual space.

[0089] This involves click pixels, which are the specific pixel points on the display interface where a click occurs. They are the basic units that make up the displayed image. Click pixels not only reflect the location of the click operation but also the size of the physical contact area.

[0090] This involves the click pixel size, which refers to the actual area or volume of a click pixel in virtual space. It is affected by the input device's resolution, the scaling of the display interface, and the mapping relationship between virtual and real space. In other words, the click pixel size differs depending on the display resolution, in order to ensure more accurate interactive operations.

[0091] This involves a virtual coordinate range, which is a three-dimensional coordinate range within virtual space, derived from the clicked pixels, used to determine whether a click interacts with a target object in the virtual space. The size of this range is determined by the size of the clicked pixel and can be an area of ​​varying volume depending on the display resolution.

[0092] First, the system pinpoints the exact pixel the user clicked (the clicked pixel). This step typically depends on the input device's hardware precision and software resolution capabilities. Then, the system maps the clicked pixel into a coordinate range with a certain volume in virtual space, based on its size. The conversion of the clicked pixel size in virtual space depends on several factors. For example, if the user is using a stylus on a high-resolution screen, the clicked pixel size may be very small, resulting in a relatively small coordinate range in virtual space; conversely, if the user is using a finger on a low-resolution touchscreen, the converted coordinate range in virtual space will be larger.

[0093] By converting the size of clicked pixels into a virtual coordinate range, the system can more accurately determine whether a click has touched the target object, especially when dealing with small objects, thus avoiding interaction failures due to insufficient click precision. Different input devices (such as mice, touchpads, and touchscreens) have different levels of precision and input characteristics. By adjusting the conversion rules from clicked pixel size to virtual coordinate range, the system can optimize the input experience on different devices, ensuring that users can interact naturally with the virtual space regardless of the input device used. In some situations, such as when users operate via touchscreen, appropriately expanding the virtual coordinate range can reduce the difficulty of clicking. Even if the finger slightly deviates from the edge of the target object, the operation can still be recognized as valid, thereby improving the smoothness and satisfaction of user operation.

[0094] Based on the above embodiments and optional embodiments, an optional implementation method is provided, which is described in detail below.

[0095] An optional embodiment of the present invention provides an object interaction method, which is described below.

[0096] S1, determine the volume of the interactive object;

[0097] S2, if the volume is less than a predetermined threshold, generate a virtual volume of the object with the center point of the object as the center.

[0098] It should be noted that the virtual volume only works when clicked by devices such as a mouse; it will not be blocked when a user walks by.

[0099] Therefore, when applying this method, it is necessary to determine whether it is a mouse click. If it is a mouse click, the object after expanding the virtual volume is taken as the clicked object. As long as the click is made within the virtual volume, it can be considered as a clicked object.

[0100] The following steps can be performed when applying the application:

[0101] Step 1: Receive input: Receive input via mouse, touchscreen or other input devices (same as receiving click operations based on the display interface as described above).

[0102] Step 2: Determine the click location: The game needs to determine the specific location of the player's click. For a mouse, this is usually achieved by obtaining the mouse's coordinates on the screen. For a touchscreen, it's achieved by obtaining the coordinates of the touch point (same as the click coordinates described above).

[0103] Step 3: Coordinate System Conversion: Objects in the game world typically exist in a coordinate system different from the screen coordinates. Therefore, it is necessary to convert the clicked screen coordinates to game world coordinates. This usually involves some mathematical calculations, such as matrix transformations (similar to determining the range of virtual coordinates corresponding to the clicked coordinates in virtual space as described above).

[0104] Step 4, Collision Detection: Once the click coordinates in the game world are obtained, the next step is to perform collision detection. This typically involves checking whether the click coordinates intersect or overlap with any object in the game world (similar to the interaction result above, which determines whether an interaction with the target object occurs based on the boundary coordinate range corresponding to the virtual coordinate range).

[0105] There are several methods to achieve this, including using bounding boxes, raycasting, or more complex shape matching algorithms. Collision detection here refers to definitive collisions with the virtual volume.

[0106] Step 5: Handling Click Events: If a click intersects with an object, the game will typically trigger an event or callback function to further process the player's click. This may include performing a specific action, opening a menu, displaying information, or changing the game state (similar to the above where, if the interaction result is an interaction with the target object, the corresponding interactive action is displayed on the screen).

[0107] For step four above, several methods can be used:

[0108] 1. Bounding Boxes:

[0109] Each object typically has a rectangular frame (for 2D games) or a cube frame (for 3D games) that surrounds its outer shape. These frames are usually larger than the actual shape of the object, but they are calculated quickly and are ideal for rapidly eliminating objects that do not collide.

[0110] When performing collision detection, you can check if the coordinates of the clicked point are within the bounding box of any object. If so, the click intersects with that object.

[0111] 2. Raycasting:

[0112] This method emits a ray from the click location (e.g., the player's mouse click or touch point) and checks whether the ray intersects with any object (including virtual volume parts).

[0113] You can also use the physics raycasting function to perform raycasting. This function checks if there are any objects on the ray from the start point to the end point and returns a function click object containing information about the objects that intersect the ray.

[0114] 3. Shape matching algorithm:

[0115] For more complex collision detection, more advanced shape matching algorithms may be required. These algorithms can handle irregularly shaped objects and determine more accurately whether they intersect. For example, polygon intersection algorithms can be used to detect whether two complex polygon shapes intersect. These algorithms are generally more complex and computationally expensive, but they offer higher accuracy.

[0116] The above method can solve the technical problem in related technologies where users may not be able to click on small objects, resulting in a poor user experience.

[0117] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that the present invention is not limited to the described order of actions, because according to the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to the present invention.

[0118] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of the present invention.

[0119] Example 2

[0120] According to embodiments of the present invention, an apparatus for implementing the above-described object interaction method is also provided. Figure 2 This is a structural block diagram of an object interaction device according to an embodiment of the present invention, such as... Figure 2 As shown, the device includes: a receiving module 202, a first determining module 204, a second determining module 206, and a display module 208. The device will be described in detail below.

[0121] A receiving module 202 is used to receive a click operation based on a display interface, wherein the click operation carries click coordinates, and the display interface displays a virtual space; a first determining module 204, connected to the receiving module 202, is used to determine the range of virtual coordinates in the virtual space corresponding to the click coordinates; a second determining module 206, connected to the first determining module 204, is used to determine whether to interact with the target object based on the boundary coordinate range of the virtual coordinate range and the target object, wherein the target object is located in the virtual space, and the depth coordinates of the coordinates within the virtual coordinate range and the coordinates within the boundary coordinate range are the same; a display module 208, connected to the second determining module 206, is used to display the interactive action corresponding to the click operation on the display interface when the interaction result is interaction with the target object.

[0122] Optionally, the receiving module 202 is further configured to receive a click operation based on the display interface, wherein the click operation carries click coordinates, and the display interface displays a virtual space; determine the virtual coordinate range corresponding to the click coordinates in the virtual space; determine the interaction result of whether to interact with the target object based on the boundary coordinate range corresponding to the virtual coordinate range and the target object, wherein the target object is located in the virtual space, the target object is an object whose current display area is less than a predetermined threshold, and the depth coordinates of the coordinates within the virtual coordinate range and the coordinates within the boundary coordinate range are the same; if the interaction result is to interact with the target object, display the interaction action corresponding to the click operation on the display interface.

[0123] Optionally, the second determining module 206 is further configured to determine the boundary coordinate range of the target object; determine the expansion parameter corresponding to the boundary coordinate range; expand the boundary coordinate range according to the expansion parameter to obtain the expanded coordinate range; determine whether there is an intersection result between the virtual coordinate range and the expanded coordinate range; and determine the interaction result according to the intersection result.

[0124] Optionally, the second determining module 206 is further configured to determine the target distance between the first coordinate within the virtual coordinate range and the second coordinate within the boundary coordinate range, wherein the target distance is the shortest distance among the distances formed by any coordinate within the virtual coordinate range and any coordinate within the boundary coordinate range; and to determine the interaction result based on the target distance and a predetermined threshold.

[0125] Optionally, the second determining module 206 is further configured to determine the moving direction and moving speed of the target object when the target object is a mobile object, and determine a predetermined threshold based on the moving direction and moving speed; and / or, determine the predetermined threshold based on the scaling ratio of the display interface and the virtual space.

[0126] Optionally, the display module 208 is further configured to display the interactive action corresponding to the click operation on the display interface when the interaction result is an interaction with a target object, including: when there are M target objects, determining the center coordinates of the objects corresponding to the M target objects respectively; determining the priority of the M target objects based on the distance between the center coordinates of the M objects and the virtual coordinate range respectively; when there is an interaction result with an interactive object, according to the priority of the M target objects, sequentially according to the corresponding interaction results, until the interaction result with the corresponding interactive object is determined, and displaying the interaction action of the click operation with the interactive object on the display interface.

[0127] Optionally, the second determining module 206 is further configured to determine the expansion parameters corresponding to the boundary coordinate range, including: determining expansion index items, wherein the expansion index items include at least one of the following: object type item, neighboring object influence item, object display ratio item; and determining the expansion parameters based on the expansion index value corresponding to the expansion index item.

[0128] Optionally, the first determining module 204 is further configured to determine the virtual coordinate range corresponding to the click coordinates, including: determining the click pixel corresponding to the click coordinates; and determining the virtual coordinate range corresponding to the click coordinates based on the click pixel size.

[0129] It should be noted that the above-mentioned receiving module 202, first determining module 204, second determining module 206 and display module 208 correspond to steps S102 to S108 in the object interaction method. The multiple modules and the corresponding steps implement the same instances and application scenarios, but are not limited to the content disclosed in the above embodiment 1.

[0130] Example 3

[0131] Embodiments of this application may provide an electronic device, which may include: one or more processors, a memory, a memory controller, and a peripheral interface, wherein the peripheral interface is connected to a radio frequency module, an audio module, and a display, the memory stores an executable program, and the processor is used to run the program, wherein the program executes the method described in any of the above-mentioned embodiments when it runs.

[0132] The memory can be used to store software programs and modules, such as the program instructions / modules corresponding to the methods and apparatus in the embodiments of this application. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, thereby implementing the above-described methods. The memory may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include memory remotely located relative to the processor, and these remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0133] The processor can access information and applications stored in memory via a transmission device to execute the following steps: receiving a click operation based on a display interface, wherein the click operation carries click coordinates, and the display interface displays a virtual space; determining the range of virtual coordinates corresponding to the click coordinates in the virtual space; determining whether to interact with the target object based on the boundary coordinate range of the virtual coordinate range and the target object, wherein the target object is located in the virtual space, the target object is an object whose current display area is less than a predetermined threshold, and the depth coordinates of the coordinates within the virtual coordinate range and the coordinates within the boundary coordinate range are the same; if the interaction result is interaction with the target object, displaying the interactive action corresponding to the click operation on the display interface.

[0134] The processor can access information and applications stored in the memory via a transmission device to execute the following steps: determining whether to interact with the target object based on the boundary coordinate range corresponding to the virtual coordinate range and the target object, including: determining the boundary coordinate range of the target object; determining the expansion parameter corresponding to the boundary coordinate range; expanding the boundary coordinate range according to the expansion parameter to obtain the expanded coordinate range; determining whether there is an intersection point between the virtual coordinate range and the expanded coordinate range; and determining the interaction result based on the intersection point result.

[0135] The processor can call the information and application program stored in the memory through the transmission device to perform the following steps: determining the interaction result of whether to interact with the target object based on the virtual coordinate range and the boundary coordinate range corresponding to the target object, including: determining the target distance between the first coordinate in the virtual coordinate range and the second coordinate in the boundary coordinate range, wherein the target distance is the shortest distance formed by any coordinate in the virtual coordinate range and any coordinate in the boundary coordinate range; and determining the interaction result based on the target distance and a predetermined threshold.

[0136] The processor can access information and applications stored in the memory via a transmission device to perform the following steps: determining a predetermined threshold before determining the interaction result based on the target distance and a predetermined threshold, including: determining the direction and speed of movement of the target object when the target object is a moving object, and determining the predetermined threshold based on the direction and speed of movement; and / or determining the predetermined threshold based on the scaling ratio of the display interface and the virtual space.

[0137] The processor can access information and applications stored in the memory via a transmission device to execute the following steps: When the interaction result is an interaction with a target object, display the interaction action corresponding to the click operation on the display interface, including: when there are M target objects, determining the center coordinates of each of the M target objects; determining the priority of the M target objects based on the distances between the center coordinates of the M objects and the virtual coordinate range; if the interaction result includes an interaction with an interactive object, based on the priority of the M target objects, sequentially determining the corresponding interaction results until an interaction result with the corresponding interactive object is determined, and displaying the interaction action between the click operation and the interactive object on the display interface.

[0138] The processor can access information and applications stored in the memory via a transmission device to perform the following steps: determining the scaling parameters corresponding to the boundary coordinate range, including: determining scaling index items, wherein the scaling index items include at least one of the following: object type item, neighboring object influence item, object display scale item; and determining the scaling parameters based on the scaling index value corresponding to the scaling index item.

[0139] The processor can access information and applications stored in the memory via a transmission device to perform the following steps: determining the virtual coordinate range corresponding to the click coordinates, including: determining the click pixel corresponding to the click coordinates; and determining the virtual coordinate range corresponding to the click coordinates based on the click pixel size.

[0140] Those skilled in the art will understand that electronic devices can also be smartphones (such as Android phones, iOS phones, etc.), tablets, PDAs, mobile internet devices (MIDs), PADs, and other terminal devices.

[0141] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing the hardware related to the terminal device. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0142] Embodiments of this application also provide a storage medium. Optionally, in this embodiment, the storage medium can be used to store the program code executed by the object interaction method provided in Embodiment 1.

[0143] Optionally, in this embodiment, the storage medium may be located in any computer terminal in a group of computer terminals in a computer network, or in any mobile terminal in a group of mobile terminals.

[0144] Example 4

[0145] This application also provides a computer program product, which, when executed on a data processing device, is suitable for performing the steps of an object interaction method: receiving a click operation based on a display interface, wherein the click operation carries click coordinates, and the display interface displays a virtual space; determining the range of virtual coordinates in the virtual space corresponding to the click coordinates; determining an interaction result of whether to interact with the target object based on the boundary coordinate range of the virtual coordinate range and the boundary coordinate range corresponding to the target object, wherein the target object is located in the virtual space, the target object is an object whose current display area is less than a predetermined threshold, and the depth coordinates of the coordinates within the virtual coordinate range and the coordinates within the boundary coordinate range are the same; and displaying the interaction action corresponding to the click operation on the display interface when the interaction result is interaction with the target object.

[0146] Example 5

[0147] According to another aspect of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored executable program, wherein, when the executable program is executed, it controls the device where the computer-readable storage medium is located to perform the method described in any of the above-described embodiments.

[0148] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0149] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0150] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0151] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0152] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0153] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0154] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A method for object interaction, characterized in that, include: Receive a click operation based on a display interface, wherein the click operation carries click coordinates, and the display interface displays a virtual space; Determine the range of virtual coordinates in the virtual space corresponding to the click coordinates; Based on the virtual coordinate range and the boundary coordinate range corresponding to the target object, an interaction result is determined as to whether to interact with the target object. The target object is located in the virtual space, and the target object is an object whose current display area is less than a predetermined threshold. The depth coordinates of the coordinates within the virtual coordinate range and the coordinates within the boundary coordinate range are the same. If the interaction result is an interaction with the target object, the interactive action corresponding to the click operation is displayed on the display interface.

2. The method according to claim 1, characterized in that, Based on the virtual coordinate range and the boundary coordinate range corresponding to the target object, the interaction result of determining whether to interact with the target object includes: Determine the boundary coordinate range of the target object; Determine the expansion parameter corresponding to the boundary coordinate range; Based on the expansion parameters, the boundary coordinate range is expanded to obtain an expanded coordinate range; Determine whether there is an intersection point between the virtual coordinate range and the expanded coordinate range; The interaction result is determined based on the intersection result.

3. The method according to claim 1, characterized in that, Based on the virtual coordinate range and the boundary coordinate range corresponding to the target object, the interaction result of determining whether to interact with the target object includes: Determine the target distance between a first coordinate within the virtual coordinate range and a second coordinate within the boundary coordinate range, wherein the target distance is the shortest distance among the distances formed by any coordinate within the virtual coordinate range and any coordinate within the boundary coordinate range; The interaction result is determined based on the target distance and a predetermined threshold.

4. The method according to claim 3, characterized in that, Before determining the interaction result based on the target distance and a predetermined threshold, the predetermined threshold is determined, including: If the target object is a moving object, determine the moving direction and moving speed of the target object, and determine the predetermined threshold based on the moving direction and moving speed; and / or, determine the predetermined threshold based on the scaling ratio of the display interface and the virtual space.

5. The method according to claim 1, characterized in that, If the interaction result is an interaction with the target object, the display interface shows the interaction action corresponding to the click operation, including: Given M target objects, determine the center coordinates of each of the M target objects. The priority of the M target objects is determined based on the distances between the center coordinates of the M objects and the virtual coordinate range. If the interaction result includes an interaction with an interactive object, then based on the priority of the M target objects, the corresponding interaction results are sequentially determined until an interaction result with the corresponding interactive object is determined, and the click operation and the interaction action with the interactive object are displayed on the display interface.

6. The method according to claim 2, characterized in that, Determining the expansion parameters corresponding to the boundary coordinate range includes: Determine the expanded indicator items, wherein the expanded indicator items include at least one of the following: object type item, neighboring object influence item, object display ratio item; The expansion parameter is determined based on the expansion index value corresponding to the expansion indicator item.

7. The method according to any one of claims 1 to 6, characterized in that, Determining the virtual coordinate range corresponding to the click coordinates includes: Determine the click pixel corresponding to the click coordinates; Based on the click pixel size, determine the virtual coordinate range corresponding to the click coordinates.

8. An object interaction device, characterized in that, include: A receiving module is used to receive click operations based on a display interface, wherein the click operation carries click coordinates, and the display interface displays a virtual space; The first determining module is used to determine the range of virtual coordinates in the virtual space corresponding to the click coordinates; The second determining module is used to determine whether to interact with the target object based on the virtual coordinate range and the boundary coordinate range corresponding to the target object. The target object is located in the virtual space, the target object is an object whose current display area is less than a predetermined threshold, and the depth coordinates of the coordinates in the virtual coordinate range and the coordinates in the boundary coordinate range are the same. The display module is used to display the interactive action corresponding to the click operation on the display interface when the interaction result is an interaction with the target object.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored executable program, wherein, when the executable program is executed, it controls the device on which the computer-readable storage medium is located to perform the method of any one of claims 1 to 7.

10. An electronic device, characterized in that, include: Memory, which stores executable programs; A processor for running the program, wherein the program, when running, performs the method according to any one of claims 1 to 7.

11. A computer program product comprising computer instructions, characterized in that, When the computer instructions are executed by the processor, they implement the steps of the method described in any one of claims 1 to 7.

Images