A data processing method, a computer device and a readable storage medium

Abstract

Embodiments of the present application provide a data processing method, a computer device and a readable storage medium, the method comprising: displaying a shooting picture in a data shooting interface; the shooting picture is obtained by a shooting component; the shooting picture contains a target object; in response to a first trigger operation on the target object in the data shooting interface, displaying a first virtual rendering area for pointing to the target object in the data shooting interface; displaying media data in the first virtual rendering area; the media data is associated with an object classification of the target object. By the present application, the display mode and the interaction mode can be enriched.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a data processing method, a computer device, and a readable storage medium. Background Technology

[0002] Currently, Augmented Reality (AR) devices can overlay real-world scenes captured by a local camera (i.e., the captured image) with rendered virtual scenes, and then display the overlaid image on the AR device. Existing AR devices can respond to triggers on the rendered virtual scene, updating it and then overlaying the updated virtual scene onto the real-world scene. However, existing AR devices cannot respond to triggers on the real-world scene, resulting in a limited interaction method. Furthermore, existing AR devices display the rendered virtual scene fixedly in a designated area of ​​the AR device, further limiting the display options. Summary of the Invention

[0003] This application provides a data processing method, a computer device, and a readable storage medium, which can enrich the display and interaction methods.

[0004] One embodiment of this application provides a data processing method, including:

[0005] The captured image is displayed in the data capture interface; the captured image is obtained through the capture component; the captured image contains the target object;

[0006] In response to the first trigger operation targeting the target object in the data capture interface, a first virtual rendering area is displayed in the data capture interface to point to the target object;

[0007] Media data is displayed in the first virtual rendering area; the media data is associated with the object category of the target object.

[0008] One embodiment of this application provides a data processing apparatus, including:

[0009] The image display module is used to display the captured image in the data capture interface; the captured image is obtained by the capture component; the captured image contains the target object;

[0010] The area display module is used to respond to the first trigger operation for the target object in the data capture interface and display the first virtual rendering area for pointing to the target object in the data capture interface.

[0011] The data display module is used to display media data in the first virtual rendering area; the media data is associated with the object category of the target object.

[0012] The area display module is specifically used to respond to the first trigger operation on the target object in the data capture interface and obtain the target position of the target object in the data capture interface.

[0013] The area display module is specifically used to display a first virtual rendering area in the data capture interface that points to the target object if the target location is the focus location in the data capture interface, according to the focus display method.

[0014] The area display module is specifically used to display a first virtual rendering area in the data capture interface that points to the target object if the target location is not in the focus position of the data capture interface, in a non-focus display mode.

[0015] Specifically, the area display module is used to respond to the first trigger operation for the target object in the data capture interface and determine the number M of display cards used to point to the target object; the number of cards M is determined based on the number of media in the media data, and M is a positive integer.

[0016] The area display module is specifically used to determine the M display cards as the first virtual rendering area for pointing to the target object, and to display the first virtual rendering area in the data capture interface.

[0017] The device also includes:

[0018] The identifier display module is used to display a hyperlink identifier associated with the target object in the area where the target object is located in the data capture interface if the target object in the data capture interface meets the hyperlink display conditions; the hyperlink identifier is associated with the target media data in the media data.

[0019] The content display module is used to respond to a second trigger operation for the target object indicated by the hyperlink identifier and display a second virtual rendering area in the data capture interface for pointing to the target object;

[0020] The content display module is used to display the media content corresponding to the target media data in the second virtual rendering area.

[0021] The device also includes:

[0022] The model display module is used to respond to modeling operations on the target object in the data capture interface and display a virtual model object with the same shape as the target object in the data capture interface.

[0023] The model transformation module is used to respond to transformation operations on virtual model objects in the data capture interface and display the virtual model objects at virtual locations in the data capture interface; the virtual location refers to the transformation position indicated by the transformation operation.

[0024] The device also includes:

[0025] The data hiding module is used to obtain the updated position of the target object in the updated data shooting interface when the data shooting interface is updated based on the mobile shooting component.

[0026] The data hiding module is used to hide the first virtual rendering area and media data if the target update position is located in the edge area of ​​the updated data capture interface, and to display a hidden mark for the target object in the updated data capture interface.

[0027] The data viewing module is used to respond to viewing operations targeting hidden identifiers of the target object, and redisplays the first virtual rendering area containing media data in the updated data capture interface.

[0028] The first triggering operation includes a voice triggering operation;

[0029] The area display module is specifically used to respond to voice trigger operations on the data shooting interface, obtain the audio data corresponding to the voice trigger operation, and identify the objects in the shooting screen that have a matching relationship with the voice text data indicated by the audio data as the target objects;

[0030] The area display module is specifically used to display the first virtual rendering area in the data capture interface, which is used to point to the target object.

[0031] The area display module includes:

[0032] The object determination unit is used to respond to the first trigger operation on the data shooting interface, obtain the trigger trajectory corresponding to the first trigger operation, and determine the object in the shooting screen that has a selection relationship with the trigger trajectory as the target object;

[0033] The area display unit is used to display a first virtual rendering area in the data capture interface for pointing to the target object.

[0034] The object determination unit includes:

[0035] The first trigger subunit is used to, when the triggering object displayed on the data capturing interface is captured by the capturing component, respond to the first triggering operation of the triggering object on the data capturing interface, and obtain the trigger trajectory corresponding to the first triggering operation; or...

[0036] The second trigger subunit is used to acquire the trigger trajectory corresponding to the first trigger operation when responding to the first trigger operation on the screen containing the data capture interface.

[0037] The object determination unit includes:

[0038] The overlay processing subunit is used to overlay the trigger trajectory and the captured image, and to identify objects in the captured image whose positions intersect with the trigger trajectory as overlay objects;

[0039] The object determination subunit is used to identify the target object from the superimposed objects that has a selected relationship with the trigger trajectory.

[0040] The object determination sub-unit is specifically used to display the object selection area associated with the at least two superimposed objects if the number of superimposed objects is at least two, and to display the candidate options corresponding to each superimposed object in the object selection area.

[0041] The object determination sub-unit is specifically used to respond to the selection operation for the candidate option, take the candidate option selected by the selection operation as the target option, and determine the superimposed object corresponding to the target option as the target object that has a selection relationship with the trigger trajectory.

[0042] The object determination subunit is specifically used to determine the overlap between the trigger trajectory and each superimposed object if the number of superimposed objects is at least two, to obtain the superimposed object with the maximum overlap from the at least two superimposed objects, and to determine the superimposed object with the maximum overlap as the target object that has a selected relationship with the trigger trajectory.

[0043] Among them, the object determination sub-unit is specifically used to input at least two superimposed objects into the heat analysis model if the number of superimposed objects is at least two. The heat analysis model is used to perform heat analysis on at least two superimposed objects to obtain the heat probability corresponding to each superimposed object.

[0044] The object determination sub-unit is specifically used to determine the superimposed object with the highest heat probability among at least two superimposed objects as the target object that has a selected relationship with the trigger trajectory.

[0045] The object determination subunit is specifically used to input at least two superimposed objects into the matching analysis model if the number of superimposed objects is at least two. The matching analysis model performs attribute feature matching analysis on at least two superimposed objects and interactive objects to obtain the attribute matching degree between the interactive object and each superimposed object. The interactive object refers to the object that starts the shooting component to obtain the shooting image.

[0046] The object determination sub-unit is specifically used to determine the superimposed object with the highest attribute matching degree among at least two superimposed objects as the target object that has a selected relationship with the trigger trajectory.

[0047] The object determination unit further includes:

[0048] The image processing subunit is used to perform image preprocessing on the captured image data in the captured scene to obtain preprocessed image data.

[0049] The image processing subunit is used to perform object edge detection on the preprocessed image data to obtain a set of object edge nodes in the preprocessed image data; the set of object edge nodes includes the edge nodes in the preprocessed image data.

[0050] The location recognition subunit is used to identify the location of the target object in the data capture interface based on the edge nodes in the edge node set.

[0051] The device also includes:

[0052] The quantity statistics module is used to count the number of distributions and triggers of target media data within a target time period, and to determine the ratio between the number of distributions and the number of triggers as the trigger probability of the target media data.

[0053] The condition determination module is used to determine if the number of triggers is greater than the number threshold and the trigger probability is greater than the probability threshold, and then determine if the target object meets the hyperlink display condition.

[0054] The model display module includes:

[0055] The model generation unit is used to respond to the modeling operation of the target object in the data shooting interface, obtain the depth information indicated by the shooting screen, map the target object in the shooting screen to the three-dimensional space based on the depth information, and generate a virtual model object with the same shape as the target object in the three-dimensional space.

[0056] The model display unit is used to display a virtual model object at the location of the target object in the data capture interface; the virtual model object is displayed over the target object.

[0057] The device also includes:

[0058] The feature extraction module is used to enhance the target objects in the data capture interface to obtain the enhanced objects.

[0059] The feature extraction module is used to extract image features from the enhanced object to obtain enhanced image features, and to extract text features from the enhanced object to obtain enhanced text features;

[0060] The classification determination module is used to perform feature fusion on enhanced image features and enhanced text features to obtain enhanced fused features, and to determine the object classification of the target object based on the enhanced fused features;

[0061] The search processing module is used to input object categories into the search engine, and the search engine performs search processing on the object categories to obtain media data for display in the first virtual rendering area.

[0062] The search processing module includes:

[0063] The search processing unit is used to input object categories into the search engine, and the search engine performs search processing on the object categories to obtain a set of media data associated with the object categories.

[0064] The feature analysis unit is used to obtain the historical trigger information corresponding to the interactive object, perform feature analysis on the historical trigger information, and obtain the historical object features of the interactive object; the interactive object refers to the object that starts the shooting component to obtain the shooting screen;

[0065] The sorting processing unit is used to sort the initial media data in the media data set based on the characteristics of historical objects, and to obtain the media data to be displayed in the first virtual rendering area from the sorted initial media data.

[0066] One embodiment of this application provides a computer device, including: a processor and a memory;

[0067] The processor is connected to a memory, which stores a computer program. When the computer program is executed by the processor, it causes the computer device to perform the method provided in the embodiments of this application.

[0068] One aspect of this application provides a computer-readable storage medium storing a computer program adapted to be loaded and executed by a processor, so that a computer device having the processor performs the method provided in this application.

[0069] One embodiment of this application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method provided in this application embodiment.

[0070] In this embodiment, the computer device can display a captured image obtained by a shooting component in a data shooting interface. The captured image includes a target object. Further, in response to a first trigger operation targeting the target object in the data shooting interface, the computer device can display a first virtual rendering area in the data shooting interface to point to the target object, and then display media data associated with the object category of the target object in the first virtual rendering area. Therefore, this embodiment can combine a first trigger operation targeting the data shooting interface with the captured image when the captured image is obtained by the shooting component, determine the target object indicated by the first trigger operation in the captured image, and then display media data associated with the object category of the target object in the first virtual rendering area. It is understood that a first virtual rendering area can be generated by pointing to the target object through the target object in the captured image, thereby enriching the interaction methods of the computer device. Furthermore, for first trigger operations targeting different objects in the captured image, different objects can generate first virtual rendering areas pointing to different objects, thereby enriching the display methods of the computer device. Attached Figure Description

[0071] To more clearly illustrate the technical solutions in the embodiments or related technologies of this application, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0072] Figure 1 This is a schematic diagram of a network architecture provided in an embodiment of this application;

[0073] Figure 2 This is a schematic diagram of a data interaction scenario provided in an embodiment of this application;

[0074] Figure 3 This is a flowchart illustrating a data processing method provided in an embodiment of this application;

[0075] Figure 4a This is a schematic diagram of a scenario for displaying a display card, provided in an embodiment of this application;

[0076] Figure 4b This is a schematic diagram of a scenario for displaying at least two display cards, provided in an embodiment of this application;

[0077] Figure 5a This is a schematic diagram illustrating a scenario for viewing media data provided in an embodiment of this application;

[0078] Figure 5b This is a schematic diagram illustrating a scenario for viewing media data provided in an embodiment of this application;

[0079] Figure 6 This is a schematic diagram illustrating a scenario of displaying a hidden identifier, provided in an embodiment of this application.

[0080] Figure 7 This is a flowchart illustrating a data processing method provided in an embodiment of this application;

[0081] Figure 8 This is a schematic diagram illustrating a scenario for displaying hyperlink identifiers provided in an embodiment of this application;

[0082] Figure 9 This is a schematic diagram of a scenario for viewing links to hyperobjects provided in an embodiment of this application;

[0083] Figure 10 This is a flowchart illustrating a data processing method provided in an embodiment of this application;

[0084] Figure 11 This is a schematic diagram of a scene undergoing modeling processing, provided in an embodiment of this application;

[0085] Figure 12a This is a scene diagram of a mobile virtual model object provided in an embodiment of this application;

[0086] Figure 12b This is a scene diagram of a rotating virtual model object provided in an embodiment of this application;

[0087] Figure 12c This is a scene diagram illustrating a flipped virtual model object provided in an embodiment of this application;

[0088] Figure 13 This is a flowchart illustrating a data processing method provided in an embodiment of this application;

[0089] Figure 14a This is a schematic diagram of a scenario for determining a target object provided in an embodiment of this application;

[0090] Figure 14b This is a schematic diagram of a scenario for determining a target object provided in an embodiment of this application;

[0091] Figure 14c This is a schematic diagram of a scenario for determining a target object provided in an embodiment of this application;

[0092] Figure 15 This is a schematic diagram of a data interaction process provided in an embodiment of this application;

[0093] Figure 16This is a flowchart illustrating a data processing method provided in an embodiment of this application;

[0094] Figure 17a This is a schematic diagram of a scenario for displaying candidate options provided in an embodiment of this application;

[0095] Figure 17b This is a schematic diagram of a scenario for determining the degree of overlap provided in an embodiment of this application;

[0096] Figure 17c This is a scene diagram illustrating a virtual rendering area as provided in an embodiment of this application;

[0097] Figure 17d This is a schematic diagram of a scenario for determining the probability of heat level, provided in an embodiment of this application;

[0098] Figure 17e This is a schematic diagram of a scenario for determining attribute matching degree provided in an embodiment of this application;

[0099] Figure 18 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application;

[0100] Figure 19 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0101] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0102] This application relates to Artificial Intelligence (AI), which is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results. In other words, AI is a comprehensive technology within computer science that attempts to understand the essence of intelligence and produce a new kind of intelligent machine that can react in a way similar to human intelligence. AI studies the design principles and implementation methods of various intelligent machines, enabling them to possess perception, reasoning, and decision-making capabilities.

[0103] Artificial intelligence (AI) is a comprehensive discipline encompassing a wide range of fields, including both hardware and software technologies. Fundamental AI technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies primarily include computer vision, speech processing, natural language processing, as well as machine learning / deep learning, autonomous driving, and intelligent transportation.

[0104] Augmented Reality (AR) technology is a novel human-computer interaction technology. AR technology can identify objects, planes, faces, etc. in the current environment and overlay virtual information on top of the current environment. The virtual information can include a simple user interface (UI) as well as additional information (such as media data in the first virtual rendering area and media display content in the second virtual rendering area involved in this application).

[0105] For details, please see Figure 1 , Figure 1 This is a schematic diagram of a network architecture provided in an embodiment of this application. Figure 1 As shown, this network architecture may include a service server 2000 and a terminal device cluster. The terminal device cluster may specifically include one or more terminal devices; the number of terminal devices in the cluster is not limited here. Figure 1 As shown, the multiple terminal devices may specifically include terminal device 3000a, terminal device 3000b, terminal device 3000c, ..., terminal device 3000n; terminal device 3000a, terminal device 3000b, terminal device 3000c, ..., terminal device 3000n can be directly or indirectly connected to the business server 2000 via wired or wireless communication, so that each terminal device can interact with the business server 2000 through the network connection.

[0106] It should be understood that in AR scenarios, such as Figure 1 Each terminal device in the illustrated terminal device cluster is an augmented reality device. Each terminal device in the cluster can include: wearable devices, smartphones, tablets, laptops, desktop computers, smart home devices, in-vehicle terminals, and other intelligent terminals with data processing capabilities. It should be understood that the application scenarios of this application may include, but are not limited to, AR scenarios.

[0107] For ease of understanding, the embodiments of this application may be described in detail below. Figure 1From the multiple terminal devices shown, one terminal device is selected as the target terminal device. For example, in the embodiments of this application, a terminal device can be selected as the target terminal device. Figure 1 The terminal device 3000n shown serves as the target terminal device, which can interact with the business server 2000. The target terminal device may integrate a camera component for capturing images; this camera component can be a camera on the target terminal device.

[0108] Among them, such as Figure 1 The business server 2000 shown can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0109] For ease of understanding, in this embodiment of the application, the objects (i.e., objects) selected by an interactive object (e.g., object Y) in the captured image for search processing can be collectively referred to as target objects. For ease of understanding, in this embodiment of the application, the content recommended to an interactive object (e.g., object Y) can be collectively referred to as media data, and the content (e.g., video data, text and image data, application data) selected by an interactive object (e.g., object Y) from the media data that matches its interests can be collectively referred to as target media data.

[0110] In this application, the media data can be video data, text and image data, or application data; this application does not limit the type of media data. It should be understood that the business scenarios applicable to the above network framework can specifically include: entertainment program on-demand scenarios, online news reading scenarios, online goods purchasing scenarios, etc. This network framework can perform search processing for target objects in business scenarios such as entertainment program on-demand scenarios, online news reading scenarios, and online goods purchasing scenarios. The specific business scenarios applicable to this network framework will not be listed here. For example, in the entertainment program on-demand scenario, the media data in this application embodiment can be video data, where the video data can be entertainment programs associated with the target object obtained after searching the object classification of the target object. As another example, in the online news reading scenario, the media data in this application embodiment can be text and image data, where the text and image data can be news articles associated with the target object obtained after searching the object classification of the target object. For example, in the scenario of purchasing goods online, the media data in this application embodiment can be application data. Here, the application data can be a shopping client associated with the target object after the object classification of the target object is searched and processed. The shopping client can include the amount required to purchase the target object.

[0111] It should be understood that an interactive object (e.g., object Y) can capture a scene in the data capture interface using a camera component. By performing object recognition on this scene, one or more objects within it can be identified. When object Y needs to search for a target object among these objects, it can perform a trigger operation (e.g., a gesture) on the target object in the data capture interface. The captured scene can be the image displayed after opening the camera component, or it can be the image during video recording using the camera component. Object recognition is a fundamental research area in computer vision; its task is to identify objects in an image and determine the object's position and orientation within the scene represented by the image. Thus, the terminal device can respond to gestures targeting the target object, identify the object's category, display a virtual rendering area in the data capture interface for pointing to the target object, and then display one or more media data items associated with the target object's category in the virtual rendering area. This allows object Y to select target media data that matches its interests from the one or more media data items.

[0112] For better understanding, please refer to [link / reference]. Figure 2 , Figure 2 This is a schematic diagram illustrating a data interaction scenario provided in an embodiment of this application. For example... Figure 2 The server 20a shown can be the one described above. Figure 1The corresponding business server 2000 in the embodiment, such as Figure 2 The terminal device 20b shown can be the one described above. Figure 1 For ease of understanding, the embodiments of this application refer to any terminal device in the terminal device cluster of the corresponding embodiments. Figure 1 The terminal device 3000n shown is used as an example of the terminal device 20b to illustrate... Figure 2 The diagram illustrates the specific process of data interaction between terminal device 20b and server 20a. The interaction object corresponding to terminal device 20b can be interaction object 20c.

[0113] like Figure 2 As shown, the interactive object 20c can be captured by a camera component integrated on the terminal device 20b, so as to display the captured image 21c in the data capture interface 21a of the terminal device 20b. The captured image 21c may include one or more objects, and the one or more objects may specifically include... Figure 2 The object 22a is shown. When the terminal device 20b is a wearable device, the capturing component can be a camera on AR glasses.

[0114] Furthermore, if the interactive object 20c needs to perform search processing on object 22a, a trigger operation (e.g., a first trigger operation) can be executed on object 22a to send a data acquisition request to server 20a via terminal device 20b. This data acquisition request is sent by terminal device 20b based on the captured image 21c and the first trigger operation. The first trigger operation can include contact operations such as clicking, long-pressing, and swiping, or non-contact operations such as voice and gestures; this application does not limit the scope of the application.

[0115] It should be understood that when the first triggering operation is a gesture operation, this application embodiment does not limit the specific type of gesture operation. It is understood that gesture recognition refers to understanding the behavior of an interactive object through computer vision, allowing the interactive object to control a virtual scene through gestures, so that the virtual scene can interact with the gestures of the interactive object, thereby improving the user experience of the interactive object. Optionally, it is understood that the interactive object 20c can also perform a gesture input operation on the data capture interface 21a. In this way, the terminal device 20b can obtain the input gesture corresponding to the gesture input operation, and then send a data acquisition request to the server 20a when the first triggering operation is this input gesture.

[0116] like Figure 2As shown, after receiving a data acquisition request, server 20a can retrieve the object 22a matching the first trigger operation from the captured image 21c, and identify object 22a as the target object. Then, it performs search processing on the target object, retrieving media data associated with the object category of the target object from the content database 20d. The content database 20d can include multiple media databases, specifically including: media database 23a, media database 23b, ..., media database 23n. Media databases 23a, 23b, ..., 23n can be used to store initial media data for different object categories. For example, media database 23a can be used to store initial media data associated with object category D1, media database 23b can be used to store initial media data associated with object category D2, ..., media database 23n can be used to store initial media data associated with object category D1, D2, D3, D3, D4, D5, D6, D7, D8, D9, D1, D1, D2, D1, D2, D3, D9, D1, D2, D2, D3 ... n Related initial media data.

[0117] For example, if object 22a is classified as D1, the search result obtained after searching object 22a could be media database 23a. Server 20a can then retrieve media database 23a from content database 20d, and further retrieve media data for pushing to terminal device 20b from the initial media data of media database 23a. The media data for pushing to terminal device 20b can be media data 22b, which may include multiple media data sets. Taking four media data sets as an example, these four media data sets can specifically include: media data S1, media data S2, media data S3, and media data S4. It can be understood that when retrieving media data S1, media data S2, media data S3, and media data S4, server 20a can determine the order of these media data sets, and then push the predefined order, along with all three media data sets, to terminal device 20b.

[0118] like Figure 2 As shown, after receiving media data 22b returned by server 20a, terminal device 20b can display a virtual rendering area 22c (i.e., the first virtual rendering area 22c) in the data capture interface 21c to point to object 22a based on the media data 22b. Furthermore, according to the predefined order contained in the media data 22b, the media data 22b is displayed in the virtual rendering area 22c. For example, the order of media data S1 can be the first position, the order of media data S2 can be the second position, the order of media data S3 can be the third position, and the order of media data S4 can be the fourth position.

[0119] Optionally, the terminal device 20b can also display the media data 22b associated with the object category of object 22a in the virtual rendering area 22c, while simultaneously displaying the object category of object 22a, which is object category D1, and object category D1 can be "mug". At this time, the terminal device 20b can switch the data capture interface from data capture interface 21a to data capture interface 21b, that is, data capture interface 21a and data capture interface 21b can be the data capture interface of the terminal device 20b at different times.

[0120] The virtual rendering area 22c can be located anywhere within the data capture interface 21a. Generally, the virtual rendering area 22c can be located at the location of object 22a, and correspondingly, the media data 22b is located at the location of object 22a. The location of object 22a can be either overlaid on top of object 22a or displayed immediately next to object 22a. Furthermore, the virtual rendering area 22c can either obscure the captured image 21c for display or be displayed after adjusting its transparency.

[0121] It is understood that the virtual rendering area 22c may include one or more display cards. This application does not limit the number of display cards. Figure 2 The following explanation uses the example of a virtual rendering area 22c including a display card. When the virtual rendering area 22c includes a display card, the terminal device 20b can display media data 22b in one display card; optionally, when the virtual rendering area 22c includes multiple display cards, the terminal device can display media data 22b in multiple display cards.

[0122] Therefore, this embodiment of the application can, when displaying a captured image containing a target object in the data capture interface, respond to a first trigger operation targeting the target object, perform search processing on the target object, and generate a first virtual rendering area pointing to the target object, thereby enriching the interaction methods of the computer device. The first virtual rendering area can be used to display media data obtained after searching for the target object. This media data is the media data most associated with the interactive object; different interactive objects will obtain different media data. Furthermore, for the first trigger operation targeting different objects in the captured image, different objects can generate first virtual rendering areas pointing to different objects, thereby enriching the display methods of the computer device.

[0123] Further, please see Figure 3 , Figure 3This is a flowchart illustrating a data processing method provided in an embodiment of this application. The method can be executed by a server, a terminal device, or both. The server can be one of the aforementioned... Figure 2 The server 20a in the corresponding embodiment can be the terminal device described above. Figure 2 The corresponding embodiment uses terminal device 20b. For ease of understanding, this application embodiment uses the method executed by the terminal device as an example for illustration. The data processing method may include the following steps S101-S103:

[0124] Step S101: Display the shooting screen in the data shooting interface;

[0125] The captured image is obtained by capturing images through a camera component. The captured image contains one or more objects, and the one or more objects contain the target object.

[0126] It is understandable that when the interactive object corresponding to the terminal device (e.g., Figure 2 When the interactive object 20c) in the corresponding embodiment needs to start the shooting component in the terminal device, it can perform a start operation on the shooting component. In this way, the terminal device can respond to the start operation performed by the interactive object on the shooting component, start the shooting component in the terminal device, shoot the real scene through the shooting component, and display the shooting screen in the data shooting interface of the terminal device.

[0127] Step S102: In response to the first trigger operation for the target object in the data capture interface, display a first virtual rendering area in the data capture interface for pointing to the target object.

[0128] Specifically, the terminal device can respond to a first trigger operation targeting a target object in the data capture interface to obtain the target object's position in the data capture interface. Further, if the target position is at the focus position in the data capture interface, the terminal device can display a first virtual rendering area pointing to the target object in a focus display mode. Optionally, if the target position is not at the focus position in the data capture interface, the terminal device can display the first virtual rendering area pointing to the target object in a non-focus display mode.

[0129] The focus position refers to the location in the center of the data capture interface, while the non-focus position refers to the location outside the center. The center and non-center areas are manually defined; for example, the terminal device can designate the central 60% of the data capture interface as the center area and the surrounding 40% as the non-center area.

[0130] Understandably, the terminal device can acquire the auxiliary command trajectory used to trigger the display of the first virtual rendering area and perform a similarity judgment between the auxiliary command trajectory and the trigger trajectory corresponding to the first triggering operation. The auxiliary command trajectory can be in the shape of a "?". Further, if the auxiliary command trajectory and the trigger trajectory meet the trajectory similarity condition, the terminal device executes the step of displaying the first virtual rendering area pointing to the target object in the data capture interface. Optionally, if the auxiliary command trajectory and the trigger trajectory do not meet the trajectory similarity condition, the terminal device does not need to execute any steps.

[0131] It should be understood that when responding to a first trigger operation targeting a target object in the data capture interface, the terminal device can determine the number M of display cards (i.e., AR cards) used to point to the target object. The number M is determined based on the amount of media data, and M can be a positive integer. Furthermore, the terminal device can define the M display cards as a first virtual rendering area for pointing to the target object and display this first virtual rendering area in the data capture interface. The M display cards have predefined priorities.

[0132] It is understood that if the target location is at the focus position in the data capture interface, the terminal device can acquire media data associated with the object classification of the target object. The media data is obtained after searching for the object classification of the target object; the object classification is obtained after classifying the target object. Further, the terminal device can determine that the number of cards indicated by the focus display mode is one (i.e., M equals 1), and display a first virtual rendering area in the data capture interface to point to the target object according to one card. Optionally, the terminal device can determine that the number of cards indicated by the focus display mode is at least two (i.e., M is a positive integer greater than 1), and display a first virtual rendering area in the data capture interface to point to the target object according to at least two cards. It should be understood that this embodiment of the application uses the focus display mode corresponding to one display card as an example for explanation.

[0133] It is understood that if the target location is not in the focus position of the data capture interface, the terminal device can acquire media data associated with the object classification of the target object. The media data is obtained after searching for the object classification of the target object; the object classification is obtained after classifying the target object. Further, the terminal device can determine that the number of cards indicated by the non-focus display mode is at least two (i.e., M is a positive integer greater than 1), and display a first virtual rendering area for pointing to the target object in the data capture interface according to at least two cards. Optionally, the terminal device can determine that the number of cards indicated by the non-focus display mode is one (i.e., M equals 1), and display a first virtual rendering area for pointing to the target object in the data capture interface according to one card. It should be understood that the embodiments of this application are described using the example of a non-focus display mode corresponding to at least two display cards.

[0134] It is understood that the card shapes corresponding to the focus display mode and the non-focus display mode can be different or the same. For example, the card shape corresponding to the focus display mode can be circular, and the card shape corresponding to the non-focus display mode can be triangular. For ease of understanding, this application embodiment uses the example where the card shape corresponding to both the focus display mode and the non-focus display mode is rectangular.

[0135] Optionally, embodiments of this application may also pre-set the display method of the display cards. In this way, the terminal device can respond to a first trigger operation targeting a target object in the data capture interface and display a first virtual rendering area pointing to the target object in the data capture interface according to the pre-set display method. The number of cards indicated by the pre-set display method can be one or at least two; this is not limited here.

[0136] Step S103: Display media data in the first virtual rendering area.

[0137] Among them, media data is associated with the object classification of the target object. The media data here is obtained by the terminal device after responding to the first trigger operation for the target object.

[0138] Specifically, if the first virtual rendering area includes at least two display cards, the terminal device can display the media data, divided into equal portions, in the at least two display cards respectively. Each display card displays different media data, and one display card is used to display one or more media data. This embodiment illustrates this by using one display card to display one piece of media data in the case of at least two display cards. Optionally, if the first virtual rendering area includes one display card, the terminal device can display the media data in one display card.

[0139] It should be understood that the embodiments of this application are illustrated using the example of at least two media data associated with the object classification of the target object. Optionally, when the number of media data is one, the non-focus display mode corresponds to one display card, and the terminal device can display a first virtual rendering area for pointing to the target object in the data capture interface according to the number of cards.

[0140] For ease of understanding, the specific process of a terminal device displaying media data on a display card can be found in [link to documentation]. Figure 4a , Figure 4a This is a schematic diagram of a scenario for displaying a display card according to an embodiment of this application; the specific process of the terminal device displaying media data on at least two display cards can be found in [reference needed]. Figure 4b , Figure 4b This is a schematic diagram illustrating a scenario where at least two display cards are shown, as provided in an embodiment of this application. Figure 4a The data capture interfaces 40a and 40b shown can be the data capture interfaces of the terminal device at different times, such as... Figure 4b The data capture interfaces 42a and 42b shown can be the data capture interfaces of the terminal device at different times. Figure 4b The data capture interface 42a shown can be used for Figure 4a The data capture interface 40a shown is shown.

[0141] like Figure 4a As shown, the data capture interface 40a of the terminal device can display a captured image 40c obtained through the capture component. The captured image 40c can contain a target object 41a that the interactive object is interested in. Here, the target object 41a can be the "mug" displayed in the captured image 40c, that is, the object category of the target object 41a can be "mug". It can be understood that when the interactive object needs to perform search processing on the target object 41a, the interactive object can perform a first trigger operation on the target object 41a. Here, the first trigger operation can be a gesture operation 41b performed by the interactive object on the target object 41a.

[0142] In this way, the terminal device can respond to the gesture operation 41b performed by the interactive object on the target object 41a, obtain the trigger trajectory 41c corresponding to the gesture operation 41b, and perform a similarity judgment on the trigger trajectory 41c and the auxiliary command trajectory to obtain a similarity judgment result. It can be understood that if the similarity judgment result indicates that the trigger trajectory 41c and the auxiliary command trajectory meet the trajectory similarity condition, the terminal device can display a first virtual rendering area for pointing to the target object 41a in the data capture interface 40a.

[0143] It is understandable that the terminal device can obtain the target position of the target object 41a in the data capture interface 40a, such as... Figure 4a As shown, the target location is at the focal point of the data capture interface 40a. Therefore, the terminal device can display a display card 41d in the data capture interface 40a to point to the target object 41a, and define the display card 41d as the first virtual rendering area for pointing to the target object 41a. Further, the terminal device can display media data associated with the object category (i.e., "mug") of the target object 41a in the first virtual rendering area, resulting in the data capture interface 40b. Here, the media data associated with the "mug" can be media data S1, media data S2, media data S3, and media data S4, that is, the terminal device can display media data S1, media data S2, media data S3, and media data S4 in the display card 41d.

[0144] like Figure 4b As shown, the data capture interface 42a of the terminal device can display a captured image 42c obtained through the capture component. The captured image 42c can contain a target object 43a that the interactive object is interested in. Here, the target object 43a can be the "mug" displayed in the captured image 42c, that is, the object category of the target object 43a can be "mug". It can be understood that when the interactive object needs to perform search processing on the target object 41a, the interactive object can perform a first trigger operation on the target object 43a. Here, the first trigger operation can be a gesture operation 43b performed by the interactive object on the target object 43a.

[0145] In this way, the terminal device can respond to the gesture operation 43b performed by the interactive object on the target object 43a, obtain the trigger trajectory 43c corresponding to the gesture operation 43b, and perform a similarity judgment on the trigger trajectory 43c and the auxiliary command trajectory to obtain a similarity judgment result. It can be understood that if the similarity judgment result indicates that the trigger trajectory 43c and the auxiliary command trajectory meet the trajectory similarity condition, the terminal device can display a first virtual rendering area for pointing to the target object 43a in the data capture interface 42a.

[0146] It is understandable that the terminal device can obtain the target position of the target object 43a in the data capturing interface 42a, such as... Figure 4bAs shown, the target location is in a non-focus position within the data capture interface 42a. Therefore, the terminal device can display display cards 43d, 43e, 43f, and 43g in the data capture interface 42a to point to the target object 43a, defining these display cards as the first virtual rendering area for pointing to the target object 43a. Further, the terminal device can display media data associated with the object category (i.e., "mug") of the target object 43a within the first virtual rendering area, resulting in the data capture interface 42b. Here, the media data associated with the "mug" can be media data S1, media data S2, media data S3, and media data S4. For example, the terminal device can display media data S1 in display card 43d, media data S2 in display card 43e, media data S3 in display card 43f, and media data S4 in display card 43g.

[0147] It should be understood that the terminal device can respond to a trigger operation targeting media data in the first virtual rendering area by displaying a second virtual rendering area in the data capture interface to point to the target object. Furthermore, the terminal device can determine the media data corresponding to the trigger operation as the target media data and display the media display content corresponding to the target media data in the second virtual rendering area.

[0148] For ease of understanding, the terminal device is in Figure 4a For the specific process of viewing media data in the corresponding scenario, please refer to [link / reference]. Figure 5a Terminal equipment Figure 4b For the specific process of viewing media data in the corresponding scenario, please refer to [link / reference]. Figure 5b , Figure 5a and Figure 5b This is a schematic diagram of a scenario for viewing media data provided in an embodiment of this application. Figure 5a The data capture interface 40b shown can be used for... Figure 4a The data capture interface 40b shown is shown. Figure 5b The data capture interface 42b shown can be used for... Figure 4b The data capture interface 42b is shown. Among them, Figure 5a The second virtual rendering area 50b shown can be Figure 5b The second virtual rendering area 51b shown is... Figure 5a The media display content 50c shown can be Figure 5b The media display content shown is 51c.

[0149] like Figure 5aAs shown, the data capture interface 40b can display a display card 41d, which can display media data S1, media data S2, media data S3, and media data S4. It can be understood that when an interactive object needs to view the media display content corresponding to media data S1, the interactive object can perform a trigger operation on media data S1. This trigger operation can be a gesture operation 50d performed by the interactive object on the area 50a corresponding to media data S1.

[0150] In this way, the terminal device can respond to the gesture operation 50d performed by the interactive object on the area 50a corresponding to the media data S1, identify the media data S1 as the target media data, and display it in the data capture interface 40b to point to the target object (i.e., Figure 4a The second virtual rendering area 50b of the target object 41a) in the corresponding embodiment. Further, the terminal device can display the media display content 50c corresponding to the target media data in the second virtual rendering area 50b to obtain the data capture interface 40c.

[0151] like Figure 5b As shown, the data capture interface 42b can display display cards 43d, 43e, 43f, and 43g. Display card 43d can display media data S1, display card 43e can display media data S2, display card 43f can display media data S3, and display card 43g can display media data S4. It can be understood that when the interactive object needs to view the media display content corresponding to media data S1, the interactive object can perform a trigger operation on media data S1. This trigger operation can be a gesture operation 51d performed by the interactive object on the area 51a corresponding to media data S1.

[0152] In this way, the terminal device can respond to the gesture operation 51d performed by the interactive object on the area 51a corresponding to the media data S1, identify the media data S1 as the target media data, and display it in the data capture interface 42b to point to the target object (i.e., Figure 4b The second virtual rendering area 51b of the target object 43a) in the corresponding embodiment. Further, the terminal device can display the media display content 51c corresponding to the target media data in the second virtual rendering area 51b to obtain the data capture interface 42c.

[0153] The interactive object can also perform a close operation on either the second virtual rendering area 50b or the second virtual rendering area 51b. Here, we will use the second virtual rendering area 51b as an example. It is understood that the computer device can respond to the close operation on the second virtual rendering area 51b, closing the second virtual rendering area 51b and switching the data capture interface 42c to the data capture interface 42b.

[0154] It should be understood that when the data capture interface is updated based on the mobile capture component, the terminal device can obtain the updated position of the target object in the updated data capture interface. Furthermore, if the updated position of the target object is located in the edge area (i.e., the non-safe area) of the updated data capture interface, the terminal device can hide the first virtual rendering area and the media data, displaying a hidden identifier for the target object in the updated data capture interface. The state of the first virtual rendering area and the media data can be referred to as the omission mode. Furthermore, the terminal device can respond to a viewing operation of the hidden identifier for the target object, redisplaying the first virtual rendering area containing the media data in the updated data capture interface.

[0155] For easier understanding, please refer to Figure 6 , Figure 6 This is a schematic diagram illustrating a scenario for displaying / hiding an identifier, provided in an embodiment of this application. For example... Figure 6 As shown, when the terminal device is a wearable device, the interactive object 61d can be a user wearing AR glasses. When the interactive object 61d is wearing AR glasses and looking straight ahead, it can observe the data capture interface 60a in the AR glasses; when the interactive object 61d slightly raises its head, it can observe the data capture interface 60b in the AR glasses.

[0156] like Figure 6 The data capture interface 60a shown can be used for the above. Figure 4a The data capture interface 40b in the corresponding embodiment and the data capture interface 60a may include a first virtual rendering area 61a, and the first virtual rendering area 61a may include media data 61b. For example... Figure 6 The data capture interface 60a shown may include edge and non-edge regions. When the target object (e.g., target object 61f) is fully displayed, target object 61f is in the non-edge region; when target object 61f is not fully displayed, target object 61f is in the edge region. Similarly, as... Figure 6 The data capture interface 60b shown may include edge regions and non-edge regions corresponding to the data capture interface 60a. It should be understood that edge regions and non-edge regions are relative to the target object; for different target objects, the corresponding edge regions and non-edge regions are different.

[0157] like Figure 6 As shown, when the interactive object 61d slightly tilts its head up while looking straight ahead, the data capture interface can be updated based on the moving capture component. The data capture interface on the terminal device can switch from data capture interface 60a to data capture interface 60b, where data capture interface 60b can be the updated data capture interface 60a. At the same time, the target position of the target object 61f in data capture interface 60a (not shown in the figure) can be switched to the target update position 61c in data capture interface 60b.

[0158] like Figure 6 As shown, the target position of target object 61f (not shown in the figure) can be located in the non-edge area of ​​data capture interface 60a, and the target update position 61c of target object 61f can be located in the edge area of ​​data capture interface 60b. At this time, the terminal device can hide the first virtual rendering area 61a and media data 61b in data capture interface 60a, resulting in data capture interface 60b, in which a hidden identifier 61e for target object 61f is displayed. Further, interactive object 61d can respond to a viewing operation on the hidden identifier 61e, redisplaying the first virtual rendering area 61a containing media data 61b in data capture interface 60b, resulting in data capture interface 60c (not shown in the figure).

[0159] Therefore, this embodiment of the application can, when capturing a scene in a data capture interface using a capturing component, combine a first trigger operation on the data capture interface with the captured scene to determine the target object indicated by the first trigger operation in the captured scene. Then, media data associated with the object category of the target object is displayed in a first virtual rendering area used to point to the target object. It is understood that a first virtual rendering area can be generated by pointing to the target object through the target object in the captured scene, thereby enriching the interaction methods of the computer device. Furthermore, for first trigger operations targeting different objects in the captured scene, different objects can generate first virtual rendering areas pointing to different objects, thereby enriching the display methods of the computer device.

[0160] Further, please see Figure 7 , Figure 7 This is a flowchart illustrating a data processing method provided in an embodiment of this application. The method can be executed by a server, a terminal device, or both. The server can be one of the aforementioned... Figure 2 The server 20a in the corresponding embodiment can be the terminal device described above. Figure 2The corresponding embodiment uses terminal device 20b. For ease of understanding, this application embodiment uses the method executed by the terminal device as an example for illustration. The data processing method may include the following steps S201-S205:

[0161] Step S201: Calculate the number of distributions and triggers of the target media data within the target time period, and determine the ratio between the number of distributions and the number of triggers as the trigger probability of the target media data.

[0162] The target media data can be any media data pushed to the first virtual rendering area. In this embodiment, the target media data is media data that meets the hyperlink display conditions.

[0163] It should be understood that the embodiments of this application do not limit the duration of the target time period. For example, the target time period can be one year, one month, or one hour. The embodiments of this application do not limit the time node in which the target time period is located. For example, the target time period can be the duration of the previous year, the duration of time preceding the current moment, or the duration of time within a specified time period before the current moment.

[0164] Understandably, the target media data can be any media data within the first virtual rendering area. The distribution quantity represents the number of target media data distributed to the first virtual rendering area within the target time period, and the trigger quantity represents the number of target media data triggered within the first virtual rendering area within the target time period. For example, the target media data can be distributed to Z1 terminal devices within the target time period. Each of the Z1 terminal devices displays the target media data in its respective first virtual rendering area. Among the target media data displayed on the Z1 terminal devices, Z2 target media data are triggered by different interactive objects to view the media display content (i.e., the details page) corresponding to the target media data. Therefore, Z1 here is the distribution quantity, and Z2 here is the trigger quantity, where Z1 can be a positive integer, and Z2 can be a positive integer less than or equal to Z1.

[0165] Step S202: If the number of triggers is greater than the number threshold and the trigger probability is greater than the probability threshold, then the target object is determined to meet the hyperlink display condition.

[0166] Specifically, the terminal device can obtain a quantity threshold associated with the hyperlink quantity condition, compare the trigger quantity with the quantity threshold, and if the trigger quantity is greater than the quantity threshold (e.g., 1000), then the target object is determined to meet the hyperlink quantity condition. Further, the terminal device can obtain a probability threshold associated with the hyperlink probability condition, compare the trigger probability with the probability threshold, and if the trigger probability is greater than the probability threshold (e.g., 60%), then the target object is determined to meet the hyperlink probability condition. Further, if the target object meets both the hyperlink quantity condition and the hyperlink probability condition, then the target object is determined to meet the hyperlink display condition.

[0167] It should be understood that the embodiments of this application use media data associated with the target object as an example for illustration. The shooting screen may also include objects other than the target object (e.g., object P1). If the number of triggers of the target media data associated with object P1 is greater than the number threshold, and the trigger probability of the target media data associated with object P1 is greater than the probability threshold, then it is determined that object P1 meets the hyperlink display conditions.

[0168] Step S203: If the target object in the data capture interface meets the hyperlink display conditions, then a hyperlink icon associated with the target object is displayed in the area where the target object is located in the data capture interface.

[0169] The hyperlink identifier is associated with the target media data within the media data. In other words, if the number and probability of triggers for the target media data meet the hyperlink display conditions, a hyperlink identifier associated with the target media data will be displayed in the area where the target object is located in the data capture interface.

[0170] It should be understood that the terminal device can directly display the hyperlink icon in the area where the target object is located when the target object meets the hyperlink display conditions. Optionally, the terminal device can also display the hyperlink icon in the area where the target object is located after responding to a display operation for the data capture interface. The specific process of the terminal device responding to a display operation for the data capture interface can be found in [link to relevant documentation]. Figure 8 , Figure 8 This is a schematic diagram illustrating a scenario for displaying hyperlink identifiers, provided in an embodiment of this application. Wherein, Figure 8 The data capture interface 80a shown can be used for the above. Figure 4a The corresponding embodiment shows the data capture interface 40a.

[0171] like Figure 8As shown, the data capture interface 80a of the terminal device can display a captured image 80c obtained by the capturing component. The captured image 80c can contain a target object 82b that the interactive object is interested in. Here, the target object 82b can be the "mug" displayed in the captured image 80c. Therefore, the interactive object can perform a display operation on the data capture interface 80a. This display operation can be a gesture operation 81a performed by the interactive object on the data capture interface 80a.

[0172] In this way, the terminal device can respond to the gesture operation 81a performed by the interactive object on the data capturing interface 80a. When the target object 82b meets the hyperlink display conditions, a hyperlink identifier 81c is displayed in the area where the target object 82b is located, thus obtaining a data capturing interface 80b containing the hyperlink identifier 81c. The area where the target object 82b is located can be any area used to identify the target object 82b. This embodiment of the application uses the bottom of the target object 82b as an example, meaning the hyperlink identifier 81c can be displayed at the bottom of the target object 82b.

[0173] In addition, such as Figure 8 As shown, the shooting screen 80c may also include an object 82a, which can be a "telephone" displayed in the shooting screen 80c. Therefore, when the terminal device responds to a gesture operation 81a performed by the interactive object on the data shooting interface 80a, if the object 82a meets the hyperlink display conditions, a hyperlink identifier 81b is displayed in the area where the object 82a is located, resulting in a data shooting interface 80b containing the hyperlink identifier 81b. The hyperlink identifier 81b can be displayed at the bottom of the object 82a.

[0174] It should be understood that when a hyperlink is displayed in the data capture interface, if the interactive object needs to view the media content indicated by the hyperlink, the computer device can perform the following steps S204-S205. Optionally, if the interactive object needs to directly obtain media data associated with the object category of the target object, the computer device can perform the above... Figure 3 Steps S102-S103 in the corresponding embodiments.

[0175] Step S204: In response to the second trigger operation for the target object indicated by the hyperlink identifier, a second virtual rendering area for pointing to the target object is displayed in the data capture interface;

[0176] Specifically, the terminal device can respond to a second trigger operation for the target object indicated by the hyperlink identifier, obtain the media display content corresponding to the target media data associated with the hyperlink identifier, and perform the following step S205 to display the media display content corresponding to the target media data in the second virtual rendering area.

[0177] Step S205: Display the media display content corresponding to the target media data in the second virtual rendering area.

[0178] The terminal device can count the number of times updated media data is distributed and the number of times it is triggered within a target time period. Based on these distribution and trigger counts, it determines whether the updated media data meets the hyperlink display criteria. Understandably, when the updated media data meets the hyperlink display criteria, the computer device can display a hyperlink associated with the target object in the area where the target object is located on the data capture interface. This hyperlink is associated with the updated media data within the media data.

[0179] For ease of understanding, the terminal device is in Figure 8 For details on how to view the media content displayed via hyperlinks in the corresponding scenarios, please refer to [link to relevant documentation]. Figure 9 , Figure 9 This is a schematic diagram illustrating a scenario for viewing links to hyperobjects, provided in an embodiment of this application. Figure 9 The data capture interface 80b shown can be used for Figure 8 The data capture interface shown is 80b.

[0180] like Figure 9 As shown, the data capture interface 80b may include a target object 82b and a hyperlink identifier 81c associated with the target object 82b. It can be understood that when the interactive object needs to view the media display content corresponding to the hyperlink identifier 81c, the interactive object can perform a second trigger operation on the target object 82b. This second trigger operation can be a gesture operation 90b performed by the interactive object on the target object 82b.

[0181] In this way, the terminal device can respond to the gesture operation 90b performed by the interactive object on the target object 82b, display a second virtual rendering area 90a in the data capture interface 80b for pointing to the target object 82b, and then display the media display content 90c corresponding to the hyperlink identifier 81c in the second virtual rendering area 90a, thus obtaining the data capture interface 80c. Here, the media data corresponding to the media display content 90c can be media data S1. Figure 9 The second virtual rendering area 90a shown can be Figure 5aThe second virtual rendering area 50b shown in Figure 5 and the media display content 90c shown in Figure 5 can be... Figure 5a The media display content shown is 50c.

[0182] In addition, such as Figure 9 As shown, the data capture interface 80b may also include an object 82a and a hyperlink identifier 81b associated with the object 82a. It is understood that when the interactive object needs to view the media display content corresponding to the hyperlink identifier 81b, the interactive object can perform a gesture operation 90b on the object 82a. In this way, the terminal device can display a second virtual rendering area 90d (not shown in the figure) in the data capture interface 80b for pointing to the object 82a, and then display the media display content 90e (not shown in the figure) corresponding to the hyperlink identifier 81b in the second virtual rendering area 90d (not shown in the figure). The media data corresponding to the media display content 90e (not shown in the figure) can be media data S9.

[0183] It's understandable that hyperlink identifiers 81c and 81b can also be called hyperlinks (or simply hyperlinks), which represent links from one object to another page. By adding hyperlinks to objects, users can navigate to other pages associated with that object when using the corresponding hyperlink.

[0184] It should be understood that the embodiments of this application can also automatically update the target media data associated with the hyperlink identifier to change the hyperlink associated with the target object. The media data used to update the target media data can be called the updated media data. The target media data can be the media data associated with the hyperlink identifier at time T1, and the updated media data can be the media data associated with the hyperlink identifier at time T2. Here, time T2 can be the next time after time T1.

[0185] Therefore, this application provides a method for intelligently generating hyperlink identifiers (i.e., hyperlinks) for target objects based on the number of distributions and triggers, thus enabling the target object to be hyperlinked. Specifically, if a computer device detects that most interactive objects are viewed for an extended period on a certain results page (i.e., the media display content corresponding to the target media data), and the cumulative exposure of the media display content reaches a certain amount, it can determine that the target object meets the hyperlink display conditions and automatically add a hyperlink to the target object. It is understandable that using hyperlinks can quickly and accurately obtain media data of interest to most interactive objects, thereby improving the search efficiency for target objects and the search experience for interactive objects.

[0186] Further, please see Figure 10 , Figure 10 This is a flowchart illustrating a data processing method provided in an embodiment of this application. The method can be executed by a server, a terminal device, or both. The server can be one of the aforementioned... Figure 2 The server 20a in the corresponding embodiment can be the terminal device described above. Figure 2 The corresponding embodiment uses terminal device 20b. For ease of understanding, this application embodiment uses the method executed by the terminal device as an example for explanation. The data processing method may include the following steps S301-S302:

[0187] Step S301: In response to the modeling operation of the target object in the data capture interface, a virtual model object with the same shape as the target object is displayed in the data capture interface.

[0188] Specifically, the terminal device can respond to modeling operations on the target object in the data capture interface, obtain the depth information indicated by the captured image, map the target object in the captured image to a three-dimensional space based on the depth information, and generate a virtual model object with the same shape as the target object in the three-dimensional space. Furthermore, the terminal device can display the virtual model object at the location of the target object in the data capture interface. The virtual model object is displayed overlaid on the target object.

[0189] Understandably, a depth-information-enabled camera can record the depth value (i.e., depth information) of each pixel in the captured image data using a depth buffer. This depth buffer allows for the determination of pixel occlusion relationships, ensuring the accuracy of 3D modeling (i.e., modeling operations). Furthermore, 3D modeling enables the placement of virtual objects within the current real-world environment, achieving a fusion of virtual and real-world environments.

[0190] It should be understood that the embodiments of this application take the object to be modeled as the target object for illustration. The shooting screen may also include objects other than the target object (e.g., object P2). If the interactive object performs a modeling operation on object P2, the terminal device can display a virtual model object with the same shape as object P2 in the data shooting interface.

[0191] For ease of understanding, the specific process of the terminal device modeling the target object can be found in [reference needed]. Figure 11 , Figure 11 This is a schematic diagram of a scene undergoing modeling processing according to an embodiment of this application. Figure 11 The data capture interface 110a shown can be used for the above Figure 4a The corresponding embodiment shows the data capture interface 40a.

[0192] like Figure 11As shown, the data capture interface 110a may include object 111b. It can be understood that when the interactive object needs to perform modeling processing on object 111b, the interactive object can perform a modeling operation on object 111b. Here, the modeling operation can be a gesture operation 111a performed by the interactive object on object 111b.

[0193] In this way, the terminal device can respond to the gesture operation 111a performed by the interactive object on object 111b, and display a virtual model object 111c with the same shape as object 111b at the location of object 111b in the data capturing interface 110a, thus obtaining the data capturing interface 110b. Among them, the virtual model object 111c is displayed over object 111b.

[0194] Step S302: In response to the transformation operation of the virtual model object in the data capture interface, the virtual model object is displayed at a virtual location in the data capture interface.

[0195] Virtual position refers to the transformed position indicated by the transformation operation.

[0196] Transformation operations can include, but are not limited to, movement, rotation, and flipping operations. For ease of understanding, the specific process of performing movement operations on a virtual model object can be found in [link to documentation]. Figure 12a , Figure 12a This is a scene illustration of a mobile virtual model object provided in an embodiment of this application; the specific process of performing a rotation operation on the virtual model object can be found in [reference needed]. Figure 12b , Figure 12b This is a scene illustration of a rotating virtual model object provided in an embodiment of this application; the specific process of performing a flip operation on the virtual model object can be found in [reference needed]. Figure 12c , Figure 12c This is a scene diagram of a flipped virtual model object provided in an embodiment of this application. Figure 12a , Figure 12b and Figure 12c The data capture interface 110b shown can be used for... Figure 11 The data capture interface 110b shown is shown.

[0197] like Figure 12a As shown, the data capture interface 110b may include a virtual model object 111c, and an object 111b is also displayed overlaid on the virtual model object 111c. It can be understood that when the interactive object needs to move the virtual model object 111c, the interactive object can perform a movement operation on the virtual model object 111c. This movement operation can be a gesture operation 120a performed by the interactive object on the virtual model object 111c.

[0198] In this way, the terminal device can respond to the gesture operation 120a performed by the interactive object on the virtual model object 111c, move the virtual model object 111c in the data capture interface 110b, and display the virtual model object 111c at the virtual position indicated by the gesture operation 120a in the data capture interface 110b (i.e., the end position of the movement trajectory corresponding to the gesture operation 120a), thus obtaining the data capture interface 120b. At this time, the object 111b under the virtual model object 111c is displayed in the data capture interface 120b.

[0199] like Figure 12b As shown, the data capture interface 110b may include a virtual model object 111c, and an object 111b is also displayed overlaid on the virtual model object 111c. It can be understood that when the interactive object needs to rotate the virtual model object 111c, the interactive object can perform a rotation operation on the virtual model object 111c. This rotation operation can be a gesture operation 121a performed by the interactive object on the virtual model object 111c.

[0200] In this way, the terminal device can respond to the gesture operation 121a performed by the interactive object on the virtual model object 111c, rotate the virtual model object 111c in the data capture interface 110b, and display the rotated virtual model object 111c at the virtual position indicated by the gesture operation 121a in the data capture interface 110b (i.e., the original position indicated by the gesture operation 121a), thus obtaining the data capture interface 121b. At this time, the object 111b below the virtual model object 111c is displayed in the data capture interface 121b.

[0201] like Figure 12c As shown, the data capture interface 110b may include a virtual model object 111c, and an object 111b is also displayed overlaid on the virtual model object 111c. It can be understood that when the interactive object needs to flip the virtual model object 111c, the interactive object can perform a flip operation on the virtual model object 111c. This flip operation can be a gesture operation 122a performed by the interactive object on the virtual model object 111c.

[0202] In this way, the terminal device can respond to the gesture operation 122a performed by the interactive object on the virtual model object 111c, and flip the virtual model object 111c in the data shooting interface 110b. The flipped virtual model object 111c is then displayed at the virtual position indicated by the gesture operation 122a in the data shooting interface 110b (i.e., the original position indicated by the gesture operation 122a), thus obtaining the data shooting interface 122b. At this time, the object 111b below the virtual model object 111c is displayed in the data shooting interface 122b.

[0203] It can be understood that when the interactive object needs to perform search processing on object 111b, the interactive object can perform a first trigger operation on object 111b to display a first virtual rendering area pointing to object 111b in the data capture interface 110a. Optionally, when the interactive object needs to perform search processing on object 111b, the interactive object can also perform a first trigger operation on object 111b. Figure 12a The virtual model object 111c in the data capture interface 120b shown Figure 12b The virtual model object 111c in the data capture interface 121b shown or Figure 12c The virtual model object 111c in the data capture interface 122b shown performs a first trigger operation to display a first virtual rendering area in the data capture interface 120b, data capture interface 121b or data capture interface 122b for pointing to object 111b (i.e. virtual model object 111c).

[0204] It can be understood that if the virtual model object 111c in the data shooting interface 120b, data shooting interface 121b, or data shooting interface 122b meets the hyperlink display conditions (i.e., object 111b meets the hyperlink display conditions), then a hyperlink identifier associated with the virtual model object 111c (i.e., a hyperlink identifier associated with object 111b) will be displayed in the area where the virtual model object 111c is located in the data shooting interface 120b, data shooting interface 121b, or data shooting interface 122b.

[0205] Therefore, this embodiment of the application can display a virtual model object with the same shape as the target object in the data capture interface after responding to a modeling operation on the target object in the data capture interface. Furthermore, it can display the virtual model object at a virtual location in the data capture interface after responding to a change operation on the virtual model object. It is understood that this embodiment of the application can perform 3D modeling on the target object indicated by the modeling operation to obtain a virtual model object, thereby enabling interaction with the virtual model object. This allows for the accumulation of materials in the background 3D library. When the interactive object searches for relevant 3D models, the background can recommend the virtual model object obtained from the aforementioned 3D modeling (i.e., search results), thereby improving the interactive object's operation and understanding of the target object in AR mode.

[0206] Further, please see Figure 13 , Figure 13 This is a flowchart illustrating a data processing method provided in an embodiment of this application. The method can be executed by a computer device, which can be a server or a terminal device. The server can be one of the aforementioned... Figure 2 The corresponding server 20a in the implementation can be the aforementioned terminal device. Figure 2 The corresponding terminal device 20b in the implementation. The data processing method may include the following steps S401-S408:

[0207] Step S401: Display the shooting screen in the data shooting interface;

[0208] The captured footage is obtained by a camera component and includes the target object.

[0209] The specific process of the computer equipment displaying the captured image on the data capture interface can be found in the above description. Figure 3 The description of step S101 in the corresponding embodiments will not be repeated here.

[0210] Step S402: Respond to the first trigger operation on the data shooting interface, obtain the trigger trajectory corresponding to the first trigger operation, and determine the object in the shooting screen that has a selection relationship with the trigger trajectory as the target object;

[0211] Specifically, when a triggering object displayed on the data capture interface is captured by the shooting component, the computer device can respond to the triggering object's first triggering operation on the data capture interface and obtain the trigger trajectory corresponding to the first triggering operation; or, when responding to a first triggering operation on the screen containing the data capture interface, the computer device can obtain the trigger trajectory corresponding to the first triggering operation. Further, the computer device can overlay the trigger trajectory and the captured image, identifying objects in the captured image whose positions intersect with the trigger trajectory as overlaid objects. Further, the computer device can determine target objects from the overlaid objects that have a selection relationship with the trigger trajectory.

[0212] In this embodiment, the trigger object in the data capture interface can be any object in real life, such as a hand, foot, pen, pencil, etc. It should be understood that this application uses the hand as the trigger object for illustration, where the hand can be either the left or right hand of the interactive object. It is understood that when the trigger object is the hand of the interactive object, the trigger object can specifically be the finger of the interactive object. In this case, this application embodiment needs to utilize fingertip recognition technology (i.e., fingertip technology) in gesture recognition to fit the movement trajectory along the fingertip (i.e., the trigger trajectory) with a "?" (i.e., the auxiliary command trajectory), thereby achieving a similarity judgment between the auxiliary command trajectory and the trigger trajectory.

[0213] When there is only one superimposed object, the computer device can directly identify the superimposed object as the target object with a selection relationship to the trigger trajectory. Optionally, when there are at least two superimposed objects, the specific process by which the computer device identifies the target object with a selection relationship to the trigger trajectory from at least two superimposed objects can be found below. Figure 16 The description of step S4023 in the corresponding embodiment.

[0214] It should be understood that computer equipment can perform image preprocessing on the captured image data to obtain preprocessed image data. Furthermore, the computer equipment can perform object edge detection on the preprocessed image data to obtain a set of object edge nodes in the preprocessed image data. This set of object edge nodes includes the edge nodes in the preprocessed image data. Further, the computer equipment can identify the location of the target object in the captured image within the data capture interface based on the edge nodes in the edge node set.

[0215] In this context, it can be understood that the specific process of image preprocessing of the captured image data obtained by the computer device can be described as follows: the captured image data is denoised by median filtering (for example, by using the medianblur function), thereby improving the contrast of the captured image data to clearly display the edge details in the captured image data.

[0216] In this context, it can be understood that computer devices can use edge detection algorithms (such as the Canny algorithm) to determine the gradient and direction near each pixel in the preprocessed image data, thereby determining whether the pixel belongs to an edge node on the object's edge. The identified edge nodes are then set as an edge node set, and the initial object formed by the edge nodes in the edge node set is calculated, along with the object's position and area in the data capture interface. Here, the initial object can include the target object in the captured image.

[0217] It should be understood that if multiple initial objects are identified in the preprocessed image data using the aforementioned edge detection algorithm, the computer device can determine the ratio of the object area of ​​each initial object to the data capture interface, and filter out initial objects whose ratio is greater than a ratio threshold from among the multiple initial objects. Therefore, embodiments of this application can filter out initial objects with object areas greater than an area threshold from among the multiple initial objects obtained by the edge detection algorithm, thereby removing initial objects with smaller areas from the preprocessed image data. Here, the initial objects with smaller areas can be distant objects in the preprocessed image data, or they can be tiny objects in the preprocessed image data.

[0218] Optionally, the first triggering operation includes a voice triggering operation. In this way, the computer device can respond to a voice triggering operation on the data capture interface, acquire the audio data corresponding to the voice triggering operation, and identify the object in the captured image that matches the voice text data indicated by the audio data as the target object.

[0219] In this context, it's understandable that computer devices can perform speech recognition on audio data to obtain the speech-text data indicated by the audio data. For example, the speech-text data could be "laptop," so the computer device can identify the object in the captured image that matches "laptop" as the target object, that is, identify "laptop" in the data capture interface as the target object.

[0220] For ease of understanding, the specific process of a computer device responding to the first triggering operation of a triggering object on the data capture interface can be found in [reference needed]. Figure 14a For details on how a computer device responds to a first trigger operation on a screen containing a data capture interface, please refer to [link to relevant documentation]. Figure 14b For details on how computer equipment responds to voice-triggered operations on the data capture interface, please refer to [link / reference needed]. Figure 14c , Figure 14a , Figure 14b and Figure 14c This is a schematic diagram of a scenario for determining a target object provided in an embodiment of this application.

[0221] like Figure 14a As shown, when the terminal device is a wearable device, the terminal device can be AR glasses 141c, and the interaction object 141a can be a user using AR glasses 141c. The interface observed by the interaction object 141a in AR glasses 141c can be a data capture interface 140a, and the data capture interface 140a can include object 140b.

[0222] Therefore, when interactive object 141a needs to search for object 140b, interactive object 141a can raise its arm, displaying its hand 141b in the data capture interface, and then perform a first trigger operation on object 140b in the data capture interface 140a through the hand 141b of interactive object 141a. In this way, AR glasses 141c can capture the hand 141b displayed in the data capture interface 140a through the shooting component, and then respond to the first trigger operation performed by the hand 141b of interactive object 141a on the data capture interface 140a, and determine the target object (i.e., object 140b) indicated by the first trigger operation in the data capture interface 140a.

[0223] like Figure 14bAs shown, when the terminal device is a mobile device, the terminal device can be a smartphone 143c, and the interaction object 143a can be a user using the smartphone 143c. The interface observed by the interaction object 143a in the smartphone 143c can be a data capture interface 142a, and the data capture interface 142a can include object 142b.

[0224] Therefore, when interactive object 143a needs to perform search processing on object 142b, interactive object 143a can perform a first trigger operation on object 142b in the screen containing data capture interface 142a (i.e., the screen on smartphone 143c) using its hand 143b. In this way, smartphone 143c can respond to the first trigger operation performed by interactive object 143a's hand 143b on data capture interface 142a, and determine the target object (i.e., object 142b) indicated by the first trigger operation in data capture interface 142a.

[0225] like Figure 14c As shown, terminal device 145b can be a device with voice data processing capabilities, and interactive object 145a can be a user using terminal device 145b. The interface observed by interactive object 145a in terminal device 145b can be data capture interface 144a, and data capture interface 144a can include object 144b.

[0226] Therefore, when interactive object 145a needs to perform search processing on object 144b, interactive object 145a can execute a voice trigger operation on object 144b in the data capture interface 144a. In this way, terminal device 145b can respond to the voice trigger operation executed by interactive object 145a on the data capture interface 144a, obtain the audio data corresponding to the voice trigger operation, perform speech recognition on the audio data, obtain the voice text data indicated by the audio data, and then determine the target object (i.e., object 144b) in the data capture interface 144a that has a matching relationship with the voice text data, that is, determine the object 144b in the data capture interface 144a that has a matching relationship with the voice text data indicated by the audio data.

[0227] Step S403: Enhance the target object in the data capture interface to obtain the enhanced object;

[0228] It is understood that computer devices can enhance target objects using image enhancement algorithms (i.e., enhancement algorithms). Image enhancement algorithms can adjust the brightness, contrast, saturation, and hue of captured image data to increase clarity and reduce noise, thereby obtaining useful information from the captured image data. Specifically, image enhancement can achieve object enhancement, from which the enhanced object can be obtained from the enhanced captured image data. Image enhancement often involves a combination of multiple algorithms to accomplish the above functions; for example, image denoising is equivalent to a low-pass filter, while increasing clarity is equivalent to a high-pass filter. It should be understood that the embodiments of this application do not limit the specific algorithms included in the image enhancement algorithm, nor do they limit the execution flow of the specific algorithms included in the image enhancement algorithm.

[0229] Step S404: Extract image features from the enhanced object to obtain enhanced image features; extract text features from the enhanced object to obtain enhanced text features.

[0230] It is understandable that image feature extraction can extract features such as shape, texture and color of the target object; if the target object contains text information, then the text information is preprocessed (i.e. segmented, size normalized, stroke width normalized) through text feature extraction before character recognition is performed on the text information.

[0231] Step S405: Perform feature fusion on the enhanced image features and enhanced text features to obtain enhanced fused features, and determine the object classification of the target object based on the enhanced fused features;

[0232] The computer device can perform feature fusion on enhanced image features and enhanced text features in the form of feature splicing, feature addition, or feature weighted averaging. This application does not limit the specific method of feature fusion.

[0233] Optionally, if the target object does not contain text information, the computer device may determine the object classification of the target object directly based on the extracted enhanced image features, without needing to extract text features from the enhanced object.

[0234] Step S406: Input the object category into the search engine, and use the search engine to search and process the object category to obtain media data for display in the first virtual rendering area;

[0235] Specifically, the computer device can input object categories into a search engine, which then performs search processing on these categories to obtain a set of media data associated with them. The search engine can be a retrieval technology used by the application client for search processing. Furthermore, the computer device can obtain historical trigger information corresponding to interactive objects, perform feature analysis on this information, and obtain historical object characteristics of the interactive objects. Here, an interactive object refers to the object that initiates the shooting component to capture the image. Further, the computer device can sort the initial media data in the media data set based on these historical object characteristics, and then extract media data from the sorted initial media data for display in the first virtual rendering area.

[0236] Understandably, historical trigger information can represent creators followed by the interactive object, media data viewed, etc. The computer device can adjust the order of media data published by creators followed by the interactive object, media data viewed, etc., to the front. In this way, the computer device can obtain the initial media data after the adjustment (i.e., after sorting), and then select the first L media data from the initial media data after the adjustment. According to the priority of the L media data, in steps S407 and S408, the L media data with priority are displayed in the first virtual rendering area. Here, L can be a positive integer less than or equal to the number of media in the initial media data.

[0237] It is understood that in the specific implementation of this application, data related to distribution quantity, trigger quantity, historical trigger information, etc. are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0238] Step S407: Display a first virtual rendering area for pointing to the target object in the data capture interface;

[0239] The specific process by which the computer equipment displays the first virtual rendering area for pointing to the target object in the data capture interface can be found in the above description. Figure 3 The description of step S102 in the corresponding embodiments will not be repeated here.

[0240] Understandably, when the computer device displays the first virtual rendering area in the data capture interface, it needs to determine whether the first virtual rendering area is clearly displayed. The computer device needs to determine the font size (e.g., 12px) and background color corresponding to the first virtual rendering area. Specifically, the computer device needs to determine the depth of the background color of the data capture interface, ensuring that the contrast between the background color and the background color is above a background threshold (e.g., 1.7); otherwise, only the background color can be adjusted.

[0241] Step S408: Display media data in the first virtual rendering area.

[0242] The media data is associated with the object category of the target object. The media data displayed in the first virtual rendering area is the L pieces of media data obtained in step S406 above.

[0243] The specific process by which the computer device displays media data in the first virtual rendering area can be found in the above description. Figure 3 The description of step S103 in the corresponding embodiments will not be repeated here.

[0244] For ease of understanding, the specific process of data interaction between the terminal device and the server in the embodiments of this application can be found in [reference needed]. Figure 15 , Figure 15 This is a schematic diagram illustrating a data interaction process provided in an embodiment of this application. For example... Figure 15 As shown, the embodiments of this application can be jointly executed by a terminal device (i.e., terminal presentation) and a server (i.e., backend technology). The flowchart may include steps S51-S62, and the execution order of each step in steps S51-S62 is not limited here.

[0245] like Figure 15 As shown in the flowchart, at the beginning of this process, the terminal device can execute step S51, in which the camera (i.e., the capturing component) is turned on to activate the augmented reality mode, and then step S52 is executed, in which the camera captures a picture, i.e., the system recognizes the object. Further, the terminal device can send a command to the server based on the captured picture, so that the server executes step S56, in which the main object in the captured picture is identified in step S506.

[0246] like Figure 15As shown, the terminal device can execute step S53. In step S53, the interaction object responds to the gesture operation J1 performed by the interaction object on the object recognized by the system, and then sends the trigger trajectory corresponding to the gesture operation J1 to the server, so that the server executes step S57 based on the trigger trajectory. In step S57, the server can search and render some search result cards according to the recognition results of the main object, and display them according to the predefined priority and the background depth.

[0247] like Figure 15 As shown, the terminal device can receive the search result card returned by the server after executing step S57, and render and display the search result card in the data capture interface through step S58. Furthermore, after the terminal device identifies an object in step S52, it can execute step S54. In step S54, it responds to the gesture operation J2 performed by the interactive object on the data capture interface, and then performs a 3D model of the object in the captured image based on the gesture operation J2, thereby obtaining a data capture interface containing the 3D model.

[0248] like Figure 15 As shown, after step S58, the server can proceed to step S59 to determine whether the search results corresponding to the object have reached a certain level. The server then returns the judgment result from step S59 to the terminal device. If the search results corresponding to the object have reached a certain level, the object in the data capture interface meets the hyperlink display conditions, and the terminal device can execute step S60 to display a hyperlink icon at the bottom of the object. Optionally, if the search results corresponding to the object have not reached a certain level, the object in the data capture interface does not meet the hyperlink display conditions, and the terminal device does not need to execute step S60.

[0249] like Figure 15 As shown, after step S55, the server can perform step S59 to determine whether the search results corresponding to the object have reached a certain level, and return the judgment result corresponding to step S59 to the terminal device. If the object corresponding to the 3D model in the data shooting interface meets the hyperlink display conditions, the terminal device can execute step S60 to display the hyperlink icon at the bottom of the 3D model through step S60.

[0250] like Figure 15 As shown, the terminal device can execute step S61, in which it is determined whether the object exists in the safe area. If the object does not exist in the safe area (i.e., the object is in the edge area), the mode is omitted and step S62 is executed. In step S62, the mode of the front-end card display is changed and a hidden mark for the object is displayed in the data shooting interface.

[0251] Therefore, this embodiment of the application can combine a first trigger operation on the data capture interface with the captured image when the image is captured by the capturing component. This allows for the determination of the target object indicated by the first trigger operation in the captured image, further determining the object category of the target object, and performing a search process on the target object based on its object category. The resulting media data, obtained after the object category search, is displayed in a first virtual rendering area pointing to the target object, thereby enabling interaction with the captured image and enriching the interaction methods of the computer device. It is understood that for the first trigger operation targeting the target object in the captured image, the computer device can generate a first virtual rendering area pointing to the target object, thus enriching the display methods of the computer device. Furthermore, this embodiment of the application eliminates the need to actively input search keywords (i.e., object categories) into a search engine. Instead, it determines the target object in the captured image through the first trigger operation, enabling rapid and accurate search processing for the target object. This improves the search efficiency of the target object and enhances the search experience for interactive objects.

[0252] Further, please see Figure 16 , Figure 16 This is a flowchart illustrating a data processing method provided in an embodiment of this application. The data processing method may include the following steps S4021-S4023, and steps S4021-S4023 are... Figure 13 A specific embodiment of step S402 in the corresponding embodiment.

[0253] Step S4021: Respond to the first trigger operation on the data capture interface and obtain the trigger trajectory corresponding to the first trigger operation;

[0254] The specific process of the computer device responding to the first trigger operation on the data capture interface and acquiring the trigger trajectory corresponding to the first trigger operation can be found in the above. Figure 13 The description of step S402 in the corresponding embodiment will not be repeated here.

[0255] Step S4022: Overlay the trigger trajectory and the captured image, and determine the objects in the captured image whose positions intersect with the trigger trajectory as the overlay objects;

[0256] The captured image may include one or more initial objects (hereinafter referred to as objects). Each initial object corresponds to its own object position. The computer device can overlay the trigger trajectory onto the initial object in the captured image. If the trigger trajectory and the object position of the initial object have an intersection (i.e., an intersection relationship), the initial object that has an intersection with the trigger trajectory is determined as the overlay object.

[0257] Step S4023: Determine the target object from the superimposed objects that has a selected relationship with the trigger trajectory.

[0258] In this embodiment, when there is only one superimposed object, the computer device can directly identify the superimposed object as the target object that has a selection relationship with the trigger trajectory. Optionally, when there are at least two superimposed objects, the computer device can identify the target object that has a selection relationship with the trigger trajectory from at least two superimposed objects. It should be understood that this embodiment uses at least two superimposed objects as an example for explanation. The specific process by which the computer device identifies the target object that has a selection relationship with the trigger trajectory from two superimposed objects can be found in the following... Figure 17a , Figure 17b , Figure 17c , Figure 17d and Figure 17e The corresponding implementation examples.

[0259] It should be understood that if the number of overlay objects is at least two, the computer device can display an object selection area associated with the at least two overlay objects, and display candidate options corresponding to each overlay object in the object selection area. Furthermore, in response to a selection operation on a candidate option, the computer device can use the candidate option selected by the selection operation as the target option, and determine the overlay object corresponding to the target option as the target object that has a selection relationship with the trigger trajectory.

[0260] For easier understanding, please refer to [link / reference]. Figure 17a , Figure 17a This is a schematic diagram illustrating a scenario for displaying candidate options provided in an embodiment of this application. For example... Figure 17a As shown, the terminal device can display a data capture interface 170a, which can include objects 170c and 170d. The terminal device can respond to a first trigger operation for objects 170c and 170d, obtain the trigger trajectory 170e corresponding to the first trigger operation, and send the trigger trajectory 170e to the server 171d.

[0261] In this way, server 171d can determine at least two overlapping objects that intersect with trigger trajectory 170e. These at least two overlapping objects can be object 170c and object 170d, and then return the candidate options corresponding to object 170c and object 170d to the terminal device respectively. Figure 17aAs shown, the terminal device can display an object selection area 171a associated with objects 170c and 170d in the data capture interface 170a. Within the object selection area 171a, candidate options corresponding to objects 170c and 170d, along with associated prompts, are displayed, resulting in a data capture interface 170b. The candidate option for object 170c can be candidate option 171b, and the candidate option for object 170d can be candidate option 171c. Candidate options 171b and 171c can represent the object categories of objects 170c and 170d; for example, candidate option 171b could represent "telephone," and candidate option 171c could represent "mug." The prompt associated with the candidate options could be: "To help you perform a more accurate content search, please select your desired search result."

[0262] Furthermore, the terminal device can respond to selection operations on candidate options 171b and 171c, and use the candidate option corresponding to the selection operation as the target option. For example, when the interactive object needs to view the search results for "telephone," it can perform a selection operation on candidate option 171b. At this time, the server can determine object 170c as the target object with a selection relationship with trigger trajectory 170e. As another example, when the interactive object needs to view the search results for "mug," it can perform a selection operation on candidate option 171c. At this time, the server can determine object 170d as the target object with a selection relationship with trigger trajectory 170e.

[0263] Optionally, it should be understood that if the number of superimposed objects is at least two, the computer device can determine the degree of overlap between the trigger trajectory and each superimposed object, obtain the superimposed object with the maximum degree of overlap from the at least two superimposed objects, and determine the superimposed object with the maximum degree of overlap as the target object that has a selected relationship with the trigger trajectory.

[0264] For easier understanding, please refer to [link / reference]. Figure 17b , Figure 17b This is a schematic diagram illustrating a scenario for determining the degree of overlap, provided in an embodiment of this application. For example... Figure 17b As shown, the terminal device can display a data capture interface 172a, which can include objects 172c and 172d. The terminal device can respond to a first trigger operation for objects 172c and 172d, obtain the trigger trajectory 172e corresponding to the first trigger operation, and send the trigger trajectory 172e to the server 173b.

[0265] In this way, server 172b can identify at least two overlapping objects that intersect with trigger trajectory 172e. These at least two overlapping objects can be object 172c and object 172d, and then determine the degree of overlap between trigger trajectory 172e and object 172c and object 172d respectively. For example, the degree of overlap between trigger trajectory 172e and object 172c (the object category corresponding to object 172c can be "telephone") can be 46%, and the degree of overlap between trigger trajectory 172e and object 172d (the object category corresponding to object 172d can be "mug") can be 54%.

[0266] Furthermore, the server can obtain the superimposed object with the maximum overlap between object 172c and object 172d. Since 54% is greater than 46%, the superimposed object with the maximum overlap can be object 172d. At this time, the server can determine object 172d as the target object that has a selected relationship with the trigger trajectory 172e, and display the first virtual rendering area 173a for pointing to object 172d in the data capture interface 172a, thus obtaining the data capture interface 172b.

[0267] Optionally, it should be understood that if the number of superimposed objects is at least two, the computer device may identify at least two superimposed objects as target objects that have a selected relationship with the trigger trajectory.

[0268] For easier understanding, please refer to [link / reference]. Figure 17c , Figure 17c This is a scene diagram illustrating a virtual rendering area as provided in an embodiment of this application. Figure 17c As shown, the terminal device can display a data capture interface 174a, which can include objects 174c and 174d. The terminal device can respond to a first trigger operation for objects 174c and 174d, obtain the trigger trajectory 174e corresponding to the first trigger operation, and send the trigger trajectory 174e to the server 175c.

[0269] In this way, server 175c can identify at least two superimposed objects that have an intersection relationship with trigger trajectory 174e. These at least two superimposed objects can be object 174c and object 174d. Then, object 174c and object 174d are both identified as target objects that have a selection relationship with trigger trajectory 174e. At the same time, the first virtual rendering area 175b for pointing to object 174c and the first virtual rendering area 175a for pointing to object 174d are displayed in the data shooting interface 174a, thus obtaining the data shooting interface 174b.

[0270] The first virtual rendering area 175b may include a display card, and the display card includes four media data items; the first virtual rendering area 175a may also include a display card, and the display card includes four media data items. Optionally, the terminal device may also display the four media data items corresponding to the first virtual rendering area 175b through the four display cards; the terminal device may also display the four media data items corresponding to the first virtual rendering area 175a through the four display cards.

[0271] Optionally, the terminal device can also use an artificial intelligence model to determine the target object that has a selected relationship with the trigger trajectory. This artificial intelligence model can be a heat analysis model or a matching analysis model. It should be understood that this application embodiment does not limit the model types of the heat analysis model and the matching analysis model.

[0272] Optionally, it should be understood that if the number of superimposed objects is at least two, the computer device can input at least two superimposed objects into the heat analysis model, and perform heat analysis on the at least two superimposed objects to obtain the heat probability corresponding to each superimposed object. Further, the computer device can determine the superimposed object with the highest heat probability among the at least two superimposed objects as the target object with a selected relationship to the trigger trajectory.

[0273] For easier understanding, please refer to [link / reference]. Figure 17d , Figure 17d This is a schematic diagram illustrating a scenario for determining the probability of heat level, provided in an embodiment of this application. For example... Figure 17d As shown, the terminal device can display a data capture interface 176a, which can include objects 176c and 176d. The terminal device can respond to a first trigger operation for objects 176c and 176d, obtain the trigger trajectory 176e corresponding to the first trigger operation, and send the trigger trajectory 176e to the server 177b.

[0274] In this way, server 177b can identify at least two overlapping objects that intersect with trigger trajectory 176e. These at least two overlapping objects can be object 176c and object 176d. Then, object 176c and object 176d are input into the popularity analysis model, which outputs the popularity probabilities corresponding to object 176c and object 176d. For example, the popularity probability of object 176c (whose corresponding object category could be "telephone") could be 13%, and the popularity probability of object 176d (whose corresponding object category could be "mug") could be 25%.

[0275] Furthermore, the server can obtain the superimposed object with the highest heat probability from objects 176c and 176d. Since 25% is greater than 13%, the superimposed object with the highest heat probability here can be object 176d. At this time, the server can determine object 176d as the target object that has a selected relationship with the trigger trajectory 176e, and display the first virtual rendering area 177a for pointing to object 176d in the data capture interface 176a, thus obtaining the data capture interface 176b.

[0276] Optionally, it should be understood that if the number of overlay objects is at least two, the computer device can input at least two overlay objects into the matching analysis model. The matching analysis model then performs attribute feature matching analysis on the at least two overlay objects and the interactive object to obtain the attribute matching degree between the interactive object and each overlay object. Here, the interactive object refers to the object that initiates the shooting component to acquire the captured image. Further, the computer device can determine the overlay object with the highest attribute matching degree among the at least two overlay objects as the target object that has a selected relationship with the trigger trajectory.

[0277] For easier understanding, please refer to [link / reference]. Figure 17e , Figure 17e This is a schematic diagram illustrating a scenario for determining attribute matching degree according to an embodiment of this application. For example... Figure 17e As shown, the terminal device can display a data capture interface 178a, which can include objects 178c and 178d. The terminal device can respond to a first trigger operation for objects 178c and 178d, obtain the trigger trajectory 178e corresponding to the first trigger operation, and send the trigger trajectory 178e to the server 179b.

[0278] In this way, server 179b can identify at least two overlapping objects that intersect with trigger trajectory 178e. These at least two overlapping objects can be object 178c and object 178d. Then, object 178c and object 178d are input into the matching analysis model, which outputs the attribute matching degree between the interactive object and object 178c and object 178d respectively. For example, the attribute matching degree between the interactive object and object 178c (the object category corresponding to object 178c can be "telephone") can be 33%, and the attribute matching degree between the interactive object and object 178d (the object category corresponding to object 178d can be "mug") can be 25%.

[0279] Furthermore, the server can obtain the superimposed object with the highest attribute matching degree from objects 178c and 178d. Since 33% is greater than 25%, the superimposed object with the highest attribute matching degree can be object 178c. At this time, the server can determine object 178c as the target object that has a selected relationship with the trigger trajectory 178e, and display the first virtual rendering area 179a for pointing to object 178c in the data capture interface 178a, thus obtaining the data capture interface 178b.

[0280] Therefore, the embodiments of this application can respond to a first trigger operation on the data capture interface, obtain the trigger trajectory corresponding to the first trigger operation, and then overlay the trigger trajectory and the captured image to determine the target object that has a selection relationship with the trigger trajectory from the captured image. Where the trigger trajectory and multiple objects in the captured image have an overlay relationship, the embodiments of this application can determine the target object from multiple objects using various methods, improving the diversity and accuracy of target object determination.

[0281] Further, please see Figure 18 , Figure 18 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application. The data processing device 1 may include: a screen display module 11, a region display module 12, and a data display module 13; further, the data processing device 1 may also include: an identifier display module 14, a content display module 15, a model display module 16, a model transformation module 17, a data hiding module 18, a data viewing module 19, a quantity statistics module 20, a condition determination module 21, a feature extraction module 22, a classification determination module 23, and a search processing module 24;

[0282] The screen display module 11 is used to display the captured image in the data capture interface; the captured image is obtained by capturing the image through the capture component; the captured image contains the target object;

[0283] The area display module 12 is used to respond to the first trigger operation for the target object in the data capture interface and display a first virtual rendering area for pointing to the target object in the data capture interface.

[0284] Among them, the area display module 12 is specifically used to respond to the first trigger operation for the target object in the data shooting interface and obtain the target position of the target object in the data shooting interface.

[0285] The area display module 12 is specifically used to display a first virtual rendering area pointing to the target object in the data capture interface according to the focus display method if the target position is at the focus position in the data capture interface.

[0286] The area display module 12 is specifically used to display a first virtual rendering area pointing to the target object in the data capture interface in a non-focus display mode if the target position is not in the focus position of the data capture interface.

[0287] Among them, the area display module 12 is specifically used to respond to the first trigger operation for the target object in the data capture interface and determine the number M of display cards used to point to the target object; the number of cards M is determined based on the number of media in the media data, and M is a positive integer;

[0288] The area display module 12 is specifically used to determine the M display cards as the first virtual rendering area for pointing to the target object, and to display the first virtual rendering area in the data capture interface.

[0289] The first triggering operation includes a voice triggering operation;

[0290] The area display module 12 is specifically used to respond to the voice trigger operation of the data shooting interface, obtain the audio data corresponding to the voice trigger operation, and identify the object in the shooting screen that has a matching relationship with the voice text data indicated by the audio data as the target object.

[0291] The area display module 12 is specifically used to display a first virtual rendering area for pointing to the target object in the data capture interface.

[0292] The area display module 12 includes: an object determination unit 121 and an area display unit 122;

[0293] The object determination unit 121 is used to respond to the first trigger operation on the data shooting interface, obtain the trigger trajectory corresponding to the first trigger operation, and determine the object in the shooting screen that has a selection relationship with the trigger trajectory as the target object.

[0294] The object determination unit 121 includes: a first trigger subunit 1211, a second trigger subunit 1212, an overlay processing subunit 1213, and an object determination subunit 1214; optionally, the object determination unit 121 may further include: an image processing subunit 1215 and a location recognition subunit 1216.

[0295] The first trigger subunit 1211 is used to, when the triggering object displayed on the data capturing interface is captured by the capturing component, respond to the first triggering operation of the triggering object on the data capturing interface, and obtain the trigger trajectory corresponding to the first triggering operation; or...

[0296] The second trigger subunit 1212 is used to acquire the trigger trajectory corresponding to the first trigger operation when responding to the first trigger operation on the screen containing the data capture interface.

[0297] The overlay processing subunit 1213 is used to overlay the trigger trajectory and the captured image, and to determine the objects in the captured image whose positions intersect with the trigger trajectory as the overlay objects;

[0298] The object determination subunit 1214 is used to determine the target object that has a selected relationship with the trigger trajectory from the superimposed objects.

[0299] Among them, the object determination subunit 1214 is specifically used to display the object selection area associated with the at least two superimposed objects if the number of superimposed objects is at least two, and to display the candidate options corresponding to each superimposed object in the object selection area;

[0300] The object determination subunit 1214 is specifically used to respond to the selection operation for the candidate option, take the candidate option selected by the selection operation as the target option, and determine the superimposed object corresponding to the target option as the target object that has a selection relationship with the trigger trajectory.

[0301] Among them, the object determination subunit 1214 is specifically used to determine the overlap between the trigger trajectory and each superimposed object if the number of superimposed objects is at least two, obtain the superimposed object with the maximum overlap from the at least two superimposed objects, and determine the superimposed object with the maximum overlap as the target object that has a selected relationship with the trigger trajectory.

[0302] Among them, the object determination subunit 1214 is specifically used to input at least two superimposed objects into the heat analysis model if the number of superimposed objects is at least two, and to perform heat analysis on at least two superimposed objects through the heat analysis model to obtain the heat probability corresponding to each superimposed object.

[0303] The object determination subunit 1214 is specifically used to determine the superimposed object with the highest heat probability among at least two superimposed objects as the target object that has a selected relationship with the trigger trajectory.

[0304] Among them, the object determination subunit 1214 is specifically used to input at least two superimposed objects into the matching analysis model if the number of superimposed objects is at least two. The matching analysis model performs attribute feature matching analysis on at least two superimposed objects and interactive objects to obtain the attribute matching degree between the interactive object and each superimposed object. The interactive object refers to the object that starts the shooting component to obtain the shooting screen.

[0305] The object determination subunit 1214 is specifically used to determine the superimposed object with the highest attribute matching degree among at least two superimposed objects as the target object that has a selected relationship with the trigger trajectory.

[0306] Optionally, the image processing subunit 1215 is used to perform image preprocessing on the captured image data in the captured scene to obtain preprocessed image data;

[0307] The image processing subunit 1215 is used to perform object edge detection on the preprocessed image data to obtain a set of object edge nodes in the preprocessed image data; the set of object edge nodes includes edge nodes in the preprocessed image data.

[0308] The position recognition subunit 1216 is used to identify the position of the target object in the data capture interface based on the edge nodes in the edge node set.

[0309] The specific implementation methods of the first trigger subunit 1211, the second trigger subunit 1212, the superposition processing subunit 1213, and the object determination subunit 1214 can be found in the above description. Figure 13 In the corresponding embodiment, steps S402 and... Figure 16 The descriptions of steps S4021-S4023 in the corresponding embodiments will not be repeated here. The specific implementations of the image processing subunit 1215 and the location recognition subunit 1216 can be found above. Figure 13 The description of step S402 in the corresponding embodiment will not be repeated here.

[0310] The area display unit 122 is used to display a first virtual rendering area for pointing to the target object in the data capture interface.

[0311] The specific implementation methods of the object determination unit 121 and the area display unit 122 can be found in the above description. Figure 3 In the corresponding embodiment, step S102, Figure 13 In the corresponding embodiments, steps S402 and S407, and Figure 16 The descriptions of steps S4021-S4023 in the corresponding embodiments will not be repeated here.

[0312] The data display module 13 is used to display media data in the first virtual rendering area; the media data is associated with the object category of the target object.

[0313] Optionally, the identification display module 14 is used to display a hyperlink identifier associated with the target object in the area where the target object is located in the data capture interface if the target object in the data capture interface meets the hyperlink display conditions; the hyperlink identifier is associated with the target media data in the media data.

[0314] Content display module 15 is used to respond to a second trigger operation for the target object indicated by the hyperlink identifier and display a second virtual rendering area in the data capture interface for pointing to the target object;

[0315] The content display module 15 is used to display the media display content corresponding to the target media data in the second virtual rendering area.

[0316] Optionally, the model display module 16 is used to respond to modeling operations on the target object in the data capture interface and display a virtual model object with the same shape as the target object in the data capture interface.

[0317] The model display module 16 includes: a model generation unit 161 and a model display unit 162;

[0318] The model generation unit 161 is used to respond to the modeling operation of the target object in the data shooting interface, obtain the depth information indicated by the shooting screen, map the target object in the shooting screen to the three-dimensional space based on the depth information, and generate a virtual model object with the same shape as the target object in the three-dimensional space.

[0319] The model display unit 162 is used to display a virtual model object at the location of the target object in the data capture interface; the virtual model object is displayed over the target object.

[0320] The specific implementation methods of the model generation unit 161 and the model display unit 162 can be found in the above description. Figure 10 The description of step S301 in the corresponding embodiments will not be repeated here.

[0321] The model transformation module 17 is used to respond to the transformation operation of the virtual model object in the data capture interface and display the virtual model object at a virtual position in the data capture interface; the virtual position refers to the transformation position indicated by the transformation operation.

[0322] Optionally, the data hiding module 18 is used to obtain the target update position of the target object in the updated data shooting interface when the data shooting interface is updated based on the mobile shooting component.

[0323] The data hiding module 18 is used to hide the first virtual rendering area and media data if the target update position is located in the edge area of ​​the updated data capture interface, and to display a hidden mark for the target object in the updated data capture interface.

[0324] The data viewing module 19 is used to respond to viewing operations of hidden identifiers for target objects and to redisplay the first virtual rendering area containing media data in the updated data capture interface.

[0325] Optionally, the quantity statistics module 20 is used to count the number of distributions and triggers of target media data within the target time period, and to determine the ratio between the number of distributions and the number of triggers as the trigger probability of the target media data.

[0326] The condition determination module 21 is used to determine that the target object meets the hyperlink display condition if the number of triggers is greater than the number threshold and the trigger probability is greater than the probability threshold.

[0327] Optionally, feature extraction module 22 is used to enhance the target object in the data capture interface to obtain the enhanced object;

[0328] Feature extraction module 22 is used to extract image features from the enhanced object to obtain enhanced image features, and to extract text features from the enhanced object to obtain enhanced text features;

[0329] The classification determination module 23 is used to perform feature fusion on enhanced image features and enhanced text features to obtain enhanced fusion features, and to determine the object classification of the target object based on the enhanced fusion features;

[0330] The search processing module 24 is used to input object categories into the search engine, and to perform search processing on the object categories through the search engine to obtain media data for display in the first virtual rendering area.

[0331] The search processing module 24 includes: a search processing unit 241, a feature analysis unit 242, and a sorting processing unit 243.

[0332] Search processing unit 241 is used to input object categories into a search engine, perform search processing on the object categories through the search engine, and obtain a set of media data associated with the object categories.

[0333] Feature analysis unit 242 is used to obtain historical trigger information corresponding to the interactive object, perform feature analysis on the historical trigger information, and obtain the historical object features of the interactive object; the interactive object refers to the object that starts the shooting component to obtain the shooting screen;

[0334] The sorting processing unit 243 is used to sort the initial media data in the media data set based on the characteristics of historical objects, and to obtain media data for display in the first virtual rendering area from the sorted initial media data.

[0335] The specific implementation methods of the search processing unit 241, the feature analysis unit 242, and the sorting processing unit 243 can be found in the above description. Figure 13 The description of step S406 in the corresponding embodiment will not be repeated here.

[0336] The specific implementation methods of the screen display module 11, the area display module 12, and the data display module 13 can be found in the above description. Figure 3 In the corresponding embodiment, steps S101-S103, Figure 13 In the corresponding embodiments, steps S401-S402 and steps S407-S408, and Figure 16 The descriptions of steps S4021-S4023 in the corresponding embodiments will not be repeated here. The specific implementation methods of the identifier display module 14, content display module 15, quantity statistics module 20, and condition determination module 21 can be found above. Figure 7 The descriptions of steps S201-S205 in the corresponding embodiments will not be repeated here. The specific implementations of the model display module 16 and the model transformation module 17 can be found above. Figure 10 The descriptions of steps S301-S302 in the corresponding embodiments will not be repeated here. The specific implementations of the data hiding module 18 and the data viewing module 19 can be found above. Figure 3 The description of step S103 in the corresponding embodiments will not be repeated here. The specific implementation methods of the feature extraction module 22, the classification determination module 23, and the search processing module 24 can be found above. Figure 3 The descriptions of steps S403-S406 in the corresponding embodiments will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated.

[0337] Further, please see Figure 19 , Figure 19 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Figure 19 As shown, the computer device 1000 may include a processor 1001, a network interface 1004, and a memory 1005. Furthermore, the computer device 1000 may also include a user interface 1003 and at least one communication bus 1002. The communication bus 1002 is used to enable communication between these components. In some embodiments, the user interface 1003 may include a display screen and a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. Optionally, the network interface 1004 may include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be high-speed RAM or non-volatile memory, such as at least one disk storage device. Optionally, the memory 1005 may also be at least one storage device located remotely from the processor 1001. Figure 19As shown, the memory 1005, which is a computer-readable storage medium, may include an operating system, a network communication module, a user interface module, and a device control application.

[0338] In such Figure 19 In the computer device 1000 shown, the network interface 1004 provides network communication functionality; the user interface 1003 is mainly used to provide an input interface for the user; and the processor 1001 can be used to call the device control application stored in the memory 1005 to achieve:

[0339] The captured image is displayed in the data capture interface; the captured image is obtained through the capture component; the captured image contains the target object;

[0340] In response to the first trigger operation targeting the target object in the data capture interface, a first virtual rendering area is displayed in the data capture interface to point to the target object;

[0341] Media data is displayed in the first virtual rendering area; the media data is associated with the object category of the target object.

[0342] It should be understood that the computer device 1000 described in the embodiments of this application can execute the foregoing text. Figure 3 , Figure 7 , Figure 10 , Figure 13 and Figure 16 The description of the data processing method in the corresponding embodiments can also be performed as described above. Figure 18 The description of the data processing device 1 in the corresponding embodiments will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated here.

[0343] Furthermore, it should be noted that this application embodiment also provides a computer-readable storage medium, which stores a computer program executed by the aforementioned data processing device 1. The computer program includes program instructions, and when the processor executes the program instructions, it can execute the aforementioned... Figure 3 , Figure 7 , Figure 10 , Figure 13 and Figure 16 The description of the data processing method in the corresponding embodiments is already provided and will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated. For technical details not disclosed in the computer-readable storage medium embodiments related to this application, please refer to the description of the method embodiments of this application.

[0344] Furthermore, it should be noted that this application also provides a computer program product or computer program, which may include computer instructions, which may be stored in a computer-readable storage medium. The processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor may execute the computer instructions, causing the computer device to perform the aforementioned actions. Figure 3 , Figure 7 , Figure 10 , Figure 13 and Figure 16 The description of the data processing method in the corresponding embodiments is already provided and will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated. For technical details not disclosed in the computer program products or computer program embodiments related to this application, please refer to the description of the method embodiments of this application.

[0345] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0346] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.

Claims

1. A data processing method, characterized in that, include: Display the captured image in the data capture interface; The captured footage was obtained using a camera module; The captured footage includes the target object; In response to a first trigger operation targeting the target object in the data capture interface, a first virtual rendering area for pointing to the target object is displayed in the data capture interface; Media data is displayed in the first virtual rendering area; the media data is associated with the object category of the target object. When the data capture interface is updated based on the movement of the capture component, the target update position of the target object in the updated data capture interface is obtained; If the target update position is located in the edge area of ​​the updated data capture interface, the first virtual rendering area and the media data are hidden, and a hidden identifier for the target object is displayed in the updated data capture interface. In response to the viewing operation of the hidden identifier of the target object, the first virtual rendering area containing the media data is redisplayed in the updated data capture interface.

2. The method according to claim 1, characterized in that, The response is a first trigger operation on the target object in the data capture interface, and displays a first virtual rendering area in the data capture interface for pointing to the target object, including: In response to a first trigger operation on the target object in the data capture interface, the target position of the target object in the data capture interface is obtained; If the target location is at the focus position in the data capture interface, then a first virtual rendering area for pointing to the target object is displayed in the data capture interface according to the focus display method; If the target location is not in the focus position of the data capture interface, a first virtual rendering area for pointing to the target object is displayed in the data capture interface in a non-focus display mode; both the focus display mode and the non-focus display mode are used to indicate the number and shape of the display cards to be displayed, and the media data is used to be displayed in the display cards; the number and shape of the cards corresponding to the focus display mode and the non-focus display mode are different from each other.

3. The method according to claim 1, characterized in that, The response is a first trigger operation on the target object in the data capture interface, and displays a first virtual rendering area in the data capture interface for pointing to the target object, including: In response to a first trigger operation targeting the target object in the data capture interface, the number M of display cards for pointing to the target object is determined; the number M of cards is determined based on the number of media in the media data, and M is a positive integer; M display cards are designated as the first virtual rendering area for pointing to the target object, and the first virtual rendering area is displayed in the data capture interface.

4. The method according to claim 1, characterized in that, The method further includes: If the target object in the data capture interface meets the hyperlink display conditions, then a hyperlink identifier associated with the target object is displayed in the area where the target object is located in the data capture interface; the hyperlink identifier is associated with the target media data in the media data. In response to a second triggering operation on the target object indicated by the hyperlink identifier, a second virtual rendering area for pointing to the target object is displayed in the data capture interface; The media display content corresponding to the target media data is displayed in the second virtual rendering area.

5. The method according to claim 1, characterized in that, The method further includes: In response to a modeling operation on the target object in the data capture interface, a virtual model object with the same shape as the target object is displayed in the data capture interface; In response to a transformation operation on the virtual model object in the data capture interface, the virtual model object is displayed at a virtual location in the data capture interface; the virtual location refers to the transformation position indicated by the transformation operation.

6. The method according to claim 1, characterized in that, The first triggering operation includes a voice triggering operation; The response is a first trigger operation on the target object in the data capture interface, and displays a first virtual rendering area in the data capture interface for pointing to the target object, including: In response to a voice trigger operation on the data capture interface, the system acquires the audio data corresponding to the voice trigger operation and identifies the object in the capture screen that matches the voice text data indicated by the audio data as the target object. The data capture interface displays a first virtual rendering area for pointing to the target object.

7. The method according to claim 1, characterized in that, The response is a first trigger operation on the target object in the data capture interface, and displays a first virtual rendering area in the data capture interface for pointing to the target object, including: In response to a first trigger operation on the data capture interface, the trigger trajectory corresponding to the first trigger operation is obtained, and the object in the capture screen that has a selection relationship with the trigger trajectory is identified as the target object; The data capture interface displays a first virtual rendering area for pointing to the target object.

8. The method according to claim 7, characterized in that, The response to the first trigger operation of the data capture interface includes obtaining the trigger trajectory corresponding to the first trigger operation, including: When the shooting component captures a triggering object displayed on the data shooting interface, it responds to a first triggering operation by the triggering object on the data shooting interface and obtains the trigger trajectory corresponding to the first triggering operation; or... When responding to a first trigger operation on a screen containing the data capture interface, the trigger trajectory corresponding to the first trigger operation is obtained.

9. The method according to claim 7, characterized in that, The step of identifying the object in the captured image that has a selection relationship with the trigger trajectory as the target object includes: The trigger trajectory and the captured image are superimposed, and the objects in the captured image whose positions intersect with the trigger trajectory are identified as superimposed objects. Identify the target object from the superimposed objects that has a selected relationship with the trigger trajectory.

10. The method according to claim 9, characterized in that, Determining the target object from the superimposed objects that has a selected relationship with the trigger trajectory includes: If the number of overlay objects is at least two, then an object selection area associated with the at least two overlay objects is displayed, and candidate options corresponding to each overlay object are displayed in the object selection area; In response to the selection operation for the candidate option, the candidate option selected by the selection operation is taken as the target option, and the superimposed object corresponding to the target option is determined as the target object that has a selection relationship with the trigger trajectory.

11. The method according to claim 9, characterized in that, Determining the target object from the superimposed objects that has a selected relationship with the trigger trajectory includes: If the number of superimposed objects is at least two, then the overlap between the trigger trajectory and each superimposed object is determined, the superimposed object with the maximum overlap is obtained from the at least two superimposed objects, and the superimposed object with the maximum overlap is determined as the target object that has a selected relationship with the trigger trajectory.

12. The method according to claim 9, characterized in that, Determining the target object from the superimposed objects that has a selected relationship with the trigger trajectory includes: If the number of superimposed objects is at least two, then the at least two superimposed objects are input into the matching analysis model. The matching analysis model performs attribute feature matching analysis on the at least two superimposed objects and the interactive object to obtain the attribute matching degree between the interactive object and each superimposed object. The interactive object refers to the object that initiates the shooting component to acquire the shooting image. The superimposed object with the highest attribute matching degree among the at least two superimposed objects is determined as the target object that has a selected relationship with the trigger trajectory.

13. The method according to claim 9, characterized in that, The method further includes: The captured image data in the captured screen is preprocessed to obtain preprocessed image data; Perform object edge detection on the preprocessed image data to obtain a set of object edge nodes in the preprocessed image data; the set of object edge nodes includes the edge nodes in the preprocessed image data. Based on the edge nodes in the set of edge nodes, identify the position of the target object in the captured image within the data capture interface.

14. The method according to claim 4, characterized in that, The method further includes: The number of times the target media data is distributed and the number of times it is triggered are statistically analyzed within the target time period. The ratio between the number of times the data is distributed and the number of times it is triggered is determined as the trigger probability of the target media data. If the number of triggers is greater than the number threshold and the trigger probability is greater than the probability threshold, then the target object is determined to meet the hyperlink display condition.

15. The method according to claim 5, characterized in that, The response is in response to a modeling operation of the target object in the data capture interface, displaying a virtual model object with the same shape as the target object in the data capture interface, including: In response to the modeling operation of the target object in the data capture interface, the depth information indicated by the capture screen is obtained, and the target object in the capture screen is mapped to a three-dimensional space based on the depth information, and a virtual model object with the same shape as the target object is generated in the three-dimensional space. The virtual model object is displayed at the location of the target object in the data capture interface; the virtual model object is displayed over the target object.

16. The method according to claim 1, characterized in that, The method further includes: The target object in the data capture interface is augmented to obtain an augmented object; Image features are extracted from the enhanced object to obtain enhanced image features, and text features are extracted from the enhanced object to obtain enhanced text features; The enhanced image features and the enhanced text features are fused to obtain enhanced fused features. Based on the enhanced fused features, the object classification of the target object is determined. The object category is input into a search engine, and the search engine performs a search on the object category to obtain the media data to be displayed in the first virtual rendering area.

17. The method according to claim 16, characterized in that, The step of inputting the object classification into a search engine, and performing search processing on the object classification through the search engine to obtain media data for display in the first virtual rendering area includes: The object category is input into a search engine, and the search engine performs a search on the object category to obtain a set of media data associated with the object category. The historical trigger information corresponding to the interactive object is obtained, and feature analysis is performed on the historical trigger information to obtain the historical object features of the interactive object; the interactive object refers to the object that initiates the shooting component to acquire the shooting image; Based on the historical object characteristics, the initial media data in the media data set is sorted, and the media data to be displayed in the first virtual rendering area is obtained from the sorted initial media data.

18. A data processing apparatus, characterized in that, include: The screen display module is used to display the captured image in the data capture interface; The captured footage was obtained using a camera module; The captured footage includes the target object; A region display module is used to respond to a first trigger operation on the target object in the data capture interface and display a first virtual rendering region in the data capture interface for pointing to the target object. A data display module is used to display media data in the first virtual rendering area; the media data is associated with the object category of the target object; The data hiding module is used to obtain the target update position of the target object in the updated data shooting interface when the data shooting interface is updated based on the movement of the shooting component; The data hiding module is further configured to hide the first virtual rendering area and the media data if the target update position is located in the edge area of ​​the updated data capture interface, and display a hidden identifier for the target object in the updated data capture interface. The data hiding module is also configured to respond to a viewing operation of the hidden identifier for the target object and redisplay the first virtual rendering area containing the media data in the updated data capture interface.

19. A computer device, characterized in that, include: Processor and memory; The processor is connected to the memory, wherein the memory is used to store a computer program, and the processor is used to invoke the computer program to cause the computer device to perform the method according to any one of claims 1-17.

20. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program adapted to be loaded and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-17.

21. A computer program product, characterized in that, The computer program product includes computer instructions stored in a computer-readable storage medium and adapted to be read and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-17.

Images