Data display method and device

Abstract

The invention discloses a data display method and device. According to one specific embodiment, the method comprises the steps that according to an obtained operation instruction, three-dimensional display parameters of multiple display objects are determined, and the multiple display objects are in one-to-one correspondence with multiple types of data of a target object; superposing a plurality of display objects adopting the three-dimensional display parameters in a real scene image representing the current scene to obtain a superposed image; and displaying the superposed image. According to the method for displaying the article data in the augmented reality mode, the displayed data size is increased, and the information obtaining efficiency of the user and the operation convenience of the user are improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, specifically to the field of augmented reality and natural language understanding technology, and in particular to a data display method, device, computer-readable medium, electronic device, and computer program product. Background Art

[0002] Currently, shopping apps mainly use the following two methods to display product details: 1. Pop-up display: After the user clicks on a product, a pop-up overlay will pop up on the current page to display product details; 2. Secondary page display: After the user clicks on a product, the app will navigate to a new secondary page to display product details. When using the above display methods, users need to frequently open and close pop-ups or switch secondary pages to view different types of product data. Summary of the invention

[0003] The embodiments of the present application provide a data display method, device, computer-readable medium, and electronic device.

[0004] In a first aspect, an embodiment of the present application provides a data display method, comprising: determining three-dimensional display parameters of multiple display objects according to an acquired operation instruction, wherein the multiple display objects correspond one-to-one to multiple types of data of the target item; in a real scene image representing a current scene, superimposing multiple display objects using three-dimensional display parameters to obtain a superimposed image; and displaying the superimposed image.

[0005] In some examples, the three-dimensional display parameters include transparency parameters and three-dimensional transformation parameters, and the determining of the three-dimensional display parameters of the plurality of display objects according to the acquired operation instructions includes: determining a target display object from the plurality of display objects according to the operation instructions; in a process in which the plurality of display objects are three-dimensionally rotated along a preset central axis until the target display object rotates to a target area, determining the transparency parameters and three-dimensional transformation parameters of the plurality of display objects according to their respective positions, wherein the target area is the central area of ​​the display areas corresponding to the plurality of display objects in the real scene image, the transparency represented by the transparency parameter is positively correlated with the target distance, the inclination angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is the distance between the position of the display object and the center point of the target area.

[0006] In some examples, in the above-mentioned real scene image representing the current scene, multiple display objects using three-dimensional display parameters are superimposed to obtain a superimposed image, including: in the display area, multiple display objects using three-dimensional display parameters are superimposed, and in the navigation area corresponding to the display area, multiple type labels corresponding one-to-one to multiple types of data are superimposed to obtain the superimposed image.

[0007] In some examples, the above-mentioned determining the target display object from multiple display objects according to the operation instruction includes: determining the target type label from multiple type labels according to the operation instruction; and determining the display object corresponding to the target type label among the multiple display objects as the target display object.

[0008] In some examples, the method further includes: determining a rotation direction of multiple display objects according to the target display object and the current display object displayed in the target area; and determining the transparency parameters and three-dimensional transformation parameters of the multiple display objects according to the respective positions of the multiple display objects during the three-dimensional rotation of the multiple display objects along the preset central axis until the target display object rotates to the target area, including: determining the transparency parameters and three-dimensional transformation parameters of the multiple display objects according to the respective positions of the multiple display objects during the three-dimensional rotation of the multiple display objects along the preset central axis according to the rotation direction until the target display object rotates to the target area.

[0009] In some examples, the above-mentioned determining the three-dimensional display parameters of each of the multiple display objects based on the obtained operation instructions includes: in response to obtaining multiple forms of candidate operation instructions, determining the operation instruction from multiple candidate operation instructions based on the priorities of the multiple forms of candidate operation instructions; determining the three-dimensional display parameters of each of the multiple display objects based on the operation instructions.

[0010] In some examples, in response to obtaining multiple forms of candidate operation instructions, the operation instruction is determined from multiple candidate operation instructions according to the priorities of the multiple forms of candidate operation instructions, including: in response to obtaining multiple forms of candidate operation instructions, the priority is determined according to current environmental information; and the operation instruction is determined from multiple candidate operation instructions according to the priority.

[0011] In some examples, the above method also includes: in response to not receiving an operation instruction for exceeding a preset time, superimposing multiple display objects that automatically rotate in three dimensions along a preset central axis in a real scene image representing the current scene to display each of the multiple display objects in turn.

[0012] In some examples, before determining the three-dimensional display parameters of each of the plurality of display objects according to the acquired operation instructions, the method further includes: preloading a plurality of types of data of the target objects.

[0013] In a second aspect, an embodiment of the present application provides a data display device, comprising: a determination unit, configured to determine the three-dimensional display parameters of multiple display objects according to the acquired operation instructions, wherein the multiple display objects correspond one-to-one to multiple types of data of the target items; a superposition unit, configured to superimpose multiple display objects using three-dimensional display parameters in a real scene image representing the current scene to obtain a superimposed image; and a display unit, configured to display the superimposed image.

[0014] In some examples, the three-dimensional display parameters include transparency parameters and three-dimensional transformation parameters, and the determination unit is further configured to: determine a target display object from multiple display objects according to an operation instruction; determine the transparency parameters and three-dimensional transformation parameters of the multiple display objects according to their respective positions during the process of three-dimensional rotation of the multiple display objects along a preset central axis until the target display object rotates to a target area, wherein the target area is the central area of ​​the display areas corresponding to the multiple display objects in the real scene image, the transparency represented by the transparency parameter is positively correlated with the target distance, the inclination angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is the distance between the position of the display object and the center point of the target area.

[0015] In some examples, the above-mentioned overlay unit is further configured to: overlay multiple display objects using three-dimensional display parameters in the display area, and overlay multiple type labels corresponding one-to-one to multiple types of data in the navigation area corresponding to the display area to obtain a superimposed image.

[0016] In some examples, the determination unit is further configured to: determine a target type tag from a plurality of type tags according to the operation instruction; and determine a display object corresponding to the target type tag from a plurality of display objects as the target display object.

[0017] In some examples, the device further includes: a direction determination unit configured to determine a rotation direction of the plurality of display objects based on the target display object and the current display object displayed in the target area; and the determination unit further configured to: determine transparency parameters and three-dimensional transformation parameters of the plurality of display objects according to their respective positions during a process in which the plurality of display objects are three-dimensionally rotated along a preset central axis according to the rotation direction until the target display object rotates to the target area.

[0018] In some examples, the determination unit is further configured to: in response to obtaining multiple forms of candidate operation instructions, determine an operation instruction from multiple candidate operation instructions according to the priorities of the multiple forms of candidate operation instructions; and determine the three-dimensional display parameters of each of the multiple display objects according to the operation instruction.

[0019] In some examples, the determination unit is further configured to: in response to obtaining multiple forms of candidate operation instructions, determine a priority based on current environmental information; and determine an operation instruction from multiple candidate operation instructions based on the priority.

[0020] In some examples, the above-mentioned device also includes: an automatic display unit, which is configured to superimpose multiple display objects that automatically rotate in three dimensions along a preset central axis in a real scene image representing the current scene in response to not receiving an operation instruction for exceeding a preset time period, so as to display each of the multiple display objects in turn.

[0021] In some examples, the apparatus further includes: a preloading unit configured to preload multiple types of data of the target object before determining the three-dimensional display parameters of each of the plurality of display objects according to the acquired operation instructions.

[0022] In a third aspect, an embodiment of the present application provides a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any implementation manner of the first aspect is implemented.

[0023] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors; a storage device on which one or more programs are stored, and when the one or more programs are executed by one or more processors, the one or more processors implement the method described in any implementation manner of the first aspect.

[0024] In a fifth aspect, a computer program product is provided, comprising: a computer program, which implements the method described in any implementation manner of the first aspect when executed by a processor.

[0025] The data display method and device provided in the embodiments of the present application determine the three-dimensional display parameters of multiple display objects according to the acquired operation instructions, wherein the multiple display objects correspond one-to-one to multiple types of data of the target object; in the real scene image representing the current scene, multiple display objects using the three-dimensional display parameters are superimposed to obtain a superimposed image; and the superimposed image is displayed, thereby providing a method for displaying object data in an augmented reality manner, increasing the amount of data displayed, and improving the user's information acquisition efficiency and the user's operation convenience. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0027] Figure 1 is an exemplary system architecture diagram in which an embodiment of the present application may be applied;

[0028] Figure 2 is a flow chart of an embodiment of a data display method according to the present application;

[0029] Figure 3 is a schematic diagram of an application scenario of the data display method according to this embodiment;

[0030] Figure 4 is a schematic diagram of a superimposed image according to the present application;

[0031] Figure 5 is a flow chart of another embodiment of the data display method according to the present application;

[0032] Figure 6 A structural diagram of an embodiment of a data display device according to the present application;

[0033] Figure 7 A schematic diagram of the structure of a computer system suitable for implementing an embodiment of the present application. DETAILED DESCRIPTION

[0034] The present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It is also necessary to explain that, for ease of description, only the parts related to the relevant invention are shown in the accompanying drawings.

[0035] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0036] It should be noted that the collection, collection, updating, analysis, processing, use, transmission, storage and other aspects of user personal information involved in the technical solution of this disclosure are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information, network security and national security.

[0037] Figure 1 An exemplary architecture 100 to which the data presentation method and apparatus of the present application can be applied is shown.

[0038] like Figure 1As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The communication connection between the terminal devices 101, 102, 103 constitutes a topological network, and the network 104 is used to provide a medium for the communication link between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0039] The terminal devices 101, 102, 103 can interact with the server 105 through the network 104 to receive or send data, etc. The terminal devices 101, 102, 103 can be hardware devices or software that support network connection for data interaction and data processing. When the terminal devices 101, 102, 103 are hardware, they can be various electronic devices that support network connection, information acquisition, interaction, display, processing and other functions, including but not limited to AR (Augmented Reality) devices (such as head-mounted AR devices), smart phones, car computers, tablet computers, e-book readers, laptop portable computers and desktop computers, etc. When the terminal devices 101, 102, 103 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules for providing distributed services, for example, or it can be implemented as a single software or software module. No specific limitation is made here.

[0040] The server 105 may be a server that provides various services, for example, a background processing server that provides various types of data of items to the terminal devices 101, 102, and 103 in response to the operation instructions provided by the terminal devices 101, 102, and 103, and displays various types of data of items to the terminal devices based on augmented reality technology. As an example, the server 105 may be a cloud server.

[0041] It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, software or software modules used to provide distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0042] It should also be noted that the data display method provided in the embodiments of the present application can be executed by a server, or by a terminal device, or by a server and a terminal device in cooperation with each other. Accordingly, the various parts (such as various units) included in the data display device can be all set in the server, or all set in the terminal device, or can be set in the server and the terminal device respectively.

[0043] It should be understood that Figure 1The number of terminal devices, networks, and servers in the system architecture is only illustrative. Depending on the implementation requirements, there may be any number of terminal devices, networks, and servers. When the electronic device on which the data display method is running does not need to transmit data with other electronic devices, the system architecture may only include the electronic device (e.g., server or terminal device) on which the data display method is running.

[0044] Continue to refer Figure 2 , shows a process 200 of an embodiment of a data display method, comprising the following steps:

[0045] Step 201: Determine the three-dimensional display parameters of each of the plurality of display objects according to the acquired operation instruction.

[0046] In this embodiment, the execution subject of the data display method (for example Figure 1 The terminal device or server in the display device can determine the three-dimensional display parameters of each of the multiple display objects according to the acquired operation instruction. The multiple display objects are used to display multiple types of data of the target object, and the multiple display objects correspond to the multiple types of data of the target object one by one.

[0047] The target item can be a variety of items. Taking the e-commerce platform as an example, the target item can be various commodities such as home appliances, clothes, and food in the e-commerce platform. The various types of data of the target item are data generated by describing the target item from multiple dimensions, such as commodity parameter data, commodity service data, commodity detail data, delivery time data, user evaluation data, etc.

[0048] In this embodiment, after the execution subject is started, it automatically loads the augmented reality interface, and uses augmented reality technology to load and display various types of target data in real time according to user needs. Specifically, first, in the data preparation stage, various types of data of the target item are obtained from the server. Among them, various types of data can be obtained in advance on the front page. In order to improve the display efficiency of data and enhance the user's viewing experience, various types of data can be requested and processed concurrently through different server ports. Then, in the stage of generating display objects, the rendering engine of the AR device is used to render various types of data into elements in 3D (Three Dimensional) cards (display objects), and the rendering effects such as the position, size and display content of the cards are set. It mainly includes: ① Setting the basic parameters of 3D rendering, including viewing angle, projection mode, etc.; ② Rendering a 3D card object for each type of data, setting its initial position and size; ③ Filling each type of data into the corresponding 3D card object; ④ Presenting an automatic carousel effect, according to the position of the 3D card, rendering a 3D card with corresponding parameters.

[0049] For the augmented reality interface, the user can issue operation instructions to it to change the display data or display effects in the augmented reality interface.

[0050] The above-mentioned execution subject can collect the user's operation instructions through various sensors, such as a camera for capturing the user's hand movement instructions, a voice collector for capturing the user's voice instructions, and an eye tracker for capturing the user's eye movement instructions. Various forms of user operation instructions can be collected in an all-round manner through a variety of sensors. In terms of control content, operation instructions include instructions for moving, scaling, switching, etc. of display areas of multiple display objects in a real scene image, instructions for adjusting the number and position of display objects displayed in the real scene image, and instructions for adjusting the type data displayed in each display object.

[0051] After receiving the operation instruction, the execution subject can analyze and process the operation instruction, determine the specific operation content of the operation instruction, and determine the three-dimensional display parameters of multiple display objects according to the operation content. Among them, the three-dimensional display parameters are, for example, position and posture parameters, size and scale parameters, lighting and shadow parameters, etc.

[0052] In this embodiment, various display effects corresponding to various operation instructions can be preset. For example, when the operation instruction is an instruction to zoom in and out of the display area, the display area and the display object in the display area can be zoomed in and out in the real scene image based on the preset zoom speed; for another example, when the operation instruction is an instruction to adjust the display position of the display object, the display object selected by the user can be translated to the center position of the display area based on the preset movement speed.

[0053] An example of an AR device is the Apple Vision Pro device (Apple's first head-mounted "spatial computing" display device). The Apple Vision Pro device includes a panoramic perspective display, a depth sensor, and a dynamic loading module. The panoramic perspective display is used to superimpose multiple display objects in the real world, the depth sensor is used to capture the depth information of the user's environment, and the dynamic loading module is used to load and display relevant content in real time according to user needs.

[0054] Step 202 , superimposing a plurality of display objects using three-dimensional display parameters on a real scene image representing the current scene to obtain a superimposed image.

[0055] In this embodiment, the above-mentioned execution subject can superimpose multiple display objects using three-dimensional display parameters on the real scene image representing the current scene to obtain a superimposed image.

[0056] The above-mentioned execution subject can collect the real scene image representing the current scene in real time, and render multiple display objects in the display area in the real scene image, each display object displays a type of data of the target object, so as to achieve the effect of superimposing multiple display objects using three-dimensional display parameters in the real scene image to obtain a superimposed image.

[0057] The display area can also be called the scene depth card area, where each display object is rendered as a floating three-dimensional card. For example, multiple display objects are arranged in sequence in the display area, and the target display object that the user wants to view specifically is enlarged and displayed in the center to enhance the user's viewing experience.

[0058] Step 203: display the superimposed image.

[0059] In this embodiment, the above-mentioned execution entity can display the superimposed image.

[0060] It can be understood that each superimposed image is obtained by superimposing a plurality of display objects using three-dimensional display parameters on a real-time collected real scene image, and is displayed to the user in real time.

[0061] Continue to see Figure 3 , Figure 3 FIG. 3 is a schematic diagram 300 of an application scenario of the data display method according to this embodiment. Figure 3 In the application scenario, user 301 uses a head-mounted AR device (such as Apple Vision Pro) 302 to view the relevant data of the target product in the e-commerce platform. Server 303 first receives the user's operation instruction through the head-mounted AR device 302, and determines the three-dimensional display parameters of multiple display objects (three-dimensional cards corresponding to product parameter data, product service data, product detail data, delivery time data, and user evaluation data) according to the obtained operation instruction, wherein the multiple display objects correspond to multiple types of data of the target item one by one; then, in the real scene image representing the current scene, multiple display objects using three-dimensional display parameters are superimposed to obtain a superimposed image 304; finally, the superimposed image is fed back to the head-mounted AR device 302 to display the superimposed image to the user 301.

[0062] The method provided by the above-mentioned embodiment of the present application determines the three-dimensional display parameters of each of a plurality of display objects according to the acquired operation instructions, wherein the plurality of display objects correspond one-to-one to a plurality of types of data of the target object; in a real scene image representing the current scene, a plurality of display objects using the three-dimensional display parameters are superimposed to obtain a superimposed image; and the superimposed image is displayed, thereby providing a method for displaying object data using an augmented reality manner, increasing the amount of displayed data, and improving the user's information acquisition efficiency and the user's operation convenience.

[0063] Continue to refer Figure 4 , showing a schematic diagram of the superimposed image 400. In some implementations of this embodiment, the effect presented by the augmented reality technology is that multiple display objects rotate three-dimensionally along a preset central axis, and each display object changes its tilt angle during the rotation process, so that when the display object moves to the central area of ​​the display area 401, it is parallel to the augmented reality interface.

[0064] In this implementation, the three-dimensional display parameters include transparency parameters and three-dimensional transformation parameters. The execution subject may perform step 201 in the following manner:

[0065] First, according to the operation instruction, a target display object is determined from multiple display objects.

[0066] Taking the operation instruction as a hand movement instruction as an example, the execution subject can determine the rotation direction of multiple display objects according to the moving direction of the hand movement; determine the length to be rotated along the rotation direction according to the moving speed of the hand movement, and then determine the target display object according to the rotation length. Among them, the moving speed is positively correlated with the rotation length.

[0067] Taking the operation instruction as a voice instruction as an example, the above-mentioned execution subject recognizes the voice instruction to obtain a voice text, and determines a display object matching the voice text among multiple display objects as a target display object.

[0068] Second, during the process of the multiple display objects rotating three-dimensionally along the preset central axis until the target display object rotates to the target area, the transparency parameters and three-dimensional transformation parameters of the multiple display objects are determined according to the respective positions of the multiple display objects.

[0069] Among them, the target area is the central area of ​​the display area corresponding to multiple display objects in the real scene image, the transparency represented by the transparency parameter is positively correlated with the target distance, the inclination angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is the distance between the position of the display object and the center point of the target area.

[0070] The transparency parameter can be calculated by the following formula:

[0071]

[0072] Among them, alpha represents the transparency parameter, offset represents the offset of the display object relative to the center point; fadeMin represents the minimum offset at which the transparency begins to decrease; fadeMax represents the maximum offset at which the transparency begins to decrease; fadeRange represents the range of transparency change; fadeMinalpha represents the minimum transparency.

[0073] The three-dimensional transformation parameters can be calculated by the following formula:

[0074] Calculate a reasonable offset for the display object:

[0075] clampedOffset=max(-1.0,min(1.0,offset))

[0076] Calculate the translation and depth of the display object:

[0077] x=(clampedOffset×0.5×tilt+offset×spacing)×itemWidth

[0078] z=∣clampedOffset∣×-itemWidth×0.5

[0079] Apply a translation transform:

[0080] transform=CATransform3DTranslate(transform,x,0.0,z)

[0081] Apply a rotation transformation:

[0082] finalTransform

[0083] =CATransform3DRotate(transform,-clampedOffset

[0084] ×π / 2×tilt,0.0,1.0,0.0)

[0085] Among them, tilt represents the tilt angle of the display object; spacing represents the spacing between display objects; itemWidth represents the width of the display object.

[0086] In this implementation, when displaying various types of data of the target object based on augmented reality technology, a three-dimensional rotating, fade-in and fade-out display method is adopted, which enhances the interaction with the user and improves the user experience.

[0087] In some implementations of this embodiment, a navigation area is provided corresponding to a display area of ​​a plurality of objects to be displayed, and a plurality of type labels corresponding one-to-one to a plurality of types of data are provided in the navigation area.

[0088] In this implementation, the execution subject may perform step 202 as follows: in the display area, multiple display objects using three-dimensional display parameters are superimposed, and in the navigation area corresponding to the display area, multiple type labels corresponding one-to-one to multiple types of data are superimposed to obtain a superimposed image.

[0089] Continue to refer to the above Figure 4 , a navigation area 402 is provided below the display area 401. In this implementation, multiple display objects in the display area are associated with multiple type labels in the navigation area. When the target display object is displayed in the central area of ​​the display area, the target type label corresponding to the target display object in the navigation area is highlighted. For example, the target type label is highlighted.

[0090] In this implementation, a navigation area is provided corresponding to the display area, and a plurality of type labels are provided in the navigation area corresponding to the plurality of display objects in the display area, which helps to further improve the user's information acquisition efficiency and the convenience of operation.

[0091] In some implementations of this embodiment, the execution subject may perform the process of determining the target display object in the following manner:

[0092] First, according to the operation instruction, a target type label is determined from a plurality of type labels.

[0093] In this implementation, the navigation area may also receive user operation instructions, such as click instructions for target type labels in the navigation area, voice instructions for target type labels in the navigation area, and eye movement instructions for target type labels in the navigation area.

[0094] The execution subject may analyze and process the operation instruction and determine a target type tag from a plurality of type tags.

[0095] Then, a display object corresponding to the target type label among the multiple display objects is determined as a target display object.

[0096] According to the correspondence between the display objects and the type labels, the execution subject may determine the display object corresponding to the target type label among the multiple display objects as the target display object.

[0097] In this implementation, the navigation area matching the display area can also receive user operation instructions, further improving the convenience of user operation on item data.

[0098] In some implementations of this embodiment, the execution subject may further perform the following operation: determining the rotation directions of the multiple display objects according to the target display object and the current display object displayed in the target area.

[0099] The rotation direction generally includes two directions: left (left side of the augmented reality interface) and right (right side of the augmented reality interface). However, under certain operation instructions, the execution subject cannot directly determine the rotation direction according to the operation instruction. For example, the center area of ​​the display area is the display object A. When the voice command "display object B" for the type label is received, the display object B can be rotated to the center area by rotating to the left or right.

[0100] In this implementation, the execution subject can determine the required rotation distances of the target display object and the current display object displayed in the target area in two rotation modes: left rotation and right rotation, and determine the rotation direction with the smaller rotation distance as the rotation direction of multiple display objects.

[0101] In this implementation, the above-mentioned execution entity can determine the three-dimensional display parameters of multiple display objects in the following manner: when the multiple display objects are three-dimensionally rotated along a preset central axis according to the rotation direction until the target display object is rotated to the target area, the transparency parameters and three-dimensional transformation parameters of the multiple display objects are determined according to the respective positions of the multiple display objects.

[0102] The same as the process of determining the three-dimensional display parameters in the above embodiment, the transparency represented by the transparency parameter is positively correlated with the target distance, and the inclination angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is the distance between the position of the display object and the center point of the target area.

[0103] In this implementation, the rotation direction of multiple display objects is first determined, and they are rotated according to the rotation direction, so that the central area can display the display objects desired by the user as quickly as possible, which helps to further improve the user's information acquisition efficiency, and the rotation distance is reduced based on the determined rotation direction, which helps to reduce the rendering pressure of the above-mentioned execution subject during the rotation process.

[0104] In some implementations of this embodiment, the execution subject may perform step 201 in the following manner:

[0105] First, in response to acquiring candidate operation instructions in multiple forms, an operation instruction is determined from the multiple candidate operation instructions according to the priorities of the candidate operation instructions in multiple forms.

[0106] As an example, the execution subject or the electronic device connected to the execution subject in communication is provided with priorities corresponding to multiple instruction forms. In response to simultaneously acquiring multiple forms of candidate operation instructions, an operation instruction with the highest priority is determined from the multiple candidate operation instructions according to the priorities of the multiple forms of candidate operation instructions.

[0107] In some implementations, in response to simultaneously obtaining multiple forms of different operation instructions, the above-mentioned execution subject can determine whether there is a conflict between the different operation instructions; in response to determining that there is no conflict, determine the execution order between the multiple different operation instructions, and then execute the multiple operation instructions in sequence according to the execution order.

[0108] Then, according to the operation instruction, the three-dimensional display parameters of each of the plurality of display objects are determined.

[0109] In this implementation, the execution subject may refer to the above embodiment and determine the three-dimensional display parameters of each of the plurality of display objects according to the operation instruction, which will not be described in detail here.

[0110] In this implementation, an information processing method in a multi-operation instruction scenario is provided, which expands the scope of application of the data display method.

[0111] In some implementations of this embodiment, the execution subject may perform the determination process of the operation instruction in the following manner:

[0112] First, in response to obtaining multiple forms of candidate operation instructions, priorities are determined according to current environment information.

[0113] As an example, when a motion instruction and a voice instruction are received simultaneously, in response to determining that the current environment information is a noisy environment, it is determined that the motion instruction has a higher priority.

[0114] In some implementations, the execution subject may also determine the priority of multiple forms of candidate operation instructions according to the context of the operation instruction.

[0115] Then, according to the priority, an operation instruction is determined from a plurality of candidate operation instructions.

[0116] In this implementation, an operation instruction with the highest priority is determined from a plurality of candidate operation instructions.

[0117] In this implementation, a method for determining the priority of an operation instruction is provided, which improves the accuracy of the priority and the adaptability between the priority and the environmental information based on the current environmental information.

[0118] In some implementations of this embodiment, the above-mentioned execution entity may also perform the following operations: in response to not receiving an operation instruction for more than a preset time, superimposing multiple display objects that automatically rotate in three dimensions along a preset central axis in a real scene image representing the current scene, so as to display each of the multiple display objects in turn.

[0119] The preset duration may be set according to actual conditions, for example, 5 seconds.

[0120] The automatic carousel function is to automatically rotate the 3D cards when the user does not issue an operation instruction for a long time, providing the user with a continuous visual experience. The automatic carousel function mainly relies on:

[0121] Time Manager: used to control the time interval (preset duration) of the automatic carousel. When the system starts, the time manager initializes and sets the time interval of the automatic carousel (for example, every 5 seconds). The time manager keeps counting, and when the timer reaches the time interval, the carousel controller is triggered to proceed to the next step.

[0122] Carousel controller: used to perform carousel operation of 3D cards. The carousel controller receives the trigger signal of the time manager and performs the carousel operation of the cards. Through the 3D rendering module, the carousel controller realizes the smooth transition effect of the cards, including visual effects such as rotation and fade-in and fade-out. The carousel controller ensures the loop playback of the card list. When the last 3D card is displayed, the carousel starts again from the first 3D card.

[0123] Status monitor: used to monitor the user's interaction status. The status monitor continuously monitors the user's gestures and interactive operations. Automatic carousel start and stop control: When the user gesture operation is detected, the automatic carousel is paused; when the user stops operating for a preset period of time, the automatic carousel is restarted.

[0124] In this implementation, based on the automatic carousel function, a continuous visual experience is provided to the user, which helps to improve the user experience.

[0125] In some implementations of this embodiment, the execution subject may further perform the following operation before executing the step 201: pre-load multiple types of data of the target item.

[0126] Preloading refers to a strategy of loading resources or data that may be needed in the future in advance during data processing or page loading. For example, the server can actively push resources to the client to achieve preloading.

[0127] In this implementation, through preloading, various types of data of items can be loaded more quickly, reducing waiting time and further improving user experience.

[0128] Continue to refer Figure 5 , shows a schematic process 500 of another embodiment of the data display method according to the present application, comprising the following steps:

[0129] Step 501: Determine a target display object from multiple display objects according to the acquired operation instruction.

[0130] Among them, multiple display objects correspond one-to-one to multiple types of data of the target item.

[0131] Step 502 : during the process of the multiple display objects rotating three-dimensionally along the preset central axis until the target display object rotates to the target area, the transparency parameters and three-dimensional transformation parameters of the multiple display objects are determined according to the respective positions of the multiple display objects.

[0132] The target area is the central area of ​​the display area corresponding to multiple display objects in the real scene image. The transparency represented by the transparency parameter is positively correlated with the target distance. The tilt angle represented by the three-dimensional transformation parameter is positively correlated with the target distance. The target distance is the distance between the position of the display object and the center point of the target area.

[0133] Step 503 , in the display area, multiple display objects using three-dimensional display parameters are superimposed, and in the navigation area corresponding to the display area, multiple type labels corresponding to multiple types of data are superimposed to obtain a superimposed image.

[0134] Step 504: display the superimposed image.

[0135] It can be seen from this embodiment that Figure 2 Compared with the corresponding embodiments, the process 500 of the data display method in this embodiment specifically illustrates the process of obtaining the superimposed image, and uses augmented reality to increase the amount of data displayed, thereby improving the user's information acquisition efficiency and the user's operation convenience.

[0136] Continue to refer Figure 6 As an implementation of the methods shown in the above figures, the present application provides an embodiment of a data display device, which is similar to Figure 2 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0137] like Figure 6 As shown, a data display device includes: a determination unit 601, configured to determine the three-dimensional display parameters of multiple display objects according to the acquired operation instructions, wherein the multiple display objects correspond one-to-one to multiple types of data of the target item; an overlay unit 602, configured to overlay multiple display objects using three-dimensional display parameters in a real scene image representing a current scene to obtain a superimposed image; and a display unit 603, configured to display the superimposed image.

[0138] In some implementations of this embodiment, the three-dimensional display parameters include transparency parameters and three-dimensional transformation parameters, and the determination unit 601 is further configured to: determine a target display object from multiple display objects according to an operation instruction; in a process in which the multiple display objects are three-dimensionally rotated along a preset central axis until the target display object is rotated to a target area, determine the transparency parameters and three-dimensional transformation parameters of the multiple display objects according to their respective positions, wherein the target area is a central area of ​​the display areas corresponding to the multiple display objects in the real scene image, the transparency represented by the transparency parameter is positively correlated with the target distance, the inclination angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is the distance between the position of the display object and the center point of the target area.

[0139] In some implementations of this embodiment, the above-mentioned overlay unit 602 is further configured to: overlay multiple display objects using three-dimensional display parameters in the display area, and overlay multiple type labels corresponding one-to-one to multiple types of data in the navigation area corresponding to the display area to obtain a superimposed image.

[0140] In some implementations of this embodiment, the determination unit 601 is further configured to: determine a target type tag from multiple type tags according to an operation instruction; and determine a display object corresponding to the target type tag among multiple display objects as a target display object.

[0141] In some implementations of this embodiment, the above-mentioned device also includes: a direction determination unit (not shown in the figure), which is configured to determine the rotation direction of multiple display objects according to the target display object and the current display object displayed in the target area; and the above-mentioned determination unit 601 is further configured to: in the process of performing three-dimensional rotation of the multiple display objects along a preset central axis according to the rotation direction until the target display object rotates to the target area, determine the transparency parameters and three-dimensional transformation parameters of the multiple display objects according to their respective positions.

[0142] In some implementations of this embodiment, the above-mentioned determination unit 601 is further configured to: in response to obtaining multiple forms of candidate operation instructions, determine the operation instruction from multiple candidate operation instructions according to the priorities of the multiple forms of candidate operation instructions; and determine the three-dimensional display parameters of each of the multiple display objects according to the operation instruction.

[0143] In some implementations of this embodiment, the above-mentioned determination unit 601 is further configured to: in response to obtaining multiple forms of candidate operation instructions, determine the priority according to current environmental information; and determine the operation instruction from multiple candidate operation instructions according to the priority.

[0144] In some implementations of this embodiment, the above-mentioned device also includes: an automatic display unit (not shown in the figure), which is configured to superimpose multiple display objects that automatically rotate in three dimensions along a preset central axis in a real scene image representing the current scene in response to not receiving an operation instruction for more than a preset time, so as to display each of the multiple display objects in turn.

[0145] In some implementations of this embodiment, the above-mentioned device also includes: a preloading unit (not shown in the figure), which is configured to preload multiple types of data of the target object before determining the three-dimensional display parameters of each of the multiple display objects according to the acquired operation instructions.

[0146] In this embodiment, a determination unit in a data display device determines three-dimensional display parameters of each of a plurality of display objects according to an acquired operation instruction, wherein the plurality of display objects correspond one-to-one to a plurality of types of data of a target object; a superposition unit superimposes a plurality of display objects using three-dimensional display parameters in a real scene image representing a current scene to obtain a superimposed image; and a display unit displays the superimposed image, thereby providing a device for displaying object data in an augmented reality manner, increasing the amount of displayed data, and improving the user's information acquisition efficiency and the user's operation convenience.

[0147] Reference below Figure 7 , which shows a device suitable for implementing the embodiments of the present application (eg Figure 1 Schematic diagram of the structure of a computer system 700 of devices 101, 102, 103, 105) shown. Figure 7 The device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0148] like Figure 7 As shown, the computer system 700 includes a processor (e.g., CPU, central processing unit) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage part 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the system 700 are also stored. The processor 701, ROM 702, and RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0149] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, etc.; an output section 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage section 708 as needed.

[0150] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 709, and / or installed from a removable medium 711. When the computer program is executed by the processor 701, the above-mentioned functions defined in the method of the present application are executed.

[0151] It should be noted that the computer-readable medium of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0152] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the client computer, partially on the client computer, as a separate software package, partially on the client computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the client computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0153] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the device, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0154] The units involved in the embodiments described in the present application may be implemented by software or by hardware. The described units may also be set in a processor, for example, may be described as: a processor comprising a determination unit, an overlay unit and a display unit. Among them, the names of these units do not constitute a limitation on the unit itself under certain circumstances. For example, the overlay unit may also be described as "a unit that overlays multiple display objects using three-dimensional display parameters in a real scene image representing the current scene to obtain a superimposed image."

[0155] As another aspect, the present application also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by the device, the computer device: determines the three-dimensional display parameters of each of the multiple display objects according to the acquired operation instructions, wherein the multiple display objects correspond one-to-one to the multiple types of data of the target object; in the real scene image representing the current scene, superimposes the multiple display objects using the three-dimensional display parameters to obtain the superimposed image; and displays the superimposed image.

[0156] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.

Claims

1. A data display method, comprising: Determine, according to the acquired operation instruction, the three-dimensional display parameters of each of the plurality of display objects, wherein the plurality of display objects correspond one to one to the plurality of types of data of the target item; In a real scene image representing a current scene, a plurality of display objects using the three-dimensional display parameters are superimposed to obtain a superimposed image; The superimposed image is displayed.

2. The method according to claim 1, wherein: The three-dimensional display parameters include transparency parameters and three-dimensional transformation parameters, and The determining of the three-dimensional display parameters of the plurality of display objects according to the acquired operation instructions includes: According to the operation instruction, determining a target display object from the multiple display objects; In the process of the multiple display objects performing three-dimensional rotation along the preset central axis until the target display object rotates to the target area, the transparency parameters and three-dimensional transformation parameters of the multiple display objects are determined according to the respective positions of the multiple display objects, wherein the target area is the central area of ​​the display area corresponding to the multiple display objects in the real scene image, the transparency represented by the transparency parameter is positively correlated with the target distance, the inclination angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is the distance between the position of the display object and the center point of the target area.

3. The method according to claim 2, wherein: The method of superimposing a plurality of display objects using the three-dimensional display parameters on a real scene image representing the current scene to obtain a superimposed image includes: In the display area, multiple display objects using the three-dimensional display parameters are superimposed, and in the navigation area corresponding to the display area, multiple type labels corresponding to the multiple types of data are superimposed to obtain the superimposed image.

4. The method according to claim 3, wherein: The step of determining a target display object from the plurality of display objects according to the operation instruction includes: According to the operation instruction, determining a target type tag from the multiple type tags; A display object corresponding to the target type label among the multiple display objects is determined as the target display object.

5. The method according to claim 4, wherein: Also includes: Determining a rotation direction of the plurality of display objects according to the target display object and a current display object displayed in the target area; as well as The method of determining the transparency parameters and the three-dimensional transformation parameters of the plurality of display objects according to the respective positions of the plurality of display objects during the three-dimensional rotation of the plurality of display objects along the preset central axis until the target display object rotates to the target area includes: In the process that the multiple display objects are three-dimensionally rotated along the preset central axis according to the rotation direction until the target display object is rotated to the target area, the transparency parameters and three-dimensional transformation parameters of the multiple display objects are determined according to the respective positions of the multiple display objects.

6. The method according to any one of claims 1 to 5, wherein: The determining of the three-dimensional display parameters of the plurality of display objects according to the acquired operation instructions includes: In response to acquiring multiple forms of candidate operation instructions, determining the operation instruction from the multiple candidate operation instructions according to the priorities of the multiple forms of candidate operation instructions; According to the operation instruction, three-dimensional display parameters of each of the plurality of display objects are determined.

7. The method according to claim 6, wherein: In response to acquiring multiple forms of candidate operation instructions, determining the operation instruction from the multiple candidate operation instructions according to the priorities of the multiple forms of candidate operation instructions includes: In response to acquiring the candidate operation instructions in the multiple forms, determining the priority according to the current environment information; According to the priority, the operation instruction is determined from a plurality of the candidate operation instructions.

8. The method according to any one of claims 1 to 5, wherein: Also includes: In response to not receiving an operation instruction for more than a preset time, the multiple display objects that automatically rotate in three dimensions along a preset central axis are superimposed on the real scene image representing the current scene to display each of the multiple display objects in turn.

9. The method according to any one of claims 1 to 5, wherein: Before determining the three-dimensional display parameters of the plurality of display objects according to the acquired operation instructions, the method further includes: Preload various types of data of the target item.

10. A data display device, comprising: a determination unit configured to determine three-dimensional display parameters of each of a plurality of display objects according to the acquired operation instruction, wherein the plurality of display objects correspond one-to-one to a plurality of types of data of a target item; A superimposition unit is configured to superimpose a plurality of display objects using the three-dimensional display parameters on a real scene image representing a current scene to obtain a superimposed image; The display unit is configured to display the superimposed image.

11. A computer readable medium having a computer program stored thereon, wherein: When the program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

12. An electronic device comprising: one or more processors; a storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 9.

13. A computer program product comprising: A computer program which, when executed by a processor, implements the method according to any one of claims 1 to 9.

Images