Data display method and apparatus

Abstract

Disclosed in the present application are a data display method and apparatus. A specific embodiment of the method comprises: on the basis of an acquired operation instruction, determining respective three-dimensional display parameters of a plurality of display objects, wherein the plurality of display objects correspond to a plurality of types of data of a target item on a one-to-one basis; in a real-scene image representing the current scene, superimposing the plurality of display objects using the three-dimensional display parameters, so as to obtain a superimposed image; and displaying the superimposed image. Provided in the present application is a method for displaying item data in an augmented-reality manner, such that the amount of displayed data is increased, thereby improving the information acquisition efficiency of users and the operation convenience of the users.

Description

Data display method and device

[0001] Cross-reference to related applications

[0002] This application claims priority to Chinese Patent Application No. 202411388392.3, filed September 30, 2024, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD

[0003] Embodiments of the present application relate to the technical field of computers, specifically to the technical fields of augmented reality and natural language understanding, and more particularly to a data display method and device, a computer readable medium, an electronic device, and a computer program product. BACKGROUND

[0004] Currently, shopping applications mainly use the following two ways to display product detail data: 1. Pop-up display: when a user clicks on a product, a pop-up layer covering the current page is displayed to show product detail data; 2. Secondary page display: when a user clicks on a product, the application navigates to a new secondary page to display product detail data. When using the above display methods, users need to frequently open and close pop-up layers or switch between secondary pages to view different types of data for a product. SUMMARY

[0005] Embodiments of the present application provide a data display method, device, computer readable medium, and electronic device.

[0006] In a first aspect, embodiments of the present application provide a data display method, comprising: determining three-dimensional display parameters of a plurality of display objects according to an obtained operation instruction, wherein the plurality of display objects correspond one-to-one to a plurality of types of data of a target item; superimposing the plurality of display objects using the three-dimensional display parameters in a real scene image representing a current scene to obtain a superimposed image; and displaying the superimposed image.

[0007] In some examples, the three-dimensional display parameters include a transparency parameter and a three-dimensional transformation parameter, and determining the three-dimensional display parameters of the plurality of display objects according to the obtained operation instruction includes: determining a target display object from the plurality of display objects according to the operation instruction; and determining the transparency parameter and the three-dimensional transformation parameter of each of the plurality of display objects according to the position of each of the plurality of display objects during a process of three-dimensional rotation of the plurality of display objects along a preset central axis until the target display object is rotated to a target region, wherein the target region is a central region of a display region of the plurality of display objects in the real scene image, the transparency represented by the transparency parameter is positively correlated with a target distance, the inclination angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is a distance between the position of the display object and a center point of the target region.

[0008] In some examples, the superimposing the plurality of display objects with the three-dimensional display parameters in the real scene image representing the current scene to obtain the superimposed image comprises: superimposing the plurality of display objects with the three-dimensional display parameters in the display area, and superimposing the plurality of type labels corresponding to the plurality of types of data in the navigation area corresponding to the display area to obtain the superimposed image.

[0009] In some examples, the determining the target display object from the plurality of display objects according to the operation instruction comprises: determining the target type label from the plurality of type labels according to the operation instruction; and determining the display object corresponding to the target type label from the plurality of display objects as the target display object.

[0010] In some examples, the method further comprises: determining the rotation direction of the plurality of display objects according to the target display object and the current display object displayed in the target area; and in the process of rotating the plurality of display objects along the preset central axis in three dimensions until the target display object is rotated to the target area, determining the transparency parameter and the three-dimensional transformation parameter of each of the plurality of display objects according to the position of each of the plurality of display objects, comprising: in the process of rotating the plurality of display objects along the preset central axis in three dimensions according to the rotation direction until the target display object is rotated to the target area, determining the transparency parameter and the three-dimensional transformation parameter of each of the plurality of display objects according to the position of each of the plurality of display objects.

[0011] In some examples, the determining the three-dimensional display parameter of each of the plurality of display objects according to the obtained operation instruction comprises: in response to obtaining a plurality of forms of candidate operation instructions, determining the operation instruction from the plurality of candidate operation instructions according to the priority of the plurality of forms of candidate operation instructions; and determining the three-dimensional display parameter of each of the plurality of display objects according to the operation instruction.

[0012] In some examples, the determining the operation instruction from the plurality of candidate operation instructions according to the priority of the plurality of forms of candidate operation instructions in response to obtaining the plurality of forms of candidate operation instructions comprises: in response to obtaining the plurality of forms of candidate operation instructions, determining the priority according to the current environmental information; and determining the operation instruction from the plurality of candidate operation instructions according to the priority.

[0013] In some examples, the method further comprises: in response to not receiving the operation instruction for more than a preset time length, superimposing the plurality of display objects automatically rotating along the preset central axis in three dimensions in the real scene image representing the current scene to take turns to display each of the plurality of display objects.

[0014] In some examples, before the determining the three-dimensional display parameters of the plurality of display objects according to the obtained operation instruction, the method further includes: preloading the plurality of types of data of the target item.

[0015] In a second aspect, the embodiments of the present application provide a data display device, which includes: a determining unit configured to determine three-dimensional display parameters of a plurality of display objects according to an obtained operation instruction, wherein the plurality of display objects correspond to a plurality of types of data of a target item one by one; a superimposing unit configured to superimpose the plurality of display objects adopting the three-dimensional display parameters in a real scene image representing a current scene to obtain a superimposed image; and a display unit configured to display the superimposed image.

[0016] In some examples, the three-dimensional display parameters include a transparency parameter and a three-dimensional transformation parameter, and the determining unit is further configured to: determine a target display object from the plurality of display objects according to the operation instruction; and determine the transparency parameter and the three-dimensional transformation parameter of each of the plurality of display objects according to a position of each of the plurality of display objects in a process in which the plurality of display objects are rotated in three dimensions along a preset central axis until the target display object is rotated to a target region, wherein the target region is a central region of a display region of the plurality of display objects in the real scene image, the transparency represented by the transparency parameter is positively correlated with a target distance, the inclination angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is a distance between the position of the display object and a center point of the target region.

[0017] In some examples, the superimposing unit is further configured to: superimpose the plurality of display objects adopting the three-dimensional display parameters in the display region, and superimpose a plurality of type labels corresponding to the plurality of types of data in a navigation region corresponding to the display region to obtain the superimposed image.

[0018] In some examples, the determining unit is further configured to: determine a target type label from the plurality of type labels according to the operation instruction; and determine a display object corresponding to the target type label from the plurality of display objects as a target display object.

[0019] In some examples, the device further includes: a direction determining unit configured to determine a rotation direction of the plurality of display objects according to the target display object and a current display object displayed in the target region; and the determining unit is further configured to: determine the transparency parameter and the three-dimensional transformation parameter of each of the plurality of display objects according to a position of each of the plurality of display objects in a process in which the plurality of display objects are rotated in three dimensions along the preset central axis in the rotation direction until the target display object is rotated to the target region.

[0020] In some examples, the determining unit is further configured to: in response to obtaining multiple forms of candidate operation instructions, determine the operation instruction from the multiple candidate operation instructions according to a priority of the multiple forms of candidate operation instructions; and determine the three-dimensional display parameters of the multiple display objects according to the operation instruction.

[0021] In some examples, the determining unit is further configured to: in response to obtaining multiple forms of candidate operation instructions, determine the priority according to the current environment information; and determine the operation instruction from the multiple candidate operation instructions according to the priority.

[0022] In some examples, the apparatus further includes an automatic display unit configured to, in response to not receiving the operation instruction for more than a preset time length, superimpose the multiple display objects that automatically rotate along a preset central axis in a real scene image representing a current scene to sequentially display each of the multiple display objects.

[0023] In some examples, the apparatus further includes a preloading unit configured to pre-load the multiple types of data of the target item before determining the three-dimensional display parameters of the multiple display objects according to the obtained operation instruction.

[0024] In a third aspect, an embodiment of the present application provides a computer readable medium, having a computer program stored thereon, wherein the program, when executed by a processor, implements the method described in any of the implementations of the first aspect.

[0025] In a fourth aspect, an embodiment of the present application provides an electronic device, including: one or more processors; and a storage device having one or more programs stored thereon, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any of the implementations of the first aspect.

[0026] In a fifth aspect, a computer program product is provided, including: a computer program, which, when executed by a processor, implements the method described in any of the implementations of the first aspect.

[0027] The data display method and apparatus provided by the embodiments of the present application determine the three-dimensional display parameters of the multiple display objects according to the obtained operation instruction, wherein the multiple display objects correspond to the multiple types of data of the target item one by one; superimpose the multiple display objects using the three-dimensional display parameters in a real scene image representing a current scene to obtain a superimposed image; and display the superimposed image, thereby providing a method of displaying item data in an augmented reality manner, increasing the amount of displayed data, and improving the information acquisition efficiency of a user and the operation convenience of the user. BRIEF DESCRIPTION OF DRAWINGS

[0028] Other features, objects, and advantages of the application will become more apparent from the following detailed description when read in conjunction with the accompanying drawings:

[0029] Fig. 1 is an exemplary system architecture diagram in which one embodiment of the present application can be applied;

[0030] Fig. 2 is a flow chart of one embodiment of the data display method according to the present application;

[0031] Fig. 3 is a schematic diagram of an application scenario of the data display method according to the present embodiment;

[0032] Fig. 4 is a schematic diagram of a superimposed image according to the present application;

[0033] Fig. 5 is a flow chart of another embodiment of the data display method according to the present application;

[0034] Fig. 6 is a structural diagram of one embodiment of the data display device according to the present application;

[0035] Fig. 7 is a structural schematic diagram of a computer system suitable for implementing the embodiments of the present application. DETAILED DESCRIPTION

[0036] The present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely intended for the purpose of illustration of the relevant application, and are not intended to limit the application. In addition, it should be noted that only the parts related to the application are shown in the drawings for ease of description.

[0037] It should be noted that the embodiments and features in the embodiments of the present application can be combined with each other without conflict. The present application will be described in detail below with reference to the accompanying drawings and embodiments.

[0038] It should be noted that in the technical solutions of the present disclosure, the collection, collection, updating, analysis, processing, use, transmission, storage, etc. of user personal information are in line with relevant legal regulations, are used for legal purposes, and do not violate public order and good customs. Necessary measures are taken to prevent illegal access to user personal information data, and to maintain user personal information security, network security and national security.

[0039] Fig. 1 shows an exemplary architecture 100 to which the data display method and device of the present application can be applied.

[0040] As shown in FIG. 1, the system architecture 100 can include terminal devices 101, 102, 103, a network 104, and a server 105. The terminal devices 101, 102, 103 are communicatively connected to form a topology network, and the network 104 is used as a medium to provide a communication link between the terminal devices 101, 102, 103 and the server 105. The network 104 can include various connection types, such as wired, wireless communication links, or fiber optic cables, etc.

[0041] The terminal devices 101, 102, 103 can interact with the server 105 through the network 104 to receive or send data, etc. The terminal devices 101, 102, 103 can be hardware devices or software that support network connection to interact and process data. When the terminal devices 101, 102, 103 are hardware, they can be various electronic devices that support network connection, information acquisition, interaction, display, processing, etc., including but not limited to AR (Augmented Reality) devices (such as head-mounted AR devices), smart phones, vehicle-mounted computers, tablet computers, e-book readers, laptop computers, desktop computers, etc. When the terminal devices 101, 102, 103 are software, they can be installed in the above-mentioned electronic devices. They can be implemented as multiple software or software modules (such as software or software modules used to provide distributed services), or as a single software or software module. No specific limitation is made herein.

[0042] The server 105 can be a server that provides various services, such as a background processing server that provides operation instructions for the terminal devices 101, 102, 103, provides various types of data of the items for the terminal devices 101, 102, 103, and displays various types of data of the items based on the augmented reality technology. As an example, the server 105 can be a cloud server.

[0043] It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster composed of multiple servers, or as a single server. When the server is software, it can be implemented as multiple software or software modules (such as software or software modules used to provide distributed services), or as a single software or software module. No specific limitation is made herein.

[0044] It should also be noted that the data display method provided by the embodiments of the present application can be executed by the server, or by the terminal device, or by the server and the terminal device in cooperation with each other. Accordingly, the data display apparatus includes various parts (such as units), which can all be arranged in the server, or all be arranged in the terminal device, or be arranged in the server and the terminal device respectively.

[0045] It should be understood that the number of terminal devices, networks and servers in FIG. 1 is only illustrative. According to the needs of implementation, there can be any number of terminal devices, networks and servers. When the electronic device on which the data display method runs does not need to transmit data with other electronic devices, the system architecture can only include the electronic device (such as a server or a terminal device) on which the data display method runs.

[0046] With reference to FIG. 2, a flow 200 of one embodiment of the data display method is shown, including the following steps:

[0047] In step 201, according to the obtained operation instruction, the three-dimensional display parameters of each of the plurality of display objects are determined.

[0048] In this embodiment, the execution subject (such as the terminal device or the server in FIG. 1) of the data display method can determine the three-dimensional display parameters of each of the plurality of display objects according to the obtained operation instruction. The plurality of display objects are used to display the plurality of types of data of the target item, and the plurality of display objects correspond one-to-one to the plurality of types of data of the target item.

[0049] The target item can be various items. Taking an e-commerce platform as an example, the target item can be various goods such as home appliances, clothes, food, etc. in the e-commerce platform. The plurality of types of data of the target item are data generated from multiple dimensions describing the target item, such as product parameter data, product service data, product detail data, delivery timeliness data, user evaluation data, etc.

[0050] In this embodiment, after the execution subject is started, the augmented reality interface is automatically loaded, and the augmented reality technology is used to load and display the plurality of types of data of the target data in real time according to the user demand. Specifically, first, in the data preparation stage, the plurality of types of data of the target item are obtained from the server. The plurality of types of data can be obtained in advance in the pre-page. In order to improve the display efficiency of the data and improve the viewing experience of the user, the plurality of types of data can be requested and processed concurrently through different server ports. Then, in the generation of the display object stage, the rendering engine of the AR device is used to render the plurality of types of data into elements in the 3D card (display object) and set the rendering effects such as the position, size and display content of the card. Mainly including: ① setting the basic parameters of 3D rendering, including the perspective, projection mode, etc.; ② rendering a 3D card object for each type of data, setting its initial position and size; ③ filling each type of data into the corresponding 3D card object; ④ presenting an automatic carousel effect, rendering the 3D card with corresponding parameters according to the position of the 3D card.

[0051] For the augmented reality interface, the user can issue operation instructions to it to change the display data or display effect in the augmented reality interface.

[0052] The execution subject can collect the operation instructions of the user through various sensors, such as a camera for capturing hand movement instructions of the user, a voice collector for capturing voice instructions of the user, and an eye tracker for capturing eye movement instructions of the user. Through various sensors, various forms of operation instructions of the user can be collected comprehensively. In terms of control content, the operation instructions are, for example, movement, scaling, switching, etc. instructions to the display area of a plurality of display objects in the real scene image, and are, for example, adjustment instructions to the number and position of the display objects displayed in the real scene image, and are, for example, adjustment instructions to the type data displayed in each display object.

[0053] After receiving the operation instructions, the execution subject can analyze and process the operation instructions to determine the specific operation content of the operation instructions, and determine the three-dimensional display parameters of the plurality of display objects according to the operation content. The three-dimensional display parameters are, for example, position and attitude parameters, size and scale parameters, light and shadow parameters, etc.

[0054] In this embodiment, for various operation instructions, corresponding various display effects can be set in advance. For example, when the operation instruction is a scaling instruction to the display area, the display area and the display objects in the display area can be scaled in the real scene image based on a preset scaling speed; for example, when the operation instruction is an adjustment instruction to the display position of the display object, the selected display object of the user can be translated to the center position in the display area based on a preset moving speed.

[0055] The AR device is, for example, Apple Vision Pro device (the first head-mounted "space computing" display device of Apple Inc.). The Apple Vision Pro device includes a panoramic perspective display, a depth sensor, and a dynamic loading module. The panoramic perspective display is used to superimpose a plurality of display objects in the real world, the depth sensor is used to capture depth information of the environment where the user is located, and the dynamic loading module is used to load and display related content in real time according to the needs of the user.

[0056] In step 202, a plurality of display objects using three-dimensional display parameters are superimposed in a real scene image representing a current scene to obtain a superimposed image.

[0057] In this embodiment, the execution subject can superimpose a plurality of display objects using three-dimensional display parameters in a real scene image representing a current scene to obtain a superimposed image.

[0058] The execution subject can collect a real scene image representing a current scene in real time, and render a plurality of display objects in a display area in the real scene image, each display object displaying one type of data of the target item, so as to superimpose the plurality of display objects using the three-dimensional display parameters in the real scene image, and obtain a superimposed image.

[0059] The display area can also be called a scene depth card area, and each display object in the display area is rendered as a suspended three-dimensional card. For example, the plurality of display objects are arranged in sequence in the display area, and for a target display object to be specifically viewed by the user, the target display object is enlarged and displayed in the center, so as to improve the viewing experience of the user.

[0060] In step 203, the superimposed image is displayed.

[0061] In the embodiment, the execution subject can display the superimposed image.

[0062] It can be understood that each superimposed image is obtained by superimposing the plurality of display objects using the three-dimensional display parameters on the real scene image collected in real time, and is displayed to the user in real time.

[0063] Referring to FIG. 3, FIG. 3 is a schematic diagram 300 of an application scenario of the data display method according to the embodiment. In the application scenario of FIG. 3, a user 301 views related data of a target item in an e-commerce platform through a head-mounted AR device (for example, Apple Vision Pro) 302. A server 303 first receives an operation instruction of the user through the head-mounted AR device 302, and determines three-dimensional display parameters of a plurality of display objects (three-dimensional cards corresponding to the product parameter data, the product service data, the product detail data, the delivery time data, and the user evaluation data, respectively) according to the obtained operation instruction, wherein the plurality of display objects correspond one-to-one to a plurality of types of data of the target item; then, the plurality of display objects using the three-dimensional display parameters are superimposed in a real scene image representing a current scene, to obtain a superimposed image 304; and finally, the superimposed image is fed back to the head-mounted AR device 302, so as to display the superimposed image to the user 301.

[0064] The method provided by the above embodiments of the application determines three-dimensional display parameters of a plurality of display objects according to an obtained operation instruction, wherein the plurality of display objects correspond one-to-one to a plurality of types of data of a target item; superimposes the plurality of display objects using the three-dimensional display parameters in a real scene image representing a current scene, to obtain a superimposed image; and displays the superimposed image, thereby providing a method of displaying item data in an augmented reality manner, increasing the amount of displayed data, and improving the information acquisition efficiency of the user and the operation convenience of the user.

[0065] With reference back to FIG. 4, a schematic diagram of the superimposed image 400 is shown. In some implementations of the present embodiment, the effect presented by the augmented reality technology is that the plurality of display objects rotate in three dimensions along a preset central axis, and each display object changes its tilt angle during the rotation so as to be parallel to the augmented reality interface when the display object moves to the central region of the display region 401.

[0066] In the present implementation, the three-dimensional display parameters include a transparency parameter and a three-dimensional transformation parameter, and the execution subject can execute the step 201 in the following manner:

[0067] First, according to the operation instruction, a target display object is determined from the plurality of display objects.

[0068] Taking a hand action instruction as an example of the operation instruction, the execution subject can determine the rotation direction of the plurality of display objects according to the moving direction of the hand action, determine the length of rotation along the rotation direction according to the moving speed of the hand action, and further determine the target display object according to the rotation length. The moving speed is positively correlated with the length of rotation.

[0069] Taking a voice instruction as an example of the operation instruction, the execution subject identifies the voice instruction to obtain a voice text, and determines a display object in the plurality of display objects that matches the voice text as the target display object.

[0070] Second, during the process in which the plurality of display objects rotate in three dimensions along the preset central axis until the target display object rotates to the target region, the transparency parameter and the three-dimensional transformation parameter of each of the plurality of display objects are determined according to the position of each of the plurality of display objects.

[0071] The target region is a central region of a display region in the real scene image corresponding to the plurality of display objects, the transparency represented by the transparency parameter is positively correlated with a target distance, the tilt angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is the distance between the position of the display object and the center point of the target region.

[0072] The transparency parameter can be calculated by the following formula:

[0073] In the formula, alpha represents the transparency parameter, offset represents the offset of the display object relative to the center point, fadeMin represents the minimum offset at which the transparency starts to decrease, fadeMax represents the maximum offset at which the transparency starts to decrease, fadeRange represents the range of transparency change, and fadeMinalpha represents the minimum transparency.

[0074] The three-dimensional transformation parameter can be calculated by the following formula:

[0075] Calculate the reasonable offset of the display object: clampedOffset = max(-1.0, min(1.0, offset))

[0076] Calculate the translation and depth of the display object: x = (clampedOffset x 0.5 x tilt + offset x spacing) x itemWidth z = |clampedOffset| x - itemWidth x 0.5

[0077] Apply the translation transform: transform = CATransform3DTranslate(transform, x, 0.0, z)

[0078] Apply the rotation transform: finalTransform = CATransform3DRotate(transform, -clampedOffset x π / 2 x tilt, 0.0, 1.0, 0.0)

[0079] Wherein, tilt represents the tilt angle of the display object; spacing represents the spacing between the display objects; itemWidth represents the width of the display object.

[0080] In the present implementation, when displaying multiple types of data of the target item based on augmented reality technology, a three-dimensional rotation and a fade-in and fade-out display mode are adopted, which enhances the interaction with the user and improves the user experience.

[0081] In some implementations of the present embodiment, a navigation area is provided corresponding to the display area of the multiple display objects, and multiple type labels corresponding to the multiple types of data are provided in the navigation area.

[0082] In the present implementation, the execution subject can execute the step 202 by superimposing multiple display objects using three-dimensional display parameters in the display area and superimposing multiple type labels corresponding to the multiple types of data in the navigation area corresponding to the display area to obtain a superimposed image.

[0083] Continuing to refer to FIG. 4, a navigation area 402 is provided below the display area 401. In the present implementation, the multiple display objects in the display area correspond one-to-one to the multiple type labels in the navigation area. When a target display object is displayed in the central area of the display area, a target type label corresponding to the target display object in the navigation area is highlighted. For example, the target type label is highlighted.

[0084] In the present implementation, the navigation area is provided corresponding to the display area, and the plurality of type labels are provided in the navigation area corresponding to the plurality of display objects in the display area, which helps to further improve the information acquisition efficiency and operation convenience of the user.

[0085] In some implementations of the present embodiment, the execution subject can execute the determination process of the target display object in the following manner:

[0086] First, the target type label is determined from the plurality of type labels according to the operation instruction.

[0087] In the present implementation, the navigation area can also receive the operation instruction of the user. For example, a click instruction for the target type label in the navigation area, a voice instruction for the target type label in the navigation area, and an eye movement instruction for the target type label in the navigation area.

[0088] The execution subject can analyze and process the operation instruction to determine the target type label from the plurality of type labels.

[0089] Then, the display object corresponding to the target type label in the plurality of display objects is determined as the target display object.

[0090] According to the correspondence between the display object and the type label, the execution subject can determine the display object corresponding to the target type label in the plurality of display objects as the target display object.

[0091] In the present implementation, the navigation area matched with the display area can also receive the operation instruction of the user, further improving the convenience of the user in operating the item data.

[0092] In some implementations of the present embodiment, the execution subject can also perform the following operation: determining the rotation direction of the plurality of display objects according to the target display object and the current display object displayed in the target area.

[0093] The rotation direction generally includes left (left side of the augmented reality interface) rotation and right (right side of the augmented reality interface) rotation. However, under certain operation instructions, the execution subject cannot directly determine the rotation direction according to the operation instruction. For example, the display object A is displayed in the center area of the display area, and when the voice instruction "display object B" for the type label is received, the display object B can be rotated to the center area by left rotation and right rotation.

[0094] In this implementation, the execution subject can determine distances at which the target display object and the current display object displayed in the target region need to be rotated in the two rotation modes of left rotation and right rotation, and determine the rotation direction with the smaller rotation distance as the rotation direction of the plurality of display objects.

[0095] In this implementation, the execution subject can determine the three-dimensional display parameters of the plurality of display objects by determining the transparency parameters and the three-dimensional transformation parameters of the plurality of display objects according to the positions of the plurality of display objects during the process of rotating the plurality of display objects along the preset central axis in the rotation direction until the target display object is rotated to the target region.

[0096] The transparency represented by the transparency parameter and the inclination angle represented by the three-dimensional transformation parameter are positively correlated with the target distance, which is the distance between the position of the display object and the center point of the target region, in the same way as the determination process of the three-dimensional display parameters in the above embodiment.

[0097] In this implementation, the rotation direction of the plurality of display objects is first determined to rotate in the rotation direction so that the central region displays the display object expected by the user as soon as possible, which helps to further improve the information acquisition efficiency of the user, and the rotation distance is reduced based on the determined rotation direction, which helps to reduce the rendering pressure of the execution subject in the rotation process.

[0098] In some implementations of this embodiment, the execution subject can execute the step 201 in the following way:

[0099] First, in response to obtaining the candidate operation instructions in multiple forms, the operation instruction is determined from the plurality of candidate operation instructions according to the priority of the candidate operation instructions in multiple forms.

[0100] As an example, the execution subject or an electronic device in communication connection with the execution subject is provided with a priority corresponding to each of the multiple instruction forms. In response to obtaining the candidate operation instructions in multiple forms at the same time, the operation instruction with the highest priority is determined from the plurality of candidate operation instructions according to the priority of the candidate operation instructions in multiple forms.

[0101] In some implementations, in response to obtaining different operation instructions in multiple forms at the same time, the execution subject can determine whether there is a conflict between the different operation instructions; in response to determining that there is no conflict, the execution order between the plurality of different operation instructions is determined, and subsequently the plurality of operation instructions are executed in sequence according to the execution order.

[0102] Then, the three-dimensional display parameters of the plurality of display objects are determined according to the operation instruction.

[0103] In the implementation manner, the execution subject can determine the three-dimensional display parameters of each of the plurality of display objects according to the operation instruction, which will not be described herein again.

[0104] In the implementation manner, the information processing manner in the multi-operation instruction scenario is provided, and the application range of the data display method is expanded.

[0105] In some implementation manners of the embodiment, the execution subject can perform the determination process of the operation instruction in the following manner:

[0106] Firstly, in response to obtaining the candidate operation instructions in multiple forms, the priority is determined according to the current environmental information.

[0107] For example, when the action instruction and the voice instruction are received at the same time, in response to determining that the current environmental information is a noisy environment, it is determined that the action instruction has a higher priority.

[0108] In some implementation manners, the execution subject can also determine the priority of the candidate operation instructions in multiple forms according to the context of the operation instruction.

[0109] Then, the operation instruction is determined from the plurality of candidate operation instructions according to the priority.

[0110] In the implementation manner, the operation instruction with the highest priority is determined from the plurality of candidate operation instructions.

[0111] In the implementation manner, the determination manner of the priority of the operation instruction is provided, and the accuracy of the priority and the adaptation degree between the priority and the environmental information are improved based on the current environmental information.

[0112] In some implementation manners of the embodiment, the execution subject can also perform the following operation: in response to not receiving the operation instruction for more than a preset time length, a plurality of display objects automatically rotating along a preset central axis in three dimensions are superimposed in a real scene image representing a current scene, so as to take turns to display each of the plurality of display objects.

[0113] The preset time length can be set according to actual conditions, for example, 5 seconds.

[0114] The automatic carousel function refers to automatically carouseling the three-dimensional card when the user does not issue the operation instruction for a long time, and providing continuous visual experience to the user. The automatic carousel function mainly depends on:

[0115] Time manager: used to control the time interval (preset time length) of automatic carousel. When the system starts, the time manager initializes and sets the time interval (for example, every 5 seconds) of the automatic carousel. The time manager continues to count, and when the timer reaches the time interval, the carousel controller triggers the next operation.

[0116] carousel controller: used to perform the carousel operation of the three-dimensional card. The carousel controller receives the trigger signal of the time manager, and performs the carousel operation of the card. Through the 3D rendering module, the carousel controller realizes the smooth transition effect of the card, including rotation, fade-in and fade-out, etc. The carousel controller ensures the circular playing of the card list, and when the last three-dimensional card is displayed, the carousel starts from the first three-dimensional card.

[0117] state monitor: used to monitor the interaction state of the user. The state monitor continuously monitors the gestures and interaction operations of the user. Automatic carousel start-stop control: when the user performs a gesture operation, the automatic carousel is paused; when the user stops operating for a predetermined time, the automatic carousel is restarted.

[0118] In the implementation mode, based on the automatic carousel function, the user is provided with a continuous visual experience, which helps to improve the user experience.

[0119] In some implementation modes of the embodiment, the above execution subject can further perform the following operation before performing the above step 201: preloading the multiple types of data of the target item.

[0120] Preloading refers to a strategy of loading resources or data that may be needed in the future in advance during data processing or page loading. For example, the server can actively push resources to the client to realize preloading.

[0121] In the implementation mode, the multiple types of data of the item can be loaded faster through the preloading mode, the waiting time is reduced, and the user experience is further improved.

[0122] With reference to FIG. 5, another embodiment of the data display method according to the present application is shown in a schematic flow 500, including the following steps:

[0123] Step 501: determining a target display object from the multiple display objects according to the obtained operation instruction.

[0124] The multiple display objects correspond one-to-one to the multiple types of data of the target item.

[0125] Step 502: determining the transparency parameter and the three-dimensional transformation parameter of each of the multiple display objects according to the position of each of the multiple display objects in the process of three-dimensional rotation of the multiple display objects along the preset central axis until the target display object is rotated to the target area.

[0126] The target region is a central region in the real scene image corresponding to a display region of the plurality of display objects, the transparency represented by the transparency parameter is positively correlated with the target distance, the tilt angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is a distance between a position of the display object and a center point of the target region.

[0127] In step 503, the plurality of display objects using the three-dimensional display parameters are superimposed in the display region, and a plurality of type labels corresponding to the plurality of types of data are superimposed in the navigation region corresponding to the display region, to obtain a superimposed image.

[0128] In step 504, the superimposed image is displayed.

[0129] As can be seen from the embodiment, compared with the embodiment corresponding to FIG. 2, the flow 500 of the data display method in the embodiment specifically describes the obtaining process of the superimposed image, the amount of displayed data is increased in an augmented reality manner, and the information acquisition efficiency of the user and the operation convenience of the user are improved.

[0130] With reference still to FIG. 6, as an implementation of the method shown in the above figures, the present application provides an embodiment of a data display device, which corresponds to the method embodiment shown in FIG. 2, and the device embodiment can be specifically applied to various electronic devices.

[0131] As shown in FIG. 6, a data display device includes a determination unit 601 configured to determine three-dimensional display parameters of a plurality of display objects according to an obtained operation instruction, wherein the plurality of display objects correspond to a plurality of types of data of a target object one by one; a superimposition unit 602 configured to superimpose the plurality of display objects using the three-dimensional display parameters in a real scene image representing a current scene, to obtain a superimposed image; and a display unit 603 configured to display the superimposed image.

[0132] In some implementations of the embodiment, the three-dimensional display parameters include a transparency parameter and a three-dimensional transformation parameter, and the determination unit 601 is further configured to: determine a target display object from the plurality of display objects according to the operation instruction; and determine the transparency parameter and the three-dimensional transformation parameter of each of the plurality of display objects according to a position of each of the plurality of display objects in a process in which the plurality of display objects are rotated three-dimensionally along a preset central axis until the target display object is rotated to a target region, wherein the target region is a central region in the real scene image corresponding to a display region of the plurality of display objects, the transparency represented by the transparency parameter is positively correlated with the target distance, the tilt angle represented by the three-dimensional transformation parameter is positively correlated with the target distance, and the target distance is a distance between the position of the display object and a center point of the target region.

[0133] In some implementations of the present embodiment, the superimposition unit 602 is further configured to superimpose the plurality of display objects adopting the three-dimensional display parameters in the display area, and superimpose the plurality of type labels corresponding to the plurality of types of data in the navigation area corresponding to the display area, to obtain the superimposed image.

[0134] In some implementations of the present embodiment, the determination unit 601 is further configured to determine the target type label from the plurality of type labels according to the operation instruction, and determine the display object corresponding to the target type label in the plurality of display objects as the target display object.

[0135] In some implementations of the present embodiment, the device further comprises a direction determination unit (not shown in the figure) configured to determine the rotation direction of the plurality of display objects according to the target display object and the current display object displayed in the target area, and the determination unit 601 is further configured to determine the transparency parameter and the three-dimensional transformation parameter of each of the plurality of display objects according to the position of each of the plurality of display objects in the process of rotating the plurality of display objects along the preset central axis in the rotation direction until the target display object is rotated to the target area.

[0136] In some implementations of the present embodiment, the determination unit 601 is further configured to determine the operation instruction from the plurality of candidate operation instructions according to the priority of the plurality of forms of candidate operation instructions in response to obtaining the plurality of forms of candidate operation instructions, and determine the three-dimensional display parameter of each of the plurality of display objects according to the operation instruction.

[0137] In some implementations of the present embodiment, the determination unit 601 is further configured to determine the priority according to the current environmental information in response to obtaining the plurality of forms of candidate operation instructions, and determine the operation instruction from the plurality of candidate operation instructions according to the priority.

[0138] In some implementations of the present embodiment, the device further comprises an automatic display unit (not shown in the figure) configured to superimpose the plurality of display objects automatically rotating along the preset central axis in the real scene image representing the current scene to take turns displaying each of the plurality of display objects in response to not receiving the operation instruction for more than a preset time length.

[0139] In some implementations of the present embodiment, the device further comprises a preloading unit (not shown in the figure) configured to pre-load the plurality of types of data of the target item before determining the three-dimensional display parameter of each of the plurality of display objects according to the obtained operation instruction.

[0140] In this embodiment, the determining unit in the data display device determines the three-dimensional display parameters of the plurality of display objects according to the obtained operation instruction, wherein the plurality of display objects correspond to the plurality of types of data of the target object one by one; the superimposing unit superimposes the plurality of display objects adopting the three-dimensional display parameters in the real scene image representing the current scene to obtain the superimposed image; and the display unit displays the superimposed image, thereby providing a device for displaying the data of the object in an augmented reality manner, increasing the amount of displayed data, and improving the information acquisition efficiency of the user and the operation convenience of the user.

[0141] Reference is made below to Fig. 7, which shows a structural schematic diagram of a computer system 700 of a device (e.g., the devices 101, 102, 103, 105 shown in Fig. 1) suitable for implementing the embodiments of the present application. The device shown in Fig. 7 is merely an example, and should not impose any limitation on the functions and use range of the embodiments of the present application.

[0142] As shown in Fig. 7, the computer system 700 includes a processor (e.g., a CPU, central processing unit) 701, which can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 702 or loaded into a random access memory (RAM) 703 from a storage portion 708. In the RAM 703, various programs and data required for the operation of the system 700 are also stored. The processor 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0143] The following components are connected to the I / O interface 705: an input portion 706 including a keyboard, a mouse, and the like; an output portion 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), and the like, and a speaker, and the like; a storage portion 708 including a hard disk, and the like; and a communication portion 709 including a network interface card such as a LAN card, a modem, and the like. The communication portion 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as necessary. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, and the like is mounted on the drive 710 as necessary, so that a computer program read therefrom is installed in the storage portion 708 as necessary.

[0144] In particular, the processes described above with reference to the flow charts can be implemented as a computer software program in accordance with embodiments of the present application. For example, embodiments of the present application include a computer program product which includes a computer program tangibly embodied on a computer readable medium, the computer program containing program code for executing the methods illustrated by the flow charts. In such embodiments, the computer program can be downloaded and installed from a network via the communication portion 709 and / or installed from the removable media 711. When the computer program is executed by the processor 701, the above-described functions defined in the methods of the present application are performed.

[0145] Note that the computer readable medium of the present application can be a computer readable signal medium or a computer readable storage medium or any combination thereof. The computer readable storage medium can be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any suitable combination thereof. More specific examples of the computer readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present application, the computer readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus or device. In the present application, the computer readable signal medium can include a data signal that propagates in a baseband or as part of a carrier wave, in which the computer readable program code is carried. Such a propagated data signal can take any of a variety of forms, including but not limited to electro-magnetic, optical, or any suitable combination thereof. The computer readable signal medium can also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate or transport a program for use by or in connection with an instruction execution system, apparatus or device. The program code contained on the computer readable medium can be transmitted by any suitable medium, including but not limited to wireless, wire line, optical fiber cable, RF, etc., or any suitable combination thereof.

[0146] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0147] The computer program instructions can also be loaded onto a computer or other programmable information processing apparatus to cause a series of operations to be performed on the computer or other programmable information processing apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable information processing apparatus implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0148] The units described in the embodiments of the present application can be implemented by software, or by hardware. The units described can also be implemented by a processor, for example, can be described as: a processor, comprising a determining unit, a superimposing unit and a displaying unit. In some cases, the names of the units do not constitute a limitation on the units themselves, for example, the superimposing unit can also be described as: a unit that superimposes a plurality of display objects using three-dimensional display parameters in a real scene image representing a current scene to obtain a superimposed image.

[0149] As another aspect, the application also provides a computer readable medium, which can be included in the device described in the above embodiments, or can exist independently without being assembled into the device. The computer readable medium carries one or more programs, which, when executed by the device, cause the computer device to: determine three-dimensional display parameters of a plurality of display objects according to acquired operation instructions, wherein the plurality of display objects correspond to a plurality of types of data of a target object one by one; superimpose the plurality of display objects adopting the three-dimensional display parameters in a real scene image representing a current scene to obtain a superimposed image; and display the superimposed image.

[0150] The above description is merely the preferred embodiments of the present application and the explanation of the principles of the applied technology. It should be understood by those skilled in the art that the disclosed range of the present application is not limited to the technical solutions formed by the specific combinations of the above technical features, and should also cover other technical solutions formed by any combinations of the above technical features or equivalent features without departing from the disclosed concept. For example, the above features can be replaced with the technical features disclosed in the present application (but not limited to) having similar functions to form technical solutions.

Claims

1. A data display method, comprising: determining three-dimensional display parameters of a plurality of display objects according to an obtained operation instruction, wherein the plurality of display objects correspond to a plurality of types of data of a target item one-to-one; superimposing the plurality of display objects with the three-dimensional display parameters in a real scene image representing a current scene to obtain a superimposed image; and displaying the superimposed image.

2. The method of claim 1, wherein, The three-dimensional display parameters include transparency parameters and three-dimensional transformation parameters, and The determining of the three-dimensional display parameters of the plurality of display objects according to the obtained operation instruction comprises: determining a target display object from the plurality of display objects according to the operation instruction; determining the transparency parameters and the three-dimensional transformation parameters of the plurality of display objects according to positions of the plurality of display objects in a process in which the plurality of display objects are rotated three-dimensionally along a preset central axis until the target display object is rotated to a target region, wherein the target region is a central region of a display region corresponding to the plurality of display objects in the real scene image, the transparency represented by the transparency parameters is positively correlated with a target distance, the tilt angle represented by the three-dimensional transformation parameters is positively correlated with the target distance, and the target distance is a distance between a position of the display object and a center point of the target region.

3. The method of claim 2, wherein, The superimposing of the plurality of display objects with the three-dimensional display parameters in the real scene image representing the current scene to obtain the superimposed image comprises: superimposing the plurality of display objects with the three-dimensional display parameters in the display region and superimposing a plurality of type labels corresponding to the plurality of types of data in a navigation region corresponding to the display region to obtain the superimposed image.

4. The method of claim 3, wherein, The determining of the target display object from the plurality of display objects according to the operation instruction comprises: determining a target type label from the plurality of type labels according to the operation instruction; and determining a display object corresponding to the target type label from the plurality of display objects as the target display object. 5.The method of claim 4, further comprising: determining a rotation direction of the plurality of display objects according to the target display object and a current display object displayed in the target region; and The determining of the transparency parameters and the three-dimensional transformation parameters of the plurality of display objects according to the positions of the plurality of display objects in the process in which the plurality of display objects are rotated three-dimensionally along the preset central axis until the target display object is rotated to the target region comprises: determining the transparency parameters and the three-dimensional transformation parameters of the plurality of display objects according to the positions of the plurality of display objects in a process in which the plurality of display objects are rotated three-dimensionally along the preset central axis in the rotation direction until the target display object is rotated to the target region. The determining of the three-dimensional display parameters of the plurality of display objects according to the obtained operation instruction comprises:

6. The method of any one of claims 1-5, wherein, ​ In response to obtaining the candidate operation instructions in multiple forms, the operation instruction is determined from the candidate operation instructions according to priorities of the candidate operation instructions in multiple forms; and According to the operation instruction, the three-dimensional display parameters of the plurality of display objects are determined respectively.

7. The method of claim 6, wherein, The operation instruction is determined from the candidate operation instructions according to priorities of the candidate operation instructions in multiple forms in response to obtaining the candidate operation instructions in multiple forms, including: In response to obtaining the candidate operation instructions in multiple forms, the priorities are determined according to current environmental information; and The operation instruction is determined from the candidate operation instructions according to the priorities.

8. The method of any one of claims 1-5, further comprising: In response to not receiving an operation instruction for more than a preset time length, the plurality of display objects automatically rotating along a preset central axis in three dimensions are superimposed in a real scene image representing a current scene to take turns to display each of the plurality of display objects.

9. The method of any one of claims 1-5, wherein, Before the three-dimensional display parameters of the plurality of display objects are determined according to the obtained operation instruction, the method further comprises: Preloading the plurality of types of data of the target object.

10. A data display device, comprising: A determination unit configured to determine the three-dimensional display parameters of the plurality of display objects according to the obtained operation instruction, wherein the plurality of display objects correspond to the plurality of types of data of the target object one by one; A superposition unit configured to superimpose the plurality of display objects adopting the three-dimensional display parameters in a real scene image representing a current scene to obtain a superimposed image; A display unit configured to display the superimposed image.

11. A computer readable medium having stored thereon a computer program, wherein, The program is executed by the processor to implement the method of any one of claims 1-9.

12. An electronic device, comprising: One or more processors; A storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, the one or more processors implement the method of any one of claims 1-9.

13. A computer program product, comprising: A computer program, when executed by a processor, implements the method of any one of claims 1-9. A computer program, when executed by a processor, implements the method of any one of claims 1-9.

Images