Rendering object determination method and related device

By determining the object to be rendered based on the various properties of the object on the rendering end, and rendering only the objects matching the sensor resources, the problem of the difference in actions between the virtual world and the real world is solved, and the action coordination is achieved.

WO2025108205A1PCT designated stage expired Publication Date: 2025-05-30VIVO MOBILE COMM CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/132528
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-11-23
Filing Date
2024-11-18
Publication Date
2025-05-30

AI Technical Summary

Technical Problem

In tactile scenes, the virtual geometric shapes of the source objects and avatars in the virtual world differ greatly from the actions of objects in the real world, resulting in inconsistent behavior between the virtual world and the real world.

Method used

By determining the object to be rendered based on the object's state properties, detail hierarchy LOD properties, sensor-related information and functional functions at the rendering end, only objects matching the current sensor resource are rendered to reduce the action difference.

Benefits of technology

It effectively reduces the movement differences between the virtual geometric shapes of source objects and avatars in the virtual world and objects in the real world, making the movements of the virtual geometric shapes of source objects and avatars in the virtual world more coordinated with the movements of objects in the real world.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024132528_30052025_PF_FP_ABST
    Figure CN2024132528_30052025_PF_FP_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of rendering, and discloses a rendering object determination method and a related device. The method in embodiments of the present application comprises: on the basis of at least one of the following items, determining an object to be rendered: first attribute information of an object, the first attribute information comprising a state attribute; second attribute information of the object, the second attribute information comprising a Level of Detail (LOD) attribute or an attribute related to the LOD attribute; sensor-related information; and a functional function, the functional function being used for determining, on the basis of a specific attribute, the object to be rendered.
Need to check novelty before this filing date? Find Prior Art

Description

Method for determining rendering object and related equipment

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application No. 202311576039.3 filed in China on November 23, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present application belongs to the field of rendering technology, and specifically relates to a method for determining a rendering object and related equipment. Background Art

[0004] In a tactile scene, the virtual geometric shapes of the (tactile) source object and avatar may have a variety of shapes, for example, including high-definition geometric shapes or low-definition geometric shapes. High-definition geometric shapes can more realistically simulate the form of the tactile source object and avatar, but require more processor resources to process and require high-definition sensing devices and execution devices to match them. Otherwise, there will be a significant mismatch between the behavior of the virtual world and the behavior of the real world. Therefore, it is necessary to reduce the movement difference between the virtual geometric shapes of the source object and avatar in the virtual world and the objects in the real world to ensure that the movement of the virtual geometric shapes of the source object and avatar in the virtual world is more coordinated with the movement of the objects in the real world. Summary of the Invention

[0005] The embodiments of the present application provide a method for determining a rendering object and related devices, which can solve the problem of how to reduce the movement difference between the virtual geometric shapes of source objects and avatars in the virtual world and objects in the real world.

[0006] In a first aspect, a method for determining a rendering object is provided, which is executed by a rendering end, and the method includes:

[0007] Determine the object to be rendered based on at least one of the following:

[0008] First attribute information of the object, the first attribute information including a state attribute;

[0009] Second attribute information of the object, the second attribute information including a level of detail (LOD) attribute or an attribute related to the LOD attribute;

[0010] Sensor related information;

[0011] A function is used to determine an object to be rendered according to specific attributes.

[0012] In a second aspect, a device for determining a rendering object is provided, comprising:

[0013] A determination module is configured to determine an object to be rendered based on at least one of the following:

[0014] First attribute information of the object, the first attribute information including a state attribute;

[0015] Second attribute information of the object, the second attribute information including a level of detail (LOD) attribute or an attribute related to the LOD attribute;

[0016] Sensor related information;

[0017] A function is used to determine an object to be rendered according to specific attributes.

[0018] In a third aspect, an electronic device is provided, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0019] In a fourth aspect, an electronic device is provided, including a processor and a communication interface, wherein the processor is configured to determine an object to be rendered based on at least one of the following:

[0020] First attribute information of the object, the first attribute information including a state attribute;

[0021] Second attribute information of the object, the second attribute information including a level of detail (LOD) attribute or an attribute related to the LOD attribute;

[0022] Sensor related information;

[0023] A function is used to determine an object to be rendered according to specific attributes.

[0024] In a fifth aspect, a readable storage medium is provided, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0025] In a sixth aspect, a chip is provided, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is configured to run a program or instruction to implement the method described in the first aspect.

[0026] In a seventh aspect, a computer program / program product is provided, wherein the computer program / program product is stored in a storage medium and is executed by at least one processor to implement the steps of the method described in the first aspect.

[0027] In an embodiment of the present application, the rendering end determines the object to be rendered based on at least one of the following: first attribute information of the object, the first attribute information including a state attribute; second attribute information of the object, the second attribute information including a detail level LOD attribute or an attribute related to the LOD attribute; sensor-related information; a function function, the function function being used to determine the object to be rendered based on a specific attribute. Through the above scheme, objects with specific attributes can be screened out as objects to be rendered, so that only objects with specific attributes can be rendered, such as only rendering objects that match the current sensor resources, thereby effectively reducing the difference in movement between the virtual geometric shapes of the source objects and avatars in the virtual world and the objects in the real world, so that the movement of the virtual geometric shapes of the source objects and avatars in the virtual world is more coordinated with the movement of the objects in the real world. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] FIG1 is a schematic flow chart showing a method for determining a rendering object according to an embodiment of the present application;

[0029] FIG2 is a schematic diagram showing a module of a device for determining a rendering object according to an embodiment of the present application;

[0030] FIG3 is a block diagram showing the structure of an electronic device according to an embodiment of the present application;

[0031] FIG4 shows a structural block diagram of a terminal according to an embodiment of the present application. DETAILED DESCRIPTION

[0032] The following will be combined with the accompanying drawings in the embodiments of this application to clearly describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0033] The terms "first", "second", etc. in this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same type, and do not limit the number of objects, for example, the first object can be one or more. In addition, "or" in this application represents at least one of the connected objects. For example, "A or B" covers three options, namely, Option 1: including A but not including B; Option 2: including B but not including A; Option 3: including both A and B. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0034] The term "indication" in this application can be either a direct indication (or explicit indication) or an indirect indication (or implicit indication). A direct indication can be understood as the sender explicitly informing the receiver of specific information, the operation to be performed, or the requested result, etc. in the instruction sent; an indirect indication can be understood as the receiver determining the corresponding information based on the instruction sent by the sender, or making a judgment and determining the operation to be performed or the requested result, etc. based on the judgment result.

[0035] In order to enable those skilled in the art to better understand the embodiments of the present application, the following description is first given.

[0036] 1. Interactivity extension in glTF (3D model file format);

[0037] glTF is used for efficient transmission and loading of 3D scenes and models by engines and applications. glTF defines an extensible publishing format that simplifies authoring workflows and interactive services by enabling interoperable use of 3D content across the industry.

[0038] The Moving Picture Experts Group (MPEG) has extended glTF and initially designed standards for interactivity. For haptic scenarios, these standards primarily describe the interaction between avatars and haptic sources, triggering and generating haptic signals based on this interaction.

[0039] Interactivity is defined based on behavior. Behavior includes trigger nodes and action nodes. Triggers include collision conditions, proximity conditions, and visibility conditions. Actions include haptic feedback actions (ACTION_SET_HAPTIC) and activation nodes (ACTION_ACTIVATE).

[0040] As shown in Table 1, ACTION_ACTIVATE defines the active / inactive state and the node list.

[0041] Table 1

[0042] 2. Level of detail (LOD) extensions in glTF;

[0043] The MSFT_lod extension is added to the node corresponding to the highest LOD level. The extension defines an ids property, which is an array containing the indices of nodes at lower LOD levels. Each value in the array points to a node corresponding to an LOD level of lower quality than the previous one. For example, if the extension is defined at the node level, the node object with the extension is the highest LOD level. Each value specified in the extension's ids array points to the index of another node object that should be used as a lower LOD level.

[0044] LOD can represent different levels of detail / resolution of objects such as nodes / mesh grids.

[0045] The object in the embodiment of the present application includes at least one of the following: scene, node, mesh, material, vertices, face, etc.

[0046] The following describes in detail the method for determining a rendering object and related devices provided by the embodiments of the present application through some embodiments and their application scenarios in conjunction with the accompanying drawings.

[0047] As shown in FIG1 , an embodiment of the present application provides a method for determining a rendering object, which is executed by a rendering end, specifically a rendering engine or a display engine of the rendering end, and includes:

[0048] Step 101: Determine an object to be rendered based on at least one of the following:

[0049] The first item: first attribute information of the object, wherein the first attribute information includes a state attribute, and the state attribute can be an active state or an inactive state;

[0050] For example, an object includes activation / inactive related properties, and a rendering engine or a presentation engine on a rendering end determines whether to determine the object as an object to be rendered based on the activation / inactive properties.

[0051] Optionally, in an embodiment of the present application, object group-based deactivation is supported. That is, when an object is inactive, its sub-objects are also inactive; when an object is active, whether its sub-objects are active is further determined based on the activation / inactive status of the sub-objects.

[0052] For example, if an avatar node corresponds to meshes of multiple resolutions, and each mesh has an active / inactive state, only the active mesh will be processed by the rendering engine.

[0053] The second item: second attribute information of the object, where the second attribute information includes a level of detail (LOD) attribute or an attribute related to the LOD attribute.

[0054] For example, an attribute related to the LOD attribute may be the geometry fineness of the object, through which the fineness corresponding to the LOD may be determined;

[0055] Item 3: Sensor related information.

[0056] In some scenarios, high-precision geometric shapes can more realistically simulate the form of tactile source objects and avatars. However, high-precision geometric shapes require more processor resources to process and require high-precision sensing and execution devices to match them. Otherwise, there will be a significant mismatch between the behavior of the virtual world and the behavior of the real world. For example, when simulating the action of a hand stroking the surface of an object, if the hand and object are simulated using high-precision geometric shapes, and the user's hand position sensor has low sensitivity, then even if the action of stroking the object is performed in the real world, the object will sometimes be touchable in the virtual world and sometimes not. Conversely, if the hand and object are simulated using low-precision geometric shapes, even if the user's hand position sensor has high sensitivity, there will be a significant difference in movement between the virtual world and the real world.

[0057] Therefore, in the embodiment of the present application, determining the object to be rendered based on sensor-related information can effectively reduce the action difference between the virtual world and the real world.

[0058] The fourth item: a function, which is used to determine the object to be rendered according to specific attributes.

[0059] For example, the above-mentioned specific attributes include a specific LOD or a specific state.

[0060] In the embodiment of the present application, after the object to be rendered is determined, the object to be rendered is rendered.

[0061] In an embodiment of the present application, the rendering end determines the object to be rendered based on at least one of the following: first attribute information of the object, the first attribute information including a state attribute; second attribute information of the object, the second attribute information including a detail level LOD attribute or an attribute related to the LOD attribute; sensor-related information; a function function, the function function being used to determine the object to be rendered based on a specific attribute. Through the above scheme, objects with specific attributes can be screened out as objects to be rendered, so that only objects with specific attributes can be rendered, such as only rendering objects that match the current sensor resources, thereby effectively reducing the difference in movement between the virtual geometric shapes of the source objects and avatars in the virtual world and the objects in the real world, so that the movement of the virtual geometric shapes of the source objects and avatars in the virtual world is more coordinated with the movement of the objects in the real world.

[0062] Optionally, determining the object to be rendered according to the function includes:

[0063] The functional function is directly monitored to obtain the object to be rendered.

[0064] In the embodiment of the present application, the object to be rendered is obtained by directly monitoring the functional function without adding corresponding specific attributes to the object, thereby achieving the purpose of quickly and conveniently obtaining the object to be rendered with specific attributes.

[0065] Optionally, directly monitoring the functional function to obtain the object to be rendered includes:

[0066] According to the identification information of the function, the function is directly monitored to obtain an object to be rendered;

[0067] The identification information is used to indicate that the functional function is directly monitored by the rendering engine or the display engine.

[0068] Through this identification information, the rendering end determines that the function is a function that can be directly monitored, that is, distinguishes this function from existing functions that cannot be directly monitored (such as the ACTION_ACTIVATE object in the interactivity), thereby facilitating the acquisition of the object to be rendered with specific properties based on the function.

[0069] Optionally, the functional function includes a first variable and a second variable;

[0070] The first variable is used to indicate a specific attribute, and the second variable includes at least one object.

[0071] For example, the specific attribute is a specific state or a specific LOD.

[0072] When the specific attribute corresponds to an enabled value (such as ENABLED=0), at least one object included in the second variable is used as a rendering object; when the specific attribute corresponds to a disabled value (such as DISABLED=1), at least one object included in the second variable is not used as a rendering object.

[0073] Optionally, the functional function includes a first functional function or a second functional function;

[0074] The first function is used to determine the object to be rendered according to a specific state, wherein the specific state includes an activated state or a deactivated state;

[0075] The second function is used to determine the object to be rendered according to a specific LOD.

[0076] Exemplarily, the first function includes an activation function or a deactivation function, and an object list exists in the function, that is, the first function includes a specific state variable and an object list variable.

[0077] Exemplarily, the first function is used to activate or deactivate avatar meshes of different fineness corresponding to the node object.

[0078] The second function mentioned above can also be described as an LOD selection function, which is used to select an object corresponding to a target LOD from a group of objects so as to facilitate rendering by a rendering engine or a display engine.

[0079] As an implementation method, an LOD identification attribute is introduced into the object, and the rendering engine or the display engine determines whether to process the corresponding object based on the LOD identification detected by the second function.

[0080] The second function includes a specific LOD identifier (or a target LOD identifier) ​​and an object list variable, and the rendering engine renders the object including the target LOD identifier.

[0081] Optionally, in an embodiment of the present application, the rendering engine determines LOD information in metadata of the generated tactile signal according to the LOD associated with the avatar object.

[0082] In the embodiment of the present application, the definition of the functional function may refer to the definition of ACTION_ACTIVATE in Table 1.

[0083] Optionally, determining the object to be rendered according to the second attribute information of the object includes:

[0084] determining the priority of the object according to the second attribute information;

[0085] The high-priority object is determined as the object to be rendered.

[0086] In the embodiment of the present application, the priority of an object is proportional to the LOD of the object, that is, the higher the LOD value of the object, the higher the priority of the object. The above-mentioned high-priority object is an object with an LOD value higher than the preset LOD value.

[0087] Exemplarily, based on the second attribute information, the LOD of the object is determined. The higher the LOD value, the higher the priority of the object. For example, the priority corresponding to a high-fineness LOD object is higher than the priority corresponding to a low-fineness LOD object. When determining the object to be rendered, the object corresponding to the high-fineness LOD is determined as the object to be rendered.

[0088] For example, objects corresponding to high-precision LOD are in an activated state, and objects corresponding to low-precision LOD are in a deactivated state. The rendering engine or display engine only processes objects in the activated state, that is, treats objects in the activated state as objects to be rendered.

[0089] Optionally, the sensor-related information includes at least one of positioning accuracy information of the position sensor and position distribution information of the sensor. Optionally, the positioning accuracy-related information includes at least one of the following: angular positioning accuracy and position positioning accuracy.

[0090] The sensor in the embodiment of the present application is a sensor used by an end user or an avatar. Optionally, there is a mapping relationship between the positioning accuracy related information and the LOD of the object. This mapping relationship can be configured by the rendering engine.

[0091] In an embodiment of the present application, the rendering end selects an object to be rendered from multiple objects based on sensor-related information. For example, according to the positioning accuracy information of the position sensor, the target LOD is determined, and then the object to be processed is selected according to the target LOD.

[0092] Optionally, the method of the embodiment of the present application further includes:

[0093] Acquire the sensor-related information through the third attribute (glTF attribute) information;

[0094] The third attribute information includes at least one of the following:

[0095] Type of device, for example, including position sensor, rotation angle sensor, etc.;

[0096] Device capabilities, such as the device's positioning accuracy, positioning method, and positioning latency;

[0097] Sensor type;

[0098] Sensor accuracy.

[0099] As an implementation, the third attribute information is carried by a glTF object. The glTF object can be a first object whose determination as a to-be-rendered object is needed, an object other than the first object, an object associated with the first object, or a preset object (e.g., an avatar node or avatar sub-node). The third attribute information is used at least for information exchange with the rendering engine.

[0100] Optionally, the location distribution information includes at least one of the following:

[0101] The body part mapped by the sensor, which can be a body part mask, a body part target, etc.

[0102] The vertices, surfaces, or primitives of the graphics that the sensor maps.

[0103] It should be noted that the method of the embodiment of the present application is applicable to scenarios other than tactile scenarios, for example, audio scenarios or video scenarios.

[0104] In the solution of the embodiment of the present application, the rendering end determines the object to be rendered based on at least one of the following: the first attribute information of the object, the first attribute information includes a state attribute; the second attribute information of the object, the second attribute information includes a detail level LOD attribute or an attribute related to the LOD attribute; sensor-related information; a function function, the function function is used to determine the object to be rendered based on a specific attribute. Through the above solution, objects with specific attributes can be screened out as objects to be rendered, so that only objects with specific attributes can be rendered, such as only rendering objects that match the current sensor resources. This can effectively reduce the difference in movement between the virtual geometric shapes of the source objects and avatars in the virtual world and the objects in the real world, so that the movement of the virtual geometric shapes of the source objects and avatars in the virtual world is more coordinated with the movement of objects in the real world.

[0105] The rendering object determination method provided in the embodiment of the present application can be executed by a rendering object determination device. In the embodiment of the present application, the rendering object determination device performing the rendering object determination method is used as an example to illustrate the rendering object determination device provided in the embodiment of the present application.

[0106] As shown in FIG2 , an embodiment of the present application provides a rendering object determination device 200, including:

[0107] The determination module 201 is configured to determine an object to be rendered based on at least one of the following:

[0108] First attribute information of the object, the first attribute information including a state attribute;

[0109] Second attribute information of the object, the second attribute information including a level of detail (LOD) attribute or an attribute related to the LOD attribute;

[0110] Sensor related information;

[0111] A function is used to determine an object to be rendered according to specific attributes.

[0112] Optionally, the device of the embodiment of the present application further includes:

[0113] The rendering module is used to render the object to be rendered.

[0114] Optionally, the determination module is used to directly monitor the functional function to obtain the object to be rendered.

[0115] Optionally, the determining module is used to directly monitor the function according to the identification information of the function to obtain the object to be rendered;

[0116] The identification information is used to indicate that the functional function is directly monitored by the rendering engine or the display engine.

[0117] Optionally, the functional function includes a first variable and a second variable;

[0118] The first variable is used to indicate a specific attribute, and the second variable includes at least one object.

[0119] Optionally, the functional function includes a first functional function or a second functional function;

[0120] The first function is used to determine the object to be rendered according to a specific state, wherein the specific state includes an activated state or a deactivated state;

[0121] The second function is used to determine the object to be rendered according to a specific LOD.

[0122] Optionally, the determining module includes:

[0123] a first determining submodule, configured to determine a priority of an object according to the second attribute information;

[0124] The second determining submodule is configured to determine the high-priority object as the object to be rendered.

[0125] Optionally, the sensor-related information includes at least one of positioning accuracy-related information of the position sensor and position distribution information of the sensor.

[0126] Optionally, there is a mapping relationship between the positioning accuracy related information and the LOD of the object.

[0127] Optionally, the device of the embodiment of the present application further includes:

[0128] An acquisition module, configured to acquire the sensor-related information through third attribute information;

[0129] The third attribute information includes at least one of the following:

[0130] Type of equipment;

[0131] Equipment capabilities;

[0132] Sensor type;

[0133] Sensor accuracy.

[0134] Optionally, the location distribution information includes at least one of the following:

[0135] the object portion of the sensor map;

[0136] The vertices, surfaces, or primitives of the graphic that the sensor maps.

[0137] The device of the embodiment of the present application determines the object to be rendered based on at least one of the following: first attribute information of the object, the first attribute information including a state attribute; second attribute information of the object, the second attribute information including a detail level LOD attribute or an attribute related to the LOD attribute; sensor-related information; a function function, the function function being used to determine the object to be rendered based on a specific attribute. The above scheme can filter out objects with specific attributes as objects to be rendered, so that only objects with specific attributes can be rendered, such as only rendering objects that match the current sensor resources, thereby effectively reducing the difference in movement between the virtual geometric shapes of the source objects and avatars in the virtual world and the objects in the real world, so that the movement of the virtual geometric shapes of the source objects and avatars in the virtual world is more coordinated with the movement of objects in the real world.

[0138] The rendering object determination device provided in the embodiment of the present application can implement each process implemented by the method embodiment of Figure 1 and achieve the same technical effect. To avoid repetition, it will not be described here.

[0139] Optionally, as shown in Figure 3, an embodiment of the present application also provides an electronic device 300, including a processor 301 and a memory 302, and the memory 302 stores programs or instructions that can be run on the processor 301. For example, when the electronic device 300 is a terminal, the program or instruction is executed by the processor 301 to implement the various steps of the above-mentioned rendering object determination method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0140] The present application also provides an electronic device including a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is configured to execute a program or instruction to implement the steps in the method embodiment shown in FIG1 . This device embodiment corresponds to the above-described method embodiment, and each implementation process and implementation method of the above-described method embodiment are applicable to this electronic device embodiment and can achieve the same technical effects.

[0141] The electronic device may be a terminal, or may be other devices other than a terminal, such as a server, a network attached storage (NAS), etc.

[0142] Among them, the terminal can be a mobile phone, tablet personal computer, laptop computer, notebook computer, personal digital assistant (PDA), handheld computer, netbook, ultra-mobile personal computer (UMPC), mobile Internet device (MID), augmented reality (AR), virtual reality (VR) equipment, mixed reality (MR) equipment, robot, wearable device, flight vehicle, vehicle user equipment (VUE), shipborne equipment, pedestrian user equipment (PUE), smart home (home appliances with wireless communication function, such as refrigerator, TV, washing machine or furniture, etc.), game console, personal computer (PC), ATM or self-service machine and other terminal-side devices. Wearable devices include: smart watches, smart bracelets, smart headphones, smart glasses, smart jewelry (smart bracelets, smart bracelets, smart rings, smart necklaces, smart anklets, smart anklets, etc.), smart wristbands, smart clothing, etc. Among them, vehicle-mounted devices can also be called vehicle-mounted terminals, vehicle-mounted controllers, vehicle-mounted modules, vehicle-mounted components, vehicle-mounted chips, or vehicle-mounted units, etc. It should be noted that the specific type of terminal is not limited in the embodiments of this application.

[0143] The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that can provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), or cloud computing services based on big data and artificial intelligence platforms.

[0144] Taking an electronic device as a terminal as an example, FIG4 is a schematic diagram of the hardware structure of a terminal implementing an embodiment of the present application.

[0145] The terminal 400 includes but is not limited to: a radio frequency unit 401, a network module 402, an audio output unit 403, an input unit 404, a sensor 405, a display unit 406, a user input unit 407, an interface unit 408, a memory 409 and at least some of the components of the processor 410.

[0146] Those skilled in the art will appreciate that terminal 400 may further include a power source (e.g., a battery) to power various components. The power source may be logically connected to processor 410 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The terminal structure shown in FIG4 does not limit the terminal. The terminal may include more or fewer components than shown, or may combine certain components or arrange the components differently, which will not be described in detail here.

[0147] It should be understood that in the embodiment of the present application, the input unit 404 may include a graphics processing unit (GPU) 4041 and a microphone 4042. The graphics processor 4041 processes the image data of a static picture or video obtained by an image acquisition device (such as a camera) in a video acquisition mode or an image acquisition mode, or may process the obtained point cloud data. The display unit 406 may include a display panel 4061, which may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 407 includes a touch panel 4071 and at least one of other input devices 4072. The touch panel 4071 is also called a touch screen. The touch panel 4071 may include two parts: a touch detection device and a touch controller. Other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0148] In the embodiment of the present application, after receiving downlink data from a network-side device, the radio frequency unit 401 may transmit the data to the processor 410 for processing. Furthermore, the radio frequency unit 401 may send uplink data to the network-side device. Typically, the radio frequency unit 401 includes, but is not limited to, an antenna, an amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and the like.

[0149] The memory 409 can be used to store software programs or instructions and various data. The memory 409 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 409 may include a volatile memory or a non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 409 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0150] Processor 410 may include one or more processing units. Optionally, processor 410 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 410.

[0151] The processor 410 is configured to determine an object to be rendered based on at least one of the following:

[0152] First attribute information of the object, the first attribute information including a state attribute;

[0153] Second attribute information of the object, the second attribute information including a level of detail (LOD) attribute or an attribute related to the LOD attribute;

[0154] Sensor related information;

[0155] A function is used to determine an object to be rendered according to specific attributes.

[0156] Optionally, the processor 410 is further configured to:

[0157] The functional function is directly monitored to obtain the object to be rendered.

[0158] Optionally, the processor 410 is further configured to:

[0159] According to the identification information of the function, the function is directly monitored to obtain an object to be rendered;

[0160] The identification information is used to indicate that the functional function is directly monitored by the rendering engine or the display engine.

[0161] Optionally, the functional function includes a first variable and a second variable;

[0162] The first variable is used to indicate a specific attribute, and the second variable includes at least one object.

[0163] Optionally, the functional function includes a first functional function or a second functional function;

[0164] The first function is used to determine the object to be rendered according to a specific state, wherein the specific state includes an activated state or a deactivated state;

[0165] The second function is used to determine the object to be rendered according to a specific LOD.

[0166] Optionally, the processor 410 is further configured to:

[0167] determining the priority of the object according to the second attribute information;

[0168] The high-priority object is determined as the object to be rendered.

[0169] Optionally, the processor 410 is further configured to: the sensor-related information includes at least one of positioning accuracy-related information of the position sensor and position distribution information of the sensor.

[0170] Optionally, the processor 410 is further configured to: establish a mapping relationship between the positioning accuracy related information and the LOD of the object.

[0171] Optionally, the processor 410 is further configured to obtain the sensor-related information through third attribute information;

[0172] The third attribute information includes at least one of the following:

[0173] Type of equipment;

[0174] Equipment capabilities;

[0175] Sensor type;

[0176] Sensor accuracy.

[0177] Optionally, the processor 410 is further configured to: the location distribution information includes at least one of the following:

[0178] the object portion of the sensor map;

[0179] The vertices, surfaces, or primitives of the graphic that the sensor maps.

[0180] In an embodiment of the present application, the rendering end determines the object to be rendered based on at least one of the following: first attribute information of the object, the first attribute information including a state attribute; second attribute information of the object, the second attribute information including a detail level LOD attribute or an attribute related to the LOD attribute; sensor-related information; a function function, the function function being used to determine the object to be rendered based on a specific attribute. Through the above scheme, objects with specific attributes can be screened out as objects to be rendered, so that only objects with specific attributes can be rendered, such as only rendering objects that match the current sensor resources, thereby effectively reducing the difference in movement between the virtual geometric shapes of the source objects and avatars in the virtual world and the objects in the real world, so that the movement of the virtual geometric shapes of the source objects and avatars in the virtual world is more coordinated with the movement of the objects in the real world.

[0181] It can be understood that the implementation process of each implementation method mentioned in this embodiment can refer to the relevant description of the method for determining the rendering object in the method embodiment, and achieve the same or corresponding technical effects. To avoid repetition, it will not be repeated here.

[0182] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned rendering object determination method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0183] The processor is the processor in the terminal described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk. In some examples, the readable storage medium may be a non-transitory readable storage medium.

[0184] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned rendering object determination method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0185] It should be understood that the chip mentioned in the embodiments of the present application may include a system-level chip (also referred to as a system chip, a chip system or a system-on-chip chip), and may also include an independent display chip, etc.

[0186] An embodiment of the present application further provides a computer program / program product, which is stored in a storage medium. The computer program / program product is executed by at least one processor to implement the various processes of the above-mentioned rendering object determination method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0187] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0188] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of a computer software product plus a necessary general-purpose hardware platform, or of course, by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.) and includes a number of instructions for enabling a terminal or network-side device to execute the methods described in each embodiment of the present application.

[0189] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms of implementation methods without departing from the purpose of this application and the scope of protection of the claims. These implementation methods are all within the protection of this application.

Claims

1. A method for determining a rendering object, executed by a rendering end, the method comprising: The object to be rendered is determined based on at least one of the following: First attribute information of the object, the first attribute information comprising a state attribute; Second attribute information of the object, the second attribute information including a level of detail (LOD) attribute or an attribute related to the LOD attribute; Sensor related information; A function is used to determine an object to be rendered according to a specific attribute.

2. The method according to claim 1, wherein: Determine the object to be rendered based on the function, including: The functional function is directly monitored to obtain the object to be rendered.

3. The method according to claim 2, wherein: The functional function is directly monitored to obtain the object to be rendered, including: According to the identification information of the function function, the function function is directly monitored to obtain an object to be rendered; The identification information is used to indicate that the functional function is directly monitored by the rendering engine or the display engine.

4. The method according to claim 2 or 3, wherein: The functional function includes a first variable and a second variable; The first variable is used to indicate a specific attribute, and the second variable includes at least one object.

5. The method according to any one of claims 1 to 4, wherein: The functional function includes a first functional function or a second functional function; Wherein, the first function is used to determine the object to be rendered according to a specific state, and the specific state includes an activated state or a deactivated state; The second function is used to determine the object to be rendered according to a specific LOD.

6. The method according to claim 1, wherein: Determining the object to be rendered according to the second attribute information of the object includes: determining the priority of the object according to the second attribute information; The high priority object is determined as the object to be rendered.

7. The method according to claim 1, wherein: The sensor-related information includes at least one of information related to the positioning accuracy of the position sensor and position distribution information of the sensor.

8. The method according to claim 7, wherein: There is a mapping relationship between the positioning accuracy related information and the LOD of the object.

9. The method according to claim 7 or 8, further comprising: Acquire the sensor related information through the third attribute information; The third attribute information includes at least one of the following: Type of equipment; Equipment capabilities; Sensor type; Sensor accuracy.

10. The method according to claim 7, wherein: The location distribution information includes at least one of the following: The object portion of the sensor map; The vertices, surfaces, or primitives of a graphic that the sensor maps.

11. A device for determining a rendering object, comprising: The determination module is used to determine the object to be rendered according to at least one of the following: First attribute information of the object, the first attribute information comprising a state attribute; Second attribute information of the object, the second attribute information including a level of detail (LOD) attribute or an attribute related to the LOD attribute; Sensor related information; A function is used to determine an object to be rendered according to a specific attribute.

12. The device according to claim 11, wherein The determination module is used to directly monitor the functional function to obtain the object to be rendered.

13. The device according to claim 12, wherein: The determination module is used to directly monitor the function function according to the identification information of the function function to obtain the object to be rendered; The identification information is used to indicate that the functional function is directly monitored by the rendering engine or the display engine.

14. The device according to claim 12 or 13, wherein: The functional function includes a first variable and a second variable; The first variable is used to indicate a specific attribute, and the second variable includes at least one object.

15. The device according to any one of claims 11 to 14, wherein: The functional function includes a first functional function or a second functional function; Wherein, the first function is used to determine the object to be rendered according to a specific state, and the specific state includes an activated state or a deactivated state; The second function is used to determine the object to be rendered according to a specific LOD.

16. The device according to claim 11, wherein The determination module comprises: A first determination submodule, configured to determine a priority of an object according to the second attribute information; The second determining submodule is used to determine the high-priority object as the object to be rendered.

17. The device according to claim 11, wherein: The sensor-related information includes at least one of information related to the positioning accuracy of the position sensor and position distribution information of the sensor.

18. The device according to claim 17, wherein: There is a mapping relationship between the positioning accuracy related information and the LOD of the object.

19. The apparatus according to claim 17 or 18, further comprising: An acquisition module, used for acquiring the sensor related information through the third attribute information; The third attribute information includes at least one of the following: Type of equipment; Equipment capabilities; Sensor type; Sensor accuracy.

20. The device according to claim 17, wherein: The location distribution information includes at least one of the following: The object portion of the sensor map; The vertices, surfaces, or primitives of a graphic that the sensor maps.

21. An electronic device comprising a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method for determining a rendering object as described in any one of claims 1 to 10 are implemented.

22. A readable storage medium storing a program or an instruction, wherein the program or the instruction, when executed by a processor, implements the steps of the method for determining a rendering object according to any one of claims 1 to 10.

23. A chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or an instruction to implement the steps of the method for determining a rendering object according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Realistic occlusion for a head mounted augmented reality display

    CN103472909A

  • Virtual vegetation rendering method and device, storage medium and electronic equipment

    CN110288688A

  • Virtual object rendering method and device, computer equipment and storage medium

    CN112370783A

  • Representation formats for haptic objects

    CN116601587A

  • Continuous and dynamic level of detail for efficient point cloud object rendering

    US20140198097A1