Rendering method and apparatus, and device

Abstract

The present application relates to the technical field of computers, and discloses a rendering method and apparatus, and a device. The rendering method of the present application comprises: a first device acquires first information, the first information being information related to the conduction of a haptic signal; and the first device performs rendering on the basis of the first information.

Description

Rendering methods, devices and equipment

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202510005105.4, filed in China on January 2, 2025, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application belongs to the field of communication technology, and specifically relates to a rendering method, apparatus and device. Background Technology

[0004] The relevant technologies support basic haptic rendering functionality. For example, the rendering engine can render haptic scenes based on Graphics Language Transmission Format (glTF) files. However, in haptic scenes, for signal sources that the avatar does not actually touch, the engine cannot generate haptic feedback from the avatar to that signal source, resulting in poor realism in the rendered haptic scenes. Summary of the Invention

[0005] This application provides a rendering method, apparatus, and device that can solve the problem of poor realism in rendered tactile scenes.

[0006] Firstly, a rendering method is provided, which includes:

[0007] The first device acquires first information, which is information related to the transmission of tactile signals;

[0008] The first device renders based on the first information.

[0009] Secondly, a rendering apparatus is provided, comprising:

[0010] The processing module is used to acquire first information, which is information related to the transmission of tactile signals;

[0011] The processing module is also used to: perform rendering based on the first information.

[0012] Thirdly, a rendering apparatus is provided, the apparatus being configured to perform the steps of the method described in the first aspect.

[0013] Fourthly, an electronic device is provided, comprising a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method described in the first aspect.

[0014] Fifthly, an electronic device is provided, including a processor and a communication interface, wherein,

[0015] A processor is configured to acquire first information, which is information related to the transmission of tactile signals;

[0016] The processor is also used to: perform rendering based on the first information.

[0017] In a sixth aspect, a readable storage medium is provided, on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.

[0018] In a seventh aspect, a chip is provided, the chip including a processor and a communication interface coupled to the processor, the processor being used to run programs or instructions to implement the steps of the method described in the first aspect.

[0019] Eighthly, a computer program / program product is provided, the computer program / program product being stored in a storage medium, the computer program / program product being executed by at least one processor to implement the method as described in the first aspect.

[0020] A ninth aspect provides an electronic device configured to perform the rendering method as described in the first aspect.

[0021] In this embodiment, the first device acquires first information, which is information related to the transmission of tactile signals; the first device performs rendering based on the first information. Thus, rendering based on information related to the transmission of tactile signals allows for consideration of tactile transmission characteristics during rendering, thereby improving the realism of the rendered tactile scene. Attached Figure Description

[0022] Figure 1 is a flowchart of a rendering method provided in an embodiment of this application;

[0023] Figure 2 is a schematic diagram of a rendering device provided in an embodiment of this application;

[0024] Figure 3 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0025] Figure 4 is a schematic diagram of the structure of a terminal provided in an embodiment of this application. Detailed Implementation

[0026] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0027] The terms "first," "second," etc., used in this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same class, not limited in number; for example, the first object can be one or more. Furthermore, "or" in this application indicates at least one of the connected objects. For example, the scope of protection for "A or B" covers at least three scenarios: Scenario 1: including A but not B; Scenario 2: including B but not A; Scenario 3: including both A and B. In addition, the terms "A and / or B," "at least one of A and B," and "at least one of A or B" also cover at least the above three scenarios. The character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0028] The term "instruction" in this application can be either a direct instruction (or explicit instruction) or an indirect instruction (or implicit instruction). A direct instruction can be understood as the sender explicitly informing the receiver of specific information, the required operation, or the requested result in the instruction sent. An indirect instruction can be understood as the receiver determining the corresponding information based on the instruction sent by the sender, or making a judgment and determining the required operation or requested result based on the judgment result.

[0029] For ease of understanding, the following explains some aspects of the embodiments of this application:

[0030] Interactivity extension in scene description of the Moving Pictures Experts Group (MPEG) Graphics Language Transmission Format (glTF):

[0031] glTF is a storage format for 3D models and scenes. It uses JSON-formatted text files to store individual elements and the relationships between them, and supports extensions, using binary files to store resources such as meshes. glTF can also be further binary-coded, storing scene description information in binary files to further compress space usage and facilitate network transmission and rendering.

[0032] MPEG extends the interactive functionality of glTF scene description (MPEG_scene_interactivity), using various triggers and actions to describe triggering conditions and execution actions. Triggers and actions are combined through behaviors to achieve rich and diverse interactive logic. Among the actions, one type is SetHapticAction, which supports basic haptic output.

[0033] The rendering method, apparatus, and related equipment provided in this application will be described in detail below with reference to the accompanying drawings and through some embodiments and application scenarios.

[0034] Referring to Figure 1, which is a flowchart of a rendering method provided in an embodiment of this application, the rendering method includes the following steps:

[0035] Step 101: The first device acquires first information, which is information related to the transmission of tactile signals;

[0036] Step 102: The first device renders based on the first information.

[0037] The first information is information related to the conduction of tactile signals. It can also be expressed as the first information being information related to describing the conduction of tactile signals, or the first information being information related to processing the conduction of tactile signals, or the first information being related to the conduction of tactile signals, or the first information being used to process the conduction of tactile signals, or the first information being used to describe or characterize the conduction of tactile signals.

[0038] The first information can be glTF attribute information, which is related information about the conductive object used to conduct tactile signals.

[0039] In one embodiment, the first information may be related information about the target object, which is used to characterize the conductive object.

[0040] In one embodiment, the first information may be carried by a target object, which may include objects related to tactile signal transmission, objects related to tactile sources, objects related to tactile feedback reception, or objects related to tactile actions, etc. This embodiment does not limit this.

[0041] In this embodiment, the target object can be a scene-level glTF extension or a node-level glTF extension. Optionally, if a haptic signal transmission-related object is introduced, the target object can be a scene-level extension; if a haptic source-related object carrying the first information is introduced, the haptic source-related object can also be a scene-level extension or a node-level extension; if a haptic feedback receiving-related object is introduced, the object can also be a scene-level extension or a node-level extension; if an extension is made based on a haptic action-related object, the target object is a node-level extension. Furthermore, the first information can be used as attribute information under an existing glTF extension, for example, adding attribute information related to the first information under a haptic action-related extension, adding attribute information related to the first information under an avatar-related extension, etc. Additionally, the haptic feedback receiving-related object can also be an existing object, such as a camera object, an avatar object, etc.

[0042] In one implementation, the first device acquiring the first information may include:

[0043] The first device obtains the first information from the attribute information of the graphical language transmission format glTF.

[0044] In one implementation, the first device obtains first information from glTF attribute information, including:

[0045] The first device obtains the objects related to tactile signal transmission from the glTF attribute information;

[0046] The object related to the tactile signal transmission carries the first information.

[0047] In one implementation, the first device obtains first information from glTF attribute information, including:

[0048] The first device obtains the haptic source-related objects from the glTF attribute information;

[0049] The tactile source-related object carries the first information.

[0050] It should be noted that the tactile signal transmission related object can also be described as a tactile source related object, such as an indirect tactile source object, where the generation of tactile signals on the indirect tactile source depends on other tactile source objects.

[0051] Optionally, the aforementioned tactile signal starting to be transmitted on the conductive object can be understood as the indirect tactile source starting to generate tactile signals.

[0052] In one implementation, the first device obtains first information from glTF attribute information, including:

[0053] The first device obtains haptic feedback from the glTF attribute information and receives relevant objects (such as avatars);

[0054] The tactile feedback receives the first information carried by the relevant object.

[0055] In one implementation, the first device obtains first information from glTF attribute information, including:

[0056] The first device obtains tactile motion-related objects from the glTF attribute information;

[0057] The tactile action-related object carries the first information.

[0058] In one embodiment, the first device rendering based on the first information may mean that the first device performs rendering processing based on the first information.

[0059] It's important to note that tactile conduction is a ubiquitous scenario. For example, the human body can feel temperature when in contact with a heat source (in this case, the tactile signal is a temperature signal), and can also feel temperature when indirectly in contact with a heat source through a medium. The rate at which the medium changes temperature varies depending on the material; for instance, heating a metal sheet typically occurs faster than heating water. After being removed from the heat source, the medium gradually warms to ambient temperature. Currently, the MPEG glTF extension does not support tactile conduction characteristics. MPEG_scene_interactivity cannot render tactile signals based on their conduction characteristics, thus failing to realistically reproduce application scenarios such as heat conduction.

[0060] This application embodiment sets first information (such as glTF related attribute information), which is related information for processing tactile signal transmission, so that tactile signals can be rendered based on the transmission characteristics of tactile signals, and the application scenario can be restored more realistically.

[0061] In this embodiment, the first device acquires first information, which is information related to the transmission of tactile signals; the first device performs rendering based on the first information. Thus, rendering based on information related to the transmission of tactile signals allows for consideration of tactile transmission characteristics during rendering, thereby improving the realism of the rendered tactile scene.

[0062] Optionally, the first information includes at least one of the following:

[0063] Transmits information related to the geometry of the object;

[0064] Information related to tactile signal modes;

[0065] Target signal strength;

[0066] Tactile signal transduction factor;

[0067] Relevant information about the tactile signal transmission correlation function;

[0068] Information related to the tactile source associated with tactile signal transmission;

[0069] Tactile signal transmission triggers related identifiers;

[0070] Information related to the triggering method of tactile signal transmission;

[0071] Information related to the triggering method of tactile signal feedback;

[0072] Haptic feedback receives the identifier of the relevant object;

[0073] Information related to the location of tactile feedback;

[0074] Information related to the attenuation of tactile signals as they propagate through a medium.

[0075] The information related to the geometry of the conductive object may include information indicating the geometry of the conductive object, such as: sphere, cube, capsule, primitive, mesh, etc.

[0076] The relevant information of the tactile signal mode can be used to indicate the tactile mode corresponding to the tactile signal transmission, such as heat, vibration, etc. For example, the relevant information of the tactile signal mode may include a tactile signal mode identifier or a tactile signal mode indicator.

[0077] The target signal strength may include at least one of a first target signal strength and a second target signal strength. The first target signal strength is greater than the second target signal strength.

[0078] In one implementation, the first target signal strength can be used to indicate the maximum signal strength that the conductive object can achieve. Taking the tactile signal as a temperature signal as an example, the maximum signal strength can be the maximum temperature value that the conductive object can reach.

[0079] It should be noted that, if the first target signal strength is defaulted, the first target signal strength (upper limit) can be obtained based on the signal strength of the tactile source and the interaction-related attributes between the transmitting object and the tactile source; or, if the first target signal strength is defaulted, the first target signal strength (upper limit) can be determined by the default signal strength in the environment, for example, the first target signal strength is the maximum value of the default signal strength in the environment.

[0080] In addition, the attribute information of the first target signal strength can be applied to some tactile modalities.

[0081] In addition, the attribute information of the first target signal strength can be set independently for specific tactile modalities, such as temperature.

[0082] In one embodiment, the second target signal strength can be used to indicate the minimum signal strength that the conductive object can achieve. Taking the tactile signal as a temperature signal as an example, the second target signal strength can be the minimum temperature value that the conductive object can reach.

[0083] It should be noted that, when the second target signal strength is defaulted, the second target signal strength (intensity lower limit) can be obtained based on the signal strength of the tactile source and the interaction-related attributes between the transmitting object and the tactile source; or, when the second target signal strength is defaulted, the second target signal strength (intensity lower limit) can be determined by the default signal strength in the environment, for example, the second target signal strength is the minimum value of the default signal strength in the environment.

[0084] In addition, the attribute information of the second target signal strength can be applied to some tactile modalities, such as temperature.

[0085] In addition, the attribute information of the second target signal strength can be set independently for specific tactile modalities, such as temperature.

[0086] The tactile signal transmission factor can include the transmission factor associated with the target object, and the tactile signal transmission factor can be applied to the tactile transmission function.

[0087] In addition, the tactile signal transmission factor can be applied to some tactile modalities, such as temperature (the transmission factor related to temperature transmission can be thermal conductivity).

[0088] In addition, the tactile signal transmission factor can be set independently for specific tactile modalities, such as temperature.

[0089] Among them, the relevant information of the tactile signal transmission correlation function may include information about the transmission function associated with the target object.

[0090] It should be noted that by using the relevant information of the tactile signal transmission correlation function, the increment or decrement of the tactile signal, or the tactile signal value, can be obtained.

[0091] In addition, the relevant information of the tactile signal transmission correlation function can be applied to some tactile modalities, such as temperature.

[0092] In addition, the relevant information of the tactile signal transmission correlation function can be set independently for specific tactile modalities, such as temperature.

[0093] The information related to the tactile sources associated with tactile signal transmission may include information indicating the tactile sources associated with the target object. This information can be used to identify which tactile sources the transmitting object is used to transmit tactile signals from. For example, the information related to the tactile sources associated with tactile signal transmission may be a tactile signal source identifier.

[0094] For example, the data type of information related to the tactile source associated with the tactile signal transmission can be an array type or an integer type.

[0095] For example, the relevant information about the tactile source associated with the tactile signal transmission can be the identifier of the tactile source node.

[0096] It should be noted that, if the relevant information of the tactile source associated with the tactile signal transmission is missing, the rendering engine can find the tactile source associated with the transmitting object based on the location information or modal information of the tactile source in the scene.

[0097] The tactile signal conduction trigger related identifier may include a conduction trigger identifier associated with the target object, which can be used to identify whether the conducting object has started to conduct signals emitted by the tactile source.

[0098] It should be noted that if the first information is carried by the object related to the tactile source, the tactile signal conduction trigger related identifier can identify whether the tactile source is activated. If the conduction trigger considers the tactile source to be activated, the rendering engine can perform tactile rendering based on the activated tactile source.

[0099] The information related to the triggering method of tactile signal transmission may include information indicating the interaction method between the target object and the tactile source, or it may be described as information related to the interaction between the transmitting object and the tactile source, which can be used to indicate how to trigger tactile signal transmission.

[0100] For example, the interaction between a conductive object and a tactile source can include collision, contact, or proximity, etc.

[0101] The triggering method information for tactile signal feedback may include information indicating the interaction method between the target object and the second tactile feedback receiving object, and can be used to indicate how to trigger tactile signal feedback based on the conductive object. Taking the second tactile feedback receiving object as an avatar as an example, the triggering method information for tactile signal feedback may be interaction information between the conductive object and the avatar.

[0102] In addition, the interaction between the conductive object and the avatar can include collision, contact, approach, etc.

[0103] Among them, the identifier of the tactile feedback receiving related object can be an avatar identifier, and the tactile signal feedback acting on the avatar is triggered according to the conductive object.

[0104] It should be noted that, with the identifier of the haptic feedback receiving object (such as an avatar identifier) ​​defaulting, the rendering engine can render haptic signals based on the positional information or associated modal information of the second haptic feedback receiving object (such as an avatar) and the conductive object in the scene. For example, the rendering engine can use an avatar in contact with the conductive object in the scene as the second haptic feedback receiving object.

[0105] The location-related information for haptic feedback may include information indicating the actuator associated with the target object. This location-related information can refer to body part information or actuator information. The body part information or actuator information can be used to indicate the location of the haptic feedback.

[0106] The attenuation-related information of the tactile signal propagating in the medium may include attenuation information of the tactile signal associated with the target object in the medium. For example, it may be the signal attenuation information associated with the continued propagation of the tactile signal radiated from the conductive object in the air.

[0107] Based on the aforementioned first information, this application embodiment defines a scene description format for tactile conduction characteristics.

[0108] Optionally, the relevant information of the tactile signal transduction correlation function is associated with at least one of the following:

[0109] Time; the tactile signal transmission factor; the target signal intensity.

[0110] The relevant information of the tactile signal transmission correlation function can be used to obtain the increment or decrement of the tactile signal, or the tactile signal value.

[0111] For example, for temperature conduction, the temperature increment or decrement can be: thermal conductivity * temperature difference * time length * 2 / (target temperature + current temperature).

[0112] Optionally, the first information is carried by a target object, which includes at least one of the following:

[0113] Objects related to tactile signal transmission;

[0114] Tactile source related objects;

[0115] Haptic feedback is received from the relevant object;

[0116] Objects related to tactile movements.

[0117] Optionally, the target object also carries second information, which includes at least one of the following:

[0118] The identifier of the target object;

[0119] Information about the activation status of the target object.

[0120] In one embodiment, the second information may include an identifier of the target object, used to identify the object as a target object, for example, to identify the object as a tactile signal transmission related object.

[0121] In one implementation, the second information may include information about the activation state of the target object. This activation state information may be an activation identifier or activation indication, etc., and the renderer only needs to process the target object in its active state.

[0122] Optionally, when the target object is the object related to the tactile signal transmission, the first device renders based on the first information, including at least one of the following:

[0123] The first device identifies the objects related to the tactile signal transmission during the rendering process;

[0124] During the rendering process, the first device determines whether the tactile signal transmission related object transmits tactile signals based on the relationship between the second tactile source related object and the tactile signal transmission related object;

[0125] During the rendering process, the first device generates tactile feedback based on the relationship between the tactile signal transmission related object and the second tactile feedback receiving related object.

[0126] For example, a first device (such as the rendering engine of the first device) can identify a tactile signal transmission related object based on the identifier of the tactile signal transmission related object in the first information.

[0127] For example, a first device (such as the rendering engine of the first device) can determine whether a tactile signal transmitting object transmits a tactile signal based on the relationship (e.g., position, modality, etc.) between the tactile source-related object and the tactile signal transmitting-related object.

[0128] For example, a first device (such as a rendering engine of a first device) can generate haptic feedback based on the relationship (e.g., position, modality, etc.) between the haptic signal transmission related object and the haptic feedback receiving related object (such as an avatar related object).

[0129] In this embodiment, when the target object is the tactile signal transmission related object, the first device performs rendering based on the first information, including at least one of the following: the first device identifies the tactile signal transmission related object during rendering; the first device determines whether the tactile signal transmission related object transmits tactile signals based on the relationship between the second tactile source related object and the tactile signal transmission related object during rendering; the first device generates tactile feedback based on the relationship between the tactile signal transmission related object and the second tactile feedback receiving related object during rendering. This defines rendering behavior related to tactile transmission characteristics when introducing tactile signal transmission related objects to characterize the transmitting object, thus enhancing the transmission object-related object.

[0130] Optionally, when the target object is an object related to the first tactile source, the first device renders based on the first information, including at least one of the following:

[0131] The first device identifies objects related to the first tactile source during the rendering process;

[0132] During the rendering process, the first device generates tactile feedback based on the relationship between the first tactile source-related object and the third tactile feedback receiving-related object.

[0133] For example, a first device (such as the rendering engine of the first device) can identify a haptic source-related object based on the identifier of the haptic source-related object in the first information.

[0134] For example, a first device (such as the rendering engine of the first device) can generate haptic feedback based on the relationship (e.g., position, modality, etc.) between the haptic source-related object and the haptic feedback receiving-related object (such as the avatar-related object).

[0135] In this embodiment, when the target object is the first tactile source-related object, the first device performs rendering based on the first information, including at least one of the following: the first device identifies the first tactile source-related object during the rendering process; the first device generates tactile feedback based on the relationship between the first tactile source-related object and the third tactile feedback receiving related object during the rendering process. This defines the rendering behavior related to tactile conduction characteristics when a tactile source-related object for characterizing the conductive object is introduced, thereby enhancing the tactile source-related object.

[0136] Optionally, when the target object is the object related to the first haptic feedback reception, the first device performs rendering based on the first information, including:

[0137] During the rendering process, the first device generates tactile feedback based on the relationship between the third tactile source-related object and the first tactile feedback receiving-related object.

[0138] For example, a first device (such as the rendering engine of the first device) can generate haptic feedback based on the relationship (e.g., position, modality, etc.) between the haptic source-related object and the haptic feedback receiving-related object (such as the avatar-related object).

[0139] In this embodiment, when the target object is the first haptic feedback receiving related object, the first device performs rendering based on the first information, including: during the rendering process, the first device generates haptic feedback based on the relationship between the third haptic source related object and the first haptic feedback receiving related object. This defines the rendering behavior related to haptic conduction characteristics when introducing haptic feedback receiving related objects to characterize conductive objects, thereby enhancing the haptic feedback receiving related objects.

[0140] Optionally, when the target object is a tactile action-related object, the first device renders based on the first information, including at least one of the following:

[0141] During the rendering process, the first device triggers tactile actions based on the interactive processing model.

[0142] When the tactile motion-related object carries the first information, the first device renders based on the first information in the tactile motion-related object.

[0143] For example, the first device (such as the rendering engine of the first device) can trigger haptic actions based on the interactivity of the model.

[0144] If the object related to haptic action (such as a node related to haptic action) carries the first information, the rendering engine can render according to the first information.

[0145] In this embodiment, when the target object is the tactile motion-related object, the first device renders based on the first information, including at least one of the following: the first device triggers a tactile action based on an interactive processing model during rendering; when the tactile motion-related object carries the first information, the first device renders based on the first information in the tactile motion-related object. This defines rendering behavior related to tactile conduction characteristics when introducing tactile motion-related objects to characterize conduction objects, thereby enhancing the MPEG interactivity processing model.

[0146] The following examples will provide further explanation:

[0147] Example 1:

[0148] This example describes an enhanced conduction-related object based on an audio scene-based processing model.

[0149] The first device acquires first information, which is information related to a target object, and the target object is an object related to tactile signal transmission.

[0150] The tactile signal transmission-related object may carry first information, which may be tactile signal transmission-related characteristics or auxiliary information related to the rendering of the transmission object. The first information includes at least one of the following:

[0151] The identifier of the tactile signal transmission related object is used to identify the object as a tactile signal transmission related object;

[0152] The renderer only needs to process the active state of the tactile signal transmission-related objects, which are the activation identifiers of the objects.

[0153] Transmitting information about the object's properties;

[0154] Transmits attribute information related to the interaction between the object and the tactile source;

[0155] Transmits attribute information related to the interaction between the object and its avatar.

[0156] Among them, the relevant attribute information of the transmitted object includes at least one of the following:

[0157] (1) Transmitting information related to the geometry of an object, such as: sphere, cube, capsule, primitive, mesh, etc.

[0158] (2) Tactile signal modality identifier, used to indicate the tactile mode corresponding to the tactile signal transmission, such as heat, vibration, etc.

[0159] (3) Target signal strength 1 (upper limit of strength) for tactile signal transmission, used to indicate the maximum signal strength that the transmitting object can achieve;

[0160] Optionally, this attribute can be omitted; then, the target signal strength 1 (upper limit of strength) can be obtained based on the signal strength of the tactile source and the interaction-related attributes between the transmitting object and the tactile source.

[0161] Optionally, this attribute can be omitted; in that case, the target signal strength 1 (upper limit) can be determined by the default signal strength in the environment.

[0162] Optionally, this attribute can be applied to some tactile modalities, and / or the attribute can be set independently for specific tactile modalities, such as temperature.

[0163] (4) Target signal strength 2 (lower limit of strength) for tactile signal transmission, used to indicate the minimum signal strength that the transmitting object can achieve.

[0164] Optionally, this attribute can be omitted; then, the target signal strength 2 (lower limit of strength) can be obtained based on the signal strength of the tactile source and the interaction-related attributes between the transmitting object and the tactile source.

[0165] Optionally, this attribute can be omitted; in that case, the target signal strength 2 (lower strength limit) can be determined by the default signal strength in the environment.

[0166] Optionally, this property can be applied to certain tactile modalities, such as temperature.

[0167] Optionally, this attribute can be set independently for a specific tactile modality, such as temperature.

[0168] (5) The conduction factor of tactile signal conduction is applied to the tactile conduction function.

[0169] Optionally, this property can be applied to some tactile modalities, such as temperature (the conduction factor related to temperature conduction can be thermal conductivity).

[0170] Optionally, this attribute can be set independently for a specific tactile modality, such as temperature.

[0171] (6) Functions related to tactile signal transmission.

[0172] Optionally, the increment or decrement of the tactile signal, or the value of the tactile signal, can be obtained through a function related to the transmission of the tactile signal.

[0173] Optionally, the tactile signal transduction-related function is related to at least one of the following:

[0174] Time; the conduction factor; the target signal strength.

[0175] For example, for temperature conduction, the temperature increment or decrement can be: thermal conductivity * temperature difference * time length * 2 / (target temperature + current temperature).

[0176] Optionally, this property can be applied to certain tactile modalities, such as temperature.

[0177] Optionally, this attribute can be set independently for a specific tactile modality, such as temperature.

[0178] Among them, the attribute information related to the interaction between the conductive object and the tactile source may include at least one of the following:

[0179] (1) Tactile signal source identifier, used to identify which tactile sources the conductive object is used to transmit tactile signals.

[0180] Optionally, the data type of the information indicated by this attribute can be array type or int type.

[0181] Optionally, the information indicated by the attribute can be the identifier of the haptic source node.

[0182] Optionally, this attribute can be omitted; in that case, the rendering engine will at least find the tactile source associated with the transmitting object based on the location information or modal information of the tactile source in the scene.

[0183] (2) Tactile signal conduction triggering identifier, used to identify whether the conduction object has started to conduct the signal emitted by the tactile source.

[0184] (3) Transmitting information related to the interaction between the object and the tactile source, which is used to indicate how to trigger the transmission of tactile signals.

[0185] Optionally, the interaction method may include collision, contact, or proximity, etc.

[0186] Among them, the attribute information related to the interaction between the conductive object and the avatar may include at least one of the following:

[0187] (1) Interaction-related information between the conductive object and the avatar, used to indicate how to trigger tactile signal feedback based on the conductive object.

[0188] Optionally, the interaction method may include collision, contact, proximity, etc.

[0189] (2) Avatar identifier, the tactile signal feedback acting on the avatar is triggered by the conductive object.

[0190] Optionally, this attribute can be omitted; in that case, the rendering engine will at least render haptic signals based on the position information / associated modal information of the avatar and the conveying object in the scene.

[0191] (3) Body part information / actuator information, used to indicate the location of tactile feedback.

[0192] (4) Attenuation information of tactile signals in a medium. For example, tactile signals radiated from a conductive object continue to propagate in the air, and the propagation is associated with signal attenuation information.

[0193] It should be noted that the tactile signal transmission related object can also be described as a tactile source related object, such as an indirect tactile source object, where the generation of tactile signals on the indirect tactile source depends on other tactile source objects.

[0194] Optionally, the aforementioned tactile signal starting to be transmitted on the conductive object can be understood as the indirect tactile source starting to generate tactile signals.

[0195] In addition, the rendering engine's processing behavior includes at least one of the following:

[0196] The rendering engine must at least identify the object related to the tactile signal transmission;

[0197] The rendering engine determines whether the object transmitting the tactile signal transmits the tactile signal based on the relationship between the object related to the tactile source and the object related to the tactile signal transmission (such as position, modality, etc.).

[0198] The rendering engine generates haptic feedback based on the relationship between the haptic signal transmission object and the avatar-related object (such as position, modality, etc.).

[0199] Example 2:

[0200] This example describes an audio scene-based processing model that enhances avatar-related objects.

[0201] The tactile signal conduction-related object can also be described as an avatar-related object. For example, an avatar carrying the conduction object is introduced, and the renderer renders the tactile signal based on that avatar.

[0202] Optionally, the avatar-related object carries first information, which may be tactile signal transmission-related characteristics or transmission object rendering-related auxiliary information. The description of the first information can be found in Example 1.

[0203] Optionally, the rendering engine's processing behavior includes:

[0204] The rendering engine generates haptic feedback based on the relationship between the haptic source-related object and the avatar-related object (such as position, modality, etc.).

[0205] In addition, if the avatar-related object carries tactile signal transmission-related characteristics or transmission object rendering-related auxiliary information, the rendering engine performs rendering based on the tactile signal transmission-related characteristics or transmission object rendering-related auxiliary information.

[0206] Example 3:

[0207] This example illustrates an enhancement to the MPEG interactivity processing model.

[0208] Optionally, MPEG interactivity is enhanced by setting sub-objects or attribute information in the haptic action-related node to carry first information. The first information may be haptic signal transmission-related characteristics or auxiliary information related to the rendering of the transmission object. The description of the first information can be found in Example 1.

[0209] Optionally, the rendering engine's processing behavior includes at least one of the following:

[0210] The rendering engine processes the model based on the interaction, triggering a haptic action.

[0211] If the haptic action-related node carries haptic signal transmission characteristics or auxiliary information related to the rendering of the transmission object, the rendering engine will render according to the haptic signal transmission characteristics or auxiliary information related to the rendering of the transmission object.

[0212] This application introduces first information, defines a scene description format for tactile conduction characteristics, and defines rendering behaviors related to tactile conduction characteristics, which can solve the problem that MPEG glTF extensions in related technologies do not support tactile conduction characteristics.

[0213] The rendering method provided in this application can be executed by a rendering device. This application uses the example of a rendering device executing the rendering method to illustrate the rendering apparatus provided in this application.

[0214] This application provides a rendering apparatus. As an example, the rendering apparatus may be a communication device or a component within a communication device, such as a chip. The communication device may be a terminal, a network-side device, or a server, etc.

[0215] The rendering device includes a receiving module, a transmitting module, and a processing module. These modules can be implemented in software or hardware. When implemented in hardware, the processing module can be implemented by a processor. For example, the processor can include general-purpose processors, special-purpose processors, etc., such as central processing units (CPUs), microprocessors, digital signal processors (DSPs), artificial intelligence (AI) processors, graphics processing units (GPUs), application-specific integrated circuits (ASICs), network processors (NPs), field-programmable gate arrays (FPGAs), or other programmable logic devices, gate circuits, transistors, discrete hardware components, etc. The receiving and transmitting modules can be implemented by a communication interface, which can include one or more of the following: transceivers, pins, circuits, buses, radio frequency units, etc.

[0216] Specifically, referring to Figure 2, when the rendering apparatus is a first device or a component of the first device, the rendering apparatus 200 includes:

[0217] Processing module 201 is used to acquire first information, which is information related to the transmission of tactile signals;

[0218] The processing module 201 is further configured to: perform rendering based on the first information.

[0219] Optionally, the first information includes at least one of the following:

[0220] Transmits information related to the geometry of the object;

[0221] Information related to tactile signal modes;

[0222] Target signal strength;

[0223] Tactile signal transduction factor;

[0224] Relevant information about the tactile signal transmission correlation function;

[0225] Information related to the tactile source associated with tactile signal transmission;

[0226] Tactile signal transmission triggers related identifiers;

[0227] Information related to the triggering method of tactile signal transmission;

[0228] Information related to the triggering method of tactile signal feedback;

[0229] Haptic feedback receives the identifier of the relevant object;

[0230] Information related to the location of tactile feedback;

[0231] Information related to the attenuation of tactile signals as they propagate through a medium.

[0232] Optionally, the relevant information of the tactile signal transduction correlation function is associated with at least one of the following:

[0233] Time; the tactile signal transmission factor; the target signal intensity.

[0234] Optionally, the first information is carried by a target object, which includes at least one of the following:

[0235] Objects related to tactile signal transmission;

[0236] The object related to the primary tactile source;

[0237] The first tactile feedback is received from the relevant object;

[0238] Objects related to tactile movements.

[0239] Optionally, the target object also carries second information, which includes at least one of the following:

[0240] The identifier of the target object;

[0241] Information about the activation status of the target object.

[0242] Optionally, when the target object is an object related to the tactile signal transmission, the processing module is specifically used for at least one of the following:

[0243] During the rendering process, the objects related to the transmission of the tactile signals are identified;

[0244] During the rendering process, based on the relationship between the second tactile source-related object and the tactile signal transmission-related object, it is determined whether the tactile signal transmission-related object transmits tactile signals;

[0245] During the rendering process, tactile feedback is generated based on the relationship between the tactile signal transmission related object and the second tactile feedback receiving related object.

[0246] Optionally, when the target object is an object related to the first tactile source, the processing module is specifically used for at least one of the following:

[0247] During the rendering process, identify objects related to the first tactile source;

[0248] During the rendering process, tactile feedback is generated based on the relationship between the first tactile source related object and the third tactile feedback receiving related object.

[0249] Optionally, when the target object is the object related to the first haptic feedback reception, the processing module is specifically used for:

[0250] During the rendering process, tactile feedback is generated based on the relationship between the third tactile source related object and the first tactile feedback receiving related object.

[0251] Optionally, when the target object is an object related to the tactile action, the processing module is specifically used for at least one of the following:

[0252] During the rendering process, tactile actions are triggered based on the interactive processing model.

[0253] If the tactile motion-related object carries the first information, rendering is performed based on the first information in the tactile motion-related object.

[0254] The rendering apparatus provided in this application embodiment can implement the various processes implemented in the method embodiment of FIG1 and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0255] As shown in Figure 3, this application embodiment also provides an electronic device 300. The electronic device 300 can be a first device, including a processor 301 and a memory 302. The memory 302 stores a program or instructions that can run on the processor 301. When the program or instructions are executed by the processor 301, they implement the various steps of the above-described tactile signal processing method embodiment and can achieve the same technical effect.

[0256] This application also provides an electronic device, which can be a first device including a processor and a communication interface. The communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps in the method embodiment shown in FIG1. ​​This device embodiment corresponds to the above method embodiment, and all implementation processes and methods of the above method embodiments can be applied to this terminal embodiment and can achieve the same technical effect.

[0257] The processor or processing circuit in the embodiments of this application may include general-purpose processors, special-purpose processors, etc., such as central processing units (CPUs), microprocessors, digital signal processors (DSPs), artificial intelligence (AI) processors, graphics processing units (GPUs), application-specific integrated circuits (ASICs), network processors (NPs), field-programmable gate arrays (FPGAs), or other programmable logic devices, gate circuits, transistors, discrete hardware components, etc. The communication interface in the embodiments of this application may include transceivers, pins, circuits, buses, etc.

[0258] The aforementioned electronic devices can be terminals or other devices besides terminals, such as servers, network attached storage (NAS), etc.

[0259] Among them, the terminal can also be called user equipment (UE), which can be a mobile phone, tablet computer, laptop computer, notebook computer, personal digital assistant (PDA), handheld computer, netbook, ultra-mobile personal computer (UMPC), mobile internet device (MID), augmented reality (AR), virtual reality (VR) device, mixed reality (MR) device, robot, wearable device, flight vehicle, vehicle user equipment (VUE), shipborne equipment, pedestrian user equipment (PUE), smart home (home devices with wireless communication functions, such as refrigerators, televisions, washing machines or furniture, etc.), game console, personal computer (PC), ATM or self-service machine, etc. Wearable devices include: smartwatches, smart bracelets, smart earphones, smart glasses, smart jewelry (smart bracelets, smart chains, smart rings, smart necklaces, smart anklets, smart anklets, etc.), smart wristbands, smart clothing, etc. Among these, in-vehicle devices can also be referred to as in-vehicle terminals, in-vehicle controllers, in-vehicle modules, in-vehicle components, in-vehicle chips, or in-vehicle units, etc. It should be noted that the embodiments in this application do not limit the specific type of terminal.

[0260] A server can be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server. A cloud server can provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), or cloud computing services based on big data and artificial intelligence platforms.

[0261] Taking an electronic device as an example, Figure 4 is a schematic diagram of the hardware structure of a terminal that implements an embodiment of this application.

[0262] The terminal 400 includes, but is not limited to, at least some of the following components: radio frequency unit 401, network module 402, audio output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, and processor 410.

[0263] Those skilled in the art will understand that terminal 400 may also include a power supply (such as a battery) for powering various components. The power supply can be logically connected to processor 410 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The terminal structure shown in Figure 4 does not constitute a limitation on the terminal. The terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0264] It should be understood that, in this embodiment, the input unit 404 may include a graphics processor 4041 and a microphone 4042. The graphics processor 4041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 406 may include a display panel 4061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 407 includes at least one of a touch panel 4071 and other input devices 4072. The touch panel 4071 is also called a touch screen. The touch panel 4071 may include a touch detection device and a touch controller. Other input devices 4072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0265] In this embodiment, after receiving downlink data from the network-side device, the radio frequency unit 401 can transmit it to the processor 410 for processing; in addition, the radio frequency unit 401 can send uplink data to the network-side device. Typically, the radio frequency unit 401 includes, but is not limited to, antennas, amplifiers, transceivers, couplers, low-noise amplifiers, duplexers, etc.

[0266] The memory 409 can be used to store software programs or instructions, as well as various data. The memory 409 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 409 may include volatile memory or non-volatile memory. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 409 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0267] Processor 410 may include one or more processing units; optionally, processor 410 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 410.

[0268] The processor 410 is used to acquire first information, which is information related to the transmission of tactile signals.

[0269] The processor 410 is further configured to: perform rendering based on the first information.

[0270] Optionally, the first information includes at least one of the following:

[0271] Transmits information related to the geometry of the object;

[0272] Information related to tactile signal modes;

[0273] Target signal strength;

[0274] Tactile signal transduction factor;

[0275] Relevant information about the tactile signal transmission correlation function;

[0276] Information related to the tactile source associated with tactile signal transmission;

[0277] Tactile signal transmission triggers related identifiers;

[0278] Information related to the triggering method of tactile signal transmission;

[0279] Information related to the triggering method of tactile signal feedback;

[0280] Haptic feedback receives the identifier of the relevant object;

[0281] Information related to the location of tactile feedback;

[0282] Information related to the attenuation of tactile signals as they propagate through a medium.

[0283] Optionally, the relevant information of the tactile signal transduction correlation function is associated with at least one of the following:

[0284] Time; the tactile signal transmission factor; the target signal intensity.

[0285] Optionally, the first information is carried by a target object, which includes at least one of the following:

[0286] Objects related to tactile signal transmission;

[0287] The object related to the primary tactile source;

[0288] The first tactile feedback is received from the relevant object;

[0289] Objects related to tactile movements.

[0290] Optionally, the target object also carries second information, which includes at least one of the following:

[0291] The identifier of the target object;

[0292] Information about the activation status of the target object.

[0293] Optionally, when the target object is an object related to the tactile signal transmission, the processor 410 is specifically used for at least one of the following:

[0294] During the rendering process, the objects related to the transmission of the tactile signals are identified;

[0295] During the rendering process, based on the relationship between the second tactile source-related object and the tactile signal transmission-related object, it is determined whether the tactile signal transmission-related object transmits tactile signals;

[0296] During the rendering process, tactile feedback is generated based on the relationship between the tactile signal transmission related object and the second tactile feedback receiving related object.

[0297] Optionally, when the target object is an object related to the first tactile source, the processor 410 is specifically used for at least one of the following:

[0298] During the rendering process, identify objects related to the first tactile source;

[0299] During the rendering process, tactile feedback is generated based on the relationship between the first tactile source related object and the third tactile feedback receiving related object.

[0300] Optionally, when the target object is the object related to the first haptic feedback reception, the processor 410 is specifically used for:

[0301] During the rendering process, tactile feedback is generated based on the relationship between the third tactile source related object and the first tactile feedback receiving related object.

[0302] Optionally, when the target object is a tactile action-related object, the processor 410 is specifically used for at least one of the following:

[0303] During the rendering process, tactile actions are triggered based on the interactive processing model;

[0304] If the tactile motion-related object carries the first information, rendering is performed based on the first information in the tactile motion-related object.

[0305] It is understood that the implementation process of each implementation method mentioned in this embodiment can refer to the relevant description in Figure 1 of the method embodiment and achieve the same or corresponding technical effects. To avoid repetition, it will not be described again here.

[0306] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described rendering method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0307] The processor mentioned above is either the processor in the terminal described in the above embodiments or the processor in the network-side device. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk. In some examples, the readable storage medium may be a non-transient readable storage medium.

[0308] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described rendering method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0309] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0310] This application also provides a computer program / program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described rendering method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0311] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0312] From the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of computer software products plus necessary general-purpose hardware platforms, and of course, they can also be implemented by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.), and the computer software product includes several instructions to cause the terminal or network-side device to execute the methods described in the various embodiments of this application.

[0313] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other implementations under the guidance of this application without departing from the spirit and scope of the claims. All of these implementations are within the protection scope of this application.

Claims

1. A rendering method, comprising: The first device acquires first information, which is information related to the transmission of tactile signals; The first device renders based on the first information.

2. The method according to claim 1, wherein, The first information includes at least one of the following: Transmits information related to the geometry of the object; Information related to tactile signal modes; Target signal strength; Tactile signal transduction factor; Relevant information about the tactile signal transmission correlation function; Information related to the tactile source associated with tactile signal transmission; Tactile signal transmission triggers related identifiers; Information related to the triggering method of tactile signal transmission; Information related to the triggering method of tactile signal feedback; Haptic feedback receives the identifier of the relevant object; Information related to the location of tactile feedback; Information related to the attenuation of tactile signals as they propagate through a medium.

3. The method according to claim 2, wherein, The relevant information of the tactile signal transduction correlation function is associated with at least one of the following: Time; the tactile signal transmission factor; the target signal intensity.

4. The method according to any one of claims 1-3, wherein, The first information is carried by a target object, which includes at least one of the following: Objects related to tactile signal transmission; The object related to the primary tactile source; The first tactile feedback is received from the relevant object; Objects related to tactile movements.

5. The method according to claim 4, wherein, The target object also carries second information, which includes at least one of the following: The identifier of the target object; Information about the activation status of the target object.

6. The method according to claim 4 or 5, wherein, When the target object is a tactile signal transmission-related object, the first device renders based on the first information, including at least one of the following: The first device identifies the objects related to the tactile signal transmission during the rendering process; During the rendering process, the first device determines whether the tactile signal transmission related object transmits tactile signals based on the relationship between the second tactile source related object and the tactile signal transmission related object; During the rendering process, the first device generates tactile feedback based on the relationship between the tactile signal transmission related object and the second tactile feedback receiving related object.

7. The method according to claim 4 or 5, wherein, When the target object is an object related to the first tactile source, the first device renders based on the first information, including at least one of the following: The first device identifies objects related to the first tactile source during the rendering process; During the rendering process, the first device generates tactile feedback based on the relationship between the first tactile source-related object and the third tactile feedback receiving-related object.

8. The method according to claim 4 or 5, wherein, When the target object is the object related to the first haptic feedback reception, the first device renders based on the first information, including: During the rendering process, the first device generates tactile feedback based on the relationship between the third tactile source-related object and the first tactile feedback receiving-related object.

9. The method according to claim 4 or 5, wherein, When the target object is a tactile action-related object, the first device renders based on the first information, including at least one of the following: During the rendering process, the first device triggers tactile actions based on the interactive processing model. When the tactile motion-related object carries the first information, the first device renders based on the first information in the tactile motion-related object.

10. A rendering apparatus, comprising: The processing module is used to acquire first information, which is information related to the transmission of tactile signals; The processing module is also used to: perform rendering based on the first information.

11. The apparatus according to claim 10, wherein, The first information includes at least one of the following: Transmits information related to the geometry of the object; Information related to tactile signal modes; Target signal strength; Tactile signal transduction factor; Relevant information about the tactile signal transmission correlation function; Information related to the tactile source associated with tactile signal transmission; Tactile signal transmission triggers related identifiers; Information related to the triggering method of tactile signal transmission; Information related to the triggering method of tactile signal feedback; Haptic feedback receives the identifier of the relevant object; Information related to the location of tactile feedback; Information related to the attenuation of tactile signals as they propagate through a medium.

12. The apparatus according to claim 11, wherein, The first information is carried by a target object, which includes at least one of the following: Objects related to tactile signal transmission; The object related to the primary tactile source; The first tactile feedback is received from the relevant object; Objects related to tactile movements.

13. The apparatus according to claim 12, wherein, When the target object is an object related to the tactile signal transmission, the processing module is specifically used for at least one of the following: During the rendering process, the objects related to the transmission of the tactile signals are identified; During the rendering process, based on the relationship between the second tactile source-related object and the tactile signal transmission-related object, it is determined whether the tactile signal transmission-related object transmits tactile signals; During the rendering process, tactile feedback is generated based on the relationship between the tactile signal transmission related object and the second tactile feedback receiving related object.

14. The apparatus according to claim 12, wherein, When the target object is an object related to the first tactile source, the processing module is specifically used for at least one of the following: During the rendering process, identify objects related to the first tactile source; During the rendering process, tactile feedback is generated based on the relationship between the first tactile source related object and the third tactile feedback receiving related object.

15. The apparatus according to claim 12, wherein, When the target object is the first tactile feedback receiving related object, the processing module is specifically used to: generate tactile feedback based on the relationship between the third tactile source related object and the first tactile feedback receiving related object during the rendering process.

16. The apparatus according to claim 12, wherein, When the target object is an object related to the tactile action, the processing module is specifically used for at least one of the following: During the rendering process, tactile actions are triggered based on the interactive processing model. If the tactile motion-related object carries the first information, rendering is performed based on the first information in the tactile motion-related object.

17. An electronic device comprising a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the rendering method as claimed in any one of claims 1 to 9.

18. A readable storage medium storing a program or instructions that, when executed by a processor, implement the rendering method as described in any one of claims 1 to 9.

19. A chip comprising a processor and a communication interface coupled to the processor, the processor being configured to run a program or instructions to implement the rendering method as described in any one of claims 1 to 9.

20. A computer program product stored in a storage medium, the computer program product being executed by at least one processor to implement the rendering method as claimed in any one of claims 1 to 9.

21. An electronic device, wherein, The electronic device is configured to perform the rendering method as described in any one of claims 1 to 9.

Images