Method, device and electronic equipment for generating extended reality (XR) effects

Abstract

The application provides a method and device for generating an extended reality (XR) special effect and electronic equipment, and the method comprises the following steps: obtaining use information of a user; determining target element special effects corresponding to a plurality of element objects of the XR special effect according to the use information of the user; and generating the XR special effect according to the target element special effects corresponding to the plurality of element objects. The application can solve the problem that the current display mode of the XR special effect is relatively single.

Description

Technical Field

[0001] This invention relates to the field of communication technology, and in particular to a method, apparatus, and electronic device for generating extended reality (XR) effects. Background Technology

[0002] Extended Reality (XR) refers to the use of computers to combine the real and virtual worlds, creating an interactive virtual environment. It's a collective term for various technologies such as Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR). By integrating the visual interaction technologies of these three technologies, it provides users with a seamless "immersive" experience between the virtual and real worlds. When showcasing XR effects, a target XR effect is usually selected from preset options. For example, in a scanning scenario, when the camera scans a specific target, a preset target XR effect can be displayed. However, this method results in relatively limited and singular XR effects. Summary of the Invention

[0003] This invention provides a method, apparatus, and electronic device for generating extended reality (XR) effects, which solves the problem that the current methods for displaying XR effects are relatively limited.

[0004] Embodiments of the present invention provide a method for generating XR effects, comprising:

[0005] Obtain user usage information;

[0006] Based on the user's usage information, determine the target element effects corresponding to the multiple element objects of the XR effect;

[0007] The XR effect is generated based on the target element effects corresponding to the multiple element objects.

[0008] Optionally, determining the target element effects corresponding to multiple element objects of the XR effect based on the user's usage information includes:

[0009] Based on the user's usage information, a set of user tags is determined; wherein, the set of user tags includes target user tags and target user relevance values;

[0010] Based on the user tag set, determine the target element effects corresponding to the multiple element objects of the XR effect.

[0011] Optionally, the user's usage information includes: user's historical usage information and / or the collected target image; determining the user tag set based on the user's usage information includes:

[0012] Based on the user's historical usage information, a first user tag and a first user relevance value are determined; and / or, based on the target image, a second user tag and a second user relevance value are determined.

[0013] The user tag set is determined based on the first user tag and the first user relevance value, and / or the second user tag and the second user relevance value.

[0014] Optionally, determining the first user tag and the first user relevance value based on the user's historical usage information includes:

[0015] A first user tag matching the user's historical usage information is determined from the user tag library, and the first user relevance value is determined based on the relevance between the first user tag and the user's historical usage information.

[0016] And / or,

[0017] The step of determining the second user tag and the second user relevance value based on the target image includes:

[0018] A second user tag matching the target object in the target image is determined from the user tag library, and the second user relevance value is determined based on the proportion of the target object in the target image.

[0019] Optionally, determining the user tag set based on the first user tag and the first user relevance value, and / or the second user tag and the second user relevance value, includes:

[0020] Adjust the first user relevance value and / or the second user relevance value according to the preset filtering parameters;

[0021] The user tag set is determined based on the first user tag and the adjusted first user relevance value, and / or the second user tag and the adjusted second user relevance value.

[0022] Optionally, determining the target element effects corresponding to the multiple element objects of the XR effect based on the user tag set includes:

[0023] Based on the target user relevance value corresponding to the target user tag, determine the tag relevance value of the element effects in the element effects library that are associated with the target user tag;

[0024] Based on the user tag set and the tag relevance value of the element effects associated with the target user tags, the target element effects corresponding to the multiple element objects of the XR effect are determined respectively.

[0025] Optionally, determining the tag relevance value of element effects associated with the target user tag in the element effects library based on the target user relevance value corresponding to the target user tag includes:

[0026] Identify the element effects associated with the target user tag from the element effects library;

[0027] Based on a pre-defined relevance value table of element effects associated with user tags, determine the pre-defined relevance value of element effects associated with the target user tag;

[0028] For each element effect associated with the target user tag, the tag relevance value of the element effect is determined based on the preset relevance value and the target user relevance value corresponding to the target user tag.

[0029] Optionally, determining the target element effects corresponding to multiple element objects of the XR effect based on the user tag set and the tag relevance values ​​of the element effects associated with the target user tags includes:

[0030] According to the decreasing order of the target user relevance value of the target user tag in the user tag set, the element effects associated with the target user tag in the element effect set corresponding to the multiple element objects are matched in turn, and the element effect with the highest tag relevance value associated with the target user tag is determined as the target element effect;

[0031] or,

[0032] Following the order of decreasing importance of the multiple element objects, the element effects associated with the target user tag in the element effect set corresponding to each element object are matched sequentially, and the element effect with the highest tag relevance value associated with the target user tag is determined as the target element effect.

[0033] Optionally, determining the target element effects corresponding to multiple element objects of the XR effect based on the user tag set and the tag relevance values ​​of the element effects associated with the target user tags includes:

[0034] Perform the following operations on the target user tags in descending order of their target user relevance values:

[0035] For the i-th target user tag, determine whether there is an element effect associated with the i-th target user tag in the element effect set corresponding to the element object, in descending order of importance of the element objects in the i-th element object set;

[0036] If there is an element effect associated with the i-th target user tag in the element effect set corresponding to the first element object in the i-th element object set, then the element effect with the highest tag relevance value associated with the i-th target user tag in the element effect set is determined as the target element effect corresponding to the first element object, and the i+1-th element object set is obtained after deleting the first element object in the i-th element object set.

[0037] If none of the element effects in the set of element effects corresponding to all element objects in the set of element objects in the i-th element object set are associated with the i-th target user tag, then the set of element objects in the i-th element object set is determined as the (i+1)-th element object set.

[0038] Where i is a positive integer, and i is less than or equal to the number of target user tags in the user tag set.

[0039] This invention also provides an XR effects generation apparatus, comprising:

[0040] The acquisition module is used to acquire user usage information;

[0041] The determination module is used to determine the target element effects corresponding to multiple element objects of XR effects based on the user's usage information.

[0042] The generation module is used to generate the XR effect based on the target element effects corresponding to the multiple element objects respectively.

[0043] Optionally, the determining module includes:

[0044] The first determining submodule is used to determine a set of user tags based on the user's usage information; wherein, the set of user tags includes target user tags and target user relevance values;

[0045] The second determining submodule is used to determine the target element effects corresponding to the multiple element objects of the XR effect based on the user tag set.

[0046] Optionally, the user's usage information includes: user's historical usage information and / or the acquired target image; the first determining submodule includes:

[0047] The first determining unit is configured to determine a first user tag and a first user relevance value based on the user's historical usage information; and / or, determine a second user tag and a second user relevance value based on the target image;

[0048] The second determining unit is used to determine the user tag set based on the first user tag and the first user relevance value, and / or the second user tag and the second user relevance value.

[0049] Optionally, the first determining unit is further configured to:

[0050] A first user tag matching the user's historical usage information is determined from the user tag library, and the first user relevance value is determined based on the relevance between the first user tag and the user's historical usage information.

[0051] And / or,

[0052] A second user tag matching the target object in the target image is determined from the user tag library, and the second user relevance value is determined based on the proportion of the target object in the target image.

[0053] Optionally, the second determining unit is further configured to:

[0054] Adjust the first user relevance value and / or the second user relevance value according to the preset filtering parameters;

[0055] The user tag set is determined based on the first user tag and the adjusted first user relevance value, and / or the second user tag and the adjusted second user relevance value.

[0056] Optionally, the second determining submodule includes:

[0057] The third determining unit is used to determine the tag relevance value of the element effects in the element effects library that are associated with the target user tag based on the target user relevance value corresponding to the target user tag.

[0058] The fourth determining unit is used to determine the target element effects corresponding to multiple element objects of the XR effect based on the user tag set and the tag relevance value of the element effects associated with the target user tags.

[0059] Optionally, the third determining unit is further configured to:

[0060] Identify the element effects associated with the target user's tag from the element effects library;

[0061] Based on a pre-defined relevance value table of element effects associated with user tags, determine the preset relevance value of element effects associated with the target user tag;

[0062] For each element effect associated with the target user tag, the tag relevance value of the element effect is determined based on the preset relevance value and the target user relevance value corresponding to the target user tag.

[0063] Optionally, the fourth determining unit is further configured to:

[0064] According to the decreasing order of the target user relevance value of the target user tag in the user tag set, the element effects associated with the target user tag in the element effect set corresponding to the multiple element objects are matched in turn, and the element effect with the highest tag relevance value associated with the target user tag is determined as the target element effect;

[0065] or,

[0066] Following the order of decreasing importance of the multiple element objects, the element effects associated with the target user tag in the element effect set corresponding to each element object are matched sequentially, and the element effect with the highest tag relevance value associated with the target user tag is determined as the target element effect.

[0067] Optionally, the fourth determining unit is further configured to:

[0068] Perform the following operations on the target user tags in descending order of their target user relevance values:

[0069] For the i-th target user tag, determine whether there is an element effect associated with the i-th target user tag in the element effect set corresponding to the element object, in descending order of importance of the element objects in the i-th element object set;

[0070] If there is an element effect associated with the i-th target user tag in the element effect set corresponding to the first element object in the i-th element object set, then the element effect with the highest tag relevance value associated with the i-th target user tag in the element effect set is determined as the target element effect corresponding to the first element object, and the i+1-th element object set is obtained after deleting the first element object in the i-th element object set.

[0071] If none of the element effects in the set of element effects corresponding to all element objects in the set of element objects in the i-th element object set are associated with the i-th target user tag, then the set of element objects in the i-th element object set is determined as the (i+1)-th element object set.

[0072] Where i is a positive integer, and i is less than or equal to the number of target user tags in the user tag set.

[0073] This invention also provides an electronic device, including: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the XR effect generation method described above.

[0074] This invention also provides a readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the XR effect generation method described above.

[0075] In embodiments of the present invention, based on user information, corresponding target element effects are determined for multiple element objects, and XR effects are generated based on the target element effects corresponding to each of the multiple element objects. In other words, the XR effects are composed of the target element effects corresponding to each of the multiple element objects. This approach allows for the generation of XR effects based on user habits, improving user experience, and also ensures that the generated XR effects are more flexible and diverse. Attached Figure Description

[0076] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0077] Figure 1 A flowchart illustrating the method for generating XR effects according to an embodiment of the present invention;

[0078] Figure 2 A schematic diagram showing the element objects in an embodiment of the present invention;

[0079] Figure 3 A schematic diagram illustrating the element effects corresponding to the element objects in this embodiment of the invention;

[0080] Figure 4 A schematic diagram illustrating the determination of target element special effects according to an embodiment of the present invention;

[0081] Figure 5 This diagram illustrates the interaction between the user terminal and the server in an embodiment of the present invention.

[0082] Figure 6 A block diagram illustrating an XR effects generation apparatus according to an embodiment of the present invention;

[0083] Figure 7 A block diagram illustrating an electronic device according to an embodiment of the present invention. Detailed Implementation

[0084] To make the technical problems, technical solutions, and advantages of this invention clearer, a detailed description will be provided below in conjunction with the accompanying drawings and specific embodiments. In the following description, specific details such as particular configurations and components are provided merely to aid in a comprehensive understanding of the embodiments of this invention. Therefore, those skilled in the art should understand that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this invention. Furthermore, for clarity and brevity, descriptions of known functions and structures have been omitted.

[0085] It should be understood that the phrase "one embodiment" or "an embodiment" throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of the invention. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments.

[0086] In the various embodiments of the present invention, it should be understood that the sequence numbers of the following processes do not imply a specific order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention. Furthermore, the terms "system" and "network" are often used interchangeably herein.

[0087] In the embodiments provided in this application, it should be understood that "B corresponding to A" means that B is associated with A, and B can be determined based on A. However, it should also be understood that determining B based on A does not mean determining B solely based on A; B can also be determined based on A and / or other information.

[0088] like Figure 1 As shown, an embodiment of the present invention provides a method for generating XR effects, including:

[0089] Step 11: Obtain user usage information.

[0090] Optionally, the user's usage information includes: user's historical usage information and / or the target image collected. For example, user's historical usage information may include, but is not limited to, at least one of the following: historical browsing information, user-defined information of interest, etc. The target image collected may be an image captured by an image acquisition device (such as a camera), such as an image captured by scanning in a "scan" scenario.

[0091] Step 12: Based on the user's usage information, determine the target element effects corresponding to the multiple element objects of the XR effect.

[0092] Optionally, an XR effect can be composed of element effects corresponding to multiple element objects, such as Figure 2As shown, the element objects may include, but are not limited to: the main body (such as a person, animal or other object), clothing (such as top, bottom, suit, etc.), accessories (such as headdress, waist accessories, hand-held items, etc.) or other scene elements, etc., and the embodiments of the present invention are not limited thereto.

[0093] Optionally, for each of the multiple element objects, a target element effect is determined based on the user's usage information. For example, for each element object, a target element effect can be generated based on the user's usage information; or, multiple element effects can be pre-configured for each element object (such as...). Figure 3 As shown, for the "main" element, element effects such as "panda", "real person", and "anime character" can be set, and for the "clothing" element, element effects such as "modern clothing" and "cape" can be set. The target element effects corresponding to each element object are determined based on the user's usage information. This embodiment of the invention is not limited thereto.

[0094] Optionally, XR effects may include, but are not limited to, at least one of the following: AR effects, VR effects, MR effects, etc.

[0095] Step 13: Generate the XR effect based on the target element effects corresponding to the multiple element objects respectively.

[0096] In this embodiment, based on user information, corresponding target element effects are determined for multiple element objects, and XR effects are generated based on the target element effects corresponding to each of the multiple element objects. In other words, the XR effects are composed of the target element effects corresponding to each of the multiple element objects. This approach allows for the generation of XR effects based on user habits, improving user experience, and also ensures that the generated XR effects are more flexible and diverse.

[0097] Optionally, determining the target element effects corresponding to multiple element objects of the XR effect based on the user's usage information includes:

[0098] Based on the user's usage information, a set of user tags is determined; wherein, the set of user tags includes target user tags and target user relevance values;

[0099] Based on the user tag set, determine the target element effects corresponding to the multiple element objects of the XR effect.

[0100] Specifically, a user tag library can be pre-configured, containing multiple user tags. Based on the user's usage information, multiple target user tags can be matched from the user tag system. Furthermore, based on the user's usage information, a target user relevance value can be determined for each target user tag. The target user relevance value characterizes the degree of relevance between the user tag and the user's usage information. A higher target user relevance value indicates a higher degree of relevance, meaning the user tag is closer to the information the user is familiar with or interested in. User tags include, but are not limited to, "traditional style," "modern," "fashion," "food," "animals," "sports," and "health," etc., and this embodiment of the invention is not limited to these categories.

[0101] Optionally, the user's usage information includes: user's historical usage information and / or the collected target image; determining the user tag set based on the user's usage information includes:

[0102] Based on the user's historical usage information, a first user tag and a first user relevance value are determined; and / or, based on the target image, a second user tag and a second user relevance value are determined.

[0103] The user tag set is determined based on the first user tag and the first user relevance value, and / or the second user tag and the second user relevance value.

[0104] For example, if the user's usage information is the user's historical usage information, a first user tag and a first user relevance value can be determined based on the historical usage information, and the first user tag can be determined as the target user tag, thereby generating the user tag set.

[0105] For example, if the user's usage information is the collected target image, a second user tag and a second user relevance value can be determined based on the target image, and the second user tag can be determined as the target user tag, thereby generating the user tag set.

[0106] For example, when the user's usage information includes the user's historical usage information and the collected target image, a first user tag and a first user relevance value are determined based on the user's historical usage information, and a second user tag and a second user relevance value are determined based on the target image; the first user tag and the second user tag are merged as the target user tag, and the user relevance value corresponding to each target user tag is determined, thereby generating the user tag set.

[0107] Specifically, merging the first user tag and the second user tag as the target user tag includes: when there are no identical user tags in the first user tag and the second user tag, adding the first user tag and its corresponding first user relevance value, and the second user tag and its corresponding second user relevance value to the user tag set.

[0108] Taking the first user tag as {tag1(relevance value a1), tag2(relevance value a2), tag3(relevance value a3)} and the second user tag as {tag4(relevance value b1), tag5(relevance value b2)} as an example, since each user tag in the first and second user tags is different, the generated user tag set is {tag1(relevance value a1), tag2(relevance value a2), tag3(relevance value a3), tag4(relevance value b1), tag5(relevance value b2)}.

[0109] Alternatively, merging the first user tag and the second user tag as the target user tag includes: if there are identical user tags in the first user tag and the second user tag, adding the different user tags in the first user tag and the second user tag and their corresponding user relevance values ​​to the user tag set; and determining a target relevance value based on the user relevance values ​​corresponding to the identical user tags in the first user tag and the second user tag, and adding the identical user tag and its corresponding target relevance value to the user tag set.

[0110] Taking the first user tag as {tag1 (relevance value a1), tag2 (relevance value a2), tag3 (relevance value a3)} and the second user tag as {tag2 (relevance value b1), tag4 (relevance value b2)}, the different user tags in the first and second user tags, namely tag1, tag3, and tag4, and their user relevance values, are added to the user tag set. In addition, for the user tag2 that is the same in the first and second user tags, the target relevance value c1 of tag2 can be determined based on the relevance value a2 of tag2 in the first user tag and the relevance value b1 of tag2 in the second user tag. For example, c1 can be the maximum value between b1 and a2, or the average value between b1 and a2, or the weighted average value between b1 and a2, etc. In this way, the user tag set is obtained as {tag1 (relevance value a1), tag2 (relevance value c1), tag3 (relevance value a3), tag4 (relevance value b2)}.

[0111] Optionally, determining the first user tag and the first user relevance value based on the user's historical usage information includes:

[0112] A first user tag matching the user's historical usage information is determined from the user tag library, and the first user relevance value is determined based on the relevance between the first user tag and the user's historical usage information.

[0113] And / or,

[0114] The step of determining the second user tag and the second user relevance value based on the target image includes:

[0115] A second user tag matching the target object in the target image is determined from the user tag library, and the second user relevance value is determined based on the proportion of the target object in the target image.

[0116] Specifically, multiple user tags can be pre-configured in the user tag library, such as including but not limited to: "traditional style," "modern," "fashion," "food," "animals," "sports," and "health." For example, if a user has defined "running" as their area of ​​interest in their historical usage information, then user tags such as "sports" and "health" can be matched from the user tag library. Furthermore, based on the user's historical usage information of "running," it can be determined that the user tag "sports" has a higher user relevance value than the user tag "health," such as a user relevance value of 0.9 for the user tag "sports" and 0.6 for the user tag "health." However, the user tags and user relevance values ​​in this embodiment of the invention are not limited to these limitations.

[0117] For example, if the captured target image includes a "cartoon panda holding a steamed bun," then "steamed bun" and "panda" can be considered as target objects. User tags such as "animal" and "food" can then be matched from the user tag library. Based on the proportion of the target object "panda" corresponding to the user tag "animal" in the target image, and the proportion of the target object "steamed bun" corresponding to the user tag "food" in the target image, the user relevance values ​​for the user tags "animal" and "food" are determined. For instance, the proportions of multiple target objects such as "steamed bun" and "panda" in the target image are sorted in descending order, and a corresponding index k is generated. This user relevance value can be calculated using the formula: K = 1 / ln(10*k), where K is the user relevance value.

[0118] It should be noted that the target image may include multiple target objects, such as "bamboo" in addition to "baozi" and "panda". When arranging the proportion of multiple target objects in the target image in descending order, it may be that the proportion of all target objects in the target image in descending order is arranged, or it may be that the proportion of some target objects that match the user tag in the target image is arranged in descending order, etc. The embodiments of the present invention are not limited thereto.

[0119] Optionally, determining the user tag set based on the first user tag and the first user relevance value, and / or the second user tag and the second user relevance value, includes:

[0120] Adjust the first user relevance value and / or the second user relevance value according to the preset filtering parameters;

[0121] The user tag set is determined based on the first user tag and the adjusted first user relevance value, and / or the second user tag and the adjusted second user relevance value.

[0122] For example, a filter can be added in advance, and its filtering parameters can be set. These parameters are used to intervene in the user relevance value of a specific user tag. For example, the filtering parameters can be pre-set to increase or decrease the user relevance value of certain specific user tags by a predetermined value, or to increase or decrease a predetermined percentage, etc. The embodiments of the present invention are not limited to this.

[0123] It should be noted that when generating a user tag set based on the first user tag and its user relevance value, and the second user tag and its user relevance value, the user relevance values ​​of the first and second user tags can be adjusted separately according to the filtering parameters, and then the user tag set can be generated based on the adjusted user relevance values. Alternatively, the first and second user tags can be merged first, and the merged user relevance value can be determined (the specific merging method can be found in the above embodiments, which will not be repeated here), and then the merged user relevance value can be adjusted according to the filtering parameters, etc. The embodiments of the present invention are not limited to this.

[0124] Optionally, determining the target element effects corresponding to the multiple element objects of the XR effect based on the user tag set includes:

[0125] Based on the target user relevance value corresponding to the target user tag, determine the tag relevance value of the element effects in the element effects library that are associated with the target user tag;

[0126] Based on the user tag set and the tag relevance value of the element effects associated with the target user tags, the target element effects corresponding to the multiple element objects of the XR effect are determined respectively.

[0127] Specifically, the element effects library allows for the pre-configuration of multiple element effects for each element object. For example, for the "Main" element, effects such as "Panda," "Real Person," and "Anime Character" can be set; for the "Clothing" element, effects such as "Modern Clothing" and "Cape" can be set. Furthermore, the element effects library includes a mapping between element objects, element effects, and user tags. This allows for the matching of corresponding element effects from the library for a specific target user tag within the user tag set. Based on the target user relevance value corresponding to that target user tag, the tag relevance value of the matched element effect is determined. This tag relevance value characterizes the degree of relevance between the element effect and the user tag; a higher tag relevance value indicates a higher degree of relevance, meaning the element effect is closer to the content of the user tag.

[0128] In this embodiment, based on the target user relevance value corresponding to the target user tag, the tag relevance value of the element effects associated with the target user tag in the element effects library is determined. For example, the element effect with the highest tag relevance value associated with the target user tag can be used as the target element effect, thereby ensuring that the obtained target element effect is more relevant to the user tag, that is, more in line with user habits or user interests, and further improving the user experience.

[0129] Optionally, determining the tag relevance value of element effects associated with the target user tag in the element effects library based on the target user relevance value corresponding to the target user tag includes:

[0130] Identify the element effects associated with the target user's tag from the element effects library;

[0131] Based on a pre-defined relevance value table of element effects associated with user tags, determine the pre-defined relevance value of element effects associated with the target user tag;

[0132] For each element effect associated with the target user tag, the tag relevance value of the element effect is determined based on the preset relevance value and the target user relevance value corresponding to the target user tag.

[0133] For example, you can pre-establish the association between element effects and user tags. For each element effect, you can add corresponding descriptive information. This descriptive information can be nouns or phrases, such as instructions for use with terms like "cloak," "modern clothing," or "steamed bun." Based on this descriptive information, you can then determine which element effects from the element effect library are associated with the target user tags. For instance, if the descriptive information for an element effect is "cloak," the corresponding target user tag could be "traditional style," etc.

[0134] Optionally, the pre-defined relevance value table for element effects associated with user tags can be a corpus built based on methods such as word2vector and TF-IDF, used to pre-configure the preset relevance values ​​of element effects corresponding to user tags; for example, if the description information of an element effect is "modern clothing", its preset relevance value corresponding to the user tag "fashion" is 0.8, while its preset relevance value corresponding to the user tag "traditional style" is 0.4, etc., as shown in Table 1.

[0135] Table 1

[0136]

[0137] For the relevance values ​​of element effects in the pre-defined relevance value table of element effects associated with user tags, the preset relevance values ​​of element effects associated with the target user tags are adjusted by using the user relevance values ​​corresponding to the target user tags, so as to obtain the tag relevance values ​​of element effects associated with the target user tags.

[0138] For example, the tag relevance value of the element effects associated with the target user tag can be determined using the following formula:

[0139] score(E i Tag j =textSimilarity(E i Tag j )*UserTag(User k Tag j )

[0140] Among them, E i The element effect i, Tag j Represents the target user label j, User k The identifier is user k, textSimilarity represents the preset relevance value of element effect i, UserTag represents the user relevance value of the target user tag, and score represents the tag relevance value of element effect i.

[0141] Optionally, determining the target element effects corresponding to multiple element objects of the XR effect based on the user tag set and the tag relevance values ​​of the element effects associated with the target user tags includes:

[0142] Following the descending order of the target user relevance value of the target user tags in the user tag set, the element effects associated with the target user tags in the element effect set corresponding to the multiple element objects are matched sequentially, and the element effect with the highest tag relevance value associated with the target user tag is determined as the target element effect.

[0143] For example: following the descending order of target user relevance values ​​of the target user tags in the user tag set, determine the element effect with the highest tag relevance value for each element object corresponding to each target user tag; if there is only one element effect with the highest tag relevance value determined for a target element object, then that element effect with the highest tag relevance value can be determined as the target element effect; if there are multiple element effects with the highest tag relevance value determined for a target element object, then the element effect with the highest tag relevance among these element effects, or the element effect with the highest user relevance value of the associated target user tag, can be determined as the target element effect, etc. Here, the target element object can be any one of the multiple element objects.

[0144] For example, determining the target element effects corresponding to multiple element objects of XR effects based on the user tag set and the tag relevance values ​​of element effects associated with the target user tags includes:

[0145] Perform the following operations on the target user tags in descending order of their target user relevance values:

[0146] For the i-th target user tag, determine whether there is an element effect associated with the i-th target user tag in the element effect set corresponding to the element object, in descending order of importance of the element objects in the i-th element object set;

[0147] If there is an element effect associated with the i-th target user tag in the element effect set corresponding to the first element object in the i-th element object set, then the element effect with the highest tag relevance value associated with the i-th target user tag in the element effect set is determined as the target element effect corresponding to the first element object, and the i+1-th element object set is obtained after deleting the first element object in the i-th element object set.

[0148] If none of the element effects in the set of element effects corresponding to all element objects in the set of element objects in the i-th element object set are associated with the i-th target user tag, then the set of element objects in the i-th element object set is determined as the (i+1)-th element object set.

[0149] Where i is a positive integer, and i is less than or equal to the number of target user tags in the user tag set.

[0150] Optionally, if no associated element effect is matched for a certain element object based on the above method, the preset element effect can be used as the target element effect (i.e., the default effect), or the element effect can be not displayed for the element object, etc. The embodiments of the present invention are not limited thereto.

[0151] Specifically, the target user tags in the user tag set are sorted in descending order according to their user relevance value; and the element objects are sorted in descending order according to their importance. The importance of the element objects can be preset, such as setting the element object "body" to have the highest importance and the element object "holding an item" to have a lower importance. This embodiment of the invention is not limited to this.

[0152] Furthermore, starting with target user tags with high user relevance values, the system sequentially searches for element effects in the corresponding element effect sets, sorting element objects by importance in descending order. If no element effect in the set is relevant to the target user tag, the search continues to the next element object's element effect set; otherwise, the element effect with the highest tag relevance value is selected as the target element effect for that element object. Once the target element effect for an element object is determined, the element object is removed from the element object set.

[0153] If the set of element objects is empty, meaning all element objects in the set match the corresponding target element effect, the process ends. If, after searching for element effects for the last target user tag, the set of element objects is not empty, meaning some elements in the set still do not match the corresponding target element objects, then for the remaining element objects, a preset element effect can be used as the target element object, or the element effect can be not displayed for the remaining element objects, etc., but this embodiment of the invention is not limited thereto.

[0154] like Figure 4As shown, taking an example with element objects including: main body, clothing, accessories, and other element objects n. Each element object is configured with multiple element effects. For example, the "main body" is configured with 3 element effects: "panda", "anime character", and "real person"; the "clothing" is configured with 2 element effects: "cape" and "modern clothing", etc. Based on the tag relevance value corresponding to the element effects, the element effect with the highest tag relevance value associated with the user tags "animal", "traditional style", and "food" is determined. If the user tag "animal" has the highest relevance value to the element effect "panda" in the element object "subject" (e.g., a relevance value of 0.9), then the element effect "panda" will be added to the final XR effect; if the user tag "ancient style" has the highest relevance value to the element effect "cloak" in the element object "clothing" (e.g., a relevance value of 0.8), then the element effect "cloak" will be added to the final XR effect; if the user tag "food" has the highest relevance value to the element effect "food" in the element object "accessories" (e.g., a relevance value of 0.9 for "food", 0.2 for "weapons", and 0.3 for "lights"), then the element effect "food" will be added to the final XR effect.

[0155] Optionally, as another implementation: determining the target element effects corresponding to multiple element objects of the XR effect based on the user tag set and the tag relevance values ​​of the element effects associated with the target user tags includes:

[0156] Following the order of decreasing importance of the multiple element objects, the element effects associated with the target user tag in the element effect set corresponding to each element object are matched sequentially, and the element effect with the highest tag relevance value associated with the target user tag is determined as the target element effect.

[0157] For example: Following the decreasing order of importance of the multiple element objects, for each element object, determine the element effect with the highest tag relevance value associated with the target user tag. If there is only one element effect with the highest tag relevance value for the target element object, then that element effect with the highest tag relevance value can be determined as the target element effect. If there are multiple element effects with the highest tag relevance value for the target element object, then the element effect with the highest tag relevance value among these element effects, or the element effect with the highest user relevance value associated with the target user tag, can be determined as the target element effect, etc. Here, the target element object can be any one of the multiple element objects.

[0158] For example: the step of sequentially matching the element effects associated with the target user tag in the element effect set corresponding to each element object in descending order of importance, and determining the element effect with the highest tag relevance value associated with the target user tag as the target element effect, includes:

[0159] Perform the following operations on the element objects in descending order of importance:

[0160] For the j-th element object, determine whether there exists a target user tag in the j-th user tag set that is associated with the element effect corresponding to the j-th element object, in descending order of the user relevance value of the target user tag in the j-th user tag set;

[0161] If the first target user tag in the j-th user tag set is associated with the element effect corresponding to the j-th element object, then the element effect with the highest tag relevance value associated with the first target user tag is determined as the target element effect corresponding to the j-th element object, and the j+1-th user tag set is obtained after deleting the first target user tag in the j-th user tag set.

[0162] If there is no target user tag in the j-th user tag set that is associated with the element effect corresponding to the j-th element object, then the j-th user tag set is determined as the (j+1)-th user tag set;

[0163] Where j is a positive integer, and j is less than or equal to the number of the element objects.

[0164] Optionally, if no associated element effect is matched for a certain element object based on the above method, the preset element effect can be used as the target element effect (i.e., the default effect), or the element effect can be not displayed for the element object, etc. The embodiments of the present invention are not limited thereto.

[0165] This embodiment is similar to the method described above, which matches target element effects to target user tags in descending order of target user relevance value and element object importance. It also helps to ensure the diversity of target element effects used to generate XR effects. To avoid repetition, it will not be described again here.

[0166] The XR effect generation method described above in this embodiment of the invention can be applied to the server side. User information can be collected by the user terminal. The step of determining the user tag set based on the user information can be implemented by the server side, or determined by the user terminal and uploaded to the server side. For example, the user terminal can be a mobile phone (or cell phone), or other devices capable of sending or receiving wireless signals, including user equipment, personal digital assistants (PDAs), wireless modems, wireless communication devices, handheld devices, laptop computers, cordless phones, wireless local loop (WLL) stations, CPEs (Customer Premise Equipment) or mobile smart hotspots capable of converting mobile signals into WiFi signals, smart home appliances, or other devices that can spontaneously communicate with mobile communication networks without human intervention.

[0167] like Figure 5 As shown, a schematic diagram of the interaction between the user terminal and the server is given. Specifically, the user terminal can obtain user information, such as recording user operations and browsing information, or collecting target images in the "scan" scenario, and upload the recorded user operations and browsing information, as well as the collected target images, as user information to the server.

[0168] The server analyzes and processes the collected target images to determine activity information (such as reward details) in the "scan" scenario, and tags users based on their usage information to determine a user tag set. Since XR effects are divided into multiple element objects, each with multiple corresponding element effects, the tag relevance value of the element effects associated with the target user tags in the user tag set can be further determined based on the user tag set and a pre-defined relevance value table for element effects associated with user tags. Based on the user tag set, the element effect with the highest tag relevance value is selected for each element object and combined to form the final XR effect.

[0169] The server sends the generated XR effects to the user's device for display. Furthermore, when the user clicks on the XR effect, the user's device can display reward information, etc. For example, if the user tag combination includes the target user tags "traditional Chinese style" or "food," the final XR effect will be an image of "Kung Fu Panda and steamed buns." If the user tag combination includes the target user tags "animals" or "fitness," the final XR effect will be an image of "panda jumping rope," etc. This embodiment of the invention is not limited to these examples.

[0170] like Figure 6 As shown, this embodiment of the invention provides an XR effects generation device 600, comprising:

[0171] Module 610 is used to obtain user usage information;

[0172] The determining module 620 is used to determine the target element effects corresponding to the multiple element objects of the XR effect based on the user's usage information.

[0173] The generation module 630 is used to generate the XR effect based on the target element effects corresponding to the multiple element objects respectively.

[0174] Optionally, the determining module 620 includes:

[0175] The first determining submodule is used to determine a set of user tags based on the user's usage information; wherein, the set of user tags includes target user tags and target user relevance values;

[0176] The second determining submodule is used to determine the target element effects corresponding to the multiple element objects of the XR effect based on the user tag set.

[0177] Optionally, the user's usage information includes: user's historical usage information and / or the acquired target image; the first determining submodule includes:

[0178] The first determining unit is configured to determine a first user tag and a first user relevance value based on the user's historical usage information; and / or, determine a second user tag and a second user relevance value based on the target image;

[0179] The second determining unit is used to determine the user tag set based on the first user tag and the first user relevance value, and / or the second user tag and the second user relevance value.

[0180] Optionally, the first determining unit is further configured to:

[0181] A first user tag matching the user's historical usage information is determined from the user tag library, and the first user relevance value is determined based on the relevance between the first user tag and the user's historical usage information.

[0182] And / or,

[0183] A second user tag matching the target object in the target image is determined from the user tag library, and the second user relevance value is determined based on the proportion of the target object in the target image.

[0184] Optionally, the second determining unit is further configured to:

[0185] Adjust the first user relevance value and / or the second user relevance value according to the preset filtering parameters;

[0186] The user tag set is determined based on the first user tag and the adjusted first user relevance value, and / or the second user tag and the adjusted second user relevance value.

[0187] Optionally, the second determining submodule includes:

[0188] The third determining unit is used to determine the tag relevance value of the element effects in the element effects library that are associated with the target user tag, based on the target user relevance value corresponding to the target user tag.

[0189] The fourth determining unit is used to determine the target element effects corresponding to multiple element objects of the XR effect based on the user tag set and the tag relevance value of the element effects associated with the target user tags.

[0190] Optionally, the third determining unit is further configured to:

[0191] Identify the element effects associated with the target user tag from the element effects library;

[0192] Based on a pre-defined relevance value table of element effects associated with user tags, determine the pre-defined relevance value of element effects associated with the target user tag;

[0193] For each element effect associated with the target user tag, the tag relevance value of the element effect is determined based on the preset relevance value and the target user relevance value corresponding to the target user tag.

[0194] Optionally, the fourth determining unit is further configured to:

[0195] According to the decreasing order of the target user relevance value of the target user tag in the user tag set, the element effects associated with the target user tag in the element effect set corresponding to the multiple element objects are matched in turn, and the element effect with the highest tag relevance value associated with the target user tag is determined as the target element effect;

[0196] or,

[0197] Following the order of decreasing importance of the multiple element objects, the element effects associated with the target user tag in the element effect set corresponding to each element object are matched sequentially, and the element effect with the highest tag relevance value associated with the target user tag is determined as the target element effect.

[0198] Optionally, the fourth determining unit is further configured to:

[0199] Perform the following operations on the target user tags in descending order of their target user relevance values:

[0200] For the i-th target user tag, determine whether there is an element effect associated with the i-th target user tag in the element effect set corresponding to the element object, in descending order of importance of the element objects in the i-th element object set;

[0201] If there is an element effect associated with the i-th target user tag in the element effect set corresponding to the first element object in the i-th element object set, then the element effect with the highest tag relevance value associated with the i-th target user tag in the element effect set is determined as the target element effect corresponding to the first element object, and the i+1-th element object set is obtained after deleting the first element object in the i-th element object set.

[0202] If none of the element effects in the set of element effects corresponding to all element objects in the set of element objects in the i-th element object set are associated with the i-th target user tag, then the set of element objects in the i-th element object set is determined as the (i+1)-th element object set.

[0203] Where i is a positive integer, and i is less than or equal to the number of target user tags in the user tag set.

[0204] It should be noted that the apparatus provided in this embodiment of the invention can implement all the method steps implemented in the above method embodiment and can achieve the same technical effect. Therefore, the parts and beneficial effects that are the same as those in the method embodiment will not be described in detail here.

[0205] like Figure 7 As shown, this embodiment of the invention also provides an electronic device, such as a user device or a server, preferably a server. The electronic device includes a transceiver 73, a processor 71, a memory 72, and a computer program stored in the memory 72 and executable on the processor 71. When the processor 71 executes the computer program, it implements the steps of the above-described XR effects generation method and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0206] The bus architecture may include any number of interconnected buses and bridges, specifically linking various circuits of one or more processors 71 (represented by processor 71) and memory 72 (represented by memory 72). The bus architecture may also link various other circuits, such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and therefore will not be described further herein. The bus interface provides an interface. The transceiver 73 may be multiple elements, including transmitters and transceivers, providing a unit for communicating with various other devices over a transmission medium. Processor 71 is responsible for managing the bus architecture and general processing, and memory 72 may store data used by the processor during operation.

[0207] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a computer program instructing the relevant hardware to implement them. The computer program includes instructions to perform some or all of the steps of the above methods; and the computer program can be stored in a readable storage medium, which can be any form of storage medium.

[0208] In addition, a specific embodiment of the present invention also provides a readable storage medium on which a computer program is stored. When the program is executed by a processor, it implements the steps in the above-described method for generating XR effects and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0209] In the several embodiments provided in this application, it should be understood that the disclosed methods and apparatus can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0210] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can be physically comprised separately, or two or more units can be integrated into one unit. The integrated unit described above can be implemented in hardware or in the form of hardware plus software functional units.

[0211] The integrated units implemented as software functional units described above can be stored in a computer-readable storage medium. These software functional units, stored in a storage medium, include several instructions that cause a computer device (which may be a personal computer, server, or network device, etc.) to execute some steps of the transmission and reception methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0212] The above describes the preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications are also within the scope of protection of the present invention.

Claims

1. A method for generating extended reality (XR) effects, characterized in that, include: Obtain user usage information; Based on the user's usage information, determine the target element effects corresponding to the multiple element objects of the XR effect; The XR effect is generated based on the target element effects corresponding to the multiple element objects respectively; The step of determining the target element effects corresponding to multiple element objects of XR effects based on the user's usage information includes: Based on the user's usage information, a set of user tags is determined; wherein, the set of user tags includes target user tags and target user relevance values; Based on the target user relevance value corresponding to the target user tag, determine the tag relevance value of the element effects in the element effects library that are associated with the target user tag; Based on the user tag set and the tag relevance value of the element effects associated with the target user tags, the target element effects corresponding to the multiple element objects of the XR effect are determined respectively.

2. The method according to claim 1, characterized in that, The user's usage information includes: the user's historical usage information and / or the collected target image; determining the user tag set based on the user's usage information includes: Based on the user's historical usage information, a first user tag and a first user relevance value are determined; and / or, based on the target image, a second user tag and a second user relevance value are determined. The user tag set is determined based on the first user tag and the first user relevance value, and / or the second user tag and the second user relevance value.

3. The method according to claim 2, characterized in that, The step of determining the first user tag and the first user relevance value based on the user's historical usage information includes: A first user tag matching the user's historical usage information is determined from the user tag library, and the first user relevance value is determined based on the relevance between the first user tag and the user's historical usage information. And / or, The step of determining the second user tag and the second user relevance value based on the target image includes: A second user tag matching the target object in the target image is determined from the user tag library, and the second user relevance value is determined based on the proportion of the target object in the target image.

4. The method according to claim 2 or 3, characterized in that, The step of determining the user tag set based on the first user tag and the first user relevance value, and / or the second user tag and the second user relevance value, includes: Adjust the first user relevance value and / or the second user relevance value according to the preset filtering parameters; The user tag set is determined based on the first user tag and the adjusted first user relevance value, and / or the second user tag and the adjusted second user relevance value.

5. The method according to claim 1, characterized in that, The step of determining the tag relevance value of element effects in the element effects library associated with the target user tag based on the target user relevance value corresponding to the target user tag includes: Identify the element effects associated with the target user tag from the element effects library; Based on a pre-defined relevance value table of element effects associated with user tags, determine the pre-defined relevance value of element effects associated with the target user tag; For each element effect associated with the target user tag, the tag relevance value of the element effect is determined based on the preset relevance value and the target user relevance value corresponding to the target user tag.

6. The method according to claim 1, characterized in that, The step of determining the target element effects corresponding to multiple element objects of the XR effect based on the user tag set and the tag relevance value of the element effects associated with the target user tags includes: According to the decreasing order of the target user relevance value of the target user tag in the user tag set, the element effects associated with the target user tag in the element effect set corresponding to the multiple element objects are matched in turn, and the element effect with the highest tag relevance value associated with the target user tag is determined as the target element effect; or, Following the order of decreasing importance of the multiple element objects, the element effects associated with the target user tag in the element effect set corresponding to each element object are matched sequentially, and the element effect with the highest tag relevance value associated with the target user tag is determined as the target element effect.

7. The method according to claim 1 or 6, characterized in that, The step of determining the target element effects corresponding to multiple element objects of the XR effect based on the user tag set and the tag relevance value of the element effects associated with the target user tags includes: Perform the following operations on the target user tags in descending order of their target user relevance values: For the i-th target user tag, determine whether there is an element effect associated with the i-th target user tag in the element effect set corresponding to the element object, in descending order of importance of the element objects in the i-th element object set; If there is an element effect associated with the i-th target user tag in the element effect set corresponding to the first element object in the i-th element object set, then the element effect with the highest tag relevance value associated with the i-th target user tag in the element effect set is determined as the target element effect corresponding to the first element object, and the i+1-th element object set is obtained after deleting the first element object in the i-th element object set. If none of the element effects in the set of element effects corresponding to all element objects in the set of element objects in the i-th element object set are associated with the i-th target user tag, then the set of element objects in the i-th element object set is determined as the (i+1)-th element object set. Where i is a positive integer, and i is less than or equal to the number of target user tags in the user tag set.

8. A device for generating extended reality (XR) effects, characterized in that, include: The acquisition module is used to acquire user usage information; The determination module is used to determine the target element effects corresponding to multiple element objects of XR effects based on the user's usage information. The generation module is used to generate the XR effect based on the target element effects corresponding to the multiple element objects respectively; The determining module includes: The first determining submodule is used to determine a set of user tags based on the user's usage information; wherein, the set of user tags includes target user tags and target user relevance values; The second determining submodule is used to determine the target element effects corresponding to the multiple element objects of the XR effect based on the user tag set. The second determining submodule includes: The third determining unit is used to determine the tag relevance value of the element effects in the element effects library that are associated with the target user tag, based on the target user relevance value corresponding to the target user tag. The fourth determining unit is used to determine the target element effects corresponding to multiple element objects of the XR effect based on the user tag set and the tag relevance value of the element effects associated with the target user tags.

9. An electronic device, characterized in that, include: A processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the method for generating extended reality XR effects as described in any one of claims 1 to 8.

10. A readable storage medium, characterized in that, The readable storage medium stores a computer program that, when executed by a processor, implements the steps of the method for generating extended reality XR effects as described in any one of claims 1 to 8.

Images