Display control method of story card of electronic equipment and related device

Abstract

The invention provides a display control method for a story card of electronic equipment and a related device. The method comprises the following steps: displaying object category keywords of a shot target object on a display interface of the electronic equipment; in response to a selection operation for a story card in the electronic equipment, determining a picture book story corresponding to the object category keyword, the picture book story including a plurality of screens, and picture book content of a key screen in the plurality of screens including interaction configuration information for the target object; and in the process of controlling the electronic equipment to output the picture book content of each screen in the plurality of screens, in response to an interaction operation for a target object in the picture book content, executing an interaction response operation corresponding to the interaction operation according to the interaction configuration information. The problem that a story card of an existing electronic device is low in interaction rate with children in the picture book story outputting process and cannot meet the real demands of the children is solved.

Description

Technical Field

[0001] This invention relates to the field of artificial intelligence, and in particular to a method and apparatus for displaying story cards in an electronic device. Background Technology

[0002] Current learning aids can select and output preset picture book stories from a pre-set library. These stories can include multiple scenes, each containing images, narration, and background music. The learning aid then outputs the image and audio information from each scene. However, the interaction between the learning aid and young children is limited to basic audio and video display. This approach fails to consider the interactive characteristics of young children based on curiosity, resulting in low child engagement and an inability to meet the needs of a real user group. Summary of the Invention

[0003] This invention provides a method for displaying story cards on an electronic device, aiming to address the problem that existing electronic devices, during the presentation of picture book stories, limit interaction with young children to the original image and audio information of the story. This limited interaction results in a presentation effect that fails to meet the needs of the target user group. This invention determines the corresponding picture book story based on the object category keywords of captured objects, adds interactive configuration information to key scenes within the story, and executes corresponding interactive responses to interactive operations on target objects during the story's output. This increases interaction with children during the story's output, thereby enhancing children's memory of the object category keywords and better meeting the usage needs of children.

[0004] In a first aspect, embodiments of the present invention provide a method for displaying story cards in an electronic device, the method comprising:

[0005] The object category keywords of the captured target object are displayed on the display interface of the electronic device;

[0006] In response to a selection operation of a story card in the electronic device, a picture book story corresponding to the object category keyword is determined, wherein the picture book story includes multiple acts, and the picture book content of the key acts in the multiple acts contains interactive configuration information for the target object;

[0007] During the process of controlling the electronic device to output the picture book content of each of the multiple scenes, in response to the interactive operation on the target object in the picture book content, the interactive response operation corresponding to the interactive operation is executed according to the interactive configuration information.

[0008] Optionally, the picture book content of the key scene includes image information, and the image information contains a figurative graphic of the target object;

[0009] In the process of controlling the electronic device to output the picture book content of each of the multiple scenes, in response to the interactive operation on the target object in the picture book content, the interactive response operation corresponding to the interactive operation is executed according to the interactive configuration information, including:

[0010] During the process of controlling the electronic device to display key screen image information on the display interface, it is determined whether an interactive operation is detected. The interactive operation includes at least one of the following: clicking or sliding on the graphic, pressing the physical button of the electronic device, voice containing preset interactive keywords, and shaking the electronic device.

[0011] If the interactive operation is detected, at least one of the following interactive response operations is executed according to the interactive configuration information: controlling the preset part of the figurative graphic to move according to the preset motion trajectory, adding special effects to the figurative graphic, adjusting the character voice of the figurative graphic, and controlling the electronic device to display a pop-up window corresponding to the object category keyword on the display interface.

[0012] Optionally, determining whether an interactive operation is detected during the process of controlling the electronic device to display image information of key scenes on the display interface includes:

[0013] During the process of controlling the electronic device to output the picture book content of key scenes, the electronic device is controlled to output prompt information to inform the user of the interactive operations that can be performed according to the interactive configuration information, and it is determined whether the interactive operation corresponding to the prompt information is detected.

[0014] Optionally, the picture book content of the key scene includes image information, and the image information contains a figurative graphic of the target object; determining the picture book story corresponding to the object category keyword includes:

[0015] Based on the object category keywords, determine the image and audio information of each scene in the picture book story.

[0016] The picture book content that confirms the image information contains a visual representation of the target object and the audio information contains keywords related to the object category belongs to the key scene;

[0017] Set the interactive configuration information for the visual representation of the target object contained in the picture book content of the key scene.

[0018] Optionally, determining the image and audio information of each scene in the picture book story based on the object category keywords includes:

[0019] Based on the object category keywords, the multi-dimensional attribute extraction rules for the target object are determined. The multi-dimensional attribute extraction rules are different for different object category keywords.

[0020] According to the multi-dimensional attribute extraction rules, extract the feature information of the target object in multiple dimensions;

[0021] The feature information under each dimension is scored, and the feature information with the highest score is taken as the target feature information. The scoring dimensions include the uniqueness of the target object, its visibility, and its potential to trigger or resolve story conflicts.

[0022] Based on the target feature information, the main character's task, core conflict, solution to the core conflict, and emotional tone are determined respectively.

[0023] Based on the main character's mission, the core conflict, the solution to the core conflict, and the emotional tone, determine the image and audio information of each scene in the picture book.

[0024] Optionally, the method for determining the core conflict and its solution based on the target feature information includes:

[0025] Determine the inherent advantages and potential disadvantages corresponding to each of the target feature information;

[0026] The core potential defects of the target object are determined from the potential defects of each of the target feature information;

[0027] Based on the aforementioned core potential defects, the core conflict is identified;

[0028] Identify the key advantages from among the inherent advantages that can resolve the core conflict;

[0029] Based on the aforementioned key advantages, a solution to the core conflict is determined.

[0030] Optionally, the image information of the key scenes includes the appearance and display position of the figurative graphics. The process of determining the image information of each scene's picture book content according to the protagonist's task, the core conflict, the solution to the core conflict, and the emotional tone includes:

[0031] The appearance features of the target object in the image of interest are extracted to obtain the appearance features of the target object;

[0032] The appearance of the graphic is constructed based on the aforementioned appearance features;

[0033] Based on the main character's mission, the core conflict, the solution to the core conflict, and the emotional tone, determine the display position of the figurative graphics in the picture book content of the key scene.

[0034] Secondly, embodiments of the present invention provide a display control device for story cards in an electronic device, the display control device for story cards in the electronic device comprising:

[0035] The display module is used to display the object category keywords of the captured target object on the display interface of the electronic device.

[0036] A determining module is configured to determine a picture book story corresponding to the object category keyword in response to a selection operation of a story card in the electronic device, wherein the picture book story includes multiple acts, and the picture book content of the key acts in the multiple acts contains interactive configuration information for the target object;

[0037] The interaction module is used to respond to interactive operations on the target object in the picture book content during the process of controlling the electronic device to output the picture book content of each of the multiple scenes, and to execute the interactive response operation corresponding to the interactive operation according to the interactive configuration information.

[0038] Thirdly, embodiments of the present invention provide an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps in the story card display control method of the electronic device provided in the embodiments of the present invention.

[0039] Fourthly, embodiments of the present invention provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps in the story card display control method of the electronic device provided in the embodiments of the present invention.

[0040] In this embodiment of the invention, considering that the main purpose of children creating and outputting picture book stories based on the object category keywords corresponding to the photographed items is to better help children remember the object category keywords, this solution sets interactive configuration information about the target object in the picture book content of key scenes in the picture book story. This allows children to perform interactive operations related to the target object during the output of picture book content belonging to key scenes. After detecting the interactive operation performed by the child on the target object, the electronic device can perform an interactive response operation corresponding to the interactive operation, thereby enhancing the degree of interaction between the child and the object category keywords corresponding to the target object during the output of the picture book story. This implicitly improves the child's memory effect of the object category keywords, that is, it improves the presentation effect of the picture book story and can meet the usage needs of real user groups. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 This is a flowchart of a method for displaying story cards in an electronic device according to an embodiment of the present invention;

[0043] Figure 2 This is a first interactive schematic diagram of the display interface of an electronic device provided in an embodiment of the present invention;

[0044] Figure 3 This is a second interactive schematic diagram of the display interface of an electronic device provided in an embodiment of the present invention;

[0045] Figure 4 This is a schematic diagram of the structure of a story card display control device for an electronic device provided in an embodiment of the present invention;

[0046] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0047] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0048] like Figure 1 As shown, Figure 1 This is a flowchart of a method for displaying story cards in an electronic device according to an embodiment of the present invention. The method for displaying story cards in an electronic device includes the following steps:

[0049] 101. Display the object category keywords of the captured target object on the display interface of the electronic device.

[0050] In this embodiment of the invention, the aforementioned electronic device may be a learning device or other terminal device (such as a mobile phone). The learning device refers to a portable hardware device that integrates core functions such as image acquisition, intelligent recognition, learning content generation, and interactive feedback, and can be applied to scenarios such as learning assistance and interactive activities.

[0051] The method for displaying story cards on an electronic device can be applied to a server, with a communication connection between the server and the electronic device. In another embodiment, the method for displaying story cards on an electronic device can be applied to the electronic device itself. The electronic device may include an image acquisition device, which can be used to acquire image data, and may be a camera, etc. When the method for displaying story cards on an electronic device is applied to a server, step 101 can be implemented by the server performing object category recognition on the image captured by the electronic device, obtaining object category keywords of the target object, and sending the object category keywords to the electronic device so that the electronic device can display them on its display interface.

[0052] The target object mentioned above can be understood as an object that needs to be recognized or explained by electronic devices, such as building blocks, squirrels, cups, etc. Object category keywords can be used to characterize the category to which the target object belongs; for example, the object category keyword could be "squirrel".

[0053] 102. In response to the selection operation of story cards in electronic devices, determine the picture book story corresponding to the object category keyword.

[0054] The picture book story comprises multiple acts, and the key acts within these acts contain interactive configuration information for the target objects. There can be one or more key acts. Each act also includes visual and audio information. The audio information includes narration and / or background music.

[0055] The electronic device's display interface can show several cards, such as word cards and story cards. If the user selects a word card, the translation of the object category keyword in that language can be displayed, such as an English translation. The selection of story cards on the electronic device can be done by clicking or swiping. Methods for determining the picture book story corresponding to the object category keyword include, but are not limited to, generating a picture book story based on the object category keyword, or selecting a picture book story corresponding to the object category keyword from a picture book story library.

[0056] 103. In the process of controlling the electronic device to output the picture book content of each scene in the multi-scene, in response to the interactive operation on the target object in the picture book content, the interactive response operation corresponding to the interactive operation is executed according to the interactive configuration information.

[0057] Electronic devices can output multiple screens sequentially, displaying each screen of the picture book content in turn. Interactive operations can include, but are not limited to, clicking, swiping, voice interaction, and interacting with physical buttons on the electronic device (e.g., ...). Figure 2 This includes actions such as pressing the "AI" button (or similar buttons on electronic devices). Interactive responses can include, but are not limited to, displaying special effects related to the target object on the electronic device's display interface, adjusting the buttons and entry points required for switching between different scenes of a picture book, or playing audio related to the target object through the electronic device's audio playback component.

[0058] For example, during the output of the picture book content in the key scene, if a click operation on a target object in the picture book content is detected, then special effects related to the target object are displayed at the same time as the picture book content in the key scene is displayed.

[0059] In this embodiment of the invention, considering that the main purpose of children creating and outputting picture book stories based on the object category keywords corresponding to the photographed items is to better help children remember the object category keywords, this solution sets interactive configuration information about the target object in the picture book content of key scenes in the picture book story. This allows children to perform interactive operations related to the target object during the output of picture book content belonging to key scenes. After detecting the interactive operation performed by the child on the target object, the electronic device can perform an interactive response operation corresponding to the interactive operation, thereby enhancing the degree of interaction between the child and the object category keywords corresponding to the target object during the output of the picture book story. This subtly deepens the child's memory of the object category keywords, that is, it improves the presentation effect of the picture book story and can meet the usage needs of real user groups.

[0060] It is understood that in the specific implementation of this application, data such as image data, subject object data, voice data, question data, knowledge data, and answer data are involved. When the embodiments in this application are applied to specific products or technologies, user permission or consent is required. Furthermore, the collection, use, and processing of related data, as well as the training, deployment, and invocation of algorithm models, must comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0061] Optionally, the picture book content of the key scenes includes image information, and the image information contains a figurative graphic of the target object. Specifically, during the process of controlling the electronic device to output the picture book content of each scene in multiple scenes, the method of executing the interactive response operation corresponding to the interactive operation based on the interactive configuration information in response to an interactive operation targeting the target object in the picture book content may include the following steps: during the process of controlling the electronic device to display the image information of the key scenes on the display interface, determining whether an interactive operation is detected, the interactive operation including at least one of the following: a click or swipe operation on the figurative graphic, a press operation on a physical button of the electronic device, a voice containing preset interactive keywords, or a shaking operation on the electronic device; if an interactive operation is detected, executing at least one of the following interactive response operations based on the interactive configuration information: controlling a preset part of the figurative graphic to move according to a preset motion trajectory, adding special effects to the figurative graphic, adjusting the character voice of the figurative graphic, or controlling the electronic device to display a pop-up window corresponding to the object category keywords on the display interface.

[0062] A figurative graphic of a target object can be considered as a graphic constructed to represent the target object. For example, the figurative graphic can be a cartoon anthropomorphic drawing based on a photograph of the target object.

[0063] The visual information in each scene of the picture book can include, but is not limited to, figurative graphics of target objects, the appearance of story characters, the posture and movement trajectory of figurative graphics, scene details, and other visual information. The picture book content of key scenes can also include audio information, which can include, but is not limited to, character voices, narration, background music, etc.

[0064] For example, taking a squirrel as the target object, the image information of a scene in a picture book might include the following: 1. Scene details: An oak forest in late autumn, the ground covered with pale yellow fallen leaves, the squirrel's tree hole is at the base of an old oak tree behind it, four pine cones neatly stacked at the entrance (already stored food), and half of the dried moss protruding from the hole; five pine cones waiting to be picked hang on a pine branch nearby, the pine needles are covered with morning dew, and sunlight shines through the leaves, casting circular spots of light. 2. Figurative graphic: A cartoon image of a squirrel. 3. The posture and movement trajectory of the figurative graphic: In the center of the picture, the squirrel stands upright, its round eyes sparkling, its large brown tail slightly upturned, and a plump pine cone in its mouth; its front paws are bent over, reaching for the pine branch in front of it, the sharp tips of its claws clearly visible, its expression serious and proud. The audio information of this scene in the picture book might include the following: 1. Ambient sounds: The gentle rustling of the autumn wind, the subtle rustling of pine needles. 2. Narration: Autumn has arrived, and the little squirrel ("squirrel" here is a keyword for the object category) is preparing food for winter. 3. Character Voice: The squirrel's childlike voice, tinged with pride: "Just five more will be enough!" The voice ends with a light, cheerful tone. 4. Background Music: A light and cheerful xylophone solo, with a steady and elastic rhythm, and a crisp bell sound at the end of each measure, echoing the "sense of accomplishment in storing food."

[0065] Clicking can be done by clicking on an area of ​​a visualized image, while swiping can be done in a fixed direction or in any direction. Electronic devices have physical buttons that users can press to perform interactive actions. Preset interaction keywords can be interaction words corresponding to object category keywords; for example, if the object category keyword is "packaging box," the preset interaction keyword could be "open the packaging box." Shaking operations can be detected by installing a vibration sensor in the electronic device to detect shaking, or by acquiring the changes in the electronic device's posture at different times to determine whether a shaking operation has occurred.

[0066] The preset parts of the figurative graphic can be determined based on its appearance characteristics. For example, a squirrel's prominent feature is its large tail, so the preset part can be the squirrel's large tail. The preset movement trajectory can be related to the behavior of the preset part. For example, the large tail's behavior can be swaying, so the preset part moving according to the preset movement trajectory could be the squirrel's large tail swaying with a preset amplitude. Special effects include, but are not limited to, scattering flowers on the figurative graphic. The figurative graphic's voice can include its lines and tone of voice, so adjusting the figurative graphic's voice can be adjusting its lines and tone of voice. The pop-up window corresponding to the object category keyword can be set based on the object category keyword. For example, if the object category keyword is "packaging box," the pop-up window could show the treasures inside the box after it is opened.

[0067] Optionally, in the process of controlling the electronic device to display the image information of the key scene on the display interface, determining whether an interactive operation is detected includes: in the process of controlling the electronic device to output the picture book content of the key scene, controlling the electronic device to output prompt information to inform the user of the interactive operation that can be performed according to the interactive configuration information, and determining whether the interactive operation corresponding to the prompt information is detected.

[0068] The prompts for interactive actions can be used to instruct users to perform interactive actions that meet the triggering conditions.

[0069] Specifically, during the output of key scenes in a picture book story, prompts can be output according to the interactive configuration information corresponding to those key scenes. These prompts can be at least one of the following: text, audio, or video information. The picture book story can be output by displaying image information of each picture book scene on the electronic device's display interface and playing audio information from each picture book scene using an audio playback component.

[0070] For example, during the process of an electronic device displaying key scenes of a picture book, the voice prompt might say, "Little friend, you can click on the packaging box on the screen to see if there's treasure inside!" If a user's click on the visual representation of the packaging box in the picture book is detected, then the corresponding interactive response action will be executed based on the interaction configuration information. For example... Figure 2 and Figure 3 As shown, Figure 2 The electronic device's display screen shows key visual information. The target object is represented by a graphic of the packaging box. If a user clicks on the packaging box, a pop-up window displays the corresponding item inside. Figure 3 The squirrel doll shown.

[0071] Optionally, the picture book content of the key scene includes image information, and the image information contains a figurative graphic of the target object. The method for determining the picture book story corresponding to the object category keywords described above may include the following steps: based on the object category keywords, determining the image information and audio information of the picture book content for each scene in the picture book story; confirming that picture book content containing a figurative graphic of the target object in the image information and containing the object category keywords in the audio information belongs to a key scene; and setting interactive configuration information for the figurative graphic of the target object contained in the picture book content of the key scene.

[0072] In some application scenarios, the method described above for determining the image and audio information of each scene in a picture book story based on object category keywords can be as follows: The object category keywords are input into the picture book story generation model to obtain the image and audio information of each scene; alternatively, if the object category keywords are in a preset picture book story knowledge base, a preset picture book story corresponding to the object category keywords can be selected from the preset picture book story knowledge base as the picture book story. The preset picture book story knowledge base can store several picture book stories corresponding to object category keywords. If an object category keyword matching the object category keyword of the target object exists in the preset picture book story knowledge base, then it is determined that the object category keyword is in the preset picture book story knowledge base.

[0073] The image information in each scene of the picture book can include, but is not limited to, figurative graphics of the target object, the appearance of the story characters, the posture and movement trajectory of the figurative graphics, scene details, and other visual information. The picture book content of key scenes can also include audio information, which can include, but is not limited to, character voices, narration, background music, etc.

[0074] Optionally, the interaction configuration information may include prompts to inform users of interactive actions they can perform, triggering conditions for interactive actions, and interactive response actions.

[0075] The above-mentioned methods for setting interactive configuration information for the visual representation of target objects in the picture book content of key scenes may include: determining trigger conditions based on the usage of electronic devices; combining the trigger conditions with prompt information templates to obtain prompt information; acquiring the appearance features of the target object; and determining interactive response operations from the interactive configuration knowledge base based on object category keywords and appearance features.

[0076] The usage of electronic devices can be measured by the number of times a user performs various interactive actions while using the device. These actions can include, but are not limited to, clicking, swiping, and long-pressing. The most frequently used action can be selected as the trigger condition. The prompt message template can include fixed wording and templates with empty trigger conditions. Filling the trigger condition into the prompt message template will generate the prompt message in the interaction configuration information. For example, if the interactive action is clicking, the trigger condition could be clicking the graphic, and the prompt message could be, "Hello, little friend, try clicking the squirrel in the picture! You'll be pleasantly surprised!" The interactive response could be controlling the squirrel's tail to swing at a preset amplitude.

[0077] The appearance features of a target object may include, but are not limited to, its shape, color, texture, and special markings. These appearance features can be obtained by using a feature extraction model to extract features from the captured image.

[0078] The interactive configuration knowledge base can include combinations of appearance features and interactive response actions under several object category keywords. That is, the target object's object category keywords are matched with several object category keywords in the interactive configuration knowledge base, and combinations of appearance features and interactive response actions matching the target object's object category keywords are invoked from the interactive configuration knowledge base. The target object's appearance features are then matched with these combinations to obtain the corresponding interactive response action.

[0079] Following the previous example, the target object is a squirrel, whose appearance features include abundant fur, and the interactive response operation can include controlling the movement of the squirrel's fur.

[0080] In the above scheme, by determining the triggering conditions according to the usage of electronic devices, it can be ensured that the determined triggering conditions are not difficult for young children to operate, making it easy for children to actively perform interactive operations. In addition, the interactive response operation is adaptively set according to the appearance characteristics of the target object. Compared with performing the same interactive response operation on target objects with different appearance characteristics, the interactive response operation of this scheme depends more on the target object itself, making the interactive response operation highly related to the target object, and thus deepening the child's memory of the target object.

[0081] Optionally, the method of determining the image and audio information of each scene in a picture book story based on object category keywords may include: determining multi-dimensional attribute extraction rules for the target object based on object category keywords, with different multi-dimensional attribute extraction rules corresponding to different object category keywords; extracting feature information of the target object in multiple dimensions according to the multi-dimensional attribute extraction rules; scoring the feature information in each dimension and taking the feature information with the highest score as the target feature information, wherein the scoring dimensions include the uniqueness of the target object, its visual appeal, and its potential to trigger or resolve story conflicts; determining the protagonist's task, core conflict, solution to the core conflict, and emotional tone based on each target feature information; and determining the image and audio information of each scene's picture book content according to the protagonist's task, core conflict, solution to the core conflict, and emotional tone.

[0082] The multi-dimensional attribute extraction rules can include multiple dimensions for feature extraction. For example, for squirrels, the dimensions for feature extraction can include behavioral habits, physiological characteristics, and high-frequency activity scenarios. Specifically, the extracted features under the behavioral habits dimension include squirrel food storage, features under the physiological characteristics dimension include the squirrel's large tail, and features under the high-frequency activity scenario dimension include forest. The multi-dimensional attribute extraction rules corresponding to each object category keyword can be pre-defined.

[0083] The uniqueness of a target object can be assessed by whether the feature is shared by multiple objects; the fewer objects that share it, the more unique the feature is. Visual appeal can be assessed by whether the feature can be visually represented. For example, the handle structure of a cup can be visually represented, but the material of the cup cannot; therefore, the visual appeal of the handle structure is higher than that of the material. The potential for conflict can be assessed by whether the feature easily triggers story conflict, and the potential for resolving conflict can be assessed by whether the feature easily resolves story conflict. For example, the features of a sycamore tree include easily broken branches and green leaves; the potential for conflict arising from easily broken branches is higher than that from green leaves. The preset quantity can be pre-set based on object category keywords.

[0084] The main character's task can be the task that the target object needs to perform in the picture book story; the core conflict can be the problems that the target object may encounter in the process of performing the task; the solution to the core conflict can be the solution to the problems encountered; and the emotional tone can be considered as the emotion conveyed by the picture book story.

[0085] The method for determining the protagonist task based on the target feature information described above may include the following steps: determining the function of each target feature information, filtering each function to obtain the core function and the auxiliary functions used to support the core function, and then formulating the protagonist task corresponding to the target object based on the core function and the auxiliary functions. For example, the target feature information of the squirrel mentioned above mainly includes feature information under the behavioral habit feature dimension, such as squirrel food storage, and feature information under the physiological feature dimension, such as squirrel's large tail and sharp front claws. The core function is the function corresponding to the feature of food storage, such as storing food for winter. The auxiliary function can be the function corresponding to the large tail and sharp front claws, such as using the large tail to help balance and then using the sharp front claws to pick. Therefore, the final protagonist task can be that the squirrel uses its large tail to help balance and uses its sharp front claws to pick and store 10 pine cones for winter.

[0086] The above method of determining the core conflict based on the characteristic information of each target may include the following steps: determining the defects of the characteristic information of each target, and then formulating the core conflict based on each defect.

[0087] The above-mentioned method of determining the solution to the core conflict based on the target feature information may include the following steps: determining the feature information in each target feature information that can resolve the core conflict, and then formulating a solution to the core conflict based on the feature information.

[0088] The above-mentioned solution for determining the emotional tone based on the characteristic information of each target can include the following steps: According to the development of the story, determine the corresponding emotional tone for each story segment. For example, in the first act, the squirrel is diligently storing food, so the emotional tone is "hardworking"; in the second act, the pine cone falls, so the emotional tone is "anxious"; in the third act, the squirrel uses its front paws to retrieve the pine cone, so the emotional tone is "reassuring"; and in the fourth act, the squirrel shares the pine cone with other squirrels, so the emotional tone is "warmth".

[0089] The above method of determining the image and audio information of each scene of the picture book content according to the main character's task, the core conflict, the solution to the core conflict, and the emotional tone can be as follows: the object category keywords, the main character's task, the core conflict, the solution to the core conflict, and the emotional tone can be input into the picture book story generation model to obtain the image and audio information of each scene of the picture book content.

[0090] In the above approach, the most core features of the target object are used to construct the picture book story, which makes the constructed picture book story highly related to the target object. This reduces the degree of homogenization between picture book stories corresponding to different target objects and better helps children understand the feature differences between different objects.

[0091] Optionally, the above method of determining the core conflict and the solution to the core conflict based on each target feature information may include the following steps: determining the inherent advantages and potential defects corresponding to each target feature information; determining the core potential defects of the target object from the potential defects of each target feature information; determining the core conflict based on the core potential defects; determining the key advantages that can resolve the core conflict from each inherent advantage; and determining the solution to the core conflict based on the key advantages.

[0092] Inherent advantages can include the advantages that the target feature information possesses in the process of the target object performing the main task, while potential defects can include the defects that the target feature information may have in the process of the target object performing the main task.

[0093] A core potential flaw can be considered the most likely defect that the target object will encounter while performing its primary task. For example, the long fur on a squirrel's tail is a core potential flaw. Specifically, this flaw could mean that the squirrel's tail is prone to tangling, potentially causing it to lose its balance while carrying a pine cone, and in its panic, the pine cone might accidentally fall into a narrow crevice. A key advantage, on the other hand, can be one of the target object's many inherent strengths that can resolve this core conflict. For example, a squirrel's key advantage might be its sharp claws, which can be used to dig. The solution could be to use its sharp claws to gently dig around the crevice, widening it and exposing most of the pine cone, thus successfully retrieving it.

[0094] In the above scheme, the solution of setting core conflicts by using the core potential defects corresponding to the characteristic information of the target object and setting core conflicts by using the key advantages is to make the resulting picture book story highly related to the characteristic information of the target object, making it easier for children to understand the characteristics of the target object in depth, thereby deepening children's memory of the target object.

[0095] Optionally, the image information of the key scenes includes the appearance and display position of the figurative graphics. The method of determining the image information of each scene's picture book content according to the protagonist's task, core conflict, resolution of the core conflict, and emotional tone can include: extracting the appearance features of target objects in the image of interest to obtain the appearance features of the target objects; constructing the appearance of figurative graphics based on the appearance features; and determining the display position of the figurative graphics in the picture book content of the key scenes based on the protagonist's task, core conflict, resolution of the core conflict, and emotional tone.

[0096] The appearance features of the target object may include, but are not limited to, its shape, color, texture, and special markings. Based on these appearance features, a figurative graphic is constructed to resemble the target object, ensuring that the similarity between the figurative graphic's appearance features and the target object's appearance features is greater than or equal to a preset similarity. In other words, the constructed figurative graphic retains more of the target object's appearance features.

[0097] The placement of the visual image can be within the context of the image information. For example, if the squirrel's main task is to store food, and the core conflict is that its tail gets tangled while carrying pine cones, causing it to lose its balance and accidentally fall into a narrow crevice, the solution is to use its front paws to dig the soil and expose the pine cones. The emotional tone is one of actively solving the problem. In this process, the visual image could be placed where the squirrel is standing on a tree and then moves to the ground.

[0098] Optionally, after performing the interactive response operation corresponding to the interactive operation based on the interactive configuration information, the method further includes: controlling the electronic device to continue displaying the next scene of the picture book content; or, controlling the electronic device to display picture book content related to the picture book content belonging to the key scene in the picture book story.

[0099] The next scene in the picture book story is the scene following the currently displayed content. The picture book content related to the key scene can be content that is not the next scene, or it can be content that is directly displayed and displayed corresponding to the interaction if the child performs an interactive action in the key scene, instead of displaying the next scene in the order of the story.

[0100] For example, if the prompt in the interactive configuration information prompts the child to click on the cartoon box on the display interface, after the user clicks, in response to the click operation, the current interface can display a pop-up or the entire interface can jump to the state where the box is open and the treasure is displayed, and after holding for 3 seconds, it can jump back to the original storyline or jump to a scene of the picture book content in the specially designed subsequent storyline.

[0101] Optionally, the "back" button on the electronic device can exit the story card, control the electronic device to display preset homepage content, or control the electronic device to return to the step of displaying object category keywords.

[0102] like Figure 4 As shown, this embodiment of the invention provides a display control device for story cards in an electronic device. The display control device for story cards in an electronic device includes:

[0103] Display module 201 is used to display the object category keywords of the captured target object on the display interface of the electronic device;

[0104] The determination module 202 is used to determine the picture book story corresponding to the object category keyword in response to the selection operation of the story card in the electronic device, wherein the picture book story includes multiple scenes, and the picture book content of the key scenes in the multiple scenes contains interactive configuration information for the target object.

[0105] The interaction module 203 is used to respond to interactive operations on target objects in the picture book content during the process of controlling the electronic device to output the picture book content of each scene in the multi-scene. It executes the interactive response operation corresponding to the interactive operation according to the interactive configuration information.

[0106] Optionally, the picture book content of the key scene includes image information, and the image information contains a figurative graphic of the target object; in the process of controlling the electronic device to output the picture book content of each scene in the multi-scene, the interaction module 203, in response to the interactive operation on the target object in the picture book content, executes the interactive response operation corresponding to the interactive operation according to the interactive configuration information, specifically for:

[0107] During the process of controlling the electronic device to display key screen image information on the display interface, it is determined whether an interactive operation is detected. The interactive operation includes at least one of the following: clicking or sliding on the graphic, pressing the physical button of the electronic device, voice containing preset interactive keywords, and shaking the electronic device.

[0108] If the interactive operation is detected, at least one of the following interactive response operations is executed according to the interactive configuration information: controlling the preset part of the figurative graphic to move according to the preset motion trajectory, adding special effects to the figurative graphic, adjusting the character voice of the figurative graphic, and controlling the electronic device to display a pop-up window corresponding to the object category keyword on the display interface.

[0109] Optionally, the interaction module 203, in the process of controlling the electronic device to display image information of key scenes on the display interface, specifically determines whether an interactive operation is detected in the operation aspect of:

[0110] During the process of controlling the electronic device to output the picture book content of key scenes, the electronic device is controlled to output prompt information to inform the user of the interactive operations that can be performed according to the interactive configuration information, and it is determined whether the interactive operation corresponding to the prompt information is detected.

[0111] Optionally, the picture book content of the key scene includes image information, and the image information contains a figurative graphic of the target object; in determining the picture book story corresponding to the object category keyword, the determining module 202 is specifically used for:

[0112] Based on object category keywords, determine the image and audio information of each scene in the picture book story;

[0113] The picture book content that confirms the image information contains a visual representation of the target object and the audio information contains keywords related to the object category belongs to the key scene;

[0114] Set interactive configuration information for the visual representations of target objects contained in the key scenes of the picture book.

[0115] Optionally, in the operation of determining the image and audio information of each scene in a picture book story based on object category keywords, the determining module 202 is specifically used for:

[0116] Based on object category keywords, the multi-dimensional attribute extraction rules for the target object are determined. The multi-dimensional attribute extraction rules are different for different object category keywords.

[0117] Based on the multi-dimensional attribute extraction rules, extract the feature information of the target object in multiple dimensions;

[0118] The feature information under each dimension is scored, and the feature information with the highest score is selected as the target feature information. The scoring dimensions include the uniqueness of the target object, its visibility, and its potential to trigger or resolve story conflicts.

[0119] Based on the characteristic information of each target, the main character's task, core conflict, solution to the core conflict, and emotional tone are determined respectively.

[0120] Based on the main character's mission, the core conflict, the solution to the core conflict, and the emotional tone, determine the image and audio information for each scene of the picture book.

[0121] Optionally, in the operation of determining the core conflict and the solution to the core conflict based on the characteristic information of each target, the determining module 202 is specifically used for:

[0122] Identify the inherent advantages and potential disadvantages corresponding to each target feature;

[0123] Identify the core potential defects of the target object from the potential defects of each target feature information;

[0124] Identify the core conflicts based on the core potential flaws;

[0125] Identify the key advantages from among the existing strengths that can resolve the core conflict;

[0126] Identify solutions to core conflicts based on key strengths.

[0127] Optionally, the image information of key scenes includes the appearance and display position of the figurative graphics. In determining the image information of each scene's picture book content according to the protagonist's task, core conflict, the solution to the core conflict, and the emotional tone, the determining module 202 is specifically used for:

[0128] The appearance features of the target object in the image of interest are extracted to obtain the appearance features of the target object;

[0129] Based on the aforementioned appearance features, a figurative graphic appearance is constructed.

[0130] Based on the main character's mission, the core conflict, the solution to the core conflict, and the emotional tone, determine the display position of the visual graphics in the key scenes of the picture book.

[0131] like Figure 5 As shown, this embodiment of the invention also provides an electronic device, including a processor, which can execute the story card display control method of any of the above-mentioned electronic devices.

[0132] Specifically, it includes a processor 301 and a memory 302, as well as a computer program stored in the memory 302 and capable of running on the processor 301, which executes a method for displaying story cards of an electronic device, wherein:

[0133] The processor 301 executes the calculator program for the display control method of the story cards of the electronic device stored in the memory 302, and performs the following steps:

[0134] The object category keywords of the captured target object are displayed on the display interface of the electronic device;

[0135] In response to a selection operation of a story card in the electronic device, a picture book story corresponding to the object category keyword is determined, wherein the picture book story includes multiple acts, and the picture book content of the key acts in the multiple acts contains interactive configuration information for the target object;

[0136] During the process of controlling the electronic device to output the picture book content of each of the multiple scenes, in response to the interactive operation on the target object in the picture book content, the interactive response operation corresponding to the interactive operation is executed according to the interactive configuration information.

[0137] Optionally, the process executed by processor 301 to determine the picture book story corresponding to the object category keyword includes:

[0138] If the object category keyword is not in the preset picture book story knowledge base, the image information and audio information of each scene in the picture book story are determined based on the object category keyword.

[0139] For each scene of the picture book content, in response to the fact that the image information of the picture book content includes a figurative graphic of the target object and the audio information includes the object category keyword, it is determined that the picture book content belongs to a key scene;

[0140] Set the interactive configuration information for the visual representation of the target object contained in the picture book content of the key scene.

[0141] Optionally, the interactive configuration information includes prompts for informing users of interactive operations they can perform, triggering conditions for the interactive operations, and interactive response operations. The step of processor 301 setting the interactive configuration information for the figurative graphics of the target object contained in the picture book content of the key scene includes:

[0142] The triggering conditions are determined based on the usage of the electronic device;

[0143] The triggering condition is combined with the prompt message template to obtain the prompt message;

[0144] Obtain the appearance features of the target object;

[0145] Based on the object category keywords and the appearance features, the interactive response operation is determined from the interactive configuration knowledge base.

[0146] Optionally, the image and audio information of the picture book content for each scene in the picture book story, determined by the processor 301 based on the object category keywords, includes:

[0147] Based on the object category keywords, the multi-dimensional attribute extraction rules for the target object are determined. The multi-dimensional attribute extraction rules are different for different object category keywords.

[0148] According to the multi-dimensional attribute extraction rules, extract the feature information of the target object in multiple dimensions;

[0149] The feature information under each dimension is scored, and the feature information with the highest score is taken as the target feature information. The scoring dimensions include the uniqueness of the target object, its visibility, and its potential to trigger or resolve story conflicts.

[0150] Based on the target feature information, the main character's task, core conflict, solution to the core conflict, and emotional tone are determined respectively.

[0151] Based on the main character's mission, the core conflict, the solution to the core conflict, and the emotional tone, determine the image and audio information of each scene in the picture book.

[0152] Optionally, the processor 301 determines the core conflict and its solution based on the target feature information in the following ways:

[0153] Determine the inherent advantages and potential disadvantages corresponding to each of the target feature information;

[0154] The core potential defects of the target object are determined from the potential defects of each of the target feature information;

[0155] Based on the aforementioned core potential defects, the core conflict is identified;

[0156] Identify the key advantages from among the inherent advantages that can resolve the core conflict;

[0157] Based on the aforementioned key advantages, a solution to the core conflict is determined.

[0158] Optionally, the image information of the key scene includes the appearance and display position of the figurative graphic. The image information of the picture book content of each scene, executed by the processor 301 according to the protagonist's task, the core conflict, the solution to the core conflict, and the emotional tone, includes:

[0159] The appearance features of the target object in the image of interest are extracted to obtain the appearance features of the target object;

[0160] The appearance of the graphic is constructed based on the aforementioned appearance features;

[0161] Based on the main character's mission, the core conflict, the solution to the core conflict, and the emotional tone, determine the display position of the figurative graphics in the picture book content of the key scene.

[0162] Optionally, after executing the interactive response operation corresponding to the interactive operation based on the interactive configuration information, the method executed by the processor 301 further includes:

[0163] The electronic device is controlled to continue displaying the next scene of the picture book content;

[0164] Alternatively, the electronic device may be controlled to display picture book content related to the picture book content belonging to the key scene within the picture book story.

[0165] This invention also provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the various processes of the story card display control method of the electronic device provided in this invention and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0166] Those skilled in the art will understand that implementing all or part of the processes in the above embodiments can be accomplished by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0167] The above description discloses only preferred embodiments of the present invention and should not be construed as limiting the scope of the present invention. Therefore, equivalent variations made in accordance with the claims of the present invention are still within the scope of the present invention.

Claims

1. A method for displaying story cards in an electronic device, characterized in that, include: The object category keywords of the captured target object are displayed on the display interface of the electronic device; In response to a selection operation of a story card in the electronic device, a picture book story corresponding to the object category keyword is determined, wherein the picture book story includes multiple acts, and the picture book content of the key acts in the multiple acts contains interactive configuration information for the target object; During the process of controlling the electronic device to output the picture book content of each of the multiple scenes, in response to the interactive operation on the target object in the picture book content, the interactive response operation corresponding to the interactive operation is executed according to the interactive configuration information.

2. The method according to claim 1, characterized in that, The picture book content of the key scene includes image information, and the image information contains a figurative graphic representation of the target object; In the process of controlling the electronic device to output the picture book content of each of the multiple scenes, in response to the interactive operation on the target object in the picture book content, the interactive response operation corresponding to the interactive operation is executed according to the interactive configuration information, including: During the process of controlling the electronic device to display key screen image information on the display interface, it is determined whether an interactive operation is detected. The interactive operation includes at least one of the following: clicking or sliding on the graphic, pressing the physical button of the electronic device, voice containing preset interactive keywords, and shaking the electronic device. If the interactive operation is detected, at least one of the following interactive response operations is executed according to the interactive configuration information: controlling the preset part of the figurative graphic to move according to the preset motion trajectory, adding special effects to the figurative graphic, adjusting the character voice of the figurative graphic, and controlling the electronic device to display a pop-up window corresponding to the object category keyword on the display interface.

3. The method according to claim 2, characterized in that, In the process of controlling the electronic device to display image information of key scenes on the display interface, determining whether an interactive operation is detected includes: During the process of controlling the electronic device to output the picture book content of key scenes, the electronic device is controlled to output prompt information to inform the user of the interactive operations that can be performed according to the interactive configuration information, and it is determined whether the interactive operation corresponding to the prompt information is detected.

4. The method according to any one of claims 1 to 3, characterized in that, The picture book content of the key scene includes image information, and the image information contains a figurative graphic of the target object; determining the picture book story corresponding to the object category keyword includes: Based on the object category keywords, determine the image and audio information of each scene in the picture book story. The picture book content that confirms the image information contains a visual representation of the target object and the audio information contains keywords related to the object category belongs to the key scene; Set the interactive configuration information for the visual representation of the target object contained in the picture book content of the key scene.

5. The method as described in claim 4, characterized in that, The process of determining the image and audio information of each scene in the picture book story based on the object category keywords includes: Based on the object category keywords, the multi-dimensional attribute extraction rules for the target object are determined. The multi-dimensional attribute extraction rules are different for different object category keywords. According to the multi-dimensional attribute extraction rules, extract the feature information of the target object in multiple dimensions; The feature information under each dimension is scored, and the feature information with the highest score is taken as the target feature information. The scoring dimensions include the uniqueness of the target object, its visibility, and its potential to trigger or resolve story conflicts. Based on the target feature information, the main character's task, core conflict, solution to the core conflict, and emotional tone are determined respectively. Based on the main character's mission, the core conflict, the solution to the core conflict, and the emotional tone, determine the image and audio information of each scene in the picture book.

6. The method as described in claim 5, characterized in that, Based on the target feature information, the methods for determining the core conflict and its solution include: Determine the inherent advantages and potential disadvantages corresponding to each of the target feature information; The core potential defects of the target object are determined from the potential defects of each of the target feature information; Based on the aforementioned core potential defects, the core conflict is identified; Identify the key advantages from among the inherent advantages that can resolve the core conflict; Based on the aforementioned key advantages, a solution to the core conflict is determined.

7. The method as described in claim 5, characterized in that, The image information of the key scenes includes the appearance and display position of the figurative graphics. The image information for determining the picture book content of each scene according to the protagonist's task, the core conflict, the solution to the core conflict, and the emotional tone includes: The appearance features of the target object in the image of interest are extracted to obtain the appearance features of the target object; The appearance of the graphic is constructed based on the aforementioned appearance features; Based on the main character's mission, the core conflict, the solution to the core conflict, and the emotional tone, determine the display position of the figurative graphics in the picture book content of the key scene.

8. A display control device for story cards in an electronic device, characterized in that, include: The display module is used to display the object category keywords of the captured target object on the display interface of the electronic device. A determining module is configured to determine a picture book story corresponding to the object category keyword in response to a selection operation of a story card in the electronic device, wherein the picture book story includes multiple acts, and the picture book content of the key acts in the multiple acts contains interactive configuration information for the target object; The interaction module is used to respond to interactive operations on the target object in the picture book content during the process of controlling the electronic device to output the picture book content of each of the multiple scenes, and to execute the interactive response operation corresponding to the interactive operation according to the interactive configuration information.

9. An electronic device, characterized in that, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the steps in the method for displaying story cards of an electronic device as claimed in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps in the method for displaying story cards of an electronic device as described in any one of claims 1 to 7.

Images