Picture book display method and display equipment

Abstract

The invention relates to a picture book display method and display equipment, and relates to the technical field of display equipment. The method is applied to reality equipment and comprises the following steps: in response to an operation instruction of a picture book application, controlling a display to display a picture book display interface; responding to a playing instruction of the picture book in the picture book display interface, and controlling the display to play the selected target picture book in the picture book playing interface; when input picture book rewriting demand information is received, controlling the display to display a corresponding rewritten picture book page on a picture book playing interface; the picture book rewriting is used for rewriting picture book contents in a picture book page corresponding to the picture book rewriting demand information in the target picture book; when input picture book continuous writing demand information is received, controlling the display to display a corresponding continuous writing picture book page on a picture book playing interface; the picture book continuous writing is used for representing that a new picture book page is added before or after the picture book page corresponding to the picture book continuous writing demand information in the target picture book. According to the invention, the editing efficiency of the generated picture book can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a picture book display method and a display device. Background Art

[0002] With the development of artificial intelligence technology, smart devices in scenarios such as smart homes and smart life can understand users' language and intentions through technologies such as natural language processing, computer vision and machine learning, and automatically generate picture books with corresponding content.

[0003] In the prior art, when a generated picture book does not meet user expectations and the user wants to edit the picture book, such as rewriting or continuing it, the user usually re-submits a more detailed outline, and the background regenerates a complete picture book.

[0004] Therefore, the prior art has a technical problem that the editing process of the generated picture book is relatively complicated, which leads to low editing efficiency of the generated picture book. Summary of the invention

[0005] The present application provides a picture book display method and a display device method to solve the technical problem of low editing efficiency of a generated picture book.

[0006] In a first aspect, some embodiments provide a picture book display method, applied to a display device, comprising:

[0007] In response to an operation instruction of the picture book application, the display is controlled to display a picture book display interface; the picture book display interface displays a plurality of picture books for selection and playback;

[0008] In response to a picture book playback instruction, the display is controlled to play a selected target picture book on a picture book playback interface; the target picture book includes a plurality of picture book pages;

[0009] When receiving the input picture book rewriting requirement information, controlling the display to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface; the picture book rewriting is used to indicate rewriting the picture book content in the picture book page corresponding to the picture book rewriting requirement information in the target picture book;

[0010] When receiving the input picture book continuation requirement information, the display is controlled to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface; the picture book continuation is used to indicate adding a new picture book page before or after the picture book page corresponding to the picture book continuation requirement information in the target picture book.

[0011] Technical effect: By responding to the operation instructions of the picture book application, the display can be controlled to display the generated picture book in the picture book interface, so that the user can select the picture book for playback, which improves the interactive experience between the user and the display device. When the user inputs the picture book rewriting requirement information or the continuation requirement information, it can quickly respond and display the rewriting picture book page or the continuation picture book page corresponding to the requirement on the current playback interface, effectively improving the efficiency of rewriting or continuing the generated picture book.

[0012] In some embodiments of the present application, when receiving the input picture book rewriting requirement information, controlling the display to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface includes:

[0013] When receiving a rewrite instruction triggered by a target picture book played on the picture book playing interface, controlling the display to display a rewrite option on the picture book playing interface; the rewrite option represents an option for selecting to rewrite a picture book page in the target picture book;

[0014] In response to a selection instruction triggered by the rewriting option, receiving input picture book rewriting requirement information;

[0015] The display is controlled to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface.

[0016] Technical effect: By providing a rewrite option on the picture book playback interface, the interactivity between the user and the displayed target picture book can be enhanced; then the controller quickly responds to the selection instruction triggered by the rewrite option, and controls the display to display the rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface, thereby improving the efficiency of rewriting the picture book pages in the target picture book.

[0017] In some embodiments of the present application, controlling the display to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface includes:

[0018] Controlling the display to display the rewriting text information corresponding to the picture book rewriting requirement information on the picture book playback interface;

[0019] In response to a confirmation instruction for the rewriting text information, the display is controlled on the picture book playback interface to stop displaying the picture book page corresponding to the picture book rewriting requirement information, and to display the rewritten picture book page corresponding to the rewriting text information.

[0020] Technical effect: By responding to the operation instructions of the picture book application, the display can be controlled to display the generated picture book in the picture book interface, so that the user can select the picture book for playback, which improves the interactive experience between the user and the display device. When the user inputs the picture book rewriting requirement information or the continuation requirement information, it can quickly respond and display the rewriting picture book page or the continuation picture book page corresponding to the requirement on the current playback interface, effectively improving the efficiency of rewriting or continuing the generated picture book.

[0021] In some embodiments of the present application, after controlling the display to display the rewrite option on the picture book playback interface, the method further includes:

[0022] In response to a selection instruction for the rewriting option, controlling a sound receiving device on the display or a remote control device associated with the display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain voice input rewriting data;

[0023] The identification information of the picture book page corresponding to the voice input rewriting data and the selected instruction is set as the picture book rewriting requirement information.

[0024] Technical effect: After responding to the selection command for the rewriting option, it can flexibly select the far-field reception mode or the near-field reception mode to provide users with a variety of voice input methods; then the voice input rewriting data is associated with the identification information of the corresponding picture book page, and together they are used as picture book rewriting demand information, providing a reliable processing basis for subsequent rewriting of the picture book page.

[0025] In some embodiments of the present application, when receiving the input picture book rewriting requirement information, controlling the display to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface includes:

[0026] When receiving a rewriting instruction triggered by a target picture book selected on the picture book display interface, controlling a sound receiving device on the display or a remote control device associated with the display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain picture book rewriting requirement information in a voice format;

[0027] The display is controlled to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface.

[0028] Technical effect: respond to the rewriting instruction triggered by the target picture book selected on the picture book display interface, and then select far-field sound reception processing or near-field sound reception processing through the sound receiving device or the remote control device associated with the display device to obtain the picture book rewriting demand information in voice format, laying the foundation for the subsequent rewriting of the picture book page; then obtain the rewritten picture book page based on the picture book rewriting demand information, and display the rewritten page on the picture book playback interface, so that users can check the rewriting effect of the picture book page in time, thereby improving the convenience of rewriting the picture book page.

[0029] In some embodiments of the present application, the rewritten picture book page is obtained by:

[0030] Performing voice recognition processing on the picture book rewriting requirement information in voice format to obtain rewriting text information corresponding to the picture book rewriting requirement information;

[0031] Performing semantic recognition processing on the rewritten text information to obtain a picture book page corresponding to the picture book rewriting requirement information;

[0032] The rewritten text information is input into an image processing model to obtain a rewritten picture book page corresponding to the picture book rewriting requirement information; the rewritten picture book page represents a picture book page composed of a picture book image corresponding to the rewritten text information; the image processing model is used to perform image generation processing on the input rewritten text information to obtain a rewritten picture book page corresponding to the picture book rewriting requirement information.

[0033] Technical effect: By performing voice recognition processing on the picture book rewriting demand information in voice format, the user's rewriting intention can be captured efficiently and accurately, thereby generating the corresponding rewritten text information; through semantic recognition processing, the rewritten text information can be deeply understood, thereby accurately locating the picture book page corresponding to the picture book rewriting demand information; finally, the image processing model is used to perform image generation processing on the rewritten text information, so that users can not only obtain the rewritten version of the text, but also intuitively view the rewritten picture book page, effectively improving the efficiency and accuracy of rewriting picture books.

[0034] In some embodiments of the present application, when receiving the input picture book continuation requirement information, controlling the display to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface includes:

[0035] When receiving a continuation instruction triggered by a target picture book played on the picture book playing interface, controlling the display to display a continuation option on the picture book playing interface; the continuation option represents an option for selecting to continue writing a picture book page in the target picture book;

[0036] In response to a selection instruction triggered by the continuation option, receiving input picture book continuation requirement information;

[0037] Controlling the display to display the continuation text information corresponding to the picture book continuation requirement information on the picture book playback interface;

[0038] In response to a confirmation instruction for the continuation text information, the display is controlled to display a continuation picture book page corresponding to the continuation text information before or after the picture book page corresponding to the picture book continuation requirement information.

[0039] Technical effect: By providing a continuation option on the picture book playback interface, the interactivity between the user and the displayed target picture book can be enhanced; by quickly responding to the selection instruction triggered by the continuation option, the continuation picture book page corresponding to the continuation text information is displayed before or after the picture book page corresponding to the picture book continuation requirement information, thereby improving the efficiency of continuation processing for the picture book pages in the target picture book.

[0040] In some embodiments of the present application, the step of responding to the selection instruction triggered by the continuation option and receiving the input picture book continuation requirement information includes:

[0041] In response to a selection instruction triggered by the continuation option, controlling a sound receiving device on the display or a remote control device associated with the display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain voice input continuation data;

[0042] The voice input continuation data and the identification information of the picture book page corresponding to the selected instruction are set as the picture book continuation requirement information.

[0043] Technical effect: After responding to the selection command for the continuation option, it can flexibly select the far-field reception mode or the near-field reception mode to provide users with a variety of voice input methods; then the voice input continuation data is associated with the identification information of the corresponding picture book page and the continuation direction information, which are used together as the picture book continuation demand information, providing a reliable processing basis for the subsequent rewriting of the picture book page.

[0044] In some embodiments of the present application, when receiving the input picture book continuation requirement information, controlling the display to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface includes:

[0045] When receiving a continuing instruction triggered by a target picture book selected on the picture book display interface, controlling a sound receiving device on the display or a remote control device associated with the display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain picture book continuing demand information in a voice format;

[0046] The display is controlled to display the continued picture book page before or after the picture book page corresponding to the picture book continuation requirement information.

[0047] Technical effect: respond to the continuation instruction triggered by the target picture book selected on the picture book display interface, and then select far-field sound reception processing or near-field sound reception processing through the sound receiving device or the remote control device associated with the display device to obtain the picture book continuation demand information in voice format, laying the foundation for the subsequent continuation of the picture book page; and then display the forward-written continuation picture book page corresponding to the picture book page corresponding to the picture book continuation demand information before the picture book page, or display the forward-written continuation picture book page corresponding to the picture book page corresponding to the picture book continuation demand information after the picture book page, so that users can check the continuation effect of the picture book page in time, thereby improving the convenience of continuing the picture book page.

[0048] In a second aspect, some embodiments further provide a display device, comprising: a display and a controller. The controller is coupled to the display and is configured to:

[0049] In response to an operation instruction of the picture book application, the display is controlled to display a picture book display interface; the picture book display interface displays a plurality of picture books for selection and playback;

[0050] In response to a picture book playback instruction, the display is controlled to play a selected target picture book on a picture book playback interface; the target picture book includes a plurality of picture book pages;

[0051] When receiving the input picture book rewriting requirement information, controlling the display to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface; the picture book rewriting is used to indicate rewriting the picture book content in the picture book page corresponding to the picture book rewriting requirement information in the target picture book;

[0052] When receiving the input picture book continuation requirement information, the display is controlled to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface; the picture book continuation is used to indicate adding a new picture book page before or after the picture book page corresponding to the picture book continuation requirement information in the target picture book.

[0053] Technical effect: By responding to the operation instructions of the picture book application, the display can be controlled to display the generated picture book in the picture book interface, so that the user can select the picture book for playback, which improves the interactive experience between the user and the display device. When the user inputs the picture book rewriting requirement information or the continuation requirement information, it can quickly respond and display the rewriting picture book page or the continuation picture book page corresponding to the requirement on the current playback interface, effectively improving the efficiency of rewriting or continuing the generated picture book. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0055] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0056] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0057] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0058] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0059] Figure 5 A schematic diagram of a process of displaying a picture book provided in some embodiments of the present application;

[0060] Figure 6 A flowchart of steps for rewriting picture book pages corresponding to picture book rewriting requirement information provided in some embodiments of the present application;

[0061] Figure 7 A schematic diagram of an interface showing rewriting options in a picture book playback interface provided in some embodiments of the present application;

[0062] Figure 8 A flowchart of steps for obtaining picture book rewriting requirement information provided in some embodiments of the present application;

[0063] Fig. 9 A flowchart of steps for obtaining picture book rewriting requirement information in voice format provided in some embodiments of the present application;

[0064] Fig.10 A schematic diagram of an interface for a picture book display interface provided in some embodiments of the present application;

[0065] Fig.11 A flowchart of the steps of performing voice recognition processing on picture book rewriting requirement information in voice format provided in some embodiments of the present application;

[0066] Fig.12 A flowchart of steps for displaying a continue writing option on a picture book playback interface provided by some embodiments of the present application;

[0067] Fig.13 A flowchart of steps for controlling a display to display a picture book continuation page before or after a picture book page corresponding to picture book continuation requirement information provided in some embodiments of the present application;

[0068] Fig.14 A signaling interaction diagram of a picture book display method provided in some embodiments of the present application;

[0069] Fig.15 A structural block diagram of a picture book display device provided in some embodiments of the present application. DETAILED DESCRIPTION

[0070] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0071] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0072] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0073] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0074] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0075] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0076] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , the user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0077] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0078] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0079] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0080] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0081] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0082] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0083] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0084] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0085] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0086] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0087] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0088] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0089] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0090] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0091] Figure 3 Some embodiments of the present application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0092] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0093] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0094] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0095] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.

[0096] The communication interface 130 implements communication of control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.

[0097] The user input / output interface 140 , wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a button 144 .

[0098] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, and can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.

[0099] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0100] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0101] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0102] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0103] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0104] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0105] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0106] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0107] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0108] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0109] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 4As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0110] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0111] In some embodiments, a picture book display method is provided, which can be applied to Figure 1 The display device 200 shown in FIG. Figure 2 As shown, the display device 200 may include a display 260 and a controller 250; the display 260 is configured to display a user interface; the user interface includes at least a picture book display interface and a picture book playback interface; the controller 250 is coupled to the display 260; the method may include the following steps:

[0112] Step S501, responding to the operation instruction of the picture book application, controlling the display to display a picture book display interface; the picture book display interface displays a plurality of picture books for selection and playback.

[0113] Step S502, responding to the picture book playback instruction, controlling the display to play the selected target picture book on the picture book playback interface; the target picture book includes multiple picture book pages.

[0114] Step S503, when receiving the input picture book rewriting requirement information, control the display to display the rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface; picture book rewriting is used to indicate rewriting the picture book content in the picture book page corresponding to the picture book rewriting requirement information in the target picture book.

[0115] Step S504, when receiving the input picture book continuation requirement information, control the display to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface; picture book continuation is used to indicate adding a new picture book page before or after the picture book page corresponding to the picture book continuation requirement information in the target picture book.

[0116] Among them, picture books are books in video format that combine simple text, illustrations, audio readings and music.

[0117] The picture book application refers to an application used to generate and edit picture books. The picture book application can be set on a display device (such as a smart TV), on a web (webpage), or on a user terminal (such as a smart phone).

[0118] Among them, the picture book display interface refers to the interface for displaying the generated picture books.

[0119] Among them, the picture book playback interface refers to the interface for displaying the selected target picture book.

[0120] Among them, the picture book rewriting demand information refers to the demand information requesting to rewrite the generated picture book. Picture book rewriting refers to rewriting the picture book content in the picture book page corresponding to the picture book rewriting demand information in the target picture book, that is, picture book rewriting refers to rewriting the picture book content in the generated picture book page. Among them, the picture book content can be information such as text and images in the picture book page. It can be understood that the number of pages of the rewritten picture book and the number of pages of the picture book page corresponding to the picture book rewriting demand information remain unchanged.

[0121] Among them, the picture book continuation demand information refers to the demand information requesting the continuation of the generated picture book. Picture book continuation refers to adding a new picture book page before or after the picture book page corresponding to the picture book continuation demand information in the target picture book. For example, a new picture book page can be continued before or after the first picture book page, or before or after the last picture book page, or before or after the middle picture book page. It can be understood that the number of pages of the picture book after continuation is greater than the number of pages of the picture book corresponding to the picture book continuation demand information.

[0122] Specifically, the user operates the picture book application to view the picture book, and the controller 250 responds to the operation instruction of the picture book application, controls the display 260 to display the picture book display interface and displays multiple picture books for selection and playback on the picture book display interface. The user can select any picture book displayed in the picture book display interface for playback, and the controller 250 controls the display 260 to play the target picture book selected by the user on the picture book playback interface according to the triggered playback instruction. The user can also choose to rewrite any picture book page in the target picture book, and can also choose to continue writing on the basis of the existing picture book page of the target picture book; after the rewriting or continuation is completed, the controller 250 can also control the display 260 to display the rewritten picture book page or the continued picture book page on the picture book playback interface.

[0123] For example, the user can rewrite the first page, middle page or last page of the generated target picture book, and then replace the original picture book page with the newly generated rewritten picture book page to obtain the rewritten target picture book. The user can also continue writing forward or backward at any position in the generated target picture book, and then connect the newly generated continued picture book page with the original picture book page to obtain the continued target picture book.

[0124] The technical solution provided in this embodiment can control the display to display the generated picture book in the picture book interface by responding to the operation instructions of the picture book application, so that the user can select the picture book for playback, thereby improving the interactive experience between the user and the display device. When the user inputs the picture book rewriting requirement information or the continuation requirement information, it can quickly respond and display the rewriting picture book page or the continuation picture book page corresponding to the requirement on the current playback interface, effectively improving the efficiency of rewriting or continuing the generated picture book.

[0125] In some embodiments, Figure 6 As shown, in the above step S503, when the input picture book rewriting requirement information is received, the display is controlled to display the rewriting picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface, which specifically includes the following contents:

[0126] Step S601, when receiving a rewrite instruction triggered by a target picture book played on the picture book playing interface, controlling the display to display a rewrite option on the picture book playing interface; the rewrite option represents an option for selecting to rewrite a picture book page in the target picture book.

[0127] Step S602, responding to the selection instruction triggered by the rewriting option, receiving input picture book rewriting requirement information.

[0128] Step S603, controlling the display to display the rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface.

[0129] The rewrite option represents a virtual software button for triggering the rewrite process of the picture book page in the target picture book. The rewrite option can correspond to the picture book page one by one.

[0130] Specifically, in the process of playing the target picture book on the picture book playback interface, the user can trigger a rewrite instruction for the target picture book being played through a remote control device associated with a real device, a picture book application, etc. If the controller 250 receives a rewrite instruction, it controls the display 260 to display the rewrite option on the picture book playback interface. If the user wants to rewrite a picture book page, the rewrite option corresponding to the picture book page can be selected. The controller 250 responds to the selection instruction, obtains the picture book rewriting requirement information input by the user, and then rewrites the picture book page according to the picture book rewriting requirement information, and then controls the display to display the rewritten picture book page on the picture book playback interface.

[0131] For example, Figure 7 The interface diagram of the picture book playback interface showing the rewrite option. During the process of playing the target picture book, the rewrite option will be displayed below the currently displayed picture book page. If you want to rewrite the currently displayed picture book page, you can trigger the selection instruction of the rewrite option to enable the controller 250 to rewrite the picture book page.

[0132] The technical solution provided in this embodiment can enhance the interactivity between the user and the displayed target picture book by providing a rewrite option on the picture book playback interface; then the controller 250 quickly responds to the selection instruction triggered by the rewrite option, and controls the display 260 to display the rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface, thereby improving the efficiency of rewriting the picture book pages in the target picture book.

[0133] In some embodiments, the above step S603, controlling the display to display the rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface, specifically includes the following contents:

[0134] Control the display to display the rewritten text information corresponding to the picture book rewriting requirement information on the picture book playback interface; in response to a confirmation instruction for the rewriting text information, control the display to stop displaying the picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface, and display the rewritten picture book page corresponding to the rewriting text information.

[0135] Specifically, the controller 250 can convert the picture book rewriting requirement information into rewriting text information in text form by performing voice recognition processing on the picture book rewriting requirement information, and then control the display 260 to display the rewriting text information on the picture book playback interface for the user to view. After the user confirms that the displayed rewriting text information meets his picture book rewriting requirement information, he can send a confirmation instruction to the controller 250 through a remote control device associated with the display device, a picture book application, or voice input, and then the controller 250 rewrites the picture book page corresponding to the picture book rewriting requirement information, and controls the display to display the rewritten rewritten picture book page on the picture book playback interface.

[0136] The technical solution provided in this embodiment dynamically displays the rewritten text corresponding to the user's rewriting demand information on the picture book playback interface, so that the user can intuitively see the picture book content created or adjusted by himself, thereby improving the accuracy of picture book rewriting; after responding to the confirmation instruction, the original picture book page is switched to the rewritten picture book page, which is convenient for the user to check the rewriting effect of the picture book page in time, thereby improving the convenience of rewriting the picture book page.

[0137] In some embodiments, Figure 8 As shown, in the above step S601, after controlling the display to display the rewrite option on the picture book playback interface, the method further includes:

[0138] Step S801, in response to a selection instruction for a rewriting option, controls a sound receiving device on a display or a remote control device associated with a display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain voice input rewriting data.

[0139] Step S802, setting the voice input rewriting data and the identification information of the picture book page corresponding to the selected instruction as the picture book rewriting requirement information.

[0140] The sound receiving device may be a hardware device with a sound receiving function, such as a sound receiving microphone.

[0141] The remote control device refers to a tool for remotely controlling the display device. The remote control device usually uses wireless communication technology (such as infrared) to interact with the display device. For example, the remote control device can be a TV remote control.

[0142] Specifically, after the controller 250 receives a trigger for the rewriting option displayed in the picture book playback interface, it can also control the sound receiving device installed on the display 260 or the remote control device associated with the display device 200 to collect audio. For example, when the sound source is far away from the sound receiving device or the remote control device, the voice input rewriting data can be collected by far-field sound receiving. For example, when the sound source is close to the sound receiving device or the remote control device, the voice input rewriting data can be collected by near-field sound receiving. Since the rewriting options correspond to the picture book pages one by one, when the rewriting option is triggered, the controller 250 can also obtain the identification information of the picture book page corresponding to the rewriting option, and then confirm the voice input rewriting data and the identification information as the picture book rewriting demand information.

[0143] It is understandable that far-field sound pickup can capture a wide sound field and can record sounds in a wide range, including multiple sound sources and ambient sounds, but it may also reduce the clarity of the sound due to the long distance, or capture background noise. The microphone of near-field sound pickup is close to the sound source, and the background noise is usually less, so it is more focused on the required audio signal, but due to the narrow recording range, it may not be able to capture the complete ambient sound or multiple sound sources. Therefore, in actual applications, far-field sound pickup / near-field sound pickup can be flexibly selected according to needs.

[0144] For example, the user clicks the remote control to focus on a picture book page. At this time, voice input can be used, such as: "Rewrite this content to: the child cried loudly and knocked over the medicine bottle on the ground." The picture book application can then package the identification information corresponding to the picture book page and the voice input data collected by the microphone and send them to the controller 250.

[0145] The technical solution provided in this embodiment can flexibly select far-field sound reception mode or near-field sound reception mode in response to a selection instruction for a rewriting option, thereby providing users with a variety of voice input methods; and then associate the voice input rewriting data with the identification information of the corresponding picture book page, which together serve as picture book rewriting demand information, thereby providing a reliable processing basis for subsequent rewriting of the picture book page.

[0146] In some embodiments, Fig. 9 As shown, in the above step S503, when the input picture book rewriting requirement information is received, the display is controlled to display the rewriting picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface, which specifically includes the following contents:

[0147] Step S901, when receiving a rewriting instruction triggered by a target picture book selected on the picture book display interface, control the sound receiving device on the display or the remote control device associated with the display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain picture book rewriting requirement information in voice format.

[0148] Step S902, controlling the display to display the rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface.

[0149] Specifically, in addition to triggering the rewriting of the picture book page through the rewriting option displayed in the picture book playback interface, the user can also select the target picture book in the picture book display interface to trigger the rewriting instruction. At this time, the sound receiving device (such as a sound receiving microphone) installed on the display 260, or the remote control device associated with the display device (such as a TV remote control), performs audio collection and processing. For example, when the sound source is far away from the sound receiving device or the remote control device, the voice input rewriting data can be collected by far-field sound receiving. For example, when the sound source is close to the sound receiving device or the remote control device, the voice input rewriting data can be collected by near-field sound receiving. The controller 250 confirms the voice input rewriting data as the picture book rewriting demand information in the voice format, and then the controller 250 rewrites the picture book page corresponding to the picture book rewriting demand information, and controls the display to display the rewritten rewritten picture book page on the picture book playback interface.

[0150] Fig.10 This is a diagram of the picture book display interface. It should be noted that, Fig.10 As shown, since there is no actual rewrite option in the picture book playback interface, the identification information of the picture book page cannot be directly obtained through the rewrite instruction. Instead, it is necessary to parse the voice input rewrite data in voice format to determine the picture book page to be rewritten. Therefore, in this embodiment, only the voice input rewrite data in voice format needs to be confirmed as the picture book rewriting requirement information.

[0151] For example, the user controls the remote control to focus on a picture book, and then inputs a voice input such as "At the end, Yaowanwan invented a magical medicine. After taking it, children will never get sick again." The controller 250 rewrites the data by recognizing the voice input, and can obtain the user's intention to rewrite the picture book page corresponding to the "ending". The rewritten content is "Yaowanwan invented a magical medicine. After taking it, children will never get sick again."

[0152] The technical solution provided in this embodiment responds to the rewriting instruction triggered by the target picture book selected on the picture book display interface, and then selects far-field sound reception processing or near-field sound reception processing through a sound receiving device or a remote control device associated with the display device to obtain picture book rewriting demand information in voice format, laying a foundation for the subsequent rewriting of picture book pages; and then obtaining a rewritten picture book page based on the picture book rewriting demand information, and displaying the rewritten page on the picture book playback interface, so that users can check the rewriting effect of the picture book page in time, thereby improving the convenience of rewriting the picture book page.

[0153] In some embodiments, Fig.11 As shown, the rewritten picture book page is obtained by the following method:

[0154] Step S1101, performing voice recognition processing on the picture book rewriting requirement information in voice format to obtain rewriting text information corresponding to the picture book rewriting requirement information.

[0155] Step S1102, performing semantic recognition processing on the rewritten text information to obtain the picture book page corresponding to the picture book rewriting requirement information.

[0156] Step S1103, input the rewritten text information into the image processing model to obtain the rewritten picture book page corresponding to the picture book rewriting requirement information; the rewritten picture book page represents the picture book page composed of the picture book image corresponding to the rewritten text information; the image processing model is used to perform image generation processing on the input rewritten text information to obtain the rewritten picture book page corresponding to the picture book rewriting requirement information.

[0157] The rewriting text information refers to the picture book rewriting demand information expressed in text format.

[0158] Specifically, since the picture book rewriting requirement information in voice format does not contain the identification information of the picture book page corresponding to the picture book continuation requirement information, the controller 250 also needs to identify the rewriting text information corresponding to the picture book continuation requirement information from the picture book rewriting requirement information in voice format through voice recognition processing. Then the controller 250 can input the rewriting text information into the large language model to perform semantic recognition processing on the rewriting text information through the large language model, and output the semantic information corresponding to the rewriting text information; according to the semantic information, determine the picture book page corresponding to the picture book rewriting requirement information, for example, the semantic information can be "modify the end", then the picture book page corresponding to the picture book rewriting requirement information is the last page of the picture book. The controller 250 inputs the rewritten text information into the image processing model to perform image generation processing on the input rewritten text information through the image processing model, and then generates a rewritten picture book page corresponding to the rewritten text information; the controller 250 replaces the picture book page corresponding to the picture book rewriting requirement information with the rewritten picture book page corresponding to the rewritten text information, for example, replaces the last page of the picture book page with the rewritten picture book page corresponding to the rewritten text information.

[0159] The technical solution provided in this embodiment can efficiently and accurately capture the user's rewriting intention by performing voice recognition processing on the picture book rewriting demand information in voice format, thereby generating corresponding rewritten text information; through semantic recognition processing, it can deeply understand the rewritten text information, thereby accurately locating the picture book page corresponding to the picture book rewriting demand information; finally, the rewritten text information is processed by image generation using the Wenshengtu large model, so that the user can not only obtain the rewritten version of the text, but also intuitively view the rewritten picture book page, which effectively improves the efficiency and accuracy of rewriting the picture book.

[0160] In some embodiments, Fig.12As shown, in the above step S504, when the input picture book continuation requirement information is received, the display is controlled to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface, which specifically includes the following contents:

[0161] Step S1201, when receiving a continuation instruction triggered by a target picture book played on the picture book playing interface, controlling the display to display a continuation option on the picture book playing interface; the continuation option represents an option for selecting a picture book page in the target picture book to continue writing.

[0162] Step S1202, responding to the selection instruction triggered by the continuation option, receiving input picture book continuation requirement information.

[0163] Step S1203, controlling the display to display the picture book continuation text information corresponding to the picture book continuation requirement information on the picture book playback interface.

[0164] Step S1204, in response to a confirmation instruction for the continuation text information, the display is controlled to display a continuation picture book page corresponding to the continuation text information before or after the picture book page corresponding to the picture book continuation requirement information.

[0165] The continue option refers to a virtual software button for triggering the continue processing of the picture book page in the target picture book. The continue option can correspond to the picture book page one by one.

[0166] Specifically, Figure 7 As shown, in the process of playing the target picture book in the picture book playback interface, the user can trigger the continuation instruction for the target picture book being played through the remote control device associated with the real device, the picture book application, etc. If the controller 250 receives the continuation instruction, the control display 260 displays the continuation option in the picture book playback interface. If the user wants to continue writing a certain picture book page, the continuation option corresponding to the picture book page can be selected and processed. The controller 250 responds to the selection instruction, obtains the picture book continuation requirement information input by the user, and then continues the picture book page according to the picture book continuation requirement information, and obtains the display of the continuation picture book page. If the picture book continuation requirement information indicates that the writing is continued before the picture book page, the control display 260 displays the continuation picture book page before the picture book page; if the picture book continuation requirement information indicates that the writing is continued after the picture book page, the control display 260 displays the continuation picture book page after the picture book page.

[0167] The technical solution provided in this embodiment can enhance the interactivity between the user and the displayed target picture book by providing a continuation option on the picture book playback interface; by quickly responding to the selection instruction triggered by the continuation option, the continuation picture book page corresponding to the continuation text information is displayed before or after the picture book page corresponding to the picture book continuation requirement information, thereby improving the efficiency of continuation processing for the picture book pages in the target picture book.

[0168] In some embodiments, the above step S1202, in response to the selection instruction triggered by the continuation option, receives the input picture book continuation requirement information, specifically including the following contents:

[0169] In response to the selection command triggered by the continuation option, the sound receiving device on the display or the remote control device associated with the display device is controlled to perform far-field sound receiving processing or near-field sound receiving processing to obtain voice input continuation data; the identification information of the picture book page corresponding to the voice input continuation data and the selection command is set as the picture book continuation requirement information.

[0170] Specifically, after the controller 250 receives the selection instruction triggered by the continuation option displayed in the picture book playback interface, it can also control the sound receiving device installed on the display 260 or the remote control device associated with the display device 200 to collect audio. For example, when the sound originates from the sound receiving device or the remote control device is far away, the voice input continuation data can be collected by far-field sound receiving. For another example, when the sound originates from the sound receiving device or the remote control device is close, the voice input continuation data can be collected by near-field sound receiving. Since the continuation option corresponds to the picture book page one by one, when the rewrite option is triggered, the controller 250 can also obtain the identification information of the picture book page corresponding to the continuation option, and obtain the continuation direction information; wherein, the continuation direction information is used to indicate whether the picture book page corresponding to the continuation option is to be continued forward or backward; finally, the controller 250 confirms the voice input rewrite data, identification information and continuation direction information as picture book continuation demand information.

[0171] For example, the picture book continuation requirement information can indicate that the writing is continued after the fifth picture book page in the target picture book, such as continuing to write a target number of pages (such as 1 page, 2 pages) of new content. It can also indicate that the writing is continued before the fifth picture book page in the target picture book, such as continuing to write a target number of pages (new content.

[0172] The technical solution provided in this embodiment can flexibly select far-field reception mode or near-field reception mode in response to the selection instruction for the continuation option, providing users with a variety of voice input methods; then the voice input continuation data is associated with the identification information of the corresponding picture book page and the continuation direction information, which are used together as picture book continuation demand information, providing a reliable processing basis for subsequent rewriting of the picture book page.

[0173] In some embodiments, Fig.13 As shown, in the above step S504, when the input picture book continuation requirement information is received, the display is controlled to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface, which specifically includes the following contents:

[0174] Step S1301, when receiving a continuation instruction triggered by a target picture book selected on the picture book display interface, control the sound receiving device on the display or the remote control device associated with the display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain picture book continuation demand information in voice format.

[0175] Step S1302, controlling the display to display the picture book continuation page before or after the picture book page corresponding to the picture book continuation requirement information.

[0176] Specifically, in addition to triggering the continuation of the picture book page through the continuation option displayed in the picture book playback interface, the user can also select the target picture book in the picture book display interface to trigger the continuation instruction. At this time, the sound receiving device (such as a sound receiving microphone) installed on the display 260, or the remote control device associated with the display device (such as a TV remote control), performs audio collection and processing. For example, when the sound source is far away from the sound receiving device or the remote control device, the voice input rewriting data can be collected by far-field sound receiving. For example, when the sound source is close to the sound receiving device or the remote control device, the voice input continuation data can be collected by near-field sound receiving. The controller 250 confirms the voice input continuation data as the picture book continuation demand information in the voice format, and then the controller 250 performs forward continuation processing or forward continuation processing on the picture book page corresponding to the picture book continuation demand information, and controls the display 260 to display the continuation picture book page obtained by continuation before or after the picture book page corresponding to the picture book continuation demand information.

[0177] The technical solution provided in this embodiment responds to the continuation instruction triggered by the target picture book selected on the picture book display interface, and then selects far-field sound reception processing or near-field sound reception processing through a sound receiving device or a remote control device associated with the display device to obtain picture book continuation demand information in voice format, laying a foundation for the subsequent continuation of picture book pages; and then the forward-continuation picture book page corresponding to the picture book page corresponding to the picture book continuation demand information is displayed before the picture book page, or the forward-continuation picture book page corresponding to the picture book page corresponding to the picture book continuation demand information is displayed after the picture book page, so that users can check the continuation effect of the picture book page in time, thereby improving the convenience of continuing to write picture book pages.

[0178] In some embodiments, Figure 5 As shown, Figure 1 and 2 As shown, the present application provides a display device 200, which may include a display 260 and a controller 250; wherein the display 260 is configured to display a user interface; the user interface at least includes a picture book display interface and a picture book playback interface; the controller 250 is coupled to the display 260. The controller 250 is configured to:

[0179] Step S501, responding to the operation instruction of the picture book application, controlling the display to display a picture book display interface; the picture book display interface displays a plurality of picture books for selection and playback.

[0180] Step S502, responding to the picture book playback instruction, controlling the display to play the selected target picture book on the picture book playback interface; the target picture book includes multiple picture book pages.

[0181] Step S503, when receiving the input picture book rewriting requirement information, control the display to display the rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface; picture book rewriting is used to indicate rewriting the picture book content in the picture book page corresponding to the picture book rewriting requirement information in the target picture book.

[0182] Step S504, when receiving the input picture book continuation requirement information, control the display to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface; picture book continuation is used to indicate adding a new picture book page before or after the picture book page corresponding to the picture book continuation requirement information in the target picture book.

[0183] It should be noted that for the specific implementation process of the controller 250, reference can be made to Figure 5 The relevant embodiments of the picture book display method shown are not described in detail here.

[0184] The technical solution provided in this embodiment can control the display to display the generated picture book in the picture book interface by responding to the operation instructions of the picture book application, so that the user can select the picture book for playback, thereby improving the interactive experience between the user and the display device. When the user inputs the picture book rewriting requirement information or the continuation requirement information, it can quickly respond and display the rewriting picture book page or the continuation picture book page corresponding to the requirement on the current playback interface, effectively improving the efficiency of rewriting or continuing the generated picture book.

[0185] In some embodiments, the controller 250 is further configured to:

[0186] When a rewrite instruction is received that is triggered by a target picture book played on the picture book playback interface, the display is controlled to display a rewrite option on the picture book playback interface; the rewrite option represents an option for selecting to rewrite a picture book page in the target picture book; in response to a selection instruction triggered by the rewrite option, input picture book rewriting requirement information is received; and the display is controlled to display a rewrite picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface.

[0187] In some embodiments, the controller 250 is further configured to:

[0188] Control the display to display the rewritten text information corresponding to the picture book rewriting requirement information on the picture book playback interface; in response to a confirmation instruction for the rewriting text information, control the display to stop displaying the picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface, and display the rewritten picture book page corresponding to the rewriting text information.

[0189] In some embodiments, the controller 250 is further configured to:

[0190] In response to a selection instruction for a rewriting option, a sound receiving device on a display or a remote control device associated with a display device is controlled to perform far-field sound receiving processing or near-field sound receiving processing to obtain voice input rewriting data; the identification information of the picture book page corresponding to the voice input rewriting data and the selection instruction is set as picture book rewriting requirement information.

[0191] In some embodiments, the controller 250 is further configured to:

[0192] When a rewriting instruction is received that is triggered by a target picture book selected on the picture book display interface, the sound receiving device on the display or the remote control device associated with the display device is controlled to perform far-field sound receiving processing or near-field sound receiving processing to obtain picture book rewriting demand information in a voice format; the display is controlled to display a rewritten picture book page corresponding to the picture book rewriting demand information on the picture book playback interface.

[0193] In some embodiments, the controller 250 is further configured to:

[0194] Perform voice recognition processing on the picture book rewriting demand information in voice format to obtain rewritten text information corresponding to the picture book rewriting demand information; perform semantic recognition processing on the rewritten text information to obtain a picture book page corresponding to the picture book rewriting demand information; input the rewritten text information into an image processing model to obtain a rewritten picture book page corresponding to the picture book rewriting demand information; the rewritten picture book page represents a picture book page composed of a picture book image corresponding to the rewritten text information; the image processing model is used to perform image generation processing on the input rewritten text information to obtain a rewritten picture book page corresponding to the picture book rewriting demand information.

[0195] In some embodiments, the controller 250 is further configured to:

[0196] When receiving a continuation instruction triggered by a target picture book played on a picture book playback interface, the display is controlled to display a continuation option on the picture book playback interface; the continuation option represents an option for selecting a picture book page in the target picture book to continue writing; in response to a selection instruction triggered by the continuation option, input picture book continuation requirement information is received; the display is controlled to display continuation text information corresponding to the picture book continuation requirement information on the picture book playback interface; in response to a confirmation instruction for the continuation text information, the display is controlled to display the continuation picture book page corresponding to the continuation text information before or after the picture book page corresponding to the picture book continuation requirement information.

[0197] In some embodiments, the controller 250 is further configured to:

[0198] In response to the selection command triggered by the continuation option, the sound receiving device on the display or the remote control device associated with the display device is controlled to perform far-field sound receiving processing or near-field sound receiving processing to obtain voice input continuation data; the identification information of the picture book page corresponding to the voice input continuation data and the selection command is set as the picture book continuation requirement information.

[0199] In some embodiments, the controller 250 is further configured to:

[0200] When a continuation instruction is received that is triggered by a target picture book selected on the picture book display interface, the sound receiving device on the display or the remote control device associated with the display device is controlled to perform far-field sound receiving processing or near-field sound receiving processing to obtain picture book continuation demand information in a voice format; the display is controlled to display the continuation picture book page before or after the picture book page corresponding to the picture book continuation demand information.

[0201] In some embodiments, Fig.14 As shown, in order to more clearly describe the signaling interaction process between the modules of the display device, the present application also provides another picture book display method, which may include the following steps:

[0202] Step 1: The picture book control in the control center receives the content input by the user.

[0203] Step 2: The picture book central control initiates a data pull request to the database (including a character information pull request, a theme pull request, a style information pull request, and a broadcast tone id pull request).

[0204] Step 3: The database returns character information, theme, style information, character reference features and broadcast tone ID to the picture book central control.

[0205] Step 4: The picture book central control passes the user input content and the character information obtained from the database to the rewriting / continuation module in the multimodal generation model.

[0206] Step 5: The rewriting / continuation module processes the received information and generates corresponding content.

[0207] Step 6: The rewriting / continuation module passes the generated content to the text and picture rewriting module, and can also send the content to the picture book central control.

[0208] Step 7: The text-to-raw image rewriting module converts the received content into prompt words suitable for raw images.

[0209] Step 8: The text-image rewriting module transmits the converted prompt words to the text-image module.

[0210] Step 9: The text image module generates a composite image according to the prompt word (in which the style model can be switched), and returns the composite image to the picture book control.

[0211] Step 10: The speech synthesis module receives the announcement tone ID sent by the picture book central control, generates a speech announcement and returns it to the picture book central control.

[0212] Step 11, the music generation module receives the theme information and style information sent by the picture book central control, generates background music based on the theme information and style information, and returns it to the picture book central control.

[0213] Step 12: The picture book central control stores the key information into the database (updates the content) and returns the image / broadcast audio / background audio to the user.

[0214] The technical solution provided in this embodiment obtains theme information, role information, role reference information, style information and broadcast tone information from a database according to a picture book identifier corresponding to picture book update requirement information, which is conducive to quickly obtaining multi-dimensional information related to the picture book and avoiding repeated information collection; generates picture book text content based on text information and role information through a large language model, and performs picture book image generation processing based on picture book text content, style information and role reference information, which is conducive to maintaining the coherence and consistency of updated content with original content; automatically generates broadcast audio and background music, and updates the picture book according to the updated picture book image, broadcast audio and background music, which is conducive to realizing automatic updating of picture books and reducing manual operation steps, thereby helping to improve the updating efficiency of picture books.

[0215] The technical solution provided in this embodiment automatically extracts subject information and role information from text information through a large language model, which is conducive to reducing the time for manual analysis and extraction of key information; automatically generates initial text content based on the extracted information and uses a large language model to adjust the text, which is conducive to quickly generating high-quality content; automatically generates picture book images and synthesizes picture books, which is conducive to reducing the workload of manual creation and editing; this full-process automated processing method is conducive to improving the efficiency of picture book generation.

[0216] In some embodiments, in order to more clearly illustrate the picture book display method provided in the embodiments of the present application, the picture book display method is specifically described below using a specific embodiment.

[0217] (1) On the user interface of the picture book application, a voice input box for inputting picture book rewriting / continuation requirements is displayed.

[0218] (2) In the voice input box, the text information corresponding to the picture book rewriting voice or picture book continuation voice input by the user is displayed.

[0219] To give an example of rewriting a picture book, it can be: 1. Press the menu button on the TV remote control to pop up the rewrite option, select the rewrite option and enter, then the TV starts far-field / near-field reception, input the rewritten text by voice, then press the confirmation button to start rewriting; 2. Directly press the near-field voice button on the TV remote control to enter the rewriting content reception and recording, then press the confirmation button to start rewriting.

[0220] To give an example of continuing writing in a picture book, it can be: use the TV remote control to switch to the page that needs to be continued, press the menu button on the TV remote control, and select Continue forward / Continue forward. At this time, the TV starts to receive far-field / near-field sound, and the text to be continued forward / continued is input by voice. Then click the confirmation button to start continuing writing.

[0221] (3) When a picture book corresponding to the input picture book rewriting voice or picture book continuation voice has been successfully generated, the picture book corresponding to the input picture book rewriting voice or picture book continuation voice is displayed; the picture book outputs a rewritten picture book image or a continued picture book image corresponding to the text information through the large language model, and is generated based on the rewritten picture book image or the continued picture book image, the historical picture book image, the background sound, and the reading sound.

[0222] The technical solution provided in this embodiment is that the large language model outputs the corresponding rewritten picture book image or the continued picture book image based on the text information corresponding to the input picture book rewritten voice or the picture book continuation voice, and generates a picture book corresponding to the input picture book rewritten voice or the picture book continuation voice in combination with the historical picture book image, background sound, and reading sound. There is no need to re-execute the picture book generation process, and only the input picture book rewritten voice or picture book continuation voice needs to be analyzed, and there is no need to analyze a more detailed summary, thereby simplifying the picture book update process and improving the picture book update efficiency.

[0223] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0224] Based on the same inventive concept, the embodiment of the present application also provides a picture book display device for implementing the picture book display method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more picture book display device embodiments provided below can refer to the limitations of the picture book display method above, and will not be repeated here.

[0225] In some embodiments, Fig.15 As shown, a picture book display device 1500 is provided, which can be applied to Figure 1 The display device 200 shown in FIG. Figure 2 As shown, the display device 200 includes a display 260 and a controller 250; the display 260 is configured to display a user interface; the user interface includes at least a picture book display interface and a picture book playback interface; the controller 250 is coupled to the display 260; the device may include:

[0226] The picture book display module 1501 is used to respond to the operation instructions of the picture book application and control the display to display the picture book display interface; the picture book display interface displays multiple picture books for selection and playback.

[0227] The picture book playing module 1502 is used to respond to the picture book playing instruction and control the display to play the selected target picture book in the picture book playing interface; the target picture book includes multiple picture book pages.

[0228] The picture book rewriting module 1503 is used to control the display to display the rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface when receiving the input picture book rewriting requirement information; picture book rewriting is used to indicate rewriting the picture book content in the picture book page corresponding to the picture book rewriting requirement information in the target picture book.

[0229] The picture book continuation module 1504 is used to control the display to display the continuation picture book page corresponding to the picture book continuation demand information on the picture book playback interface when receiving the input picture book continuation demand information; picture book continuation is used to indicate adding a new picture book page before or after the picture book page corresponding to the picture book continuation demand information in the target picture book.

[0230] Each module in the above picture book display device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0231] In some embodiments, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0232] In some embodiments, a computer program product is provided, including a computer program, which implements the steps in the above-mentioned method embodiments when executed by a processor.

[0233] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0234] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0235] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0236] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A picture book display method, characterized in that: Applied to display devices, including: In response to an operation instruction of the picture book application, the display is controlled to display a picture book display interface; the picture book display interface displays a plurality of picture books for selection and playback; In response to a picture book playback instruction, the display is controlled to play a selected target picture book on a picture book playback interface; the target picture book includes a plurality of picture book pages; When receiving the input picture book rewriting requirement information, controlling the display to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface; the picture book rewriting is used to indicate rewriting the picture book content in the picture book page corresponding to the picture book rewriting requirement information in the target picture book; When receiving the input picture book continuation requirement information, the display is controlled to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface; the picture book continuation is used to indicate adding a new picture book page before or after the picture book page corresponding to the picture book continuation requirement information in the target picture book.

2. The method according to claim 1, characterized in that When receiving the input picture book rewriting requirement information, controlling the display to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface includes: When receiving a rewrite instruction triggered by a target picture book played on the picture book playing interface, controlling the display to display a rewrite option on the picture book playing interface; the rewrite option represents an option for selecting to rewrite a picture book page in the target picture book; In response to a selection instruction triggered by the rewriting option, receiving input picture book rewriting requirement information; The display is controlled to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface.

3. The method according to claim 2, characterized in that The controlling the display to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface includes: Controlling the display to display the rewriting text information corresponding to the picture book rewriting requirement information on the picture book playback interface; In response to a confirmation instruction for the rewriting text information, the display is controlled on the picture book playback interface to stop displaying the picture book page corresponding to the picture book rewriting requirement information, and to display the rewritten picture book page corresponding to the rewriting text information.

4. The method according to claim 2, characterized in that: After controlling the display to display the rewrite option on the picture book playback interface, the method further includes: In response to a selection instruction for the rewriting option, controlling a sound receiving device on the display or a remote control device associated with the display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain voice input rewriting data; The identification information of the picture book page corresponding to the voice input rewriting data and the selected instruction is set as the picture book rewriting requirement information.

5. The method according to claim 1, characterized in that When receiving the input picture book rewriting requirement information, controlling the display to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface includes: When receiving a rewriting instruction triggered by a target picture book selected on the picture book display interface, controlling a sound receiving device on the display or a remote control device associated with the display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain picture book rewriting requirement information in a voice format; The display is controlled to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface.

6. The method according to claim 5, characterized in that The rewritten picture book page is obtained by the following method: Performing voice recognition processing on the picture book rewriting requirement information in voice format to obtain rewriting text information corresponding to the picture book rewriting requirement information; Performing semantic recognition processing on the rewritten text information to obtain a picture book page corresponding to the picture book rewriting requirement information; The rewritten text information is input into an image processing model to obtain a rewritten picture book page corresponding to the picture book rewriting requirement information; the rewritten picture book page represents a picture book page composed of a picture book image corresponding to the rewritten text information; the image processing model is used to perform image generation processing on the input rewritten text information to obtain a rewritten picture book page corresponding to the picture book rewriting requirement information.

7. The method according to claim 1, characterized in that When receiving the input picture book continuation requirement information, controlling the display to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface includes: When receiving a continuation instruction triggered by a target picture book played on the picture book playing interface, controlling the display to display a continuation option on the picture book playing interface; the continuation option represents an option for selecting to continue writing a picture book page in the target picture book; In response to a selection instruction triggered by the continuation option, receiving input picture book continuation requirement information; Controlling the display to display the continuation text information corresponding to the picture book continuation requirement information on the picture book playback interface; In response to a confirmation instruction for the continuation text information, the display is controlled to display a continuation picture book page corresponding to the continuation text information before or after the picture book page corresponding to the picture book continuation requirement information.

8. The method according to claim 7, characterized in that The step of responding to the selection instruction triggered by the continuation option and receiving input picture book continuation requirement information includes: In response to a selection instruction triggered by the continuation option, controlling a sound receiving device on the display or a remote control device associated with the display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain voice input continuation data; The voice input continuation data and the identification information of the picture book page corresponding to the selected instruction are set as the picture book continuation requirement information.

9. The method according to claim 1, characterized in that: When receiving the input picture book continuation requirement information, controlling the display to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface includes: When receiving a continuing instruction triggered by a target picture book selected on the picture book display interface, controlling a sound receiving device on the display or a remote control device associated with the display device to perform far-field sound receiving processing or near-field sound receiving processing to obtain picture book continuing demand information in a voice format; The display is controlled to display the continued picture book page before or after the picture book page corresponding to the picture book continuation requirement information.

10. A display device, characterized in that: include: monitor; A controller is coupled to the display and is configured to: In response to an operation instruction of the picture book application, the display is controlled to display a picture book display interface; the picture book display interface displays a plurality of picture books for selection and playback; In response to a picture book playback instruction, the display is controlled to play a selected target picture book on a picture book playback interface; the target picture book includes a plurality of picture book pages; When receiving the input picture book rewriting requirement information, controlling the display to display a rewritten picture book page corresponding to the picture book rewriting requirement information on the picture book playback interface; the picture book rewriting is used to indicate rewriting the picture book content in the picture book page corresponding to the picture book rewriting requirement information in the target picture book; When receiving the input picture book continuation requirement information, the display is controlled to display the continuation picture book page corresponding to the picture book continuation requirement information on the picture book playback interface; the picture book continuation is used to indicate adding a new picture book page before or after the picture book page corresponding to the picture book continuation requirement information in the target picture book.

Images