Content delivery device

Abstract

To provide a terminal device and a content provider device that allow users to enjoy related scenes from manga and animation in parallel. [Solution] The terminal device includes a reception unit that receives a user's switching instruction to switch to displaying a second scene related to the first scene of either an animation provided by a linked animation application or a comic provided by a comic application while the display device is displaying the first scene of the other content; a communication control unit that acquires data including the second scene from a server; and a display control unit that switches the display on the display device from the first scene to the second scene in response to the switching instruction.

Description

Technical Field

[0001] The present disclosure relates to a terminal device and a content providing device.

Background Art

[0002] Techniques for viewing contents such as comics and animations on a terminal device such as a smartphone are known. A user can view each of different contents such as comics and animations via one terminal device.

[0003] In Patent Document 1, a service for distributing a plurality of different types of contents such as videos or e-books to a terminal device is known. In order to use both a video service and an e-book service, it is necessary to install dedicated software for each.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In order to use a plurality of contents in a terminal device as in the technology described in Patent Document 1, it is necessary to install an application corresponding to each content. For this reason, for example, when a user wants to view comics and animations, it is necessary to install an application for viewing comics and an application for viewing animations on the terminal device. By installing these applications, the user can view each of comics and animations.

[0006] However, conventionally, if a user wants to see a related scene in a manga while watching an animation, they need to operate the corresponding icon in the manga application to display the manga on their device instead of the animation. Then, the user has to find the related scene in the manga themselves. This is very cumbersome. For this reason, with conventional technology, it is difficult to enjoy related scenes from both manga and animation simultaneously on a single device. [Means for solving the problem]

[0007] To solve the above problems, a terminal device according to a preferred embodiment of the present disclosure includes: a reception unit that receives a user's switching instruction to switch to displaying a second scene related to the first scene of either an animation provided by a linked animation application or a comic provided by a comic application while the display device is displaying a first scene of the other content; a communication control unit that acquires data including the second scene from a server; and a display control unit that switches the display of the display device from the first scene to the second scene in response to the switching instruction.

[0008] A content providing device according to a preferred embodiment of the present disclosure includes: a linking unit that links animation data executed by an animation application installable on a terminal device with manga data executed by a manga application installable on the terminal device; a request receiving unit that receives a switching request from a user to switch from one of the contents, either the animation from the animation application or the manga from the manga application, via the terminal device while the display device of the terminal device is displaying one of the contents; and a data providing unit that, in response to the switching request, provides the terminal device with data including a second scene of the other content related to the first scene, instead of providing data including a first scene of the one content. [Effects of the Invention]

[0009] According to this disclosure, it is possible to enjoy related scenes from manga and animation simultaneously on a single terminal device. [Brief explanation of the drawing]

[0010] [Figure 1] This is a diagram showing the content provision system of the first embodiment. [Figure 2] Figure 1 is a block diagram of an example configuration of the terminal device shown. [Figure 3] Figure 2 shows examples of manga icons and animation icons that can be displayed on the screen of the display device shown. [Figure 4] Figure 2 shows an example of a comic strip displayed on the screen of the display device shown. [Figure 5] Figure 2 shows an example of an animation displayed on the screen of the display device shown. [Figure 6] Figure 2 shows an example of a cartoon-style operation screen displayed on the screen of the display device shown. [Figure 7] Figure 2 shows an example of an animated operation screen displayed on the screen of the display device shown. [Figure 8] This is an example of data for a request to switch from manga to animation. [Figure 9] This is an example of data for a request to switch from animation to comics. [Figure 10] Figure 1 is a block diagram of an example configuration of the content delivery device shown. [Figure 11] Figure 10 shows an example of an animation data file. [Figure 12] Figure 10 shows an example of an animation list file. [Figure 13] Figure 10 shows an example of a manga data file. [Figure 14] Figure 10 shows an example of a manga list file. [Figure 15] Figure 10 shows an example of a related information file. [Figure 16]An example of comic character data shown in FIG. 10. [Figure 17] An example of animation character data shown in FIG. 10. [Figure 18] An example of comic dialogue data shown in FIG. 10. [Figure 19] An example of animation dialogue data shown in FIG. 10. [Figure 20] A diagram showing an overview of the first learning model shown in FIG. 10. [Figure 21] A diagram showing an overview of the second learning model shown in FIG. 10. [Figure 22] A diagram for explaining the second learning model of FIG. 21. [Figure 23] A diagram showing an overview of the third learning model shown in FIG. 10. [Figure 24] A diagram showing an overview of the fourth learning model shown in FIG. 10. [Figure 25] A diagram showing an overview of the fifth learning model shown in FIG. 10. [Figure 26] A flowchart showing an example of the operation of switching from the first scene of a comic to the second scene of an animation. [Figure 27] A flowchart showing the generation of a relationship information file.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments according to the present disclosure will be described with reference to the drawings. The embodiments described below are preferred specific examples of the present disclosure. For this reason, various technically preferable limitations are imposed on the embodiments. However, the scope of the present disclosure is not limited to these forms unless there is a description to specifically limit the present disclosure in the following description.

[0012] 1. First Embodiment 1-1. Overall Configuration Figure 1 shows a content provision system 100 according to the first embodiment. As shown in Figure 1, the content provision system 100 comprises a content provision device 10 and terminal devices 30-1, 30-2, ... 30-K, ... 30-N. N is an integer of 1 or more. K is an integer between 1 and N. The content provision system 100 is a client-server system. Terminal device 30 corresponds to a client. The content provision device 10 is a server.

[0013] In this embodiment, the multiple terminal devices 30-1 to 30-N have the same configuration. However, configurations that are not identical may be included. Furthermore, each of the multiple terminal devices 30-1 to 30-N communicates with each other via the content provisioning device 10 and a communication network 50 such as the Internet. Hereafter, if the multiple terminal devices 30-1 to 30-N are not distinguished, they will be referred to as terminal device 30. The owners of terminal devices 30-1, 30-2, ... 30-K, ... 30-N will be referred to as users U1, U2, ... UK, ... UN. The owner of terminal device 30 will be referred to as user U.

[0014] The content provider 10 provides content such as animation A1 and manga M1 to multiple terminal devices 30-1 to 30-N.

[0015] Terminal device 30 has an animation application installed for viewing animation A1 and a manga application installed for viewing manga M1. Furthermore, for example, user U can view the content on terminal device 30 by streaming, simultaneously receiving and playing the content data.

[0016] Furthermore, the terminal device 30 can automatically switch the display from the first scene of one of the contents, animation A1 or comic M1, to the second scene of the other related content, in response to the user U's request.

[0017] 1-1a. Terminal device 30 Figure 2 is a block diagram of an example configuration of the terminal device 30 shown in Figure 1. Examples of terminal devices 30 include mobile information terminals such as smartphones and tablets, personal computers, and wearable devices.

[0018] The terminal device 30 comprises a processing unit 31, a storage device 32, a communication device 33, a display device 34, and an input device 35. Each element of the terminal device 30 is interconnected using one or more buses for communicating information.

[0019] The processing unit 31 is a processor that controls the entire terminal device 30. The processing unit 31 is configured using, for example, one or more chips. The processing unit 31 includes, for example, a central processing unit (CPU) including an arithmetic unit and registers. Some or all of the functions of the processing unit 31 may be implemented using hardware such as a DSP, ASIC, PLD, FPGA, etc. The processing unit 31 executes various processes in parallel or sequentially.

[0020] The storage device 32 is a recording medium that can be read from and written to by the processing device 31. The storage device 32 stores multiple programs executed by the processing device 31, as well as various data files. Specifically, the storage device 32 stores the executable program P1. By executing the executable program P1, the processing device 31 performs the functions described below.

[0021] The communication device 33 is hardware that acts as a transmitting and receiving device for communicating with the content provision device 10. The communication device 33 is also called, for example, a network device, a network controller, a network card, and a communication module. The communication device 33 may be equipped with a connector for wired connection and an interface circuit corresponding to the connector. The communication device 33 may also be equipped with a wireless communication interface. Examples of connectors and interface circuits for wired connection include products compliant with wired LAN, IEEE1394, and USB. Examples of wireless communication interfaces include products compliant with wireless LAN and Bluetooth®.

[0022] The display device 34 is a device that displays images and text information. The display device 34 displays various images under the control of the processing device 31. For example, various display panels such as liquid crystal display panels and organic EL (Electro-Luminescence) display panels are preferably used as the display device 34.

[0023] The input device 35 accepts input from the user U. For example, the input device 35 includes a keyboard, touchpad, touch panel, or pointing device such as a mouse.

[0024] In this embodiment, for example, the display device 34 includes a touch panel and also functions as an input device 35. Therefore, in the following description, it may be stated that the display device 34 accepts instructions from user U.

[0025] The aforementioned processing unit 31 reads the executable program P1 from the storage device 32 and executes it. As a result, the processing unit 31 functions as a display control unit 311, a reception unit 312, a decision unit 313, and a communication control unit 314.

[0026] The display control unit 311 controls the display on the display device 34. The display control unit 311 launches an animation application and displays animation A1 on the display device 34. The display control unit 311 also launches a manga application and displays manga M1 on the display device 34. Animation A1, which is displayed on the terminal device 30 when the animation application is executed, and manga M1, which is displayed on the terminal device 30 when the manga application is executed, are linked to each other.

[0027] Figure 3 shows examples of manga icons X1 and animation icons Y1 displayed on the screen SC of the display device 34 shown in Figure 2. As shown in Figure 3, the display control unit 311 causes the manga icons X1 and animation icons Y1 to be displayed on the screen SC of the display device 34. The manga icons X1 are operated by the user U to run manga applications. The animation icons Y1 are operated by the user U to run animation applications.

[0028] Figure 4 is an example of a comic strip M1 displayed on the screen SC of the display device 34 shown in Figure 2. The display control unit 311 displays the comic strip M1 on the screen SC of the display device 34. As shown in Figure 4, the comic strip M1 displays multiple characters and multiple lines of dialogue. In the example in Figure 4, the comic strip M1 is displayed page by page, but it may also be displayed panel by panel. For example, the scene of the comic strip M1 shown in Figure 4 has three panels. The right side of the figure is the first panel, the upper left is the second panel, and the lower left is the third panel. In this embodiment, "scene" in the comic strip M1 refers to the page displayed on the screen SC. If the comic strip M1 is displayed panel by panel on the screen SC, "scene" may refer to the panel.

[0029] In the first frame, characters C01 and C02 are displayed, with dialogue C1 displayed near character C01 and dialogue C2 displayed near character C02. Character C01 is standing near character C02. Character C02 is sleeping on a futon. Dialogue C1 is, "Don't sleep forever." Dialogue C2 is, "I'm sleepy." In the second frame, dialogue C3 is displayed, and there are no characters. Dialogue C3 is, "The live show is about to start." In the third frame, characters C01 and C02 are displayed, with dialogue C4 displayed near character C01 and dialogue C5 displayed near character C02. Character C01 has his left hand raised. Character C02 has both hands raised. Dialogue C4 is, "Let's go." Dialogue C5 is, "That's right, let's go."

[0030] Figure 5 is an example of animation A1 displayed on the screen SC of the display device 34 shown in Figure 2. The display control unit 311 displays animation A1 on the screen SC of the display device 34. As shown in Figure 5, animation A1 displays multiple characters and multiple lines of dialogue. Furthermore, in the example in Figure 5, subtitles D are displayed, but subtitles D may be omitted. Subtitles D include, for example, the lines of dialogue and the name of the character speaking those lines. In animation A1, "scene" refers to a part of animation A1, such as a frame.

[0031] For example, in the scene of animation A1 shown in Figure 4, characters C01 and C02 and subtitle D are displayed. Character C01 is standing near character C02. Character C01 is sleeping on a futon. Subtitle D shows that character C01 is saying, "Don't sleep forever."

[0032] Figure 6 is an example of an operation screen PM on cartoon M1 displayed on screen SC of the display device 34 shown in Figure 2. Figure 7 is an example of an operation screen PA on animation A1 displayed on screen SC of the display device 34 shown in Figure 2.

[0033] On the comic strip M1 in Figure 6, the operation screen PM is displayed. On the animation A1 in Figure 7, the operation screen PA is displayed. The operation screen PM and PA are displayed, for example, when user U performs a click operation on screen SC. The operation screen PM and PA are pop-up menus, but they may also be composed of other GUIs (Graphical User Interfaces). The operation screen PM displays the details button B1, the share button B2, the favorites button B3, and the button B4 for viewing animation A1. The operation screen PM displays the details button B1, the share button B2, the favorites button B3, and the button B4 for viewing comic strip M1.

[0034] The Details button B1 is used when user U wants to know more details about the manga M1 or animation A1 displayed on screen SC, such as the author. The Share button B2 is used when user U wants to share the manga M1 or animation A1 displayed on screen SC with other users U. The Favorites button B3 is used when user U wants to add the manga M1 or animation A1 displayed on screen SC to their favorites.

[0035] Button B4 for viewing animation A1 is used when user U wants to view a scene from animation A1 related to a scene from comic M1 displayed on screen SC. Button B5 for viewing comic M1 is used when user U wants to view a scene from comic M1 related to a scene from animation A1 displayed on screen SC. Related scenes are the same scene, a scene that is similar enough to be considered the same, and a scene that contains the same content.

[0036] Currently, the scene from either animation A1 or comic M1 displayed on screen SC is referred to as "Scene 1." The scene from the other content related to "Scene 1" is referred to as "Scene 2." The first frame of comic M1 shown in Figure 6 is a scene that is similar enough to be considered identical to the scene from animation A1 shown in Figure 7. Therefore, for example, if the scene from comic M1 shown in Figure 6 is currently displayed on screen SC, that scene is "Scene 1," and the scene from animation A1 shown in Figure 7 is "Scene 2."

[0037] The reception unit 312 shown in Figure 2 receives instructions from user U via the input device 35 or display device 34. User U's instructions include operations on the screen SC and voice instructions. For example, it receives a switching instruction from user U to switch from the display of the first scene to the display of the second scene. This switching instruction is made via the operation screen PM or operation screen PA mentioned above.

[0038] As shown in Figure 2, the decision unit 313 determines whether to switch the display from one of the content, animation A1 or comic M1, to the other, in response to the switching instruction from user U received by the reception unit 312. The decision unit 313 then generates switching request data RM or RA.

[0039] Figure 8 shows an example of the switch request data RM from manga M1 to animation A1. Figure 9 shows an example of the switch request data RA from animation A1 to manga M1. The switch request data RM in Figure 8 is used to send a switch request to the content provider 10 to switch from the display of manga M1 to the display of animation A1. The switch request data RA in Figure 9 is used to send a switch request to the content provider 10 to switch from the display of animation A1 to the display of manga M1.

[0040] As shown in Figure 8, for example, the switching request data RM includes the application ID, manga ID, volume number, page number, panel number, and terminal ID. The application ID is an ID that indicates the foreground application that is currently active and operable by user U. In the example in Figure 8, it is a manga application. The manga ID is an identifier used to identify manga M1. A manga application can display multiple manga M1s. The manga ID is used to identify which of these multiple manga M1s it is. The volume number indicates the volume number if manga M1 consists of multiple volumes. The page number indicates the page that was displayed on the screen SC when the switching instruction was received. The panel number indicates the panel that can be inferred from the position where the switching instruction was received. The terminal ID is an identifier that indicates the terminal device 30. The presence of the terminal ID makes it possible to identify which user U owns the terminal device 30 from which the switching instruction was made.

[0041] The switching request data RM shown in Figure 8 includes information indicating that a switching instruction was issued at the first panel of page 22 of volume 1 of manga M1, manga ID "m0001", while the manga application indicated by application ID "ap0m" was running on terminal device 30 with terminal ID "30-1".

[0042] As shown in Figure 9, for example, the switching request data RA includes the application ID, animation ID, episode number, playback time, and terminal ID. In the example in Figure 9, the application ID is the animation application. The animation ID is an identifier used to identify animation A1. An animation application can display multiple animations A1. The animation ID is used to identify which of these multiple animations A1 is being displayed. The episode number indicates the number of episodes if animation A1 consists of multiple episodes. The playback time corresponds to the time when the switching instruction was received.

[0043] The switching request data RA shown in Figure 9 includes information indicating that a switching instruction was given at 681 seconds of the first episode of animation A1, animation ID "a0001", while the animation application indicated by app ID "ap0a" was running on terminal device 30 with terminal ID "30-1".

[0044] The communication control unit 314 shown in Figure 2 causes the communication device 33 to send and receive various types of information with the content provisioning device 10. For example, the communication control unit 314 causes the communication device 33 to send switching request data RM or RA. For example, the communication control unit 314 causes the communication device 33 to receive animation data D10, which is data related to animation A1 and will be described later, and manga data D20, which is data related to manga M1 and will be described later.

[0045] 1-1b. Content provision device 10 Figure 10 is a block diagram of an example configuration of the content provision device 10 shown in Figure 1. As shown in Figure 10, the content provision device 10 comprises a processing unit 11, a storage device 12, a communication device 13, a display device 14, and an input device 15. Each element of the content provision device 10 is interconnected using one or more buses for communicating information.

[0046] The processing unit 11 is a processor that controls the entire content provisioning device 10. The processing unit 11 is configured using, for example, one or more chips. The processing unit 11 is configured using, for example, a central processing unit (CPU) including an arithmetic unit and registers. Some or all of the functions of the processing unit 11 may be implemented using hardware such as a DSP, ASIC, PLD, and FPGA. The processing unit 11 executes various processes in parallel or sequentially.

[0047] The storage device 12 is a recording medium that can be read from and written to by the processing unit 11. The storage device 12 also stores multiple programs executed by the processing unit 11, as well as various data files. Specifically, the storage device 12 stores the control program P2. By executing the control program P2, the processing unit 11 performs the functions described below. The storage device 12 also stores the animation list file F1, the manga list file F2, the animation data file F10, the manga data file F20, the relationship information file F3, the manga character data file F41, the animation character data file F51, the manga dialogue data file F42, and the animation dialogue data file F52. Furthermore, the storage device 12 stores the first learning model P01, the second learning model P02, the third learning model P03, the fourth learning model P04, and the fifth learning model P05.

[0048] Figure 11 is an example of the animation data file F10 shown in Figure 10. The animation data file F10 shown in Figure 11 includes animation data D10-1, D10-2, D10-3, ..., D10-α, where α is an integer. Each animation data D10 is segmented data from the original data, divided into multiple parts based on playback time. For example, an animation data file F10 is created for each work. Furthermore, if there are multiple episodes, an animation data file F10 is created for each episode, such as episode 1, episode 2, etc. Also, for example, animation data D10-1 is the data from playback time 0 seconds to 1 second. Animation data D10-2 is the data from playback time 1 second to 2 seconds. Note that each animation data D10 does not need to be divided into 1-second segments; it may be divided into segments of any playback time.

[0049] Figure 12 is an example of the animation list file F1 shown in Figure 10. The animation list file F1 shown in Figure 12 is a playback list of multiple animation data D10. The animation list file F1 includes the playback time (#EXTINF:), the segment location (segment), and the playback order. The segment location (segment) indicates which of the multiple animation data D10 it is. Note that the example in the figure is an example for streaming distribution in HLS format, but other streaming distribution formats such as Smooth Streaming format or MPEG-DASH format may also be used.

[0050] For example, the segment location shown on the second line (segment -000.ts) indicates animation data D10-1, and the segment location shown on the fourth line (segment -001.ts) indicates animation data D10-2. Basically, multiple animation data D10s are played sequentially from top to bottom in the animation list file F1. For example, at the playback time shown on the first line (#EXTINF:10.500000), animation data D10-1 shown on the second line is played. At the playback time shown on the third line (#EXTINF:1.458333), animation data D10-2 shown on the fourth line is played.

[0051] Figure 13 is an example of the manga data file F20 shown in Figure 10. The manga data file F20 shown in Figure 13 includes manga data D20-1, D20-2, D20-3, ... D20-β, where β is an integer. Each manga data D20 is segmented data from the original data, for example, data divided into multiple parts per page. For example, a manga data file F20 is created for each work. Furthermore, if there are multiple volumes, a manga data file F20 is created for each volume, such as volume 1, volume 2, etc. For example, manga data D0-1 is the data for page 0, and manga data D20-2 is the data for page 1. Note that each manga data D20 does not need to be divided per page; it may be divided into any number of pages, or for example, per panel.

[0052] Figure 14 is an example of the manga list file F2 shown in Figure 10. The manga list file F2 shown in Figure 7 is a list of multiple manga data D20. The manga list file F2 includes page numbers (p.) and page order. Note that a reference representation expressed in epub format or similar may be used instead of page numbers (p.).

[0053] For example, the page number shown on the first line (p.0) represents manga data D20-1, the page number shown on the second line (p.1) represents manga data D20-2, and the page number shown on the third line (p.2) represents manga data D20-3. Also, basically, multiple manga data D20s are played in order from top to bottom in the manga list file F2.

[0054] Figure 15 is an example of the relational information file F3 shown in Figure 10. The relational information file F3 shown in Figure 15 contains relational information that associates the playback time of animation A1 with the page number of manga M1. In other words, the relational information file F3 is a linking file that links multiple animation data D10 with multiple manga data D20.

[0055] The playback time (#EXTINF:10.500000) shown in the first line of Figure 15 corresponds to the page number (p.0) shown in the second line. Therefore, the animation data D10-1 in Figure 11, which corresponds to the segment location (segment -000.ts) corresponding to the playback time (#EXTINF:10.500000) in Figure 12, corresponds to the comic data D20-1 in Figure 13, which corresponds to the page number (p.0) in Figure 14.

[0056] Furthermore, the playback time (#EXTINF:1.458333) shown in the third line of Figure 15 is associated with the page number (p.0) shown in the fourth line. Therefore, the animation data D10-2 in Figure 11, which corresponds to the location of the segment (segment -001.ts) corresponding to the playback time (#EXTINF:1.458333) in Figure 12, is associated with the manga data D20-1 in Figure 13, which corresponds to the page number (p.0) in Figure 4.

[0057] Furthermore, the playback time (#EXTINF:3.875000) shown in the 5th line of Figure 15 corresponds to the page number (p.1) shown in the 6th line. Therefore, the animation data D10-3 in Figure 11, which corresponds to the segment location (segment -002.ts) corresponding to the playback time (#EXTINF:3.875000) in Figure 12, corresponds to the manga data D20-2 in Figure 13, which corresponds to the page number (p.1) in Figure 4.

[0058] Thus, the relationship information file F3 links animation data D10, which is executed in the animation application, with manga data D20, which is executed in the manga application. Therefore, animation A1 and manga M1 are linked.

[0059] The communication device 13 shown in Figure 10 is hardware that acts as a transmitting and receiving device for communicating with the terminal device 30. The communication device 13 is also called, for example, a network device, a network controller, a network card, and a communication module. The communication device 13 may be equipped with a connector for wired connection and an interface circuit corresponding to the connector. The communication device 13 may also be equipped with a wireless communication interface. Examples of connectors and interface circuits for wired connection include products compliant with wired LAN, IEEE1394, and USB. Examples of wireless communication interfaces include products compliant with wireless LAN and Bluetooth®.

[0060] The display device 14 is a device that displays images and text information. The display device 14 displays various images under the control of the processing unit 11. For example, various display panels such as liquid crystal display panels and organic EL (Electro-Luminescence) display panels are preferably used as the display device 14.

[0061] The input device 15 receives operations from the administrator of the content provision device 10. For example, the input device 15 includes a keyboard, touchpad, touch panel, or a pointing device such as a mouse. If the display device 14 includes a touch panel, the display device 14 may also function as the input device 15.

[0062] The processing unit 11 reads the control program P2 from the storage device 12 and executes it. As a result, the processing unit 11 functions as a communication control unit 111, a data provision unit 112, a cooperation unit 113, and a display control unit 114.

[0063] The communication control unit 111 causes the communication device 13 to send and receive various types of information with the terminal device 30. The communication control unit 111 also has a request receiving unit 1111. The request receiving unit 1111 receives switching request data RA and RM. Specifically, the request receiving unit 1111 causes the communication device 13 to receive the switching request data RA and RM. For example, the communication control unit 111 also causes the communication device 13 to send animation data D10 and manga data D20 to the terminal device 30. The communication control unit 111 may also cause the communication device 13 to send related information file F3.

[0064] The data provision unit 112 provides animation data D10 to the terminal device 30 via the communication device 13. For example, the data provision unit 112 refers to the animation list file F1 and the animation data file F10 and performs seek processing of animation data D10-1 to D10-α. Through this process, the data provision unit 112 selects a predetermined animation data D10. Then, the data provision unit 112 provides the predetermined animation data D10 to the terminal device 30 via the communication device 13. These processes are repeated.

[0065] Furthermore, the data provision unit 112 provides the manga data D20 to the terminal device 30 via the communication device 13. For example, the data provision unit 112 refers to the manga list file F2 and the manga data file F20 and performs a seek operation for manga data D20-1 to D20-β. Through this process, the data provision unit 112 selects a predetermined manga data D20. Then, the data provision unit 112 provides the predetermined manga data D20 to the terminal device 30 via the communication device 13. These processes are repeated.

[0066] For example, the data provision unit 112 provides data related to the foreground application on the terminal device 30. Therefore, if an animation application is active on the terminal device 30, the data provision unit 112 provides animation data D10 to the terminal device 30. On the other hand, if a manga application is active on the terminal device 30, the data provision unit 112 provides manga data D20 to the terminal device 30.

[0067] Furthermore, the data provision unit 112 switches from providing animation data D10 to providing manga data D20 in response to the switching request data RA from the terminal device 30. Similarly, the data provision unit 112 switches from providing manga data D20 to providing animation data D10 in response to the switching request data RM from the terminal device 30.

[0068] The display control unit 114 controls the display on the display device 14. The display control unit 114 may also control the display on the screen SC of the terminal device 30.

[0069] The linking unit 113 links the animation data D10 and the manga data D20. The linking unit 113 also functions as a generation unit that generates a relationship information file F3 used for this linking. To generate the relationship information file F3, the linking unit 113 generates a manga character data file F41, an animation character data file F51, a manga dialogue data file F42, and an animation dialogue data file F52.

[0070] Figure 16 is an example of the manga character data file F41 shown in Figure 10. The manga character data file F41 shown in Figure 16 contains multiple manga character data D41. In Figure 16, for example, manga character data D41-1 and D41-2 are illustrated. Each manga character data D41 is data that associates the title, volume number, page number, character name, and character position of manga M1. The character position indicates the character's position within the page and is shown in XY coordinates.

[0071] For example, manga character data D41-1 shows information about character C02 in the first panel of Figure 4. Manga character data D41-1 includes information indicating that character C02 is located at coordinates (20,60) on page 22 of volume 1 of the manga titled "No.1". For example, manga character data D41-2 shows information about character C01 in the first panel of Figure 4. Manga character data D41-2 includes information indicating that character C01 is located at coordinates (120,55) on page 22 of volume 1 of the manga titled "No.1".

[0072] Figure 17 is an example of the animation character data file F51 shown in Figure 10. The animation character data file F51 shown in Figure 17 contains multiple animation character data D51. In Figure 17, for example, animation character data D51-1 and D51-2 are illustrated among the multiple animation character data D51. The animation character data file F51 is data that associates the title, episode number, chapter, appearance time, character name, and character position of animation A1. The character position indicates the character's position within the scene and is shown in XY coordinates. The appearance time includes the number of seconds from when the character first appears on screen to when it ends.

[0073] For example, animation character data D51-1 contains information about character C02 in the scene shown in Figure 5. Animation character data D51-1 includes information indicating that character C02 is located at coordinates (60,60) from 679 to 689 seconds in the first chapter of the first episode of the title "No.1". For example, animation character data D51-2 contains information about character C01 in the scene shown in Figure 5. Animation character data D51-2 includes information indicating that character C01 is located at coordinates (120,30) from 679 to 684 seconds in the first chapter of the first episode of the title "No.1".

[0074] Figure 18 is an example of the manga dialogue data file F42 shown in Figure 10. The manga dialogue data file F42 shown in Figure 18 contains multiple manga dialogue data files D42. In Figure 18, manga dialogue data files D42-1 and D42-2 are illustrated. Each manga dialogue data file D42 is data that associates the title, volume number, page number, character name, character position, and dialogue of manga M1. For example, as shown in the second panel of Figure 4, if there is no character in the panel, the character position is omitted in the manga dialogue data file D42. The manga dialogue data file D42 may also include the position of the dialogue.

[0075] Furthermore, the manga dialogue data D42 includes a score. The score is the result of scoring using persona estimation, which estimates which character's dialogue is most likely to be spoken by in the manga M1. Persona estimation uses a learning model that can identify which character's dialogue it is based on the unique phrasing, frequently used words, sentence endings, dialects, and other characteristics of each character. This learning model has already learned the relationship between dialogue and character names. When dialogue is input into this learning model, a score is output for each of the names of the multiple characters appearing in the manga. The score indicates the degree of probability that the dialogue belongs to the corresponding character. The score is expressed numerically, and a higher number indicates a higher probability. Each of the multiple training data used to train the learning model is a pair of dialogue and character names. The correspondence between dialogue and character names is annotated by a human. Alternatively, annotation may be performed automatically using the animation data D10. Animation data D10 can display subtitles D that associate dialogue with character names, as explained with reference to Figures 4 and 5. Animation data D10 contains subtitle data that shows subtitles D. A learning model can be trained by using multiple subtitle data extracted from animation data D10 as training data. The score may also be the result of scoring based on the distance between the character and the dialogue, and the direction of the speech bubble. Furthermore, the score may be the result of scoring a combination of these multiple elements.

[0076] For example, manga dialogue data D42-1 shows the content related to character C02 in the first panel of Figure 4. Manga dialogue data D42-1 includes information indicating that character C02 is located at coordinates (20,60) on page 22 of volume 1 of the title "No.1" and that character C02 is uttering the line "Don't sleep forever." Manga dialogue data D42-1 also includes information indicating that the score for character C02 uttering this line is "0.25." Manga dialogue data D42-2 shows the content related to character C01 in the first panel of Figure 4. Manga dialogue data D42-2 includes information indicating that character C01 is located at coordinates (120,55) on page 22 of volume 1 of the title "No.1" and that character C01 is uttering the line "Don't sleep forever." Additionally, manga dialogue data D42-2 includes information indicating that the score for character C01 speaking the dialogue is "0.70".

[0077] Figure 19 is an example of the animation dialogue data file F52 shown in Figure 10. The animation dialogue data file F52 shown in Figure 19 contains multiple animation dialogue data files D52. In Figure 18, animation dialogue data file D52-1 is illustrated among the multiple animation dialogue data files D52. Each animation dialogue data file D52 is data that associates the title, episode number, chapter, character name, character position, dialogue, and playback time of animation A1. Specifically, the playback time is the start time of the dialogue.

[0078] For example, animation dialogue data D52-1 contains information about character C01 in the scene shown in Figure 5. Animation dialogue data D52-1 includes information indicating that character C01 is located at coordinates (60,60) in the first chapter of the first episode of the title "No.1", and that character C01 speaks the line "Don't sleep forever" starting at 679 seconds.

[0079] Figure 20 is a diagram illustrating the overview of the first learning model P01 shown in Figure 10. The aforementioned manga character data file F41 is generated using the first learning model P01. The first learning model P01 includes, for example, an object detection model and a character matching model, and integrates the results of these models. The object detection model is a model that has learned, for example, the relationship between the location of an object and the type of object. The types of objects include, for example, people, other animals, and items such as blankets. The object detection model can extract where characters exist. The character matching model is a model that has learned, for example, the relationship between a character that is an object and the name of that character. This model can analyze which character the character extracted by the object detection model is.

[0080] As shown in Figure 20, by inputting each manga data D20 as input data DI into the first learning model P01, the first learning model P01 outputs manga character data D41 as output data DO.

[0081] Figure 21 is a diagram illustrating the overview of the second learning model P02 shown in Figure 10. The aforementioned animated character data file F51 is generated using the second learning model P02. The second learning model P02 includes, for example, an object detection model and a character matching model, and integrates the results of these models.

[0082] Figure 22 is a diagram illustrating the second learning model P02 in Figure 21. While Figure 22 uses the second learning model P02 as an example, the same applies to the first learning model P01. The object detection model extracts the regions containing characters within each frame of the animation data D10. For example, in the case of the scene, i.e., the frame images shown in Figure 5, the character detection model extracts regions R1 and R2 as shown in Figure 22. The character matching model is then input with images of one or more regions detected by the object detection model. The character matching model has already learned the relationship between character images and character names. The character matching model outputs the character's name.

[0083] As shown in Figure 21, by inputting each animation data D10 as input data DI into the second learning model P02, the second learning model P02 outputs animation character data D51 as output data DO.

[0084] Figure 23 is a diagram illustrating the overview of the third learning model P03 shown in Figure 10. The aforementioned manga dialogue data file F42 is generated using the third learning model P03. The third learning model P03 includes, for example, a character detection model and a character recognition model, and integrates the results of these models. The character detection model is a model that has learned the relationship between image features, such as the shape and color that make up an image, and character regions. Dialogue can be extracted using the character detection model. The character recognition model is a model that has learned the relationship between character images in character regions and the characters themselves. Dialogue can be converted into text using the character recognition model. The third learning model P03 may also include the aforementioned object detection model and character matching model.

[0085] Furthermore, the third learning model P03 scores the transcribed dialogue. As mentioned earlier, scoring is performed using the distance between the character and the dialogue, the direction of the speech bubble, and persona estimation. For example, characters that are closer to the dialogue will have a higher score. For example, characters whose speech bubble is facing the dialogue will have a higher score. For example, the score is set based on the modeled utterance through the aforementioned persona estimation. Furthermore, the score is set by a combination of these elements.

[0086] As shown in Figure 23, by inputting each manga data D20 as input data DI into the third learning model P03, the third learning model P03 outputs manga dialogue data D42 as output data DO.

[0087] Figure 24 shows an overview of the fourth learning model P04 shown in Figure 10. The aforementioned animation dialogue data file F52 is generated using the fourth learning model P04. The third learning model P03 includes, for example, a character detection model and a character recognition model, and integrates the results of these models. The fourth learning model P04 may also include an object detection model and a character matching model. Furthermore, the fourth learning model P04 may also include a speech recognition model. The speech recognition model is a model that has learned the relationship between the voice of the character's voice actor and the character's name. The speech recognition model can analyze which character is speaking the lines.

[0088] As shown in Figure 24, by inputting each animation data D10 as input data DI into the fourth learning model P04, the fourth learning model P04 outputs animation dialogue data D52 as output data DO.

[0089] Figure 25 is a diagram illustrating the overview of the fifth learning model P05 shown in Figure 10. The aforementioned relationship information file F3 is generated using the fifth learning model P05. The fifth learning model P05 includes, for example, a model trained to compare and associate manga character data D41 and animation character data D51, and a model trained to compare and associate manga dialogue data D42 and animation dialogue data D52. In the fifth learning model P05, for example, it is numerically determined whether two sets of data are similar or identical. Then, if the two sets of data are most similar or identical, the fifth learning model P05 associates the animation data D10 and manga data D20 corresponding to those two sets of data. This model makes it possible to link the first frame of Figure 4 and the scene in Figure 5, even if the characters and dialogue are the same but the character illustrations are slightly different, as in the first frame of Figure 4 and the scene in Figure 5.

[0090] As shown in Figure 25, by inputting manga character data D41, animation character data D51, manga dialogue data D42, and animation dialogue data D52 as input data DI to the fifth learning model P05, the fifth learning model P05 outputs a relational information file F3 as output data DO. Based on this relational information file F3, the animation data D10 and manga data D20 are associated.

[0091] 1-2. Operation of switching between displaying manga M1 and animation A1. Figure 26 is a flowchart illustrating an example of the transition from the first scene of manga M1 to the second scene of animation A1. Furthermore, the explanation will describe an example where user U gives instructions to terminal device 30 via touch operation on display device 34.

[0092] In step S101, the reception unit 312 receives the user U's operation of the manga icon X1 via the display device 34. In step S102, the display control unit 311 starts the manga application. In step S103, the reception unit 312 receives the user U's operation via the display device 34 regarding the selection of one manga M1 from among multiple manga M1s. In step S104, the communication control unit 314 causes the user U to send a viewing request for the manga M1 selected by the user U to the communication device 33.

[0093] In step S105, the communication control unit 111 causes the communication device 33 to receive manga data D20 in response to the viewing request. In step S106, the display control unit 311 displays the manga M1 based on the manga data D20 on the display device 34. In this embodiment, streaming distribution is described as an example, in which case segmented manga data D20 is transmitted to the terminal device 30 as needed. For example, the first scene of manga M1 shown in Figure 4 is displayed on screen SC.

[0094] In step S107, the reception unit 312 receives an operation from user U to display the operation screen PM in the first scene. In step S108, the display control unit 311 displays the operation screen PM in the first scene on the display device 34. For example, the operation screen PM shown in Figure 6 is displayed on screen SC.

[0095] In step S109, the reception unit 312 receives a switching instruction from user U via the operation screen PM. For example, user U makes a switching instruction by selecting button B4 in Figure 6. In step S110, the decision unit 313 generates the switching request data RM shown in Figure 8. In step S111, the communication control unit 314 causes the switching request data RM to be transmitted to the communication device 33. In step S112, the request reception unit 1111 receives the switching request data RM.

[0096] In step S113, the data provision unit 112 provides animation data D10, which includes a second scene related to the first scene, to the terminal device 30, and the communication control unit 314 of the terminal device 30 causes the communication device 33 to receive the animation data D10. In step S113, the display control unit 311 starts the animation application. In step S114, the display control unit 311 displays the second scene of animation A1 on the display device 34. For example, the scene of animation A1 shown in Figure 5 is displayed.

[0097] As a result of the actions in steps S101 to S115 described above, the display switches from the first scene of comic M1 to the second scene of animation A1, which corresponds to the first scene.

[0098] In step S101, when switching from the first scene of animation A1 to the second scene of manga M1, the animation icon Y1 is used instead of the manga icon X1. In step S102, the animation application is launched. In step S105, the terminal device 30 receives the animation data D10, and in step S107, animation A1 is displayed. In step S107, the operation screen PA is displayed. In step S112, the request reception unit 1111 receives the switching request data RA. In step S113, the data provision unit 112 provides the terminal device 30 with manga data D20, which includes the second scene related to the first scene, and the terminal device 30 receives the manga data D20. In step S114, the manga application is launched. Then, in step S115, the second scene of manga M1 is displayed on screen SC.

[0099] As described above, the terminal device 30 includes a reception unit 312, a communication control unit 314, and a display control unit 311. In step S109, the reception unit 312 receives a switching instruction from user U. The switching instruction is to switch from displaying the first scene of one of the contents, animation A1 from an animation application or comic M1 from a comic application, on the display device 34 to displaying the second scene related to the first scene of the other content. The communication control unit 314 acquires data including the second scene from the content providing device 10. The display control unit 311 switches the display on the display device 34 from the first scene to the second scene in response to the switching instruction.

[0100] With this terminal device 30, if user U wants to view the second scene related to the first scene of one piece of content while viewing the first scene of one piece of content, the terminal device 30 can be instructed to switch, and the display will automatically switch from the first scene to the second scene. Therefore, when user U is viewing the first scene of one piece of content, it eliminates the need for user U to manually select the icon of the other piece of content and search for the second scene related to the first scene. Thus, user U can enjoy both the first and second scenes in parallel using a single terminal device 30.

[0101] Furthermore, as described above, in step S108, the display control unit 311 displays an operation screen PM or PA prompting the user to switch to the other content while the first scene is being displayed on the display device 34. Then, in step S109, the reception unit 312 receives a switching instruction from the user U via the operation screen PM or PA. Since the switching instruction can be given via the operation screen PM or PA, the operation to switch is very simple for the user U, and the user U can perform the switching operation quickly. Therefore, the user U can enjoy the first scene and the second scene in parallel with almost no time loss.

[0102] 1-3. Generation of related information file F3 Figure 27 is a flowchart illustrating the generation of the relational information file F3. The generation of the relational information file F3 shown in Figure 27 is performed by the content provider 10. As shown in Figure 27, in step S21, the content provider 10 acquires the input data DI. For example, the source data provided from an external source is segmented to generate a manga data file F20 containing multiple manga data D20 and a manga list file F2. Alternatively, for example, the source data provided from an external source is segmented to generate an animation data file F10 containing multiple animation data D10 and an animation list file F1. The content provider 10 then acquires the multiple animation data D10 and multiple manga data D20 as the input data DI.

[0103] In step S22, the linkage unit 113 inputs input data DI to the learning models. Specifically, multiple manga data D20 is input to the first learning model P01 and the third learning model P03, and multiple animation data D10 is input to the second learning model P02 and the fourth learning model P04.

[0104] In step S23, the linkage unit 113 acquires the output data DO. For example, manga character data D41 is output from the first learning model P01. Animation character data D51 is output from the second learning model P02. Manga dialogue data D42 is output from the third learning model P03. Animation dialogue data D52 is output from the fourth learning model P04.

[0105] In step S24, the linking unit 113 inputs the output data DO as input data DI to the fifth learning model P05. Therefore, the manga character data D41, animation character data D51, manga dialogue data D42, and animation dialogue data D52 are input to the fifth learning model P05 as input data DI.

[0106] In step S25, the linking unit 113 obtains the relationship information file F3 as output data DO. The relationship information file F3 is generated by the above steps S21 to S25. Then, the linking unit 113 links the animation data D10 and the manga data D20 based on the relationship information file F3.

[0107] As described above, the content provision device 10 includes a linking unit 113, a request receiving unit 1111, and a data provision unit 112. The linking unit 113 links animation data D10, which is executed by an animation application that can be installed on the terminal device 30, with manga data D20, which is executed by a manga application that can be installed on the terminal device 30, in steps S21 to S25 shown in Figure 27. In step S112 of Figure 26, the request receiving unit 1111 receives a switching request from user U via the terminal device 30 to switch from one content to the other content while the display device 34 of the terminal device 30 is displaying either animation A1 from the animation application or manga M1 from the manga application. In step S113 of Figure 26, in response to the switching request, the data provision unit 112 provides the terminal device 30 with animation data D10, which includes the second scene of the other content related to the first scene, instead of providing manga data D20, which includes the first scene of the one content.

[0108] With this content provisioning device 10, if user U operating the terminal device 30 wants to watch the second scene related to the first scene of one piece of content while watching the first scene of another piece of content, the user can issue a switching instruction to the terminal device 30, which will automatically switch the display from the first scene to the second scene. Therefore, user U can enjoy the first and second scenes in parallel on a single terminal device 30. In particular, since the content provisioning device 10 links animation data D10 and manga data D20, it can immediately provide the second scene to the terminal device 30 in response to user U's switching request. As a result, user U can enjoy the first and second scenes almost simultaneously.

[0109] Furthermore, the linking unit 113 generates a relational information file F3 that associates information about the pages of manga M1 with information about the playback time of animation A1, and links animation data D10 and manga data D20 based on the relational information file F3. Thus, the second scene is identified based on the relational information file F3 that associates information about the pages of manga M1 with information about the playback time of animation A1. Then, in step S113, the identified animation data D10 is provided from the content providing device 10 to the terminal device 30.

[0110] Thus, the existence of the related information file F3 allows the second scene to be immediately provided to the terminal device 30 in response to the user U's switching request. As a result, user U can enjoy the first and second scenes almost simultaneously.

[0111] Furthermore, as mentioned above, the linkage unit 113 generates a relationship information file F3 based on the manga character data D41 and the animation character data D51. By generating the manga character data D41 and the animation character data D51 in advance, the relationship information file F3 can be generated using these, for example, by the fifth learning model P05, without requiring manual work.

[0112] Furthermore, as mentioned above, the linkage unit 113 generates a relationship information file F3 based on the manga dialogue data D42 and the animation dialogue data D52. By generating the manga dialogue data D42 and the animation dialogue data D52 in advance, the relationship information file F3 can be generated using these, for example, by the fifth learning model P05, without requiring manual work.

[0113] Furthermore, as mentioned above, the linking unit 113 generates a relationship information file F3 based on the manga character data D41, animation character data D51, manga dialogue data D42, and animation dialogue data D52. By using multiple data in this way, a highly accurate relationship information file F3 can be generated. In other words, the accuracy of the association between manga data D20 and animation data D10 can be improved.

[0114] Furthermore, the manga character data D41 is generated by the first learning model P01, as described above. Similarly, the animation character data D51 is generated by the second learning model P02, as described above. Specifically, the linkage unit 113 generates both the manga character data D41 and the animation character data D51 using a model that includes object detection and character matching. As a result, a huge amount of data can be quickly acquired without manual work in the generation of both the manga character data D41 and the animation character data D51.

[0115] Furthermore, the manga dialogue data D42 is generated by the third learning model P03, as described above. Similarly, the animation dialogue data D52 is generated by the fourth learning model P04, as described above. Specifically, the linking unit 113 generates both the manga dialogue data D42 and the animation dialogue data D52 using models that include character detection and character recognition. Therefore, in the generation of both the manga dialogue data D42 and the animation dialogue data D52, a huge amount of data can be acquired quickly without manual work. As mentioned above, for the animation dialogue data D52, a speech recognition model may be used instead of character detection.

[0116] Furthermore, as mentioned above, the linkage unit 113 scores the manga dialogue data D42 using one or more of the following factors: the distance between the character and the dialogue, the direction of the speech bubble, and persona estimation. Persona estimation estimates which character's dialogue is closest to being spoken by the character. These factors improve the accuracy of the association between dialogue and characters.

[0117] In particular, it is preferable for the collaboration unit 113 to perform scoring using persona estimation. As shown in the second frame of Figure 4, there are cases where no character is present in some frames. Even in such cases, using persona estimation can improve the accuracy of the association between dialogue and characters.

[0118] 2. Variations Preferred embodiments have been described above. These preferred embodiments can be modified in various ways. Specific examples of modifications that can be applied to the above-described preferred embodiments are given below.

[0119] In the embodiment described above, user U views the manga through streaming, where the terminal device 30 receives and simultaneously plays the data. However, the terminal device 30 may also download and play the animation data D10 and manga data D20 from the content provider device 10.

[0120] Even if an account associated with one terminal device 30 is used with another terminal device 30, various information will remain linked to the account.

[0121] 3. Others (1) In the above-mentioned disclosure, the storage devices 12 and 32 are given examples such as ROM and RAM, but other suitable storage media include flexible disks, magneto-optical disks (e.g., compact disks, digital multipurpose disks, Blu-ray® disks), smart cards, flash memory devices (e.g., cards, sticks, key drives), CD-ROMs (Compact Disc-ROMs), registers, removable disks, hard disks, floppy® disks, magnetic strips, databases, servers, and other appropriate storage media.

[0122] (2) The information, signals, etc. described in the foregoing disclosure may be represented using any of the following different techniques. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the foregoing description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0123] (3) In the above disclosure, the input and output information may be stored in a specific location (e.g., memory) or managed using a management table. The input and output information may be overwritten, updated, or appended to. The output information may be deleted. The input information may be transmitted to other devices.

[0124] (4) In the above disclosure, the determination may be made by a value represented using 1 bit (0 or 1), by a Boolean value (true or false), or by a numerical comparison (for example, a comparison with a predetermined value).

[0125] (5) The processing procedures, sequences, flowcharts, etc., exemplified in the present disclosure described above may be rearranged in any order, provided that they do not contradict each other. For example, the methods described in the present disclosure present various step elements in an exemplary order and are not limited to the specific order presented.

[0126] (6) Each function illustrated in Figures 2 and 10 is implemented by any combination of at least one of hardware and software. Furthermore, the method of implementing each function block is not particularly limited. That is, each function block may be implemented using one device that is physically or logically coupled, or it may be implemented using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wired or wireless connections). A function block may also be implemented by combining the one or more devices with software.

[0127] (7) The programs described above in this disclosure should be interpreted broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., whether they are referred to as software, firmware, middleware, microcode, hardware description languages ​​or by other names.

[0128] Furthermore, software, instructions, information, etc., may be transmitted and received via a transmission medium. For example, if software is transmitted from a website, server, or other remote source using at least one of wired technology (such as coaxial cable, fiber optic cable, twisted pair, or digital subscriber line (DSL)) and wireless technology (such as infrared or microwave), then at least one of these wired and wireless technologies is included in the definition of a transmission medium.

[0129] (8) In the foregoing disclosure, the terms “system” and “network” shall be used interchangeably.

[0130] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a given value, or other corresponding information.

[0131] (10) In the foregoing disclosure, the content provider 10 and terminal devices 30-1 to 30-N include cases where they are mobile stations (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or several other appropriate terms. In the same disclosure, terms such as “mobile station,” “user terminal,” “user equipment (UE),” and “terminal” may be used interchangeably.

[0132] (11) In the foregoing disclosure, the terms “connected,” “coupled,” or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, and may include one or more intermediate elements between two elements that are “connected” or “coupled” with each other. The coupling or connection between elements may be a physical coupling or connection, a logical coupling or connection, or a combination thereof. For example, “connection” may be reinterpreted as “access.” As used in the disclosure, two elements may be considered to be “connected” or “coupled” with each other using at least one of one or more wires, cables and printed electrical connections, and, in some non-limiting and non-exclusive examples, electromagnetic energy having wavelengths in the radio frequency domain, microwave domain and optical (both visible and invisible) domain.

[0133] (12) In the foregoing disclosure, the phrase “based on” does not mean “based solely on” unless otherwise specified. In other words, the phrase “based on” means both “based solely on” and “based at least on.”

[0134] (13) The terms “determining” and “determining” as used in this disclosure may encompass a wide variety of actions. “Determining” may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiry (e.g., searching in a table, database or other data structure), and ascertaining. “Determining” may also include, for example, receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, and accessing (e.g., accessing data in memory). Furthermore, "judgment" and "decision" can include considering something as having been "judged" or "decided" after resolving, selecting, choosing, establishing, comparing, etc. In other words, "judgment" and "decision" can include considering something as having been "judged" or "decided" after some action. Also, "judgment (decision)" can be reinterpreted as "assuming," "expecting," or "considering."

[0135] (14) Where the terms “include,” “including,” and variations thereof are used in the foregoing disclosure, these terms are intended to be inclusive, as is the term “comprising.” Furthermore, the term “or” as used in the disclosure is not intended to be exclusive OR.

[0136] (15) In the present disclosure, if articles are added by translation, such as a, an, and the in English, the present disclosure may include the fact that the noun following these articles is plural.

[0137] (16) In this disclosure, the term “A and B are different” may mean “A and B are different from each other.” The term may also mean “A and B are each different from C.” Terms such as “separate” and “combine” may be interpreted in the same way as “different.”

[0138] (17) The first embodiments and modifications described herein may be used individually, in combination, or switched between as needed in practice. Furthermore, notification of the specified information (e.g., notification that "X is") is not limited to explicit notification, but may also be implicit (e.g., by not notifying the specified information).

[0139] Although the present disclosure has been described in detail above, it will be clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the intent and scope of the present disclosure as defined by the claims. Accordingly, the descriptions in the present disclosure are illustrative and not restrictive in any way.

[0140] It will be apparent to those skilled in the art that this disclosure is not limited to the first embodiments and modifications described herein. This disclosure can be implemented in modified and altered forms without departing from the spirit and scope of this disclosure as defined by the claims. Accordingly, the descriptions herein are for illustrative purposes only and are not intended to be restrictive in any way. Furthermore, configurations selected from the first embodiments and modifications illustrated herein may be combined. [Explanation of Symbols]

[0141] 10...Content provision device, 100...Content provision system, 111...Communication control unit, 112...Data provision unit, 113...Coordination unit, 114...Display control unit, 1111...Request reception unit, 311...Display control unit, 312...Reception unit, 313...Decision unit, 314...Communication control unit, A1...Animation, D10...Animation data, D20...Manga data, D41...Manga character data, D42...Manga dialogue data, D51...Animation character data D52...Animation dialogue data, F3...Relationship information file, F41...Character data file, F42...Dialogue data file, F51...Character data file, F52...Dialogue data file, M1...Manga, P01...First learning model, P02...Second learning model, P03...Third learning model, P04...Fourth learning model, P05...Fifth learning model, PA, PM...Operation screen, RA, RM...Switching request data, SC...Screen, U...User.

Claims

1. A receiving unit that receives a user's switching instruction to switch to displaying a second scene related to the first scene of either an animation provided by a linked animation application or a comic provided by a comic application, while the first scene of one of the contents is being displayed on the display device, A communication control unit that acquires data including the second scene from the server, A display control unit that switches the display on the display device from the first scene to the second scene in response to the switching instruction, A terminal device characterized by having the following features.

2. The display control unit displays an operation screen prompting the user to switch to the other content while the first scene is being displayed on the display device. The reception unit receives the switching instruction from the user via the operation screen. The terminal device according to claim 1.

3. The second scene is identified based on a relational information file that associates information about the pages of the manga with information about the playback time of the animation. The terminal device according to claim 1.

4. A linking unit that links animation data executed by an animation application installable on the terminal device with manga data executed by a manga application installable on the terminal device, The terminal device includes a request receiving unit that, while displaying either the animation provided by the animation application or the comics provided by the comics application on the display device, receives a request from the user via the terminal device to switch from one of the contents to the other. A data provision unit that, in response to the switching request, provides the terminal device with data including a second scene of the other content related to the first scene, instead of providing data including a first scene of the other content. A content provisioning device characterized by having the following features.

5. The linking unit generates a relational information file that associates information about the manga pages with information about the animation playback time, and links the animation data and the manga data based on the relational information file. The content provisioning device according to claim 4.

6. The linking unit generates the relationship information file based on manga character data that associates the title, page, character name, and character position of the manga, and animation character data that associates the title, playback time, character name, and character position of the animation. The content provision device according to claim 5.

7. The linking unit generates the relationship information file based on manga dialogue data that associates the title, page, character name, and dialogue of the manga, and animation dialogue data that associates the title, character name, playback time, and dialogue of the animation. The content provision device according to claim 5.

8. The aforementioned linkage unit generates the manga character data and the animation character data, respectively, using a model that includes an object detection model for detecting the character and a character matching model for identifying the name of the character detected by the object detection model. The content provision device according to claim 6.

9. The aforementioned linkage unit performs scoring in the generation of the manga dialogue data by estimating which character's dialogue is closest to being spoken by. The content provision device according to claim 7.

Images