Content display device, content display system and content display program

Abstract

To give a highly amusing experience to a user.SOLUTION: A content display device 10 displays a content on a display. The content display device includes: a detection part 12 for detecting a predetermined object from a real space image which is an image of a real space imaged by a camera; and a content reproduction part 13 which is the content reproduction part 13 which displays a content of a moving picture associated with an object on a display, overlapped with the real space image, by associating with the detection position of the object in the real space image, in which the content includes a two-dimensional content in which a character is expressed two-dimensionally, and a three-dimensional content which is associated with the two-dimensional content and in which the character is expressed three-dimensionally, and which reproduces the two-dimensional contents and after the end of reproduction of the two-dimensional content, reproduces the three-dimensional content.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a content display device, a content display system, and a content display program. [Background technology]

[0002] There is known a so-called Augmented Reality (AR) technology that detects a known marker from an image captured in real space and displays content previously associated with the marker by superimposing it on the image of real space. There is also known a technology that downloads positional content according to a position and marker content according to a marker extracted from an image and displays each of the contents (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-133883 A Summary of the Invention [Problem to be solved by the invention]

[0004] In augmented reality technology, the contents reproduced and displayed on a display include two-dimensional (2D) contents that depict characters, etc. in two dimensions, and three-dimensional (3D) contents that depict characters, etc. in three dimensions. It is expected that these contents will provide users with a more interesting experience.

[0005] Therefore, the present invention has been made in consideration of the above problems, and has an object to provide a user with a highly interesting experience. [Means for solving the problem]

[0006] In order to solve the above problems, a content display device according to one aspect of the present disclosure is a content display device that displays content on a display, and includes a detection unit that detects a predetermined object from a real-space image, which is an image of real space captured by a camera, and a content playback unit that associates the object with a detected position in the real-space image and superimposes video content associated with the object on the real-space image and displays it on the display, the content including two-dimensional content in which a character is represented in two dimensions and three-dimensional content associated with the two-dimensional content and in which a character is represented in three dimensions, the content playback unit plays the two-dimensional content and plays the three-dimensional content after playback of the two-dimensional content has been completed.

[0007] According to the above aspect, the two-dimensional content associated with the object detected from the real space image is played back in association with the detection position of the object, and the three-dimensional content is played back after the two-dimensional content is played back. As a result, the animation of the character expressed in two dimensions is displayed, and then the animation of the same character expressed in three dimensions is displayed, so that the user can watch the character moving between the two-dimensional world and the three-dimensional world. This increases the user's interest. Effect of the Invention

[0008] It is possible to provide the user with a highly interesting experience. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a functional configuration of a content display system and a content display device according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of an image displayed on a display, the image being a real space image obtained by capturing an image of a real space in which an object is provided. [Diagram 3] 3 is a diagram showing an example of a configuration of a content storage unit and stored data; FIG. [Figure 4]FIG. 2 is a diagram illustrating a configuration of content data. [Diagram 5] FIG. 11 is a diagram showing an example of an image displayed on a display, in which a display frame is superimposed on a real space image. [Figure 6] FIG. 11 is a diagram showing an example of an image displayed on a display, in which two-dimensional content is reproduced and superimposed on a real space image. [Figure 7] FIG. 11 is a diagram showing an example of an image displayed on a display, in which three-dimensional content is reproduced and superimposed on a real space image. [Figure 8] FIG. 2 is a diagram showing an example of an image displayed on a display in which a three-dimensional content is reproduced and then a second two-dimensional content is reproduced. [Figure 9] FIG. 13 is a diagram showing an example of an image displayed on a display, in which link information is displayed within a display frame. [Figure 10] 4 is a flowchart showing the process of a content display method in a content display device. [Figure 11] FIG. 4 is a diagram showing a configuration of a content display program. [Figure 12] FIG. 2 is a hardware block diagram of a content display device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] An embodiment of a content display system according to the present invention will be described with reference to the drawings. Whenever possible, the same parts are given the same reference numerals and duplicated explanations will be omitted.

[0011] 1 is a diagram showing the functional configuration of a content display system and a content display device according to this embodiment. The content display system 1 of this embodiment is a system that displays content on a display, and is, as an example, configured by a content display device 10. The content display system 1 may include a VPS server 20 that provides VPS (Visual Positioning System) information to the content display device 10 via a network N.

[0012] As shown in Fig. 1, content display device 10 functionally comprises an image acquisition unit 11, a detection unit 12, and a content playback unit 13. Content display device 10 may also include devices such as a camera 14 and a display 15. These functional units 11-13 and devices 14, 15 may be configured in one device as exemplified in Fig. 1, or may be distributed across multiple devices. In other words, content display device 10 may be configured by functional units distributed across multiple devices.

[0013] Each of the functional units 11-13 of the content display device 10 is configured to be able to access a storage means (storage) such as a content storage unit 16. The content storage unit 16 may be provided in the content display device 10 as exemplified in Fig. 1, or may be configured in another device configured to be accessible from the content display device 10.

[0014] The VPS server 20 includes, for example, a VPS information providing unit 21 and a VPS information storage unit 22. The VPS information providing unit 21 provides VPS information to the content display device 10. The VPS information is information used for matching in order to detect an object from a real space image, which is an image of real space captured by the content display device 10, and may be information representing the shape of the object, information representing feature points of the object, etc. The VPS information may further include information for identifying the object.

[0015] The VPS information storage unit 22 is a storage means (storage) that stores VPS information. The VPS information providing unit 21 provides the VPS information acquired from the VPS information storage unit 22 to the content display device 10.

[0016] Next, a description will be given of each functional unit of the content display device 10. The image acquisition unit 11 acquires a real space image, which is an image of real space. The camera 14 captures the image of real space. The image acquisition unit 11 acquires the real space image captured by the camera 14.

[0017] The image acquiring unit 11 displays the acquired real space image on the display 15. Fig. 2 is a diagram showing an example of an image displayed on the display 15, the real space image being an image of a real space in which an object is provided. As shown in Fig. 2, an image D1, which is a real space image acquired by the image acquiring unit 11 and displayed on the display 15, includes an object ob. The object ob in this embodiment is a panel on which a character is depicted.

[0018] The detection unit 12 detects a predetermined object from the real space image. Specifically, the detection unit 12 detects a predetermined object stored in advance from the real space image acquired by the image acquisition unit 11, for example, by a known technology called VPS. The detection unit 12 detects a predetermined object ob from the image D1, for example, based on VPS information provided by the VPS server 20. The detection unit 12 may acquire identification information of the detected object ob based on the VPS information.

[0019] The content playback unit 13 associates the moving image content associated with the object with the detected position of the object ob in the real space image, and plays and displays the moving image content associated with the object on the display by superimposing the moving image content on the real space image.

[0020] The content reproducing unit 13 may, for example, obtain and reproduce content stored in the content storage unit 16. Fig. 3 is a diagram showing a schematic example of the configuration of the content storage unit 16 and data stored therein. As shown in Fig. 3, the content storage unit 16 stores content data in association with object information that identifies the object.

[0021] When the object information identifying the object detected by the detection unit 12 is "obj1", the content playback unit 13 acquires the content data "cont1" associated with the object information "obj1". Note that in this embodiment, the content data is stored in the content storage unit 16 provided in the content display device 10, but the content playback unit 13 may acquire the content data from another device configured to be able to communicate with the content display device 10.

[0022] The content in this embodiment includes two-dimensional content in which a character is expressed in two dimensions, and three-dimensional content in which a character is expressed in three dimensions and is associated with the two-dimensional content.

[0023] Fig. 4 is a diagram showing a schematic configuration of content data. As shown in Fig. 4, the content data cd includes two-dimensional content cd1 and three-dimensional content cd2. The content playback unit 13 first plays back the two-dimensional content cd1 in association with the detection position of the object ob, and plays back the 3D content cd2 after the playback of the two-dimensional content cd1 is completed.

[0024] Hereinafter, the content reproduction process by the content reproduction unit 13 will be described step by step with reference to Figs. 5 to 9. The content reproduction unit 13 may display the two-dimensional content cd1 in an area in the real space image that corresponds to the shape of the object ob. In this embodiment, the object ob provided in the real space has a plane with an extension, and may be, for example, a panel-like object (hereinafter, referred to as a "panel") representing a character. The content reproduction unit 13 sets the area in the real space image in which the panel is represented as an area for reproducing the two-dimensional content cd1.

[0025] More specifically, the content reproduction unit 13 displays a display frame consisting of a monochromatic region in an area corresponding to the shape of the object ob. FIG. 5 is a diagram showing an example of an image D2 displayed on the display 15, in which the display frame is superimposed on a real space image. As shown in FIG. 5, the content reproduction unit 13 displays a display frame df consisting of a monochromatic region corresponding to the shape of the object ob superimposed on the real space image. The display frame df is an area set for playing the two-dimensional content cd1, and may be a monochromatic white area. By displaying the display frame df in this manner, it becomes possible for the user to recognize the area on the display 15 in which the two-dimensional content cd1 is played and displayed.

[0026] The content playback unit 13 displays the character in the two-dimensional content cd1 in the display frame df. Fig. 6 is a diagram showing an example of an image displayed on the display 15, in which the two-dimensional content cd1 is played back and superimposed on a real space image. An image D3 is a real space image on which the display frame df is superimposed. The content playback unit 13 displays the character ch1 constituting the two-dimensional content cd1 in the display frame df. The display frame df is set in an area corresponding to the panel on which the character is displayed, and the character ch1 is displayed in the display frame df, so that the user can experience as if the character displayed in the object ob had started moving.

[0027] Following the end of the playback of the two-dimensional content cd1, the content playback unit 13 plays the corresponding three-dimensional content cd2. The three-dimensional content cd2 includes an action expression in which a character jumps out of the display frame df. Fig. 7 is a diagram showing an example of an image displayed on the display 15 in which the three-dimensional content cd2 is played back and superimposed on a real space image. An image D4 is a real space image on which the three-dimensional content cd2 is superimposed.

[0028] As shown in Fig. 7, the content reproducing unit 13 reproduces three-dimensional content cd2 including an expression of an action of a three-dimensional character ch2 jumping out of a display frame df by superimposing it on a real space image. Also, as illustrated in Fig. 7, the area in which the three-dimensional content cd2 is reproduced is not limited to the display frame df, unlike the reproduction of two-dimensional content cd1. By reproducing such three-dimensional content cd2, the user can experience as if the character has moved from the two-dimensional world to the three-dimensional world.

[0029] Here, the motion representation of the character ch1 in the two-dimensional content cd1 immediately before the end of playback and the motion representation of the character ch2 in the three-dimensional content cd2 immediately after the start of playback may be configured to be continuous in time series. In this way, the motion representation of the character in the two-dimensional content cd1 and the motion representation of the character in the three-dimensional content cd2 are configured so that there is continuity between them, so that the user can experience as if the character had jumped out of the two-dimensional world into the three-dimensional world.

[0030] In order to realize an action expression of the character ch2 represented in three dimensions as if it were jumping out of the display frame df, the representation of the character ch1 in the two-dimensional content cd1 immediately before the end of playback and the representation of the character ch2 in the three-dimensional content cd2 immediately after the start of playback may be configured to match at least in part, thereby ensuring the continuity of the character's action expression.

[0031] In order to realize an action expression in which the three-dimensional character ch2 appears to jump out of the display frame df, the pixels on the display 15 where at least a part of the character's expression in the two-dimensional content cd1 immediately before the end of playback is displayed may be configured to match the pixels where the part of the character's expression in the three-dimensional content cd2 immediately after the start of playback is displayed. This strictly ensures the continuity of the character's action expression.

[0032] After the playback of the three-dimensional content cd2 is completed, the content playback unit 13 may further play back a second two-dimensional content in which a character is expressed, in the display frame. Fig. 8 is a diagram showing an example of an image displayed on the display 15, in which the second two-dimensional content is played back after the three-dimensional content cd2 is played back. An image D5 is a real space image in which the display frame df and the second two-dimensional content are superimposed and displayed.

[0033] As shown in Fig. 8, the content reproducing unit 13 reproduces and superimposes a second two-dimensional content in the display frame df superimposed on the real space image after reproducing the three-dimensional content cd2. The second two-dimensional content includes a character ch3 expressed in two dimensions, and the character ch3 is accompanied by an action expression as if the character has returned from the three-dimensional real space to the two-dimensional world. In this way, by reproducing the second two-dimensional content including the expression of the character in the display frame following the reproduction of the three-dimensional content, the user can have an experience as if the character has returned from the three-dimensional world to inside the object of the panel, which is the two-dimensional world.

[0034] The content playback unit 13 may display predetermined link information in the display frame df after playing back the three-dimensional or two-dimensional content including the representation of a character. Fig. 9 is a diagram showing an example of an image displayed on the display 15, in which link information is displayed in the display frame df. Image D6 is a real space image in which link information is displayed in the display frame df.

[0035] 9, the content playback unit 13 displays link information ln in a display frame df superimposed on a real space image. When a user performs a predetermined operation such as tapping on the link information ln, information on the linked destination is provided to the content display device 10 and displayed on the display 15. Thereby, for example, by configuring the link information ln as a link to a site that provides information on the character, it becomes possible to provide information related to the character to the user.

[0036] FIG. 10 is a flowchart showing the process of the content display method in the content display system 1. As shown in FIG.

[0037] In step S1, the content display device 10 uses the camera 14 to capture an image of a real space in which an object, which is a panel including a representation of a character, is placed.

[0038] In step S2, the image acquisition unit 11 acquires a real space image, which is an image of real space captured by the camera 14. The image acquisition unit 11 causes the display 15 to display the acquired real space image.

[0039] In step S3, the detection unit 12 detects a panel (object) from the real space image. In step S4, the content reproduction unit 13 obtains object data associated with the detected panel.

[0040] In step S5, the content playback unit 13 displays a display frame df consisting of a monochrome (e.g., white) area in an area corresponding to the shape of the panel, and displays two-dimensional content cd1 in which a character is represented in two dimensions within the display frame df.

[0041] In step S6, following the end of the playback of the two-dimensional content cd1, the content playback unit 13 plays the corresponding three-dimensional content cd2. Unlike the playback of the two-dimensional content cd1, the area in which the three-dimensional content cd2 is played is not limited to within the display frame df. In step S7, after the playback of the three-dimensional content cd2 is ended, the content playback unit 13 further plays a second two-dimensional content in which a character is expressed within the display frame df.

[0042] In step S8, the content reproducing unit 13 displays link information ln including link information to a predetermined site in the display frame df.

[0043] Next, a content display program for causing a computer to function as the content display device 10 of this embodiment will be described with reference to Fig. 11. Fig. 11 is a diagram showing the configuration of the content display program. The content display program P1 is configured to include a main module m10 that performs overall control of the content display process in the content display device 10, an image acquisition module m11, a detection module m12, and a content playback module m13. Each of the modules m11 to m13 realizes a function for each of the functional units 11 to 13.

[0044] The content display program P1 may be transmitted via a transmission medium such as a communication line, or may be stored in a recording medium M1 as shown in FIG.

[0045] According to the content display system 1, the content display device 10, the content display method, and the content display program P1 of the present embodiment described above, the two-dimensional content associated with an object detected from a real space image is played back in association with the detection position of the object, and the three-dimensional content is played back after the two-dimensional content has been played back. As a result, a video of a character expressed in two dimensions is displayed, and then a video of the same character expressed in three dimensions is displayed, so that the user can watch the character moving between the two-dimensional world and the three-dimensional world. This increases the user's interest.

[0046] The content display device 10, the content display system 1, and the content display program P1 according to the present disclosure may have the following configurations. Furthermore, the actions and effects of each configuration will be described as follows.

[0047] A content display device according to one aspect of the present disclosure is a content display device that displays content on a display, and includes a detection unit that detects a predetermined object from a real-space image, which is an image of real space captured by a camera, and a content playback unit that associates the object with a detected position in the real-space image and superimposes video content associated with the object on the real-space image and displays it on the display, the content including two-dimensional content in which a character is represented in two dimensions and three-dimensional content associated with the two-dimensional content and in which a character is represented in three dimensions, the content playback unit playing the two-dimensional content and playing the three-dimensional content after playback of the two-dimensional content has been completed.

[0048] A content display system according to one aspect of the present disclosure is a content display system that displays content on a display, and includes a detection unit that detects a predetermined object from a real-space image, which is an image of real space captured by a camera, and a content playback unit that associates the object with a detected position in the real-space image and superimposes video content associated with the object on the real-space image and displays it on the display, the content including two-dimensional content in which a character is represented in two dimensions and three-dimensional content associated with the two-dimensional content and in which a character is represented in three dimensions, and the content playback unit plays the two-dimensional content and plays the three-dimensional content after playback of the two-dimensional content has finished.

[0049] A content display program according to one aspect of the present disclosure is a content display program for causing a computer to function as a content display device that displays content on a display, and provides the computer with a detection function for detecting a predetermined object from a real-space image, which is an image of real space captured by a camera, and a content playback function for superimposing video content associated with the object on the real-space image, associated with the detected position of the object in the real-space image, and displaying the content on the display, the content including two-dimensional content in which a character is represented in two dimensions and three-dimensional content associated with the two-dimensional content and in which a character is represented in three dimensions, playing the two-dimensional content and playing the three-dimensional content after playback of the two-dimensional content has been completed.

[0050] According to the above aspect, the two-dimensional content associated with the object detected from the real space image is played back in association with the detection position of the object, and the three-dimensional content is played back after the two-dimensional content is played back. As a result, the animation of the character expressed in two dimensions is displayed, and then the animation of the same character expressed in three dimensions is displayed, so that the user can watch the character moving between the two-dimensional world and the three-dimensional world. This increases the user's interest.

[0051] In a content display device according to another aspect, the content playback section may set an area corresponding to the shape of an object in a real space image as a display frame, and display two-dimensional content within the display frame.

[0052] According to the above aspect, two-dimensional content depicting a character is displayed within an area corresponding to the shape of an object, so that a user can experience as if the character depicted in the object has started to move.

[0053] In a content display device according to another aspect, the content playback section may display a display frame made up of a single color area.

[0054] According to the above aspect, it is possible to allow a user to recognize the area on the display where two-dimensional content is reproduced and displayed.

[0055] In a content display device according to another aspect, the content playback section may display a character in the two-dimensional content within the display frame.

[0056] According to the above aspect, a display frame is set in an area corresponding to the detected object, and a character is displayed within the display frame, allowing the user to experience as if the character represented in the object had started to move.

[0057] In a content display device according to another aspect, the area in which the three-dimensional content is played back may not be limited to the display frame.

[0058] According to the above aspect, the user can experience as if the character has jumped out of the two-dimensional world into the three-dimensional world.

[0059] In addition, in a content display device according to another aspect, the content playback unit may further play back a second two-dimensional content depicting a character within the display frame after playback of the three-dimensional content has been completed.

[0060] According to the above aspect, by playing back the three-dimensional content, followed by playing back a second two-dimensional content including a representation of the character within the display frame, the user can experience as if the character had returned from the three-dimensional world to an object in the two-dimensional world.

[0061] In addition, in a content display device according to another aspect, the content playback unit may display predetermined link information in the display frame after playback of three-dimensional content or two-dimensional content including a character representation.

[0062] According to the above aspect, for example, by displaying link information to a site that provides information about the character, it is possible to provide the user with information related to the character.

[0063] In addition, in a content display device according to another aspect, the content playback unit may play the three-dimensional content continuously after the playback of the two-dimensional content has ended, and the movement representation of the character in the two-dimensional content immediately before the playback has ended and the movement representation of the character in the three-dimensional content immediately after the playback has started may be continuous in chronological order.

[0064] According to the above aspect, the two-dimensional content and the three-dimensional content are configured so that there is continuity between the expression of a character's movements in the two-dimensional content and the expression of a character's movements in the three-dimensional content, thereby providing the user with the experience of the character jumping out of the two-dimensional world into the three-dimensional world.

[0065] The block diagram shown in FIG. 1 shows functional blocks. These functional blocks (components) are realized by any combination of at least one of hardware and software. The method of realizing each functional block is not particularly limited. That is, each functional block may be realized by using one device that is physically or logically combined, or may be realized by using two or more devices that are physically or logically separated and directly or indirectly connected (for example, by using wires, wirelessly, etc.). The functional block may be realized by combining the one device or the multiple devices with software.

[0066] Functions include, but are not limited to, judgment, determination, judgment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocation, mapping, assignment, etc. For example, a functional block (component) that performs the function of transmission is called a transmitting unit or a transmitter. In either case, as described above, there is no particular limitation on the method of realization.

[0067] For example, content display device 10 in one embodiment of the present invention may function as a computer. Fig. 12 is a diagram showing an example of the hardware configuration of content display device 10 according to this embodiment. Content display device 10 may be physically configured as a computer device including a processor 1001, memory 1002, storage 1003, communication device 1004, input device 1005, output device 1006, bus 1007, etc.

[0068] In the following description, the word "apparatus" may be interpreted as a circuit, a device, a unit, etc. The hardware configuration of content display device 10 may be configured to include one or more of the devices shown in the figures, or may be configured to exclude some of the devices.

[0069] Each function in the content display device 10 is realized by loading specific software (programs) onto hardware such as a processor 1001 and a memory 1002, causing the processor 1001 to perform calculations and control communications via a communication device 1004 and the reading and / or writing of data in the memory 1002 and storage 1003.

[0070] The processor 1001 controls the entire computer by running, for example, an operating system. The processor 1001 may be configured as a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, each of the functional units 11 to 13 shown in FIG. 1 may be realized by the processor 1001.

[0071] Furthermore, the processor 1001 reads out programs (program codes), software modules, and data from the storage 1003 and / or the communication device 1004 into the memory 1002, and executes various processes in accordance with these. The programs used are those that cause a computer to execute at least some of the operations described in the above-mentioned embodiments. For example, the functional units 11 to 13 of the content display device 10 may be realized by a control program stored in the memory 1002 and operated by the processor 1001. Although the above-mentioned various processes have been described as being executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented in one or more chips. The programs may be transmitted from a network via a telecommunications line.

[0072] The memory 1002 is a computer-readable recording medium, and may be composed of at least one of, for example, a Read Only Memory (ROM), an Erasable Programmable ROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), a Random Access Memory (RAM), etc. The memory 1002 may also be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store a program (program code), software modules, etc. that are executable to implement a content display method according to one embodiment of the present invention.

[0073] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray® disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy disk, a magnetic strip, and the like. Storage 1003 may be referred to as an auxiliary storage device. The above-mentioned storage medium may be, for example, a database, a server, or other suitable medium including memory 1002 and / or storage 1003.

[0074] The communication device 1004 is hardware (transmission / reception device) for performing communication between computers via a wired and / or wireless network, and is also called, for example, a network device, a network controller, a network card, or a communication module.

[0075] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that accepts input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that performs output to the outside. The input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).

[0076] Furthermore, each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be configured as a single bus, or may be configured as different buses between the devices.

[0077] Furthermore, content display device 10 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), etc., and some or all of the functional blocks may be realized by the hardware. For example, processor 1001 may be implemented by at least one of these pieces of hardware.

[0078] The notification of information is not limited to the aspects / embodiments described in the present disclosure, and may be performed using other methods. For example, the notification of information may be performed by physical layer signaling (e.g., Downlink Control Information (DCI), Uplink Control Information (UCI)), higher layer signaling (e.g., Radio Resource Control (RRC) signaling, Medium Access Control (MAC) signaling, broadcast information (Master Information Block (MIB), System Information Block (SIB))), other signals, or a combination thereof. In addition, the RRC signaling may be called an RRC message, and may be, for example, an RRC Connection Setup message, an RRC Connection Reconfiguration message, or the like.

[0079] Each aspect / embodiment described in the present disclosure may be applied to at least one of systems using LTE (Long Term Evolution), LTE-A (LTE-Advanced), SUPER 3G, IMT-Advanced, 4G (4th generation mobile communication system), 5G (5th generation mobile communication system), FRA (Future Radio Access), NR (new Radio), W-CDMA (registered trademark), GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi (registered trademark)), IEEE 802.16 (WiMAX (registered trademark)), IEEE 802.20, UWB (Ultra-WideBand), Bluetooth (registered trademark), and other suitable systems, and next-generation systems extended based on these. In addition, a combination of multiple systems (e.g., a combination of at least one of LTE and LTE-A and 5G, etc.) may be applied.

[0080] The order of the steps, sequences, flow charts, etc. of each aspect / embodiment described in this disclosure may be changed unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0081] In the present disclosure, a specific operation performed by a base station may be performed by its upper node in some cases. In a network consisting of one or more network nodes having a base station, it is clear that various operations performed for communication with a terminal may be performed by at least one of the base station and other network nodes other than the base station (e.g., MME or S-GW, etc., but are not limited to these). Although the above example illustrates a case in which there is one other network node other than the base station, it may also be a combination of multiple other network nodes (e.g., MME and S-GW).

[0082] Information, etc. may be output from a higher layer (or a lower layer) to a lower layer (or a higher layer). Information may be input / output via multiple network nodes.

[0083] The input and output information may be stored in a specific location (e.g., memory) or may be managed in a management table. The input and output information may be overwritten, updated, or added to. The output information may be deleted. The input information may be transmitted to another device.

[0084] The determination may be based on a value represented by a single bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0085] Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched according to execution. In addition, notification of specific information (e.g., notification that "X is the case") is not limited to being done explicitly, but may be done implicitly (e.g., not notifying the specific information).

[0086] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0087] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0088] Additionally, software, instructions, etc. may be transmitted or received over a transmission medium. For example, if the software is transmitted from a website, server, or other remote source using wired technologies, such as coaxial cable, fiber optic cable, twisted pair, and Digital Subscriber Line (DSL), and / or wireless technologies, such as infrared, radio, and microwave, these wired and / or wireless technologies are included within the definition of transmission media.

[0089] The information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0090] In addition, terms explained in this disclosure and / or terms necessary for understanding this specification may be replaced with terms having the same or similar meanings.

[0091] As used in this disclosure, the terms "system" and "network" are used interchangeably.

[0092] In addition, the information, parameters, etc. described in the present disclosure may be represented by absolute values, may be represented by relative values ​​from a predetermined value, or may be represented by other corresponding information. For example, a radio resource may be indicated by an index.

[0093] The names used for the above-mentioned parameters are not limiting in any way. Moreover, the formulas using these parameters may differ from those explicitly disclosed in this disclosure. The various channels (e.g., PUCCH, PDCCH, etc.) and information elements may be identified by any suitable names, and therefore the various names assigned to these various channels and information elements are not limiting in any way.

[0094] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, inquiry (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in a memory), and the like. In addition, "judgment" and "decision" can include considering resolving, selecting, choosing, establishing, comparing, etc., to be a "judgment" or "decision." In other words, "judgment" and "decision" can include considering some action to be a "judgment" or "decision." In addition, "judgment" can be interpreted as "assuming," "expecting," "considering," etc.

[0095] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0096] When designations such as "first," "second," and the like are used in this disclosure, any reference to an element is not intended to generally limit the quantity or order of those elements. These designations may be used herein as a convenient way to distinguish between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed therein or that the first element must precede the second element in some way.

[0097] The "means" in the configuration of each of the above devices may be replaced with "part," "circuit," "device," etc.

[0098] To the extent that the terms "include," "including," and variations thereof are used herein in the specification or claims, these terms are intended to be inclusive, similar to the term "comprising." Further, the term "or" as used herein is not intended to be an exclusive or.

[0099] In this disclosure, where articles have been added due to translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0100] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different."

[0101] The content display device 10, the content display system 1, and the content display program of the present disclosure may have the following configuration. [1] A content display device that displays content on a display, a detection unit that detects a predetermined object from a real space image that is an image of real space captured by a camera; a content playback unit that displays on the display a video content associated with the object in association with a detection position of the object in the real space image, the video content being superimposed on the real space image, the video content including a two-dimensional content in which a character is expressed in two dimensions and a three-dimensional content associated with the two-dimensional content in which the character is expressed in three dimensions, the content playback unit playing back the two-dimensional content and playing back the three-dimensional content after the playback of the two-dimensional content has ended; A content display device comprising: [2] the content playback unit displays the two-dimensional content within a display frame, the two-dimensional content being displayed within a region in the real space image that corresponds to a shape of the object; A content display device according to [1]. [3] the content playback unit displays the display frame consisting of a monochrome area; A content display device according to [2]. [4] the content playback unit displays the character in the two-dimensional content within the display frame. A content display device according to [2] or [3]. [5] The area in which the three-dimensional content is played back is not limited to the display frame; The content display device according to any one of [2] to [4]. [6] After the playback of the three-dimensional content is completed, the content playback unit further plays a second two-dimensional content in which the character is expressed, within the display frame. The content display device according to any one of [2] to [5]. [7] the content playback unit displays predetermined link information in the display frame after playback of the three-dimensional content or the two-dimensional content including the representation of the character. The content display device according to any one of [2] to [6]. [8] the content playback unit continuously plays the three-dimensional content after the playback of the two-dimensional content is completed; The movement representation of the character in the two-dimensional content immediately before the end of playback and the movement representation of the character in the three-dimensional content immediately after the start of playback are continuous in time series. The content display device according to any one of [1] to [7]. [9] A content display system for displaying content on a display, comprising: a detection unit that detects a predetermined object from a real space image that is an image of real space captured by a camera; a content playback unit that displays on the display a video content associated with the object in association with a detection position of the object in the real space image, the video content being superimposed on the real space image, the video content including a two-dimensional content in which a character is expressed in two dimensions and a three-dimensional content associated with the two-dimensional content in which the character is expressed in three dimensions, the content playback unit playing back the two-dimensional content and playing back the three-dimensional content after the playback of the two-dimensional content has ended; A content display system comprising:

[10] A content display program for causing a computer to function as a content display device that displays content on a display, The computer includes: A detection function for detecting a predetermined object from a real space image, which is an image of real space captured by a camera; a content playback function for superimposing video content associated with the object on the real-space image in association with a detection position of the object in the real-space image and displaying the content on the display, the content including two-dimensional content in which a character is expressed in two dimensions and three-dimensional content associated with the two-dimensional content in which the character is expressed in three dimensions, playing the two-dimensional content, and playing the three-dimensional content after the playback of the two-dimensional content has ended; A content display program that makes this possible. [Explanation of symbols]

[0102] 1...content display system, 10...content display device, 11...image acquisition unit, 12...detection unit, 13...content playback unit, 14...camera, 15...display, 16...content storage unit, 20...VPS server, 21...VPS information providing unit, 22...VPS information storage unit, cd...content data, cd1...2D content, cd2...3D content, ch1, ch2, ch3...character, df...display frame, ln...link information, M1...recording medium, m10...main module, m11...image acquisition module, m12...detection module, m13...content playback module, ob...object, P1...content display program.

Claims

1. A content display device that displays content on a display, a detection unit that detects a predetermined object from a real space image that is an image of real space captured by a camera; a content playback unit that displays on the display a video content associated with the object in association with a detection position of the object in the real space image, the video content being superimposed on the real space image, the video content including a two-dimensional content in which a character is expressed in two dimensions and a three-dimensional content associated with the two-dimensional content in which the character is expressed in three dimensions, the content playback unit playing back the two-dimensional content and playing back the three-dimensional content after the playback of the two-dimensional content has ended; A content display device comprising:

2. the content playback unit displays the two-dimensional content within a display frame, the two-dimensional content being displayed within a region in the real space image that corresponds to a shape of the object; The content display device according to claim 1 .

3. the content playback unit displays the display frame consisting of a monochrome area; The content display device according to claim 2 .

4. the content playback unit displays the character in the two-dimensional content within the display frame; The content display device according to claim 2 .

5. The area in which the three-dimensional content is played back is not limited to the display frame. The content display device according to claim 2 .

6. After the playback of the three-dimensional content is completed, the content playback unit further plays a second two-dimensional content in which the character is expressed, within the display frame. The content display device according to claim 2 .

7. the content playback unit displays predetermined link information in the display frame after playback of the three-dimensional content or the two-dimensional content including the representation of the character. The content display device according to claim 2 .

8. the content playback unit plays back the three-dimensional content continuously after the playback of the two-dimensional content is completed; The movement representation of the character in the two-dimensional content immediately before the end of playback and the movement representation of the character in the three-dimensional content immediately after the start of playback are continuous in time series. The content display device according to claim 1 .

9. A content display system for displaying content on a display, comprising: a detection unit that detects a predetermined object from a real space image that is an image of real space captured by a camera; a content playback unit that displays on the display a video content associated with the object in association with a detection position of the object in the real space image, the video content being superimposed on the real space image, the video content including a two-dimensional content in which a character is expressed in two dimensions and a three-dimensional content associated with the two-dimensional content in which the character is expressed in three dimensions, the content playback unit playing back the two-dimensional content and playing back the three-dimensional content after the playback of the two-dimensional content has ended; A content display system comprising:

10. A content display program for causing a computer to function as a content display device that displays content on a display, The computer includes: A detection function for detecting a predetermined object from a real space image, which is an image of real space captured by a camera; a content playback function for superimposing video content associated with the object on the real-space image in association with a detection position of the object in the real-space image and displaying the content on the display, the content including two-dimensional content in which a character is expressed in two dimensions and three-dimensional content in which the character is expressed in three dimensions associated with the two-dimensional content, playing the two-dimensional content, and playing the three-dimensional content after the playback of the two-dimensional content has ended; A content display program that makes this possible.

Images