Content display system, content display device, and content display program

Abstract

The present invention provides a content display system, a content display device, and a content display program that can increase the number of displayable content types relative to the number of marker types. [Solution] The content display system comprises a content display device that displays content and a content distribution system that distributes content to the content display device. The content display device recognizes markers by photography, and the content distribution system distributes content to the content display device according to the content of the multiple markers recognized by the content display device and the order in which these markers were recognized by the content display device (S143). The content display device displays the content distributed by the content distribution system (S144).

Description

Technical Field

[0001] The present invention relates to a content display system, a content display device, and a content display program that display content corresponding to a marker recognized by photography.

Background Art

[0002] Conventionally, a content display device that displays content corresponding to a marker included in a photographed image has been known (see, for example, Patent Documents 1-3).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in a conventional content display device, since there is one content corresponding to each marker, there is a problem that in order to increase the number of types of displayable content, it is necessary to increase the number of types of markers.

[0005] Therefore, an object of the present invention is to provide a content display system, a content display device, and a content display program that can increase the number of types of displayable content with respect to the number of types of markers.

Means for Solving the Problems

[0006] The content display system of the present invention comprises a content display device that displays content and a content distribution system that distributes the content to the content display device, wherein the content display device recognizes markers by imaging, the content distribution system distributes the content to the content display device according to the contents of a plurality of markers recognized by the content display device and the order in which these markers were recognized by the content display device, and the content display device displays the content distributed by the content distribution system.

[0007] With this configuration, the content display system of the present invention displays content on the content display device according to the content of multiple markers recognized by the content display device and the order in which these markers were recognized by the content display device. Therefore, even if markers of the same type are recognized by the content display device, the type of content displayed by the content display device may differ. Accordingly, the content display system of the present invention can increase the number of displayable content types relative to the number of marker types.

[0008] In the content display system of the present invention, if the recognized plurality of markers include a code image as an image of a code indicating a page number, the content display device may display the content in a state where the page number indicated by the code image is open, when the content is a document having multiple pages.

[0009] With this configuration, the content display system of the present invention can improve convenience by displaying the content in an open state on the page number indicated by the code image when the content is a document with multiple pages, provided that multiple markers recognized by the content display device include a code image indicating a page number.

[0010] In the content display system of the present invention, the content display device may display the content using AR (Augmented Reality).

[0011] With this configuration, the content display system of the present invention can display content using augmented reality (AR), thereby improving convenience.

[0012] The content display device of the present invention is characterized by recognizing markers by imaging and displaying content corresponding to the content of the multiple recognized markers and the order in which these markers were recognized.

[0013] With this configuration, the content display device of the present invention displays content corresponding to the content of multiple recognized markers and the order in which these markers were recognized. Therefore, even when markers of the same type are recognized, the type of content displayed may differ. Consequently, the content display device of the present invention can increase the number of displayable content types relative to the number of marker types.

[0014] The content display program of the present invention is characterized by causing a computer to recognize markers by taking a photograph, and displaying content on the computer corresponding to the content of a plurality of markers recognized by the computer and the order in which these markers were recognized by the computer.

[0015] With this configuration, a computer running the content display program of the present invention displays content corresponding to the content of multiple recognized markers and the order in which these markers were recognized. Therefore, even when markers of the same type are recognized, the type of content displayed may differ. Consequently, a computer running the content display program of the present invention can increase the number of displayable content types relative to the number of marker types. [Effects of the Invention]

[0016] The content display system, content display device, and content display program of the present invention can increase the number of types of displayable content with respect to the number of types of markers.

Brief Description of the Drawings

[0017] [Figure 1] It is a block diagram of an example of a system according to the first embodiment of the present invention. [Figure 2] It is a front view of an example of the image forming apparatus shown in FIG. 1. [Figure 3] It is a block diagram of an example of the image forming apparatus shown in FIG. 2. [Figure 4] It is a diagram showing an example of display marker information shown in FIG. 3. [Figure 5] It is a block diagram of an example of the content display device shown in FIG. 1. [Figure 6] It is a diagram showing an example of marker information shown in FIG. 5. [Figure 7] It is a diagram showing an example of history information shown in FIG. 5. [Figure 8] It is a block diagram of an example of the content distribution system shown in FIG. 1 when it is configured by one computer. [Figure 9] It is a diagram showing an example of distribution content information shown in FIG. 8. [Figure 10] It is a flowchart of the operation of the image forming apparatus shown in FIG. 3 when an error occurs. [Figure 11] It is a flowchart of the operation of the content display device shown in FIG. 5 when shooting is being performed by the shooting unit. [Figure 12] It is a sequence diagram of the operation of the system shown in FIG. 1 when the content display device transmits a history to the content distribution system. [Figure 13] It is a flowchart of the operation of the content display device shown in FIG. 5 when the history shown in the history information is deleted. [Figure 14](a) This figure shows an example of a screen displayed by the display unit of the content display device shown in Figure 5. (b) This figure shows another example of a screen displayed by the display unit of the content display device, different from the example shown in Figure 14(a). [Figure 15] (a) This figure shows an example of a screen displayed by the display unit of a content display device, different from the examples shown in Figures 14(a) and 14(b). (b) This figure shows an example of a screen displayed by the display unit of a content display device, different from the examples shown in Figures 14(a), 14(b), and 15(a). (c) This figure shows an example of a screen displayed by the display unit of a content display device, different from the examples shown in Figures 14(a), 14(b), 15(a), and 15(b). [Figure 16] This is a block diagram of an example of a system according to a second embodiment of the present invention. [Figure 17] Figure 16 is a block diagram of an example of a content display device. [Figure 18] Figure 17 shows an example of the display content information. [Figure 19] Figure 17 is a flowchart illustrating the operation of the content display device when the image is being captured by the camera unit. [Modes for carrying out the invention]

[0018] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0019] (First Embodiment) First, the configuration of the system according to this embodiment will be described.

[0020] Figure 1 is a block diagram of an example of the system 10 according to this embodiment.

[0021] As shown in Figure 1, the system 10 includes an image forming apparatus 20 as an electronic device and a content display system 11 that displays content related to the image forming apparatus 20.

[0022] The content display system 11 includes a content display device 30, which is a computer that displays content related to the image forming apparatus 20, and a content distribution system 40 that distributes content related to the image forming apparatus 20 to the content display device 30.

[0023] The content display device 30 may be comprised of, for example, a smartphone or a head-mounted display.

[0024] The content distribution system 40 may consist of one computer, such as a PC (Personal Computer), or it may consist of multiple computers. The content distribution system 40 may also be configured on the cloud.

[0025] System 10 may be used, for example, in the commercial printing industry or the industrial printing industry. In the commercial and industrial printing industries, printing companies often perform maintenance work on the image forming apparatus 20 themselves. Therefore, it is highly convenient if the manual for the image forming apparatus 20 is displayed as content by the content display device 30.

[0026] Figure 2 is a front view of an example of the image forming apparatus 20. Figure 3 is a block diagram of an example of the image forming apparatus 20.

[0027] As shown in Figures 2 and 3, the image forming apparatus 20 is a computer comprising a supply unit 21 that supplies a recording medium such as paper, a printing engine 22 which is a printing device that prints an image on the recording medium supplied by the supply unit 21, an ejection unit 23 that ejects the recording medium on which the image has been printed by the printing engine 22, a display unit 24 which is a display device such as an LCD (Liquid Crystal Display) that displays various information, a communication unit 25 which is a communication device that communicates with external devices via a network such as a LAN or the Internet, or directly by wired or wireless connection without going through a network, a storage unit 26 which is a non-volatile storage device such as a semiconductor memory or HDD (Hard Disk Drive) that stores various information, and a control unit 27 that controls the entire image forming apparatus 20.

[0028] As shown in Figure 2, the image forming apparatus 20 includes a marker 28a that is attached to the supply unit 21 and displayed on the supply unit 21, a marker 28b that is attached to the printing engine 22 and displayed on the printing engine 22, and a marker 28c that is attached to the discharge unit 23 and displayed on the discharge unit 23.

[0029] The image forming apparatus 20 can also display the marker 28d using the display unit 24. The marker 28d may be a code image, which is an image of a code that indicates information according to a specific rule. As the code image, for example, a one-dimensional code may be used, or a two-dimensional code such as a QR code (registered trademark) may be used.

[0030] As shown in Figure 3, the storage unit 26 can store a marker display program 26a for displaying the marker 28d on the display unit 24. The marker display program 26a may be installed in the image forming apparatus 20 during the manufacturing stage, or it may be additionally installed in the image forming apparatus 20 from an external storage medium such as a USB (Universal Serial Bus) memory, or it may be additionally installed in the image forming apparatus 20 from a network.

[0031] The storage unit 26 can store display marker information 26b that indicates markers to be displayed on the display unit 24.

[0032] Figure 4 shows an example of display marker information 26b.

[0033] The display marker information 26b shown in Figure 4 is a table that associates an error ID, which serves as error identification information, with a marker to be displayed on the display unit 24 for each error ID. For example, the display marker information 26b may associate a code image indicating the page number of the page related to a specific error in a specific manual with the error ID of that error. Some information is omitted in the display marker information 26b shown in Figure 4.

[0034] The control unit 27 shown in Figure 3 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory) that stores programs and various data, and a RAM (Random Access Memory) used as a working area for the CPU of the control unit 27. The CPU of the control unit 27 executes programs stored in the storage unit 26 or the ROM of the control unit 27.

[0035] The control unit 27 implements a marker display unit 27a that displays the marker 28d on the display unit 24 by executing the marker display program 26a.

[0036] Figure 5 is a block diagram of an example of a content display device 30.

[0037] As shown in Figure 5, the content display device 30 includes an operation unit 31, which is an operation device such as a button into which various operations are input; a display unit 32, which is a display device such as an LCD that displays various information; a shooting unit 33, which is a shooting device such as a camera; a communication unit 34, which is a communication device that communicates with external devices via a network such as a LAN or the Internet, or directly by wired or wireless connection without going through a network; a storage unit 35, which is a non-volatile storage device such as a semiconductor memory or HDD that stores various information; and a control unit 36 ​​that controls the entire content display device 30.

[0038] The storage unit 35 is capable of storing a content display program 35a for displaying content related to the image forming apparatus 20. The content display program 35a may, for example, be installed in the content display device 30 during the manufacturing stage, or it may be additionally installed in the content display device 30 from an external storage medium such as a USB memory, or it may be additionally installed in the content display device 30 from a network.

[0039] The storage unit 35 is capable of storing marker information 35b that indicates a marker recognized by the content display device 30.

[0040] Figure 6 shows an example of marker information 35b.

[0041] The marker information 35b shown in Figure 6 is a table containing the markers recognized by the content display device 30 for each marker. Regarding code images, the marker information 35b contains the type of code image recognized by the content display device 30, rather than the specific individual code images themselves. Some information is omitted in the marker information 35b shown in Figure 6.

[0042] As shown in Figure 5, the storage unit 35 is capable of storing history information 35c that indicates the history of markers recognized by the content display device 30.

[0043] Figure 7 shows an example of history information 35c.

[0044] The history information 35c shown in Figure 7 is a table containing combinations of the order in which markers were recognized by the content display device 30 and the content of those markers. If the marker is not a code image, the history information 35c includes the marker itself as the content of the marker. If the marker is a code image, the history information 35c includes not the code image itself as the marker, but rather a combination of the type of code image and the information that the code image represents as the content of the marker. For example, in the history information 35c shown in Figure 7, the content of the marker whose order is "3", "QR

[0123] ", indicates that the type of code image is "QR code" and the information that the code image represents is "0123".

[0045] The control unit 36 ​​shown in Figure 5 includes, for example, a CPU, a ROM that stores programs and various data, and RAM as memory used as a workspace for the CPU of the control unit 36. The CPU of the control unit 36 ​​executes programs stored in the storage unit 35 or the ROM of the control unit 36.

[0046] The control unit 36 ​​implements a content display unit 36a that displays content related to the image forming apparatus 20 by executing a content display program 35a.

[0047] Figure 8 is a block diagram of an example of a content distribution system 40 that is configured with a single computer.

[0048] As shown in Figure 8, the content distribution system 40 includes an operation unit 41 which is an operation device such as a keyboard or mouse into which various operations are input; a display unit 42 which is a display device such as an LCD that displays various information; a communication unit 43 which is a communication device that communicates with external devices via a network such as a LAN or the Internet, or directly via wired or wireless connection without going through a network; a storage unit 44 which is a non-volatile storage device such as a semiconductor memory or HDD that stores various information; and a control unit 45 which controls the entire content distribution system 40.

[0049] The memory unit 44 can store a content distribution program 44a for distributing content related to the image forming apparatus 20 to the content display device 30. The content distribution program 44a may, for example, be installed in the content distribution system 40 during the manufacturing stage of the content distribution system 40, or it may be additionally installed in the content distribution system 40 from an external storage medium such as a USB memory, or it may be additionally installed in the content distribution system 40 from a network.

[0050] The memory unit 44 stores content 44b. The memory unit 44 may also store other content besides content 44b. Examples of content stored in the memory unit 44 include the manual for the supply unit 21 (see Figure 2), the manual for section A (see Figure 2), which consists of the supply unit 21 and the first half of the printing engine 22 (see Figure 2), the manual for section B (see Figure 2), which consists of the second half of the printing engine 22 and the discharge unit 23 (see Figure 2), and the manual for the discharge unit 23.

[0051] The memory unit 44 is capable of storing distribution content information 44c, which indicates the content of the content to be distributed.

[0052] Figure 9 shows an example of the distributed content information 44c.

[0053] The distribution content information 44c shown in Figure 9 includes the conditions for distributing content (hereinafter referred to as "distribution conditions") and the content to be distributed, associated with each distribution condition. The distribution conditions are the history of markers recognized by the content display device 30. Some information is omitted in the distribution content information 44c shown in Figure 9.

[0054] The control unit 45 shown in Figure 8 includes, for example, a CPU, a ROM that stores programs and various data, and RAM as memory used as a workspace for the CPU of the control unit 45. The CPU of the control unit 45 executes programs stored in the storage unit 44 or the ROM of the control unit 45.

[0055] The control unit 45 implements a content distribution unit 45a that distributes content related to the image forming apparatus 20 to the content display device 30 by executing a content distribution program 44a.

[0056] Next, we will describe the operation of system 10.

[0057] First, we will explain the operation of the image forming apparatus 20 when an error occurs.

[0058] Figure 10 is a flowchart showing the operation of the image forming apparatus 20 when an error occurs.

[0059] The image forming apparatus 20 performs printing in accordance with print data received from an external electronic device (not shown). Specifically, when the control unit 27 of the image forming apparatus 20 receives print data via the communication unit 25, it supplies a recording medium to the printing engine 22 via the supply unit 21 according to the print data, the printing engine 22 performs printing on the recording medium supplied to the printing engine 22 according to the print data, and the printing engine 22 ejects the recording medium with the printed image via the ejection unit 23. However, various errors may occur in the image forming apparatus 20 during printing, such as paper jams. The marker display unit 27a of the image forming apparatus 20 performs the operations shown in Figure 10 for each error that occurs in the image forming apparatus 20.

[0060] As shown in Figure 10, the marker display unit 27a identifies the marker in the display marker information 26b that corresponds to the error that is the target of the operation shown in Figure 10 (S101).

[0061] When the processing in S101 is completed, the marker display unit 27a displays the marker identified in S101 on the display unit 24 (S102), and then terminates the operation shown in Figure 10.

[0062] Next, we will describe the operation of the content display device 30 when it is being captured by the shooting unit 33.

[0063] Figure 11 is a flowchart showing the operation of the content display device 30 when it is being captured by the shooting unit 33.

[0064] The content display unit 36a of the content display device 30 performs the operation shown in Figure 11 when it is being captured by the shooting unit 33.

[0065] As shown in Figure 11, the content display unit 36a determines whether or not a marker exists in the image captured by the shooting unit 33 based on the marker information 35b until it determines that a marker exists in the image captured by the shooting unit 33 (S121).

[0066] If the content display unit 36a determines in S121 that a marker exists in the image captured by the shooting unit 33, it determines whether or not the marker present in the image captured by the shooting unit 33 is a code image (S122).

[0067] If the content display unit 36a determines in S122 that the marker present in the image captured by the shooting unit 33 is not a code image, it determines whether the marker present in the image captured by the shooting unit 33 is the same as the content of the latest marker in the history information 35c (S123).

[0068] If the content display unit 36a determines in S123 that the marker present in the image captured by the shooting unit 33 is the same as the content of the latest marker in the history information 35c, it executes the process in S121.

[0069] If the content display unit 36a determines in S123 that the marker present in the image captured by the shooting unit 33 is not the same as the content of the latest marker in the history information 35c, it registers the marker present in the image captured by the shooting unit 33 as the content of the latest marker in the history information 35c (S124).

[0070] If the content display unit 36a determines in S122 that a marker present in the image captured by the shooting unit 33 is a code image, it identifies the type of code image present as a marker in the image captured by the shooting unit 33 and the information that this code image represents (S125).

[0071] When the processing in S125 is completed, the content display unit 36a determines whether the combination of code image type and information identified in S125 is the same as the content of the latest marker in the history information 35c (S126).

[0072] If the content display unit 36a determines in S126 that the combination of code image type and information identified in S125 is the same as the content of the latest marker in the history information 35c, it executes the process in S121.

[0073] If the content display unit 36a determines in S126 that the combination of code image type and information identified in S125 is not the same as the content of the latest marker in the history information 35c, it registers the combination of code image type and information identified in S125 as the content of the latest marker in the history information 35c (S127).

[0074] When the processing in S124 or S127 is completed, the content display unit 36a transmits the history shown in the history information 35c to the content distribution system 40 (S128). For example, if the history information 35c is as shown in Figure 7, the content display unit 36a transmits the information "●→★→QR

[0123] " as the history shown in the history information 35c to the content distribution system 40 in S128.

[0075] When the processing in S128 is completed, the content display unit 36a executes the processing in S121.

[0076] Next, we will describe the operation of the system 10 when the content display device 30 transmits the history to the content distribution system 40.

[0077] Figure 12 is a sequence diagram of the operation of system 10 when the content display device 30 transmits the history to the content distribution system 40.

[0078] As shown in Figure 12, the content display unit 36a of the content display device 30 transmits the history to the content distribution system 40 (S141). The process in S141 is the same as the process in S128 (see Figure 11).

[0079] In S141, when the content distribution unit 45a of the content distribution system 40 receives history from the content display device 30, it identifies the content that is associated in the distribution content information 44c with the same distribution conditions as the history received from the content display device 30 (S142).

[0080] When the processing in S142 is completed, the content distribution unit 45a distributes the content identified in S142 to the content display device 30 (S143).

[0081] When content is delivered from the content distribution system 40 in S143, the content display unit 36a of the content display device 30 displays the content delivered from the content distribution system 40 on the display unit 32 using AR (Augmented Reality) (S144).

[0082] Next, we will describe the operation of the content display device 30 when the history shown in the history information 35c is deleted.

[0083] Figure 13 is a flowchart showing the operation of the content display device 30 when the history shown in history information 35c is deleted.

[0084] As shown in Figure 13, the content display unit 36a of the content display device 30 determines whether the conditions for deleting the history (hereinafter referred to as "history deletion conditions") have been met until it determines that the conditions for deleting the history have been met (S161). The history deletion conditions may be, for example, a regular timing such as when the date changes, or a condition that an error that occurred in the image forming apparatus 20 has been resolved, or a condition that the user has instructed that the history shown in the history information 35c be deleted.

[0085] If the content display unit 36a determines in S161 that the conditions for deleting history have been met, it deletes the history shown in the history information 35c (S162) and executes the process in S161.

[0086] Next, we will describe a specific example of content display by the content display device 30.

[0087] Figure 14(a) shows an example of a screen displayed by the display unit 32 of the content display device 30. Figure 14(b) shows a different example of a screen displayed by the display unit 32 of the content display device 30, different from the example shown in Figure 14(a). Figure 15(a) shows a different example of a screen displayed by the display unit 32 of the content display device 30, different from the examples shown in Figures 14(a) and 14(b). Figure 15(b) shows a different example of a screen displayed by the display unit 32 of the content display device 30, different from the examples shown in Figures 14(a), 14(b), 15(a), and 15(a). Figure 15(c) shows a different example of a screen displayed by the display unit 32 of the content display device 30, different from the examples shown in Figures 14(a), 14(b), 15(a), and 15(b).

[0088] If no history is shown in history information 35c, when the marker 28a (see Figure 2) is photographed by the shooting unit 33 of the content display device 30, "?" is registered in history information 35c as the content of the marker whose order is "1" (S124), and the information "?" as the history shown in history information 35c is transmitted from the content display device 30 to the content distribution system 40 (S128). Therefore, if the distribution content information 44b is as shown in Figure 9, the "supply unit manual" is distributed from the content distribution system 40 to the content display device 30 (S143). Consequently, the supply unit manual 91 is displayed in AR on the display unit 32 of the content display device 30, as shown in Figure 14(a) (S144).

[0089] If only "?" is registered in the history information 35c as the content of the marker whose order is "1", when the shooting unit 33 of the content display device 30 photographs marker 28b (see Figure 2), "★" is registered in the history information 35c as the content of the marker whose order is "2" (S124), and the information "?→★" is transmitted from the content display device 30 to the content distribution system 40 as history shown in the history information 35c (S128). Therefore, if the distributed content information 44b is as shown in Figure 9, the content distribution system 40 distributes "Manual for Section A" to the content display device 30 (S143). Consequently, as shown in Figure 14(b), the manual for Section A 92 is displayed in AR on the display unit 32 of the content display device 30 (S144).

[0090] If no history is shown in history information 35c, when the marker 28c (see Figure 2) is photographed by the shooting unit 33 of the content display device 30, "●" is registered in history information 35c as the content of the marker whose order is "1" (S124), and the information "●" as the history shown in history information 35c is transmitted from the content display device 30 to the content distribution system 40 (S128). Therefore, if the distribution content information 44b is as shown in Figure 9, the "Discharge Unit Manual" is distributed from the content distribution system 40 to the content display device 30 (S143). Consequently, the Discharge Unit Manual 93 is displayed in AR on the display unit 32 of the content display device 30, as shown in Figure 15(a) (S144).

[0091] When only "●" is registered in the history information 35c as the content of the marker whose order is "1", and the marker 28b (see Figure 2) is photographed by the shooting unit 33 of the content display device 30, "★" is registered in the history information 35c as the content of the marker whose order is "2" (S124), and the information "●→★" is transmitted from the content display device 30 to the content distribution system 40 as history shown in the history information 35c (S128). Therefore, if the distributed content information 44b is as shown in Figure 9, the "Manual for Section B" is distributed from the content distribution system 40 to the content display device 30 (S143). Consequently, the manual for Section B 94 is displayed in AR on the display unit 32 of the content display device 30, as shown in Figure 15(b) (S144).

[0092] When only "●" as the content of the marker with the order "1" and "★" as the content of the marker with the order "2" are registered in the history information 35c, and the marker 28d (see Figure 2) is photographed by the shooting unit 33 of the content display device 30, "QR

[0123] " is registered in the history information 35c as the content of the marker with the order "3" (S127), and the information "●→★→QR

[0123] " is transmitted from the content display device 30 to the content distribution system 40 as the history shown in the history information 35c (S128). Therefore, if the distributed content information 44b is as shown in Figure 9, the content distribution system 40 distributes "the manual for section B with page 123 open" to the content display device 30 (S143). Consequently, as shown in Figure 15(c), the display unit 32 of the content display device 30 displays the manual 94 for section B with page 123 open in AR (S144).

[0093] As explained above, the content display system 11 displays content on the content display device 30 according to the content of multiple markers recognized by the content display device 30 and the order in which these markers were recognized by the content display device 30 (S144). Therefore, even if markers of the same type are recognized by the content display device 30, the type of content displayed by the content display device 30 may differ. For example, the screen shown in Figure 14(b) and the screen shown in Figure 15(b) are both displayed by the content display device 30 when marker 28b is recognized by the content display device 30, but different content is displayed. Thus, the content display system 11 can increase the number of displayable content types relative to the number of marker types.

[0094] When the content display system 11 receives multiple markers recognized by the content display device 30, and the content is a multi-page document, it displays the content with the page number indicated by the code image open, as shown in Figure 15(c), thus improving usability.

[0095] The content display system 11 can improve convenience by displaying content using AR, as shown in Figures 14 and 15, for example.

[0096] In this embodiment, the content display device 30 displays the content using augmented reality (AR). However, the content display device 30 may also display the content independently, without using AR.

[0097] In this embodiment, the content distribution system 40 distributes various manuals as content. However, the content distribution system 40 may also distribute content other than manuals. For example, the content distribution system 40 may distribute videos as content.

[0098] (Second Embodiment) First, the configuration of the system according to this embodiment will be described.

[0099] Among the components of the system according to this embodiment, components that are the same as those of system 10 according to the first embodiment (see Figure 1) are denoted by the same reference numerals as those of system 10, and detailed descriptions are omitted.

[0100] Figure 16 is a block diagram of an example of the system 210 according to this embodiment.

[0101] As shown in Figure 16, the configuration of system 210 is the same as that of system 10, in which a content display device 230 for displaying content related to the image forming apparatus 20 is provided instead of the content display system 11 (see Figure 1).

[0102] Figure 17 is a block diagram of an example of a content display device 230.

[0103] As shown in Figure 17, the configuration of the content display device 230 is the same as the configuration in which the content display device 30 (see Figure 5) is equipped with a content display program 235a for displaying content related to the image forming apparatus 20, instead of a content display program 35a (see Figure 5), and the content display device 30 is equipped with multiple contents including content 235b and display content information 235c that indicates the content of the content to be displayed.

[0104] The control unit 36 ​​implements a content display unit 236a that displays content related to the image forming apparatus 20 by executing a content display program 235a.

[0105] Figure 18 shows an example of display content information 235c.

[0106] The display content information 235c shown in Figure 18 includes the conditions for displaying the content (hereinafter referred to as "display conditions") and the content to be displayed, associated with each display condition. The display conditions are the history of markers recognized by the content display device 230. Some information is omitted in the display content information 235c shown in Figure 18.

[0107] Next, we will describe the operation of system 210.

[0108] The image forming apparatus 20 operates in the same manner as in the first embodiment. The content display device 230 operates in the same manner as the content display device 30 according to the first embodiment, except for the operations described below.

[0109] The operation of the content display device 230 when shooting is performed by the shooting unit 33 will be described below.

[0110] Figure 19 is a flowchart showing the operation of the content display device 230 when it is being captured by the shooting unit 33.

[0111] The content display unit 236a of the content display device 230 performs the operation shown in Figure 19 when it is being captured by the shooting unit 33.

[0112] As shown in Figure 19, the content display unit 36a executes the processes shown in S321 to S327, which are the same as the processes shown in S121 to S127 (see Figure 11).

[0113] When the processing in S324 or S327 is completed, the content display unit 36a identifies the content that is associated in the display content information 235c with the same display conditions as the history shown in the history information 35c (S328).

[0114] When the processing in S328 is completed, the content distribution unit 45a displays the content identified in S328 on the display unit 32 using AR (S329) and then executes the processing in S321.

[0115] As explained above, the content display device 230 displays content corresponding to the content of the multiple recognized markers and the order in which these markers were recognized (S329). Therefore, even when markers of the same type are recognized, the type of content displayed may differ. Consequently, the content display device 230 can increase the number of displayable content types relative to the number of marker types. [Explanation of Symbols]

[0116] 11. Content Display System 28a, 28b, 28c, 28d markers 30. Content display device (computer) 35a Content display program 40. Content distribution system 44b Content 91 Supply Unit Manual (Contents) 92 Section A Manual (Contents) 93. Manual for the discharge unit (contents) 94 Section B Manual (Contents) 230 Content display devices (computers) 235a Content display program 235b Content

Claims

1. A content display device that displays content, A content distribution system that distributes the aforementioned content to the content display device. Equipped with, The content display device recognizes a marker by taking a picture, The content distribution system distributes to the content display device the content corresponding to the content of the multiple markers recognized by the content display device and the order in which these markers were recognized by the content display device. The content display device is a content display system characterized by displaying the content distributed by the content distribution system.

2. The content display system according to claim 1, characterized in that when the recognized plurality of markers include a code image as an image of a code indicating a page number, and the content is a document having multiple pages, the content is displayed with the page number indicated by the code image open.

3. The content display system according to claim 1, characterized in that the content display device displays the content using AR (Augmented Reality).

4. A content display device characterized by recognizing markers by taking a photograph, and displaying content corresponding to the content of the multiple recognized markers and the order in which these markers were recognized.

5. A content display program characterized by causing a computer to recognize markers by taking a photograph, and displaying content on the computer corresponding to the contents of a plurality of markers recognized by the computer and the order in which these markers were recognized by the computer.

Images