Display system and information processing device
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SEIKO EPSON CORP
- Filing Date
- 2025-01-24
- Publication Date
- 2026-08-05
Smart Images
Figure 2026126636000001_ABST
Abstract
Description
Technical Field
[0004] ,
[0006] , , , ,
[0005] , , , , , ,
[0001] The present invention relates to a display system and an information processing apparatus.
Background Art
[0002] Patent Document 1 proposes an image forming apparatus that displays a two-dimensional code for guiding information on a troubleshooting method on a display unit when a trouble occurs in the apparatus. A user can confirm the troubleshooting method by reading the displayed two-dimensional code with a portable device or the like. In this image forming apparatus, when a plurality of troubles occur in the apparatus, a plurality of two-dimensional codes are displayed on the display unit.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, when a plurality of two-dimensional codes are displayed on the display unit simultaneously or in sequence, a user may read a two-dimensional code different from the two-dimensional code that should be read originally.
Means for Solving the Problems
[0005] The display system includes an image display device, and an information processing apparatus including a camera, a display unit, and a control unit. The image display device displays a first code image in a first color and a second code image in a second color different from the first color. The control unit displays, on the display unit, first guidance information for guiding imaging of the first code image by the camera. The first guidance information includes information indicating that the color of the first code image is the first color.
[0006] The information processing device comprises a camera, a display unit, and a control unit. The control unit displays first guidance information on the display unit, which indicates that the camera should capture the first code image from among a first code image displayed by the image display device in a first color and a second code image displayed by the image display device in a second color different from the first color. The first guidance information includes information indicating that the color of the first code image is the first color. [Brief explanation of the drawing]
[0007] [Figure 1] A diagram showing the general configuration of the display system. [Figure 2] A block diagram showing the internal configuration of the projector and terminal equipment. [Figure 3] A flowchart illustrating the operation of a display system when a projector and a terminal device are connected via Wi-Fi. [Figure 4] A diagram showing the projected image displayed by the projector. [Figure 5] A diagram showing the projected image displayed by the projector. [Figure 6] A diagram showing the display image shown on the display unit of a terminal device. [Figure 7] A diagram showing the display image shown on the display unit of a terminal device. [Figure 8] A diagram showing the display image shown on the display unit of a terminal device. [Figure 9] A diagram showing the projected image displayed by the projector related to the modification. [Figure 10] A diagram showing the display image displayed on the display unit of a modified terminal device. [Modes for carrying out the invention]
[0008] 1. Embodiment The display system 100 of this embodiment will be described below with reference to the drawings. Figure 1 is a schematic diagram showing the general configuration of the display system 100, and Figure 2 is a block diagram showing the internal configuration of the projector 1 and the terminal device 2. As shown in Figures 1 and 2, the display system 100 includes a projector 1 that projects image light onto a projection surface Sc, and a terminal device 2 used by the user of the projector 1.
[0009] Projector 1 comprises a first control unit 10, a first storage unit 11, a first communication unit 12, a first operation unit 13, and a projection unit 14. Projector 1 displays a projected image P on the projection surface Scr by projecting image light from the projection unit 14. Projector 1 is an example of an image display device.
[0010] The first control unit 10 includes one or more processors, such as a CPU (Central Processing Unit). The first control unit 10 controls the operation of the projector 1 by operating according to a control program stored in the first storage unit 11.
[0011] The first storage unit 11 is equipped with memory such as RAM (Random Access Memory) and ROM (Read Only Memory). The RAM is used for temporary storage of various data, and the ROM stores control programs, control data, and various image data for controlling the operation of the projector 1.
[0012] The first communication unit 12 is connected to the wireless router 3 via a wireless local area network (LAN), and is connected to the network N via the wireless router 3. The first communication unit 12 includes an interface circuit for performing communication via the network N, and can communicate with other devices connected to the network N. In addition to the projector 1, a terminal device 2 is connected to the network N in this embodiment. The first communication unit 12 can perform input / output of information with the terminal device 2 via the network N. Note that the first communication unit 12 may be connected to the network N by wire without going through the wireless router 3.
[0013] The first operation unit 13 includes a plurality of operation keys (not shown) for the user to give various instructions to the projector 1. When the user operates the operation keys of the first operation unit 13, the first operation unit 13 outputs an operation signal corresponding to the operation content of the user to the first control unit 10. Note that a configuration may be adopted in which a remote controller (not shown) capable of remote operation is used as the first operation unit 13. In this case, the remote controller transmits an infrared operation signal corresponding to the operation content of the user, and a remote controller signal receiving unit (not shown) receives this and transmits it to the first control unit 10.
[0014] The projection unit 14 projects image light based on image data supplied from an external image supply device (not shown) or image data stored in the first storage unit 11, and displays a projection image P on the projection surface Sc. Although not shown, the projection unit 14 includes a light source device, a light modulation device that modulates the light emitted by the light source device to form image light, and a projection lens that projects the image light.
[0015] The projector 1 of this embodiment can project a code image C (see FIG. 1). The code image C is, for example, a QR code (registered trademark), which is a matrix-type two-dimensional code. By having the terminal device 2 read the projected code image C, the user can cause the terminal device 2 to execute a predetermined operation.
[0016] The terminal device 2 is a portable information processing device used by the user of the projector 1, and is constituted by, for example, a smartphone, a tablet-type terminal device, or the like.
[0017] The terminal device 2 includes a second control unit 20, a second storage unit 21, a second communication unit 22, a second operation unit 23, a display unit 24, and an imaging unit 25. The second control unit 20 includes a processor such as a CPU, and controls the operation of the terminal device 2 by operating according to an OS (Operating System), an application program, or the like, which is not shown in the figure and is stored in the second storage unit 21. The second control unit 20 is an example of a control unit.
[0018] The second storage unit 21 is constituted by a storage device such as a memory, and stores the above-described OS, application program, and various data.
[0019] The second communication unit 22 is connected to the wireless router 3 via a wireless LAN, and is connected to the network N via the wireless router 3. The second communication unit 22 includes an interface circuit for performing communication via the network N, and can communicate with other devices connected to the network N. The connection between the second communication unit 22 and the network N is usually a wireless connection, but may also be a wired connection.
[0020] The second operation unit 23 receives the input operation of the user. The second operation unit 23 outputs operation information corresponding to the received input operation to the second control unit 20. The display unit 24 includes a display device such as a liquid crystal display or an organic EL (Electro Luminescence) display, and displays various information based on the control of the second control unit 20. Note that the second operation unit 23 may be integrally configured with the display unit 24, such as a touch panel.
[0021] The imaging unit 25 is a camera equipped with an image sensor (not shown), such as a CCD sensor or CMOS sensor, and an imaging lens (not shown). The imaging unit 25 captures an image range corresponding to the orientation and posture of the terminal device 2 and generates an image. The imaging unit 25 outputs the generated image to the second control unit 20.
[0022] The terminal device 2 has various application programs (not shown) installed on it, and the second control unit 20 can perform various operations according to the launched application program. The application programs installed on the terminal device 2 include a reading program for reading the code image C captured by the imaging unit 25, and a web browser for displaying web pages.
[0023] In this embodiment, the first storage unit 11 of the projector 1 stores image data of multiple code images C, and the projector 1 can project various code images C. Specifically, the first storage unit 11 stores image data of a code image C1 (see Figure 4) for installing a connection program on the terminal device 2. The connection program is an application program for connecting the terminal device 2 and the projector 1 via a wireless LAN. The code image C1 represents a URL (Uniform Resource Locator) to be accessed when installing the connection program. When a user captures the code image C1 projected from the projector 1 with the imaging unit 25 of the terminal device 2, the terminal device 2 accesses the above URL and installs the connection program. The code image C1 is an example of a second code image, and the URL represented by the code image C1 is an example of a second address.
[0024] Furthermore, the first memory unit 11 of the projector 1 stores image data of a code image C2 (see Figure 5) that represents connection information for connecting the terminal device 2 to the projector 1 via a connection program. The connection information includes, for example, an SSID (Service Set Identifier) for identifying the wireless LAN, a password, and the IP address of the projector 1. When the user starts the connection program and captures the code image C2 projected from the projector 1 with the imaging unit 25 of the terminal device 2, the projector 1 and the terminal device 2 are connected and can communicate via wireless LAN. This connection makes it possible to project images displayed on the display unit 24 of the terminal device 2 from the projector 1. Code image C2 is an example of a first code image, and the IP address included in the connection information represented by code image C2 is an example of a first address.
[0025] The colors of the multiple code images C stored in the first storage unit 11 as image data are not identical, but each is different. In this embodiment, the code image C1 for installing the connection program is a blue image. Also, the code image C2 for connecting the projector 1 and the terminal device 2 via wireless LAN is a red image. In other words, the projector 1 displays code image C2 in red and code image C1 in a blue color that is different from red. Red is an example of a first color, and blue is an example of a second color.
[0026] Next, we will explain the operation of the display system 100 when projector 1 and terminal device 2 are connected via wireless LAN. Figure 3 is a flowchart illustrating the operation of the display system 100 when connecting projector 1 and terminal device 2 via wireless LAN, and includes the operation of projector 1 and terminal device 2. Figures 4 to 8 are explanatory diagrams illustrating the operation of the display system 100. Figures 4 and 5 show projected images P1 and P2 projected by projector 1, and Figures 6 to 8 show display images T1, T2, and T3 displayed on the display unit 24 of terminal device 2. When a user operates the first operation unit 13 of projector 1 to connect projector 1 and terminal device 2 via wireless LAN, the first control unit 10 of projector 1 operates according to the flow shown in Figure 3. It is assumed that the terminal device 2 does not have the connection program described above installed.
[0027] First, in step S11, the first control unit 10 reads image data of the code image C1 for installing the connection program from the first storage unit 11. Then, the first control unit 10 projects a projection image P1 including the code image C1 from the projection unit 14. As a result, as shown in Figure 4, the blue code image C1 is displayed on the projection surface Sc. In addition, the first control unit 10 displays a message M1 prompting the user to capture the code image C1 and a proceed button B1 to be operated when proceeding to the next step, within the projection image P1 along with the code image C1.
[0028] When the code image C1 is displayed, the user operates the second operation unit 23 of the terminal device 2 to start the reading program. The user then holds the terminal device 2 so that the imaging lens of the imaging unit 25 is pointed towards the code image C1 on the projection surface Sc, and performs the operation to execute imaging using the second operation unit 23.
[0029] In step S21, the second control unit 20 of the terminal device 2 causes the imaging unit 25 to capture a code image C1 in response to user operation. Then, in step S22, the second control unit 20 accesses the URL represented by the code image C1 and installs the connection program into the terminal device 2. Once the installation of the connection program is complete, in step S23, the second control unit 20 starts the installed connection program. From this point onward, the second control unit 20 operates according to the started connection program.
[0030] On the other hand, after capturing the code image C1, the user switches the projected image P1 of the projector 1 to the next projected image P2 (see Figure 5) by operating the advance button B1 on the first operation unit 13 of the projector 1.
[0031] In step S12, upon receiving confirmation from the user that the forward button B1 has been pressed, the first control unit 10 of the projector 1 reads image data of the code image C2 for connecting the projector 1 and the terminal device 2 via wireless LAN from the first storage unit 11. The first control unit 10 then projects the projection image P2, which includes the code image C2, from the projection unit 14. As a result, the red code image C2 is displayed on the projection surface Sc, as shown in Figure 5. The first control unit 10 also displays a message M2 prompting the user to capture the code image C2, and a reverse button B2, which is pressed to return to the previous step, within the projection image P2.
[0032] In step S24, the second control unit 20 determines whether the projector 1 and the terminal device 2 are already connected using another application program or the like. If the projector 1 and the terminal device 2 are not yet connected (step S24: NO), the second control unit 20 moves the process to step S25. On the other hand, if the projector 1 and the terminal device 2 are already connected (step S24: YES), the second control unit 20 moves the process to step S30.
[0033] If the process proceeds to step S25 before the projector 1 and terminal device 2 are connected, the second control unit 20 guides the user to capture the code image C2 using the display unit 24. Specifically, the second control unit 20 displays the display image T1 shown in Figure 6 on the display unit 24. The display image T1 includes a monitor unit V1 for monitoring the imaging range of the imaging unit 25, shutter buttons Bs, and guidance information G1. The guidance information G1 is information that guides the user to capture the code image C2 with the imaging unit 25, and includes the message, "Capture the red code image displayed by the projector and connect to the projector." In other words, the guidance information G1 includes information indicating that the code image C2 to be captured is red. Guidance information G1 is an example of first guidance information. Here, it is desirable that at least some of the characters in the guidance information G1, such as "red code image," be written in red. In other words, it is desirable that at least some of the characters in the guidance information G1 be the same color as the code image C2 to be captured. The user holds the terminal device 2 so that the imaging lens of the imaging unit 25 is pointed towards the code image C2 on the projection surface Sc, and operates the shutter button Bs using the second operation unit 23.
[0034] In step S26, the second control unit 20 causes the imaging unit 25 to capture a code image C2 in response to the operation of the shutter button Bs.
[0035] In step S27, the second control unit 20 determines whether or not an appropriate code image C2 has been captured. The second control unit 20 can determine whether or not an appropriate code image C2 has been captured based on the format of the information stored in the captured code image C. If an appropriate code image C2 has been captured (step S27: YES), the second control unit 20 proceeds to step S28. On the other hand, if an inappropriate code image C has been captured (step S27: NO), the second control unit 20 proceeds to step S29. For example, if a user forgets to operate the forward button B1 for projected image P1, or accidentally operates the reverse button B2 for projected image P2, an inappropriate code image C1 may be captured.
[0036] If a suitable code image C2 is captured and the process proceeds to step S28, the second control unit 20 connects to the projector 1 based on the connection information represented by the code image C2. In other words, when the image capture unit 25 captures the code image C2, the second control unit 20 accesses the IP address included in the connection information represented by the code image C2. As a result, the projector 1 and the terminal device 2 are connected via wireless LAN. From this point onward, the image displayed on the display unit 24 of the terminal device 2 is projected from the projector 1.
[0037] On the other hand, if an inappropriate code image C is captured in step S27 and the process proceeds to step S29, the second control unit 20 notifies the user of the error. Specifically, the second control unit 20 displays the display image T2 shown in Figure 7 on the display unit 24. The display image T2 includes guidance information G2 that notifies the user that the captured code image C is inappropriate and instructs them to operate the projector 1 to display the red code image C2 and then capture the image again, as well as a confirmation button Bc. When the user confirms the guidance information G2 and operates the confirmation button Bc, the second control unit 20 returns the process to step S25 without accessing the address represented by the captured inappropriate code image C, and guides the user to capture the code image C2 again. In this way, if a code image C different from code image C2 is captured by the imaging unit 25, the second control unit 20 does not access the address represented by the code image C captured by the imaging unit 25. For example, if the imaging unit 25 captures a code image C1, the second control unit 20 does not access the URL represented by the code image C1.
[0038] Furthermore, if the projector 1 and the terminal device 2 are already connected in step S24 and the process proceeds to step S30, the second control unit 20 displays the display image T3 shown in Figure 8 on the display unit 24 without displaying the display image T1. The display image T3 includes guidance information G3 that notifies the user that capturing the code image C2 is unnecessary, and an exit button Be for terminating the connection program. When the display image T3 is displayed, the user terminates the connection program by operating the exit button Be on the second operation unit 23 without capturing the code image C2.
[0039] Step S24, which determines whether the projector 1 and the terminal device 2 are connected, can be considered as a step to determine whether or not to display the display image T1, which includes the guidance information G1, on the display unit 24. If it is determined that the guidance information G1 should not be displayed on the display unit 24 (step S24: YES), the second control unit 20 displays guidance information G3 on the display unit 24 in step S30, notifying that it is not necessary to capture the code image C2. Guidance information G3 is an example of second guidance information.
[0040] As described above, the display system 100 and terminal device 2 of this embodiment provide the following advantages.
[0041] According to this embodiment, the projector 1 displays multiple code images C1 and C2 in different colors, and the display unit 24 of the terminal device 2 displays guidance information G1 that guides the user to capture code image C2. The guidance information G1 clearly indicates the color of the code image C2 to be captured. Therefore, the user can determine whether the code image C they are trying to capture is the code image C2 to be captured based on the color of the code image C. As a result, it is prevented for the user to capture a code image C other than the code image C2 to be captured.
[0042] According to this embodiment, if a code image C different from the code image C2 to be captured is captured, access to the address represented by the captured code image C is not performed, thus preventing unnecessary access to that address.
[0043] According to this embodiment, in step S24, if the terminal device 2 is already connected to the projector 1, that is, if the second control unit 20 determines that guidance information G1 is not to be displayed on the display unit 24, guidance information G3 notifying that capturing the code image C2 is unnecessary is displayed on the display unit 24. This allows the user to reduce the effort required to capture the code image C2.
[0044] 2. Variations The above embodiment is based on the configuration described above, but it is possible to make partial changes or omissions to the configuration without departing from the gist of this disclosure. Furthermore, this embodiment and the modifications described below can be combined and implemented to the extent that they do not contradict the technical aspects. The modifications will be described below.
[0045] In the above embodiment, a configuration in which multiple code images C1 and C2 are displayed in a predetermined order is shown, but a configuration in which multiple code images C are displayed simultaneously is also possible. In the example shown in Figure 9, two code images C3 and C4 are arranged side by side in a single projected image P3. One code image C3 is a code image C representing a URL for displaying a detailed manual for projector 1, and is displayed in black. The other code image C4 is a code image representing a URL for displaying FAQs (Frequently Asked Questions) about projector 1, and is displayed in green.
[0046] Meanwhile, the second control unit 20 of the terminal device 2 displays the display image T4 shown in Figure 10 on the display unit 24. The display image T4 includes a monitor unit V1 for monitoring the imaging range of the imaging unit 25, a shutter button Bs, and guidance information G4. The guidance information G4 is information that guides the user to capture code images C3 and C4 with the imaging unit 25, and includes the message, "To view the detailed manual, capture the black code image; to view the FAQ, capture the green code image." In other words, the guidance information G4 includes information indicating that the color of code image C3 is black and information indicating that the color of code image C4 is green. Therefore, the user can appropriately capture one of the code images C3 and C4 by referring to their colors.
[0047] In the above embodiment, the code image C is not limited to a QR code. For example, it may be a two-dimensional code other than a QR code, or a one-dimensional barcode. It may also be a code image whose pattern changes over time.
[0048] In the above embodiment, it is desirable to clearly indicate the color of the code image C to be captured in the instruction manual distributed to the user in paper or electronic format. For example, in the instruction manual, the description explaining the capture of code image C1 in step S21 would state, "Capture the blue code image displayed by the projector and install the connection program." Similarly, the description explaining the capture of code image C2 in step S26 would state, "Capture the red code image displayed by the projector and connect to the projector," similar to the guidance information G1. Furthermore, it is desirable that at least some of the characters in the instruction manual be the same color as the code image C to be captured.
[0049] In the above embodiment, a configuration in which the projector 1 and the terminal device 2 are connected in a communicative manner is shown. However, any configuration in which the terminal device 2 captures the code image C displayed by the projector 1 is acceptable, and the embodiment is not limited to a configuration in which the two are connected.
[0050] In the above embodiment, code image C represents an address such as a URL or IP address, but code image C may also represent information other than an address.
[0051] In the above embodiment, a projector 1 is described as an example of an image display device, but the image display device is not limited to a projector 1 and may be other image display devices such as liquid crystal displays or organic EL displays.
[0052] 3. Summary of this disclosure A summary of this disclosure is provided below.
[0053] (Note 1) A display system comprising an image display device and an information processing device comprising a camera, a display unit and a control unit, wherein the image display device displays a first code image in a first color and a second code image in a second color different from the first color, and the control unit displays first guidance information on the display unit that guides the camera to capture the first code image, and the first guidance information includes information indicating that the color of the first code image is the first color.
[0054] According to the configuration described in Appendix 1, the image display device displays multiple code images in different colors, and the display unit of the information processing device displays first guidance information that guides the user in capturing code images. The first guidance information clearly indicates the color of the code image to be captured. Therefore, the user can determine whether the code image they are trying to capture is the correct code image based on its color. As a result, it is prevented from the user capturing a code image other than the one that should be captured.
[0055] (Note 2) A display system as described in Note 1, wherein the control unit accesses the first address represented by the first code image when the first code image is captured by the camera, and does not access the second address represented by the second code image when the second code image is captured by the camera.
[0056] According to the configuration described in Appendix 2, if a code image different from the code image to be captured is captured, access to the address represented by the captured code image will not be made, thus preventing unnecessary access to that address.
[0057] (Note 3) A display system according to Note 1 or 2, wherein the control unit determines whether or not to display the first guidance information on the display unit, and if it determines not to display the first guidance information on the display unit, it displays second guidance information on the display unit indicating that it is not necessary to capture the first code image.
[0058] According to the configuration described in Appendix 3, if the control unit determines that it does not need to display the first guidance information on the display unit, second guidance information notifying the user that capturing the first code image is unnecessary will be displayed on the display unit. This allows the user to reduce the time and effort required to capture the first code image.
[0059] (Note 4) An information processing apparatus comprising a camera, a display unit, and a control unit, wherein the control unit displays on the display unit first guidance information that guides the camera to capture the first code image from among a first code image displayed by an image display device in a first color and a second code image displayed by the image display device in a second color different from the first color, and the first guidance information includes information indicating that the color of the first code image is the first color.
[0060] According to the configuration described in Appendix 4, the display unit of the information processing device displays first guidance information that guides the user in capturing a code image, and the first guidance information clearly indicates the color of the code image to be captured. Therefore, the user can determine whether the code image they are trying to capture is the correct code image based on the color of the code image. As a result, it is prevented from the user capturing a code image other than the one that should be captured. [Explanation of Symbols]
[0061] 1...Projector, 2...Terminal device, 3...Wireless router, 10...First control unit, 11...First memory unit, 12...First communication unit, 13...First operation unit, 14...Projection unit, 20...Second control unit, 21...Second memory unit, 22...Second communication unit, 23...Second operation unit, 24...Display unit, 25...Imaging unit, 100...Display system, B1...Forward button, B2...Reverse button, Bc...Confirm button, Be...End button, Bs...Shutter button, C,C1,C2,C3,C4...Code image, G1,G2,G3,G4...Guidance information, M1,M2...Message, N...Network, P,P1,P2,P3...Projected image, Sc...Projection surface, T1,T2,T3,T4...Display image, V1...Monitor unit.
Claims
1. Image display device and An information processing device comprising a camera, a display unit, and a control unit, The image display device displays the first code image in a first color, and displays the second code image in a second color different from the first color. The control unit displays first guidance information on the display unit that instructs the camera to capture the first code image. A display system in which the first guidance information includes information indicating that the color of the first code image is the first color.
2. The control unit, When the first code image is captured by the camera, the first address represented by the first code image is accessed. The display system according to claim 1, wherein when the second code image is captured by the camera, the second address represented by the second code image is not accessed.
3. The control unit, Determine whether or not to display the first guidance information on the display unit. The display system according to claim 1, wherein if it is determined that the first guidance information is not to be displayed on the display unit, a second guidance information indicating that it is not necessary to capture the first code image is displayed on the display unit.
4. It comprises a camera, a display unit, and a control unit, The control unit displays first guidance information on the display unit that instructs the camera to capture the first code image, which is among the first code image displayed by the image display device in a first color and the second code image displayed by the image display device in a second color different from the first color. An information processing device wherein the first guidance information includes information indicating that the color of the first code image is the first color.