Information processing method, information processing device, and projector

Abstract

To resolve such a problem that it is difficult to identify the cause that prevents a projector from normally performing display control according to the position of an indicator when a support person is remote.SOLUTION: An information processing method includes processes of: acquiring error information indicating an error related to optical detection of a position of an indicator on a projection surface, which is performed by a projector for projecting an image on the projection surface, from the projector via a network; and displaying the acquired error information.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing method, an information processing device, and a projector. [Background technology]

[0002] Patent Document 1 discloses a light emitting device that emits detection light into a detection area where the pointed positions of a first pointer and a second pointer are detected, and a projector that detects the pointed positions of the first pointer and the second pointer in the detection area. This projector includes an imaging unit that captures an image of the detection area, and a position detection unit that detects at least one of an image of light emitted by the first pointer and an image of the detection light reflected by the second pointer from image data captured by the imaging unit, and distinguishes and detects the pointed positions of the first pointer and the second pointer based on the light emission timing of the first pointer and the light emitting device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-160265 Summary of the Invention [Problem to be solved by the invention]

[0004] In a projector that controls display according to the position of a pointer, as in the technology of Patent Document 1, there are cases where the device or process for detecting the pointer and controlling rendering does not operate normally. This can be caused by a wide range of factors, including the projector's operating environment, user errors, and malfunctions in the detection device, making it difficult for support personnel in a remote location to determine the cause. [Means for solving the problem]

[0005] An information processing method according to one embodiment of the present invention includes obtaining error information from a projector via a network, the error information indicating an error relating to optical detection of the position of a pointer on a projection surface, the projector performing the operation to project an image onto the projection surface, and displaying the obtained error information.

[0006] An information processing device of one embodiment of the present invention includes a display device that displays an image, and a control device that acquires error information from the projector via a network, the error information indicating an error related to optical detection of the position of a pointer on a projection surface, which is performed by the projector that projects an image onto the projection surface, and displays the acquired error information on the display device.

[0007] A projector according to one embodiment of the present invention comprises a first optical device that projects an image onto a projection surface, a second optical device that emits light to a pointer and receives light from the pointer, and a control device that optically detects the position of the pointer on the projection surface based on a signal output from the second optical device, and transmits error information indicating an error related to the detection via a network. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing a schematic configuration of a projector management system. [Figure 2] FIG. 1 is a block diagram showing a schematic configuration of an information processing device. [Figure 3] FIG. 1 is a diagram illustrating an example of a situation in which a projector is used. [Figure 4] FIG. 1 is a block diagram showing a schematic configuration of a projector. [Figure 5] 10 is a flowchart showing each process executed by a second control device of the projector. [Figure 6] 4 is a flowchart showing each process executed by a first control device of the information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the following drawings, the scale of each component may be different from the actual scale in order to make each component large enough to be recognizable.

[0010] 1 is a block diagram showing a schematic configuration of a projector management system according to the present embodiment. As shown in FIG. 1, the projector management system according to the present embodiment includes a plurality of projectors 1, a monitoring terminal 2, a cloud server 3, and an information processing device 4.

[0011] The projector 1 projects an image onto a projection surface. The projector 1 optically detects the position of a pointer on the projection surface and performs image processing based on the position of the pointer. For example, the projector 1 performs processing such as drawing a figure, character, or symbol at the position of the pointer, drawing a figure along the trajectory of the pointer position, and erasing the drawn figure, character, or symbol. The position of the pointer on the projection surface is the position on the projection surface pointed to by the tip of the pointer. In this embodiment, as an example, the position of the pointer is expressed by two-dimensional coordinate values.

[0012] The monitoring terminal 2 communicates with each of the multiple projectors 1. For example, the monitoring terminal 2 communicates with each of the multiple projectors 1 via a wired local area network (LAN) or a wireless LAN. The monitoring terminal 2 periodically acquires logs from each of the multiple projectors 1. The logs include various information used to manage the multiple projectors 1. The log of the projector 1 includes at least error information that indicates an error related to optically detecting the position of the pointer on the projection surface. The monitoring terminal 2 transmits the logs acquired from each of the multiple projectors 1 to the cloud server 3 via a network such as the Internet.

[0013] The cloud server 3 is a server that provides an online storage service that stores various data on the cloud. The cloud server 3 has a large-capacity storage device and stores logs received from the monitoring terminal 2 via the Internet.

[0014] The information processing device 4 communicates with the cloud server 3 via the Internet. For example, the information processing device 4 is installed in a support center located away from a facility where multiple projectors 1 and monitoring terminals 2 are installed. The support center is a facility where support personnel are stationed to support the management of the multiple projectors 1. The information processing device 4 is used by the support personnel.

[0015] The information processing device 4 acquires logs of multiple projectors 1 from the cloud server 3 via the Internet. The information processing device 4 displays the acquired logs. If the acquired logs contain the above-mentioned error information, the information processing device 4 displays the acquired error information. For example, the information processing device 4 is a notebook PC (Personal Computer), a desktop PC, a smartphone, a tablet terminal, or the like.

[0016] Fig. 2 is a block diagram showing a schematic configuration of the information processing device 4. As shown in Fig. 2, the information processing device 4 includes a first communication device 110, a display device 120, a first input device 130, a first storage device 140, and a first control device 150.

[0017] The first communication device 110 is a communication interface circuit that controls communication between the first control device 150 and external devices. The external devices with which the first control device 150 communicates via the first communication device 110 include the cloud server 3 described above. The display device 120 displays an image based on an image signal input from the first control device 150. For example, the display device 120 is a liquid crystal panel or an organic EL (Electro Luminescence) panel.

[0018] The first input device 130 is a device that accepts input operations from a support staff member to the information processing device 4. When the information processing device 4 is a notebook PC or a desktop PC, the first input device 130 includes at least a keyboard and a mouse. The keyboard and mouse output signals corresponding to operations accepted from the support staff member to the first control device 150.

[0019] When the information processing device 4 is a smartphone or a tablet terminal, the first input device 130 has at least a touch sensor. For example, when the touch sensor is a resistive touch sensor or a capacitive touch sensor, the touch sensor included in the first input device 130 is a transparent plate-like device overlaid on the display surface of the display device 120. In this way, a touch panel is formed by overlaying the transparent plate-like touch sensor on the display surface of the display device 120. The touch sensor repeatedly detects a position on the display surface indicated by the support staff's finger and outputs a signal corresponding to the detected position to the first control device 150. The touch sensor may detect a position indicated by a device such as a stylus pen instead of the support staff's finger.

[0020] The first storage device 140 includes a nonvolatile memory that stores programs and various setting data required for the first control device 150 to execute various processes, and a volatile memory that is used as a temporary storage destination for data when the first control device 150 executes various processes. For example, the nonvolatile memory is an EEPROM (Electrically Erasable Programmable Read-Only Memory) or a flash memory. The volatile memory is, for example, a RAM (Random Access Memory).

[0021] The first control device 150 is an arithmetic processing device that controls the overall operation of the information processing device 4 in accordance with a program stored in the first storage device 140. As an example, the first control device 150 is configured with one or more processors such as a CPU (Central Processing Unit). Some or all of the functions of the first control device 150 may be configured with circuits such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). The first control device 150 executes various processes in parallel or sequentially. The first control device 150 is an example of a control device included in the information processing device 4.

[0022] As described below, the first control device 150 acquires error information from the projector 1 via the network, indicating an error related to the optical detection of the position of the pointer on the screen SC performed by the projector 1, and displays the acquired error information on the display device 120.

[0023] FIG. 3 is a diagram showing an example of a situation in which the projector 1 is used. The projector 1 projects an image onto a screen SC. For example, the projector 1 is fixed to a wall surface (not shown). The screen SC is installed below the projector 1. The screen SC is an example of a projection surface onto which an image is projected by the projector 1. Note that a wall surface may be used as the projection surface instead of the screen SC.

[0024] The projector 1 displays a drawing screen on the screen SC for drawing objects according to position information of the electronic pen P or the user's finger F. The projector 1 draws objects such as lines, characters, and figures on the drawing screen based on the position information of the electronic pen P or the user's finger F. In this way, the drawing screen displayed on the screen SC is used as an electronic whiteboard.

[0025] The electronic pen P has a light-emitting element that emits infrared light at its pen tip, and emits the infrared light from the pen tip in synchronization with a synchronization signal transmitted from a synchronization device 41 of the projector 1. The electronic pen P has a light-receiving element that receives the infrared light, and receives an infrared light synchronization signal from the synchronization device 41, which will be described later. The electronic pen P emits infrared light in accordance with a predetermined sequence at a timing according to the synchronization signal. The projector 1 captures the infrared light emitted from the electronic pen P with a camera 43, and acquires position information of the electronic pen P based on the captured image obtained from the camera 43. Note that the synchronization device 41 and camera 43 are not shown in FIG. 3.

[0026] The projector 1 includes a light-emitting device 42. The light-emitting device 42 includes a light source that emits infrared light. The light-emitting device 42 is disposed between the main body of the projector 1 and the screen SC, and emits diffused infrared light downward within a range of angle θ. The infrared light emitted from the light-emitting device 42 forms a layer of light along the screen SC. In this embodiment, the angle θ reaches approximately 180 degrees, and the layer of light is formed over almost the entire screen SC. It is preferable that the surface of the screen SC and the layer of light formed by the light-emitting device 42 are close to each other. The light-emitting device 42 may include an adjustment mechanism that adjusts the distance and angle between the layer of light emitted by the light source and the screen SC. Note that the light-emitting device 42 can be omitted if detection of a user's finger F is not performed.

[0027] The projector 1 captures, with the camera 43, reflected light generated when infrared light emitted from the light-emitting device 42 is reflected by the user's finger F, and acquires position information of the user's finger F based on the captured image obtained from the camera 43. The electronic pen P and the user's finger F are examples of a pointer. In the following description, when there is no need to distinguish between the electronic pen P and the user's finger F, the electronic pen P and the user's finger F will be collectively referred to as a pointer. The electronic pen P is an example of a light-emitting pointer that emits light.

[0028] 4 is a diagram showing a schematic configuration of the projector 1 of this embodiment. As shown in Fig. 4, the projector 1 includes a first optical device 30, a second optical device 40, a second input device 50, a second communication device 60, a second storage device 70, and a second control device 80.

[0029] The first optical device 30 projects an image onto a screen SC. The first optical device 30 includes a light source 10, two dichroic mirrors 11 and 14, three reflecting mirrors 12, 17, and 19, five relay lenses 13, 15, 16, 18, and 20, a dichroic prism 21, a projection optical system 22, and three liquid crystal panels 23R, 23G, and 23B.

[0030] The light source 10 emits white light L0 to the dichroic mirror 11. For example, the light source 10 is a mercury lamp. The amount of the white light L0 emitted from the light source 10 is controlled by the second control device 80.

[0031] The dichroic mirror 11 separates the white light L0 into a first color light L1 and a second color light L2. For example, the first color light L1 is red light, and the second color light L2 is a mixture of green and blue light. The dichroic mirror 11 outputs the first color light L1 to the reflecting mirror 12 and the second color light L2 to the dichroic mirror 14.

[0032] The dichroic mirror 14 separates the second color light L2 into a third color light L3 and a fourth color light L4. For example, the third color light L3 is green light, and the fourth color light L4 is blue light. The dichroic mirror 14 outputs the third color light L3 to a relay lens 15 and the fourth color light L4 to a relay lens 16.

[0033] The first color light L1 emitted from the dichroic mirror 11 passes through a reflecting mirror 12 and a relay lens 13 and is incident on the liquid crystal panel 23R. The third color light L3 emitted from the dichroic mirror 14 passes through a relay lens 15 and is incident on the liquid crystal panel 23G. The fourth color light L4 emitted from the dichroic mirror 14 passes through a relay lens 16, a reflecting mirror 17, a relay lens 18, a reflecting mirror 19, and a relay lens 20 and is incident on the liquid crystal panel 23B.

[0034] The liquid crystal panels 23R, 23G, and 23B are each a liquid crystal panel for displaying an image. The liquid crystal panel 23R is disposed on the optical path of the first colored light L1. The liquid crystal panel 23G is disposed on the optical path of the third colored light L3. The liquid crystal panel 23B is disposed on the optical path of the fourth colored light L4. Hereinafter, when it is not necessary to distinguish between the liquid crystal panels 23R, 23G, and 23B, these three liquid crystal panels 23R, 23G, and 23B may be collectively referred to as the liquid crystal panel 23.

[0035] , For example, the liquid crystal panel 23 in this embodiment is an active drive type liquid crystal panel provided with a TFT (Thin Film Transistor) as a pixel switching element for each pixel. Furthermore, for example, the liquid crystal panel 23 is a VA (Vertical Alignment) type liquid crystal panel. The liquid crystal panel 23 functions as a light modulation device in the projector 1. The liquid crystal panel 23R modulates the first red color light L1. The liquid crystal panel 23G modulates the third green color light L3. The liquid crystal panel 23B modulates the fourth blue color light L4. Although not shown in FIG. 1, the transmittance of the pixels of each of the liquid crystal panels 23R, 23G, and 23B is controlled by the second control device 80.

[0036] The dichroic prism 21 generates image light L5 representing a color image by mixing the first color light L1 modulated by the liquid crystal panel 23R, the third color light L3 modulated by the liquid crystal panel 23G, and the fourth color light L4 modulated by the liquid crystal panel 23B. The dichroic prism 21 outputs the image light L5 to the projection optical system 22. The projection optical system 22 enlarges and projects the image light L5 onto the screen SC. A color image is displayed on the screen SC by projecting the image light L5 onto the screen SC.

[0037] Within the housing of the projector 1, the dichroic mirrors 11 and 14, the reflecting mirrors 12, 17 and 19, the relay lenses 13, 15, 16, 18 and 20, the dichroic prism 21, the projection optical system 22, and the liquid crystal panels 23R, 23G and 23B are housed, for example, inside a resin case 90. The case 90 is configured so that light other than the white light L0 emitted from the light source 10 does not enter the liquid crystal panel 23.

[0038] The second optical device 40 emits infrared light to the pointer and receives infrared light from the pointer. The second optical device 40 includes a synchronization device 41, a light emitting device 42, and a camera 43. The camera 43 is an example of an imaging device.

[0039] The synchronization device 41 includes a light source that emits infrared light, and transmits the infrared light as a synchronization signal in accordance with an instruction from the second control device 80. As already explained, the electronic pen P emits infrared light from its pen tip in synchronization with the synchronization signal transmitted from the synchronization device 41. The light-emitting device 42 emits infrared light that forms a layer of light along the screen SC in accordance with an instruction from the second control device 80. The light-emitting device 42 has been explained above.

[0040] The projector 1 includes a camera 43 for acquiring position information of the electronic pen P or the user's finger F. The camera 43 includes an imaging element that receives infrared light emitted by the electronic pen P and reflected light generated when the infrared light emitted from the light-emitting device 42 is reflected by the user's finger F, an optical system that forms an image on the imaging element, and an aperture that limits the light incident on the imaging element. The imaging element is, for example, a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) that detects infrared light and visible light. The camera 43 captures an image of an area including the screen SC in accordance with instructions from the second control device 80, and outputs captured image data representing the captured image to the second control device 80.

[0041] The second input device 50 is a device that accepts user input operations on the projector 1. As an example, the second input device 50 includes an operation unit 51 and a light receiving unit 52. The operation unit 51 is composed of a plurality of operation keys provided on the projector 1. For example, the operation keys include a power key, a menu call key, direction keys, an enter key, and a volume adjustment key. The operation keys may be hardware keys or software keys displayed on a touch panel provided on the projector 1. The operation unit 51 outputs an electrical signal generated when each operation key is operated by the user to the second control device 80 as an operation signal.

[0042] The light-receiving unit 52 includes a photoelectric conversion circuit that receives infrared light transmitted from a remote controller (not shown) of the projector 1 and converts it into an electrical signal. The light-receiving unit 52 outputs the electrical signal obtained by photoelectrically converting the infrared light to the second control device 80 as a remote operation signal. The remote controller has a plurality of operation keys, similar to the operation unit 51. The remote controller converts electrical signals generated when the user operates each operation key provided on the remote controller into infrared light and transmits the infrared light to the projector 1. In other words, the remote operation signal output from the light-receiving unit 52 is substantially the same as the electrical signal generated when the user operates each operation key on the remote controller. Note that if the remote controller transmits radio signals in accordance with a short-range wireless communication standard such as Bluetooth (registered trademark), a receiving device for receiving the radio signal may be provided instead of the light-receiving unit 52.

[0043] The second communication device 60 is a communication interface circuit that controls communication between the second control device 80 and external devices. The external devices with which the second control device 80 communicates via the second communication device 60 include the monitoring terminal 2 described above.

[0044] The second storage device 70 includes a nonvolatile memory that stores programs and various setting data required for the second control device 80 to execute various processes, and a volatile memory that is used as a temporary storage destination for data when the second control device 80 executes various processes. For example, the nonvolatile memory is an EEPROM or a flash memory. The volatile memory is, for example, a RAM.

[0045] The second control device 80 is an arithmetic processing device that controls the overall operation of the projector 1 in accordance with a program stored in the second storage device 70. As an example, the second control device 80 is configured with one or more processors such as a CPU. Some or all of the functions of the second control device 80 may be configured with circuits such as a DSP, ASIC, PLD, and FPGA. The second control device 80 executes various processes in parallel or sequentially. The second control device 80 is an example of a control device provided in the projector 1.

[0046] As described below, the second control device 80 optically detects the position of the indicator on the screen SC based on the signal output from the second optical device 40, and transmits error information indicating an error related to the optical detection of the indicator position via the network.

[0047] 5 is a flowchart showing each process executed by the second control device 80 of the projector 1. The second control device 80 executes a program stored in the second storage device 70 to execute each process shown in FIG.

[0048] 5, the second control device 80 detects the position of the electronic pen P or the user's finger F while a drawing screen, which is an electronic whiteboard, is displayed on the screen SC (step S1). Specifically, the second control device 80 instructs the synchronization device 41 to transmit a synchronization signal, and instructs the light-emitting device 42 to emit infrared light at a predetermined timing.

[0049] The electronic pen P emits infrared light from its pen tip in synchronization with a synchronization signal transmitted from the synchronization device 41 of the projector 1. The light-emitting device 42 emits infrared light at a timing instructed by the second control device 80. The second control device 80 controls the synchronization device 41 and the light-emitting device 42 as described above, and also instructs the camera 43 to perform an image capturing operation at a predetermined timing.

[0050] The camera 43 captures an image of an area including the screen SC at a timing instructed by the second control device 80, and outputs captured image data representing the captured image to the second control device 80. The captured image includes an image area representing reflected light generated when the infrared light emitted by the electronic pen P or the infrared light emitted from the light-emitting device 42 is reflected by the user's finger F.

[0051] The second control device 80 acquires position information of the electronic pen P or the user's finger F based on the captured image obtained from the camera 43. For example, the method disclosed in Patent Document 1 can be adopted as a method by which the second control device 80 acquires position information of the electronic pen P or the user's finger F. Therefore, in this embodiment, a detailed description of the method by which the second control device 80 acquires position information of the electronic pen P or the user's finger F will be omitted.

[0052] Step S1 is not limited to the process of detecting the position of the indicator, but may also include an adjustment process for detecting the position of the indicator. For example, it may include an adjustment process for at least one of the synchronization device 41, the light-emitting device 42, and the camera 43. Specifically, the second control device 80 may transmit a signal for confirming operation to each of these devices and confirm whether each device is operating normally by receiving a response signal. The second control device 80 may perform a calibration process for converting the position of the indicator in the coordinate system of the image captured by the camera 43 into a position in the coordinate system of the liquid crystal panel 23. The second control device 80 may also perform a process for adjusting the irradiation angle of infrared light from the light-emitting device 42.

[0053] A first example of the calibration process will be described. The calibration process may be started by a user operating the second input device 50 or a remote controller. The second control device 80 controls the first optical device 30 to project a pattern image for calibration onto the screen SC. The pattern image is an image including a plurality of figures, such as rectangles. The second control device 80 controls the camera 43 to acquire a captured image of the screen SC including the pattern image. The second control device 80 determines a conversion formula for converting a position in the captured image to a position on the liquid crystal panel 23 based on the positional relationship between the position of the figure in the captured image and the position of the figure on the liquid crystal panel 23.

[0054] As a second example of the calibration process, the second control device 80 may perform calibration based on a user's operation on the screen SC. In this case, the second control device 80 controls the first optical device 30 to project multiple figures included in a calibration image onto the screen SC. The user touches the multiple figures in order with the electronic pen P. The touch order is specified by the second control device 80 based on the display order of the figures, etc. The second control device 80 controls the light emission timing of the electronic pen P using the synchronization device 41 and captures a captured image of the screen SC using the camera 43 while the touch operation is being performed. The second control device 80 determines a conversion formula for converting a position in the captured image to a position on the liquid crystal panel 23 based on the positional relationship between the position of the infrared light of the electronic pen P in the captured image and the position of the figure on the liquid crystal panel 23.

[0055] If the light-emitting device 42 has an adjustment mechanism, the second control device 80 may perform a process to adjust the irradiation angle of the infrared light emitted by the light-emitting device 42. This process adjusts the irradiation angle of the infrared light emitted by the light-emitting device 42 so that the layer of light emitted by the light-emitting device 42 covers almost the entire screen SC in close proximity to the surface of the screen SC. As an example, the second control device 80 causes the light-emitting device 42 to emit infrared light, and detects the positions of the markers on the screen SC by using the camera 43 to detect the reflected light from multiple markers that reflect the infrared light and are arranged on the screen SC. The second control device 80 displays an image of a landmark at the position of the detected marker. The user adjusts the irradiation angle of the infrared light by operating the adjustment mechanism while referring to the image. The adjustment mechanism may be controlled by the second control device 80.

[0056] The processing of step S1 as described above is an example of optically detecting the position of the pointer on the screen SC based on a signal output from the second optical device 40. The captured image data output from the camera 43 to the second control device 80 is an example of a signal output from the second optical device 40. The second control device 80 controls the first optical device 30 based on position information of the electronic pen P or the user's finger F so that objects such as lines, characters, and figures are drawn on the drawing screen.

[0057] If the second control device 80 detects an error in optically detecting the position of the pointer during the process of step S1, it transmits a log containing error information indicating the detected error to the monitoring terminal 2 via the second communication device 60 (step S2). Specifically, if an error occurs in any of the above processes, the second control device 80 acquires an error ID from the second storage device 70 based on the return value of the control signal, etc. The error ID is, for example, a two-digit code that corresponds one-to-one with the content of the error. If there are multiple error contents or causes in one process, the second control device 80 may acquire the error ID and a detail code indicating the details of the error. For example, in the calibration of the first example described above, if some of the figures included in the pattern image are not detected, this may be due to an obstacle being captured or the influence of external light. Furthermore, if all of the figures are detected but the conversion formula cannot be determined, this may be due to distortion of the projection surface. A detail code may be prepared for each of these causes. The error information preferably includes at least an error ID, identification information uniquely identifying the projector 1 in which the error occurred, and the date and time the error occurred. The error information may include an error ID and a detail code.

[0058] The monitoring terminal 2 transmits the logs acquired from each of the multiple projectors 1 to the cloud server 3 via a network such as the Internet. The cloud server 3 stores the logs received from the monitoring terminal 2 in a storage device installed in the cloud server 3.

[0059] The processing of step S2 as described above is an example of transmitting error information indicating an error related to optically detecting the position of the pointer via a network. In this embodiment, an example is shown in which each projector 1 transmits a log including the error information to the cloud server 3 via the monitoring terminal 2, but each projector 1 may also transmit a log including the error information to the cloud server 3 without via the monitoring terminal 2. In this case, the second communication device 60 communicates with the cloud server 3.

[0060] 5 is periodically executed by the second control device 80 of each projector 1, and logs of each projector 1 are accumulated in the cloud server 3. Among the logs accumulated in the cloud server 3, there are also logs that contain the above-mentioned error information.

[0061] When an abnormality occurs in one of the multiple projectors 1, a user of the multiple projectors 1 notifies a support person of the occurrence of the abnormality and asks the support person how to deal with the abnormality. When the support person receives the contact from the user, the support person operates the first input device 130 of the information processing device 4 to instruct the information processing device 4 to display the log of the projector 1 in which the abnormality occurred.

[0062] 6 is a flowchart showing each process executed by the first control device 150 of the information processing device 4. The first control device 150 executes a program stored in the first storage device 140 to execute each process shown in FIG.

[0063] 6, when first control device 150 receives an operation from the support person via first input device 130 instructing that the log of projector 1 be displayed, first control device 150 acquires the log of projector 1 specified by the support person from cloud server 3 via first communication device 110 (step S11). First control device 150 causes display device 120 to display error information included in the log acquired from cloud server 3 (step S12).

[0064] The processing of step S11 as described above is an example of acquiring, via the network from the projector 1, error information indicating an error related to optically detecting the position of the pointer on the screen SC, which is executed by the projector 1. The processing of step S12 as described above is an example of displaying the acquired error information on the display device 120.

[0065] Optically detecting the position of the pointer includes capturing an image of the screen SC using an imaging device. Errors related to optically detecting the position of the pointer include errors related to the imaging device. For example, errors related to the imaging device can cause the position of the pointer to be incapable of being detected due to a malfunction of the imaging device, strong external light such as sunlight or fluorescent light entering the light-receiving section of the screen SC or the imaging device, or the presence of an obstacle between the imaging device and the screen SC.

[0066] Optically detecting the position of the indicator includes detecting the position of the user's finger F based on reflected light generated when infrared light emitted from the light-emitting device 42 is reflected by the user's finger F. Errors related to optically detecting the position of the indicator include errors related to the light-emitting device 42. For example, an error related to the light-emitting device 42 is an inability to detect the position of the user's finger F due to a malfunction of the light-emitting device 42, strong external light such as sunlight or fluorescent light entering the screen SC, or the presence of an obstacle between the light-emitting device 42 and the screen SC.

[0067] Optically detecting the position of the pointer includes detecting the position of the electronic pen P based on infrared light emitted from the electronic pen P. Errors related to optically detecting the position of the pointer include errors related to the electronic pen P. For example, errors related to the electronic pen P include an inability to detect the position of the electronic pen P due to a malfunction of the electronic pen P, strong external light such as sunlight or fluorescent light entering the screen SC, or the presence of an obstacle between the electronic pen P and the screen SC.

[0068] For example, the error information may be first error information including both an OSD (On-Screen Display) message number and a detail code, or second error information including the OSD message number among the OSD message number and detail code. That is, the second error information includes an OSD message number but not a detail code. The OSD message number is the number of a message displayed on the OSD screen according to the content of the error. The detail code is an error code accompanying the OSD message. The OSD is an image displayed by the projector 1 and is used to present a menu screen for controlling the projector 1 and various information related to the projector 1. If an error occurs, the projector 1 may display a message corresponding to the error via the OSD in step S2. The content of the message preferably includes the type of error and an explanation of how to deal with the error, and may include an error ID or a detail code. The content of the message is stored in the second storage device 70 in association with the OSD message number. The OSD message number is stored in the second storage device 70 in association with the error ID or the detail code, and the second control device 80 causes the first optical device 30 to display the OSD message based on the error ID or the detail code.

[0069] The support staff can easily understand the details of the error that occurred in the projector 1 contacted by the user and how to deal with it by checking the OSD message number and detail code included in the error information displayed on the display device 120 of the information processing device 4. As a result, the support staff can give the user appropriate advice about the abnormality that occurred in one of the multiple projectors 1.

[0070] The first control device 150 of the information processing device 4 executes the process shown in FIG. 6, thereby realizing the information processing method of this embodiment as follows. That is, the information processing method of this embodiment includes obtaining error information from the projector 1 via a network, which indicates an error related to optically detecting the position of a pointer on the screen SC, which is performed by the projector 1 that projects an image onto the screen SC, and displaying the obtained error information. According to the present embodiment as described above, error information indicating an error relating to the optical detection of the position of the indicator on the screen SC is acquired from the projector 1, and the acquired error information is displayed. Therefore, even if the support person is located far away from the installation location of the projector 1, the support person can understand the reason why the projector 1 is unable to properly perform display control according to the position of the indicator.

[0071] In the information processing method of this embodiment, optically detecting the position of the pointer includes capturing an image of the screen SC using an imaging device, and errors related to optically detecting the position of the pointer include errors related to the imaging device, such as an abnormal value in a response signal to an operation confirmation signal from the second control device 80, no detection of connection of the imaging device, or no imaging. According to the present embodiment as described above, optically detecting the position of the indicator includes capturing an image of the screen SC using an imaging device, and errors related to optically detecting the position of the indicator include errors related to the imaging device, so the support staff can recognize errors related to the imaging device as the cause of the projector 1 being unable to properly control the display in accordance with the position of the indicator.

[0072] In the information processing method of this embodiment, optically detecting the position of the indicator includes detecting the position of the user's finger F based on reflected light generated when infrared light emitted from the light-emitting device 42 is reflected by the user's finger F, and errors related to optically detecting the position of the indicator include errors related to the light-emitting device 42. Errors related to the light-emitting device 42 include when connection of the light-emitting device 42 is not detected, when a response signal to a signal for operation confirmation is an abnormal value, when a marker is not detected in processing for adjusting the irradiation angle of infrared light by the light-emitting device 42, etc. According to the present embodiment as described above, optically detecting the position of the indicator includes detecting the position of the user's finger F based on the reflected light generated when the infrared light emitted from the light-emitting device 42 is reflected by the user's finger F, and since an error related to optically detecting the position of the indicator includes an error related to the light-emitting device 42, the support staff can recognize the error related to the light-emitting device 42 as the cause of the projector 1 being unable to properly perform display control according to the position of the indicator.

[0073] In the information processing method of this embodiment, the indicator includes a light-emitting electronic pen P, optically detecting the position of the indicator includes detecting the position of the electronic pen P based on infrared light emitted from the electronic pen P, and errors related to optically detecting the position of the indicator include errors related to the electronic pen P. Errors related to the electronic pen P are, for example, the items exemplified in the explanation of the detailed code. Note that the various errors described above are merely examples and are not limited to these. According to the present embodiment as described above, optically detecting the position of the indicator includes detecting the position of the electronic pen P based on infrared light emitted from the electronic pen P, and errors related to optically detecting the position of the indicator include errors related to the electronic pen P, so the support staff can recognize errors related to the electronic pen P as the cause of the projector 1 being unable to properly perform display control according to the position of the indicator.

[0074] In the information processing method of this embodiment, the error information is either first error information including both an OSD message number and a detail code, or second error information including the OSD message number out of the OSD message number and the detail code. According to the present embodiment as described above, the support staff can easily understand the content of the error that has occurred in projector 1 and how to deal with it by checking the OSD message number and detail code contained in the displayed error information.

[0075] The information processing device 4 of this embodiment includes a display device 120 that displays an image, and a first control device 150 that acquires error information indicating an error related to optically detecting the position of a pointer on the screen SC, which is performed by the projector 1 that projects an image onto the screen SC, from the projector 1 via a network, and displays the acquired error information on the display device 120. According to the information processing device 4 of this embodiment as described above, the first control device 150 acquires error information from the projector 1 via the network, indicating an error in the optical detection of the position of the indicator on the screen SC, which is performed by the projector 1 that projects an image onto the screen SC, and displays the acquired error information on the display device 120.Therefore, even if the support person is located far away from the installation location of the projector 1, the support person can understand the reason why the projector 1 is unable to properly perform display control according to the position of the indicator.

[0076] The projector 1 of this embodiment includes a first optical device 30 that projects an image onto a screen SC, a second optical device 40 that emits infrared light to a pointer and receives infrared light from the pointer, and a second control device 80 that optically detects the position of the pointer on the screen SC based on a signal output from the second optical device 40, and transmits error information indicating an error related to the optical detection of the position of the pointer via a network. According to the projector 1 of this embodiment as described above, the second control device 80 optically detects the position of the indicator on the screen SC based on the signal output from the second optical device 40, and transmits error information indicating an error related to the optical detection of the position of the indicator via the network. Therefore, even if the support person is located far away from the installation location of the projector 1, the support person can understand the reason why the projector 1 is unable to properly control the display according to the position of the indicator.

[0077] The above describes embodiments of the present disclosure, but the technical scope of the present disclosure is not limited to the above embodiments, and various modifications can be made within the scope that does not deviate from the spirit of the present disclosure.

[0078] In the above embodiment, as examples of errors relating to optically detecting the position of the pointer, an error relating to the imaging device, an error relating to the light-emitting device 42, and an error relating to the electronic pen P have been given, but the contents of errors in the present disclosure are not limited to these. Furthermore, when the monitoring terminal 2 acquires a log including error information, it may notify a support person that an error has occurred in any of the projectors 1 by sending an email to the information processing device 4. Furthermore, in the above embodiment, an example has been given in which a support person uses the log stored in the cloud server 3, but the administrator of the projector 1 may also use it for maintenance.

[0079] Summary of the Disclosure A summary of this disclosure is provided below.

[0080] (Appendix 1) An information processing method including: acquiring, via a network, error information from a projector that projects an image onto a projection surface, the error information indicating an error relating to optical detection of the position of a pointer on the projection surface, the operation being performed by the projector; and displaying the acquired error information.

[0081] The information processing method described in Appendix 1 includes obtaining error information from the projector via a network, which indicates an error in the optical detection of the position of the indicator on the projection surface performed by the projector, and displaying the obtained error information. Therefore, even if the support person is located far away from the projector's installation location, the support person can understand the reason why the projector is unable to properly control the display in accordance with the indicator's position.

[0082] (Supplementary Note 2) The information processing method according to Supplementary Note 1, wherein the detecting includes capturing an image of the projection surface using an imaging device, and the error includes an error related to the imaging device.

[0083] According to the information processing method described in Appendix 2, the detecting includes capturing an image of the projection surface using an imaging device, and the error includes an error related to the imaging device, so the support staff can recognize the error related to the imaging device as the cause of the projector being unable to properly control the display according to the position of the indicator.

[0084] (Appendix 3) An information processing method according to appendix 1 or 2, wherein the detecting includes detecting the position of the indicator based on reflected light generated when light emitted from the light emitting device is reflected by the indicator, and the error includes an error related to the light emitting device.

[0085] According to the information processing method described in Appendix 3, the detecting includes detecting the position of the indicator based on reflected light generated when light emitted from the light-emitting device is reflected by the indicator, and since the error includes an error related to the light-emitting device, the support staff can recognize the error related to the light-emitting device as the cause of the projector being unable to properly control the display according to the position of the indicator.

[0086] (Appendix 4) The information processing method according to any one of Appendices 1 to 3, wherein the indicator includes a light-emitting indicator that emits light, the detecting includes detecting a position of the light-emitting indicator based on light emitted from the light-emitting indicator, and the error includes an error related to the light-emitting indicator.

[0087] According to the information processing method described in Appendix 4, the indicator includes a light-emitting indicator that emits light, the detecting includes detecting the position of the light-emitting indicator based on light emitted from the light-emitting indicator, and the error includes an error related to the light-emitting indicator, so the support staff can recognize the error related to the light-emitting indicator as the cause of the projector being unable to properly control the display in accordance with the position of the indicator.

[0088] (Appendix 5) An information processing method described in any one of Appendices 1 to 5, wherein the error information is either first error information that includes both a message number of a message corresponding to the error and a detail code that indicates details of the error, and is displayed by the projector, or second error information that includes the message number among the message number and the detail code.

[0089] According to the information processing method described in Appendix 5, a support staff member can easily understand the content of the error that has occurred in the projector and how to deal with it by checking the message number and detailed code contained in the displayed error information.

[0090] (Appendix 6) An information processing device comprising: a display device that displays an image; and a control device that executes the following: acquiring, via a network, from a projector that projects an image onto a projection surface, error information indicating an error in optically detecting the position of a pointer on the projection surface, the error information being executed by the projector; and displaying the acquired error information on the display device.

[0091] According to the information processing device described in Appendix 6, the control device acquires error information from the projector via the network, indicating an error in the projector's optical detection of the position of the indicator on the projection surface, and displays the acquired error information on the display device. Therefore, even if the support person is located far away from the projector's installation location, the support person can understand the reason why the projector is unable to properly control the display in accordance with the indicator's position.

[0092] (Appendix 7) A projector comprising: a first optical device that projects an image onto a projection surface; a second optical device that emits light to a pointer and receives light from the pointer; and a control device that optically detects the position of the pointer on the projection surface based on a signal output from the second optical device, and transmits error information indicating an error related to the detection via a network.

[0093] According to the projector described in Appendix 7, the control device optically detects the position of the indicator on the projection surface based on the signal output from the second optical device, and transmits error information indicating an error related to the optical detection of the position of the indicator via the network. Therefore, even if the support person is located far away from the installation location of the projector, the support person can understand the reason why the projector is unable to properly control the display according to the position of the indicator. [Explanation of symbols]

[0094] 1...Projector, 2...Monitoring terminal, 3...Cloud server, 4...Information processing device, 30...First optical device, 40...Second optical device, 80...Second control device, 120...Display device, 150...Second control device, SC...Screen (projection surface), P...Electronic pen, F...User's finger

Claims

1. acquiring, via a network, from a projector that projects an image onto a projection surface, error information indicating an error related to optically detecting a position of a pointer on the projection surface, the error information being executed by the projector; Displaying the acquired error information; An information processing method, including:

2. the detecting includes capturing an image of the projection surface using an imaging device; the error includes an error related to the imaging device; The information processing method according to claim 1 .

3. the detecting includes detecting a position of the indicator based on reflected light generated when light emitted from a light-emitting device is reflected by the indicator, the error includes an error related to the light emitting device; The information processing method according to claim 1 .

4. the indicator is a light-emitting indicator that emits light, the detecting includes detecting a position of the light-emitting indicator based on light emitted from the light-emitting indicator; The error includes an error related to the light-emitting indicator. The information processing method according to claim 1 .

5. 5. An information processing method according to claim 1, wherein the error information is either first error information that includes both a message number of a message corresponding to the error and a detail code that indicates details of the error, and is displayed by the projector, or second error information that includes the message number among the message number and the detail code.

6. a display device for displaying an image; acquiring, via a network, from a projector that projects an image onto a projection surface, error information indicating an error related to optically detecting a position of a pointer on the projection surface, the error information being executed by the projector; displaying the acquired error information on the display device; a control device that executes the An information processing device comprising:

7. a first optical device that projects an image onto a projection surface; a second optical device that emits light to the indicator and receives light from the indicator; optically detecting a position of the pointer on the projection surface based on a signal output from the second optical device; transmitting error information over a network indicative of the error related to the detecting; a control device that executes the A projector equipped with

Images