Viewpoint position recovery device

By indicating light spots on the display surface and using the camera device to calculate the position, the problem of unclear viewpoint position is solved, and viewpoint position recovery without the need for a display device is achieved, and it is suitable for paper or electronic display surfaces.

JP7627947B2Active Publication Date: 2025-02-07有限会社システック

Patent Information

Application Number
JP2021101671
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-06-18
Publication Date
2025-02-07
Estimated Expiration
2041-06-18

AI Technical Summary

Technical Problem

When the viewer's viewpoint or its nearby location becomes unclear, the viewpoint location cannot be effectively restored.

Method used

The viewpoint position is indicated on the display surface by the light point application device, and the display surface is photographed by the imaging device, the light point position is calculated, and the light point position is guided to restore the light point to the initial position using the light point position memory storage and recovery command device.

Benefits of technology

The viewpoint position can be restored without a display device, which is suitable for paper or electronic display surfaces, realizing the viewpoint position recovery of a simple and small device.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007627947000001
    Figure 0007627947000001
  • Figure 0007627947000002
    Figure 0007627947000002
  • Figure 0007627947000003
    Figure 0007627947000003
Patent Text Reader

Abstract

To provide a viewpoint position recovery device that can use even a display surface such as a paper base without requiring display means of projecting a display surface, and can recover a position of a light spot viewed before it becomes unknown with only a small and simple configuration that can be mounted on a viewer's head.SOLUTION: A viewpoint position recovery device includes recovery instruction means that issues an instruction including at least a recovery direction for moving a current light spot to recover to a reference light spot position, which is a light spot position viewed before the current light spot position becomes unknown, and determines whether a recovery movement amount Δ is within a desired range centered on the reference light spot position.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a viewpoint position recovery device capable of recovering the viewpoint position when the viewpoint or its vicinity on the surface of an object to be viewed becomes unclear to a viewer. [Background technology]

[0002] In the prior patent document 1, the term "gazing point" is used, but the meaning is different from the viewpoint position in the present application, and it means the area where the photographer is paying attention to the focus detection area of ​​the camera, and there is no similarity or connection with the argument of the present application. In the patent document 2, a viewpoint detection device is described, but when an operator performs a touch operation on a touch panel, an eye image is taken under the assumption that the eye image is looking at the touch position, and the touch position is used to correct the viewpoint position. Words such as viewpoint position appear, but it is unrelated to the subject of the present application and there is no suggestive content. A similar one is patent document 3. Patent document 4 describes a pointing device that detects eye movement to estimate the viewpoint position and displays the viewpoint position obtained from it on a screen. This is also unrelated to the subject of the present application and there is no suggestive content. Furthermore, as something similar to patent document 4, patent document 5 describes a device that mounts a light source that follows the movement of the neck, detects the brightest position of a light point on a display with a photoelectric element filter, and displays a cursor at the corresponding position. This is also unrelated to the subject of the present application and there is no suggestive content. Patent Document 6 was filed by the applicant in consideration of the above-mentioned prior application, and has a display means in its configuration to recover the ambiguity of the viewpoint position, and performs recovery processing by looking at the unknown viewpoint position displayed on the display screen. I think it brings about good effects, but there were still some problems that could not be solved. That is, while the constituent means other than the display means have the advantage of being small enough to be mounted on the head, the display means has a display surface and a housing with a relatively large area corresponding to the display surface, and has the characteristic that it cannot be attached to the head or the like except as a head-mounted display (HMD). Furthermore, in the state of use, for example, a smartphone or the like is not always around as a display means, and for example, especially when viewing a paper-based document, this requirement could not be met unless an electronic display means that displays to recover the viewpoint position is prepared separately. For such applications, I felt that it would be effective to be able to perform the recovery of the viewpoint position only with a small means that can be mounted on the head without relying on a display means. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent H4-149413 [Patent Document 2] Patent Publication 2015-46111 [Patent Document 3] Patent H9-44310 [Patent Document 4] Patent H4-323715 [Patent Document 5] Patent H2-110622 [Patent Document 6] Patent Publication No. 2020-154907 Summary of the Invention [Problem to be solved by the invention]

[0004] The object of this application is to provide a viewpoint position recovery device that can recover the viewpoint by guiding a light point corresponding to the viewpoint to the viewpoint position stored until that point in time when the viewpoint or a position near the viewpoint on the surface of the object being viewed becomes unclear to the viewer. [Means for solving the problem]

[0005] The following is described in accordance with the claims. The invention described in claim 1 is a viewpoint position recovery device, A control means and a control device controlled by the control means. a light spot providing means for providing a light spot indicating a viewer's viewpoint or its vicinity on a display surface, whether paper or electronic; a display surface photographing means for photographing the display surface to which the light spot has been provided; an in-display surface light spot position calculating means for calculating a position of the light spot on the display surface; a light spot position memory for storing the calculated position of the light spot as data of a reference light spot position before it becomes unclear which position on the display surface the viewer was looking at; a recovery operation starting means for starting an operation to restore a current light spot position to the reference light spot position seen before it became unclear; a recovery direction / recovery movement amount calculating means for calculating a recovery movement amount Δ and a recovery direction which are the difference between the current light spot position and the reference light spot position obtained by photographing with the display surface photographing means and calculation by the in-display surface light spot position calculating means after it becomes unclear which position on the display surface the viewer was looking at The above and a recovery instruction means for giving an instruction including a recovery direction and judging whether the recovery movement amount Δ falls within a desired range centered on the reference light spot position.

[0006] The invention described in claim 2 is the viewpoint position recovery device of claim 1, The recovery instruction means is The above The present light spot is provided with an expression function for indicating a recovery direction and the like.

[0007] The invention described in claim 3 is the viewpoint position recovery device according to claim 2, wherein the at least The above The light spot providing means has the expression function of the current light spot when giving an instruction including a recovery direction.

[0008] The invention described in claim 4 is the viewpoint position recovery device described in claim 2 or claim 3, When the current light point having the expression function indicates the recovery direction, A group of multiple light points that light up or blink in an ordered sequence, or Or, it is a collection of multiple light points, and the light and shade are applied in the order of arrangement. Or, a light spot that can be distinguished from the current light spot is arranged on the recovery direction side as viewed from the position of the current light spot, Or, the blinking speed changes in the direction approaching the reference light point position, Is it due to the light emitted from the light source passing through the direction mark formed on the display surface? It is characterized in that it is either one of the above.

[0009] The invention described in claim 5 is the viewpoint position recovery device described in claim 1, The recovery instruction means Indicating the direction of recovery and judging whether the desired range has been reached and indicating the result of the judgment. It is characterized by being done by voice.

[0010] The invention described in claim 6 is characterized in that, in the viewpoint position recovery device described in any one of claims 1 to 5, the light spot position calculation means within the display surface calculates the relative position of the light spot with respect to the outer frame or center point of the display surface.

[0011] The invention described in claim 7 is characterized in that, in the viewpoint position recovery device described in any one of claims 1 to 6, the recovery operation starting means is started by driving a start switch, which is an artificial action of the viewer.

[0012] The invention described in claim 8 is characterized in that, in the viewpoint position recovery device described in any one of claims 1 to 6, the recovery action starting means is started by being driven by a signal obtained by the display surface imaging means photographing and detecting an artificial action of the viewer, which is to move the current light point outside the display surface and then bring it back into the display surface.

[0013] The invention described in claim 9 provides the viewpoint position recovery device described in claim 8, The present invention is characterized in that the light source is activated by being driven by a signal obtained by photographing and detecting, by the display surface photographing means, that the current light spot is moved out of the display surface and then brought back into the display surface multiple times.

[0014] The invention described in claim 10 is the viewpoint position recovery device described in claim 8 or claim 9, The recovery action starting means is characterized in that it is possible to set as a judgment criterion the deviation of the current light point in a lateral or upward direction from the display surface and then back in, which is an artificial action of the viewer, as an action of moving the current light point outside the display surface and then bringing it back inside the display surface.

[0015] The present invention relates to a viewpoint position recovery device according to any one of claims 1 to 10, From before , or a specified time From before, By having a designation means that allows a desired time width to be designated, It exists within the time span designated by the designation means Data on the reference light spot position is acquired, and the data on the reference light spot position is used to calculate the recovery direction and the recovery movement amount Δ in the recovery direction / recovery movement amount calculation means.

[0016] The invention described in claim 12 provides a viewpoint position recovery device according to any one of claims 1 to 11, When the recovery position is determined to be the lowest position under the display surface, a light spot position above the lowest position is set as the reference light spot position; Using the data of the reference light spot position, said recovery direction / recovery movement amount calculation means In the recovery direction, the recovery movement amount Δand instructing the recovery instruction means to issue an instruction based on the calculation.

[0017] The invention described in claim 13 provides a viewpoint position recovery device according to any one of claims 1 to 12, This applies regardless of the length of time it takes to recover. By providing a recovery switch, when the light spot by the viewer leaves the display surface and returns, the recovery switch is operated when the viewer leaves the display surface, so that the light spot at the time of the departure can be restored. Light spot The instruction to restore to the position is given.

[0018] The invention described in claim 14 provides a viewpoint position recovery device according to any one of claims 1 to 13, By providing a recording and reproducing means, when the viewer stops watching, Light spot The device is characterized by having a recording display surface determination mode in which a recording is made to identify and convey the display surface related to the position, and the recorded contents are reproduced when the device is restored for the recovery, so that the viewer can identify and determine the display surface.

[0019] The invention described in claim 15 is characterized in that, in the viewpoint position recovery device described in any one of claims 1 to 14, it has a head-mounted means integrally having at least the light spot providing means and the display surface imaging means. Effect of the Invention

[0020] As configured as described above, the viewpoint position recovery device of the present invention does not require a display means for projecting a display surface, and can handle even a paper-based display surface, and can recover the light spot position seen before it became unclear with only a small and simple configuration that can be mounted on the viewer's head. [Brief description of the drawings]

[0021] [Figure 1] 1 is a diagram showing an embodiment of the configuration of a viewpoint position recovery device according to the present invention; [Diagram 2] FIG. 2 is a diagram showing an embodiment of the operation flow of the viewpoint position recovery device according to the present invention. [Diagram 3] 1 is a diagram showing an embodiment of a restoration instruction operation by a light point of the viewpoint position restoration device according to the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] FIG. 1 is a diagram showing an embodiment of the configuration of a viewpoint position recovery device according to the present invention. The viewpoint position recovery device 100 comprises a control means 110, a light spot providing means 120 controlled by the control means 110 and providing a light spot indicating the viewer's viewpoint or its vicinity on a display surface, whether paper or electronic, a display surface being either paper or electronic, a display surface photographing means 130 for photographing the display surface to which the light spot has been provided, a light spot position within display surface calculation means 140 for calculating the light spot position on the display surface (the amount of data to be stored can be extremely small by calculating the relative position of the light spot with respect to the outer frame or center point of the display surface), a light spot position memory 150 for storing the calculated light spot position as reference light spot position data (the calculated light spot position is referred to later in a recovery direction / recovery movement amount calculation means 170, and therefore will be referred to as the reference light spot position in the claims) data before it becomes unclear which position on the display surface the viewer was looking at, and a reference light spot position (the reference light spot position is a position that becomes unclear and serves as the reference light spot position). the light spot position calculated by the display surface imaging means 130 and the light spot position calculation means 140 in the display surface imaging means 130; and a recovery direction / recovery movement amount calculation means 170 for calculating a recovery movement amount Δ and a recovery direction, which is a difference between the current light spot position and a reference light spot position calculated by the display surface imaging means 130 and the light spot position calculation means 140 in the display surface imaging means 130, by starting the recovery operation starting means 160 after it becomes unclear which position the viewer was looking at before the light spot position was calculated. The recovery instruction means 180 issues an instruction including at least a recovery direction for moving the current light spot to recover the current light spot position to the reference light spot position based on the recovery direction and the recovery movement amount Δ, and judges whether the recovery movement amount Δ has entered a desired range centered on the reference light spot position. Furthermore, it is desirable that at least the light spot providing means 120 and the display surface imaging means 130 are mounted on head-mounted means 190 such as eyeglass temples, a belt, a hat, etc. Since the means other than the light spot providing means 120 and the display surface imaging means 130 are also small in scale, they can all be integrated into the head-mounted means 190. The display surface imaging means 130 is a camera. The display surface photographing means 130 photographs the display surface at desired time intervals in the normal state when the device is turned on or when a start operation is performed after the power is turned on, and the obtained light spot position data is stored in the light spot position data memory. Only when the recovery operation starting means 160 is started, a recovery operation is performed based on the current light spot position and the reference light spot position. Once recovery is performed, the normal state is restored.

[0023] The recovery operation starting means 160 may be a start switch that can be operated by the viewer (started by a contact switch, a proximity switch, etc.), or it can also be started by sound, vibration, etc. It is also possible to use the image of the viewer temporarily moving the light point outside the display surface and then bringing it back inside the display surface by using the display surface imaging means 130, and to use this as a start signal. Consider the recovery action. If the cause of the light spot position becoming unknown is dozing, the face and therefore the light spot often drop downward. If this countermeasure is not taken, it is assumed that the recovery position will go to the lower end surface. As a first means for dealing with such a case, it is preferable to provide a function that enables designation of the recovery time, such as how many minutes in advance, or a desired time width from how many minutes in advance, etc. For this purpose, the recovery direction / recovery movement amount calculation means 170 uses the data of the reference light spot position stored in the light spot position memory 150 for calculation, and in this case, it is preferable that the data of the reference light spot position enables designation of the recovery time as the current time, a desired time before a designated time, or a desired time width. Based on the designation, the data of the reference light spot position corresponding to the designated time can be used for calculation in the recovery direction / recovery movement amount calculation means 170. Of course, this designation function may be provided by means other than the recovery direction / recovery movement amount calculation means 170, for example, an interface of the light spot position data memory 150, or may be provided as a new means. In addition, if the recovery position is below the display surface, this can be known by position determination, so if it is determined to be the lowest position, it is desirable to deal with it using the first means. In this case, a light spot position that is not the lowest position but slightly above (earlier in time) is specified by the recovery instruction means 180 as a reference light spot position (based on the calculation by the recovery direction / recovery movement amount calculation means 170).

[0024] As a second means, the deviation from the display surface due to dozing can be distinguished from the deviation from the display surface for starting by changing the speed of movement of the light spot and especially the direction. Considering that dozing is overwhelmingly most common in the downward direction, the recovery action starting means 160 can be set to determine whether the deviation from the display surface in the lateral or upward direction and the return are the judgment criteria for the action for starting, or it is also possible to start the device with a start switch without deviation from the display surface. As for the speed of movement, since the movements of dozing vary, a speed with a large difference must be selected, but considering that the characteristics of dozing are that the head drops quickly but takes a long time to return, and that the head may slowly move like a boat when falling asleep, it is desirable to distinguish between the deviation from the display surface for starting and the deviation from the display surface for starting by a fast reciprocating movement.

[0025] Furthermore, while the above is sufficient for deviation from the display screen for startup, for example, if there is a request such as "A) looking at the display screen, taking a break and wanting to resume an hour later, or B) turning off the device and then resuming the next day," the time it takes to resume from the time of return may be too long, and the first method may not be able to respond beyond the specified time. In such cases, a mechanism is needed to allow for peace of mind in resuming operation, In the case of the response to A), for example, the action of repeating deviation multiple times in succession, such as twice, can be made into a signal, or a recovery switch for "long-term recovery" can be provided, and by operating the recovery switch before leaving the display screen, when returning, this action is detected as a signal when leaving once, or depending on whether the recovery switch is operated, a recovery instruction can be given to the reference light point position at the time of leaving once. In this way, it is possible to respond regardless of the length of time until recovery. Furthermore, in the case of the method b), even if the power is turned off, the previous reference light spot position is stored in the light spot position memory 150, so that the method b) can be implemented simultaneously if the method a) is implemented. Therefore, it can be said that as long as one display surface is fixed, there is no problem in the operation of restoring the reference light spot position. However, if we expand the requirements a little, for example, "C) Consider how to deal with a case where you are looking at a display screen and then move away, or you stop an operation and want to recover, and there are multiple display screens. There is a problem of which display screen to recover to. For example, it would be desirable to be able to accommodate multiple display surfaces corresponding to the pages of a paper-based document, or multiple files on one screen in an electronic document. However, mainly due to the simple configuration of the light spot providing means 120 and the display surface photographing means 130, it is not easy to deal with such a case and indicate which display surface, such as a page, it was. As a means for dealing with such a case, it is preferable to further provide a recording / reproducing means to operate the following recording display surface determination mode. In the recording display surface confirmation mode, when the viewer stops watching, a recording is made that identifies the display surface, such as "page 15 of what book," and when the viewer returns to recover, the recorded content is played back, and the viewer identifies and confirms the display surface, such as the page, and then, as explained above, a recovery instruction to the reference light point position can be given. Furthermore, the details of "page 15, line 3, etc. can be recorded, so recovery is also certain. In addition, in the case of recording, it is possible to either associate the recording contents with the reference light spot data or not, because as long as the display surface can be identified, the restoration instruction can be given by the reference light spot data in the light spot position data memory.

[0026] The current light spot position when the recovery action starting means 160 is started is, of course, the viewer will move to recover after putting the light spot inside the display screen, so in this case, the current light spot position is not the light spot position taken by the camera outside the display screen, but is preferably recovered on the premise that it is within the frame (positional reference) within the display screen. It is also possible to exclude the position outside the display screen frame from the data.

[0027] In addition, when you look at the center of the display screen, the device is attached to your head so that the light spot is also in the center, so you place your viewpoint on the light spot and move the light spot mainly by rotating your face, and then you move your viewpoint to the light spot that you are moving on the display screen. In reality, the light spot can be placed below the character string (the viewpoint is slightly above the light spot), or whatever the user desires. Furthermore, according to the gist of the present application, in response to the reality that "even if one is not asleep, one often loses track of where one was looking", regardless of whether one is asleep or not, in response to the reality that one senses that "one has lost track of where one was looking", it becomes possible for the viewer to activate the recovery action activation means 160 and have the recovery action performed by the viewer's own action. It is also desirable to provide an initial state start function that allows the device of the present application to function from the beginning by setting the light spot to a desired position on the display surface while in use and pressing a "clear" button, etc., with the desired position as the starting point at any time. This is because, in particular, when the device operation cannot be achieved in the desired state, it may be better to start from the initial state.

[0028] FIG. 2 is a diagram showing an embodiment of the operation flow of the viewpoint position recovery device according to the present invention. 2-A shows the normal flow of "looking" when you are looking at the display surface normally. (a1) The display surface is photographed, and (a2) the light spot position within the display surface is calculated. It is preferable to obtain light spot position data in terms of relative coordinates with respect to the display surface frame or center position. (a3) The light spot position data is stored in a memory. Since old data can be overwritten and erased, the memory capacity can be small. (a4) When a person viewing the display surface continues to read, there is an artificial shift in the light spot. The above flow is repeated at appropriate time intervals. 2-B shows the recovery operation flow for restoring the light spot to the light spot position (reference light spot position) that the viewer was looking at before he or she became unclear about where they were looking due to suddenly falling asleep, etc. (b0) When the recovery operation is started, (b1) the display surface is photographed, and (b2) the light spot position on the display surface is calculated. In the calculation of the amount of recovery movement in (b3), a recovery movement amount Δ, which is the difference between the current light spot position after it becomes unclear which position was being viewed and the reference light spot position viewed before it became unclear, and the direction of the movement are calculated. Based on the direction of movement and the amount of recovery movement Δ, (b4) a recovery instruction is issued. (b5) A recovery completion judgment is made. If the amount of recovery movement Δ is within a desired range with the reference light point position as the center position, the flow returns to the normal flow. If not, (b6) the viewer moves the light point based on the recovery instruction, and the flow returns to (b1) and is repeated.

[0029] Fig. 3 is a diagram showing one embodiment of the recovery instruction operation by light points of the viewpoint position recovery device according to the present invention. As the operation of the recovery instruction means 180 which performs the recovery instruction (b4) of 2-B, for example, it is possible to instruct by voice "Please move 5 steps to the right and 8 steps up" and to say "OK" when the user moves within the range. Fig. 3 shows an example of the recovery instruction operation by various light points instead of voices. 3-A shows an example of a set of multiple light points (a set of 5). Here, one light point (for example, a light point from one LED) is shown in a square frame, and three are arranged vertically and horizontally to form a set of five light points. The more the number, the higher the expressiveness, but in this example, the vertical and horizontal configuration is kept to a minimum. In examples 1 to 3, the viewer is instructed that the reference light point position is to the right and upward, and is prompted to move the light point in that direction. In response to the instruction, the viewer moves the light point in the instructed direction. As it moves, it approaches the reference light point position, so the recovery movement amount Δ becomes smaller, and it is determined whether it has entered the desired range centered on the reference light point position, and instructions are given corresponding to each position until it enters the range. In example 1, for example, when the direction of movement is to the right, the light point moves repeatedly in the order 1 → 2 → 3 → 1 → 2 → 3, turning on (flashing) / off. In example 2, when the direction of movement is to the right, the light point is brightened and shaded in the order 1, 2, 3. In this case, for example, if you want to define a direction toward a brighter side, make the side of light spot 3 brighter. The viewer moves the light spot to the brighter side. In example 3, for example, to indicate that the direction of movement is to the right, light spot 2 is green and light spot 3 is red (flashing green). The viewer moves to the side of the red or flashing green. This can be said to be a light spot that can be distinguished from the current light spot placed on the recovery direction side as viewed from the current light spot position. In the figure, when the recovery movement amount Δ falls within the desired range of the reference light spot position, only 2 is turned on, but this is also an example, and the light spot returns to its normal state. Furthermore, each example is an example, and how it is determined is arbitrary. For example, in example 2, it may be defined as a movement in a dark direction, and in example 3, green and red may be reversed, or different colors may be used, as long as the viewer can distinguish by definition and move to recover the light spot as instructed.

[0030] 3-B An example using two-color light spots is shown. In Example 4, 1 is defined as green (horizontal direction) and 2 is defined as red (vertical direction), and the direction seems unclear, but the following mechanism gives the direction indirectly. That is, when the light spot is moved, the blinking becomes faster in the direction approaching the reference light spot position, and when the recovery movement amount Δ enters the desired range of the reference light spot position, the blinking stops and the light turns on. Therefore, the direction is given by the fact that the viewer only needs to move in the direction in which the blinking becomes faster. In this example, the definition of color or the difference in brightness (in this case, one light spot is sufficient, but it is somewhat difficult to make a clear judgment with brightness) can be used instead of the color, and it can be decided that the blinking becomes slower in the approaching direction, but instead, it is necessary to define it so that if the blinking is too slow, it does not affect the time the viewer waits for judgment. In the above, two different light spots are used, but it is also possible to use one. When the direction of movement for recovery is indicated only by light spots at 3-A and 3-B, it is possible to configure the light spot providing means 120 to have that function, or to configure it separately from the light spot providing means 120. In the example where 1 is green (horizontal direction) and 2 is red (vertical direction), two light spots are used, but one light spot is also possible, because the approach can be determined by the blinking speed, so the distinction between vertical and horizontal is not essential.

[0031] In 3-A and 3-B, the direction of movement for recovery was indicated using only a light spot, but in 3-C, it is done using one light source and a direction mark (transmitted light and a direction mark). Here, a small liquid crystal display (LCD) that only shows the direction mark and a projecting light source are used to form a light spot on the display surface using the direction mark. Direction marks and marks without directionality are electronically formed in any shape. It is also possible to mechanically provide a direction mark with different angles, but changing the shape of the direction mark requires a mechanical means for switching, and is not a viable solution. [Industrial Applicability]

[0032] As described above, the viewpoint position recovery device of the present invention does not require a display means for projecting a display surface, and can be used with display surfaces such as paper-based ones. It is small and simple enough to be mounted on the viewer's head, and can recover the light spot position seen before it became unclear, making it extremely convenient for industrial use.

[0033] 100 Viewpoint position recovery device 110 Control Means 120 Light spot providing means 130 Display surface photographing means 140 Light spot position calculation means within display surface 150 light spot position memory 160 Recovery action starting means 170 Recovery direction and recovery movement amount calculation method 180 Recovery instruction means 190 Head mounting means

Claims

1. A control means and a control device controlled by the control means. A light spot providing means provides a light spot indicating a viewer's viewpoint or its vicinity on a display surface, whether paper or electronic, a display surface photographing means photographs the display surface to which the light spot has been provided, a light spot position calculating means within the display surface for calculating the position of the light spot on the display surface, a light spot position memory for storing the calculated position of the light spot as data of a reference light spot position before it becomes unclear which position on the display surface the viewer was looking at, a recovery operation starting means for starting an operation to restore the current light spot position to the reference light spot position seen before it became unclear, and and a recovery direction / recovery movement amount calculation means for calculating a recovery movement amount Δ, which is the difference between the current light spot position and the reference light spot position calculated by photographing with the display surface photographing means and calculating with the light spot position calculation means within the display surface, by starting the recovery operation starting means after the current light spot position has been photographed by the display surface photographing means and the reference light spot position, and a recovery instruction means for giving an instruction including at least the recovery direction for moving the current light spot to recover the current light spot position to the reference light spot position based on the recovery direction and the recovery movement amount Δ, and determining whether the recovery movement amount Δ falls within a desired range centered on the reference light spot position.

2. 2. The viewpoint position recovery device according to claim 1, wherein said recovery instruction means provides said current light point with an expression function for giving an instruction including at least said recovery direction.

3. 3. The viewpoint position recovery device according to claim 2, wherein said light spot providing means has said representation function of said current light spot when said instruction including at least said recovery direction is given.

4. When the current light point having the expression function indicates the recovery direction, A group of multiple light points that light up or blink in an ordered sequence, or Or, it is a collection of multiple light points, and the light and shade are applied in the order of arrangement. Or, a light spot that can be distinguished from the current light spot is arranged on the recovery direction side as viewed from the position of the current light spot, Or, the blinking speed changes in the direction approaching the reference light point position, Is it due to the light emitted from the light source passing through the direction mark formed on the display surface? 4. The viewpoint position recovery device according to claim 2, wherein the viewpoint position recovery device is one of the above.

5. 2. The viewpoint position recovery device according to claim 1, wherein said recovery instruction means instructs said recovery direction and judges whether said viewpoint has entered said desired range and indicates the result of said judgment by voice.

6. 6. The viewpoint position recovery device according to claim 1, wherein the display surface light spot position calculation means calculates the relative position of the light spot with respect to an outer frame or a center point of the display surface.

7. 7. The viewpoint position recovery device according to claim 1, wherein the recovery operation starting means is started by actuation of a start switch which is an artificial action of the viewer.

8. The viewpoint position recovery device according to any one of claims 1 to 6, characterized in that the recovery action starting means is started by a signal obtained by photographing and detecting, by the display surface photographing means, an artificial action by the viewer, in which the current light point is moved outside the display surface and then brought back into the display surface.

9. The viewpoint position recovery device according to claim 8, characterized in that the device is started by being driven by a signal obtained by photographing and detecting, by the display surface photographing means, that the current light point is moved out of the display surface and then brought back into the display surface multiple times.

10. The viewpoint position recovery device according to claim 8 or claim 9, characterized in that the recovery action activation means is capable of setting as a judgment criterion the deviation of the current light point from the display surface to the side or upward and then back into the display surface, which is an artificial action of the viewer.

11. The viewpoint position recovery device according to any one of claims 1 to 10, further comprising a designation means for designating a desired time width before a current time or before a designated time, and acquiring data on the reference light point position existing within the time width designated by the designation means, and using the data on the reference light point position, calculating the recovery direction and the recovery movement amount Δ in the recovery direction / recovery movement amount calculation means.

12. 12. The viewpoint position recovery device according to claim 1, wherein, when the recovery position is determined to be the lowest position below the display surface, an upper light spot position other than the lowest position is set as the reference light spot position, and the recovery direction and recovery movement amount calculation means calculates the recovery direction and the recovery movement amount Δ using data on the reference light spot position, and instructs the recovery instruction means based on the calculation.

13. This applies regardless of the length of time it takes to recover. A viewpoint position recovery device as described in any one of claims 1 to 12, characterized in that a recovery switch is provided, and when the light spot caused by the viewer leaves the display surface and returns, the recovery switch is activated when the viewer leaves the display surface, so that the instruction to restore the light spot to the position it was at at the time of leaving is given.

14. The viewpoint position recovery device according to any one of claims 1 to 13, characterized in that a recording and playback means is provided, which records a message when the viewer stops watching, identifying and informing the viewer of the display surface related to the position of the light spot, and when the viewer returns to recover, the recorded message is played back, allowing the viewer to identify and confirm the display surface.

15. 15. The viewpoint position recovery device according to claim 1, further comprising head-mounted means integrally comprising at least said light spot providing means and said display surface photographing means.

Citation Information

Patent Citations

  • Line of sight tracing cursor moving device

    JP1990110622A

  • Camera provided with means for detecting line of sight

    JP1992149413A

  • Visual point position input device

    JP1992323715A

  • Touch panel correction device

    JP1997044310A

  • Viewpoint detection device and viewpoint detection method

    JP2015046111A

Cited By

  • Reading position notification device of electronic style

    JP2023118279A

  • Electronic style reading position notification device

    JP7769373B2