Display control apparatus and display control method

Abstract

To provide a display control device and a display control method capable of suitably controlling a display mode of an operation target object on a display unit in a form suitable for convenience of an operator.SOLUTION: A display unit configured to display an operation target object; a detection unit configured to detect, when a space based on the display unit is divided into a plurality of hierarchical spaces according to a distance from the display unit, in which of the plurality of hierarchical spaces an operation unit is located; A display mode changing unit configured to change a display mode of the operation target object on the display unit; and a display mode fixing unit configured to fix the display mode of the operation target object corresponding to a specific hierarchical space among the plurality of hierarchical spaces when a specific operation is performed by the operation unit in the specific hierarchical space.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a display control device and a display control method. [Background technology]

[0002] Patent Document 1 describes an electronic device including a display unit, a detection unit, a state determination unit, a position identification unit, and a display control unit. The display unit displays an image on a display surface. The detection unit detects a physical quantity that changes depending on the distance of an object from the display unit. The state determination unit determines, based on the physical quantity detected by the detection unit, whether the object is in a contact state in which the object is in contact with the display unit, a proximity state in which the object is located in an area less than a predetermined distance from the display unit, or a non-proximity state in which the object is located in an area more than a predetermined distance from the display unit. The position identification unit identifies the position of the object relative to the display unit in a direction along the display surface. When the state determination unit determines that the object is in a proximity state to the display unit, the display control unit enables the display unit to enlarge or reduce an image centered on the position of the object identified by the position identification unit, depending on the physical quantity detected by the detection unit.

[0003] When the state determination unit determines that the object is in a proximity state to the display unit, the display control unit enlarges the image when the distance of the object to the display unit decreases based on the physical quantity detected by the detection unit, and reduces the image when the distance of the object to the display unit increases based on the physical quantity detected by the detection unit. When the state determination unit determines that the object has transitioned from a proximity state to a contact state with the display unit, the display control unit maintains the size of the enlarged image. When the state determination unit determines that the object has transitioned from a contact state to a non-contact state with the display unit via a proximity state, the display control unit cancels the reduction of the image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 5650583 Summary of the Invention [Problem to be solved by the invention]

[0005] However, according to the inventor's intensive research, the prior art including Patent Document 1 has room for improvement in terms of suitably controlling the display mode of the object to be operated on the display unit in a manner that is convenient for the operator.

[0006] The present invention was completed based on the above-mentioned concerns, and aims to provide a display control device and a display control method that can suitably control the display mode of an object to be operated on a display unit in a manner that is convenient for the operator. [Means for solving the problem]

[0007] The display control device of this embodiment is characterized by having a display unit that displays an object to be operated, a detection unit that detects in which of the plurality of hierarchical spaces the operation unit is located when a space based on the display unit is divided into a plurality of hierarchical spaces according to the distance from the display unit, a display mode change unit that changes the display mode of the object to be operated on the display unit depending on which of the plurality of hierarchical spaces the operation unit is located, and a display mode fixation unit that fixes the display mode of the object to be operated corresponding to a specific hierarchical space when a specific operation is performed by the operation unit in a specific hierarchical space of the plurality of hierarchical spaces. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a display control device and a display control method that can suitably control the display mode of an operation target object on a display unit in a manner that is convenient for an operator. [Brief explanation of the drawings]

[0009] [Figure 1]1A to 1C are diagrams illustrating an example of each step of a display control device and a display control method according to the present embodiment. [Figure 2] 1 is a functional block diagram showing an example of the configuration of a display control device according to an embodiment of the present invention. [Figure 3] FIG. 2 is a functional block diagram showing an example of the configuration of a display control unit. [Figure 4] 10 is a flowchart illustrating an example of a display control process according to the present embodiment. [Figure 5] FIG. 2 is a diagram showing a first example of the relationship between a plurality of hierarchical spaces and magnification ratios in the display control device of the present embodiment. [Figure 6] FIG. 10 is a diagram showing a second example of the relationship between a plurality of hierarchical spaces and magnification ratios in the display control device of the present embodiment. [Figure 7] FIG. 10 is a diagram showing a third example of the relationship between a plurality of hierarchical spaces and magnification ratios in the display control device of the present embodiment. [Figure 8] FIG. 10 is a diagram showing a fourth example of the relationship between a plurality of hierarchical spaces and magnification ratios in the display control device of the present embodiment. [Figure 9] FIG. 3 is a diagram showing a first example of steps of a display control process according to the present embodiment. [Figure 10] FIG. 10 is a diagram showing a second example of steps of the display control process according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] <Definitions of terms, etc.> In this specification, the "operation target object" may mean an object that constitutes at least a part of an image displayed on the display unit (display surface) and is particularly noted as an operation target by an operator. For example, in a certain operation mode, a certain three-dimensional shape (3D model) is displayed on the display unit, and there may be a case where it is observed while changing the display mode of the three-dimensional shape (for example, magnification or reduction of the display magnification, change of color, addition or omission of components, etc.). In this case, the three-dimensional shape displayed on the display unit may correspond to the "operation target object". On the other hand, various information such as date and time, communication state, battery remaining amount, etc., and icons for setting applications and operation modes may be displayed on the display unit, but these may not be included in the "operation target object". The "operation target object" may be read as "option image" or "designated image".

[0011] In this specification, the "space based on the display unit" may mean, for example, the upper space of the display unit (display surface). When a rectangular display unit is placed horizontally and oriented in the vertical direction, a frame area may be defined by drawing a line vertically from the peripheral edge (outer peripheral edge) of the rectangular display unit, and the inside of the frame area may be defined as the "space based on the display unit".

[0012] In this specification, the "plurality of hierarchical spaces according to the distance from the display unit" may mean, for example, a first hierarchical space where the distance from the display unit (display surface) is 0 or more and less than A, a second hierarchical space where the distance from the display unit (display surface) is A or more and less than B, a third hierarchical space where the distance from the display unit (display surface) is B or more and less than C, and so on. A, B, and C may satisfy the relationship A < B < C, and the unit of distance may be cm. The first hierarchical space, the second hierarchical space, and the third hierarchical space are arranged in order from the side closer to the display unit (display surface) to the side farther away, and may be defined so that the boundaries of adjacent hierarchical spaces do not overlap.

[0013] In this specification, the term "operation unit" may refer to, for example, at least a part of the operator's hand (fingers, palm, or back of the hand). When a predetermined part of the operator's hand is positioned (held over) above the display unit (display surface) (a space based on the display unit), the predetermined part is positioned in one of the first to third level spaces (multiple level spaces according to the distance from the display unit), and its position information can be detected. This position detection can be performed based on (a change in) a physical quantity detected by a non-contact sensor, for example.

[0014] In this specification, "changing the display mode of the operation target object on the display unit" may mean, for example, increasing or decreasing the display magnification of the operation target object, changing the color, adding or omitting components, etc. Assume a case where the display magnification of the operation target object on the display unit is changed depending on whether the operation unit (a predetermined part of the operator's hand) is located in a first to third hierarchical space (multiple hierarchical spaces according to the distance from the display unit). In this case, the closer the operation unit is located in a hierarchical space (e.g., the first hierarchical space), the larger the display magnification of the operation target object on the display unit may be, and the farther the operation unit is located in a hierarchical space (e.g., the third hierarchical space), the smaller the display magnification of the operation target object on the display unit.

[0015] In this specification, "a specific operation by an operating unit in a specific hierarchical space of a plurality of hierarchical spaces" may broadly mean an operation based on an operator's expression of intent to fix (lock) the display mode (e.g., display magnification) of the object to be operated by the display unit when the operating unit (e.g., a specific part of the operator's hand) is located in the specific hierarchical space.

[0016] More specifically (in a narrower sense), the operation based on the intention may mean (waiting for) a predetermined time to elapse with the operation unit positioned in a specific hierarchical space. Alternatively, the operation based on the intention may mean drawing a pattern (e.g., an arc) once or multiple times with the operator's finger positioned in the specific hierarchical space, or drawing a predetermined character or symbol. What is important is that after positioning the operation unit in one of multiple hierarchical spaces and determining the target of the display mode of the operation target object, the operator remains in the specific hierarchical space without moving to another hierarchical space and performs the operation based on the intention to fix (lock) the target of the display mode of the operation target object.

[0017] <Conventional technical issues> For example, the electronic device of the above-mentioned Patent Document 1 enlarges or reduces images or objects according to height information (contact state, proximity state, non-proximity state) of the non-contact sensor.

[0018] However, the electronic device of Patent Document 1 described above has room for improvement in terms of suitably controlling the display mode of the operation target object on the display unit in a manner that is convenient for the operator.

[0019] For example, in the electronic device of Patent Document 1, the user can only see the zoom display while performing height manipulation. To stop zooming, the user must touch the screen or move away from the screen, and it is not possible to stop at an intermediate zoom ratio. For example, when the image or object is a map or drawing, it is desirable to operate it at an appropriate zoom ratio, but such flexible support is difficult. While it is possible to seamlessly combine height information and zoom ratio, this would result in fluctuations in the user's finger height and unstable zoom ratio.

[0020] As such, users want to be able to conveniently and flexibly change the display mode of the object to be operated that is displayed on the display unit, but once they have found the display mode that they have decided on, they do not want the display mode to be changed carelessly (unintentionally).However, conventional technologies, including the electronic device of Patent Document 1 mentioned above, have not been able to fully meet this demand.

[0021] <Technical Concept of the Invention> The inventors have considered the above-mentioned problems to be important technical challenges and have conducted extensive research to improve the operability of changing (e.g., enlarging or reducing) the display mode (e.g., display magnification) of the object to be operated on the display unit, and fixing (e.g., locking the display magnification), and as a result, have completed the present invention.

[0022] 1A, 1B, and 1C are diagrams showing an example of each step of a display control device and a display control method according to this embodiment. In the examples of Fig. 1A to 1C, a space based on a display unit (display surface) that displays an object to be operated is divided into three hierarchical spaces according to the distance (height) from the display unit, here a first hierarchical space, a second hierarchical space, and a third hierarchical space.

[0023] As shown in Fig. 1A, it is detected which of the first to third hierarchical spaces the operating unit (e.g., the operator's finger) is located in, and the display mode (e.g., display magnification) of the object to be operated on the display unit is changed according to the detection result. In Fig. 1A, the display magnification of the object to be operated is set to the highest when the operating unit is located in the first hierarchical space, the display magnification of the object to be operated is set to the second highest when the operating unit is located in the second hierarchical space, and the display magnification of the object to be operated is set to the lowest when the operating unit is located in the third hierarchical space. When the operating unit (e.g., the operator's finger) moves across adjacent hierarchical spaces, the display magnification of the object to be operated is changed, and the operator may be notified of this by audio and / or image.

[0024] 1B, when an operator wishes to fix (lock) the display magnification (medium) of an object to be operated corresponding to the second hierarchical space, the second hierarchical space is regarded as a "specific hierarchical space," and a "specific operation" is performed in the specific hierarchical space (second hierarchical space) using an operation unit (for example, the operator's finger). More specifically, the operator waits for a predetermined time to elapse while the operation unit (for example, the operator's finger) is positioned (held over) the specific hierarchical space (second hierarchical space).

[0025] When the specific operation in Fig. 1B is executed, the display mode of the operation target object corresponding to the specific hierarchical space (second hierarchical space), i.e., the display magnification (medium) of the operation target object corresponding to the specific hierarchical space (second hierarchical space), is fixed as shown in Fig. 1C. Then, while the display magnification (medium) of the operation target object remains fixed, subsequent operations such as a rotation operation can be executed.

[0026] In this way, the height information from the operator's fingers is divided into multiple layers, a magnification rate is set for each layer, and the magnification rate of the displayed image or object is changed by moving back and forth between layers.Then, by stopping the operator's fingers on each layer for a certain period of time, the magnification rate is fixed at that rate.

[0027] <Specific embodiment> The display control device and the display control method according to the present embodiment will be described in detail below with reference to the drawings. The display control method according to the present embodiment is realized by each component (including a computer) of the display control device according to the present embodiment executing various processing steps (including executing a program).

[0028] The display control device 10 may be, for example, a fixed (stationary) terminal or a mobile terminal (mobile communication terminal) such as a tablet terminal. The display control device 10 may also be a communication device capable of performing various types of communication with an external device (not shown). In this case, the display control device 10 may communicate with a network (such as the Internet) via, for example, a wired and / or wireless connection (e.g., Long Term Evolution (LTE), 5th Generation New Radio (5G NR), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.).

[0029] 2 is a functional block diagram showing an example of the configuration of a display control device 10 according to this embodiment. The display control device 10 has a display unit 11, an audio output unit 12, and a hand detection unit 13.

[0030] The display unit 11 can be configured by a display device such as a display or monitor that is described based on common understanding in the technical field related to the present invention. The display unit 11 displays images (including moving and still images), various information such as the date and time, communication status, and remaining battery power, and icons for setting applications and operation modes. In particular, the display unit 11 displays objects to be operated.

[0031] The audio output unit 12 can be configured by an output device such as a speaker that is explained based on common understanding in the technical field related to the present invention. The audio output unit 12 outputs various types of audio.

[0032] Although the details will be described later, the display unit 11 and the audio output unit 12 function as a "notification unit" that notifies the progress of a specific operation performed by the operation unit in a specific level space.

[0033] The hand and finger detection unit 13 detects an operation unit (e.g., an operator's fingers) located in a space relative to the display unit 11, for example, in the space above the display unit 11. The detection method used by the hand and finger detection unit 13 is flexible and various design modifications are possible. As an example, a detection method can be adopted that detects the operation unit (e.g., an operator's fingers) based on (a change in) a physical quantity detected by a non-contact sensor. As another detection method for the hand and finger detection unit 13, LiDAR (Light Detection and Ranging) can also be adopted. LiDAR is a remote sensing method that uses light, and can use a TOF (Time of Flight) method that measures the distance to an object from the time it takes for laser light emitted from a laser light source to be reflected by the object and return to a detector.

[0034] The display unit 11, the audio output unit 12, and the finger detection unit 13 are connected to the control unit 14. The control unit 14 has a touch control unit 15, a magnification control unit 16, and a display control unit 17. The touch control unit 15 has a position identification unit 15A and a height detection unit 15B. The magnification control unit 16 has a counter 16A and a magnification storage unit 16B.

[0035] The position identification unit 15A detects coordinates on the display unit 11. The position identification unit 15A identifies the position of the operation unit (for example, the operator's finger) relative to the display unit 11 in a direction along the display surface of the display unit 11. When a plurality of components including an operation target object are displayed on the display unit 11, and the position identification unit 15A detects that the operation unit (for example, the operator's finger) is located above (directly above) the operation target object, the operation target object may be selected, decided, or captured as a target for the display control processing of this embodiment.

[0036] The height detection unit 15B cooperates with the hand detection unit 13 to detect in which of the multiple level spaces the operating unit (e.g., the operator's fingers) is located when a space based on the display unit 11, for example, the space above the display unit 11, is divided into multiple level spaces according to the distance from the display unit 11. For example, the height detection unit 15B detects in which of the multiple level spaces the operating unit (e.g., the operator's fingers) is located based on (a change in) a physical quantity detected by a non-contact sensor. Applying the above-mentioned examples of FIGS. 1A to 1C, the height detection unit 15B detects in which of the first level space, the second level space, or the third level space the operating unit (e.g., the operator's fingers) is located.

[0037] When the height detection unit 15B detects that the operation unit (e.g., the operator's finger) is located in a "specific level space," which is one of the multiple level spaces (e.g., the first level space to the third level space), the counter 16A counts the elapsed time from the detection timing. The counter 16A completes (stops) counting the elapsed time when a predetermined time (several seconds, e.g., 2 or 3 seconds) has elapsed while the operation unit (e.g., the operator's finger) is located in the "specific level space." The counter 16A resets the count of the elapsed time (e.g., starts counting from zero again) when the operation unit (e.g., the operator's finger) moves to another level space (e.g., moves from one of the first level space to the third level space) before the predetermined time (several seconds, e.g., 2 or 3 seconds) has elapsed while the operation unit (e.g., the operator's finger) is located in the "specific level space."

[0038] The magnification ratio storage unit 16B stores the magnification ratio (display magnification) of the image displayed on the display unit 11, particularly the magnification ratio (display magnification) of the operation target object. As will be described later, in a state in which the display magnification ratio can be changed, the magnification ratio (display magnification) of the operation target object varies depending on in which of the multiple hierarchical spaces (first to third hierarchical spaces) the operation unit (for example, the operator's finger) is located. The magnification ratio storage unit 16B stores the magnification ratio (display magnification) of the operation target object corresponding to each of the multiple hierarchical spaces (first to third hierarchical spaces).

[0039] The display control unit 17 controls the display of images, particularly the operation target object, displayed on the display unit 11. Fig. 3 is a functional block diagram showing an example of the configuration of the display control unit 17. The display control unit 17 has a display magnification change unit (display mode change unit) 17A, a display magnification fix unit (display mode fix unit) 17B, and a rotation operation control unit (subsequent operation control unit) 17C.

[0040] The display magnification changing unit 17A changes the display mode of the operation target object on the display unit 11 depending on which of the multiple hierarchical spaces (e.g., first to third hierarchical spaces) the operation unit (e.g., the operator's finger) is located in. More specifically, the display magnification changing unit 17A changes the display magnification of the operation target object on the display unit 11 depending on which of the multiple hierarchical spaces (e.g., the first to third hierarchical spaces) the operation unit (e.g., the operator's finger) is located in.

[0041] For example, the display magnification change unit 17A increases the display magnification of the object to be operated on the display unit 11 when the operating unit (e.g., the operator's finger) is located in a hierarchical space (e.g., the first hierarchical space) closer to the display unit 11 among multiple hierarchical spaces (e.g., the first hierarchical space to the third hierarchical space), and decreases the display magnification of the object to be operated on the display unit 11 when the operating unit (e.g., the operator's finger) is located in a hierarchical space (e.g., the third hierarchical space) farther from the display unit 11.

[0042] Conversely, the display magnification change unit 17A may decrease the display magnification of the object to be operated on the display unit 11 as the operating unit (e.g., the operator's finger) is located in a hierarchical space (e.g., the first hierarchical space) closer to the display unit 11 among multiple hierarchical spaces (e.g., the first hierarchical space to the third hierarchical space), and increase the display magnification of the object to be operated on the display unit 11 as the operating unit (e.g., the operator's finger) is located in a hierarchical space (e.g., the third hierarchical space) farther from the display unit 11.

[0043] When a "specific operation" is performed by an operation unit (e.g., an operator's finger) in a "specific hierarchical space" of a plurality of hierarchical spaces (e.g., the first to third hierarchical spaces), the display magnification fixing unit 17B fixes the display mode of the object to be operated corresponding to the specific hierarchical space, i.e., the display magnification of the object to be operated changed by the display magnification changing unit 17A.

[0044] More specifically, when a predetermined time (several seconds, for example, 2 or 3 seconds) has elapsed while the operation unit (for example, the operator's finger) is positioned (held over) a "specific hierarchical space" among multiple hierarchical spaces (for example, the first to third hierarchical spaces), the display magnification fixing unit 17B fixes the display mode, i.e., the display magnification, of the object to be operated corresponding to the specific hierarchical space.

[0045] After the display magnification of the operation target object is fixed by display magnification fixing unit 17B, when a subsequent operation, that is, a rotation operation, is performed by the operation unit (e.g., the operator's finger), regardless of which of the multiple hierarchical spaces (e.g., the first to third hierarchical spaces) the operation unit (e.g., the operator's finger) is located in, rotation operation control unit 17C keeps the display magnification of the operation target object fixed and performs the subsequent operation, that is, a rotation operation, on display unit 11. The rotation operation (subsequent operation) by rotation operation control unit 17C may be valid as long as the operation unit (e.g., the operator's finger) is detected by hand detection unit 13.

[0046] When the rotation operation control unit 17C is considered as a "subsequent operation control unit" that is not limited to rotation operations, the subsequent operation control unit causes the operation target object to be subsequently operated on the display unit 11 while keeping the display magnification (display mode) of the operation target object fixed, when a subsequent operation is performed by the operation unit (for example, the operator's finger), regardless of which of a plurality of hierarchical spaces (for example, the first to third hierarchical spaces) the operation unit (for example, the operator's finger) is located in. The subsequent operation may include, in addition to the rotation operation, various operations such as sliding (translating) the operation target object in a direction along the display surface of the display unit 11, changing the color of the operation target object, and adding or omitting components.

[0047] The display unit 11 and the audio output unit 12 as the notification unit may notify the progress of a specific operation by the operation unit (e.g., the operator's finger) in a "specific hierarchical space" of one of the multiple hierarchical spaces (e.g., the first to third hierarchical spaces). For example, the display unit 11 may output a display and / or the audio output unit 12 may output an audio to notify the operator of the remaining time (countdown) until a predetermined time (several seconds, for example, 2 or 3 seconds) has elapsed while the operation unit (e.g., the operator's finger) is positioned (held) over a "specific hierarchical space" of one of the multiple hierarchical spaces (e.g., the first to third hierarchical spaces). In addition, the display unit 11 may output a display and / or the audio output unit 12 may output an audio to notify the operator that the display magnification of the object to be operated corresponding to the specific hierarchical space has been fixed and that the operator is prompted to proceed to a subsequent operation, for example, a rotation operation. Furthermore, when an object (including the operation unit) approaches the display unit 11 and becomes closer than a threshold distance during the zoom operation of the image (object to be operated) by the display magnification fixing unit 17B, a warning (alarm) may be displayed and / or output as sound. In other words, when a predetermined threshold distance is set for a position close to the display unit 11, the display unit 11 and the sound output unit 12 may function as a "warning unit" that issues a warning (visual warning and / or sound warning) to the operator when the operation unit (for example, the operator's finger) and / or other object is located within the predetermined threshold distance from the display unit 11.

[0048] FIG. 4 is a flowchart showing an example of the display control process according to this embodiment.

[0049] In step ST1, the user is notified that the enlargement / reduction mode, which is the display control process according to this embodiment, has started. This notification may be made via at least one of the display unit 11 and the audio output unit 12.

[0050] In step ST2, the operation target object is displayed at the set magnification, that is, at the display magnification corresponding to the hierarchical space (specific hierarchical space) where the operation unit (for example, the operator's finger) is positioned.

[0051] In step ST3, a counter is started, that is, measurement of the elapsed time from the time when it is detected that the operating unit (for example, the operator's finger) is located in one of the hierarchical spaces (specific hierarchical space) is started.

[0052] In step ST4, it is determined whether the magnification (display magnification) of the object to be operated displayed on the display unit 11 has changed. That is, it is determined whether the operating unit (for example, the operator's finger) that was located in one hierarchical space has moved to another hierarchical space. If the magnification (display magnification) of the object to be operated has changed (if the operating unit has moved across hierarchical spaces) (step ST4: Yes), the process proceeds to step ST5, where the user is notified that the magnification (display magnification) of the object to be operated displayed on the display unit 11 has changed. Thereafter, the process returns to step ST3, and the counter is started (time measurement is started again from zero seconds).

[0053] If the magnification ratio (display magnification) of the object to be operated has not changed (step ST4: No), the process proceeds to step ST6, where it is determined whether a predetermined time (several seconds, for example, 2 or 3 seconds) has elapsed. If the predetermined time (several seconds, for example, 2 or 3 seconds) has not elapsed (step ST6: No), the process returns to step ST4, where it is determined whether the magnification ratio (display magnification) of the object to be operated displayed on the display unit 11 has changed. In this way, the determinations of step ST4 and step ST6 are executed simultaneously (in parallel).

[0054] If the magnification (display magnification) of the object to be operated displayed on the display unit 11 does not change, i.e., if a predetermined time (several seconds, for example, 2 or 3 seconds) has passed while the operating unit (e.g., the operator's fingers) remains in a single specific hierarchical space (step ST4: No, step ST6: Yes), proceed to step ST7, where the magnification (display magnification) of the object to be operated displayed on the display unit 11 is confirmed (fixing, locking the display magnification).

[0055] In step ST8, the user is notified that the enlargement / reduction mode, which is the display control process according to this embodiment, has ended. This notification may be made via at least one of the display unit 11 and the audio output unit 12.

[0056] In this way, the height from the display unit (display surface) is divided into layers, and the magnification rate is set according to each area. In addition, when it is detected that the user's fingers have moved between layers, information about the area of ​​the fingers is notified. In addition, the object to be operated is displayed at a magnification rate according to the notified area. When the user's fingers remain in each area for a certain period of time, that magnification rate is determined (fixed). When the magnification mode is started and ended, and when the magnification rate is changed, the user is notified by display and / or audio. After the magnification mode is ended, the user can perform subsequent operations (e.g., rotation operation) while maintaining the determined magnification rate.

[0057] 5 is a diagram showing a first example of the relationship between a plurality of hierarchical spaces and magnification ratios (display magnification ratios) in the display control device of this embodiment. In the first example of FIG. 5, use of a 12-inch display may be assumed.

[0058] 5, the area within a distance (height) of 5d from the display unit (display surface) is the detectable distance (detectable height) by the detection unit, and the area beyond a distance (height) of 5d from the display unit (display surface) is the undetectable distance (undetectable height) by the detection unit. In other words, the position where the distance (height) from the display unit (display surface) is 5d is the maximum non-contact detection height (detection is possible up to that line, but undetectable beyond that line).

[0059] In FIG. 5, in hierarchical spaces whose distance (height) from the display unit (display surface) is 0 to 2d, the magnification rate (display magnification) of the object to be operated is set to 150%. In hierarchical spaces whose distance (height) from the display unit (display surface) is 2d to 3d, the magnification rate (display magnification) of the object to be operated is set to 125%. In hierarchical spaces whose distance (height) from the display unit (display surface) is 3d to 4d, the magnification rate (display magnification) of the object to be operated is set to 100%. In hierarchical spaces whose distance (height) from the display unit (display surface) is 4d to 5d, the magnification rate (display magnification) of the object to be operated is set to 75%. By making the distance (height) of the hierarchical space closest to the display unit (display surface) the longest (the other hierarchical spaces are 1d, while the hierarchical space closest to the display unit is 2d), it is possible to prevent the operation unit (for example, the operator's finger) from accidentally coming into contact with the display unit (display surface).

[0060] 6 is a diagram showing a second example of the relationship between a plurality of hierarchical spaces and magnification ratios (display magnification ratios) in the display control device of this embodiment. In the second example of FIG. 6, use of a 12-inch display may be assumed.

[0061] The second example in Fig. 6 is basically the same as (common to) the first example in Fig. 5, so a duplicated description will be omitted. The second example in Fig. 6 differs from the first example in Fig. 5 in that, while maintaining a hierarchical space (magnification rate 150%) with a distance (height) of 0 to 2d from the display unit (display surface), a closest approach threshold is set at a position where the distance (height) from the display unit (display surface) is d, and when the operating unit (e.g., the operator's finger) approaches the display unit (display surface) beyond the closest approach threshold (when it is between 0 and d), a notification (warning) is issued by voice and / or image. This makes it possible to more reliably prevent the operating unit (e.g., the operator's finger) from accidentally coming into contact with the display unit (display surface).

[0062] 7 is a diagram showing a third example of the relationship between multiple hierarchical spaces and magnification ratios (display magnification ratios) in the display control device of this embodiment. The detectable distance (detectable height) and undetectable distance (undetectable height) based on the maximum non-contact detectable height are the same (common) as those in the first and second examples of FIGS. 5 and 6, and therefore a duplicated explanation will be omitted.

[0063] In FIG. 7, in hierarchical spaces where the distance (height) from the display unit (display surface) is 0 to 0.5d, the magnification ratio (display magnification) of the operation target object is set to 200%. Furthermore, in hierarchical spaces where the distance (height) from the display unit (display surface) is 0.5d to 1d, the magnification ratio (display magnification) of the operation target object is set to 175%. Furthermore, in hierarchical spaces where the distance (height) from the display unit (display surface) is 1d to 1.6d, the magnification ratio (display magnification) of the operation target object is set to 150%. Furthermore, in hierarchical spaces where the distance (height) from the display unit (display surface) is 1.6d to 2.3d, the magnification ratio (display magnification) of the operation target object is set to 125%. Furthermore, in hierarchical spaces where the distance (height) from the display unit (display surface) is 2.3d to 3d, the magnification ratio (display magnification) of the operation target object is set to 110%. In addition, in hierarchical spaces where the distance (height) from the display unit (display surface) is 3d to 4d, the magnification rate (display magnification) of the operation target object is set to 100%, and in hierarchical spaces where the distance (height) from the display unit (display surface) is 4d to 5d, the magnification rate (display magnification) of the operation target object is set to 75%.

[0064] For example, in the case of a touch panel equipped with a non-contact sensor, the accuracy of height tends to decrease the further away from the display unit (display surface). Therefore, it is desirable to gradually widen the height area as you move from the closer to the display unit (display surface) to the farther away from the display unit (display surface). In this case, it is acceptable for the operating unit (e.g., the operator's finger) to contact the display unit (display surface) while adjusting the magnification ratio (display magnification). Also, it is desirable to set the time until the magnification ratio is determined (the predetermined time for the operating unit to remain in a specific level space) to about 2 seconds (because if it were 3 seconds, it would be somewhat difficult to hold the operating unit in a specific level space located at a distance of 0.5d closer to the display unit).

[0065] 8 is a diagram showing a fourth example of the relationship between a plurality of hierarchical spaces and magnification ratios (display magnification ratios) in the display control device of this embodiment. The detectable distance (detectable height) and undetectable distance (undetectable height) based on the maximum non-contact detectable height are the same (common) as those in the first to third examples of FIGS. 5 to 7, and therefore a duplicated explanation will be omitted.

[0066] 8, in the hierarchical space where the distance (height) from the display unit (display surface) is 0 to 2.5d, the magnification ratio (display magnification) of the operation target object is set to 150%, and in the hierarchical space where the distance (height) from the display unit (display surface) is 2.5d to 5d, the magnification ratio (display magnification) of the operation target object is set to 100%.

[0067] In the fourth example of Fig. 8, multiple floor spaces (height ranges) are divided into two, and the division height is set to 2.5d, which is half of the maximum non-contact detection height of 5d. For example, in the case of a floating display, multiple floor spaces (height ranges) may be divided above and below the height of the floating image. The time until the magnification ratio is determined (the predetermined time for the operating unit to remain in a specific floor space) is preferably about 2 to 3 seconds.

[0068] In the first to fourth examples of FIGS. 5 to 8, the symbol "d" indicates a predetermined unit of length (distance, height), and may be read as cm.

[0069] 9A to 9D are diagrams showing a first example of steps in the display control process according to this embodiment. In Fig. 9A to 9D, a three-dimensional cubic model is depicted as the operation target object.

[0070] As shown in FIG. 9A , by touching a corresponding location on the display unit (display surface), a zoom mode, which is a display control process according to this embodiment, may be selectable between mode A and mode B. For example, mode A may be a conventional zoom mode, such as a mode in which the zoom ratio (display magnification) of a target object is changed by manually inputting a number or by operating a slide or rotary operation button (including physical and electronic buttons). mode B may be a mode incorporating a display zoom ratio manipulation system based on non-contact operation according to this embodiment. The following description is based on the assumption that mode B, which incorporates a display zoom ratio manipulation system based on non-contact operation according to this embodiment, is selected (in FIGS. 9B to 9D , the icon for mode B is depicted with a grayscale background to indicate that mode B is selected).

[0071] 9B to 9D, during operation in mode B, a cube (three-dimensional model) that is the object to be operated is displayed near the center of the display unit (display surface), and to the right of it, a display notification model is displayed that notifies whether the operating unit (for example, the operator's finger) is located in the first, second, or third hierarchical space. In addition to or instead of this display notification model, a mechanism may be provided that notifies by voice whether the operating unit (for example, the operator's finger) is located in the first, second, or third hierarchical space.

[0072] In FIG. 9B, the operating unit (for example, the operator's finger) is located in the second hierarchical space, and the magnification ratio (display magnification) of the cube (three-dimensional model) that is the object to be operated is the middle (second) of three levels. In FIG. 9C, the operating unit (for example, the operator's finger) is located in the first hierarchical space, and the magnification ratio (display magnification) of the cube (three-dimensional model) that is the object to be operated is the maximum (first) of three levels. In FIG. 9D, the operating unit (for example, the operator's finger) is located in the third hierarchical space, and the magnification ratio (display magnification) of the cube (three-dimensional model) that is the object to be operated is the minimum (third) of three levels. The operator moves the operating unit (for example, the operator's finger) back and forth between the first hierarchical space, the second hierarchical space, and the third hierarchical space to find a desirable magnification ratio (display magnification) of the cube (three-dimensional model) that is the object to be operated. That is, it is determined in which state of FIGS. 9B to 9D the magnification rate (display magnification rate) of the cube (three-dimensional model) that is the object to be operated is desired to be fixed (locked).

[0073] 10A to 10D are diagrams showing a second example of steps in the display control process according to this embodiment. Here, the description will be given assuming that the magnification ratio (display magnification) of the cube (three-dimensional model), which is the object to be operated, is fixed (locked) in the state of FIG.

[0074] As shown in FIG. 10A, when the operating unit (e.g., the operator's finger) is positioned (held) over the third-level space, the time spent in the third-level space begins to be counted. At the same time, a display notification model is displayed below the object to be operated, indicating the progress of the counted time until it reaches a predetermined time (several seconds, e.g., 2 or 3 seconds). The display transitions to FIG. 10C via FIG. 10A and FIG. 10B. When the counted time reaches the predetermined time (several seconds, e.g., 2 or 3 seconds), the magnification (display magnification) of the cube (three-dimensional model), which is the object to be operated, is locked. Instead of or in addition to the display notification model, a countdown audio output, for example, "3, 2, 1, 0," may be output. Furthermore, as shown in FIG. 10D, a message may be displayed above the object to be operated, stating, "The display magnification of the object to be operated has been locked. Please perform a subsequent operation, such as a rotation operation." (Instead of or in addition to this message, an audio output to that effect may also be output.)

[0075] The display control device of this embodiment includes a display unit that displays an operation target object, a detection unit that detects which of the plurality of hierarchical spaces the operation unit is located in when a space based on the display unit is divided into a plurality of hierarchical spaces according to distances from the display unit, a display mode change unit that changes a display mode of the operation target object on the display unit depending on which of the plurality of hierarchical spaces the operation unit is located in, and a display mode fixation unit that fixes the display mode of the operation target object corresponding to a specific hierarchical space when a specific operation is performed by the operation unit in the specific hierarchical space of the plurality of hierarchical spaces. This makes it possible to suitably control the display mode of the operation target object on the display unit in a manner that is convenient for the operator.

[0076] The display control device and display control method of this embodiment have the following advantages over the display control method described in Patent Document 1: The display mode (display magnification) of the object to be operated is changed or fixed without using (assuming) the state of contact with the display unit, thereby preventing the display unit from becoming dirty or damaged. The display mode (display magnification) is changed or fixed based on multiple adjacent hierarchical spaces (several levels, for example, single-digit levels are practical), rather than being changed or fixed in a stepless (seamless) manner. This prevents problems (noise) caused by the operator's finger tremors. The method of fixing the magnification rate involves waiting for a predetermined time while the operator's finger is positioned in a specific hierarchical space, which simplifies operation for the operator and allows the operator to set an appropriate ergonomic time. The process from changing the magnification rate to fixing it is notified (visually and audibly), improving operability for the operator.

[0077] The display control device and display control method of this embodiment relate to, for example, a display magnification / reduction ratio manipulation system based on non-contact operation. More specifically, they relate to improving operability in a display using a non-contact sensor, and further to a user interface for changing or fixing the display magnification of image data (object to be manipulated) according to height information from the non-contact sensor.

[0078] The present invention is not limited to the above-described embodiments, and various modifications can be made in the implementation stage without departing from the spirit of the invention. Furthermore, the embodiments may be implemented in appropriate combinations, in which case the combined effects can be obtained. Furthermore, the above-described embodiments include various inventions, and various inventions can be extracted by combining selected elements from the disclosed elements. For example, if the problem can be solved and the desired effect can be obtained even if some elements are deleted from all elements shown in the embodiments, the configuration from which these elements are deleted can be extracted as an invention. [Explanation of symbols]

[0079] 10 Display control device 11 Display unit (notification unit, warning unit) 12 Audio output unit (notification unit, warning unit) 13 Finger detection unit (detection unit) 14 Control Unit 15 Touch control section 15A Position identification part 15B Height detection unit (detection unit) 16 Magnification control section 16A Counter 16B Enlargement ratio memory section 17 Display control unit 17A Display magnification change section (display mode change section) 17B Display magnification fixing part (display mode fixing part) 17C Rotation operation control section (subsequent operation control section)

Claims

1. a display unit that displays an object to be operated; a detection unit that detects in which of the plurality of hierarchical spaces the operation unit is located when a space based on the display unit is divided into a plurality of hierarchical spaces according to distances from the display unit; and a display mode change unit that changes a display mode of the operation target object on the display unit depending on which of the plurality of hierarchical spaces the operation unit is located in; a display mode fixing unit that fixes a display mode of the operation target object corresponding to a specific hierarchical space of the plurality of hierarchical spaces when a specific operation is performed by the operation unit in the specific hierarchical space; A display control device comprising:

2. the display mode change unit increases the display magnification of the operation target object on the display unit as the operation unit is located in a hierarchical space closer to the display unit among the plurality of hierarchical spaces, and decreases the display magnification of the operation target object on the display unit as the operation unit is located in a hierarchical space farther from the display unit; 2. The display control device according to claim 1.

3. the display mode fixing unit fixes the display mode of the operation target object corresponding to the specific hierarchical space when a predetermined time has elapsed with the operation unit positioned in the specific hierarchical space; 2. The display control device according to claim 1.

4. the display mode change unit increases the display magnification of the operation target object on the display unit as the operation unit is located in a hierarchical space closer to the display unit among the plurality of hierarchical spaces, and decreases the display magnification of the operation target object on the display unit as the operation unit is located in a hierarchical space farther from the display unit; the display mode fixing unit fixes the display magnification of the operation target object corresponding to the specific hierarchical space when a predetermined time has elapsed with the operation unit positioned in the specific hierarchical space; 2. The display control device according to claim 1.

5. a subsequent operation control unit that, when a subsequent operation is performed by the operation unit, causes the operation target object to be subsequently operated on the display unit while keeping the display magnification of the operation target object fixed, regardless of in which of the plurality of hierarchical spaces the operation unit is located; 5. The display control device according to claim 4.

6. a notification unit that notifies a progress of the specific operation performed by the operation unit in the specific level space; 2. The display control device according to claim 1.

7. The device further includes a warning unit that issues a warning to an operator when the operation unit and / or another object is located within a range of the predetermined threshold distance from the display unit when a predetermined threshold distance is set at a position close to the display unit.

2. The display control device according to claim 1.

8. the detection unit has a non-contact sensor that detects in which of the plurality of floor spaces the operation unit is located; 2. The display control device according to claim 1.

9. The operation unit includes an operator's hand.

2. The display control device according to claim 1.

10. displaying an operation target object on a display unit; a step of dividing a space based on the display unit into a plurality of hierarchical spaces according to distances from the display unit, and detecting in which of the plurality of hierarchical spaces the operation unit is located; changing a display mode of the operation target object on the display unit depending on which of the plurality of hierarchical spaces the operation unit is located in; a step of fixing a display mode of the operation target object corresponding to a specific hierarchical space of the plurality of hierarchical spaces when a specific operation is performed by the operation unit in the specific hierarchical space; A display control method comprising:

Images