Electronic device, method for controlling electronic device, and storage medium
The electronic device efficiently manages power consumption by using a projection and detection system to switch between power-saving and normal modes based on user interactions, addressing unnecessary power usage and configuration complexity in aerial displays.
Patent Information
- Application Number
- JP2024131925
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-08
- Publication Date
- 2026-02-20
AI Technical Summary
Existing electronic devices with aerial displays face issues of unnecessary power consumption when the display is continuously formed, and existing gesture detection methods complicate the configuration and lead to unnecessary mode transitions.
An electronic device with a projection unit for forming aerial images, a detection unit for non-contact operation recognition, and a control unit that allows switching between power-saving and normal modes based on user interactions, using a simple configuration without the need for additional sensors.
Enables efficient power management by allowing contactless switching between power-saving and normal modes, reducing unnecessary power consumption and simplifying the device configuration.
Smart Images

Figure 2026029170000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an electronic device, a control method for an electronic device, and a program. [Background technology]
[0002] Aerial display technology has been known for some time, combining images in the air to form an aerial display. Gesture detection technology that detects human gestures is also known. Combining aerial display technology with gesture detection technology makes it possible to make a touch panel display appear to float in the air. A touch panel display floating in the air does not require touching an actual touch panel to operate it. Therefore, when multiple users use a touch panel display floating in the air, for example, it can reduce the risk of infection between users and prevent dirt from adhering to the touch panel display even if the users' fingers are dirty. Patent Document 1 discloses an electronic terminal that forms an aerial display and can use the aerial display as an input / output device. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-117247 Summary of the Invention [Problem to be solved by the invention]
[0004] In a device capable of forming an aerial display, for example, if the aerial display continues to be formed and displayed even when the user is not using the device, power consumption is wasted. To reduce this wasteful power consumption, the device can be switched to a power-saving mode, which stops the formation of the aerial display. Switching from the power-saving mode to a normal mode, in which the aerial display is formed, is performed by a user pressing a button. This button operation is performed by the user's fingertip touching and pressing the button, thereby compromising the benefits of the aerial display, such as reducing the risk of infection and preventing dirt from adhering. Furthermore, even if a user attempts to switch modes using gesture detection technology, the power-saving mode stops the formation of the aerial display, making it difficult to determine the gesture detection area. In the electronic device described in Patent Document 1, switching to a normal mode, in which the aerial display is formed, is performed by a sensor that detects a user approaching the electronic device. However, the need for a sensor to detect the user complicates the configuration. Furthermore, since the sensor that detects users detects any user who approaches the electronic terminal, every time a user is detected, the electronic terminal switches to normal mode regardless of whether or not switching to normal mode is necessary.
[0005] The present invention has been made in view of the above-mentioned problems. It is an object of the present invention to provide an electronic device that can switch between a first mode in which power consumption is reduced and a second mode in which power consumption reduction is released, as needed, in a contactless manner with a simple configuration. Similarly, it is an object of the present invention to provide a control method and program for an electronic device that can switch between the first mode in which power consumption is reduced and a second mode in which power consumption reduction is released, as needed, in a contactless manner with a simple configuration. [Means for solving the problem]
[0006] In order to achieve the above-mentioned object, the electronic device of the present invention is an electronic device comprising: a projection means for projecting an image into the air to form an aerial image; a detection means for non-contact detection of operations on the aerial image; and a control means for controlling the projection means and the detection means, wherein the electronic device comprises a switching operation means arranged within a detection range in which operations on the aerial image can be detected by the detection means, and which performs an operation to switch between a first mode in which power consumption consumed by the electronic device is reduced and a second mode in which the power consumption reduction is lifted, and wherein the control means, in the first mode, stops the formation of the aerial image by the projection means and puts the electronic device in a state in which operations on the switching operation means can be detected non-contact by the detection means. [Effects of the Invention]
[0007] According to the present invention, the operation of switching between the first mode in which power consumption is reduced and the second mode in which power consumption reduction is released can be performed contactlessly as needed with a simple configuration. [Brief explanation of the drawings]
[0008] [Figure 1] 1 is a block diagram showing an example of a hardware configuration of an electronic device according to a first embodiment. [Figure 2A] FIG. 10 is a diagram illustrating switching between a normal mode and a power-saving mode in an electronic device. [Figure 2B] 3A and 3B are diagrams illustrating the states of a printing unit, a reading unit, an output unit, and an input unit in a normal mode and a power saving mode. [Figure 3] FIG. 2 is a side view of the input section and the output section in the normal mode, as viewed from the side of the output section (display). [Figure 4] 10 is a side view of the input unit and the output unit in a power saving mode, seen from the side of the output unit (display). FIG. [Figure 5] FIG. 2 is a plan view of the input section and the output section in the normal mode, viewed from above the output section (display). [Figure 6]FIG. 2 is a plan view of the state of the input unit and the output unit in the power saving mode, as viewed from above the output unit (display). [Figure 7] 10 is a flowchart illustrating a process executed by the electronic device in a normal mode. [Figure 8] 10 is a flowchart illustrating a process executed by the electronic device in a power saving mode. [Figure 9A] FIG. 11 is a diagram illustrating switching between a normal mode and a power-saving mode in the electronic device according to the second embodiment. [Figure 9B] 10A and 10B are diagrams illustrating the states of a printing unit, a reading unit, an output unit, and an input unit in each of a normal mode, a first power saving mode, and a second power saving mode. [Figure 10] FIG. 10 is a plan view of the input and output units in the second power saving mode, as viewed from above the output unit (display). [Figure 11] 10 is a flowchart illustrating a process executed by the electronic device in a normal mode. [Figure 12] 10 is a flowchart illustrating a process executed by the electronic device in a power saving mode. DETAILED DESCRIPTION OF THE INVENTION
[0009] Each embodiment of the present invention will be described in detail below with reference to the drawings. However, the configurations described in each of the following embodiments are merely examples, and the scope of the present invention is not limited to the configurations described in each embodiment. For example, each component constituting the present invention can be replaced with any configuration that can perform the same function. Also, any component may be added. Furthermore, any two or more configurations (features) of each embodiment can be combined.
[0010] First Embodiment A first embodiment will be described below with reference to FIGS. 1 to 8. FIG. 1 is a block diagram showing an example of the hardware configuration of an electronic device according to the first embodiment. In this embodiment, a case where the electronic device is applied to an image forming apparatus will be described as an example. Note that the device to which the electronic device can be applied is not limited to an image forming apparatus, and may be, for example, a kiosk terminal or a medical device. As shown in FIG. 1, the electronic device 100 includes a control unit (control means) 110, an input unit 116, an output unit 118, a printing unit 120, and a reading unit 122. The control unit 110 controls the overall operation of the electronic device 100 (control process). The control unit 110 includes a CPU 111, a ROM 112, a RAM 113, a storage 114, an input unit I / F 115, an output unit I / F 117, a printing unit I / F 119, a reading unit I / F 121, and a communication unit I / F 123.
[0011] The CPU 111 is a computer that reads out control programs stored in the ROM 112 or the storage 114 and performs various controls such as reading control and printing control. The control programs include, for example, programs that cause the CPU 111 to execute each unit and each means (control method of the electronic device) of the electronic device 100. The ROM 112 stores control programs executable by the CPU 111. The ROM 112 also stores a boot program, font data, and the like. The RAM 113 is the main storage memory of the CPU 111. This RAM 113 is used as a work area and as a temporary storage area for expanding the various control programs stored in the ROM 112 and the storage 114. The storage 114 stores various programs and various setting information. In this embodiment, a flash memory is used as the storage 114, but this is not limited thereto, and an auxiliary storage device such as an SSD, HDD, or eMMC may also be used. In the present embodiment, the control unit 110 executes the control program using one CPU 111 and one memory (such as the RAM 113), but is not limited to this. For example, multiple CPUs 111 may execute the control program using multiple memories.
[0012] The input unit I / F is connected to the input unit 116. The input unit I / F is responsible for transmitting control commands from the CPU 111 to the input unit 116 and transmitting input signals from the input unit 116 to the CPU 111. The input unit 116 is an aerial sensor that detects user operations in the air, i.e., a detection means that detects operations on the aerial image formed by the output unit 118 in a non-contact manner. In the present embodiment, for example, a sensor that uses infrared rays to identify the XY coordinates of an operation performed by the user on a plane is used as the input unit 116. However, the input unit 116 is not limited to this, and for example, a sensor that can detect a user's gesture may be used. The output unit I / F 117 is connected to the output unit 118. The output unit I / F 117 is responsible for transmitting output information from the CPU 111 to the output unit 118. The output unit 118 is a display equipped with an aerial imaging mechanism, i.e., a projection means that projects an image into the air to form an aerial image.
[0013] The printing unit I / F 119 is connected to the printing unit 120. The CPU 111 transfers image data to be printed, i.e., image data to be printed, to the printing unit 120 via the printing unit I / F 119. The printing unit 120 prints the image data on recording paper fed from a paper feed cassette (not shown). The reading unit I / F 121 is connected to the reading unit 122. The reading unit 122 reads an image on a document and converts the image data into binary data or the like. The image data generated by the reading unit 122 is, for example, transmitted to an external device, stored in an external recording device, or printed on recording paper. The communication unit I / F 123 is connected to the network 102. The communication unit I / F 123 is responsible for transmitting image data to an external device and receiving print data from an external device via the network 102.
[0014] FIG. 2A is a diagram illustrating switching between a normal mode and a power-saving mode in the electronic device. As shown in FIG. 2A, the control unit 110 controls switching between a normal mode (second mode) 201 and a power-saving mode (first mode) 202. In the power-saving mode 202, power consumption by the electronic device 100 is reduced. In the normal mode 201, power consumption reduction in the electronic device 100 is released, and the electronic device 100 can accept user operations and execute various functions. Switching from the normal mode 201 to the power-saving mode 202 (see arrow 203) is performed when one of the following three conditions is satisfied. The first condition is when it is detected that an operation to switch to the power-saving mode 202 has been performed during the normal mode 201. The second condition is when it is detected that a predetermined time has elapsed since switching to the normal mode 201. The third condition is when it is detected that an external job received via the communication unit I / F 123 has been completed. Furthermore, switching from power saving mode 202 to normal mode 201 (see arrow 204) is performed when one of the following two conditions is satisfied. The first condition is when it is detected that an operation to switch to normal mode 201 has been performed during power saving mode 202. The second condition is when it is detected that a job has been received from the outside via communication unit I / F 123. Note that the time it takes to switch from power saving mode 202 to normal mode 201 is shorter than the time it takes for the main power of electronic device 100 to change from an OFF state to an ON state. As a result, when using electronic device 100, it is more user-friendly for the user of electronic device 100 to alternate between power saving mode 202 and normal mode 201 than to alternately switch the main power OFF and ON. This improves operability.
[0015] FIG. 2B is a diagram showing the states of the printing unit, reading unit, output unit, and input unit in each of the normal mode and the power saving mode. As shown in FIG. 2B , in normal mode 201, printing unit 120 and reading unit 122 are each in a state where they can execute their functions more quickly than in power saving mode 202 in response to an operation by a user (operator) of electronic device 100. Output unit 118 is in a lit state where it is possible to form an aerial image by projecting an image into the air. Input unit 116 is in a state where it is possible to detect an operation on the aerial image formed by output unit 118 in a non-contact manner. Input unit 116 is also in a state where it is possible to detect an operation to switch to power saving mode 202. Meanwhile, in power saving mode 202, printing unit 120 and reading unit 122 are each in a state where power consumption is reduced, i.e., a power-saving state. Output unit 118 is in an off state where it is possible to stop forming the aerial image. Input unit 116 is in a state where it is possible to detect an operation to switch to normal mode 201. As described above, in normal mode 201, input unit 116 is in a state where it can detect a switching operation to power saving mode 202. In this way, input unit 116 is in a state where it can detect a switching operation to either normal mode 201 or power saving mode 202, regardless of whether it is normal mode 201 or power saving mode 202.
[0016] FIG. 3 is a side view of the input and output units in normal mode, viewed from the side of the output unit (display). As shown in FIG. 3, electronic device 100 includes liquid crystal display 301, optical element 302, sensor 304, and power-saving key sticker 306. Optical element 302 is a component constituting output unit 118. Optical element 302 is flat and disposed, for example, horizontally. Liquid crystal display 301 is disposed below optical element 302, tilted at an angle of, for example, 45° relative to optical element 302. Liquid crystal display 301 includes a backlight (not shown) and is a display means capable of displaying a signal received via output unit I / F 117 as an image. Optical element 302 refracts the light from the backlight, i.e., the image displayed on liquid crystal display 301, to project the image into the air, forming aerial image 303. This allows a user to view aerial image 303. The aerial image 303 is formed at an angle of, for example, 45° relative to the optical element 302 .
[0017] Sensor 304 is a component constituting input unit 116, and is arranged above optical element 302, on the left side in FIG. 3 (the same applies to FIG. 4 ). In this embodiment, an infrared sensor is used as sensor 304. This allows for contactless detection of a user's operation on aerial image 303. Sensor detection area (detection range) 305 of the user's operation by sensor 304 is set above aerial image 303 and is a plane parallel to aerial image 303. When an operation is performed on aerial image 303, sensor 304 detects the coordinates of the operation point (fingertip) within sensor detection area 305 as the operation on aerial image 303. This detection result, i.e., the coordinates of the operation point, is transmitted to control unit 110. Based on this detection result, control unit 110 can perform control operations such as changing aerial image 303 or instructing printing unit 120 or reading unit 122 to start operating. In the configuration shown in Fig. 3, it is preferable that the user view aerial image 303 from the left side in Fig. 3 and perform operations on aerial image 303. Note that sensor detection area 305 is made up of multiple infrared rays emitted from sensor 304, and is therefore difficult for the user to see. In addition, the size of sensor detection area 305 can be changed under the control of control unit 110. In addition, sensor 304 is not limited to an infrared sensor.
[0018] Power-saving key sticker 306 is a sheet-like member attached to the upper surface of optical element 302. Power-saving key sticker 306 is made of an opaque member that refracts light and does not transmit light. Therefore, it is preferable to attach power-saving key sticker 306 to a position on optical element 302 that is away from the position where the backlight of liquid crystal display 301 shines on it. Power-saving key sticker 306 serves as a guide when switching between normal mode 201 and power-saving mode 202; that is, it functions as an operating object (switching operation means) for switching between normal mode 201 and power-saving mode 202. Power-saving key sticker 306 is arranged at a position overlapping sensor detection area 305 (within sensor detection area 305) in a planar view of sensor detection area 305. This allows the user to view power-saving key sticker 306 through sensor detection area 305 regardless of the states of liquid crystal display 301 and aerial image 303. When the sensor 304 detects a user operation on the power-saving key sticker 306 in a non-contact manner in the normal mode 201, the mode is switched to the power-saving mode 202. When a user operation is performed on the power-saving key sticker 306, the sensor 304 can detect the coordinates of the operation point within the sensor detection area 305 as an operation on the power-saving key sticker 306. This detection result (coordinates of the operation point) is transmitted to the control unit 110. Then, the control unit 110 can perform control to switch from the normal mode 201 to the power-saving mode 202 based on this detection result. This control is also similar to the control to switch from the power-saving mode 202 to the normal mode 201. In addition, the power-saving key sticker 306 is a sheet-like member in this embodiment, but is not limited to this. For example, a marker printed on the upper surface of the optical element 302 may be used instead of the power-saving key sticker 306.
[0019] FIG. 4 is a side view of the states of the input and output units in power saving mode, as viewed from the side of the output unit (display). Liquid crystal display 401 is turned off. This stops the formation of aerial image 303. Sensor detection area 402 of sensor 304 may be the same size as sensor detection area 305 in normal mode 201, or may be smaller than sensor detection area 305. When sensor detection area 402 is smaller than sensor detection area 305, power consumption by sensor 304 can be reduced. Furthermore, when sensor 304 detects a user operation on power saving key sticker 306 in a non-contact manner in power saving mode 202, the mode is switched to normal mode 201.
[0020] 5 is a plan view of the states of the input and output units in normal mode, as viewed from above the output unit (display). As shown in FIG. 5, sensor detection area 305 overlaps with aerial image 303, which has a plurality of icons and the like, and encompasses aerial image 303. As a result, as described above, when an operation is performed on aerial image 303, the coordinates of the operation point within sensor detection area 305 are detected by sensor 304 as an operation on aerial image 303. Power-saving key sticker 306 is located within sensor detection area 305, but is positioned so as not to overlap with aerial image 303. As a result, sensor 304 can distinguish between operations on aerial image 303 and operations on power-saving key sticker 306 when detecting them.
[0021] FIG. 6 is a plan view of the input and output units in the power-saving mode, viewed from above the output unit (display). As shown in FIG. 6, the horizontal length of the sensor detection area 402 is set shorter than the horizontal length of the sensor detection area 305. This reduces the number of infrared rays emitted from the sensor 304, thereby suppressing power consumption. In this embodiment, the vertical length of the sensor detection area 402 is the same as the vertical length of the sensor detection area 305, but this is not limited to this. The power-saving key sticker 306 is located within the sensor detection area 402. As described above, in the normal mode 201, the power-saving key sticker 306 is located within the sensor detection area 305. This allows the sensor 304 to detect operations on the power-saving key sticker 306 without contact, regardless of whether the mode is the normal mode 201 or the power-saving mode 202. Hereinafter, the area of the sensor detection area 402 that faces the power-saving key sticker 306 and includes the power-saving key sticker 306 will be referred to as the "sticker detection area 403." In the sticker detection area 403, operations on the power-saving key sticker 306 can be detected more reliably.
[0022] As described above, electronic device 100 can detect the operation of switching between normal mode 201 and power saving mode 202 as needed, that is, when you want to switch modes, by setting sensor detection area 305 and sensor detection area 402. Furthermore, electronic device 100 can perform the mode switching operation in a contactless manner with a simple configuration that uses sensor 304 (infrared sensor).
[0023] The location of the power-saving key sticker 306 will now be described with reference to FIG. 4. As described above, the power-saving key sticker 306 is located above the optical element 302, on the left side in FIG. 4. Specifically, the power-saving key sticker 306 is located in a position close to the user who operates the power-saving key sticker 306, in a plan view of the sensor detection area 402. As a result, when the user visually recognizes the power-saving key sticker 306, the power-saving key sticker 306 and the sticker detection area 403 overlap closely in the user's line of sight. Then, when the user operates the power-saving key sticker 306 in this state, the operation is likely to occur within the sticker detection area 403, and as a result, the operation can be detected by the sensor 304.
[0024] In contrast, consider the case where the power-saving key sticker 306' is placed, for example, farther from the user (toward the rear), i.e., on the right side in FIG. 4. The sticker detection area 403' is an area within the sensor detection area 402 that faces the power-saving key sticker 306' and encompasses the power-saving key sticker 306'. The sticker detection area 403' can more reliably detect operations on the power-saving key sticker 306'. If the power-saving key sticker 306' is placed on the right side in FIG. 4, when the user visually recognizes the power-saving key sticker 306', the power-saving key sticker 306' and the sticker detection area 403' do not overlap in the user's line of sight, but are spaced far apart. Even if the user operates the power-saving key sticker 306' in this state, the operation is unlikely to occur within the sticker detection area 403', making it difficult for the sensor 304 to detect the operation. Therefore, it is preferable to place the power-saving key sticker 306 close to the user.
[0025] Fig. 7 is a flowchart showing processing executed by the electronic device in normal mode. The program shown in Fig. 7 is periodically executed by control unit 110 in normal mode 201. As shown in Fig. 7, in step S801, control unit 110 determines whether or not input unit 116 has detected a user operation. If it is determined in step S801 that a user operation has been detected, the process proceeds to step S802. On the other hand, if it is determined in step S801 that a user operation has not been detected, the process proceeds to step S806.
[0026] In step S802, the control unit 110 determines whether the user operation detected in step S801 is a switching operation to the power saving mode 202. If it is determined in step S802 that the operation is a switching operation to the power saving mode 202, the process proceeds to step S803. On the other hand, if it is determined in step S802 that the operation is not a switching operation to the power saving mode 202, the process proceeds to step S804.
[0027] In step S803, the control unit 110 switches (transitions) to the power saving mode 202. After step S803 is executed, the process ends.
[0028] In step S804, control unit 110 resets to "0" the timer that indicates the time that has elapsed since input unit 116 last detected a user operation. After step S804 is executed, the process proceeds to step S805.
[0029] In step S805, the control unit 110 determines the user operation detected in step S801 and executes processing according to the user operation. After executing step S805, the processing ends.
[0030] In step S806, control unit 110 determines whether the time elapsed since input unit 116 last detected a user operation exceeds a preset value (the time until automatic transition to power saving mode 202). If it is determined in step S806 that the set value has been exceeded, the process proceeds to step S803. On the other hand, if it is determined in step S806 that the set value has not been exceeded, the process ends.
[0031] Fig. 8 is a flowchart showing processing executed by the electronic device in power saving mode. The program shown in Fig. 8 is periodically executed by control unit 110 during power saving mode 202. As shown in Fig. 8, in step S901, control unit 110 determines whether or not input unit 116 has detected a user operation. If it is determined in step S901 that a user operation has been detected, the process proceeds to step S902. On the other hand, if it is determined in step S901 that a user operation has not been detected, the process proceeds to step S904.
[0032] In step S902, the control unit 110 determines whether the coordinates of the user operation position detected in step S901 are included in the sticker detection area 403. If the determination in step S902 determines that the coordinates are included in the sticker detection area 403, the process proceeds to step S903. On the other hand, if the determination in step S902 determines that the coordinates are not included in the sticker detection area 403, the process ends.
[0033] In step S903, the control unit 110 switches to the normal mode 201. After step S903 is executed, the process ends.
[0034] In step S904, the control unit 110 determines whether or not a job has been received from the outside via the communication unit I / F 123, that is, whether or not there is a job from the outside. If it is determined in step S904 that there is a job, the process proceeds to step S905. On the other hand, if it is determined in step S904 that there is no job, the process ends.
[0035] In step S905, the control unit 110 switches to the normal mode 201. After step S905 is executed, the process proceeds to step S906.
[0036] In step S906, the control unit 110 identifies the job determined in step S904 and executes the job. The execution of this job is not particularly limited, and may include, for example, printing by controlling the printing unit 120. After step S906 is executed, the process proceeds to step S907.
[0037] In step S907, the control unit 110 switches to the power saving mode 202. After step S907 is executed, the process ends.
[0038] Second Embodiment The second embodiment will be described below with reference to FIGS. 9A to 12. The description will focus on differences from the previous embodiment, and similar aspects will not be repeated. FIG. 9A is a diagram illustrating switching between a normal mode and a power-saving mode in an electronic device according to the second embodiment. As shown in FIG. 9A, the control unit 110 controls switching between a normal mode 1001 and a first power-saving mode 1002, and between the normal mode 1001 and a second power-saving mode 1003. In the normal mode 1001, similar to the normal mode 201, the suppression of power consumption in the electronic device 100 is released, and the electronic device 100 can accept user operations and execute various functions. The first power-saving mode 1002 and the second power-saving mode 1003 are modes in which power consumption in the electronic device 100 is suppressed, but the sizes of the detection areas are different from each other.
[0039] Switching from the normal mode 1001 to the first power saving mode 1002 (see arrow 1004) is performed when it is detected that an operation for switching to the first power saving mode 1002 has been performed during the normal mode 1001. Switching from the first power saving mode 1002 to the normal mode 1001 (see arrow 1005) is performed when one of the following two conditions is satisfied. The first condition is when it is detected that an operation for switching to the normal mode 1001 has been performed during the first power saving mode 1002. The second condition is when it is detected that a job has been received from the outside via the communication unit I / F 123. Switching from the normal mode 1001 to the second power saving mode 1003 (see arrow 1006) is performed when one of the following two conditions is satisfied. The first condition is when it is detected that a predetermined time has elapsed since switching to the normal mode 1001. The second condition is when it is detected that the job received from the outside via the communication unit I / F 123 has been completed. Switching from the second power saving mode 1003 to the normal mode 1001 (see arrow 1007) is performed when one of the following two conditions is satisfied. The first condition is when it is detected that an operation to switch to the normal mode 1001 has been performed while in the second power saving mode 1003. The second condition is when it is detected that a job has been received from outside via the communication unit I / F 123.
[0040] FIG. 9B is a diagram showing the states of the printing unit, reading unit, output unit, and input unit in each of the normal mode, first power saving mode, and second power saving mode. As shown in FIG. 9B , in normal mode 1001, printing unit 120 and reading unit 122 are each in a state where they can execute their functions, similar to normal mode 201. Output unit 118 is in an on state where an aerial image can be formed. Input unit 116 is in a state where it can detect an operation on the aerial image in a non-contact manner and can detect an operation to switch to power saving mode 202. Meanwhile, in first power saving mode 1002 and second power saving mode 1003, similar to power saving mode 202, printing unit 120 and reading unit 122 are in a power-saving state, and output unit 118 is in an off state where it can stop forming an aerial image. In first power saving mode 1002, input unit 116 is in a state where it can detect an operation to switch to normal mode 1001. The sensor detection area of sensor 304 in first power saving mode 1002 is set as sensor detection area 402 (see FIG. 6) which includes sticker detection area 403. In second power saving mode 1003, input unit 116 is in a state where it can detect an operation to switch to an aerial image. The sensor detection area of sensor 304 in second power saving mode 1003 is set as sensor detection area 1201 (see FIG. 10). Sensor detection area 1201 is the same as sensor detection area 305 (see FIG. 5).
[0041] As described above, in this embodiment, the power saving mode includes two types of modes: first power saving mode 1002 and second power saving mode 1003. The first power saving mode 1002 and the second power saving mode 1003 differ from each other in the size of the sensor detection area when an operation on the aerial image or power saving key sticker 306 is detected. Specifically, first power saving mode 1002 (the other mode) is a small detection range mode in which the sensor detection area is small, i.e., sensor detection area 402. Second power saving mode 1003 (the one mode) is a large detection range mode in which the sensor detection area is large, i.e., sensor detection area 1201.
[0042] 10 is a plan view of the states of the input unit and output unit in the second power saving mode when viewed from above the output unit (display). As shown in FIG. 10, sensor detection area 1201 is equivalent to sensor detection area 305 (see FIG. 5). The entire sensor detection area 1201 is used as the range of operation for switching to normal mode 1001. Note that a part of sensor detection area 1201, different from sticker detection area 403, may be used as the range of operation for switching to normal mode 1001.
[0043] Fig. 11 is a flowchart showing processing executed by the electronic device in normal mode. The program shown in Fig. 11 is periodically executed by control unit 110 in normal mode 1001. As shown in Fig. 11, in step S1301, control unit 110 determines whether input unit 116 has detected a user operation. If it is determined in step S1301 that a user operation has been detected, the process proceeds to step S1302. On the other hand, if it is determined in step S1301 that a user operation has not been detected, the process proceeds to step S1306.
[0044] In step S1302, control unit 110 determines whether the user operation detected in step S1301 is a switching operation to power saving mode 202. If it is determined in step S1302 that the operation is a switching operation to power saving mode 202, the process proceeds to step S1303. On the other hand, if it is determined in step S1302 that the operation is not a switching operation to power saving mode 202, the process proceeds to step S1304.
[0045] In step S1303, control unit 110 switches to first power saving mode 1002. After step S1303 is executed, the process ends.
[0046] In step S1304, control unit 110 resets to "0" the timer that indicates the time that has elapsed since input unit 116 last detected a user operation. After step S1304 is executed, the process proceeds to step S1305.
[0047] In step S1305, the control unit 110 determines the user operation detected in step S1301 and executes processing according to the user operation. After executing step S1305, the processing ends.
[0048] In step S1306, control unit 110 determines whether the time elapsed since input unit 116 last detected a user operation exceeds a preset value (the time until automatic transition to power saving mode 202). If it is determined in step S1306 that the set value has been exceeded, the process proceeds to step S1307. On the other hand, if it is determined in step S1306 that the set value has not been exceeded, the process ends.
[0049] In step S1307, control unit 110 switches to second power saving mode 1003. After step S1307 is executed, the process ends.
[0050] As described above, in this embodiment, when the input unit 116 detects an operation on the power-saving key sticker 306 in the normal mode 201, the control unit 110 switches to the first power-saving mode 1002 (small detection range mode). Furthermore, when a predetermined time has elapsed since switching to the normal mode 201, the control unit 110 switches to the second power-saving mode 1003 (large detection range mode).
[0051] Fig. 12 is a flowchart showing processing executed by the electronic device during a power saving mode. The program shown in Fig. 12 is periodically executed by control unit 110 during first power saving mode 1002 or second power saving mode 1003. As shown in Fig. 12, in step S1401, control unit 110 determines whether input unit 116 has detected a user operation. If it is determined in step S1401 that a user operation has been detected, the process proceeds to step S1402. On the other hand, if it is determined in step S1401 that a user operation has not been detected, the process proceeds to step S1404.
[0052] In step S1402, control unit 110 determines whether the coordinates of the user operation position detected in step S1401 are included in the detection area. If the determination in step S1402 determines that the coordinates are included in the detection area, the process proceeds to step S1403. On the other hand, if the determination in step S1402 determines that the coordinates are not included in the detection area, the process ends.
[0053] In step S1403, the control unit 110 switches to the normal mode 1001. After step S1403 is executed, the process ends.
[0054] In step S1404, the control unit 110 determines whether or not a job has been received from the outside via the communication unit I / F 123. If it is determined in step S1404 that a job exists, the process proceeds to step S1405. On the other hand, if it is determined in step S1404 that a job does not exist, the process ends.
[0055] In step S1405, the control unit 110 switches to the normal mode 1001. After step S1405 is executed, the process proceeds to step S1406.
[0056] In step S1406, the control unit 110 identifies the job determined in step S1404 and executes the job. After step S1406 is executed, the process proceeds to step S1407.
[0057] In step S1407, the control unit 110 switches to the second power saving mode 1003. After step S1407 is executed, the process ends.
[0058] As described above, in this embodiment, the detection area and the determination range for switching to normal mode are separated depending on the conditions for transitioning to power-saving mode. This allows for a quick return to normal mode with a simple operation (widening the detection area) when the power-saving mode is entered automatically, i.e., regardless of the user's intention. On the other hand, when the power-saving mode is entered actively, i.e., when the power-saving mode is entered at the user's will, it is assumed that the device will not be used in normal mode for some time. Therefore, the detection area is narrowed to prevent erroneous operation, and the device waits for a return to normal mode. Narrowing the detection area reduces power consumption. Furthermore, if a print job is received during power-saving mode, for example, the device returns to normal mode and executes the print job. After execution, the device re-enters power-saving mode. In this case, the detection area is narrowed. If the detection area is not narrowed, for example, when a user goes to retrieve a printed copy obtained by executing a print job, the action of going to retrieve the printed copy may be erroneously detected, resulting in an erroneous return to normal mode.
[0059] Although preferred embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments and various modifications and variations are possible within the spirit and scope of the present invention. The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more functions. As described above, electronic devices are capable of contactlessly detecting switching between normal mode and power-saving mode, regardless of whether they are in normal mode or power-saving mode. Therefore, for example, there are cases where it is not necessary to return from power-saving mode to normal mode. Examples of such cases are not particularly limited, and include, for example, switching to a maintenance mode that allows maintenance on the electronic device.
[0060] The disclosure of each embodiment includes the following configurations, methods, and programs. (Configuration 1) An electronic device comprising: a projection unit that projects an image into the air to form an aerial image; a detection unit that detects an operation on the aerial image in a non-contact manner; and a control unit that controls the projection unit and the detection unit, a switching operation means arranged within a detection range in which an operation on the aerial image can be detected by the detection means, the switching operation means performing an operation to switch between a first mode in which power consumption of the electronic device is reduced and a second mode in which the reduction in power consumption is released; The electronic device is characterized in that, in the first mode, the control means stops the formation of the aerial image by the projection means and puts the detection means into a state where operation on the switching operation means can be detected non-contact. (Configuration 2) The electronic device according to configuration 1, wherein the control means switches to the second mode when the detection means detects an operation on the switching operation means in the first mode. (Configuration 3) The electronic device described in configuration 1 or 2, characterized in that, in the second mode, the control means controls the formation of the aerial image by the projection means, the detection of operations on the aerial image by the detection means, and the detection of operations on the switching operation means by the detection means. (Configuration 4) The electronic device according to configuration 3, wherein the control means switches to the first mode when the detection means detects an operation on the switching operation means in the second mode. (Configuration 5) The electronic device described in configuration 3 or 4, characterized in that the control means switches to the first mode when the detection means does not detect an operation on the switching operation means in the second mode and a predetermined time has elapsed since switching to the second mode. (Configuration 6) The electronic device according to any one of configurations 1 to 5, wherein the detection means has an infrared sensor whose detection range is a plane parallel to the aerial image. (Configuration 7) The electronic device described in Configuration 6, characterized in that when an operation is performed on the aerial image, the infrared sensor detects the coordinates of a point within the detection range of the operation point as an operation on the aerial image, and when an operation is performed on the switching operation means, the infrared sensor detects the coordinates of a point within the detection range of the operation point as an operation on the switching operation means. (Configuration 8) The electronic device according to configuration 6 or 7, wherein the control means controls the infrared sensor to change the size of the detection range. (Configuration 9) The electronic device described in Configuration 8 is characterized in that the first mode includes two types of modes that differ in the size of the detection range when an operation on the switching operation means is detected, and one of the two types of modes is a large detection range mode in which the detection range is large, and the other mode is a small detection range mode in which the detection range is small. (Configuration 10) The electronic device described in Configuration 9 is characterized in that the control means switches to the small detection range mode when the detection means detects an operation on the switching operation means in the second mode, and switches to the large detection range mode when a predetermined time has elapsed since switching to the second mode. (Configuration 11) The electronic device according to any one of configurations 6 to 10, wherein the switching operation means is arranged at a position overlapping the detection range in a plan view of the detection range and is visible through the detection range. (Configuration 12) 12. The electronic device according to claim 11, wherein the switching operation means has a sheet-like member. (Configuration 13) The electronic device according to configuration 12, wherein the sheet-like member is arranged in a position close to an operator who operates the switching operation means in a plan view of the detection range. (Configuration 14) A display means for displaying the image is provided, 14. The electronic device according to any one of configurations 1 to 13, wherein the projection means is configured to refract the image displayed on the display means, thereby projecting the image into the air and forming the aerial image. (Configuration 15) An electronic device comprising: a projection unit that projects an image into the air to form an aerial image; a detection unit that detects an operation on the aerial image in a non-contact manner; and a control unit that controls the projection unit and the detection unit, a switching operation means arranged within a detection range in which an operation on the aerial image can be detected by the detection means, the switching operation means performing an operation to switch between a first mode in which power consumption of the electronic device is reduced and a second mode in which the reduction in power consumption is released; The electronic device is characterized in that the detection means is capable of detecting an operation on the switching operation means in a non-contact manner, regardless of whether the mode is the first mode or the second mode. (Method 1) A method for controlling an electronic device including a projection unit that projects an image into the air to form an aerial image, and a detection unit that detects an operation on the aerial image in a non-contact manner, the method comprising: The electronic device includes: a switching operation means arranged within a detection range in which an operation on the aerial image can be detected by the detection means, the switching operation means performing an operation to switch between a first mode in which power consumption of the electronic device is reduced and a second mode in which the reduction in power consumption is released; The method for controlling an electronic device includes: a control step of controlling the projection means and the detection means, The control method for an electronic device is characterized in that, in the first mode, the control process stops the formation of the aerial image by the projection means and places the detection means in a state where operation on the switching operation means can be detected non-contact. (Program 1) A program for causing a computer to execute each means of the electronic device described in any one of configurations 1 to 15. [Explanation of symbols]
[0061] 100 Electronic equipment 110 control section 116 Input section 118 Output section 201 Normal mode 202 Power saving mode 305 Sensor detection area 306 Energy Saving Key Sticker 402 Sensor detection area
Claims
1. An electronic device comprising: a projection unit that projects an image into the air to form an aerial image; a detection unit that detects an operation on the aerial image in a non-contact manner; and a control unit that controls the projection unit and the detection unit, a switching operation means arranged within a detection range in which an operation on the aerial image can be detected by the detection means, the switching operation means performing an operation to switch between a first mode in which power consumption of the electronic device is reduced and a second mode in which the reduction in power consumption is released; The electronic device is characterized in that, in the first mode, the control means stops the formation of the aerial image by the projection means and puts the detection means into a state where operation on the switching operation means can be detected non-contact.
2. 2. The electronic device according to claim 1, wherein the control means switches the mode to the second mode when the detection means detects an operation on the switching operation means in the first mode.
3. The electronic device described in claim 1, characterized in that, in the second mode, the control means controls the formation of the aerial image by the projection means, the detection of operations on the aerial image by the detection means, and the detection of operations on the switching operation means by the detection means.
4. 4. The electronic device according to claim 3, wherein the control means switches the mode to the first mode when the detection means detects an operation on the switching operation means in the second mode.
5. 4. The electronic device according to claim 3, wherein the control means switches to the first mode when the detection means does not detect an operation on the switching operation means in the second mode and a predetermined time has elapsed since switching to the second mode.
6. 2. The electronic device according to claim 1, wherein the detection means has an infrared sensor whose detection range is a plane parallel to the aerial image.
7. The electronic device described in claim 6, characterized in that when an operation is performed on the aerial image, the infrared sensor detects the coordinates of a point within the detection range of the operation point as an operation on the aerial image, and when an operation is performed on the switching operation means, the infrared sensor detects the coordinates of a point within the detection range of the operation point as an operation on the switching operation means.
8. 7. The electronic device according to claim 6, wherein the control means controls the infrared sensor to change the size of the detection range.
9. 9. The electronic device according to claim 8, wherein the first mode includes two types of modes that differ in the size of the detection range when an operation on the switching operation means is detected, one of the two types of modes being a large detection range mode in which the detection range is large, and the other mode being a small detection range mode in which the detection range is small.
10. 10. The electronic device according to claim 9, wherein the control unit switches to the small detection range mode when the detection unit detects an operation on the switching operation unit in the second mode, and switches to the large detection range mode when a predetermined time has elapsed since the mode was switched to the second mode.
11. 7. The electronic device according to claim 6, wherein the switching operation means is arranged at a position overlapping the detection range in a plan view of the detection range, and is visible through the detection range.
12. 12. The electronic device according to claim 11, wherein the switching operation means has a sheet-like member.
13. 13. The electronic device according to claim 12, wherein the sheet-like member is disposed in a position close to an operator who operates the switching operation means in a plan view of the detection range.
14. a display means for displaying the image, 2. The electronic device according to claim 1, wherein the projection means is configured to refract the image displayed on the display means, thereby projecting the image into the air to form the aerial image.
15. An electronic device comprising: a projection unit that projects an image into the air to form an aerial image; a detection unit that detects an operation on the aerial image in a non-contact manner; and a control unit that controls the projection unit and the detection unit, a switching operation means arranged within a detection range in which an operation on the aerial image can be detected by the detection means, the switching operation means performing an operation to switch between a first mode in which power consumption of the electronic device is reduced and a second mode in which the reduction in power consumption is released; The electronic device is characterized in that the detection means is capable of detecting an operation on the switching operation means in a non-contact manner, regardless of whether the mode is the first mode or the second mode.
16. A method for controlling an electronic device including a projection unit that projects an image into the air to form an aerial image, and a detection unit that detects an operation on the aerial image in a non-contact manner, the method comprising: The electronic device includes: a switching operation means arranged within a detection range in which an operation on the aerial image can be detected by the detection means, the switching operation means performing an operation to switch between a first mode in which power consumption of the electronic device is reduced and a second mode in which the reduction in power consumption is released; The method for controlling an electronic device includes: a control step of controlling the projection means and the detection means, The control method for an electronic device is characterized in that, in the first mode, the control process stops the formation of the aerial image by the projection means and places the detection means in a state where operation on the switching operation means can be detected non-contact.
17. 16. A program for causing a computer to execute each means of the electronic device according to claim 1 or 15.
Citation Information
Patent Citations
Terminal processing device
JP2022117247A