Non-contact switch system

Abstract

To provide a technique capable of correctly detecting a state of a detection object body part of a user even when an inexpensive and simple image sensor part is adopted and correctly indicating a location of a detection area for the user without limiting the range of use in a room in a non-contact type switch system which detects the state of the detection object body part of the user by the image sensor part and controls the operation of a control object device on the basis of the detection result.SOLUTION: A non-contact type switch system comprises: an image sensor part 2 which detects the state of a detection object body part Ua of a user U in a detection area A in a room R; a device control part 3 which controls the operation of a control object device 10 on the basis of the detection result of the image sensor part 2; and a detection area indication part 5 which indicates a location of the detection area A for the user U. The detection area indication part 5 is provided by using an interior material M in the room R.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a non-contact switch system including an image sensor unit that detects the state of a user's body part to be detected in a predetermined detection area indoors, a device control unit that controls the operation of a device to be controlled based on the detection result of the image sensor unit, and a detection area instruction unit that instructs the user of the location of the detection area.

Background Art

[0002] Making the operation for controlling the operation of a device to be controlled, such as a lighting device or an air conditioner, non-contact is an effective method for preventing contact, which is one of the infection routes of infectious diseases, and its usefulness has been attracting attention in the current situation of the COVID-19 pandemic. Conventionally, as a system for performing an operation for controlling the operation of a device to be controlled in a non-contact manner, a non-contact switch system that detects the state of a user's body part to be detected with an image sensor unit and controls the operation of the device to be controlled based on the detection result has been proposed (see, for example, Patent Document 1). The non-contact switch system described in Patent Document 1 is configured to turn off the lighting device when a user who has entered the room approaches a spot-lit table and holds out a hand parallel to the floor surface for a certain period of time, and to adjust the brightness of the lighting device when the hand is tilted with respect to the floor surface and the tilt state is changed up and down while maintaining the same state for a certain period of time. That is, in this non-contact switch system, the periphery of the table is set as the detection area of the image sensor unit, and the spot-lit table functions as a detection area indicator for instructing the detection area to the user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the non-contact switch system described in Patent Document 1, the detection area covers a relatively wide area around the table. Therefore, the image sensor unit needs to be configured to capture a wider area, such as by equipping it with a wide-angle or fisheye lens, which makes it expensive and complicated. Furthermore, detection area indicators, such as tables used to show users the location of the detection area, can become obstacles that restrict the use of the room, thus becoming factors that fix or restrict the use of the space. In view of this situation, the main objective of the present invention is to provide a non-contact switch system that detects the state of a user's body parts to be detected using an image sensor unit and controls the operation of a controlled device based on the detection result, in which the state of a user's body parts to be detected can be accurately detected even when an inexpensive and simple image sensor unit is used, and furthermore, a technology can be provided that can accurately indicate the location of the detection area to the user without limiting the range of use in the room. [Means for solving the problem]

[0005] The first characteristic configuration of the present invention is an image sensor unit that detects the state of a user's body part to be detected in a predetermined detection area in a room, A device control unit controls the operation of the controlled device based on the detection results of the image sensor unit, It is equipped with, A non-contact switch system comprising a detection area indicator unit that indicates the location of the detection area to the user, The detection area indicator is provided using the interior materials of the room. Occasionally, Among the interior materials of the room, the interior material of the detection area that forms the background of the imaging range by the image sensor unit is different from other interior materials adjacent to the said detection area interior material, and functions as the detection area indicator unit. It is located at the point.

[0006] In this configuration, the detection area indicator unit, which directs the user to the location of the detection area, is constructed using the interior materials of the room. Therefore, it is possible to relatively accurately direct the user to the location of the detection area using the interior materials of the room without requiring the installation of a detection area indicator device that would restrict the use of the room. Accordingly, the present invention provides a non-contact switch system that detects the state of a user's body parts using an image sensor and controls the operation of a controlled device based on the detection results. This system can accurately detect the state of a user's body parts even when using an inexpensive and simple image sensor, and can also accurately indicate the location of the detection area to the user without limiting the range of use in a room.

[0008] Furthermore, With this configuration, since the detection area interior material is different from other interior materials adjacent to it, the user can be accurately guided to the detection area by being able to see the detection area interior material accurately. Furthermore, since the detection area interior material, which is simple with few irregularities and utilizes the interior materials of the room, becomes the background of the imaging range of the image sensor unit, even if a relatively inexpensive and simple image sensor unit is used, the state of the body part of the user to be detected can be accurately detected.

[0009] This invention 2 The key feature of this configuration is that the color tone of the interior material in the detection area is set to be captured by the image sensor at a higher brightness than that of the other interior materials.

[0010] With this configuration, the color tone of the interior material in the detection area is set to be captured by the image sensor at a higher brightness than other interior materials in the surrounding area. As a result, in the image data obtained by the image sensor with the interior material in the detection area as the background, the contours, wrinkles, and shadows of the body parts to be detected, such as the user's palm, are clearly depicted, thereby further improving the detection accuracy of the image sensor.

[0011] This invention 3A key feature of the configuration is that the image sensor unit detects the state of the user's palm as the state of the body part to be detected.

[0012] According to this configuration, since the state of the body part to be detected by the image sensor is the stationary state of the user's palm, the image sensor does not detect the state of the palm as a body part to be detected when the user's palm is not facing the image sensor and is not extended. It can only detect the state of the palm as a body part to be detected when the user's palm is facing the image sensor and is extended and stationary. Therefore, the amount of information that needs to be processed in the captured image data obtained by the image sensor can be reduced as much as possible, further simplifying the system configuration and preventing the image sensor from falsely detecting the state of the user's body part to be detected against the user's will.

[0013] This invention 4 A key feature of this configuration is that the detection area is set at a position above a predetermined height near the user's shoulders.

[0014] With this configuration, when the user's palm is used as the body part to be detected, the detection area that forms the background of the imaging range by the image sensor is set to a position above a predetermined height near the user's shoulder. Therefore, when the user lowers their palm below shoulder level, the image sensor does not detect the state of the palm as the body part to be detected. Only when the user raises their palm above shoulder level can the image sensor detect the state of the palm as the body part to be detected. Thus, it is possible to further suppress false detection of the state of the user's palm by the image sensor against the user's will. [Brief explanation of the drawing]

[0015] [Figure 1] Diagram illustrating the schematic configuration of the non-contact switch system of the first embodiment. [Figure 2]Plan view showing an example of a detection area floor finishing material in the first embodiment [Figure 3] Plan view showing an example of a detection area floor finishing material in the first embodiment [Figure 4] Explanatory drawing showing a schematic configuration of a non-contact switch system according to the second embodiment [Figure 5] Explanatory drawing showing a schematic configuration of a non-contact switch system according to the third embodiment

Mode for Carrying Out the Invention

[0016] Embodiments of the non-contact switch system according to the present invention will be described based on the drawings. First, the common configuration of the non-contact switch systems 1A, 1B, and 1C (hereinafter referred to as "this system") according to the first embodiment, the second embodiment, and the third embodiment will be described. This system 1A, 1B, 1C shown in FIGS. 1, 4, and 5 includes an image sensor unit 2 that detects the state of a detection target body part Ua of a user U in a predetermined detection area A in an indoor area R such as a living room or a passage, and a device control unit 3 that controls the operation of a controlled device 10 based on the detection result of the image sensor unit 2.

[0017] The image sensor unit 2 analyzes the captured image data obtained by imaging, and when it determines that a specific state of the detection target body part Ua of the user U is included in the captured image data, it is configured to output detection result information associated with the specific state to the device control unit 3. Further, the specific state of the detection target body part Ua is a specific stop state of the palm U1 of the user U, and a specific stop state of the palm U1 is associated with each of a plurality of types of operations on the controlled device 10. In this way, since the state of the detection target body part Ua of the user U to be analyzed in the captured image data obtained by the image sensor unit 2 is the stop state of the palm U1 of the user U, the amount of information that the image sensor unit 2 has to process is limited to the minimum related to the contour, wrinkles, center position, etc. that can identify the palm U1, and the configuration of this system 1A, 1B, 1C is simplified.

[0018] When the machine control unit 3 receives detection result information such as the stop position from the image sensor unit 2 that has detected a specific stop state of the palm U1 of the user U, it outputs a control command signal corresponding to the detection result information to the controlled device 10 to control the operation of the controlled device 10. That is, the user U who desires non-contact operation of the controlled device 10 stops the state of the palm U1 in a specific state associated with the desired operation in the detection area A of the image sensor unit 2. Then, the specific stop state of the palm U1 of the user U is detected by the image sensor unit 2, the detection result information such as the stop position is output from the image sensor unit 2 to the machine control unit 3, and the controlled device 10 is operated by the machine control unit 3 as desired by the user U.

[0019] The systems 1A, 1B, and 1C are provided with a detection area指示部 5 that指示 the location of the detection area A of the image sensor unit 2 to the user U. That is, the user U can visually recognize this detection area指示部 5 and grasp the location of the detection area A. Furthermore, the detection area指示部 5 that指示 the location of the detection area A to the user U is provided using the interior material M constructed on the floor surface or wall surface of the room R. This eliminates the need to install a detection area指示 tool such as a table that restricts the usage of the room R in order to指示 the location of the detection area A to the user U. And the location of the detection area A can be指示 to the user U relatively accurately using the interior material M of the room R.

[0020] The above is the common configuration of the systems 1A, 1B, and 1C. Hereinafter, the respective characteristic configurations of the system 1A of the first embodiment, the system 1B of the second embodiment, and the system 1C of the third embodiment will be further described.

[0021] 〔First Embodiment〕 The characteristic configuration of the system 1A of the first embodiment will be described based on FIG. 1. This system 1A is configured as a system for non-contact operation of a lighting device 10A that illuminates a room R, as an example of a controlled device 10. In this system 1A, the image sensor unit 2 is installed on the ceiling of room R with its imaging direction facing downwards toward the floor surface of room R. That is, the detection area A of the image sensor unit 2 is the area between the floor surface, which serves as the background of the imaging range, and the image sensor unit 2. In this embodiment, the detection area indicator unit 5, which indicates the location of the detection area A to the user U, is provided using a floor finishing material M1 such as carpet tiles installed on the floor surface as an interior material M of room R. Specifically, multiple carpet tiles are laid on the floor surface as the floor finishing material M1, and a portion of these carpet tiles is colored differently from the surrounding carpet tiles so that it can be seen by the user U, and this portion is used as the detection area indicator unit 5. As described above, the image sensor unit 2 is installed on the ceiling, and the detection area indicator unit 5 is provided using the floor finishing material M1, eliminating any obstacles that restrict the use of the floor surface in the room R.

[0022] The detection area indicator unit 5, which is part of the floor finishing material M1, is a rectangular detection area floor finishing material M1a (an example of a detection area interior material) that serves as the background for the imaging range by the image sensor unit 2, in order to indicate the detection area A above it to the user U. In other words, the detection area floor finishing material M1a is made to have a different color tone, etc., from other floor finishing materials M1b adjacent to it, thereby functioning as the detection area indicator unit 5.

[0023] Then, a user U who wishes to operate the controlled device 10, such as the lighting device 10A, without contact, looks at the detection area floor finishing material M1a, which functions as a detection area indicator unit 5, approaches the detection area floor finishing material M1a, extends their palm U1 upwards towards the image sensor unit 2 in the detection area A above the detection area floor finishing material M1a, and stops the state of their palm U1 in a specific state corresponding to the desired operation. The image sensor unit 2 then detects the specific stopped state of the user U's palm U1, and the image sensor unit 2 outputs detection result information such as the stopped position to the device control unit 3, causing the controlled device 10, such as the lighting device 10A, to be operated by the device control unit 3 as desired by the user U.

[0024] The surrounding floor finishing materials M1b of the detection area floor finishing material M1a are generally dark in tone so that dirt and other imperfections on the floor are less noticeable. However, the color tone of the detection area floor finishing material M1a, which forms the background of the imaging range of the image sensor unit 2, is brighter than the other floor finishing materials M1b so that it is captured by the image sensor unit 2 at a higher brightness. As a result, in the image data obtained by the image sensor unit 2 with the detection area floor finishing material M1a as the background, the contours, wrinkles, and shadows of the user U's palm U1 are clearly depicted. This further improves the detection accuracy of the image sensor unit 2.

[0025] Furthermore, if, in the detection area A, a stopping position for the palm U1 is set for each of multiple types of operations on the controlled device 10, the detection area floor finishing material M1a can be configured so that the user U can identify each of these multiple stopping positions. For example, as shown in Figure 2, multiple tile carpets M1a1 and M1a2 constituting the detection area floor finishing material M1a can be made to be different colors from adjacent ones, and the position of each of these tile carpets M1a1 and M1a2 can be set as the stopping position of the palm U1 for each of the multiple types of operations on the controlled device 10. In this case, the user U can visually confirm the positions of each of these multiple tile carpets M1a1 and M1a2, which are the detection area indicator unit 5, and stop the palm U1 facing the image sensor unit 2 above the position of each of the multiple tile carpets M1a1 and M1a2 that corresponds to the desired operation, thereby executing the desired operation on the controlled device 10. Note that in Figure 2, multiple tile carpets M1a1 and M1a2 are made to be different colors from adjacent ones by arranging two different colored tile carpets M1a1 and M1a2 in a staggered pattern.

[0026] Furthermore, as shown in Figure 3, the detection area floor finishing material M1a can be made the same color overall, but with marks M1a3 of a different color placed at predetermined locations. The positions of these marks M1a3, for example, in the front / back and left / right directions, can be designated as the stopping positions for the palm U1 for each of the multiple types of operations performed on the controlled device 10. In this case, the user U can visually locate the position of the marks M1a3, which are the detection area indicator unit 5, and stop the palm U1 facing the image sensor unit 2 above the position corresponding to the desired operation among the front / back and left / right directions of the marks M1a3, thereby performing the desired operation on the controlled device 10.

[0027] [Second Embodiment] The characteristic configuration of the second embodiment of this system 1B will be explained with reference to Figure 4. This system 1B is configured as a system for non-contact operation of a lighting device 10A that illuminates the room R, as an example of a controlled device 10. In this system 1B, the image sensor unit 2 is installed on the ceiling of room R with its imaging direction facing diagonally downward toward the wall surface of room R. That is, the detection area A of the image sensor unit 2 is the area between the wall surface, which serves as the background of the imaging range, and the image sensor unit 2. In this embodiment, the detection area indicator unit 5, which indicates the location of the detection area A to the user U, is provided using a wall finishing material M2 such as wallpaper or a sticker attached to the wallpaper, which is installed on the wall surface as an interior material M of room R. Specifically, wallpaper is laid on the wall surface as the wall finishing material M2, and a part of the wallpaper is made to a different color tone from the surrounding wallpaper so that it can be seen by the user U, and this part is used as the detection area indicator unit 5. As described above, the image sensor unit 2 is installed on the ceiling, and the detection area indicator unit 5 is provided using the wall finishing material M2, eliminating any obstacles that restrict the use of the interior wall surface R.

[0028] The detection area indicator 5, which is part of the wall finishing material M2, is composed of multiple circular detection area wall finishing materials M2a arranged horizontally on the wall surface behind detection area A, in order to indicate the detection area A on the near side to the user U. These multiple arranged detection area wall finishing materials M2a are made to have a different color tone, etc., from other wall finishing materials M2b adjacent to them, thereby functioning as the detection area indicator 5 that indicates the detection area A located on the near side to the user U.

[0029] Then, a user U who wishes to operate the controlled device 10, such as the lighting device 10A, without contact, looks at the detection area wall finishing material M2a, which functions as a detection area indicator unit 5, approaches the detection area wall finishing material M2a, extends their palm U1 diagonally upward so that it faces the image sensor unit 2 directly into the detection area A on the front side of the detection area wall finishing material M2a, and stops the state of their palm U1 in a specific state corresponding to the desired operation. The image sensor unit 2 then detects the specific stopped state of the user U's palm U1, and the image sensor unit 2 outputs detection result information such as the stopped position to the device control unit 3, causing the controlled device 10, such as the lighting device 10A, to be operated by the device control unit 3 as desired by the user U.

[0030] Furthermore, if, in the detection area A, a stopping position for the palm U1 is set for each of multiple types of operations on the controlled device 10, the detection area wall finishing material M2a can be configured so that the user U can identify each of these multiple stopping positions. For example, as shown in Figure 4, multiple detection area wall finishing materials M2a can be placed near each of multiple stopping positions, and the position of each of these detection area wall finishing materials M2a can be associated with each of multiple types of operations on the controlled device 10. In this case, the user U can visually locate the positions of these multiple detection area wall finishing materials M2a and stop their palm U1 facing the image sensor unit 2 near the position of the detection area wall finishing material M2a that corresponds to the desired operation, thereby causing the controlled device 10 to perform the desired operation.

[0031] [Third Embodiment] The characteristic configuration of the third embodiment of this system 1C will be explained with reference to Figure 5. This system 1C is configured as a system for non-contact operation of a projection device 10B that projects a predetermined image onto a projection area B on a wall surface, as an example of a controlled device 10. In this system 1C, the image sensor unit 2 is installed on the ceiling of room R with its imaging direction facing diagonally downward toward the wall surface of room R. That is, the detection area A of the image sensor unit 2 is the area between the wall surface, which serves as the background of the imaging range, and the image sensor unit 2. In this embodiment, the detection area indicator unit 5, which indicates the location of the detection area A to the user U, is provided using a wall finishing material M3 such as wallpaper or a sticker attached to the wallpaper, which is installed on the wall surface as an interior material M of room R. Specifically, wallpaper is laid on the wall surface as the wall finishing material M3, and a part of the wallpaper is made to be a different color from the surrounding wallpaper so that it can be seen by the user U, and this part is used as the detection area indicator unit 5. As described above, the image sensor unit 2 is installed on the ceiling, and the detection area indicator unit 5 is provided using the wall finishing material M3, eliminating any obstacles that restrict the use of the interior wall surface R.

[0032] The detection area indicator 5, which is part of the wall finishing material M3, is composed of triangular detection area wall finishing materials M3a, for example, positioned at both the left and right ends of the lower edge of detection area A, in order to indicate the detection area A located above and in front of it to the user U. The detection area wall finishing materials M3a positioned on both the left and right sides are made to have a different color tone, etc., from other wall finishing materials M3b adjacent to them, and thus the detection area indicator 5 functions as an indicator of the detection area indicator 5 that shows the detection area A located above it within the range sandwiched between them to the user U.

[0033] Then, a user U who wishes to operate the controlled device 10, such as the projection device 10B, without contact, looks at the detection area wall finishing material M3a, which functions as a detection area indicator unit 5, approaches the detection area wall finishing material M3a, extends their palm U1 diagonally upward so that it faces the image sensor unit 2 directly into the detection area A on the upper front side of the detection area wall finishing material M3a, and stops the state of their palm U1 in a specific state corresponding to the desired operation. When the image sensor unit 2 detects the specific stopped state of the user U's palm U1, the image sensor unit 2 outputs detection result information such as the stopped position to the device control unit 3, and the controlled device 10, such as the projection device 10B, is operated by the device control unit 3 as desired by the user U.

[0034] Furthermore, in this embodiment, detection area A is set at a position above a predetermined height near the user U's shoulder U2. Specifically, detection area wall finishing materials M3a, which are arranged on both the left and right sides, are provided at a height near the user U's shoulder U2, and detection area A is set at a position above the boundary line connecting these two detection area wall finishing materials M3a. As a result, when user U lowers their palm U1 below the level of their shoulder U2, the state of their palm U1 is not detected by the image sensor unit 2, while only when user U raises their palm U1 above the level of their shoulder U2 is the state of their palm U1 detected by the image sensor unit 2. Therefore, false detection of the state of user U's palm U1 by the image sensor unit 2 against user U's will is suppressed.

[0035] Furthermore, if, in the detection area A, a stopping position for the palm U1 is set for each of multiple types of operations on the controlled device 10, the detection area wall finishing material M3a can be configured so that the user U can identify each of these multiple stopping positions. For example, as shown in Figure 5, the area above and below the boundary line connecting the detection area wall finishing materials M3a arranged on both the left and right sides can be defined as detection area A, and the respective positions above and below this boundary line can be associated with two types of operations on the controlled device 10. In this case, the user U can perform the desired operation on the controlled device 10 by stopping their palm U1 facing the image sensor unit 2 in the detection area A corresponding to the desired operation, which is one of the detection areas A above and below the boundary line connecting the detection area wall finishing materials M3a arranged on both the left and right sides. In this embodiment, it is also possible to set the entire horizontal width of the wall surface as the detection area A by installing multiple image sensor units 2 such that the combined camera field of view of each image sensor unit 2 covers the entire horizontal width of the wall surface.

[0036] [Another embodiment] Other embodiments of the present invention will now be described. Note that the configurations of each embodiment described below are not limited to being applied individually, but can also be applied in combination with the configurations of other embodiments.

[0037] (1) In the above embodiment, the controlled device 10 to be operated was a lighting device 10A (see Figures 1 and 4) or a projection device 10B (see Figure 5), but other devices can also be used as the controlled device 10.

[0038] (2) In the above embodiment, the detection area interior materials M1a, M2a, and M3a were made to have a different color tone from the surrounding interior materials M1b, M2b, and M3b, thereby functioning as a detection area indicator 5 that is visible to the user U. However, the detection area interior materials M1a, M2a, and M3a may also be configured to function as a detection area indicator 5 by having a pattern or other condition other than the color tone that is different from the other interior materials M1b, M2b, and M3b.

[0039] (3) In the above embodiment, the state of the palm U1 of user U was used as the state of the body part Ua to be detected by the image sensor unit 2. However, the body part Ua to be detected may also be a body part other than the palm U1 of user U (for example, the back of the hand). Alternatively, the image sensor unit 2 may be configured to detect a static state change of the body part Ua, such as a pose (for example, the number of fingers held up). [Explanation of symbols]

[0040] 1A Non-contact Switch System 1B Non-contact switch system 1C Non-contact Switch System 2 Image detection unit 3. Equipment Control Unit 5. Detection Area Indicator 10. Controlled devices 10A Lighting device (controlled equipment) 10B Projection device (controlled equipment) A Detection area M Interior material M1 Floor finishing material (interior material) M1a Detection area floor finishing material (detection area interior material) M1a1 Tile carpet (interior material for detection area) M1a2 Tile carpet (interior material for detection area) M1a3 Mark (Detection Area Interior Material) M1b Floor finishing materials (other interior materials) M2 Wall finishing material (interior material) M2a detection area wall finishing material (detection area interior material) M2b Wall finishing material (other interior materials) M3 Wall finishing material (interior material) M3a Detection Area Wall Finishing Material (Detection Area Interior Material) M3b Wall finishing material (other interior materials) R Indoor U User U2 Shoulder Ua Detected body part

Claims

1. An image sensor unit that detects the state of the user's body parts to be detected within a designated detection area in the room, A device control unit controls the operation of the controlled device based on the detection results of the image sensor unit, It is equipped with, A non-contact switch system comprising a detection area indicator unit that indicates the location of the detection area to the user, The detection area indicator is provided using the interior materials of the room, A non-contact switch system that functions as a detection area indicator, wherein, among the interior materials of the room, the detection area interior material that forms the background of the imaging range by the image sensor unit is different from other interior materials adjacent to the detection area interior material.

2. The non-contact switch system according to claim 1, wherein the color tone of the interior material of the detection area is set to be captured by the image sensor at a higher brightness than the other interior materials.

3. The non-contact switch system according to claim 1 or 2, wherein the image sensor unit detects the state of the user's palm as the state of the body part to be detected.

4. The non-contact switch system according to claim 1 or 2, wherein the detection area is set to a position above a predetermined height near the user's shoulder.

Images