Operation control system for electronic device

Abstract

This operation control system (1) for an electronic device is provided with: an electronic device (refrigerator (10)) to be controlled; a signal detection unit (12) that detects the electromagnetic wave signal; and a control unit (11) that controls the operation of the electronic device (10). The control unit (11) performs a first determination to determine whether or not the information of the signal detected by the signal detection unit (12) satisfies a first condition indicating that a person is in the vicinity of the electronic device (10), and controls the operation of the electronic device (10) on the basis of at least the determination result of the first determination.

Description

Technical Field

[0001] This invention relates to a system for controlling the operation of electronic devices. Background Technology

[0002] Regarding the operation control of electronic devices, operation is controlled based on the illuminance detected by existing light sensors. For example, Patent Document 1 describes a method in a cold storage room including a light sensor to increase the set temperature of the cold storage room's energy-saving mode based on the ambient illuminance detected by the light sensor.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2001-99536 Summary of the Invention

[0006] However, in the illuminance-based operation control disclosed in Patent Document 1, it is difficult to increase the rate of temperature rise during bright daytime periods. Furthermore, it takes time to increase the rate of temperature rise when family members are away. As a result, the operation time is shortened when the rate of temperature rise increases.

[0007] Therefore, the present invention provides a system that can control the operation of an electronic device based on whether there are people around the electronic device.

[0008] An electronic device operation control system according to one aspect of the present invention includes: an electronic device as the object of control; a signal detection unit for detecting electromagnetic wave signals; and a control unit for controlling the operation of the electronic device. The control unit performs a first determination, determining whether the information of the signal detected by the signal detection unit satisfies a first condition indicating that there is a person in the vicinity of the electronic device, and controls the operation of the electronic device based at least on the determination result of the first determination.

[0009] In another aspect, the electronic device operation control system of the present invention includes: an electronic device as the controlled object; a signal detection unit for detecting electromagnetic wave signals; and a control unit for controlling the operation of the electronic device. The control unit inputs the information of the signal detected by the signal detection unit into a machine learning model, performs a first determination to determine whether there is a person around the electronic device, and controls the operation of the electronic device based on the determination result of the first determination.

[0010] The electronic device operation control system of this invention can control the operation of the electronic device based on whether there are people around the electronic device. Attached Figure Description

[0011] Figure 1 This is a block diagram illustrating the operation control system of the electronic device in Embodiment 1.

[0012] Figure 2 This is a flowchart illustrating the operation control process of the cold storage in Implementation Method 1.

[0013] Figure 3 This is a flowchart illustrating whether or not someone is involved in the judgment and processing in Implementation Method 1.

[0014] Figure 4 This is a table showing examples of evaluation values ​​in Implementation Method 1.

[0015] Figure 5 This is a flowchart illustrating the calculation process of the evaluation value in Implementation Method 1.

[0016] Figure 6 This is a flowchart illustrating the threshold update process in Implementation 1.

[0017] Figure 7 This is a table showing examples of data used in the threshold update process in Implementation 1.

[0018] Figure 8 This is a block diagram showing the operation control system of the electronic device in Embodiment 2.

[0019] Figure 9 This is a flowchart illustrating the operation control process of the cold storage in Implementation Method 2.

[0020] Figure 10 This is a flowchart illustrating whether or not someone is involved in the judgment and processing in Implementation Method 2.

[0021] Figure 11 This is a flowchart illustrating the learning process of the machine learning model in Implementation Method 2.

[0022] Explanation of reference numerals in the attached figures

[0023] 1 Operation Control System

[0024] 10 Cold storage

[0025] 11 Control Department

[0026] 12 Signal Detection Department

[0027] 13 Operation and Inspection Department

[0028] 14 Storage Department

[0029] 2 Operation Control System

[0030] 20 Cold storage warehouses

[0031] 21 Control Department

[0032] 211 Machine Learning Model

[0033] 22 Signal Detection Department

[0034] 23 Operation and Inspection Department

[0035] 24 Storage Units Detailed Implementation

[0036] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. Furthermore, the present invention is not limited to the following embodiments; various modifications can be made according to design and other factors to achieve the desired effects.

[0037] [Implementation Method 1]

[0038] First, the operation control system 1 of the electronic device in Embodiment 1 will be described.

[0039] [1-1. Overall Structure]

[0040] [1-1-1. Overall Structure]

[0041] Figure 1 This is a structural block diagram illustrating the operation control system 1 of the electronic device in Embodiment 1. For example... Figure 1 As shown, the electronic device operation control system 1 of this embodiment includes: a cold storage 10 as the controlled object, a control unit 11, and a signal detection unit 12 for detecting electromagnetic wave signals. The electronic device operation control system 1 may also include an operation detection unit 13 for detecting human (user) operations and a storage unit 14 for storing information. Furthermore, the cold storage 10, control unit 11, signal detection unit 12, operation detection unit 13, and storage unit 14 may be separately configured, or partially or entirely integrated. For example, the control unit 11, signal detection unit 12, operation detection unit 13, and storage unit 14 may all be housed within the cold storage 10.

[0042] The cold storage 10 is an example of an electronic device controlled by the operation control system 1 of the electronic device of this embodiment. The cold storage 10 may also have a temperature detection unit (not shown) such as a sensor for detecting the temperature inside the storage (hereinafter also referred to as "temperature sensor inside the storage").

[0043] In addition, the cold storage 10 operates by switching between normal operation and energy-saving operation. The energy-saving operation raises the set temperature of each compartment (freezer or refrigerator, etc.) by only 1°C, for example. By operating the energy-saving operation when the load inside the storage is expected to be light, such as when food is not being handled, the power required for cooling operation is reduced, thus achieving both energy savings and reduced electricity bills.

[0044] The control unit 11 is connected to the signal detection unit 12. Based on information from the signal detection unit 12, it determines whether there are people around the cold storage 10 and controls the operation of the cold storage 10. Furthermore, the control unit 11 can be either a hardware circuit specifically designed to implement this function, or a circuit that implements this function by executing a program stored in memory using a processor. That is, the control unit 11 can also implement its function through the cooperation of hardware and software. Additionally, the program stored in memory can be provided either by recording it on a non-temporary recording medium such as a memory card, or by providing it through a communication line such as the Internet. The details of the judgments performed by the control unit 11 will be explained later.

[0045] The signal detection unit 12 detects wireless signals of electromagnetic waves. These wireless signals can also be signals used when communicating with external devices, for example, in WAN (Wide Area Network), LAN (Local Area Network), or short-range wireless communication (such as Wi-Fi or Bluetooth). The signal can also be a signal in the general radio frequency band with a wavelength of 1 mm or more.

[0046] The operation detection unit 13 detects human operations. Human operations can include, for example, opening and closing the door of the cold storage 10, pressing a switch, or other operations on the cold storage 10 itself, such as turning on the lights, opening and closing the entrance door, or operating household appliances. That is, the operation detection unit 13 can also function as a door opening and closing detection unit to detect the opening and closing of the door of the cold storage 10.

[0047] The storage unit 14 stores historical information of signals detected by the signal detection unit 12 and historical information of human operations detected by the operation detection unit 13. The storage unit 14 may also be the memory present in the cold storage 10. Alternatively, the storage unit 14 may be installed on a server, and the control unit 11 may access the storage unit 14 via a network.

[0048] [1-2. Actions]

[0049] [1-2-1. Overall Movement]

[0050] Next, use Figure 2 The operation of the control system 1 of the cold storage 10 in Implementation Method 1 is explained.

[0051] Figure 2 This is a flowchart illustrating the operation control process of the cold storage 10. If the power is turned on in S111, the cold storage 10 will operate normally (S112).

[0052] In the temperature judgment step (S113), the temperature detection unit measures the internal temperature of the cold storage 10, and the control unit 11 determines whether the internal temperature is within the specified temperature range. Furthermore, the "specified temperature" is appropriately set based on the functions of the freezer compartment, cold storage compartment, etc., such as a freezing temperature range of approximately -18°C and a refrigeration temperature range of approximately 3°C. The "specified temperature" can have a certain range, such as -18°C to -20°C or 2°C to 4°C, and is hereinafter referred to as the "specified temperature range".

[0053] If, in the temperature determination step (S113), it is determined that the internal temperature of the cold storage 10 is within the specified temperature range (S113: "Yes"), the control unit 11 performs the human detection step (S114). In the human detection step (S114), based on the information from the signal received by the signal detection unit 12, the control unit 11 determines whether there is a person around the cold storage 10.

[0054] If, during the human detection step (S114), it is determined that a person is not in the vicinity of the cold storage 10 (S114: No person present), the control unit 11 switches the operation of the cold storage 10 to power-saving operation (S116). Alternatively, it can be set as follows: the control unit 11 repeatedly performs human detection, and if it determines that no one is present for a specified period or a specified number of times, it switches the operation to power-saving operation.

[0055] In the human detection step (S114), if it is determined that a human is present in the vicinity of the cold storage 10 (S114: Human Present), the control unit 11 performs the operation history determination step (S115). The operation history determination step (S115) is an example of the second determination of the present invention.

[0056] In the operation history judgment step (S115), the control unit 11 determines whether the number of times the door of the cold storage 10 is opened and closed, as detected by the operation detection unit 13, is less than a predetermined number within a specified period. If it is determined that the number of times the door is opened and closed is less than the predetermined number (S115: "Yes"), the control unit 11 switches the operation of the cold storage 10 to power-saving operation (S116). By setting the judgment of the number of door opening and closing (S115), it is possible to prevent the actions of pets or automatic vacuum cleaners from being mistakenly detected as human actions and thus preventing the switch to power-saving operation.

[0057] If the operation history judgment step (S115) determines that the number of times the door has been opened and closed exceeds a predetermined number (S115: "No"), the power-saving operation switch is not performed, and the internal temperature judgment step (S113) is performed again at a predetermined time. Alternatively, if the operation history judgment step (S115) determines that the number of times the door has been opened and closed exceeds a predetermined number (S115: "No"), the human detection step (S114) can also be performed again at a predetermined time.

[0058] [1-2-2. Human Testing Procedures]

[0059] Figure 3 This is a flowchart illustrating the process of the human detection step (S114). In the human detection step (S114), the presence of a person around the cold storage 10 is determined based on the information from the signal detected by the signal detection unit 12.

[0060] First, in the signal input step (S121), the information of the signal received by the signal detection unit 12 is input to the control unit 11.

[0061] Next, in the signal evaluation step (S122), the control unit 11 calculates the human motion component (hereinafter referred to as the human component) contained in the information from the signal received during the specified period, and assigns an evaluation value based on the magnitude of the human component. For example, the control unit 11 assigns an evaluation value of 15 levels to the signal information based on the magnitude of the human component detected in the information from the signal received over 5 minutes.

[0062] Next, in the "whether anyone is present" step (S123), the control unit 11 determines whether anyone is present around the cold storage 10 by comparing the evaluation value calculated in the signal evaluation step (S122) with a threshold. The "whether anyone is present" step (S123) is an example of the first determination of the present invention.

[0063] In the "whether someone is present" step (S123), the control unit 11 may also compare multiple evaluation values ​​within a specified period with a threshold, and determine whether someone is present based on whether the number of evaluation values ​​exceeding the threshold (e.g., 4) exceeds a predetermined number of times (e.g., 2 times). Furthermore, the number of evaluation values ​​exceeding the threshold exceeding a predetermined number of times is an example of the first condition of the present invention.

[0064] For example, Figure 4 This example illustrates a 30-minute period with six evaluation values ​​calculated every 5 minutes. In Data 1, since the evaluation value exceeding the threshold only occurs once at time 4, the system is considered empty during that 30-minute period. On the other hand, in Data 2, since the evaluation value exceeding the threshold occurs three times at times 2, 3, and 6, the system is considered occupied during that 30-minute period.

[0065] In the "whether anyone is present" step (S123), if it is determined that no one is present (S123: no one is present), the control unit 11 may also perform an operation history confirmation step (S124). In the operation history confirmation step (S124), the control unit 11 determines whether the operation detection unit 13 has detected any human operation within a specified period. That is, in the operation history confirmation step (S124), it determines whether the number of human operations detected by the operation detection unit 13 within the specified period is less than a specified number (1 time in this example). The operation history confirmation step (S124) is an example of the third determination of the present invention.

[0066] In the operation history confirmation step (S124), if it is determined that the operation detection unit 13 did not detect any human operation within the specified period (S124: "Yes"), the control unit 11 determines that the person is not present around the cold storage 10 (S125). On the other hand, in the operation history confirmation step (S124), if human operation was detected within the specified period (S124: "No"), it is determined that the person is present around the cold storage 10 (S126).

[0067] [1-2-2-1. Signal Evaluation Steps]

[0068] Next, use Figure 5 An example of the process of detecting human components and calculating evaluation values ​​based on the input signal information in the signal evaluation step (S122) will be explained. Figure 5 This is a flowchart illustrating the calculation process of the evaluation value in Implementation Method 1.

[0069] First, in the signal input step (S131), the signal detection unit 12 detects the signal used for communication with external devices such as routers, and inputs signal information such as signal strength (RSSI) and channel information (CSI) to the control unit 11. The signal information can be input at a certain frequency, for example, once every 100ms. In addition, the frequency of the input signal is preferably set in the range of once every 1ms to once every 1s.

[0070] Next, in the noise removal step (S132), the control unit 11 performs noise removal operations on the information of the input signal. The noise removal operation may include filtering or removing deviation values, etc.

[0071] Next, in the evaluation value calculation step (S133), the control unit 11 calculates a long-term (e.g., 6 seconds) moving average and a short-term (e.g., 1 second) moving average for the input signal information. Since the human component caused by human movement appears as a short-term sway, by calculating the difference between the short-term moving average and the long-term moving average, the influence of the surrounding environment can be removed from the signal information and the human component can be extracted.

[0072] In the example above, 6 seconds is used as the long-term moving average and 1 second is used as the short-term moving average, but this length can be varied. By extending the length, false detections caused by external noise can be reduced; by shortening the length, the time from when a person enters the vicinity to when they are detected can be reduced.

[0073] Furthermore, the above example illustrates the use of the intensity information of the detected signal for analysis, but it is not limited to this; analysis can also be performed using the phase or amplitude of the signal.

[0074] In addition, it can not only determine whether someone is present, but also perform analyses such as estimating the distance between the cold storage 10, the signal detection unit 12, and the person. For example, if the cold storage 10 includes a camera for filming inside the storage, the distance between the cold storage 10 and the person can be analyzed. If it is determined that the person is closer than a predetermined distance, the camera can be activated. Thus, the camera can be positioned to film inside the cold storage 10 when the person opens the door.

[0075] [1-2-2-2. Threshold Update]

[0076] In step S123, the threshold used for determining whether someone is present can be updated at specified times. By updating the threshold at specified times, the influence of the surrounding environment, such as the arrangement of objects around the location of the signal detection unit 12 or the cold storage 10, and the material of the walls or floors, can be taken into account to determine whether someone is present, thus improving the accuracy of the determination. For example, the threshold can be updated repeatedly once a week, once a month, or at the time when a person performs a specified operation, thereby also being able to cope with environmental changes such as changes in furniture arrangement.

[0077] Here, use Figure 6 The threshold update process is explained. Figure 6 This is a flowchart illustrating the threshold update process in Implementation 1.

[0078] The threshold can be updated using historical data of the evaluation value calculated in the signal evaluation step (S122) and historical data of human operations detected by the operation detection unit 13. Therefore, the storage unit 14 can store historical data of the evaluation value and historical data of human operations. Furthermore, the data used for threshold updating is not limited to this; historical data of the signal detected by the signal detection unit 12 itself can also be used.

[0079] In the data integration step (S141), the control unit 11 obtains historical data of evaluation values ​​and historical data of human operations from the storage unit 14, and calculates the evaluation value and the number of human operations for each specified period.

[0080] In the data extraction step (S142), the control unit 11 extracts information from multiple signals detected by the signal detection unit 12 during periods when no human operation is performed. Therefore, data from periods when it is assumed that no human is present around the cold storage 10 can be used for threshold updates.

[0081] Figure 7 This is a table showing examples of data used in the threshold update process of Implementation 1. Figure 7 This represents the average value of the evaluation value of the signal detected by the signal detection unit 12 and the number of times the operation detection unit 13 detects human operations every hour. For example, if a human operation occurs at time 1, it can be inferred that the human is present in the vicinity of the cold storage 10, so the evaluation value at time 1 is not used for threshold updating. On the other hand, if the number of human operations at time 4 and the times before and after this time is less than 1, it can be inferred that the human is not present in the vicinity of the cold storage 10, so the evaluation value at time 4 is used for threshold updating.

[0082] In addition to the condition that the number of human operations at that moment and the moments before and after it is less than 1, the data extraction condition can also be that there are no human operations at that moment.

[0083] In the threshold update step (S143), the control unit 11 updates the threshold based on the extracted multiple evaluation values. The updated threshold can utilize the average or mode, median, 25% value, 75% value, etc. of the extracted multiple evaluation values.

[0084] In addition, threshold updates can be implemented regularly, for example, every week or every month, or at any time based on user actions.

[0085] The data used for analysis can be data from a specified period such as one week, all data since the last threshold update operation, or data since a user-specified time. Furthermore, if the amount of data available for threshold updating is less than the specified value, the control unit 11 may choose not to perform a threshold update or notify that there is insufficient data.

[0086] [1-3. Effects, etc.]

[0087] As described above, the electronic device operation control system 1 in Embodiment 1 of the present invention includes: an electronic device (cold storage 10) as the object of control, a signal detection unit 12 for detecting electromagnetic wave signals, and a control unit 11 for controlling the operation of the electronic device. The control unit 11 performs a first determination to determine whether the information of the signal detected by the signal detection unit 12 satisfies a first condition indicating that a person is present in the vicinity of the electronic device, and controls the operation of the electronic device based at least on the determination result of the first determination.

[0088] Therefore, it is possible to control the operation of electronic devices based on the presence or absence of a person determined by the information in the signal.

[0089] Furthermore, the operation control system 1 of the electronic device may also include an operation detection unit 13 that detects user operations. Additionally, the control unit 11 may perform a second determination to determine whether the user operation information detected by the operation detection unit 13 meets a second condition, and control the operation of the electronic device based on the determination results of the first and second determinations. Alternatively, the second condition may be that the number of user operations detected by the operation detection unit 13 within a specified period is less than a specified number.

[0090] Therefore, in addition to signal information, the historical records of human operations can also be used to determine the presence or absence of a person, and the accuracy of the determination of the presence or absence of a person can be improved.

[0091] Furthermore, in the first determination, if the information indicating a signal does not meet the first condition, the control unit 11 may also perform a third determination to determine whether the information indicating a user's operation detected by the operation detection unit 13 meets the third condition, and control the operation of the electronic device based on the result of the third determination. Additionally, the third condition may be that the number of user operations detected by the operation detection unit 13 within a specified period is less than a specified number.

[0092] Therefore, even if the movement of non-human objects such as pets or vacuum cleaners results in a false positive in the first signal-based judgment due to the absence of a person, the presence of a person can still be determined based on their historical activity. In other words, the accuracy of the presence / absence determination can be improved.

[0093] Furthermore, the first determination can be based on a comparison between an evaluation value calculated from information about the signals detected by the signal detection unit 12 and a predetermined threshold. Additionally, the evaluation value can be calculated based on information about the signals detected by the signal detection unit 12 over a predetermined period.

[0094] Therefore, the signal information can be easily evaluated in the control unit 11, and the processing load can be reduced.

[0095] In addition, the first judgment can be made by comparing multiple evaluation values ​​with the threshold.

[0096] Therefore, by checking whether someone is present at a certain frequency (e.g., once every 30 minutes), the load caused by processing can be reduced in the control unit 11.

[0097] Furthermore, the electronic device's operation control system 1 also includes a storage unit 14, which stores information about signals detected by the signal detection unit 12. Thresholds can be updated at predetermined times based on the signal information stored in the storage unit 14. Alternatively, the thresholds can also be updated based on information from the signal information stored in the storage unit 14 regarding times when the operation detection unit 13 has not detected any user operation within a predetermined period.

[0098] Therefore, it is possible to determine whether there is a person by taking into account the surrounding environment, such as the configuration of objects around the location where the electronic device or signal detection unit 12 is installed, and the material of the walls or floor, thus improving the accuracy of the judgment.

[0099] Furthermore, the signal detection unit 12 and the control unit 11 can be installed in the electronic device.

[0100] Therefore, no other equipment needs to be installed besides the electronic device, saving installation space and further reducing the time spent on setup. Furthermore, by integrating the signal detection unit 12 with the electronic device, the discrepancy between the installation location of the signal detection unit 12 and the installation location of the electronic device is eliminated, potentially improving the accuracy of detecting people around the electronic device.

[0101] In addition, the electronic device is the cold storage 10, and the control unit 11 can switch between normal operation and power-saving operation of the cold storage 10 based on the judgment result of the first judgment.

[0102] Therefore, depending on whether someone is present, the cold storage 10 can be switched between normal operation and power-saving operation, and the electricity required for the operation of the cold storage 10 can be saved.

[0103] Alternatively, the electronic device may be the cold storage 10, and the operation detection unit 13 may be a door opening and closing detection unit of the cold storage 10 that detects the opening and closing of the door of the cold storage 10.

[0104] Therefore, the information from the opening and closing of the user's door can be used to determine whether a person is present, thus improving the accuracy of the presence determination.

[0105] In addition, the electronic device can be the cold storage 10, and the operation detection unit 13 can also detect the user's operation of other electronic devices besides the cold storage 10.

[0106] Therefore, even if the user does not operate the cold storage 10, such as operating other electronic devices at home, it can be determined that the user is in the vicinity of the cold storage 10.

[0107] Alternatively, the signal detection unit 12 can also be installed in a camera that is separate from the cold storage 10.

[0108] Therefore, when the cold storage 10 includes a camera with wireless communication capabilities, it is not necessary to install a separate signal detection unit 12 from the camera.

[0109] In addition, the cold storage 10 may also include a temperature detection unit such as an internal temperature sensor for detecting the internal temperature, and the control unit 11 makes a first determination when the internal temperature detected by the temperature detection unit is a predetermined temperature.

[0110] Therefore, when the temperature inside the cold storage is at a suitable level, it can operate in an energy-saving manner and properly preserve the food inside.

[0111] In addition, the signal detected by the signal detection unit 12 can also be the signal used by the cold storage 10 to communicate with external devices.

[0112] Therefore, the signal detection unit 12, which is set up for communication with external devices, can be used for human detection without having to reset the signal detection unit 12.

[0113] (Other implementation methods)

[0114] In Embodiment 1, the operation of the cold storage 10 was switched to power-saving operation. However, the electronic devices controlled by the electronic device operation control system 1 of Embodiment 1 are not limited to the cold storage. Examples of controlled electronic devices include washing machines, heating cookers, air conditioners, lighting, air purifiers, televisions, and surveillance cameras. Furthermore, the controlled operation is not limited to switching between normal operation and power-saving operation; it can also include device start-up, changes in illuminance / brightness, unlocking of electronic device doors, and stopping of operation.

[0115] The above description illustrates the scenario where the control unit 11 performs all signal information processing. However, the signal detection unit 12 may also perform some or all of the above processing. For example, the signal detection unit 12 may calculate an evaluation value and output the calculated evaluation value to the control unit 11, or the signal detection unit 12 may determine whether someone is present and output the determination result to the control unit 11.

[0116] The above description explains that the operation detection unit 13 detects the opening and closing of the door of the refrigerator 10 as a human operation, but the human operation detected by the operation detection unit 13 is not limited to this. For example, it could be the opening and closing of a room door or an entrance door, or the operation of other equipment outside the refrigerator 10, such as a microwave oven or other cooking appliances, or lighting in the space where the refrigerator 10 is located. Alternatively, the refrigerator 10 could be a structure where the operation detection unit 13 obtains information from external devices via network communication to detect the operation information of equipment outside the refrigerator 10.

[0117] Furthermore, the signal detection unit 12 is provided for connecting the cold storage 10 to the network, and can also be equipped in other devices. For example, if the cold storage 10 has a camera (not shown) for filming inside the storage, and the camera has network connectivity, the signal detection unit 12 can also be installed in the camera for camera communication.

[0118] [Implementation Method 2]

[0119] Next, the operation control system 2 of the electronic device in Embodiment 2 will be described.

[0120] Figure 8 This is a structural block diagram illustrating the operation control system 2 of the electronic device in Embodiment 2. For example... Figure 8 As shown, the electronic device operation control system 2 of this embodiment includes a cold storage unit 20 as the controlled object, a control unit 21, and a signal detection unit 22 for detecting electromagnetic wave signals. The electronic device operation control system 2 may also include an operation detection unit 23 for detecting human (user) operations and a storage unit 24 for storing information. Furthermore, the cold storage unit 20, control unit 21, signal detection unit 22, operation detection unit 23, and storage unit 24 can be configured separately, or partially or entirely as a single unit. For example, the control unit 21, signal detection unit 22, operation detection unit 23, and storage unit 24 can all be housed within the cold storage unit 20.

[0121] The cold storage 20 is an example of an electronic device controlled by the operation control system 2 of the electronic device of this embodiment. The cold storage 20 may include a temperature detection unit (not shown) such as an internal temperature sensor for detecting the internal temperature.

[0122] In addition, the cold storage 20 operates by switching between normal operation and energy-saving operation. The energy-saving operation raises the set temperature of each compartment (freezer or refrigerator, etc.) by only 1°C, for example. By operating the energy-saving operation when the load inside the storage is expected to be light, such as when food is not being handled, the power required for cooling operation is reduced, thus achieving both energy savings and reduced electricity bills.

[0123] The control unit 21 has a machine learning model 211. The machine learning model 211 uses machine learning techniques such as convolutional neural networks and deep learning to learn the correlation between the information of the signals detected by the signal detection unit 22 and whether there are people in the vicinity of the cold storage 20. Furthermore, the control unit 21 can be a hardware circuit specifically designed to implement this function, or it can be a circuit that implements this function by having a processor execute a program stored in memory. That is, the control unit 21 can also implement its function through the cooperation of hardware and software. In addition, the program stored in memory can be provided either by recording it on a non-temporary recording medium such as a memory card, or by providing it through communication lines such as the Internet.

[0124] The control unit 21 inputs the signal information detected by the signal detection unit 22 into the machine learning model 211 to determine whether there are people around the cold storage 20, and controls the operation of the cold storage 20 based on the judgment result.

[0125] The signal detection unit 22 detects wireless signals of electromagnetic waves. These wireless signals can also be signals used when communicating with external devices, for example, in WAN (Wide Area Network), LAN (Local Area Network), or short-range wireless communication (e.g., Wi-Fi (Wireless Fidelity) or Bluetooth). The signal can also be a signal in the general radio frequency band with a wavelength of 1 mm or more.

[0126] The operation detection unit 23 detects human operations. Human operations can include, for example, opening and closing the door of the cold storage 20, pressing a switch, or other operations on the cold storage 20 itself, such as turning on the lights, opening and closing the entrance door, or operating household appliances. In other words, the operation detection unit 23 can function as a door opening and closing detection unit to detect the opening and closing of the door of the cold storage 20.

[0127] The storage unit 24 stores historical information of signals detected by the signal detection unit 22 and historical information of human operations detected by the operation detection unit 23. The storage unit 24 can be a memory device present in the cold storage 20. Alternatively, the storage unit 24 can be installed on a server, and the control unit 21 accesses the storage unit 24 via a network.

[0128] [2-2. Action]

[0129] [2-2-1. Overall Movement]

[0130] Next, use Figure 9 The operation of the control system 2 of the cold storage 20 in Embodiment 2 is explained.

[0131] Figure 9 This is a flowchart illustrating the operation control process of the cold storage 20. If the power is turned on in S211, the cold storage 20 will operate normally (S212).

[0132] In the temperature judgment step (S213), the temperature detection unit measures the internal temperature of the cold storage 20, and the control unit 21 determines whether the internal temperature is within the specified temperature range.

[0133] If, in the temperature determination step (S213), it is determined that the internal temperature of the cold storage 20 is within the specified temperature range (S213: "Yes"), the control unit 21 proceeds to the human detection step (S214). In the human detection step (S214), based on the signal information received by the signal detection unit 22, the control unit 21 determines whether there are any people around the cold storage 20.

[0134] In the human detection step (S214), if it is determined that a person is not in the vicinity of the cold storage 20 (S214: No person), the control unit 11 switches the operation of the cold storage 20 to power-saving operation (S216). Alternatively, it can be set as follows: the control unit 21 repeatedly performs human detection, and if it determines that no one is present for a specified period or a specified number of times, it switches the operation to power-saving operation.

[0135] In the human detection step (S214), if it is determined that a human is present in the vicinity of the cold storage 20 (S214: Human Present), the control unit 21 performs the operation history record determination step (S215). The operation history record determination step (S115) is an example of the second determination of the present invention.

[0136] In the operation history judgment step (S215), the control unit 21 determines whether the number of times the door of the cold storage 20 is opened and closed, as detected by the operation detection unit 23, is less than the predetermined number within a specified period. If it is determined that the number of door opening and closing times is less than the predetermined number (S215: "Yes"), the control unit 21 switches the operation of the cold storage 20 to power-saving operation (S216). By setting the judgment of the number of door opening and closing times (S215), it is possible to prevent the actions of pets or automatic vacuum cleaners from being mistakenly detected as human actions and thus preventing the switch to power-saving operation.

[0137] If, in the operation history judgment step (S215), it is determined that the number of times the door has been opened and closed exceeds a predetermined number (S215: "No"), the power-saving operation switch is not performed, and the internal temperature judgment step (S213) is performed again at a predetermined time. Alternatively, if, in the operation history judgment step (S215), it is determined that the number of times the door has been opened and closed exceeds a predetermined number (S215: "No"), the human detection step (S214) can also be performed again at a predetermined time.

[0138] [2-2-2. Human Detection Procedure]

[0139] Figure 10 This is a flowchart illustrating the human detection step (S214). In the human detection step (S214), based on the information from the signals detected by the signal detection unit 22, the machine learning model 211 determines whether there are people around the cold storage 20.

[0140] First, in the signal input step (S221), the information of the signal received by the signal detection unit 22 is input to the control unit 21.

[0141] Next, in the determination step (S223) regarding whether someone is present, the control unit 21 inputs the information of the input signal into the machine learning model 211, thereby obtaining a determination result regarding whether someone is present as output. The machine learning model 211 provides the signal information in association with the presence of a person as training data, thereby learning the association between the signal information and the presence of a person. The determination step (S223) regarding whether someone is present is an example of the first determination of the present invention.

[0142] In the "whether someone is present" step (S223), if it is determined that no one is present (S223: no one is present), the control unit 21 can also perform an operation history confirmation step (S224). In the operation history confirmation step (S224), the control unit 21 determines whether the operation detection unit 23 has detected any human operation within a specified period. That is, in the operation history confirmation step (S224), it determines whether the number of human operations detected by the operation detection unit 23 within the specified period is less than a specified number (1 time in this example). The operation history confirmation step (S224) is an example of the third determination of the present invention.

[0143] If, in the operation history confirmation step (S224), the operation detection unit 23 determines that no human operation was detected within the specified period (S224: "Yes"), the control unit 21 determines that the person is not in the vicinity of the cold storage 20 (S225). On the other hand, if, in the operation history confirmation step (S224), human operation was detected within the specified period (S224: "No"), then it is determined that the person is in the vicinity of the cold storage 20 (S226).

[0144] [2-2-2-1. Learning Machine Learning Models]

[0145] The machine learning model 211 can learn during the system's manufacturing process, but it can also continue to learn while the user is using the operation control system 2. By learning based on data from the user's operating environment, it can consider the influence of the surrounding environment, such as the configuration of objects around the location of the signal detection unit 22 or the cold storage 20, and the material of the walls or floors, to determine whether a person is present, thus improving the accuracy of the judgment.

[0146] When the machine learning model 211 learns during human operation of the operation control system 2, a structure in which learning is performed automatically based on information obtained from the signal detection unit 22 and the operation detection unit 23 can also be adopted. That is, the machine learning model 211 can also learn the correspondence between the information of the signals detected by the signal detection unit 22 and the information of the user's operation detected by the operation detection unit 23.

[0147] Figure 11 This is a flowchart illustrating the process of machine learning model 211 learning during the period when a person uses the system.

[0148] First, in the data acquisition step (S231), the data of the signal detected by the signal detection unit 22 stored in the storage unit 24 and the data of the human operation history detected by the operation detection unit 23 are input to the control unit 21.

[0149] Next, in the training data generation step (S232), the control unit 21 determines whether there are people in each time period based on the input operation history data, and generates training data for the machine learning model 211 to learn by combining the data of the signals detected in each time period.

[0150] For example, by observing the time period surrounding the time when someone's actions are recorded, it can be inferred that a person is present in the vicinity of the cold storage 20. On the other hand, by observing the time period surrounding the time when no human actions are recorded within a specified period, it can be inferred that no one is present in the vicinity of the cold storage 20. Using this, the machine learning model 211 can learn the correlation (correspondence) between the information of whether someone is present in the vicinity of the cold storage 20 and the information of the signal detected by the signal detection unit 22.

[0151] Alternatively, noise removal and other processing can be performed on the signal data detected by the signal detection unit 22 in advance.

[0152] Next, in the training data input step (S233), the generated learning data is input into the machine learning model 211, so that the machine learning model 211 learns the correlation (correspondence) between the data of the signal detected by the signal detection unit 22 and whether there is a person.

[0153] In addition to determining whether someone is present, the machine learning model 211 can also determine the distance to a person. That is, even if the control unit 21 determines that someone is present, it can infer that the person is near the cold storage 20 before or after the person operates on the cold storage 20 (such as opening or closing the cold storage door).

[0154] By determining the distance to a person, the cold storage 20 or other electronic equipment can perform a specified action before the person operates the cold storage 20 or the operation detection unit 23.

[0155] For example, if the cold storage 20 includes a camera for filming inside the storage, the camera is activated when it is determined that a person is nearby, thereby enabling filming inside the storage when a person opens the door of the cold storage 20.

[0156] [2-3. Effects, etc.]

[0157] As described above, the electronic device operation control system 2 in Embodiment 2 of the present invention includes: an electronic device (cold storage 20) as the controlled object, a signal detection unit 22 for detecting electromagnetic wave signals, and a control unit 21 for controlling the operation of the electronic device. The control unit 21 inputs the information of the signal detected by the signal detection unit 22 into a machine learning model 211, performs a first judgment to determine whether there is a person in the vicinity of the electronic device, and controls the operation of the electronic device based on the judgment result of the first judgment.

[0158] Therefore, it is possible to control the operation of electronic devices based on the presence or absence of a person determined by the information in the signal.

[0159] Furthermore, the operation control system 2 of the electronic device may also include an operation detection unit 23 that detects user operations. The control unit 21 may also perform a second determination to determine whether the information of the user's operation detected by the operation detection unit 23 meets a second condition, and control the operation of the electronic device based on the determination results of the first and second determinations. Alternatively, the second condition may be that the number of user operations detected by the operation detection unit 23 within a specified period is less than a specified number.

[0160] Therefore, in addition to signal information, the historical records of human operations can also be used to determine the presence or absence of a person, and the accuracy of the determination of the presence or absence of a person can be improved.

[0161] Furthermore, if the machine learning model 211 determines in the first judgment that someone is nearby when the electronic device is detected, the control unit 21 can also perform a third judgment to determine whether the user's operation information detected by the operation detection unit 23 meets the third condition, and control the operation of the electronic device based on the judgment result of the third judgment. The third condition can be that the number of user operations detected by the operation detection unit 23 within a specified period is less than a specified number.

[0162] Therefore, by observing the movement of objects other than people, such as pets or vacuum cleaners, the possibility of being mistaken for someone is reduced, even if the person is not present.

[0163] Furthermore, the machine learning model 211 can also learn the correspondence between signal information and user operation information detected by the operation detection unit 23. Additionally, the machine learning model 211 can consider the moment when the operation detection unit 23 detects the user's operation as the moment when someone is near the electronic device, and learn the correspondence between signal information and the presence or absence of people.

[0164] Therefore, learning can continue even while the user is using the operation control system 2. By learning from data about the user's environment, the system can consider the influence of the surrounding environment, such as the arrangement of objects around the location of the signal detection unit 22 or the cold storage 20, and the material of the walls or floors, to determine the presence of a person, thus improving the accuracy of the judgment.

[0165] Alternatively, the signal detection unit 22 and the control unit 21 may also be installed in the electronic device.

[0166] Therefore, no other equipment needs to be installed besides the electronic device, saving installation space and further reducing the time spent on setup. Furthermore, by integrating the signal detection unit 22 with the electronic device, the discrepancy between the installation location of the signal detection unit 22 and the installation location of the electronic device is eliminated, potentially improving the accuracy of detecting people around the electronic device.

[0167] In addition, the electronic device is the cold storage 20, and the control unit 21 can switch between normal operation and power-saving operation of the cold storage 20 based on the judgment result of the first judgment.

[0168] Therefore, depending on whether a person is present, the cold storage 20 can be switched between normal operation and power-saving operation, and the electricity required for the operation of the cold storage 20 can be saved.

[0169] Alternatively, the electronic device may be the cold storage 20, and the operation detection unit 23 may be a door opening and closing detection unit of the cold storage 20 that detects the opening and closing of the door of the cold storage 20.

[0170] Therefore, the information from the opening and closing of the user's door can be used to determine whether a person is present, thus improving the accuracy of the presence / absence determination.

[0171] In addition, the electronic device is the cold storage 20, and the operation detection unit 23 can also detect the user's operation of other electronic devices besides the cold storage 20.

[0172] Therefore, even if the user does not operate the cold storage 20, for example, if they operate other electronic devices at home, it can be determined that the user is in the vicinity of the cold storage 20.

[0173] Alternatively, the signal detection unit 22 can also be installed in a camera that is separate from the cold storage 20.

[0174] Therefore, when the cold storage 20 includes a camera with wireless communication capabilities, the signal detection unit 22 does not need to be installed separately from the camera.

[0175] In addition, the cold storage 20 may also include a temperature detection unit such as an internal temperature sensor for detecting the internal temperature, and the control unit 21 may make a first determination when the internal temperature detected by the temperature detection unit is a predetermined temperature.

[0176] Therefore, when the temperature inside the cold storage is appropriate, it can operate in an energy-saving manner and properly preserve the food inside.

[0177] In addition, the signal detected by the signal detection unit 22 can also be the signal used by the cold storage 20 to communicate with external devices.

[0178] Therefore, the signal detection unit 22, which is set up for communicating with external devices, can be used for human detection without the need to reset the signal detection unit 22.

[0179] (Other implementation methods)

[0180] In Embodiment 2, the operation of the cold storage 20 is switched to power-saving operation. However, the electronic devices controlled by the operation control system 2 of Embodiment 2 are not limited to the cold storage. Examples of controlled electronic devices include washing machines, electric cookers, air conditioners, and surveillance cameras. Furthermore, the controlled operation is not limited to switching between normal and power-saving operation; it can also include starting the machine, unlocking the door, or stopping the operation.

[0181] The above description explains that the operation detection unit 23 detects the opening and closing of the door of the cold storage 20 as a human operation, but the human operation detected by the operation detection unit 23 is not limited to this. For example, it could be the opening and closing of a room door or an entryway door, or the operation of other equipment outside the cold storage 20, such as a microwave oven or other cooking appliances, or lighting in the space where the cold storage 20 is located. Alternatively, the cold storage 20 could also be structured such that the operation detection unit 23 obtains information from external devices via network communication, thereby detecting the operation information of equipment outside the cold storage 20.

[0182] Alternatively, the signal detection unit 22 can be installed to connect the cold storage 20 to a network, or it can be installed in other devices. For example, if the cold storage 20 has a camera (not shown) for filming inside the storage room, and the camera has network connectivity, the signal detection unit 22 can also be installed in the camera for camera communication.

[0183] Industrial availability

[0184] This invention is applicable to systems that can use electromagnetic wave signals to control the operation of electronic devices.

Claims

1. An operation control system for an electronic device, characterized in that, include: Electronic devices as objects of control; A signal detection unit for detecting electromagnetic wave signals; and A control unit that controls the operation of the electronic device. The control unit makes a first determination and controls the operation of the electronic device based at least on the determination result of the first determination, wherein the first determination is to determine whether the information of the signal detected by the signal detection unit satisfies a first condition indicating that a person is present in the vicinity of the electronic device.

2. The operation control system for the electronic device as described in claim 1, characterized in that: The operation control system of the electronic device also includes an operation detection unit that detects user operations. The control unit performs a second determination and controls the operation of the electronic device based on the determination results of the first determination and the second determination. The second determination is to determine whether the information of the user's operation detected by the operation detection unit meets the second condition.

3. The operation control system for the electronic device as described in claim 2, characterized in that: The second condition is that the number of times the user's operation is detected by the operation detection unit within a specified period is less than a specified number.

4. The operation control system for the electronic device as described in claim 2, characterized in that: If the information of the signal is determined not to meet the first condition in the first determination, the control unit performs a third determination and controls the operation of the electronic device based on the determination result of the third determination. The third determination is to determine whether the information of the user's operation detected by the operation detection unit meets the third condition.

5. The operation control system for the electronic device as described in claim 4, characterized in that: The third condition is that the number of times the operation detection unit detects the user performing the operation within a specified period is less than a specified number.

6. The operation control system for the electronic device as described in claim 1, characterized in that: The first determination is based on a comparison between an evaluation value calculated from the information of the signal detected by the signal detection unit and a predetermined threshold.

7. The operation control system for the electronic device as described in claim 6, characterized in that: The evaluation value is calculated based on the information of the signal detected by the signal detection unit during the specified period.

8. The operation control system for the electronic device as described in claim 6, characterized in that: The first determination is based on a comparison of the plurality of evaluation values ​​with the threshold.

9. The operation control system for the electronic device as described in claim 6, characterized in that: The operation control system of the electronic device further includes a storage unit that stores information about the signals detected by the signal detection unit. The threshold is updated at predetermined times based on the information of the signal stored in the storage unit.

10. The operation control system of the electronic device as described in claim 9, characterized in that: The operation control system of the electronic device also includes an operation detection unit that detects user operations. The threshold is updated based on the information in the signal stored in the storage unit, specifically the time when the operation detection unit does not detect the user's operation within a specified period.

11. The operation control system of the electronic device as described in claim 1, characterized in that: The signal detection unit and the control unit are disposed in the electronic device.

12. The operation control system of the electronic device as described in any one of claims 1 to 11, characterized in that: The electronic device is a cold storage unit, and the control unit switches between normal operation and power-saving operation of the cold storage unit based at least on the judgment result of the first judgment.

13. The operation control system for an electronic device as described in claim 2, 3, 4, 5, or 10, characterized in that: The electronic device is a cold storage room, and the operation detection unit is a door opening and closing detection unit installed in the cold storage room to detect the opening and closing of the cold storage room door.

14. The operation control system of the electronic device as described in claim 2, 3, 4, 5 or 10, characterized in that: The electronic device is a cold storage unit, and the operation detection unit detects the operations performed by the user on other electronic devices besides the cold storage unit.

15. The operation control system for an electronic device as described in claim 12, characterized in that: The signal detection unit includes a camera that is separate from the cold storage unit.

16. The operation control system for an electronic device as described in claim 12, characterized in that: The cold storage also includes a temperature detection unit to monitor the temperature inside the storage. The control unit makes the first determination when the temperature inside the warehouse detected by the temperature detection unit is a predetermined temperature.

17. The operation control system for an electronic device as described in claim 12, characterized in that: The signal is the signal used by the cold storage to communicate with external devices.

18. An operation control system for an electronic device, characterized in that, include: Electronic devices as the object of control; A signal detection unit for detecting electromagnetic wave signals; and A control unit that controls the operation of the electronic device. The control unit inputs the information of the signal detected by the signal detection unit into the machine learning model to make a first judgment on whether there is a person in the vicinity of the electronic device, and controls the operation of the electronic device based on the judgment result of the first judgment.

19. The operation control system of the electronic device as described in claim 18, characterized in that: The operation control system of the electronic device also includes an operation detection unit that detects user operations. The control unit performs a second judgment to determine whether the information of the operation performed by the user detected by the operation detection unit meets the second condition, and controls the operation of the electronic device based on the judgment results of the first judgment and the second judgment.

20. The operation control system of the electronic device as described in claim 19, characterized in that: The second condition is that the number of times the operation detection unit detects the user performing the operation within a specified period is less than the specified number.

21. The operation control system of the electronic device as described in claim 19, characterized in that: In the first determination, if the machine learning model determines that there is a person in the vicinity of the electronic device, the control unit performs a third determination to determine whether the information of the operation performed by the user detected by the operation detection unit satisfies the third condition, and controls the operation of the electronic device based on the determination result of the third determination.

22. The operation control system for the electronic device as described in claim 21, characterized in that: The third condition is that the number of times the operation detection unit detects the user performing the operation within a specified period is less than a specified number.

23. The operation control system of the electronic device as described in claim 19, characterized in that: The machine learning model learns the correspondence between the information of the signal and the information of the operation detected by the operation detection unit as the result of the user's operation.

24. The operation control system of the electronic device as described in claim 19, characterized in that: The machine learning model learns the correspondence between the signal information and the presence or absence of a person by taking the moment when the operation detection unit detects the operation performed by the user as the moment when a person is present in the vicinity of the electronic device.

25. The operation control system of the electronic device as described in claim 18, characterized in that: The signal detection unit and the control unit are disposed in the electronic device.

26. The operation control system of the electronic device as described in any one of claims 18 to 25, characterized in that: The electronic device is a cold storage unit, and the control unit switches between normal operation and power-saving operation of the cold storage unit based at least on the judgment result of the first judgment.

27. The operation control system of the electronic device as described in any one of claims 19 to 24, characterized in that: The electronic device is a cold storage room, and the operation detection unit is a door opening and closing detection unit installed in the cold storage room to detect the opening and closing of the cold storage room door.

28. The operation control system of the electronic device as described in any one of claims 19 to 24, characterized in that: The electronic device is a cold storage unit, and the operation detection unit detects the user's operations on other electronic devices besides the cold storage unit.

29. The operation control system for an electronic device as described in claim 26, characterized in that: The signal detection unit includes a camera that is separate from the cold storage unit.

30. The operation control system for an electronic device as described in claim 26, characterized in that: The cold storage also includes a temperature detection unit to monitor the temperature inside the storage. If the temperature inside the storage chamber detected by the temperature detection unit is a predetermined temperature, the control unit performs the first determination.

31. The operation control system of the electronic device as described in claim 26, characterized in that: The signal is the signal used by the cold storage to communicate with external devices.

Images