System, electrical outlet device, and method for monitoring the usage status of electrical appliances
The electrical outlet device with integrated current and audio detection, combined with a management server, addresses privacy and safety concerns by alerting only when unsafe appliance usage is detected, enabling independent living for the elderly.
Patent Information
- Application Number
- JP2024178951
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2023-10-30
- Filing Date
- 2024-10-11
- Publication Date
- 2025-11-12
- Estimated Expiration
- 2044-10-11
AI Technical Summary
Existing monitoring systems for elderly individuals' electrical appliance usage do not adequately address privacy concerns and fail to promptly alert relevant parties in case of accidents or unsafe usage.
An electrical outlet device with current and audio detection modules, coupled with a management server using machine learning algorithms, to monitor appliance usage and send alerts only when abnormal behavior is detected, respecting user privacy.
The system effectively monitors appliance usage, ensuring user safety by sending alerts only when unsafe behavior is detected, allowing elderly individuals to live independently while ensuring their safety.
Smart Images

Figure 0007768602000001 
Figure 0007768602000002
Abstract
Description
[Technical Field]
[0001] The present invention relates to a system, an electrical outlet device, and a method for monitoring the usage status of an electrical appliance. [Background technology]
[0002] As average life expectancy increases, the proportion of elderly people in the population is increasing year by year. Elderly people who are healthy, can take care of themselves, and value privacy often choose to live at home. However, memory, perception, and motor skills gradually decline with age, making elderly people more likely to have accidents at home (such as falls or accidents due to improper use of electrical appliances). Furthermore, when elderly people live alone, even if an accident occurs, they are unable to immediately notify relevant parties such as relatives, friends, or social workers, and these parties are unable to respond immediately.
[0003] The monitoring method and monitoring system based on the use of electrical appliances in a predetermined location disclosed in Patent Document 1 can monitor the living conditions of a user. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Taiwan Patent No. I766399 Summary of the Invention [Problem to be solved by the invention]
[0005] However, such monitoring methods and systems have room for further improvement.
[0006] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide a system, an electrical outlet device, and a method for monitoring the usage status of an electrical appliance that can alleviate at least one of the drawbacks of the prior art. [Means for solving the problem]
[0007] An electrical outlet device according to one aspect of the present invention includes an outlet module, a storage module, a current detection module, an audio receiving module, and a processing module.
[0008] The outlet module is configured to electrically connect to the electrical appliance and is operable to switch between a first state that allows power to be supplied to the electrical appliance and a second state that terminates power supply to the electrical appliance. The memory module stores current feature data associated with multiple reference values of the electrical appliance's operating current, the reference values corresponding to different operating modes of the electrical appliance. The current detection module is electrically connected to the outlet module and configured to continuously detect the current flowing through the electrical appliance and generate a current detection result. The audio receiving module receives sound from a location where the electrical appliance is placed and generates an audio result based on the received sound. The processing module is electrically connected to the outlet module, the memory module, the current detection module, and the audio receiving module and configured to generate audio feature data based on the audio result and generate event data related to the usage status of the electrical appliance based on the current feature data, the current detection result, and the audio feature data.
[0009] A system according to another aspect of the present invention includes the above-described electrical outlet device and a management server.
[0010] The management server includes a database, a storage unit, and a processing unit. The database stores user data related to users at a location, electrical appliance data related to electrical appliances, and service record data related to past usage states of the electrical appliances. The storage unit stores an action feature recognition model configured to recognize multiple action features related to users' actions using the electrical appliances. The action features and the action feature recognition model are derived and established by analyzing the user data and the service record data using a first machine learning algorithm based on multiple feature parameters respectively related to the user, the electrical appliance, and the environment in which the electrical appliance is located. The processing unit is signally connected to the processing module and electrically connected to the database and the storage unit.
[0011] The processing module transmits event data to the processing unit, and the processing unit uses an action feature recognition model to determine whether the event data received from the processing module matches any of the action features, and transmits a warning message to a user-side device associated with the user if it determines that the event data does not match any of the action features.
[0012] A method according to yet another aspect of the present invention is executed by the above-described system to monitor the usage status of an electrical appliance.
[0013] The method includes an electrical outlet device continuously detecting a current flowing through an electrical appliance and generating a current detection result, receiving sound at a location where the electrical appliance is placed and generating an audio result based on the received sound, the electrical outlet device generating audio feature data based on the audio result, generating event data related to the usage status of the electrical appliance based on the current feature data, the current detection result, and the audio feature data, transmitting the event data to a management server, the management server using an action feature recognition model to determine whether the received event data matches any of the action features, and if the management server determines that the event data does not match any of the action features, transmitting a warning message to a user-side device related to the user. [Effects of the Invention]
[0014] In summary, the electrical outlet device continuously transmits event data related to the usage status of the connected electrical appliances to the management server. The management server uses a behavioral feature recognition model to determine whether the received event data matches any of the behavioral features and predict whether the user's usage behavior of the electrical appliances is normal. This allows the user's life routine to be monitored while respecting the user's privacy. In other words, intervention in the user's life is only performed if there is a risk of the user's safety or health being compromised, allowing the user to live a more independent life while still taking safety into consideration.
[0015] Other features and advantages of the present invention will become apparent from the following detailed description of the embodiments, which proceeds with reference to the accompanying drawings. [Brief explanation of the drawings]
[0016] [Figure 1] 1 is a block diagram showing a system for monitoring the usage status of an electrical appliance according to an embodiment of the present invention; [Figure 2] 1 is a flowchart illustrating a method executed by a system for monitoring the usage status of an electrical appliance according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0017] As used herein, the terms "couple" or "connect" mean a direct connection between two or more electrical devices / apparatus / facilities by means of a conductive material (e.g., electrical wires) or an indirect connection between two electrical devices / apparatus / facilities by means of one or more other devices / apparatus / facilities or wireless communication.
[0018] 1, a system 100 for monitoring the usage status of at least one electrical appliance 200 according to an embodiment of the present invention is shown. The system 100 includes at least one electrical outlet device 1 and a management server 2. The at least one electrical appliance 200 and the at least one electrical outlet device 1 are used in a one-to-one configuration. That is, the same number of electrical outlet devices 1 as the number of the at least one electrical appliance 200 to be monitored must be used, and each electrical outlet device 1 corresponds to a respective electrical appliance 200. The at least one electrical appliance 200 may be used in a place such as a home.
[0019] Each of the at least one electrical outlet device 1 includes an outlet module 11, a storage module 12, a current detection module 13, an audio receiving module 14, an output module 15, and a processing module 16. For the sake of brevity, only one electrical outlet device 1 and one corresponding electrical product 200 will be described in detail below.
[0020] The outlet module 11 is configured to electrically connect to the electrical appliance 200 and is operable to switch between a first state that allows power to be supplied to the electrical appliance 200 and a second state that terminates power supply to the electrical appliance 200. Specifically, the electrical outlet device 1 is configured to electrically connect to a corresponding electrical appliance 200. The electrical appliance 200 may be, but is not limited to, a refrigerator, a rice cooker, or the like. In some embodiments, the outlet module 11 may be designed to include a pin portion (not shown) and a slot portion (not shown). The pin portion is configured to be plugged into a power socket (i.e., an AC power socket in a home) (not shown) that connects to a power grid (not shown), and the slot portion allows prongs of a power plug (not shown) of the electrical appliance 200 to be inserted therein. In such an embodiment, the outlet module 11 obtains power from the power grid via the power socket, but is not limited thereto. In other embodiments, the outlet module 11 may omit the pin portion and directly connect to the power grid, i.e., the outlet module 11 is fixed to an interior wall of a home as a substitute for a power socket, for example. The outlet module 11 can operate in a first state by a user manually connecting the electrical appliance 200 to the outlet module 11 (i.e., inserting the power plug of the electrical appliance 200 into the outlet module 11), and can operate in a second state by a user manually disconnecting the connection between the electrical appliance 200 and the outlet module 11 (i.e., unplugging the power plug of the electrical appliance 200 from the outlet module 11). In another example, the outlet module 11 includes a switch unit (e.g., a power switch) (not shown) operable to switch the outlet module 11 between the first state and the second state.
[0021] The current sensing module 13 is electrically connected to the outlet module 11 and configured to continuously sense the current flowing through the electrical appliance 200 and generate a power sensing result. In some embodiments, the current sensing module 13 can be implemented using a current sensor IC, a Hall sensor, a shunt resistor, or the like, but the present invention is not limited thereto. The audio receiving module 14 is positioned to receive sounds from the home where the electrical appliance 200 is located and generates an audio result based on the received sounds. In some embodiments, the audio receiving module 14 can be implemented using a microphone, a vibration sensor, a resonance sensor, or the like, but the present invention is not limited thereto. The output module 15 is used to generate a perceptible output (e.g., a visual output or an audible output). For example, the output module 15 may include, but is not limited to, a light-emitting diode (LED) device (not shown) for generating a visual output or a buzzer (not shown) for generating an audible output.
[0022] The storage module 12 stores current characteristic data related to a plurality of reference values (hereinafter referred to as reference operating current values) of the operating current of the electrical appliance 200, where the reference operating current values respectively correspond to different operating modes of the electrical appliance 200. In this embodiment, the storage module 12 further stores a house identifier uniquely corresponding to a house. In practice, the storage module 12 can obtain the house identifier and the current characteristic data through input from or download by a user operating a software application when the user first uses the system 100 or during the registration stage of the system 100. The current characteristic data may include, for example, the type and model of the electrical appliance 200, reference operating current values (or reference current thresholds) respectively corresponding to different operating modes, and reference operating current ranges. In one example, assume that electrical appliance 200 is a refrigerator with a reference operating current value of 30 mA when operating in a typical power saving mode (i.e., one of the different operating modes), a reference operating current value of 130 mA when the refrigerator door is open (i.e., another of the different operating modes), and a reference operating current value of 1500 mA when the compressor is operating (i.e., yet another of the different operating modes), then the reference operating current range is from 30 mA to 1500 mA.
[0023] The storage module 12 further stores an audio feature recognition model configured to recognize multiple audio features. The audio features and the audio feature recognition model are derived and established by analyzing audio results using a first machine learning algorithm (e.g., but not limited to, a neural network regression algorithm) based on multiple audio parameters, each associated with the environment in which the electrical outlet device 1 is located. More specifically, the audio results generated by the audio receiving module 14 include a voltage signal indicative of the sound received by the audio receiving module 14 and a time point at which the sound was received by the audio receiving module 14. Each audio feature recognized by the audio feature recognition model includes a time point, a duration of the sound, an amplitude of the sound, and an event associated with the sound. Note that the management server 2 may be signal-connected to the processing module 16 to transmit at least one audio parameter (e.g., time, amplitude, etc.) to the processing module 16, thereby enabling the processing module 16 to update the audio feature recognition model by training and fine-tuning the audio feature recognition model according to the at least one audio parameter.
[0024] The processing module 16 is electrically connected to the outlet module 11, the storage module 12, the current sensing module 13, the audio receiving module 14, and the output module 15. The processing module 16 will be described in more detail below.
[0025] The management server 2 includes a database 21, a storage unit 22, and a processing unit 23. The processing unit 23 is electrically connected to the database 21 and the storage unit 22 and is signally connected to the processing module 16 of the electrical outlet device 1. For example, the management server 2 may be implemented as a computer system including a single computer or multiple computers. In some embodiments, the management server 2 is a cloud server that communicates with the processing module 16 via a network.
[0026] The database 21 stores user data related to one or more users (hereinafter referred to as target users) who live in a house (i.e., a location in this embodiment) and are expected to use the electrical appliance 200, electrical appliance data related to the electrical appliance 200, and service record data related to the past usage of the electrical appliance 200. In other words, when the system 100 is used to monitor multiple electrical appliances 200 in a house, the database 21 stores multiple pieces of electrical appliance data corresponding to the electrical appliances 200 in the house and multiple pieces of service record data corresponding to the electrical appliances 200 in the house. For each electrical appliance 200, the electrical appliance data includes, for example, the type of the electrical appliance 200, the model of the electrical appliance 200, and reference operating current ranges corresponding to different operating modes of the electrical appliance 200 (e.g., reference operating current ranges collected and derived from a large number of electrical appliances 200 of the same type and model). For each electrical appliance 200, the service record data may include, for example, information related to each use on each day within a predetermined period of time (e.g., audio characteristics corresponding to ambient sounds, usage time (time the electrical appliance 200 is used), operation mode, usage duration (length of time the electrical appliance 200 is used at one time), etc.), and the total usage duration on each day within a predetermined period of time. The user data for each target user may include, for example, the target user's gender and age, the geographic region or location where the home is located, a home identifier, and contact information for one or more user-side devices 300 (only one of which is shown in FIG. 1 ) associated with the target user. The contact information may include, for example, telephone numbers of the target user's family, friends, emergency contacts, nursing home staff, etc. The user-side devices 300 may be, for example, but are not limited to, a smartphone, a tablet computer, a laptop computer, a desktop computer, etc.
[0027] The storage unit 22 further stores an action feature recognition model configured to recognize a plurality of action features associated with the target user's action of using the electrical appliance 200. In this embodiment, for each electrical appliance 200, the processing unit 23 analyzes the user data and the service record data using a second machine learning algorithm (for example, but not limited to, a neural network regression algorithm) based on a plurality of feature parameters respectively associated with the user, the electrical appliance 200, and the environment in which the electrical appliance 200 is located (e.g., the user's gender and age, the geographical region in which the home is located, the type and characteristics of the electrical appliance 200, the usage time, the usage duration, the total usage duration for that day, the audio characteristics of the sounds in the environment, etc.), thereby deriving a plurality of action features associated with the target user's action of using the electrical appliance 200 and establishing the action feature recognition model. The database 21, the storage unit 22, or the storage module 12 can be implemented using a non-volatile storage medium such as a hard disk drive, a solid-state drive, or a flash memory module.
[0028] The processing module 16 or processing unit 23 may include, but is not limited to, at least one of a multi-core processor, a dual-core cellular processor, a microprocessor, a digital signal processor (DSP), a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), and a radio frequency integrated circuit (RFIC). The processing module 16 or processing unit 23 may include at least one of a radio frequency integrated circuit (RFIC), a short-range wireless communication module supporting a short-range wireless communication network using wireless technologies such as Bluetooth or Wi-Fi, and a mobile communication module supporting telecommunications using LTE, third generation mobile communication systems (3G), fourth generation mobile communication systems (4G), or fifth generation mobile communication systems (5G), etc.
[0029] Referring to FIG. 2, a method for monitoring the usage of an appliance 200 performed by the system 100 according to one embodiment of the present invention is provided.
[0030] In step S01, the current detection module 13 continuously detects the current flowing through the electrical appliance 200, generates a current detection result, and transmits the current detection result to the processing module 16. The current detection result includes the actual operating current value of the electrical appliance 200. At the same time, the audio receiving module 14 continuously receives sounds in the house, generates an audio result based on the received sounds, and transmits the audio result to the processing module 16. The processing module 16 then generates audio feature data based on the audio result. In this embodiment, the processing module 16 uses an audio feature recognition model to determine audio features that the audio result generated by the audio receiving module 14 matches, and generates audio feature data based on the audio result that matches any of the audio features. That is, the processing module 16 uses the audio feature recognition model to determine whether there is at least one audio result that repeatedly occurs and is the same or similar (i.e., within a predetermined similarity) that matches any of the audio features. For example, in the case of an event in which a target user uses an electric kettle, which is electrical appliance 200, to heat water for 15 seconds at 3:00 PM, emitting a 50 dB sound at that time, which is received by the audio receiving module 14, the audio feature data generated by the processing module 16 includes data in which the "electric appliance 200" is an electric kettle, the "time" is 15:00, the "sound duration" is 15 seconds, and the "sound amplitude" is 50 dB. Specifically, the time may be the time when the electric kettle is used, and the sound duration may be the duration of the current use of the electric kettle.
[0031] In step S02, for each of a plurality of specific periods (which may be determined or changed based on actual conditions), the processing module 16 generates event data related to the usage status of the electrical appliance 200, for example, based on the current feature data, current detection results, and audio feature data within the specific period. That is, the event data is continuously generated for each specific period. The event data may include, for example, but are not limited to, a house identifier, the type and model of the electrical appliance 200, the start time of operation of the electrical appliance 200 in each operating mode, the actual operating current value and usage duration of the electrical appliance 200, and audio feature data corresponding to sounds received by the audio receiving module 14 in the house.
[0032] In step S03, the processing module 16 transmits the event data to the processing unit 23 of the management server 2, for example via a communication network.
[0033] In step S04, the processing unit 23 uses the action feature recognition model to determine whether the event data received from the processing module 16 matches any of the action features. If the determination is positive, the flow ends; if not, the flow proceeds to step S05.
[0034] In this embodiment, upon receiving the event data, the processing unit 23 further stores the event data in the database 21 as part of the service record data corresponding to the electrical appliance 200. The processing unit 23 then analyzes the service record data to derive behavioral features that may be the same or different from those already recognized by the behavioral feature recognition model. If there is a change in the user's behavior related to the use of the electrical appliance 200, the processing unit 23 may update the behavioral feature recognition model at a predetermined interval (e.g., once every few days or weeks). By constantly updating the behavioral feature recognition model, the processing unit 23 can more accurately determine whether the event data received from the processing module 16 matches any of the behavioral features using the behavioral feature recognition model. Furthermore, the processing unit 23 determines whether to adjust operating current information related to the operating current of the electrical appliance 200 based on the event data and the electrical appliance data. If the processing unit 23 determines that the operating current information needs to be adjusted, it generates current feature adjustment data indicating that the operating current information should be adjusted and sends the current feature adjustment data to the storage module 12 of the electrical outlet device 1. When the storage module 12 receives the current characteristic adjustment data from the processing unit 23, it updates the current characteristic data with the current characteristic adjustment data.
[0035] In step S05, if the processing unit 23 determines that the event data does not match any of the activity features, it sends a warning message to the user-side device 300 associated with the target user. The flow then ends. If it is determined that the event data does not match any of the activity features, it can be assumed that the target user is engaging in abnormal behavior related to the use of the electrical appliance 200. For example, assuming that the electrical appliance 200 is a refrigerator, event data indicating that neither the refrigerator nor the freezer doors of the refrigerator have been opened for a full day is determined to match any of the activity features, and such refrigerator use is determined to be abnormal. In another example, assuming that the electrical appliance is an electric kettle, event data indicating that no hot water supply operation has been performed for a full day is determined to match any of the activity features, and such use of the electric kettle is determined to be abnormal. Furthermore, because electric kettles need to keep hot water warm for a long time and their actual operating current is often continuously maintained at a relatively high current, it may be difficult to determine the target user's use of the electric kettle solely based on changes in the actual operating current when the electric kettle supplies hot water. Therefore, the sound of the electric kettle when it dispenses hot water (i.e., the audio feature data) can be used to determine the usage behavior of the electric kettle. If the usage behavior of the electric appliance 200 is determined to be abnormal, the processing unit 23 sends a warning message to the user-side device 300 associated with the target user to notify relevant parties such as the target user's friends, family, emergency contacts, and staff at the care facility, so as to prompt them to provide further assistance or take action.
[0036] If it is determined that the event data matches any of the behavior characteristics, the use of the electrical appliance 200 is determined to be normal, and the processing unit 23 does not send a warning message to the user device 300.
[0037] In this embodiment, the processing module 16 of the electrical outlet device 1 further determines whether the electrical appliance 200 is operating in an abnormal state based on the current feature data, the current detection result, and the audio feature data. If the processing module 16 determines that the electrical appliance 200 is operating in an abnormal state, the processing module 16 executes one response by controlling the output module 15 to generate a warning output indicating the abnormal state (e.g., by flashing an LED or beeping a buzzer). In some embodiments, if the processing module 16 determines that the electrical appliance 200 is operating in an abnormal state, the processing module 16 further executes one response by controlling the outlet module 11 to terminate the power supply to the electrical appliance 200. In particular, if the processing module 16 determines that the actual operating current value included in the current detection result exceeds the reference operating current range of the electrical appliance 200 included in the current feature data, the processing module 16 determines that the electrical appliance 200 is operating in an abnormal state related to an overcurrent. The processing module 16 may further determine that the electrical appliance 200 is operating in an abnormal state if the event corresponding to the audio feature data matches one of a plurality of predetermined events, and the sound amplitude exceeds a predetermined amplitude threshold and / or the duration of use exceeds a predetermined duration. The plurality of predetermined events may include, for example, refrigerator use, electric kettle use, air conditioner use, and computer use. For example, if the event corresponding to the audio feature data matches one of the predetermined events, such as refrigerator use, the refrigerator's compressor may be making an abnormal noise, indicating that the refrigerator is operating in an abnormal state. However, the actual operating current value of the refrigerator may still be within the reference operating current range. In this case, the processing module 16 receives an audio result from the audio receiving module 14. If the audio result has a sound amplitude exceeding the predetermined amplitude threshold due to the abnormal noise from the compressor, the processing module 16 determines that the refrigerator is operating in an abnormal state. This configuration allows the processing module 16 to accurately determine that the electrical appliance 200 requires maintenance.It should be noted that in the above-mentioned method, the processing module 16 determines whether the electrical appliance 200 is operating in an abnormal state based on detecting an abnormal amount of current (e.g., overcurrent) flowing through the electrical appliance 200 or receiving an abnormal sound (e.g., noise emitted by the electrical appliance 200) via the audio receiving module 14. In contrast, in step S05, the processing unit 23 determines whether there is an abnormality in the target user's usage behavior of the electrical appliance 200 within a specific period of time by using an activity feature recognition model to determine whether the event data matches any of the activity features, and accordingly derives the target user's life routine in the home.
[0038] In summary, the electrical outlet device 1 continuously transmits event data related to the usage status of the connected electrical appliance 200 to the management server 2. The management server 2 then uses the behavioral feature recognition model to determine whether the received event data matches any of the behavioral features and predicts whether the target user's usage behavior of the electrical appliance 200 is normal (i.e., predicts whether the target user's life routine is normal). This achieves the objective of the present invention of monitoring the target user's life routine while respecting their privacy. In other words, intervention in the target user's life is only performed if there is a risk of their safety or health being compromised, allowing the target user to live a more independent life while still taking safety into consideration. Furthermore, the processing unit 23 stores the event data in the database 21 as part of the service record data, thereby updating the behavioral feature recognition model at predetermined intervals and more accurately determining whether the event data matches any of the behavioral features.
[0039] In the above description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of the embodiments. However, it will be apparent to one skilled in the art that one or more other embodiments may be practiced without these specific details. Furthermore, in the description of "one embodiment" or "an embodiment" herein, all references to an ordinal number or other designation should be understood to include specific aspects, structures, and features of the present invention. Furthermore, although multiple variations may be incorporated into a single embodiment, drawing, or description thereof, this is for the purpose of streamlining the description and for the purpose of understanding the multifaceted aspects of the present invention. Furthermore, one or more features or specific embodiments of one embodiment may, where appropriate, be combined with one or more features or specific embodiments of other embodiments in the practice of the present invention.
[0040] Although the embodiments and variations of the present invention have been described above, the present invention is not limited to these and encompasses all modifications and equivalent configurations as various configurations falling within the spirit and scope of the broadest interpretation. [Explanation of symbols]
[0041] 100 systems 1 Electrical outlet device 11 Outlet Module 12 Memory Module 13 Current Sensing Module 14 Audio receiving module 15 Output Module 16 Processing Modules 2 Management Server 21 Databases 22 Memory Unit 23 Processing Unit 200 Electrical Appliances 300 User side device
Claims
1. A system for monitoring the usage status of an electrical appliance, comprising: an electrical outlet device; and a management server; The electrical outlet device is an outlet module configured to electrically connect to the appliance and operable to switch between a first state that allows power to be supplied to the appliance and a second state that terminates power supply to the appliance; a storage module configured to store current characteristic data associated with a plurality of reference values of the operating current of the electrical appliance, the reference values corresponding to different operating modes of the electrical appliance, respectively; a current sensing module electrically connected to the outlet module, for continuously sensing a current flowing through the electrical appliance and generating a current sensing result; an audio receiving module configured to receive sounds in a location where the appliance is located and generate an audio result based on the received sounds; a processing module electrically connected to the outlet module, the storage module, the current detection module, and the audio receiving module, and configured to generate audio feature data based on the audio result, and generate event data related to the usage state of the electrical appliance based on the current feature data, the current detection result, and the audio feature data; The management server a database storing user data associated with users at the location, appliance data associated with the appliance, and service record data associated with past usage of the appliance; a storage unit that stores an action feature recognition model configured to recognize a plurality of action features related to the user's action of using the electrical appliance, the action features and the action feature recognition model being derived and established by analyzing the user data and the service record data using a first machine learning algorithm based on a plurality of feature parameters respectively related to the user, the electrical appliance, and an environment in which the electrical appliance is placed; a processing unit signally connected to the processing module and electrically connected to the database and the storage unit; the processing module transmits the event data to the processing unit, and the processing unit uses the action feature recognition model to determine whether the event data received from the processing module matches any of the action features, and transmits a warning message to a user-side device associated with the user when it determines that the event data does not match any of the action features; system.
2. The processing unit of the management server further comprises: Upon receiving the event data, storing the event data in the database as part of the service record data; determining whether operating current information related to the operating current of the electrical appliance needs to be adjusted based on the event data and the electrical appliance data; generating current characteristic adjustment data indicating that the operating current information is to be adjusted when it is determined that the operating current information needs to be adjusted; sending the current characteristic adjustment data to the storage module to update the current characteristic data stored in the storage module of the electrical outlet device; The system of claim 1 .
3. the storage module of the electrical outlet device further stores a voice feature recognition model configured to recognize a plurality of voice features, the voice features and the voice feature recognition model being derived and established by analyzing the voice results using a second machine learning algorithm based on a plurality of voice parameters respectively associated with the environment in which the electrical outlet device is located; The processing module uses the voice feature recognition model to determine the voice features to which the voice results generated by the voice receiving module match, and generates the voice feature data based on the voice results that match any of the voice features. The system of claim 1 .
4. the electrical outlet device further includes an output module electrically connected to the processing module; the processing module determines whether the electrical appliance is operating in an abnormal state based on the current feature data, the current detection result, and the audio feature data, and, when determining that the electrical appliance is operating in the abnormal state, causes the output module to execute one of a first response of generating a warning output indicating the abnormal state and a second response of controlling the outlet module to terminate power supply to the electrical appliance; The system of claim 1 .
5. A method for monitoring usage status of an electrical appliance, the method being performed by a system including an electrical outlet device and a management server, comprising: The electrical outlet device stores current characteristic data relating to a plurality of reference values of operating current of the electrical appliance, the reference values respectively corresponding to different operating modes of the electrical appliance; The management server stores user data related to a user at a location where the electrical appliance is installed, electrical appliance data related to the electrical appliance, service record data related to a past usage state of the electrical appliance, and an action feature recognition model configured to recognize a plurality of action features related to the user's action of using the electrical appliance; The method comprises: the electrical outlet device continuously senses a current passing through the electrical appliance and generates a current sense result; receives sound at a location where the electrical appliance is located; and generates an audio result based on the received sound; the electrical outlet device generates audio feature data based on the audio result, generates event data related to the usage status of the electrical appliance based on the current feature data, the current detection result, and the audio feature data, and sends the event data to the management server; the management server uses the behavior feature recognition model to determine whether the received event data matches any of the behavior features; and if the management server determines that the event data does not match any of the behavior characteristics, sending a warning message to a user-side device associated with the user. method.
6. When the management server receives the event data from the electrical outlet device, the management server stores the event data as part of the service record data; the management server determines, based on the event data and the electrical product data, whether operating current information related to the operating current of the electrical product needs to be adjusted; When the management server determines that the operating current information needs to be adjusted, it generates current characteristic adjustment data indicating that the operating current information should be adjusted, and sends the current characteristic adjustment data to the electrical outlet device; and, when the electrical outlet device receives the current characteristic adjustment data from the management server, updating the current characteristic data using the current characteristic adjustment data. The method of claim 5.
7. the electrical outlet device further stores a speech feature recognition model configured to recognize a plurality of speech features; The method comprises: the electrical outlet device derives the voice features by analyzing the voice results based on a plurality of voice parameters respectively associated with an environment in which the electrical outlet device is located using a machine learning algorithm, and establishes the voice feature recognition model; the electrical outlet device further comprising: using the audio feature recognition model to determine the audio features to which the audio results match; and generating the audio feature data based on the audio results matching any of the audio features. The method of claim 5.
8. the electrical outlet device determines whether the electrical appliance is operating in an abnormal state based on the current characteristic data, the current detection result, and the audio characteristic data; and when the electrical outlet device determines that the electrical appliance is operating in the abnormal condition, performing one of a first response of generating a warning output indicative of the abnormal condition and a second response of terminating the supply of power to the electrical appliance. The method of claim 5.
9. 6. The method of claim 5, further comprising: the management server utilizing a machine learning algorithm to derive the behavior features and establish the behavior feature recognition model by analyzing the user data and the service record data based on a plurality of feature parameters respectively associated with the user, the electrical appliance, and an environment in which the electrical appliance is placed.
10. An electrical outlet device included in a system for monitoring the usage status of an electrical appliance, the system further including a management server; The electrical outlet device is an outlet module configured to electrically connect to the appliance and operable to switch between a first state that allows power to be supplied to the appliance and a second state that terminates power supply to the appliance; a storage module configured to store current characteristic data associated with a plurality of reference values of the operating current of the electrical appliance, the reference values corresponding to different operating modes of the electrical appliance, respectively; a current sensing module electrically connected to the outlet module and configured to continuously sense a current passing through the electrical appliance and generate a current sensing result; an audio receiving module that receives sounds from a location where the appliance is located and generates an audio result based on the received sounds; a processing module electrically connected to the outlet module, the storage module, the current detection module, and the audio receiving module, configured to generate audio feature data based on the audio result, generate event data related to the usage state of the electrical appliance based on the current feature data, the current detection result, and the audio feature data, and send the event data to the management server; Electrical outlet device.
11. the storage module further stores a voice feature recognition model configured to recognize a plurality of voice features, the voice features and the voice feature recognition model being derived and established by analyzing the voice results using a machine learning algorithm based on a plurality of voice parameters respectively associated with an environment in which the electrical outlet device is located; The processing module uses the voice feature recognition model to determine the voice features to which the voice results generated by the voice receiving module match, and generates the voice feature data based on the voice results that match any of the voice features.
11. The electrical outlet device of claim 10.
12. an output module electrically connected to the processing module; the processing module determines whether the electrical appliance is operating in an abnormal state based on the current feature data, the current detection result, and the audio feature data, and, when determining that the electrical appliance is operating in the abnormal state, causes the output module to execute one of a first response of generating a warning output indicating the abnormal state and a second response of controlling the outlet module to terminate power supply to the electrical appliance; 11. The electrical outlet device of claim 10.
Citation Information
Patent Citations
Household electric appliance state estimation apparatus
JP2014132732A
Prescribed place monitoring method based on use of electric appliance in prescribed place, and prescribed place monitoring system
JP2022068855A
Field monitoring methods and systems based on appliance usage
TWI766399B
Methods and apparatus notifying a remotely located user of the operating condition of a household appliance
US20150294553A1