Display system, display method, and program

The display system addresses the issue of overwhelming device functions by estimating usage patterns and displaying only relevant functions on a terminal device, enhancing user experience and reducing operational errors.

JP7822255B2Active Publication Date: 2026-03-02MITSUBISHI ELECTRIC CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2022098340
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-06-17
Publication Date
2026-03-02
Estimated Expiration
2042-06-17

AI Technical Summary

Technical Problem

Existing display systems on smartphones overwhelm users with unnecessary device functions, making it difficult to find desired features, especially during initial setup, due to the lack of frequency-based usage tracking.

Method used

A display system that estimates usage patterns of devices through a cloud server, which collects operation history, estimates usage patterns, and manages display screens to show only relevant functions based on user needs, using a terminal device to display a tailored setting screen.

Benefits of technology

Provides an easy-to-use function display screen that showcases only necessary functions, reducing operational errors and user frustration by displaying functions aligned with user needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007822255000001
    Figure 0007822255000001
  • Figure 0007822255000002
    Figure 0007822255000002
  • Figure 0007822255000003
    Figure 0007822255000003
Patent Text Reader

Abstract

To provide an easy-to-use function display screen that displays the functions required by a user.SOLUTION: A display system for displaying functional information regarding remote control of a remotely controlled apparatus 3 includes: the apparatus 3; a usage pattern estimation unit 112 that estimates a usage pattern, which is how the apparatus 3 is used; a usage pattern storage unit 122 that stores the estimated usage pattern; a functional information storage unit 123 that stores functional information regarding remote control of the apparatus 3 according to the usage pattern of the apparatus 3; a display screen management unit 113 that refers to the functional information storage unit 123 to acquire the functional information regarding remote control according to the estimated usage pattern, and manages the acquired functional information as functional information to be displayed on a terminal device 2; and a setting screen display instruction unit 114 that transmits setting information of a setting screen to be displayed on the terminal device 2, including the acquired functional information, to the terminal device 2.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a display system, a display method, and a program. [Background technology]

[0002] With the advancement of the Internet of Things (IoT) in recent years, it has become possible to turn on / off and configure home appliance functions from smartphones. Furthermore, IoT has made it possible to add newly developed, convenient features not originally included in home appliances via the Internet, allowing users to select from a wide range of options to suit their needs. Nowadays, the ease of collecting and analyzing device operation logs has led to the provision of numerous features tailored to specific user needs. However, when all of a device's functions are displayed on a smartphone's settings screen, the functions the user wants to use can be overwhelmed by unnecessary features, making it difficult to find the desired function. For example, providing functions for a bedroom air conditioner through a smartphone app can be unnecessary for users who want to operate and configure the living room air conditioner, resulting in unnecessary buttons and icons. Especially when configuring a device through a smartphone app for the first time, the numerous settings required and the display of unnecessary buttons and icons can lead to operational errors and cause frustration for the user.

[0003] In order to reduce the above-mentioned hassle, for example, Patent Document 1 discloses that on an information display terminal, by resetting the menu button so that buttons for functions that are displayed frequently are displayed on a higher hierarchical display screen, a display screen that is searched for frequently can be displayed in a short time. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 9-212324 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the above technology, in order to determine the function buttons to be displayed in the area of ​​the information display terminal, it is necessary to count the frequency with which the user actually uses each function on the device. In other words, when setting up from a smartphone app for the first time, the frequency with which each function is used is not counted, and buttons for all functions, including functions unrelated to the device, are displayed, making it impossible to improve the display screen at the beginning of use when easier operation is desired.

[0006] The present disclosure has been made in consideration of the above circumstances, and aims to provide an easy-to-use function display screen that displays functions required by the user. [Means for solving the problem]

[0007] In order to achieve the above object, the display system of the present disclosure is a display system that displays functional information related to remote control of a remotely controlled device, , machine a usage pattern estimation unit that estimates the usage pattern, i.e., how the container is used; , machine a function information storage unit that stores function information related to remote control according to a usage mode of the device; a display screen management unit that acquires function information related to remote control according to an estimated usage mode by referring to the function information storage unit and manages the information as function information to be displayed on the terminal device; and a setting screen display instruction unit that transmits to the terminal device setting information for a setting screen to be displayed on the terminal device, the setting information including the acquired function information. The device includes a keyword acquisition unit that acquires keywords related to the usage patterns of the devices, and a usage pattern estimation unit that estimates the usage patterns of the devices from the keywords. [Effects of the Invention]

[0008] According to the present disclosure, by estimating the usage pattern of a device and displaying functions related to remote control according to the estimated usage pattern of the device, it is possible to provide an easy-to-use function display screen that displays the functions that the user needs. [Brief explanation of the drawings]

[0009] [Figure 1]FIG. 1 is a diagram showing an overall configuration of a display system according to a first embodiment of the present disclosure. [Figure 2] FIG. 1 is a diagram illustrating a hardware configuration of a cloud server and a terminal device according to a first embodiment of the present disclosure. [Figure 3] FIG. 1 is a diagram showing a home screen according to a first embodiment of the present disclosure. [Figure 4] FIG. 1 is a diagram illustrating a functional configuration of a cloud server according to a first embodiment of the present disclosure. [Figure 5] FIG. 1 is a diagram illustrating an operation history storage unit according to a first embodiment of the present disclosure. [Figure 6] FIG. 1 is a diagram illustrating a usage state storage unit according to a first embodiment of the present disclosure. [Figure 7] FIG. 1 is a diagram illustrating a function information storage unit according to a first embodiment of the present disclosure. [Figure 8] 1 is a flowchart showing a display process according to a first embodiment of the present disclosure. [Figure 9] 1 is a flowchart showing a usage pattern estimation process according to a first embodiment of the present disclosure. [Figure 10] 1A is a diagram showing a match pattern of a usage pattern according to a first embodiment of the present disclosure, and FIG. 1B is a diagram showing an operation history. [Figure 11] 1 is a flowchart showing a screen generation process according to a first embodiment of the present disclosure; [Figure 12] FIG. 1A is a diagram showing a home screen on which function icons necessary for a user are displayed according to a first embodiment of the present disclosure, and FIG. 1B is a diagram showing a home screen on which function icons unnecessary for a user are not displayed. [Figure 13] 10A is a diagram showing a matching pattern of a usage pattern according to a second embodiment of the present disclosure, FIG. 10B is a diagram showing a usage pattern storage unit, and FIG. 10C is a diagram showing a function information storage unit. [Figure 14] FIG. 10 is a diagram illustrating a functional configuration of a cloud server according to a third embodiment of the present disclosure. [Figure 15] FIG. 10 is a diagram showing a home screen according to a third embodiment of the present disclosure. [Figure 16] FIG. 10 is a diagram showing a drop-down list according to a third embodiment of the present disclosure. [Figure 17] 10 is a flowchart showing a usage pattern estimation process according to a third embodiment of the present disclosure. [Figure 18] FIG. 10 is a diagram showing a match pattern of a usage pattern according to a fourth embodiment of the present disclosure. [Figure 19] FIG. 10 is a diagram showing a drop-down list according to a fifth embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of a display system according to the present disclosure will be described in detail with reference to the accompanying drawings.

[0011] (First embodiment) 1 shows the overall configuration of a display system according to a first embodiment. The display system includes a cloud server 1, a terminal device 2, and a plurality of devices 3. The plurality of devices 3 are installed inside a building H. The building H may be, for example, a detached house, an apartment building, an office building, a commercial facility, a factory, or the like.

[0012] The cloud server 1 remotely controls multiple devices 3 installed inside a building H from outside the building H. The cloud server 1 generates a setting screen for controlling the devices 3, transmits it to the terminal device 2, and causes the display unit of the terminal device 2 to display the setting screen. The terminal device 2 inputs setting conditions for controlling the devices 3 into the setting screen and transmits it to the cloud server 1. The cloud server 1 controls the devices 3 in accordance with the conditions set in the terminal device 2.

[0013] Each of the plurality of devices 3 is a device to be remotely controlled. Specifically, each of the plurality of devices 3 is electrical equipment such as an air conditioner that conditions the air inside the building H, a ventilation device that ventilates the building H, etc. Although not shown, each of the plurality of devices 3 is connected to a local network NW2 constructed inside the building H via a communication adapter. The local network NW2 is connected to a wide area network NW1 via a BBR (broadband router) 5. The local network NW2 is, for example, a wired local area network (LAN), a wireless LAN, or a network based on ECHONET Lite (registered trademark). The wide area network NW1 is, for example, the Internet.

[0014] The cloud server 1 and the terminal device 2 can communicate with each other via a wide area network NW1. The cloud server 1 can communicate with a plurality of devices 3 via the wide area network NW1 and a local area network NW2.

[0015] The cloud server 1 is a server that provides resources in cloud computing, and includes a control unit 11, a storage unit 12, and a communication unit 15, as shown in FIG.

[0016] The control unit 11 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The CPU is also called a central processing unit, central arithmetic unit, processor, microprocessor, microcomputer, etc., and functions as a central arithmetic processing unit that executes processing and calculations related to the control of the cloud server 1. In the control unit 11, the CPU reads programs and data stored in the ROM and uses the RAM as a work area to perform overall control of the cloud server 1.

[0017] The storage unit 12 includes nonvolatile memory such as a flash memory, an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), or a hard disk, and serves as a so-called secondary storage device or auxiliary storage device. The storage unit 12 stores programs and data used by the control unit 11 to perform various processes. The storage unit 12 also stores data generated or acquired by the control unit 11 as a result of performing various processes.

[0018] The communication unit 15 includes a communication interface for the cloud server 1 to communicate with external devices via the wide area network NW1. The communication unit 15 transmits and receives various information to and from the terminal device 2 and the multiple devices 3 via the wide area network NW1.

[0019] The terminal device 2 is a terminal that can be operated by a user outside the building H. The terminal device 2 is, for example, a smartphone, a tablet terminal, a personal computer, etc. A setting screen for operating the device 3 is displayed on the terminal device 2. As shown in FIG. 2 , the terminal device 2 includes a control unit 21, a storage unit 22, an input unit 23, a display unit 24, and a communication unit 25.

[0020] The control unit 21 includes a CPU, a ROM, and a RAM. The CPU is also called a central processing unit, a processor, a microprocessor, a microcomputer, etc., and functions as a central processing unit that executes processing and calculations related to the control of the terminal device 2. In the control unit 21, the CPU reads out programs and data stored in the ROM and uses the RAM as a work area to perform overall control of the terminal device 2.

[0021] The storage unit 22 includes a nonvolatile semiconductor memory such as a flash memory, an EPROM, or an EEPROM, and serves as a so-called secondary storage device or auxiliary storage device. The storage unit 22 stores programs and data used by the control unit 21 to perform various processes. The storage unit 22 also stores data generated or acquired by the control unit 21 as a result of performing various processes.

[0022] The input unit 23 includes input devices such as a keyboard, a mouse, a switch, a touchpad, and a touch panel, and receives operation inputs from a user. The user can input various instructions to the terminal device 2 by operating the input unit 23. When the input unit 23 receives an operation instruction input by the user, it transmits the received operation instruction to the control unit 21.

[0023] The display unit 24 includes a display device such as an LCD (Liquid Crystal Display) panel, an organic EL (Electro-Luminescence) panel, etc. The display unit 24 is driven by a display drive circuit (not shown), and displays a setting screen for controlling the device 3 and various other images under the control of the control unit 21.

[0024] The communication unit 25 includes a communication interface for the terminal device 2 to communicate with external devices. The communication unit 25 transmits and receives various information, such as request information for a setting screen and instruction information for displaying the setting screen, to and from the cloud server 1 via the wide area network NW1.

[0025] FIG. 3 shows an example of a setting screen (home screen) displayed on the display unit 24 of the terminal device 2. The home screen is the first screen that can accept operations from the user in controlling the devices 3. The home screen 241 shows a list of the devices 3. As examples, the screen in FIG. 3 shows an air conditioner, a water heater, and a ventilation fan. In the function column, an icon 242 for "sleep operation" is displayed as a function that is remotely controlled by the cloud server 1. When the user touches the "sleep operation" icon 242 to select "sleep operation," a function setting screen for setting detailed items related to "sleep operation" is displayed, and the user enters information for each item. When the input on the setting screen is completed, the input information is sent to the cloud server 1.

[0026] Next, the functional configuration of the cloud server 1 will be described with reference to Fig. 4. As shown in Fig. 4, the cloud server 1 functionally comprises an operation history collection unit 111, a usage pattern estimation unit 112, a display screen management unit 113, and a setting screen display instruction unit 114.

[0027] Each of these functions is realized by software, firmware, or a combination of software and firmware. The software and firmware are written as programs and stored in the ROM or storage unit 12, 22. The CPU then executes the programs stored in the ROM or storage unit 12, 22 to realize each of these functions.

[0028] The cloud server 1 also includes an operation history storage unit 121, a usage pattern storage unit 122, and a function information storage unit 123. These are constructed in appropriate storage areas of the storage unit 12.

[0029] The operation history collection unit 111 collects operation history from the device 3. The operation history collection unit 111 periodically collects operation status data from the device 3. For example, the operation history collection unit 111 collects operation status data from the device 3 every five minutes. Upon receiving a request for operation status data, the device 3 transmits data such as the time, device ID, model name, and operating status to the cloud server 1. Note that the device 3 may autonomously collect operation status data and transmit the operation status data collectively to the cloud server 1 when a data request is received from the operation history collection unit 111. Alternatively, the device 3 may autonomously transmit operation status data to the cloud server 1 without receiving a data request from the operation history collection unit 111.

[0030] The operation history collection unit 111 stores the collected operation status data in the operation history storage unit 121. The operation history storage unit 121 is a database that manages the history of the operation status of the devices 3, and is stored in the storage unit 12. An example of the data stored in the operation history storage unit 121 is shown in FIG. 5. The operation history storage unit 121 stores operation status data every five minutes, including the current time, device ID, model name, operating status, set temperature, intake temperature, and other data such as sensor data from an image sensor, heat source sensor, etc. (not shown).

[0031] The usage pattern estimation unit 112 estimates the usage pattern, which is how the device 3 is used. The usage pattern is estimated based on operation history information, which is data on the operation state stored in the operation history storage unit 121. The usage pattern is estimated from the operation history information, for example, based on the operation time period, frequently used functions, etc. From the operation time period and the length of the operation time, the usage pattern is estimated to be 24-hour operation, night operation, daytime operation, short-term operation, etc. Furthermore, from the functions used, the usage pattern is estimated to be off timer use from the off timer function, use by multiple people, etc. from sensor data from an image sensor, heat source sensor, etc.

[0032] The usage pattern estimation unit 112 stores data on the estimated usage pattern of the device 3 in the usage pattern storage unit 122. The usage pattern storage unit 122 is a database that manages data on the usage patterns of the device 3, and is stored in the storage unit 12. An example of the data stored in the usage pattern storage unit 122 is shown in FIG. 6. The usage pattern storage unit 122 stores data on the device ID, model name, and estimated usage pattern of the device 3. According to FIG. 6, the usage patterns estimated for the air conditioner with the device ID ID-1000 are three usage patterns: "nighttime operation," "off timer use," and "short-term operation." The usage pattern estimated for the air conditioner with the device ID ID-1001 is "24-hour operation." The usage pattern estimated for the air conditioner with the device ID ID-1002 is "daytime operation." The usage pattern estimated for the air conditioner with the device ID ID-1003 is "multiple-person use," which indicates, based on sensor data, that multiple people are present in the room where the air conditioner is installed.

[0033] The display screen management unit 113 acquires function information of the device corresponding to the estimated usage pattern by referring to the function information storage unit 123, and manages the function information as function information to be displayed on the terminal device 2. The display screen management unit 113 acquires the usage pattern of the device 3 by reading out the usage pattern information, which is data estimated by the usage pattern estimation unit 112 and stored in the operation history storage unit 121. For the acquired usage pattern of the device 3, the display screen management unit 113 refers to a database that lists the function information stored in the function information storage unit 123, and extracts functions that match the usage pattern.

[0034] As shown in FIG. 7, the function information storage unit 123 stores the function names and usage conditions of functions that can be provided by the cloud server 1 in cooperation with the device 3 via the wide area network NW1. In FIG. 7, for example, function names include "Sleep Operation 1," "Sleep Operation 2," "Server Management Mode," "Automatic Odor Removal," and "Automatic Air Distribution." "Sleep Operation 1" is a function that automatically turns on the air conditioner if the room temperature rises while the user is sleeping and becomes hot. "Sleep Operation 2" is a function that controls the room temperature while the user is sleeping to maintain a predetermined temperature or higher to prevent the user from becoming too cold. "Server Management Mode" is a function that detects heat sources using an image sensor, heat source sensor, etc., and focuses air conditioning on the detected heat source to achieve efficient operation. "Automatic Odor Removal" is a function that performs dehumidification operation during the day when no one is in the room, followed by heating operation to remove dirt and dry the inside of the air conditioner and remove odors from inside the air conditioner. The "automatic ventilation" function uses image sensors, heat source sensors, etc. to detect people in the room, and if the detected person's body temperature is high, it blows air towards that person, but if the detected person's body temperature is low, it does not blow air towards that person.The "smart energy saving" function monitors the CO2 concentration in the room with a CO2 sensor, and if the CO2 concentration is below a specified value, it determines that ventilation is not necessary and stops the ventilation fan, thereby achieving energy-saving operation.

[0035] In FIG. 7 , the function information storage unit 123 stores, for each function, the conditions of the usage pattern that requires the function. For the function "Sleep Operation 1," the conditions are that the usage pattern is "night operation" and "off timer use." In this case, it is conceivable that the timer goes off while the user is sleeping, stopping the air conditioner, and then the room temperature rises, causing discomfort to the user, leading to the user turning the air conditioner back on. Therefore, the function "Sleep Operation 1" is determined to be a function necessary for the user. For the function "Sleep Operation 2," the conditions are that the usage pattern is "night operation" and that the usage pattern is not "off timer use." In this case, since the off timer is not used, it is conceivable that the air conditioner continues to operate while the user is sleeping. Therefore, the function "Sleep Operation 2" is determined to be a function necessary for the user. For the function "Server Management Mode," the conditions are that the usage pattern is "24-hour operation." In this case, since continuous operation is required, more efficient operation is conceivable, so the function "Server Management Mode" is determined to be a function necessary for the user. For the function "Automatic Odor Removal," the conditions are that the usage pattern is not "daytime operation." The "automatic odor removal" function is performed during the day when no one is present in the room, so the above conditions are deemed to make it a function that can be used by users. For the "automatic air distribution" function, the condition is that it must be used by "multiple people." In this case, since the optimum room temperature varies from person to person, the "automatic air distribution" function is deemed to be a necessary function for users. Furthermore, for the "smart energy saving" function of the ventilation fan, the condition is that it must be used for "24-hour operation." In this case, since continuous operation is required, more efficient operation is likely to be required, so the "smart energy saving" function is deemed to be a necessary function for users.

[0036] 4 , when the display screen management unit 113 refers to a database that lists the function information stored in the function information storage unit 123 and acquires function information that matches the usage pattern of the user's device 3, the display screen management unit 113 transmits the acquired function information to the setting screen display instruction unit 114. The setting screen display instruction unit 114 generates setting information for a home screen that will be displayed on the terminal device 2 based on the acquired function information, and transmits the information to the terminal device 2.

[0037] Next, the operation of the display process by the cloud server 1 will be described with reference to FIG. 8. First, the cloud server 1 determines whether the terminal device 2 has requested the display of a home screen (step S101). If there is no request to display a home screen from the terminal device 2 (step S101: No), the cloud server 1 repeats the process of step S101 until there is a request to display a home screen from the terminal device 2. If there is a request to display a home screen from the terminal device 2 (step S101: Yes), the usage pattern estimation unit 112 of the cloud server 1 determines whether information about the usage pattern of the device 3 is stored in the usage pattern storage unit 122 (step S102). If information about the usage pattern of the device is not stored in the usage pattern storage unit 122 (step S102: No), the usage pattern estimation unit 112 executes a usage pattern estimation process in which the operation history collection unit 111 collects operation history from the device 3 and estimates the usage pattern of the device 3 based on the history information about the operating state of the device 3 stored in the operation history storage unit 121 (step S103). Here, the details of the usage estimation process are shown in FIG.

[0038] 9, the usage pattern estimation unit 112 determines whether or not the operation history of the device 3 is stored in the operation history storage unit 121 (step S201). If there is no operation history of the device 3 (step S201: No), the usage pattern estimation unit 112 terminates the usage pattern estimation process. If there is an operation history of the device 3 (step S201: Yes), the usage pattern estimation unit 112 acquires the operation history from the operation history storage unit 121 (step S202). The usage pattern estimation unit 112 determines whether or not the operation history matches a usage pattern for estimating a usage pattern (step S203).

[0039] An example of a matching pattern for usage patterns is shown in Figure 10(A). If device 3 is an air conditioner, the data for the past month is divided into days based on the operation history, and if the percentage of days on which the air conditioner was operated at night (midnight - 6:00) is 80% or more, the usage pattern is estimated to be "nighttime operation." Furthermore, the data for the past month is divided into days, and if the number of times the air conditioner was stopped using the off timer on days on which the air conditioner was operated is equal to or greater than the number of days on which the air conditioner was operated, the usage pattern is estimated to be "off timer use." Furthermore, the data for the past month is divided into days, and if the air conditioner was operated for two hours or more per time, the usage pattern is estimated to be "short-term operation." Furthermore, the data for the past month is divided into days, and if the percentage of days on which the air conditioner was operated 24 hours a day is 80% or more, the usage pattern is estimated to be "24-hour operation." In addition, the data for the past month is divided by day, and if the air conditioner is operating during the day (10:00-15:00) on 80% or more of the days, the usage pattern is estimated to be "daytime operation." In addition, the data for the past month is divided by day, and if the number of days on which two or more people are detected from the image sensor data on the air conditioner operating days is at least one operating day, the usage pattern is estimated to be "multiple people." In addition, if device 3 is a ventilation fan, the data for the past month is divided by day, and if the percentage of days on which the fan is operating 24 hours a day is 80% or more, the usage pattern is estimated to be "24-hour operation." In addition, the data for the past month is divided by day, and if the percentage of days on which the ventilation fan is operating during the night (24:00-6:00) is 80% or more, the usage pattern is estimated to be "nighttime operation."

[0040] Figure 10(B) shows an example of operation history data in which the usage pattern is estimated to be "nighttime operation." Figure 10(B) shows the operation history of an air conditioner at night (24:00-6:00), and the air conditioner is operating during the same time period on August 1, 2022. Similarly, the air conditioner is operating during the same time period on August 2, 2022. Similarly, if the number of days in which the air conditioner is operating at night is 80% or more of the month, the usage pattern is estimated to be "nighttime operation." Furthermore, the off timer is used in the operation history data of Figure 10(B). If the number of times this off timer is used is equal to or greater than the number of days in which the air conditioner is operating in a month, the usage pattern is estimated to be "off timer use."

[0041] 9, if the operation history matches the usage pattern shown in FIG. 10 (step S204: Yes), the usage pattern estimation unit 112 estimates the corresponding usage pattern as the usage pattern of the corresponding device 3 (step S205). When the processing of step S205 ends, or if there is no operation history that matches the usage pattern (step S204: No), the matching process for each usage pattern ends (step S206). Then, the usage pattern estimation unit 112 stores the usage pattern estimated by pattern matching in the usage pattern storage unit 122 as the usage pattern of the corresponding device 3 (step S207), and ends the usage pattern estimation process.

[0042] 8, after the use pattern estimation process in step S103 is executed, or if the use pattern information of the device is stored in the use pattern storage unit 122 (step S102: Yes), the display screen management unit 113 extracts functions that match the use pattern from the use pattern estimated by the use pattern estimation unit 112 and the function information stored in the function information storage unit 123, and executes a screen generation process to generate a display screen (step S104). Details of the screen generation process are shown in FIG.

[0043] 11, the display screen management unit 113 determines whether the usage mode of the device 3 is stored in the usage mode storage unit 123 (step S301). If the usage mode of the device 3 does not exist, i.e., is unknown (step S301: No), all functions provided by the device 3 are stored in the storage unit 12 as functions to be displayed on the home screen (step S302), and the process proceeds to step S307, which will be described later. Note that instead of displaying all functions on the home screen, all functions may be hidden. On the other hand, if the usage mode of the device 3 exists (step S301: Yes), functions matching the usage mode are acquired (step S303). The acquisition of functions matching the usage mode is executed by referring to function information stored in the function information storage unit 123. As shown in FIG. 7, the function information storage unit 123 stores conditions of usage modes that match each function. The display screen management unit 113 determines whether the usage state acquired from the usage state storage unit 122 matches the usage state conditions that match each function (step S304). If the usage state matches the usage state conditions (step S304: Yes), the function that matches the usage condition is acquired as a function to be displayed on the home screen and stored in the storage unit 12 (step S305). For example, the usage states of the air conditioner having the device ID "ID-1000" stored in the usage state storage unit 122 in FIG. 6 are "night operation," "off timer use," and "short-term operation." Here, of the usage state conditions of each function stored in the function information storage unit 123 in FIG. 7, only two, "sleep operation 1" and "sleep operation 2," include "night operation" as a usage state condition. Furthermore, only "sleep operation 1" includes "off timer use" as a usage state condition. Furthermore, there is no function in this list that corresponds to "short-term operation." "Sleep driving 1" requires that both "night driving" and "off timer use" be included as usage conditions. On the other hand, "Sleep driving 2" requires that "night driving" be included as usage conditions, but that "off timer use" not be included. Therefore, the only usage condition that matches the usage of the air conditioner with device ID "ID-1000" is "Sleep driving 1."Therefore, this "Sleep Driving 1" function is acquired as the "ID-1000" function to be displayed on the home screen. Note that the number of acquired functions is not limited to one; if the usage condition conditions for multiple functions are met, those multiple functions are acquired. In step S305, a function that matches the usage condition of the device 3 is acquired, or if the usage condition of the device 3 does not match the usage condition conditions (step S304: No), the function acquisition process for acquiring functions to be displayed on the home screen based on the usage condition is terminated (step S306). When the functions to be displayed on the home screen are acquired, the setting screen display instruction unit 114 generates setting information for the home screen to be displayed on the terminal device 2 (step S307), and the screen generation process is terminated.

[0044] Returning to FIG. 8 , after executing the screen generation process in step S104, the setting screen display instruction unit 114 transmits the generated home screen setting information to the terminal device 2 and instructs the terminal device 2 to display the home screen (step S105). Upon receiving the display instruction, the terminal device 2 displays the home screen on the display unit 24. The home screen displayed here displays only icons of functions suited to the user's usage of the device 3, and does not display icons of functions unnecessary for the user. FIG. 12(A) shows an example of a home screen displaying icons of functions suited to the user's usage of the device 3, i.e., icons of functions necessary for the user. Here, an icon and text for "Sleep Driving 1" and an ON / OFF switch for the "Sleep Driving 1" function are displayed. On the other hand, FIG. 12(B) shows an example of a home screen in which there is no function suited to the user's usage of the device 3, i.e., there is no icon for a function necessary for the user. The function column is blank and no functions are displayed. Therefore, the user can select functions without hesitation when configuring operation settings, which saves time and effort and reduces stress. Furthermore, for new functions provided by the cloud server 1, it is determined whether or not the functions are suited to the usage pattern of the user's device 3, and icons for functions that are unnecessary for the user are not displayed.

[0045] (Second embodiment) In the first embodiment, the usage pattern of the device 3 is represented by the operating state of the device 3. In contrast, in the present embodiment, an example will be described in which the usage pattern of the device 3 is represented by the installation location (installation room) of the device 3. The differences from the first embodiment are the match pattern of the usage pattern, the contents of the table in the usage pattern storage unit 122, and the contents of the table in the function information storage unit 123.

[0046] FIG. 13A shows an example of a matching pattern for the usage pattern in the second embodiment. In the case where the device 3 is an air conditioner, the data for the past month is divided into days based on the operation history. If the air conditioner is operated during the night (midnight to 6 a.m.) on 80% or more of the days on which it is operated and the operating time during the nighttime hours is longer than the operating time during other hours, the room in which it is installed is estimated to be a "bedroom." The comparison of the operating time periods is required to distinguish it from a server room. The data for the past month is divided into days. If the air conditioner is operated during the daytime and evening hours (10 a.m. to 5 p.m.) on 80% or more of the days on which it is operated and the operating time during the daytime and evening hours is longer than the operating time during the nighttime hours, the room in which it is installed is estimated to be a "living / dining room." The comparison of the operating time periods is required to distinguish it from a server room and a bedroom. The data for the past month is divided into days. If the proportion of days on which it is operated 24 hours a day is 80% or more, the room in which it is installed is estimated to be a "server room."

[0047] An example of the contents of the table in the usage pattern storage unit 122 is shown in Fig. 13(B). The usage pattern storage unit 122 stores data on the device ID, model name, and installation room as the estimated usage pattern of device 3. According to Fig. 6, the estimated installation room for the air conditioner with device ID ID-1000 is a "bedroom." The estimated installation room for the air conditioner with device ID ID-1001 is a "server room." The estimated installation room for the air conditioners with device IDs ID-1002 and ID-1003 is a "living room / dining room."

[0048] 13C shows an example of the contents of the table in the function information storage unit 123. The function information storage unit 123 stores, for each function, the room in which the function is installed as the type of use that requires the function. The "Sleep Operation 1" and "Sleep Operation 2" functions require that the room in which the function is installed be a "bedroom." The "Automatic Odor Removal" function requires that the type of use is not "Daytime Operation." The "Automatic Odor Removal" function requires that the room in which the function is installed be a "bedroom." Since "Automatic Odor Removal" is performed during the day when no one is present in the room, the above conditions make the function available to the user. The "Server Management Mode" function requires that the room in which the function is installed be a "server room." The "Automatic Air Distribution" function requires that the room in which the function is installed be a "living / dining room." Since multiple people gather in the "living / dining room," the function is determined to be necessary for the user.

[0049] The functional configuration of the cloud server 1 is the same as in Fig. 4, and the display processing is also the same as in Figs. 8, 9, and 11, so a description thereof is omitted. In the second embodiment, by using the installation location of the device 3 as the usage mode of the device 3, only functions that match the user's use and purpose are displayed, and the user can select functions without hesitation when setting up operations, saving time and reducing stress.

[0050] (Third embodiment) In the first embodiment, the usage pattern of the device 3 is estimated from the operation history of the device 3. In contrast, in the present embodiment, the usage pattern of the device 3 is estimated by inputting keywords that represent the use and purpose of the device 3 instead of the operation history.

[0051] The functional configuration of cloud server 1 in this embodiment is shown in Fig. 14. What differs from Fig. 4 is that a keyword acquisition unit 311 and a keyword storage unit 321 are provided instead of operation history collection unit 111 and operation history storage unit 121, and that keyword acquisition unit 311 acquires keywords entered by the user and transmitted from terminal device 2. Terminal device 2 displays a home screen on display unit 24 based on the home screen setting information transmitted from cloud server 1. This home screen has an input field for inputting keywords related to the usage pattern of device 3.

[0052] FIG. 15 shows an example of a home screen displayed on the terminal device 2 according to the present embodiment. The screen in FIG. 15 displays a list of devices 3, including an air conditioner, a water heater, and a ventilation fan. Below the name of each device, an input field 331 is provided for inputting keywords related to the usage pattern of the device. For example, as shown in FIG. 16, the input field 331 is a drop-down list. The drop-down list includes options such as "mainly used while sleeping," "mainly used during the daytime," and "used all day," and the user selects an option from the list that best suits the user's intended use. Alternatively, the input field 331 may be configured to allow the user to directly input characters instead of a drop-down list. For example, the user can input keywords such as "morning," "daytime," "night," "timer," and "server" into the input field 331 as keywords representing the intended use or purpose.

[0053] The keywords entered by the user in the input field 331 are transmitted from the terminal device 2 to the cloud server 1, and the keyword acquisition unit 311 acquires the received keywords. The keyword acquisition unit 311 stores the acquired keywords in the keyword storage unit 321.

[0054] The display process in the third embodiment is the same as that in FIG. 8, and the screen generation process is also the same as that in FIG. 11, so they are omitted, and the details of the usage estimation process are shown in FIG. 17. In FIG. 17, the usage pattern estimation unit 112 determines whether or not there is a keyword related to device 3 in the keyword storage unit 321 (step S401). If there is no keyword for device 3 (step S401: No), the usage pattern estimation unit 112 ends the usage pattern estimation process. If there is a keyword for device 3 (step S401: Yes), the usage pattern estimation unit 112 acquires the keyword from the keyword storage unit 321 (step S402). The usage pattern estimation unit 112 determines whether or not the keyword matches a usage pattern for estimating a usage pattern (step S403). If the keyword matches a usage pattern (step S404: Yes), the usage pattern estimation unit 112 estimates the corresponding usage pattern as the usage pattern of the corresponding device 3 (step S405). For example, if "mainly used while sleeping" is selected from the drop-down list, "nighttime driving" and "off timer use" are estimated as the usage patterns. If "mainly used during the daytime" is selected, "daytime driving" is estimated as the usage pattern. If "all-day use" is selected, "24-hour driving" is estimated as the usage pattern. If "morning" is entered in the input field 331 as a keyword representing the usage purpose or purpose, "short-term operation" is estimated as the usage pattern because "morning" is expected to be a short-term operation. If "daytime" is entered, "daytime driving" is estimated as the usage pattern. If "night" is entered, "nighttime driving" and "off timer use" are estimated as the usage patterns. If "timer" is entered, "off timer use" is estimated as the usage pattern. If "server" is entered, "24-hour driving" is estimated as the usage pattern. When the processing of step S405 ends or there is no keyword matching the usage pattern (step S404: No), the matching process for each usage pattern ends (step S406). Then, the usage pattern estimation unit 112 stores the usage pattern estimated by pattern matching in the usage pattern storage unit 122 as the usage pattern of the corresponding device 3 (step S407), and ends the usage pattern estimation process.

[0055] In the third embodiment, by using keywords entered by the user to estimate the usage pattern of the device 3, only functions that match the user's use and purpose are displayed, allowing the user to select functions without hesitation when setting up operations, saving time and reducing stress.In addition, even for newly installed devices with no operating history, it is possible to display only functions that match the user's use and purpose.

[0056] (Fourth embodiment) In this embodiment, as in the second embodiment, the usage pattern of the device 3 is represented by the installation location (installation room) of the device 3, and as in the third embodiment, the usage pattern of the device 3 is estimated based on keywords entered by the user as the usage pattern of the device 3. The functional configuration of the cloud server 1 is the same as in Fig. 14, and the home screen configuration and the flowchart of the usage pattern estimation process are also the same as in Figs. 15 and 17, so they will not be described.

[0057] FIG. 18 shows an example of a match pattern for estimating a usage pattern based on keywords entered by a user in this embodiment. FIG. 18 shows the model of device 3, the installation room where device 3 is installed, and words that form a match pattern for keywords entered by a user. For example, for an air conditioner installed in a living room, "living room" and "Living" are defined as words that form a match pattern. Therefore, if the keywords entered by a user include the characters "living room" or "Living," the installation room is determined to be a living room, and "Living room" is extracted as the usage type. Furthermore, for an air conditioner installed in a bedroom, "bedroom" and "Bedroom" are defined as words that form a match pattern. Therefore, if the keywords entered by a user include the characters "bedroom" or "Bedroom," the installation room is determined to be a bedroom, and "Bedroom" is extracted as the usage type. Furthermore, for an air conditioner installed in a dining room, "dining room" and "dining" are defined as words that form a match pattern. Therefore, if the keywords entered by a user include the characters "dining room" or "dining," the installation room is determined to be a dining room, and "dining room" is extracted as the usage type. Furthermore, for air conditioners installed in a hallway, "hall" and "hall" are defined as words that form a match pattern. Therefore, if the keywords entered by the user include the characters "hall" or "hall," the room in which the air conditioner is installed is determined to be a hallway, and "hall" is extracted as the type of use. Furthermore, for air conditioners installed in a child's room, "child's room" and "KidsRoom" are defined as words that form a match pattern. Therefore, if the keywords entered by the user include the characters "child's room" or "KidsRoom," the room in which the air conditioner is installed is determined to be a child's room, and "child's room" is extracted as the type of use. Furthermore, for air conditioners installed in a server room, "server room" and "serverRoom" are defined as words that form a match pattern.Therefore, if the keywords entered by the user include the characters "server room" or "ServerRoom," the room where the air conditioner is installed is assumed to be a server room, and "ServerRoom" is extracted as the type of use. Also, for an air conditioner installed in a guest room, "GuestRoom" and "GuestRoom" are defined as words that form a matching pattern. Therefore, if the keywords entered by the user include the characters "GuestRoom" or "GuestRoom," the room where the air conditioner is installed is assumed to be a guest room, and "GuestRoom" is extracted as the type of use.

[0058] In the fourth embodiment, the installation location of the device 3 is used as the usage pattern of the device 3, and the installation location is estimated using keywords entered by the user, so that only functions that match the user's use and purpose are displayed, allowing the user to select functions without hesitation when setting up operations, saving time and reducing stress.In addition, even for newly installed devices with no operation history, it is possible to display only functions that match the user's use and purpose.

[0059] (Fifth embodiment) In this embodiment, as in the second embodiment, the usage pattern of the device 3 is represented by the installation location (room) of the device 3. Similarly to the third embodiment, the usage pattern of the device 3 is estimated based on a keyword entered by the user as the usage pattern of the device 3. The keyword is the name of the device 3. The input field 331 is a drop-down list, as shown in FIG. 19 . The drop-down list lists items such as "bedroom air conditioner," "living room air conditioner," and "dining room air conditioner" as the names of the device 3, and the user selects an item from this list that matches the user's intended use. Note that the input field 331 may not be a drop-down list, but may be configured so that the user can directly input characters. In the fifth embodiment, the installation location of the device 3 is used as the usage pattern of the device 3, and the device name is used as the keyword entered by the user to estimate the installation location. This displays only functions that match the user's intended use and purpose, allowing the user to select functions without hesitation when setting up operations, reducing hassle and stress. Furthermore, even for newly installed devices with no operating history, only functions that match the user's intended use and purpose can be displayed.

[0060] The present disclosure allows various embodiments and modifications without departing from the broad spirit and scope of the present disclosure. Furthermore, the above-described embodiments are intended to explain the present disclosure and do not limit the scope of the present disclosure. In other words, the scope of the present disclosure is defined by the claims, not the embodiments. Various modifications made within the scope of the claims and the meaning of equivalent disclosures are considered to be within the scope of the present disclosure.

[0061] (Appendix 1) A display system for displaying functional information relating to remote control of a remotely controlled device, comprising: a usage pattern estimation unit that estimates a usage pattern, which is how the device is used; a usage pattern storage unit that stores the estimated usage pattern; a function information storage unit that stores function information related to the remote control in accordance with a usage mode of the device; a display screen management unit that refers to the function information storage unit to acquire function information related to the remote control corresponding to the estimated usage form, and manages the function information as function information to be displayed on a terminal device; a setting screen display instruction unit that transmits to the terminal device setting information for a setting screen to be displayed on the terminal device, the setting information including the acquired function information, Display system. (Appendix 2) an operation history collection unit that collects operation histories of the devices; an operation history storage unit that stores the collected operation history of the device; Furthermore, the usage pattern estimation unit estimates a usage pattern of the device from an operation history of the device; 10. A display system as described in Appendix 1. (Appendix 3) a keyword acquisition unit that acquires keywords related to the usage pattern of the device; the usage pattern estimation unit estimates a usage pattern of the device from the keyword; 10. A display system as described in Appendix 1. (Appendix 4) The usage pattern of the device is information about the location where the device is installed. 4. A display system according to any one of claims 1 to 3. (Appendix 5) the keyword acquisition unit acquires the name of the device; the usage pattern estimation unit estimates a location where the device is installed as a usage pattern of the device from the acquired name of the device; 10. A display system as described in Appendix 3. (Appendix 6) the usage pattern estimation unit determines whether the operation history of the device matches a usage pattern, and estimates the matching usage pattern as the usage pattern of the device. 1. A display system as described in Appendix 2. (Appendix 7) the display screen management unit acquires function information of all functions related to the remote control when the usage mode of the device is unknown; the setting screen display instruction unit transmits to the terminal device setting information for a setting screen to be displayed on the terminal device, the setting information including the acquired function information of all the functions; 7. A display system according to any one of claims 1 to 6. (Appendix 8) the display screen management unit does not acquire the function information related to the remote control when the usage mode of the device is unknown, the setting screen display instruction unit transmits setting information of the setting screen that does not display function information related to the remote control to the terminal device; 7. A display system according to any one of claims 1 to 6. (Appendix 9) A display method for displaying functional information relating to remote control of a remotely controlled device, comprising: A step of estimating a usage pattern, which is a manner in which the device is used; storing the estimated usage pattern; storing function information relating to the remote control in accordance with a usage pattern of the device; acquiring function information relating to the remote control corresponding to the estimated usage mode by referring to the stored function information, and managing the function information as function information to be displayed on a terminal device; and transmitting to the terminal device setting information for a setting screen to be displayed on the terminal device, the setting information including the acquired function information. Display method. (Appendix 10) A program for displaying function information relating to remote control of a remotely controlled device, Computer, a usage pattern estimation unit that estimates a usage pattern, which is how the device is used; a usage pattern storage unit that stores the estimated usage pattern; a function information storage unit that stores function information related to the remote control in accordance with a usage mode of the device; a display screen management unit that refers to the function information storage unit to acquire function information related to the remote control corresponding to the estimated usage form, and manages the function information as function information to be displayed on a terminal device; a setting screen display instruction unit that transmits, to the terminal device, setting information for a setting screen to be displayed on the terminal device, the setting information including the acquired function information; A program that functions as a [Explanation of symbols]

[0062] 1 cloud server, 2 terminal device, 3 equipment, 5 BBR (broadband router), 11, 21 control unit, 12, 22 memory unit, 15, 25 communication unit, 23 input unit, 24 display unit, 111 operation history collection unit, 112 usage pattern estimation unit, 113 display screen management unit, 114 setting screen display instruction unit, 121 operation history memory unit, 122 usage pattern memory unit, 123 function information memory unit, 241 home screen, 242 icon, 311 keyword acquisition unit, 321 keyword memory unit, 331 input field, H building, NW1 wide area network, NW2 local network.

Claims

1. A display system for displaying functional information relating to remote control of a remotely controlled device, comprising: a usage pattern estimation unit that estimates a usage pattern, which is how the device is used; a function information storage unit that stores function information related to the remote control in accordance with a usage mode of the device; a display screen management unit that refers to the function information storage unit to acquire function information related to the remote control corresponding to the estimated usage form, and manages the function information as function information to be displayed on a terminal device; a setting screen display instruction unit that transmits, to the terminal device, setting information for a setting screen to be displayed on the terminal device, the setting information including the acquired function information; a keyword acquisition unit that acquires keywords related to the usage pattern of the device, the usage pattern estimation unit estimates a usage pattern of the device from the keyword; Display system.

2. A display system for displaying functional information relating to the remote control of a remotely controlled device, comprising: a usage pattern estimation unit that estimates a usage pattern, which is how the device is used; a function information storage unit that stores function information related to the remote control in accordance with a usage mode of the device; a display screen management unit that refers to the function information storage unit to acquire function information related to the remote control corresponding to the estimated usage form, and manages the function information as function information to be displayed on a terminal device; a setting screen display instruction unit that transmits, to the terminal device, setting information for a setting screen to be displayed on the terminal device, the setting information including the acquired function information; an operation history collection unit that collects operation histories of the devices; an operation history storage unit that stores the collected operation history of the device; the usage pattern estimation unit estimates a usage pattern of the device from an operation history of the device; The usage form of the device is the location where the device is installed. Display system.

3. the keyword acquisition unit acquires the name of the device; the usage pattern estimation unit estimates a location where the device is installed as a usage pattern of the device from the acquired name of the device; The display system of claim 1 .

4. the usage pattern estimation unit determines whether the operation history of the device matches a usage pattern, and estimates the matching usage pattern as the usage pattern of the device. The display system of claim 2 .

5. the display screen management unit acquires function information of all functions related to the remote control when the usage mode of the device is unknown; the setting screen display instruction unit transmits to the terminal device setting information for a setting screen to be displayed on the terminal device, the setting information including the acquired function information of all the functions; 3. A display system according to claim 1 or 2.

6. the display screen management unit does not acquire function information of the remote control-related function when the usage mode of the device is unknown, the setting screen display instruction unit transmits setting information of the setting screen that does not display function information of the function related to the remote control to the terminal device; 3. A display system according to claim 1 or 2.

7. A display method for displaying functional information relating to remote control of a remotely controlled device, comprising: A step of estimating a usage pattern, which is a manner in which the device is used; storing function information relating to the remote control in accordance with a usage pattern of the device; acquiring function information relating to the remote control corresponding to the estimated usage mode by referring to the stored function information, and managing the function information as function information to be displayed on a terminal device; transmitting, to the terminal device, setting information for a setting screen to be displayed on the terminal device, the setting information including the acquired function information; acquiring keywords related to the usage pattern of the device; In the step of estimating the usage pattern, the usage pattern of the device is estimated from the keyword. Display method.

8. A program for displaying function information relating to remote control of a remotely controlled device, Computer, a usage pattern estimation unit that estimates a usage pattern, which is how the device is used; a function information storage unit that stores function information related to the remote control in accordance with a usage mode of the device; a display screen management unit that refers to the function information storage unit to acquire function information related to the remote control corresponding to the estimated usage form, and manages the function information as function information to be displayed on a terminal device; a setting screen display instruction unit that transmits, to the terminal device, setting information for a setting screen to be displayed on the terminal device, the setting information including the acquired function information; a keyword acquisition unit that acquires keywords related to the usage pattern of the device; the usage pattern estimation unit estimates a usage pattern of the device from the keyword; program.

Citation Information

Patent Citations

  • Information display terminal

    JP1997212324A

  • Information display control device

    JP2002147839A

  • Equipment control system for housing

    JP2007221194A

  • Remote operation system and program for hot water equipment

    JP2019205120A

  • Remote control terminal, program, remote control device, and remote control system

    JP2020113973A