Program, information processing system, and information processing method

Abstract

The objective is to provide programs, information processing systems, and information processing methods that can improve convenience. [Solution] The program of the embodiment causes the computer to display, on a single screen, a first area that displays the home appliance that has been registered when the home appliance has been registered, and a second area that displays an operation section for transitioning to a screen that displays information related to the use of the home appliance or information related to cooking, regardless of whether the registered home appliance exists or does not exist.

Description

Technical Field

[0001] Embodiments of the present invention relate to a program, an information processing system, and an information processing method.

Background Art

[0002] There is known a terminal device on which icons for operating home appliances are displayed. By the way, terminal devices for operating home appliances are expected to further improve convenience.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the present invention is to provide a program, an information processing system, and an information processing method capable of improving convenience.

Means for Solving the Problems

[0005] The program of the embodiment causes a computer to display, on one screen, a first area for displaying the home appliance for which registration has been performed when the registration of the home appliance is performed, and a second area for displaying an operation unit for transitioning to a screen for displaying information related to the use of the home appliance or information related to cooking, in any case where the registered home appliance exists or does not exist at all.

Brief Description of the Drawings

[0006] [Figure 1] A diagram showing the overall configuration of the home appliance system according to the first embodiment. [Figure 2] A block diagram showing the functional configuration of the home appliance according to the first embodiment. [Figure 3] A block diagram showing the functional configuration of the server in the first embodiment. [Figure 4] A diagram showing an example of the contents of the device registration database in the first embodiment. [Figure 5] A diagram showing an example of the contents of the inventory list DB in the first embodiment. [Figure 6] A diagram showing an example of the contents of the recipe database in the first embodiment. [Figure 7] A diagram showing an example of the contents of the reference information database in the first embodiment. [Figure 8] A block diagram showing the functional configuration of the terminal device according to the first embodiment. [Figure 9] A diagram showing an example of the display content shown on the terminal device of the first embodiment. [Figure 10] A diagram showing an example of an individual operation screen that can be used to operate the home appliance according to the first embodiment. [Figure 11] A diagram showing an example of an individual operation screen corresponding to the food ingredient management service of the first embodiment. [Figure 12] This figure shows another example of an individual operation screen corresponding to the food ingredient management service of the first embodiment. [Figure 13] A diagram showing an example of an individual operation screen corresponding to the recipe service of the first embodiment. [Figure 14] This figure shows an example of an individual operation screen corresponding to the batch operation service of the first embodiment. [Figure 15] A diagram showing an example of an individual operation screen corresponding to the home appliance-related service of the first embodiment. [Figure 16] A flowchart showing the display process of the home screen in the first embodiment. [Figure 17] A flowchart showing the display process of the home screen in the first embodiment. [Figure 18] A diagram showing an example of the home screen of the second embodiment. [Figure 19] A diagram showing an example of the home screen of the second embodiment. [Figure 20] A block diagram showing the functional configuration of the terminal device of the second embodiment. [Figure 21]A diagram showing an example of the home screen of the third embodiment. [Figure 22] A diagram showing an example of the home screen of the third embodiment. [Figure 23] A diagram showing an example of the home screen of the third embodiment. [Figure 24] A diagram showing an example of the home screen of the third embodiment.

Embodiments for Carrying Out the Invention

[0007] Hereinafter, a home appliance system, a terminal device, and a program according to embodiments will be described with reference to the drawings. In the following description, components having the same or similar functions are denoted by the same reference numerals. And duplicate descriptions of those components may be omitted. In the present application, "based on XX" means "based at least on XX", and may include cases based on other elements in addition to XX. Also, "based on XX" is not limited to the case of directly using XX, and may include cases based on something obtained by performing calculations or processing on XX. In the present application, "XX or YY" is not limited to either one of XX and YY, and may include both cases of XX and YY. This is the same when there are three or more selectable elements. XX and YY are arbitrary elements (for example, arbitrary information).

[0008] In the present application, "remote operation" is not limited to operating a home appliance from outside the dwelling where the home appliance is located, and may include operating a home appliance using a terminal device inside the dwelling where the home appliance is located. In the present application, "operation" broadly means changing the state of a home appliance. Also, hereinafter, "database" will be abbreviated as "DB".

[0009] (First Embodiment) <1. Overall Configuration of Home Appliance System> FIG. 1 is a diagram showing the overall configuration of the home appliance system 1 according to the first embodiment. The home appliance system 1 includes, for example, one or more home appliances 100, a server 200, and a terminal device 300. Note that one or more of the home appliances 100, the server 200, and the terminal device 300 may be provided as components outside the home appliance system 1. The network NW described later may be, for example, the Internet, a cellular network, a Wi-Fi network, LPWA (Low Power Wide Area), WAN (Wide Area Network), LAN (Local Area Network), or other public or dedicated lines, depending on the situation.

[0010] The home appliance 100 is an electric appliance mainly used at home. The home appliance 100 is arranged inside the residence of the user U. The home appliance 100 is, for example, an air conditioner 100A, a refrigerator 100B, a cooking heater 100C, a washing machine 100D, a vacuum cleaner, a rice cooker, an iron, etc., but is not limited thereto. The home appliance 100 is connected to the network NW via a wireless router WR and a modem M installed inside the residence of the user U. The home appliance 100 can communicate with the server 200 or the terminal device 300 via the network NW. Hereinafter, for convenience of explanation, the air conditioner 100A may be referred to as the "air conditioner 100A", and the cooking heater 100C may be referred to as the "oven range 100C".

[0011] The server 200 is a management server that manages the home appliances 100. The server 200 is composed of one or more server devices (for example, a cloud server). The server 200 may be referred to as a "server system". The server 200 can communicate with the home appliances 100 or the terminal device 300 via the network NW. The server 200 may include an information processing unit that performs edge computing or fog computing, such as an information processing unit included in a router in the network NW. The server 200 is not limited to a cloud server, and may be a computer in the residence of the user U, or a home router (for example, a wireless router WR).

[0012] The terminal device 300 is a terminal device used by user U of the home appliance 100. The terminal device 300 is, for example, a portable terminal device such as a smartphone or tablet terminal device. However, the terminal device 300 is not limited to a portable terminal device and may be a personal computer or the like. The terminal device 300 has a display device 301 including a display screen 301a capable of displaying various information, and an input device 302 capable of receiving input from user U. The input device 302 is, for example, a touch panel provided on top of the display screen 301a of the display device 301. The input device 302 may include a camera, microphone, etc., provided on the terminal device 300.

[0013] The terminal device 300 has application program P installed and supports the functions described below. Application program P is an application program for managing the home appliance 100. Application program P is used, for example, for remote control and status checking of the home appliance 100, or for using services related to the home appliance 100. Hereinafter, the application software launched when application program P is executed will be referred to as the "home appliance management app".

[0014] <2. Home appliances> First, let's explain the 100 home appliances in detail. Figure 2 is a block diagram showing the functional configuration of the home appliance 100. The home appliance 100 includes, for example, an actuator 110, an operating unit 120, a control unit 130, and a storage unit 180.

[0015] The actuator 110 is a drive unit that operates the main functions of the home appliance 100. For example, if the home appliance 100 is a refrigerator, the actuator 110 may be a compressor that compresses the refrigerant or a fan that circulates cold air inside the refrigerator. If the home appliance 100 is a washing machine, the actuator 110 may be a motor that rotates the washing tub.

[0016] The operation unit 120 is an operation button or touch panel provided on the home appliance 100. The operation unit 120 receives operations from user U regarding the home appliance 100. For example, the operation unit 120 receives operations from user U to specify or change the settings of the home appliance 100. The settings of the home appliance 100 include one or more of the following: control quantities related to various controls, target values, thresholds, timer settings, operating modes, etc. Information indicating the settings of the home appliance 100 is stored in the storage unit 180 as setting information 181.

[0017] The control unit 130 is implemented by one or more hardware processors, such as a CPU (Central Processing Unit) mounted on the home appliance 100, executing a program. However, part or all of the control unit 130 may be implemented by hardware such as an ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), or FPGA (Field Programmable Gate Array), or by the cooperation of software and hardware.

[0018] The control unit 130 comprehensively controls the entire home appliance 100. For example, the control unit 130 operates the home appliance 100 by controlling the actuator 110 based on the detection results of sensors installed on the home appliance 100 and the setting information 181. The control unit 130 also performs various controls in response to requests from the server 200 and responds to the server 200.

[0019] The memory unit 180 is a functional unit that stores various types of information. The memory unit 180 is implemented by a combination of RAM (Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable ROM), or SSD (Solid State Drive). The memory unit 180 stores the configuration information 181.

[0020] <3. Server> Next, we will explain Server 200 in detail. Figure 3 is a block diagram showing the functional configuration of server 200. Server 200 includes, for example, a device registration unit 210, a home appliance management unit 220, a service provision unit 230, and a storage unit 280.

[0021] The device registration unit 210, the home appliance management unit 220, and the service provision unit 230 are implemented by one or more hardware processors, such as a CPU mounted on the server 200, executing programs. However, some or all of these functional units may be implemented by hardware such as an ASIC, PLD, or FPGA, or by the cooperation of software and hardware. These functional units may be provided separately in multiple server devices. Furthermore, one or more of these functional units may be provided in a terminal device 300 or a home appliance 100 instead of the server 200.

[0022] <3.1 Equipment Registration Section> The device registration unit 210 registers the home appliance 100 in response to a request from the terminal device 300 (i.e., an application from user U). Device registration means associating a specific user U with the home appliance 100 used by that user U (i.e., the home appliance 100 to be remotely controlled). Device registration is performed, for example, by registering the correspondence between user information that can identify user U (e.g., user ID) and device information that can identify the individual home appliance 100 (e.g., device ID). In this embodiment, the above correspondence is registered in the device registration DB 281 stored in the storage unit 280. The device ID is, for example, the serial number of the home appliance 100. Note that instead of associating a specific user U with a specific home appliance 100, device registration may be performed by associating a specific terminal device 300 used by user U with a specific home appliance 100.

[0023] Figure 4 shows an example of the contents of the device registration DB281. In the device registration DB281, for example, the user ID, device ID, type of home appliance 100 (appliance category), model number of home appliance 100, and display name on the home appliance management app are registered in association with each other.

[0024] When the device registration unit 210 registers a home appliance 100 in response to a request from the terminal device 300, it transmits information indicating the registered home appliance 100 to the terminal device 300. This information indicating the registered home appliance 100 is stored in the storage unit 380 of the terminal device 300 as device registration information 381, which will be described later.

[0025] <3.2 Home appliance management department> The home appliance management unit 220 manages the home appliances 100 that have been registered. For example, when the home appliance management unit 220 receives a remote operation request from the terminal device 300 to remotely operate the home appliance 100, it remotely operates the home appliance 100 by notifying the home appliance 100 of a control command corresponding to the received remote operation request. Also, when the home appliance management unit 220 receives a confirmation request from the terminal device 300 to check the status of the home appliance 100, it notifies the home appliance 100 to send status information indicating the status of the home appliance 100. Based on the status information received from the home appliance 100, the home appliance management unit 220 sends information indicating the status of the home appliance 100 to the terminal device 300.

[0026] In this embodiment, the home appliance management unit 220 includes a centralized operation management unit 221. The centralized operation management unit 221 controls multiple home appliances 100 (for example, multiple home appliances 100 of the same type) collectively based on predetermined signals received from the terminal device 300. In this embodiment, the centralized operation management unit 221 can control multiple air conditioners 100A installed in the residence of user U collectively. For example, the centralized operation management unit 221 can collectively turn off the power to multiple air conditioners 100A.

[0027] <3.3 Service Provision Department> The service provision unit 230 provides services related to the home appliance 100 that has been registered. The services provided by the service provision unit 230 are, for example, services related to the home appliance 100, but are different from the operation (control) of the home appliance 100. In this embodiment, the service provision unit 230 includes a food ingredient management unit 231, a recipe provision unit 232, a reference information provision unit 233, and an advertising information provision unit 234.

[0028] (Food Management Department) The food ingredient management unit 231 provides a food ingredient management service. The food ingredient management service manages the inventory of food ingredients present in user U's home (for example, refrigerator 100B). In this embodiment, the food ingredient management service is a service related to refrigerator 100B (or oven range 100C), and user U can use it (for example, use it without functional limitations) once the refrigerator 100B is registered. The food ingredient management unit 231 accepts input of food ingredients present in user U's home and registers and manages the input food ingredients in the inventory list DB 282 stored in the storage unit 280.

[0029] Figure 5 shows an example of the contents of the inventory list DB282. In the inventory list DB282, the management ID, food name, food classification, storage location, purchase date, best-before date (or expiration date), quantity, unit, and history are associated and managed as inventory list information. The inventory list DB282 is managed separately for each individual refrigerator 100B, for example.

[0030] In addition to inventory list information, the food management unit 231 may also manage shopping list information, candidate list information, and stocked item list information. Shopping list information is information that user U can refer to when shopping to prevent forgetting to buy items. The shopping list information registers food items that user U has confirmed to be in the user's purchase plans (e.g., explicitly stated purchase intention). Candidate list information is information that user U can refer to supplementarily to prevent forgetting to buy items. The candidate list information automatically registers a food item (e.g., stocked item) when its quantity decreases and predetermined conditions are met (e.g., when the inventory becomes zero). Stocked item list information registers food items to be managed as stocked items.

[0031] The ingredient management unit 231 provides a registration function for registering, changing the quantity of, or deleting ingredients included in inventory list information, shopping list information, candidate list information, or regular stock items. For example, the ingredient management unit 231 registers, changes the quantity of, or deletes ingredients included in each list information based on user operations to the operation reception unit 330 of the terminal device 300, which will be described later. The above registration function is an example of a "registration function for registering service-related information."

[0032] (Recipe provision department) The recipe provision unit 232 provides a recipe service. The recipe service is a service related to the suggestion or retrieval of recipes. In this embodiment, the recipe service is a service related to either the refrigerator 100B or the oven range 100C, and becomes available to user U (for example, available without specific functional restrictions) when either the refrigerator 100B or the oven range 100C is registered. The recipe provision unit 232 suggests or searches for recipes based on the recipe DB 283 stored in the storage unit 280. In this embodiment, the recipe service includes a first recipe service and a second recipe service.

[0033] The first recipe service is a service that becomes available when the refrigerator 100B is registered as a device. The first recipe service can suggest or search for recipes (hereinafter referred to as "general recipes") that are not limited to the appliance 100 used for cooking. In this embodiment, the first recipe service is linked with the ingredient management service and can suggest or search for recipes that use ingredients included in the inventory list DB282.

[0034] The second recipe service is a service that becomes available when the oven range 100C is registered as a device. The second recipe service is a service that suggests or allows searching for recipes that use the oven range 100C for cooking (hereinafter referred to as "oven range recipes"). In this embodiment, the second recipe service is linked with the ingredient management service and can suggest or allow searching for recipes that use ingredients included in the inventory list DB282. In other words, in this embodiment, the second recipe service related to the oven range 100C can suggest or allow searching for recipes that use ingredients that are in stock in the refrigerator 100B, exceeding the range of home appliances 100.

[0035] In this embodiment, the second recipe service can suggest or search for oven range recipes corresponding to the model number of the registered oven range 100C, and can also transmit information indicating heating time to the registered oven range 100C. This will be described later. In this embodiment, the second recipe service can also perform searches based on search items not available in the first recipe service (e.g., nutrients).

[0036] Figure 6 shows an example of the contents of Recipe DB283. Recipe DB283 includes Recipe DB283a (first recipe) and Recipe DB283b (second recipe). In Recipe DB283a, the management ID, name, thumbnail image, recipe content, and search words are associated. On the other hand, in Recipe DB283b, the management ID, name, thumbnail image, recipe content, search words, the model number of the corresponding Oven Range 100C, the heating time for the corresponding Oven Range 100C, and nutrients (nutritional components) are associated. For example, Recipe DB283b is provided for each model number of Oven Range 100C.

[0037] As described above, the recipe provision unit 232 provides a browsing function for viewing recipes registered in the recipe database 283. For example, based on user U's operation to the operation reception unit 330 of the terminal device 300, the recipe provision unit 232 identifies a recipe included in the recipe database 283 and transmits the information of that recipe to the terminal device 300. The above browsing function is an example of a "browsing function for viewing service-related information". In this embodiment, the recipe provision unit 232 can view information corresponding to the model of the home appliance 100 used by user U.

[0038] In this embodiment, the recipe provision unit 232 also provides a search function to search for recipes included in the recipe database 283. For example, based on the user U's operation to the operation reception unit 330 of the terminal device 300, the recipe provision unit 232 searches for and identifies a recipe included in the recipe database 283 and transmits the information of that recipe to the terminal device 300. The above search function is an example of a "search function that searches for information related to a service." In this embodiment, the recipe provision unit 232 can search for information corresponding to the model of the home appliance 100 used by the user U.

[0039] In this embodiment, the recipe providing unit 232 provides a transmission function that transmits information indicating the heating time to the oven range 100C for which the device has been registered. For example, the recipe providing unit 232 can obtain information indicating the model number of the oven range 100C for which the device has been registered, based on the device registration DB 281. When a recipe included in the second recipe DB 283b is selected, the recipe providing unit 232 obtains information indicating the heating time for the oven range 100C included in the selected recipe, based on the second recipe DB 283b. Then, through communication between the server 200 and the oven range 100C, the recipe providing unit 232 transmits information indicating the heating time corresponding to the selected recipe to the oven range 100C. The above transmission function is an example of a "transmission function that transmits control quantities to home appliances". Heating time is an example of a "control quantity for home appliances".

[0040] (Reference Information Department) The Reference Information Provision Unit 233 provides a Reference Information Service. The Reference Information Service provides information related to the home appliance 100 (for example, recommended ways to use the home appliance 100). Recommended ways to use the home appliance 100 include convenient ways to use the home appliance 100, convenient ways to use the home appliance management app, or maintenance methods to extend the life of the home appliance 100. Recommended ways to use the home appliance is an example of "information that shows suggestions for how to use or maintain home appliances." From another perspective, recommended ways to use the home appliance is an example of "information that shows recommended ways to use or maintain home appliances." From yet another perspective, it is an example of "information that shows how to improve the quality or efficiency of housework using home appliances." In this embodiment, the Reference Information Provision Unit 233 registers and manages the above-mentioned reference information in the Reference Information DB 284 stored in the Storage Unit 280.

[0041] Figure 7 shows an example of the contents of the Reference Information DB 284. In the Reference Information DB 284, for example, the management ID, name, thumbnail image, content of the reference information (for example, content of usage instructions), and related home appliances 100 are associated. The Reference Information Provision Unit 233 can obtain reference information corresponding to a specific type of home appliance 100 based on the Reference Information DB 284.

[0042] The reference information provision unit 233 selects reference information to be displayed on the home screen DH of the home appliance management app, as described later, based on the selection rule information 285 described later. This information will be described in detail later.

[0043] (Advertising Information Department) The advertising information provision unit 234 provides an advertising information service. The advertising information service provides advertising information introducing the latest home appliances 100. In this embodiment, the advertising information provision unit 234 registers and manages the above-mentioned advertising information in the advertising information DB 286 stored in the storage unit 280. Based on the advertising information DB 286, the advertising information provision unit 234 can acquire advertising information corresponding to the home appliances 100 to be advertised.

[0044] <3.5 Storage section> The memory unit 280 is implemented by a combination of RAM, ROM, EEPROM, or SSD. The memory unit 280 stores, for example, equipment registration DB 281, inventory list DB 282, recipe DB 283, reference information DB 284, selection rule information 285, and advertising information DB 286.

[0045] <4. Terminal Devices> Next, we will explain the terminal device 300 in detail. Figure 8 is a block diagram showing the functional configuration of the terminal device 300. The terminal device 300 includes, for example, a registration reception unit 310, a display control unit 320, an operation reception unit 330, a notification unit 340, and a storage unit 380.

[0046] The registration reception unit 310, the display control unit 320, the operation reception unit 330, and the notification unit 340 are realized by one or more hardware processors, such as a CPU mounted on the terminal device 300, executing the application program P. In other words, the registration reception unit 310, the display control unit 320, the operation reception unit 330, and the notification unit 340 are software functions included in the home appliance management app APP.

[0047] <4.1 Registration Department> The registration reception unit 310 accepts an application for registration of the home appliance 100 based on the operation of user U to the operation reception unit 330. In this application, "accepting an application for registration" or "accepting registration" is not limited to cases where the registration process is completed at the terminal device 300, but may also include cases where the operation of user U instructing equipment registration (i.e., the application for registration) is accepted at the terminal device 300, and the actual registration process is carried out at the server 200.

[0048] In this embodiment, the registration reception unit 310 accepts an application for registration of a home appliance 100 (hereinafter referred to as "target home appliance 100") associated with the user ID used for login, while the user is logged into the home appliance management app using a user ID. For example, user U reads the QR code (registered trademark) attached to the target home appliance 100 using the camera of the terminal device 300. The registration reception unit 310 transmits the QR code information indicating the QR code read using the camera of the terminal device 300 to the server 200. As a result, the device registration unit 210 of the server 200 registers the device by associating the device ID indicated by the QR code information received from the terminal device 300 with the user ID used for login. A QR code is an example of a "two-dimensional barcode".

[0049] <4.2 Display Control Unit> The display control unit 320 controls the content displayed on the display screen 301a of the display device 301 of the terminal device 300 by controlling the display device 301 of the display device 301. For example, the display control unit 320 displays one or more first operation units B1 for operating the home appliance 100, one or more second operation units B2 for using services related to the home appliance 100, one or more third operation units B3 for viewing reference information related to the home appliance 100, one or more fourth operation units B4 for viewing recommended recipes, and one or more fifth operation units B5 for viewing advertising information on the display screen 301a in a predetermined manner (see Figure 9). Hereinafter, when the first to fifth operation units B1, B2, B3, B4, and B5 are not distinguished, they will simply be referred to as "operation unit B". The display control unit 320 will be described in detail later.

[0050] <4.3 Operation Reception Section> The operation reception unit 330 receives operations from user U on the input device 302 in relation to the home appliance management application APP. For example, the operation reception unit 330 receives operations from user U on the operation units B (the first to fifth operation units B1, B2, B3, B4, B5) displayed on the display screen 301a. The operation reception unit 330 sends a signal to the server 200 corresponding to the operation unit B operated by user U. As a result, the server 200 performs processing corresponding to the operation unit B operated by user U.

[0051] <4.4 Hochi Department> The notification unit 340 notifies user U of predetermined content via the display device 301. For example, the notification unit 340 notifies user U of how to use the home appliance management application APP.

[0052] <4.5 Storage section> The memory unit 380 is implemented by a combination of RAM, ROM, EEPROM, or SSD. The memory unit 380 stores the application program P and the device registration information 381. The device registration information 381 stores a list of home appliances 100 that have been registered in association with the user ID of user U who uses the terminal device 300.

[0053] <5. Display content of the display screen> Next, the display content of the terminal device 300 will be described. Unless otherwise specified, the display content described below is implemented by the processing of the display control unit 320. In the following description, "operation unit B" refers to the operation unit displayed on the display screen 301a, which is a function key to which a specific function is assigned in order to call that function. Operation unit B is, for example, an icon displayed on the display screen 301a.

[0054] Figure 9 shows an example of the content displayed on the display screen 301a of the terminal device 300. The screen shown in Figure 9 is, for example, the home screen (top screen) DH of the home appliance management app. The "home screen" is the screen that is initially displayed as the operation screen of the home appliance management app. The black frame indicated by reference numeral 301a in Figure 9 indicates the content that is displayed on the display screen 301a of the display device 301 at one time.

[0055] In this embodiment, the display control unit 320 causes the home screen DH to display the first function area R1, the second function area R2, the third function area R3, the fourth function area R4, and the fifth function area R5. That is, the display control unit 320 causes the first to fifth function areas R1, R2, R3, R4, and R5 to be displayed on a single screen. In this application, "display on a single screen" means "display on a continuous screen." That is, "display on a single screen" is not limited to cases where the content is displayed within a screen that can be viewed at once (for example, within the display screen 301a), but may also include cases where the content is displayed sequentially by scrolling from a state where part of the content is hidden within a screen that can be viewed at once.

[0056] In this embodiment, the widths of the first to fifth functional areas R1, R2, R3, R4, and R5 are the same. For example, the widths of the first to fifth functional areas R1, R2, R3, R4, and R5 match the width of the display screen 301a. The first to fifth functional areas R1, R2, R3, R4, and R5 are arranged vertically on the screen. Hereinafter, when the first to fifth functional areas R1, R2, R3, R4, and R5 are not distinguished, they will simply be referred to as "functional area R".

[0057] <5.1 First functional area> The first functional area R1 is a functional area corresponding to "home appliance control (home appliance operation)". The first functional area R1 includes one or more first operation units B1 for operating home appliances 100. In this embodiment, the first functional area R1 displays multiple first operation units B1 for operating different home appliances 100.

[0058] In this application, "operating unit for operating home appliance 100" is not limited to an operating unit for directly operating the home appliance 100, but may also be an operating unit for transitioning to an operation screen on which the home appliance 100 can be operated. In this embodiment, when the first operating unit B1 is operated (for example, tapped) by the user U, the system transitions to the individual operation screen (a separate operation screen for each home appliance 100) corresponding to the operated first operating unit B1.

[0059] In this embodiment, when a home appliance 100 is registered, a first operation unit B1 corresponding to the registered home appliance 100 is added to the first functional area R1. That is, the number of first operation units B1 corresponds to the number of registered home appliances 100.

[0060] In this embodiment, the size (e.g., vertical width) of the first functional area R1 is changed according to the number of first operating units B1. That is, the more home appliances 100 that are registered, the larger the size (e.g., vertical width) of the first functional area R1 becomes. On the other hand, the fewer home appliances 100 that are registered, the smaller the size (e.g., vertical width) of the first functional area R1 becomes.

[0061] Figure 9 shows an example where multiple home appliances 100, namely "Air Conditioner 1," "Air Conditioner 2," "Refrigerator," "Oven Range," and "Washing Machine," are registered, and as a result, multiple first control units B1 are displayed: B1a for operating "Air Conditioner 1," B1b for operating "Air Conditioner 2," B1c for operating "Refrigerator," B1d for operating "Oven Range," and B1e for operating "Washing Machine."

[0062] Figure 10 shows an example of an individual operation screen 410 that allows operation of a home appliance 100. The individual operation screen 410 displays one or more operation units 411 that allow operation of the home appliance 100. For example, Figure 10 shows an individual operation screen 410 corresponding to an air conditioner 1. The individual operation screen 410 corresponding to air conditioner 1 is displayed by transitioning from the home screen DH, for example, when the first operation unit B1a corresponding to "air conditioner 1" is operated (e.g., tapped) on the home screen DH.

[0063] On the individual operation screen 410 corresponding to air conditioner 1, the operation units 411 that allow operation of air conditioner 1 are displayed, including an operation unit 411a for switching the ON / OFF state of air conditioner 1 and an operation unit 411b for changing the room temperature setting. The individual operation screen 410 also includes a display unit 412 that shows the status of the home appliance 100. Figure 10 shows an example of the individual operation screen 410 corresponding to air conditioner 1, but on individual operation screens 410 corresponding to other types of home appliances 100, the operation units 411 and display units 412 will be displayed according to the type of home appliance 100.

[0064] User U's operations on the operation unit 411 displayed on the individual operation screen 410 are received by the operation reception unit 330, and a signal corresponding to the operated operation unit 411 is transmitted to the home appliance control unit 220 of the server 200. This enables remote control and status checking of the home appliance 100.

[0065] <5.2 Second functional area> Returning to Figure 9, the second functional area R2 will be described. The second functional area R2 is a functional area corresponding to services related to the home appliance 100 (hereinafter referred to as "home appliance-related services"). The second functional area R2 includes one or more second operation units B2 for using the home appliance-related services. In this embodiment, the second functional area R2 displays multiple second operation units B2, each corresponding to a different home appliance-related service.

[0066] In this application, "operating unit for using the service" is not limited to an operating unit for directly using the service, but may also be an operating unit for transitioning to an operating screen where the service can be used. In this embodiment, when the second operating unit B2 is operated (for example, tapped) by user U, it transitions to an individual operating screen for the home appliance-related service corresponding to the operated second operating unit B2 (an operating screen separated for each home appliance-related service).

[0067] In this embodiment, the home appliance-related services include a first home appliance-related service and a second home appliance-related service. The first home appliance-related service is a service related to the home appliance 100, but is different from the operation of the home appliance 100. The first home appliance-related service is the "food ingredient management service" or "recipe service" described later. On the other hand, the second home appliance-related service is a service related to the home appliance 100, but is related to the operation of the home appliance 100. The second home appliance-related service is the "bulk operation service" described later.

[0068] In this embodiment, when a home appliance 100 is registered, if there are home appliance-related services associated with the registered home appliance 100, a second operation unit B2 corresponding to those home appliance-related services is added to the second functional area R2. On the other hand, when a home appliance 100 is registered, if there are no home appliance-related services associated with the registered home appliance 100, the second operation unit B2 is not added. In other words, the number of second operation units B2 corresponds to the number of home appliance-related services that become available to user U as a result of the home appliance 100 being registered.

[0069] In this embodiment, the size (e.g., vertical width) of the second functional area R2 is changed according to the number of second operation units B2. That is, the more home appliance-related services associated with the registered home appliance 100, the larger the size (e.g., vertical width) of the second functional area R2. On the other hand, the fewer home appliance-related services associated with the registered home appliance 100, the smaller the size (e.g., vertical width) of the second functional area R2. For example, in this embodiment, there are no home appliance-related services associated with the washing machine 100D. In this case, if the only registered home appliance 100 is the washing machine 100D, a first operation unit B1 for operating the washing machine 100D is added to the first functional area R1, but no second operation unit B2 is added to the second functional area R2.

[0070] Figure 9 shows an example where, as home appliance-related services associated with the registered home appliances 100 (air conditioner 1, air conditioner 2, refrigerator, and microwave oven), there are "food ingredient management service," "recipe service," and "bulk operation service," resulting in the display of multiple second operation units B2: second operation unit B2a for using the "food ingredient management service," second operation unit B2b for using the "recipe service," and second operation unit B2c for using the "bulk operation service."

[0071] The "Food Management Service" is a service related to the refrigerator 100B (or oven range 100C) and is provided by the food management unit 231 of the server 200. The second operation unit B2a corresponding to the "Food Management Service" is added when the refrigerator 100B or oven range 100C is registered as a device. The "Food Management Service" is an example of the "First Home Appliance Related Services". Details of the "Food Management Service" will be described later.

[0072] The "Recipe Service" is a service related to the refrigerator 100B or the oven range 100C, and is provided by the recipe provision unit 232 of the server 200. The second operation unit B2b corresponding to the "Recipe Service" is added when the refrigerator 100B or the oven range 100C is registered as a device. The "Recipe Service" is another example of the "First Home Appliance Related Services". Details of the "Recipe Service" will be described later.

[0073] The "bulk operation service" is, for example, a service related to air conditioner 100A, and is provided by the bulk operation management unit 221 of server 200. The second operation unit B2c corresponding to the "bulk operation service" is added when multiple air conditioners 100A are registered as equipment. The "bulk operation service" is an example of the "second home appliance-related service." The second operation unit B2c is an example of the "special operation unit." Details of the "bulk operation service" will be described later.

[0074] In this embodiment, each of the second operation unit B2a corresponding to the "food ingredient management service" and the second operation unit B2b corresponding to the "recipe service" is an operation unit for registering or searching for information related to the home appliance 100 (for example, registering food ingredients in inventory list information or searching for recipes). In this application, "an operation unit for registering or searching for information" is not limited to an operation unit that directly registers or searches for information, but may also be an operation unit that transitions to an operation screen where information can be registered or searched.

[0075] (Food management service) Figure 11 shows an example of an individual operation screen 510 that allows access to home appliance-related services. The individual operation screen 510 displays the control section for using home appliance-related services. For example, Figure 11 shows an individual operation screen 510 that allows access to the "food management service". The individual operation screen 510 is displayed by transitioning from the home screen DH, for example, when the second control section B2a corresponding to the "food management service" is operated (e.g., tapped) on the home screen DH.

[0076] On the individual operation screen 510, an operation unit 511 is displayed for viewing food inventory list information and shopping list information, serving as an operation unit for using home appliance-related services. Additionally, the individual operation screen 510 displays a display unit 512 that shows the status of food management (e.g., inventory status).

[0077] In this embodiment, the individual operation screen 510 corresponding to the "food ingredient management service" displays an operation unit 515 for transitioning to the individual operation screen 610 (see Figure 13) corresponding to another home appliance-related service, the "recipe service." The operation unit 515 is an operation unit that allows switching between multiple independent home appliance-related services without returning to the home screen DH.

[0078] Figure 12 shows an example of another individual operation screen 520 that allows the use of the "food ingredient management service". The individual operation screen 520 is displayed when, for example, the operation unit 511 for viewing inventory list information is operated (e.g., tapped) on the individual operation screen 510 described above. On the individual operation screen 520, an operation unit 521 for viewing the details of each food ingredient registered in the inventory list information is displayed as an operation unit for using home appliance-related services.

[0079] (Recipe service) Figure 13 shows an individual operation screen 610 on which the "Recipe Service" is available. The individual operation screen 610 is displayed when, for example, the second operation unit B2b corresponding to the "Recipe Service" is operated (e.g., tapped) on the home screen DH, transitioning from the home screen DH.

[0080] On the individual operation screen 610, the following control units for using home appliance-related services are displayed: an operation unit 611 for viewing individual recipes, an operation unit 612 for searching recipes, and an operation unit 613 for switching recipe types.

[0081] In this embodiment, when the refrigerator 100B and the oven range 100C are registered, the individual operation screen 610 displays both the recipes registered in the first recipe DB 283a (i.e., "general recipes") and the recipes registered in the second recipe DB 283b (i.e., "oven range recipes"). Each recipe is marked with either a first display M1 indicating that it is a "general recipe" or a second display M2 indicating that it is an "oven range recipe".

[0082] In this embodiment, when the control unit 613 corresponding to "All" is operated, both "General Recipes" and "Oven Range Recipes" are displayed. When the control unit 613 corresponding to "General" is operated, only "General Recipes" are displayed. When the control unit 613 corresponding to "Oven Range" is operated, only "Oven Range Recipes" are displayed.

[0083] In this embodiment, the individual operation screen 610 displays an operation unit 614 for viewing a recipe collection set as a "featured recipe." A "featured recipe" is a collection of recipes categorized by theme, such as season, event, or cooking method. The "featured recipe" is registered in the recipe DB 283 of the server 200 when the operator updates it at a predetermined frequency.

[0084] In this embodiment, the display on the control panel 614 changes according to the device registration status of the home appliance 100. For example, when the refrigerator 100B is registered, the control panel 614 corresponding to multiple (e.g., two) "special recipes" which are "general recipes" is displayed. When the oven range 100C is registered, the control panel 614 corresponding to multiple (e.g., two) "special recipes" which are "oven range recipes" is displayed.

[0085] In this embodiment, the individual operation screen 610 corresponding to the "Recipe Service" displays an operation unit 615 for transitioning to the individual operation screen 510 (see Figure 11) corresponding to another home appliance-related service, the "Ingredient Management Service". The operation unit 615 is an operation unit that allows switching between multiple independent home appliance-related services without returning to the home screen DH.

[0086] (Batch operation service) Figure 14 shows an individual operation screen 710 on which the "bulk operation service" is available. The individual operation screen 710 is displayed when, for example, the second operation unit B2c corresponding to the "bulk operation service" is operated (e.g., tapped) on the home screen DH, transitioning from the home screen DH.

[0087] On the individual operation screen 710, an operation unit 711 is displayed for operating multiple home appliances 100 (for example, multiple air conditioners 100A) at once (for example, turning them all OFF at once) as an operation unit for using home appliance-related services. In addition, the individual operation screen 710 displays a display unit 712 that shows the status of each home appliance 100 (for example, each air conditioner 100A).

[0088] Alternatively, the second control unit B2c displayed on the home screen DH may be a control unit that directly and collectively operates multiple home appliances 100 (for example, multiple air conditioners 100A) (for example, turning them all OFF). In other words, by operating the second control unit B2c, multiple home appliances 100 may be operated directly without transitioning to the individual operation screen 710.

[0089] The above describes an example in which a second control unit B2 corresponding to home appliance-related services such as "food ingredient management service," "recipe service," and "batch operation service" is displayed in the second functional area R2. However, home appliance-related services are not limited to the above example. For example, the second functional area R2 may display a second control unit B2 corresponding to "monitoring service," "after-sales service," "automatic ordering of consumables," "web shopping," "health management," or "video content distribution."

[0090] <5.3 Third functional area> Returning to Figure 9, the third functional area R3 will be described. The third functional area R3 is a functional area corresponding to the "reference information service." The "reference information service" is a service provided by the reference information provision unit 233 of the server 200. The third functional area R3 includes one or more third operation units B3 for viewing reference information related to the home appliance 100. In this embodiment, the third functional area R3 displays multiple third operation units B3, each corresponding to different reference information.

[0091] In this application, the "operating unit for viewing reference information" is not limited to an operating unit for directly viewing reference information, but may also be an operating unit for transitioning to an operating screen where reference information can be viewed. From one perspective, viewing reference information related to home appliances 100 can also be considered one of the home appliance-related services.

[0092] In this embodiment, the reference information associated with the third operation unit B3 changes according to the device registration status of the home appliance 100. For example, among the reference information associated with multiple third operation units B3, the reference information corresponding to the type of home appliance 100 that has been registered takes precedence.

[0093] Furthermore, in this embodiment, the number of third operation units B3 displayed in the third functional area R3 does not change according to the number and type of home appliances 100 that have been registered. That is, even if there are no home appliances 100 that have been registered, or if there is no reference information related to home appliances 100 that have been registered, a predetermined number (for example, four) of third operation units B3 will be displayed. In this case, reference information related to home appliances 100 that have not been registered will be associated with the predetermined number of third operation units B3.

[0094] On the other hand, if there is a home appliance 100 that has been registered and reference information related to that home appliance 100 exists, then some or all of the predetermined number of third operation units B3 will be associated with the reference information related to the registered home appliance 100. For example, if only the refrigerator 100B is registered, four third operation units B3 will be displayed for viewing the reference information related to the refrigerator 100B. For example, if both the air conditioner 100A and the refrigerator 100B are registered, two third operation units B3 will be displayed for viewing the reference information related to the air conditioner 100A, and two third operation units B3 will be displayed for viewing the reference information related to the refrigerator 100B.

[0095] The reference information associated with these third operation units B3 is selected from among multiple reference information entries registered in the reference information DB 284 stored in the storage unit 280 of the server 200 and displayed in the third functional area R3. This selection of reference information is determined by the reference information provision unit 233 of the server 200 based on the type of home appliance 100 that has been registered and the selection rule information 285 stored in the storage unit 280 of the server 200.

[0096] <5.4 Fourth functional area> The fourth functional area R4 is a functional area corresponding to "Recommended Recipes (Pick-up Recipes)". "Recommended Recipes" is a service provided by the recipe provision unit 232 of the server 200. The fourth functional area R4 includes one or more fourth operation units B4 for viewing recommended recipes. In this embodiment, the fourth functional area R4 displays multiple fourth operation units B4, each corresponding to a different recommended recipe.

[0097] In this embodiment, the recommended recipes associated with the fourth operation unit B4 change according to the device registration status of the home appliance 100. For example, the recommended recipes associated with multiple fourth operation unit B4s are selected from among the recipes corresponding to the home appliance 100 that has been registered. For example, when the refrigerator 100B is registered, the recommended recipes selected from among the multiple recipes (i.e., "general recipes") included in the first recipe DB283a become the display candidates. Similarly, when the oven range 100C is registered, the recommended recipes selected from among the multiple recipes (i.e., "oven range recipes") included in the second recipe DB283b become the display candidates. The fourth function area R4 then displays the fourth operation unit B4 corresponding to a predetermined number (for example, four) of recommended recipes randomly selected from among these multiple display candidates.

[0098] The recommended recipes associated with the fourth control panel B4 are randomly selected from, for example, the "special recipes" described in the explanation of the second functional area R2. In a specific example, if "Special A" of oven range recipes includes recipes 1, 2, and 3, "Special B" of oven range recipes includes recipes 4, 5, and 6, "Special C" of general recipes includes recipes 7, 8, 9, and 10, and "Special D" of general recipes includes recipes 11, 12, and 13, then a predetermined number (for example, 4) of recommended recipes randomly selected from these recipes 1 to 13 will be displayed on the fourth control panel B4 in the fourth functional area R4.

[0099] <5.5 Fifth functional area> Next, the fifth functional area R5 will be described. The fifth functional area R5 is a functional area corresponding to the "advertising information service". The "advertising information service" is a service provided by the advertising information provision unit 234 of the server 200. The fifth functional area R5 includes one or more fifth operation units B5 for viewing advertising information. In this embodiment, the fifth functional area R5 displays multiple fifth operation units B5, each corresponding to different advertising information. In this embodiment, the number of fifth operation units B5 is fixed regardless of the type or number of registered home appliances 100.

[0100] <6. Display Modes for Functional Areas> <6.1 Changes depending on the type or number of home appliances> Next, the display modes of the first to fifth functional areas R1, R2, R3, R4, and R5 will be described. In this embodiment, the display control unit 320 changes whether or not the first functional area R1 is displayed, or whether or not the second functional area R2 is displayed, depending on the type or number of home appliances 100 that have been registered.

[0101] (Display of the first functional area) In this embodiment, the display control unit 320 does not display (hides) the first function area R1 if there are no home appliances 100 that have been registered. In this application, "do not display the function area" is not limited to not displaying the function area at all, but may include a state in which it is hidden in a manner that allows switching to a display state (such as a state in which only the operation part that can be transitioned to a display state is displayed and other areas are hidden). The same applies to the second function area R2. Alternatively, the display control unit 320 may, when there are no home appliances 100 that have been registered, display the first function area R1 in a smaller manner (for example, a manner with a smaller vertical width) compared to the first function area R1 when there are home appliances 100 that have been registered.

[0102] Furthermore, the display control unit 320 does not display (hides) the first function area R1 if the registered home appliances 100 are only of a specific type of home appliance 100 (hereinafter referred to as "first specific type of home appliance 100"). Alternatively, if the registered home appliances 100 are only of the first specific type of home appliance 100, the display control unit 320 may display the first function area R1 in a smaller form (for example, a form with a smaller vertical width) compared to the first function area R1 when the operation unit B1 is displayed.

[0103] "First specific type of home appliance" refers to, for example, a home appliance that does not have or has limited remote control functionality using the terminal device 300. In this embodiment, "first specific type of home appliance" is an electric vacuum cleaner or an iron. On the other hand, once the first specific type of home appliance 100 is registered, the third functional area R3 displays an operation unit B3 for viewing reference information (e.g., usage tips) related to the first specific type of home appliance 100.

[0104] (Display of the second functional area) The display control unit 320 will not display (hide) the second function area R2 if, with respect to multiple home appliances 100 operated by multiple first operation units B1 (all home appliances 100 for which device registration has been performed), there are no home appliance-related services associated with one or more of these multiple home appliances 100. Alternatively, if there are no home appliance-related services, the display control unit 320 may display the second function area R2 in a smaller form (for example, a form with a smaller vertical width) compared to the second function area R2 when home appliance-related services exist.

[0105] Furthermore, the display control unit 320 will not display (hide) the second function area R2 if the registered home appliances 100 are only of a specific type of home appliance 100 (hereinafter referred to as "second specific type of home appliance 100"). Alternatively, the display control unit 320 may display the second function area R2 in a smaller form (for example, a form with a smaller vertical width) compared to the second function area R2 when the operation unit B2 is displayed, if the registered home appliances 100 are only of the second specific type of home appliance 100.

[0106] A "second specified type of home appliance" refers to a home appliance for which the home appliance-related services associated with the home appliance 100 are limited. The "second specified type of home appliance" may overlap with the "first specified type of home appliance." In this embodiment, the "second specified type of home appliance" includes washing machines, vacuum cleaners, irons, etc. On the other hand, once the second specified type of home appliance 100 is registered, the individual operation screen 810 (see Figure 15), which corresponds to the "service list" described later, displays an operation unit 811 for using home appliance-related services associated with the second specified type of home appliance 100. Examples of home appliance-related services associated with the second specified type of home appliance 100 include a service that displays the brand of detergent being used for the washing machine, and a service that notifies the user of the next filter cleaning time for the vacuum cleaner.

[0107] <7. Other operating parts> Next, with reference to Figure 9, the other control units will be described. The home screen DH displays the control unit B6 corresponding to the "Service List". In this embodiment, when the control unit B6 is operated (for example, tapped) by the user U, the user transitions to the individual operation screen corresponding to the "Service List".

[0108] Figure 15 shows an example of an individual operation screen corresponding to home appliance-related services. Figure 15(a) shows an example of an individual operation screen 810 corresponding to the "Service List". The individual operation screen 810 displays multiple operation units 811, each corresponding to a different home appliance-related service.

[0109] In this embodiment, the second functional area R2 of the home screen DH displays only the second operation unit B2 corresponding to the appliance-related service if there is an appliance-related service associated with the appliance 100 that has been registered. On the other hand, the individual operation screen 810 corresponding to the "service list" displays the operation unit 811 corresponding to all appliance-related services provided by the service provision unit 230 of the server 200, regardless of whether the appliance 100 has been registered or not. In other words, even if the refrigerator 100B and the oven range 100C have not been registered, the operation unit 811 for using the "food management service" and the "recipe service" will be displayed.

[0110] In this embodiment, multiple operation units 811 are displayed, including an operation unit 811a for using the "food ingredient management service" and an operation unit 811b for using the "recipe service". Operation unit 811a is, for example, an operation unit having the same function as the second operation unit B2a displayed in the second function area R2. Operation unit 811b is, for example, an operation unit having the same function as the second operation unit B2b displayed in the second function area R2.

[0111] On the other hand, the control unit corresponding to the "bulk operation service" is not displayed. In other words, the individual operation screen 810 displays the control unit 811 for using home appliance-related services that are different from the operation of the home appliance 100. On the other hand, the individual operation screen 810 does not display the control unit for using home appliance-related services that are related to the operation of the home appliance 100.

[0112] In this embodiment, the individual operation screen 810 displays an operation unit 811c for using the "reference information service" as one of the operation units 811. When the operation unit 811c is operated (for example, tapped), the individual operation screen 810 transitions to the individual operation screen 820.

[0113] Figure 15(b) shows an example of an individual operation screen 820 for using the "Reference Information Service". The individual operation screen 820 displays multiple operation units 821 for viewing different reference information (e.g., recommended usage tips). Unlike the fourth functional area R4, the individual operation screen 820 displays operation units 821 corresponding to all reference information registered in the reference information DB 284, regardless of whether or not it is related to the registered home appliance 100. In other words, when viewing reference information related to home appliance 100 (e.g., recommended usage tips), the content and amount displayed on the home screen DH is different from the content and amount displayed on the individual operation screen 820 accessed from the "Service List".

[0114] <8. Processing Flow> Figures 16 and 17 are flowcharts showing the display process for the home screen DH. First, when the application program P is started and the home screen DH of the home appliance management app APP is displayed, the display control unit 320 detects the number and type of home appliances 100 that have been registered (hereinafter referred to as "registered home appliances 100") based on the device registration information 381 stored in the storage unit 380 (S111).

[0115] Next, the display control unit 320 determines whether there is one or more registered home appliances 100 (S112). If there are no registered home appliances 100 (S112: NO), the display control unit 320 decides not to display the first function area R1 and the second function area R2 (S113). On the other hand, if there is one or more registered home appliances 100 (S112: YES), the display control unit 320 decides to display the first function area R1 and the first operation unit B1 corresponding to the one or more registered home appliances 100 (S114).

[0116] Next, the display control unit 320 determines whether at least one of the registered home appliances 100 is included in the registered home appliances 100, if there is one or more registered home appliances 100 (S115).

[0117] The display control unit 320 decides to display the second operation unit B2a corresponding to the "food ingredient management service" and the second operation unit B2b corresponding to the "recipe service" if the registered home appliances 100 include at least one of the refrigerator 100B or the oven range 100C (S115: YES) (S116). On the other hand, the display control unit 320 decides that it is unnecessary to display the second operation unit B2a corresponding to the "food ingredient management service" and the second operation unit B2b corresponding to the "recipe service" if the registered home appliances 100 do not include either the refrigerator 100B or the oven range 100C (S115: NO) (S117).

[0118] Next, the display control unit 320 determines whether the registered home appliance 100 includes multiple air conditioners 100A (S118). If the registered home appliance 100 includes multiple air conditioners 100A (S118: YES), the display control unit 320 decides to display the second operation unit B2c corresponding to the "bulk operation service" (S119). On the other hand, if the registered home appliance 100 does not include multiple air conditioners 100A (S118: NO), the display control unit 320 decides that it is not necessary to display the second operation unit B2c corresponding to the "bulk operation service" (S120).

[0119] Next, the display control unit 320 determines whether it is necessary to display at least one second operation unit B2 (S121). If it is determined that it is necessary to display at least one second operation unit B2 (S121: YES), the display control unit 320 decides to display the second function area R2 (S122). On the other hand, if it is determined that it is unnecessary to display any of the second operation units B2 (S121: NO), the display control unit 320 decides not to display the second function area R2 (S124).

[0120] Next, the display control unit 320 sends a transmission request to the server 200 to send information used for displaying reference information (e.g., usage tips) (hereinafter referred to as the "reference information list"), a transmission request to send information used for displaying recommended recipes (hereinafter referred to as the "recommended recipes"), and information showing a list of registered home appliances 100 (hereinafter referred to as the "device list") (S131).

[0121] The reference information provision unit 233 of the server 200 selects reference information to associate with multiple third operation units B3 from the reference information DB 284 based on the device list received from the terminal device 300 and the selection rule information 285, and generates a reference information list by listing the name of the selected reference information, a thumbnail image, and a URL for accessing the reference information (S132). Then, the reference information provision unit 233 of the server 200 transmits the generated reference information list to the terminal device 300 (S133).

[0122] The recipe provision unit 232 of the server 200 selects recommended recipes from the recipe DB 283 to associate with multiple fourth operation units B4 based on the device list received from the terminal device 300, and generates a recommended recipe list by listing the names of the selected recipes, thumbnail images, and URLs for accessing the recipes (S134). Then, the recipe provision unit 232 of the server 200 sends the generated recommended recipe list to the terminal device 300 (S135).

[0123] Furthermore, the display control unit 320 notifies the server 200 of a request to send advertising information (S141). The advertising information provision unit 234 of the server 200 selects advertising information to associate with multiple fifth operation units B5 from the advertising information DB 286, and generates an advertising information list by listing the name of the selected advertising information, a thumbnail image, and a URL for accessing the advertising information (S142). Then, the advertising information provision unit 234 of the server 200 sends the generated advertising information list to the terminal device 300 (S143).

[0124] The display control unit 320 then displays a plurality of first operation units B1 corresponding to the detected registered home appliance 100 in the first function area R1, a plurality of second operation units B2 corresponding to the detected registered home appliance 100 in the second function area R2, a plurality of third operation units B3 in the third function area R3 based on the reference information list received from the server 200, a plurality of fourth operation units B4 in the fourth function area R4 based on the recommended recipe list received from the server 200, and a plurality of fifth operation units B5 in the fifth operation area R5 based on the advertising information list received from the server 200 (S151). As a result, the home screen DH is displayed.

[0125] <9. Advantages> In this embodiment, the display control unit 320 can display a first function area R1 containing a plurality of first operation units B1 for operating different home appliances 100, and a second function area R2 containing a second operation unit B2 different from the plurality of first operation units B1, on a single screen. Furthermore, it changes whether or not to display the first function area R or the second function area R depending on the type or number of home appliances 100 that have been registered. With this configuration, the necessary function areas R can be displayed while maintaining a clean appearance on the screen. As a result, it becomes easier for the user U to intuitively operate the operation unit B. This improves the convenience for the user U.

[0126] In this embodiment, the display control unit 320 either does not display the first function area R1 if there are no registered home appliances 100, or displays the first function area R1 in a smaller form than when there are registered home appliances 100. With this configuration, the first function area R1 is not displayed or is displayed in a smaller size when it is not needed, so the screen can be kept clean and uncluttered. This further improves the convenience of the user U.

[0127] In this embodiment, if there is a service related to a registered home appliance 100, the display control unit 320 displays the second operation unit B2 corresponding to the service in the second function area R2 when the home appliance 100 is registered. With this configuration, the first operation unit B1 corresponding to the operation of the home appliance 100 and the second operation unit B2 corresponding to home appliance-related services are displayed on a single screen according to the registration status of the home appliance 100 of the user U. This enables the provision of services that match the user U's usage. In addition, since the first operation unit B1 or the second operation unit B2 related to home appliances 100 that have not been registered are not displayed on the screen, the screen can be made to look neat and tidy, improving visibility.

[0128] In this embodiment, the display control unit 320, with respect to a plurality of home appliances 100 operated by a plurality of first operation units B1, either does not display the second function area R2, or displays the second function area R2 in a smaller form than when such a service exists, if there is no service associated with one or more of the plurality of home appliances 100. With this configuration, the second function area R2 is not displayed or is displayed in a smaller size when it is not needed, thus maintaining a clean screen appearance. This further improves the convenience of the user U.

[0129] (Second Embodiment) Next, a second embodiment will be described. The second embodiment differs from the first embodiment in that the display relationship between the first functional area R1 and the second functional area R2 is changed according to the type or number of home appliances 100 that have been registered. Other than what is described below, the configuration is the same as in the first embodiment.

[0130] Figures 18 and 19 show an example of the home screen DH of the second embodiment. Figure 18 shows the first state of the terminal device 300. The first state is when a specific type of home appliance 100 (e.g., refrigerator 100B or oven range 100C) has not been registered, and the second operation unit B2 for using specific types of home appliance-related services (e.g., "food management service" and "recipe service") is not displayed in the second function area R2.

[0131] A "specific type of home appliance-related service" is, for example, a service that may be used more frequently than operating the home appliance 100. A "specific type of home appliance-related service" is pre-configured based on prior research and stored in the storage unit 380 as determination information 383 (see Figure 8). The display control unit 320 determines, based on the determination information 383, whether or not the home appliance-related service to be judged is a "specific type of home appliance-related service".

[0132] In the first state, the display control unit 320 displays the first function area R1 and the second function area R2 in that order from the top of the home screen DH.

[0133] On the other hand, Figure 19 shows the second state of the terminal device 300. The second state is when a specific type of home appliance 100 (for example, a refrigerator 100B or a microwave oven 100C) is registered, and the second operation unit B2 for using specific types of home appliance-related services (for example, "food management service" and "recipe service") is displayed in the second function area R2.

[0134] In the second state, the display control unit 320 reverses the display order of the first functional area R1 and the second functional area R2 compared to the first state. That is, the display control unit 320 displays the second functional area R2 and the first functional area R1 from the top of the home screen DH. Changing the display order is an example of "changing the display relationship between the first and second functional areas."

[0135] With this configuration, depending on the registration status of the home appliance 100, the display of either the first control unit B1 for operating the home appliance 100 or the second control unit B2 corresponding to a different function is changed to be displayed at the top of the screen. This makes it easier for user U to intuitively operate the control unit B they want to use. This improves user U's convenience.

[0136] The above describes an example in which the display relationship between the first function area R1 and the second function area R2 is changed according to the type of home appliance 100 that has been registered. Alternatively, the display relationship between the first function area R1 and the second function area R2 may be changed according to the number of home appliances 100 that have been registered. For example, if the number of registered home appliances 100 is greater than the number of available home appliance-related services, the first function area R1 and the second function area R2 may be displayed from the top of the home screen DH. On the other hand, if the number of registered home appliances 100 is less than the number of available home appliance-related services, the second function area R2 and the first function area R1 may be displayed from the top of the home screen DH.

[0137] Furthermore, "changing the display relationship between the first functional area R1 and the second functional area R2" is not limited to changing the display order on the screen, but may also include changing the display manner (e.g., whether or not highlighting is used) or size of the first functional area R1 or the second functional area R2 on the screen.

[0138] (Third embodiment) Next, a third embodiment will be described. The third embodiment differs from the first embodiment in that the display status of the first functional area R1, the display status of the second functional area R2, or the display relationship between the first functional area R1 and the second functional area R2 is changed depending on the frequency of use of the first functional area R1 or the second functional area R2 by user U. Other than what is described below, the configuration is the same as in the first embodiment.

[0139] Figure 20 is a block diagram showing the functional configuration of the terminal device 300 of the second embodiment. The terminal device 300 has a usage frequency detection unit 360. The usage frequency detection unit 360 is a software function unit included in the home appliance management application APP.

[0140] The usage frequency detection unit 360 detects the usage frequency (operation frequency) of each operation unit B (the first to fifth operation units B1, B2, B3, B4, B5) displayed by the display control unit 320, based on the operation history of user U received by the operation reception unit 330. In this embodiment, the usage frequency detection unit 360 detects the usage frequency for each of the first operation units B1a, B1b, B1c, B1d, B1e and the second operation units B2a, B2b, B2c, which will be described later.

[0141] In this embodiment, the usage frequency detection unit 360 detects the usage frequency (operation frequency) of user U for each functional area R (the first to fifth functional areas R1, R2, R3, R4, R5) described later, based on the usage frequency (operation frequency) of the operation unit B. The usage frequency of each functional area R may be calculated, for example, based on the total number of operations on all operation units B included in each functional area R, or it may be calculated based on the average of the operation frequencies on all operation units B included in each functional area R. The usage frequency of the first functional area R1 is an example of "user U's usage frequency with respect to the first functional area R1". The usage frequency of the second functional area R2 is an example of "user U's usage frequency with respect to the second functional area R2".

[0142] (Display of the first functional area) Figure 21 shows an example of the home screen DH when the first functional area R1 is not displayed. In this embodiment, the display control unit 320 does not display (hides) the first functional area R1 if the usage frequency of the first functional area R1 detected by the usage frequency detection unit 360 is below a predetermined standard (for example, once a week or less). As stated above, in this application, "do not display" is not limited to not displaying the functional area at all, but may include a state in which it is hidden in a manner that allows switching to a display state (for example, a state in which only the operation unit that can transition to a display state is displayed and other areas are hidden). For example, in the example shown in Figure 21, when the operation unit Bh1 included in the first functional area R1 is operated (for example, tapped), the first functional area R1 is expanded and displayed in the same manner as in Figure 9.

[0143] In this embodiment, even when the display control unit 320 displays the first function area R1 on the home screen DH, it will not display the first operation unit B1 if the individual usage frequency detected by the usage frequency detection unit 360 is below a predetermined standard (for example, once a week or less). In this application, "not displaying the operation unit" is not limited to cases where the operation unit is not displayed at all, but may include cases where it is hidden in a manner that allows switching to a display state. This will be described later with reference to Figure 23. In addition, the display control unit 320 may change the display mode to display the first operation unit B1 if the individual usage frequency detected by the usage frequency detection unit 360 is below a predetermined standard, instead of not displaying it. Changing the display mode may include making it smaller or semi-transparent.

[0144] (Display of the second functional area) Figure 22 shows an example of the home screen DH when the second functional area R2 is not displayed. In this embodiment, the display control unit 320 does not display (hides) the second functional area R2 if the usage frequency of the second functional area R2 detected by the usage frequency detection unit 360 is below a predetermined standard (for example, once a week or less). As stated above, in this application, "do not display" is not limited to not displaying the functional area at all, but may include a state in which it is hidden in a manner that allows switching to a display state (for example, a state in which only the operation unit that can transition to a display state is displayed and other areas are hidden). For example, in the example shown in Figure 22, when the operation unit Bh2 included in the second functional area R2 is operated (for example, tapped), the second functional area R2 is expanded and displayed in the same manner as in Figure 9.

[0145] Furthermore, in this embodiment, even when the display control unit 320 displays the second function area R2 on the home screen DH, it does not display the second operation unit B2 if the individual usage frequency detected by the usage frequency detection unit 360 is below a predetermined standard (for example, once a week or less). In this application, "not displaying the operation unit" is not limited to cases where the operation unit is not displayed at all, but may include a state in which it is hidden in a manner that allows switching to a display state. This will be described later with reference to Figure 23. In addition, the display control unit 320 may change the display mode to display the second operation unit B2 if the individual usage frequency detected by the usage frequency detection unit 360 is below a predetermined standard, instead of not displaying it. Changing the display mode may include making it smaller or semi-transparent.

[0146] (Displays on the first and second operation units) Figure 23 shows an example of the home screen DH in which some of the first operation units B1 and some of the second operation units B2 are hidden. The first functional area R1 displays the operation unit B1z corresponding to "Other". When operation unit B1z is operated, the usage frequency detection unit 360 detects that the usage frequency is below a predetermined standard, and the system transitions to an individual operation screen 910 which groups together one or more operation units B1 that are not displayed in the first functional area R1. Operation units B1 whose usage frequency is below a predetermined standard are displayed by transitioning to the individual operation screen 910. Note that the operation unit B1z corresponding to "Other" may be displayed on the individual operation screen 810 (see Figure 15) corresponding to "Service List" instead of being displayed in the first functional area R1.

[0147] Similarly, the operation unit B2z corresponding to "Other" is displayed in the second functional area R2. When operation unit B2z is operated, the usage frequency detection unit 360 detects that the usage frequency is below a predetermined standard, and transitions to an individual operation screen 920 that groups together one or more operation units B2 that are not displayed in the second functional area R2. Operation units B2 whose usage frequency is below the predetermined standard are displayed by transitioning to the individual operation screen 920. Note that the operation unit B2z corresponding to "Other" may be displayed on the individual operation screen 810 (see Figure 15) corresponding to "Service List" instead of being displayed in the second functional area R2.

[0148] (Changes to the display relationship between the first and second functional areas) Figure 24 shows an example of a home screen DH in which the display order of the first function area R1 and the second function area R2 has been changed from the initial setting. In other words, in this embodiment, the display control unit 320 initially displays the first function area R1 and the second function area R2 from the top of the home screen. On the other hand, the display control unit 320 reverses the display order of the first function area R1 and the second function area R2 from the initial setting when the user's frequency of use of the first function area R1 or the second function area R2 satisfies predetermined conditions.

[0149] The "predetermined conditions" include, for example, when the usage frequency of user U with respect to the first functional area R1 detected by the usage frequency detection unit 360 is less than or equal to a predetermined first reference value (for example, once a week or less), when the usage frequency of user U with respect to the second functional area R2 detected by the usage frequency detection unit 360 is greater than or equal to a predetermined second reference value (for example, 10 times a week or more), or when the usage frequency of user U with respect to the second functional area R2 detected by the usage frequency detection unit 360 is higher than the usage frequency of user U with respect to the first functional area R1.

[0150] With this configuration, the display of the first functional area R1, the display of the second functional area R2, or the display relationship between the first and second functional areas R1 and R2 can be changed depending on the frequency of use by user U. Therefore, the necessary functional areas R can be displayed while maintaining a clean and uncluttered appearance on the screen. This improves user convenience.

[0151] (Fourth Embodiment) Next, the fourth embodiment will be described. The fourth embodiment differs from the first embodiment in that the presence or absence of display of the first functional area R1, the presence or absence of display of the second functional area R2, or the display relationship between the first functional area R1 and the second functional area R2 is changed depending on the time of day. Other than what is described below, the configuration is the same as that of the third embodiment.

[0152] In this embodiment, the usage frequency detection unit 360 detects the usage frequency (operation frequency) of user U for each time period for each operation unit B (first to fifth operation units B1, B2, B3, B4, B5) displayed by the display control unit 320. For example, the usage frequency detection unit 360 detects the usage frequency of user U for each time period for each of the first operation units B1a, B1b, B1c, B1d, B1e and the second operation units B2a, B2b, B2c. The time period may be, for example, a 3-hour time period, a 6-hour time period, or a time period of any other length.

[0153] In this embodiment, the usage frequency detection unit 360 detects the usage frequency of user U for each functional area R (the first to fifth functional areas R1, R2, R3, R4, R5) for each time period, based on the usage frequency of each operation unit B.

[0154] In this embodiment, the display control unit 320 changes the presence or absence of the display of the first functional area R1, the presence or absence of the display of the second functional area R2, or the display relationship between the first functional area R1 and the second functional area R2, based on the detection results from the usage frequency detection unit 360, for each of the above time periods.

[0155] For example, regarding the "Ingredient Management Service," if it is used more than a predetermined standard (e.g., once a day or more) during the morning and evening hours, but less than a predetermined standard (e.g., not used) during the daytime hours, the display control unit 320 will display the second operation unit B2a corresponding to the "Ingredient Management Service" during the morning and evening hours, but not during the daytime hours. Similarly, regarding the "Recipe Service," if it is used more than a predetermined standard (e.g., once a day or more) during the daytime hours, but less than a predetermined standard (e.g., not used) during the morning and evening hours, the display control unit 320 will display the second operation unit B2b corresponding to the "Recipe Service" during the daytime hours, but not during the morning and evening hours. Furthermore, regarding the "Batch Operation Service," if it is used more than a predetermined standard (e.g., once a day or more) during the morning hours, but less than a predetermined standard (e.g., not used) during the daytime, evening, or nighttime hours, the display control unit 320 will display the second operation unit B2a corresponding to the "Ingredient Management Service" during the morning hours, but not during other times.

[0156] In another example, the display control unit 320 displays the second function area R2 and the first function area R1 from the top of the home screen DH during times when the "food ingredient management service" or "recipe service" is frequently used, and displays the first function area R1 and the second function area R2 from the top of the home screen DH during other times.

[0157] With this configuration, it is possible to change whether or not the first functional area R1 is displayed, whether or not the second functional area R2 is displayed, or the display relationship between the first and second functional areas R1 and R2, depending on the time of day. Therefore, it is possible to display the necessary functional areas R while maintaining a clean and uncluttered appearance on the screen. This improves the convenience for the user U.

[0158] Furthermore, the display control unit 320 may, based on criteria different from the frequency of use by user U, change whether or not the first functional area R1 is displayed, whether or not the second functional area R2 is displayed, or the display relationship between the first functional area R1 and the second functional area R2, depending on the time of day. In other words, the display control unit 320 may control the display of a specific operation unit B during a specific time period, regardless of the frequency of use by user U, or control the display of a specific functional area R during a specific time period, or change the display order of the first functional area R1 and the second functional area R2 during a specific time period.

[0159] (Fifth embodiment) Next, a fifth embodiment will be described. The fifth embodiment differs from the first embodiment in that, based on the operation of user U, the presence or absence of display of the first functional area R1, the presence or absence of display of the second functional area R2, or the display relationship between the first functional area R1 and the second functional area R2 can be arbitrarily changed. Other than what is described below, the configuration is the same as that of the first embodiment.

[0160] In this embodiment, the operation reception unit 330 receives operations from user U to arbitrarily change the display status of the first functional area R1, the display status of the second functional area R2, or the display relationship between the first functional area R1 and the second functional area R2. For example, when user U performs a special operation on a functional area R (e.g., long press), the operation reception unit 330 becomes capable of receiving instructions to change the display status or display position of the functional area R. Then, the display control unit 320 changes the display status of the first functional area R1, the display status of the second functional area R2, or the display relationship between the first functional area R1 and the second functional area R2 based on the instructions from user U received by the operation reception unit 330.

[0161] In this embodiment, the operation reception unit 330 may also receive instructions from the user U to change the display status, display mode, or display position of an individual operation unit B. In this case, the display control unit 320 changes the display status, display mode, or display position of an individual operation unit B based on the instructions from the user U received by the operation reception unit 330.

[0162] With this configuration, based on user U's actions, it is possible to change whether the first functional area R1 is displayed, whether the second functional area R2 is displayed, or the display relationship between the first and second functional areas R1 and R2. Therefore, it is possible to display the necessary functional areas R while maintaining a clean and uncluttered appearance on the screen. This improves user convenience.

[0163] Several embodiments have been described above. However, the embodiments are not limited to the examples described above. For example, the first functional area R1 corresponding to the operation of the home appliance 100 and the second functional area R2 corresponding to the use of home appliance-related services may be combined without distinction to form a single functional area. In this case, the functional area formed by combining the first functional area R1 and the second functional area R2 may be an example of the "first functional area," and the third functional area R3 may be an example of the "second functional area." That is, the third operation unit B3 may be an example of a "second operation unit different from the first operation unit." The display control unit 320 may, similar to the first to fifth embodiments described above, change the presence or absence of display in the first functional area (functional area R1, functional area R2) and the second functional area (functional area R3), or change the display relationship between the first and second functional areas, depending on the type or number of home appliances 100 for which the equipment has been registered.

[0164] According to at least one embodiment described above, the display control unit of the terminal device can display a first functional area including a plurality of first operation units for operating different home appliances, and a second functional area including a second operation unit different from the plurality of first operation units, on a single screen. Furthermore, it can change whether or not the first functional area is displayed, whether or not the second functional area is displayed, or the display relationship between the first and second functional areas, depending on the type or number of registered home appliances. Such a configuration can improve convenience.

[0165] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of Symbols]

[0166] 1... Home appliance system, 100... Home appliance equipment, 200... Server, 210... Equipment registration unit, 220... Home appliance equipment management unit, 230... Service provision unit, 300... Terminal device, 310... Registration reception unit, 320... Display control unit, 330... Operation reception unit, 340... Notification unit, 360... Usage frequency detection unit.

Claims

1. On the computer, A first area that displays the home appliance that has been registered when the home appliance has been registered, In both cases, where there are registered home appliances and where there are none, a second area displaying an operation section for transitioning to a screen displaying information related to the use of home appliances or information related to cooking is displayed on a single screen. program.

2. In both cases, where there are registered home appliances and where there are none, a predetermined number of the operation units are displayed in the second area. The program according to claim 1.

3. If no home appliances that have been registered exist, the first area is not displayed, or the first area is displayed in a smaller form than when home appliances that have been registered exist. The program according to claim 1 or claim 2.

4. The number of operating units displayed in the second area does not change according to the number and type of home appliances that have been registered. The program according to claim 1 or claim 2.

5. The information relating to the use of the home appliance, which is associated with the second area, changes according to the registration status of the home appliance. The program according to claim 1 or claim 2.

6. The second area displays multiple operation units, each corresponding to a different recipe. The program according to claim 1 or claim 2.

7. The information relating to the use of the home appliances associated with the second domain includes information relating to how to use the home appliances, information relating to how to use application software available on the computer in relation to the home appliances, or information relating to how to maintain the home appliances. The program according to claim 1 or claim 2.

8. The information relating to the use of the home appliances associated with the second domain includes information relating to improving the quality or efficiency of household chores. The program according to claim 1 or claim 2.

9. The information relating to the use of the home appliances associated with the second area includes, if there are registered home appliances, information relating to the use of the registered home appliances. The program according to claim 1 or claim 2.

10. The size of the first area is changed according to the number of home appliances that have been registered. The program according to claim 1 or claim 2.

11. The first area displays an operating unit for operating the registered home appliance. The program according to claim 1 or claim 2.

12. A first area that displays the home appliance that has been registered when the home appliance has been registered, In both cases, where there are registered home appliances and where there are none, the system includes a display control unit that displays a second area for displaying an operation section for transitioning to information related to the use of home appliances or information related to recipes, on a single screen. Information processing system.

13. Computers A first area that displays the home appliance that has been registered when the home appliance has been registered, In both cases, where there are registered home appliances and where there are none, a second area displaying an operation section for transitioning to information related to the use of home appliances or information related to recipes is displayed on a single screen. Information processing methods.

Images