Information processor, method for processing information, and program

Abstract

To provide an information processor, a method for processing information, and a program which can make it easier to understand the state or the setting of a plurality of spaces in a site.SOLUTION: The information processor includes: a display unit; an operation unit for detecting an operation result of one of a family member; and a control unit for generating, as a first image, a weather information image including images of different types of weather conditions on the basis of weather forecast information and the time acquired by a network, generating, as a second image, the stay-home status of each member of the family, and generating, as a third image, the state of a control target apparatus for each space in a home property, and causing the display unit to display a main screen displaying the first image, the second image, and the third image in one screen.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] In recent years, technology has been used to automatically control various devices installed in a home, either locally or remotely. The various devices include, for example, lighting devices, air conditioners, front door locks, etc. When a family lives in a home, there are multiple users who remotely operate the devices, and there are also multiple rooms in which the devices are installed.

[0003] In such a system, a user operates the settings on the screen of a smartphone or the like that the user owns, groups the devices by category, and executes control (see, for example, Patent Document 1). The categories are, for example, the living room, kitchen, bedroom, entrance, etc. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-009211 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional technologies have had the problem that it is difficult for multiple users to understand and set the status of each of the multiple spaces (rooms, kitchens, bathrooms, etc.) within the premises.

[0006] The present disclosure has been made in consideration of the above-mentioned problems, and aims to provide an information processing device, an information processing method, and a program that make it easy to understand the status and settings of multiple spaces within a site. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, an information processing device according to one embodiment of the present disclosure includes a display unit, an operation unit that detects an operation result of any one of the users of family members who are members of the same house, regardless of whether they live together or separately, and a control unit that generates a weather information image including an image depicting multiple types of weather conditions with different sky conditions as a first image based on weather forecast information obtained via a network and a time, generates a status of each family member at home as a second image, and generates a status of each of control target devices in multiple spaces within the house grounds as a third image, and causes the display unit to display a main screen that displays the first image, the second image, and the third image on a single screen, and the control unit displays at least one of the weather information images selected from the multiple types of weather information images based on the weather forecast information on the main screen as the first image, and the control unit arranges the first image in an image area occupying at least a portion of a background image on the main screen. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of a configuration of an information processing system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of a terminal according to the first embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of a main screen in a room-by-room display mode of the application according to the first embodiment. [Figure 4] 4A to 4C are diagrams showing examples of main screens in a device list display mode and a camera list display mode of the application according to the first embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of a weather information image according to the first embodiment. [Figure 6] FIG. 4 is a diagram showing an example of a room state and setting screen according to the first embodiment. [Figure 7] FIG. 2 is a diagram showing an example of transition between screens according to the first embodiment. [Figure 8] FIG. 4 is a diagram showing an example of an operation history display according to the first embodiment. [Figure 9]10 is a diagram showing an example of a collective setting screen for collectively setting the operation states of a plurality of devices for each scene according to the first embodiment; FIG. [Figure 10] 10 is a diagram showing an example of a collective setting screen for collectively setting the operation states of a plurality of devices for each scene according to the first embodiment; FIG. [Figure 11] 4 is a flowchart of a processing procedure of the terminal according to the first embodiment. [Figure 12] FIG. 13 is a diagram showing a case where screen selection is performed for each house according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present disclosure will be described with reference to the drawings. In the drawings used in the following description, the scale of each component is appropriately changed so that each component is of a recognizable size.

[0010] <First Example> 1 is a diagram showing an example of the configuration of an information processing system 1 according to this embodiment. The information processing system 1 includes a home device 2, a terminal 3, and a server 4. The home device 2, the terminal 3, and the server 4 are connected via a network NW. The network NW is, for example, the Internet.

[0011] The house devices 2 are control target devices (hereinafter, simply referred to as "devices"), sensors, etc. in a plurality of spaces in the house. In the example of FIG. 1, the house has a plurality of spaces, for example, a living room, a kitchen, a bathroom, a hallway, a child's room, a study, and a bedroom. For example, an air conditioner, a lighting device, an electric window that can be opened and closed automatically, a camera that photographs the interior of the house, an electric shutter that can be opened and closed automatically, a sensor, and a gateway GW are installed in the living room. The sensors are, for example, a temperature sensor, a humidity sensor, a door and window opening and closing sensor, an illuminance sensor, a human presence sensor, etc. Each device in the house communicates with the terminal 3 and the server 4 via the gateway GW. The gateway GW is connected to each device and sensor wirelessly or by wire. Other devices installed in the house are, for example, an electric lock, a hot water heater, an air purifier, a humidifier, a dehumidifier, an outdoor camera, a doorbell, a smart speaker, etc. Each device has a wired or wireless communication function.

[0012] The gateway GW transmits the operation status and setting status of each device installed in the home device 2, and the sensor detection values ​​(hereinafter also referred to as "sensor information") to the server 4 via the network NW. The gateway GW receives instructions for each device transmitted by the server 4, and outputs or transmits the received information to each device.

[0013] The terminal 3 is, for example, a smartphone, tablet terminal, dedicated terminal, etc., owned by a user Us who is, for example, a family member of the same house, whether living together or separately. The terminal 3 detects the operation result of the user Us and transmits the detected operation result to the server 4 via the network NW. The terminal 3 receives the operation status and setting status of each device installed in the home device 2 transmitted by the server 4, as well as the detection values ​​of sensors, and displays the received information. The user Us operates the application screen displayed on the terminal 3 to grasp, for example, the status of the house, the status of each room in the house, whether the family members are at home or out, and the like, and gives instructions for the operation of the devices in each room.

[0014] The application performs functions such as setting up each device in the house, operating the devices, checking the status of the devices, providing operation history for the devices, providing environmental (weather) information, providing various alerts, and providing information indicating whether family members living in the house are at home or out.

[0015] The server 4 acquires the operating status and setting status of each device installed in the home device 2, and the detection values ​​of sensors, and stores the acquired information for, for example, seven days. The server 4 determines whether a family member is at home or out based on the location information received from the terminal 3 carried by each family member, and transmits the determination result to the gateway GW via the network NW. The server 4 creates instructions for each device installed in the home device 2 based on the operation result received from the terminal 3, and transmits the created instructions to the gateway GW via the network NW. The server 4 acquires weather information for the area where the house is located via the network NW, and transmits the acquired weather information to the terminal 3 via the network NW.

[0016] The house configuration, the devices and sensors of the house equipment 2, etc. shown in FIG. 1 are merely examples, and the present invention is not limited to these.

[0017] (Example of terminal configuration) An example of the configuration of the terminal 3 will be described. Fig. 2 is a diagram showing an example of the configuration of the terminal 3 according to this embodiment. As shown in Fig. 2, the terminal 3 includes a first communication unit 301, a second communication unit 302, a GPS receiver 303, a control unit 304, a storage unit 305, an operation unit 306, a display unit 307, a sound collection unit 308, an image capture unit 309, and a speaker 310. The first communication unit 301, the second communication unit 302, the GPS receiver 303, the control unit 304, and the storage unit 305 are connected via a BUS.

[0018] The first communication unit 301 transmits and receives information using, for example, a communication network conforming to a fourth-generation communication standard or a fifth-generation communication standard. The first communication unit 301 outputs information received from the server 4 to the control unit 304. The first communication unit 301 transmits information output by the control unit 304 to the server 4.

[0019] The second communication unit 302 transmits and receives information using, for example, a wireless LAN (Local Area Network). The first communication unit 301 outputs information received from the server 4 to the control unit 304. The first communication unit 301 transmits information output by the control unit 304 to the server 4. The terminal 3 transmits and receives information to and from the server 4 using the first communication unit 301 or the second communication unit 302.

[0020] The GPS receiver 303 outputs information received from a GPS (Global Positioning System) satellite to the control unit 304. Note that devices that emit GPS information include not only smartphones and tablets, but also, for example, smart watches and mobile phones. When viewing one account with multiple transmitting devices, the device has a function for selecting which device to prioritize.

[0021] The control unit 304 acquires an application and stores the acquired application in the storage unit 305. The control unit 304 acquires an application from an application providing site or the server 4. The application may be a Web application provided by the server 4. The control unit 304 acquires information output by the first communication unit 301 or the second communication unit 302 and displays it on the display unit 307. The control unit 304 obtains the current position of the terminal 3 based on information output by the GPS receiver 303. The control unit 304 may obtain the current position based on communication between the first communication unit 301 and a base station. The control unit 304 transmits the operation result output by the operation unit 306 to the server 4 via the first communication unit 301. The control unit 304 performs voice recognition processing on the acoustic signal output by the sound collection unit 308 to acquire a user's instruction, and transmits the acquired user's instruction to the server 4 via the first communication unit 301.

[0022] The storage unit 305 stores applications, user information, identification information of the terminal 3, and the like.

[0023] The operation unit 306 is, for example, a touch panel sensor provided on the display unit 307. The operation unit 306 detects the result of an operation performed by the user, and outputs the detected operation result to the control unit 304.

[0024] The display unit 307 displays image information output by the control unit 304. The image information is an image of each screen of an application. The display unit 307 is, for example, a liquid crystal display device, an organic EL (Electro Luminescence) display device, or the like.

[0025] The sound collection unit 308 is a microphone. The sound collection unit 308 outputs a collected sound signal to the control unit 304. The collected sound signal includes an instruction by a voice signal of the user.

[0026] The image capturing unit 309 is a camera using a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor. The image capturing unit 309 outputs the captured image to the control unit 304.

[0027] The speaker 310 outputs an acoustic signal output by the control unit 304. The acoustic signal is, for example, a warning sound or a warning voice signal.

[0028] (Application screen example) An example of an application screen will be described. The main screen of the application will be described with reference to Figs. 3 and 4. Fig. 3 is a diagram showing an example of a main screen g100 in a room-by-room display mode of the application according to this embodiment. The screens in Figs. 3 and 4 are merely examples, and the present invention is not limited to these.

[0029] Such applications can be used by family members, for example, who have been approved for use by the user representative (for example, the head of the household) and added via the application. When the user representative starts using the application, he or she registers and can, for example, add a house, add family members, add rooms, and add devices to the house. The representative can also grant detailed rights (viewing / operation rights, view-only rights, no access) to each added family member. This makes it possible to secure areas where you do not want them to enter, even when watching over them.

[0030] As shown in Fig. 3, the main screen g100 in the room display mode includes, for example, a weather information image g110, a family at home / outside display image g120, a room information display image g130, and a display mode switching image g140 of the main screen. The weather information image g110 corresponds to the first image, the family at home / outside display image g120 corresponds to the second image, and the room information display image g130 corresponds to the third image. In this embodiment, at least the weather information image g110, the family at home / outside display image g120, and the room information display image g130 are displayed on one screen on the main screen. The main screen in Fig. 3 is also a screen in the room display mode.

[0031] The weather information image g110 includes, for example, an image g111 showing the weather in the area where the house is located, an image g112 showing information about the area where the house is located, an image g113 showing the temperature in the area where the house is located, a menu display button image g114, and an operation history button image g115 showing operation history and history of family members going out.

[0032] The family at home / out of home display image g120 includes, for example, an image g121 indicating that each family member or resident living in a house is at home, and an image g122 indicating that each family member or resident is out of home. The images g121 and g122 may be icons or photos set by the family members. In FIG. 3, four people are displayed, but the number of people displayed may be five or more, and multiple people may be displayed by scrolling horizontally. The display order may be a predetermined order, and at home and out of home may be grouped and displayed.

[0033] The room-specific information display image g130 includes, for example, an image g131 that displays a lighting state g132 and a temperature state g133 for each room. The images included in the room-specific information display image g130 are not limited to this, and may include the operating state of air conditioners, etc.

[0034] The display mode switching image g140 of the main screen includes, for example, a room-based display mode selection button image g141, a device list display mode selection button image g142, and a camera list display mode selection button image g143. The device list display mode selection button image g142 corresponds to the device list button image, and the camera list display mode selection button image g143 corresponds to the camera list button image. The display modes are not limited to three, and may be two, or four or more.

[0035] According to this embodiment, by displaying the main screen g100 for room-by-room display, the state of each room can be grasped on the main screen, and the state of the entire house and the entire family can be grasped.

[0036] Fig. 4 is a diagram showing an example of a main screen in a device list display mode and a camera list display mode of the application according to the present embodiment. A main screen g100A in the device list display mode will be described. As shown in Fig. 4, the main screen g100A in the device list display mode includes, for example, a weather information image g110, a family at home / outside display image g120, a batch setting button image g150, a device list display image g160, and a display mode switching image g140 of the main screen.

[0037] The collective setting button image g150 includes, for example, a "good night" operation button image g151, a "good night" operation button image g152, a "I'm leaving" operation button image g153, and a "I'm home" operation button image g154. The "good night" operation button image g151 is an operation button that, when selected, collectively sets nighttime settings for each device in the house. The "good night" operation button image g152 is an operation button that, when selected, collectively sets sleep settings for multiple devices in the house. The "I'm leaving" operation button image g153 is an operation button that, when selected, collectively sets outgoing settings for multiple devices in the house. The "I'm home" operation button image g154 is an operation button that, when selected, collectively sets out coming-home settings for multiple devices in the house. The collective setting button image g150 may include a button image that automatically creates settings for multiple devices according to a usage scene when a predetermined number of devices are connected. This allows functions such as a set time or GPS to be set as triggers and activated automatically, but the general operation button can also be used to activate them at any desired timing.

[0038] The device list display image g160 includes, for example, images g161 to g165 that display each device in the house and the device name. The device list display image g160 can display multiple devices by, for example, vertical scrolling in response to a user's operation. The images g161 to g165 that display the device names include, for example, an image g166 that indicates the device state. This image g166 that indicates the device state is also a button image. The user can operate this button image to perform a simple operation, for example, repeatedly switching between ON (on state) and OFF (off state). Each of the images g161 to g165 that display the device names is also a button image. When this button image is selected by the user, the screen transitions to a detailed state display of the selected device and a setting screen. The display order of the displayed devices may be a preset order, for example, an order set by the user, or an order sorted by the user by device name.

[0039] The main screen g100B in the camera list display mode will be described below. The main screen g100B in the camera list display mode includes, for example, a weather information image g110, a family at home / out display image g120, a captured image list image g170, and a display mode switching image g140 for the main screen.

[0040] The captured image list image g170 includes images g171 to g176 for each camera. The images g171 to g176 may be still images or videos. The images g171 to g176 may be real-time images currently being captured, or may be recorded images. In the case of recorded images, playback or fast-forward playback may be performed in response to the operation of a playback button image g177.

[0041] (Example of weather information image) The weather information image displayed on the main screen will be described. The application displays, for example, a clear sky image g110A, a sunny image g110B, a heavy rain / storm image g110C, and snow g110D as shown in FIG. 5 based on the acquired weather forecast information under the control of the control unit 304. FIG. 5 is a diagram showing an example of a weather information image according to the present embodiment. The application changes the image of each weather to an image for night (for example, a dark image) during the nighttime hours. The weather information image may be a still image, a video, or an animation. The acquired weather forecast information is, for example, a weather code and icon, temperature, relative humidity, wind direction, wind speed, precipitation, sunrise time, sunset time, and one week's weather forecast information.

[0042] (Room status, setting screen example) An example of a screen displayed when an image corresponding to a room is selected in the room-specific information display image g130 on the main screen g100 will be described below. Fig. 6 is a diagram showing an example of a room status and setting screen according to this embodiment.

[0043] The room screen g200 is an example of a screen that is displayed when a button image corresponding to the living room is selected in the room information display image g130 of the main screen g100. The room screen g200 provides an overview of the devices installed in the room, the room status, and the device status. The room screen g200 includes, for example, a room status image g210, a family at home / out display image g120, a batch setting button image g150, a device list image g220 installed in the room, and a camera image g230 taken by a camera installed in the room.

[0044] The room condition image g210 includes, for example, an image g211 of the equipment installed in the room, an image g212 of the room temperature, humidity, and illuminance, an image g213 showing the state of the windows in the room, a button image g214 for returning to the previous screen, and a room name image g215.

[0045] The device list image g220 installed in the room includes, for example, a device name image g221 of the devices installed in the room and a device status image g222. The device status image g222 can be switched between an on state and an off state in response to a user operation.

[0046] The camera image g230 includes, for example, a play button image g231 and a menu button image g232. The menu button image g232 presents, for example, a selectable playback speed, a selection of an image to be played, and the like.

[0047] The device setting screen g250 is an example of a screen that is displayed when a button image corresponding to an air conditioning device is selected on the room screen g200. The device setting screen g250 includes a room name image g251, a selected device name image g252, an operation history (operation log) list display button image g253, a return to previous screen button image g254, device information and device power operation image g260, a power saving mode setting image g270, an operation mode setting image g280, an air volume setting image g290, and a send button image g256 for sending the set information. The device setting screen g250 includes different images for each device depending on the device's function.

[0048] The device information and device power operation image g260 includes, for example, an illustration or photo g261 corresponding to the device, and a device power state image g262. The device power state image g262 can be switched between an on state and an off state in response to a user's operation.

[0049] The power saving mode setting image g270 can be switched between an ON state and an OFF state in response to a user's operation.

[0050] The operation mode setting image g280 includes, for example, a pull-down image g281 for switching the operation mode (for example, cooling, heating, dehumidification), a button image g282 for decreasing the set temperature, and a button image g283 for increasing the set temperature.

[0051] The air volume setting image g290 includes an automatic air speed setting button image g291 and an air speed strength setting image g292.

[0052] An example of screen transition will be described. FIG. 7 is a diagram showing an example of screen transition according to the present embodiment. As shown in FIG. 7, when a room-based display mode selection button image g141 is selected on the main screen g100, a transition to a room screen g200 occurs. When a back button image is selected on the room screen g200, a transition to a previous screen, for example, the main screen g100 occurs. When a device name image g221, which is an air conditioner button image, is selected on the room screen g200, or when an air conditioner button image is selected after the room-based display mode selection button image g141 is selected on the main screen g100, a transition to a device setting screen g250 occurs. When a back button image is selected on the device setting screen g250, a transition to the main screen g100 or the room screen g200 occurs.

[0053] In the main screen g100, a room display mode, a device list display mode, and a camera list display mode are switched between each other. The transition states shown in FIG. 7 are merely examples, and the present invention is not limited to these.

[0054] (Example of operation history display) An example of the operation history display will be described. Fig. 8 is a diagram showing an example of the operation history display according to this embodiment. The operation history screen g300 in Fig. 8 is displayed when the operation history button image g115 is selected on the main screen g100, for example.

[0055] 8, the operation history screen g300 includes an image g301 indicating that a scene batch processing has been instructed, an image g302 indicating that a scene batch processing has been executed, images g303 to g305 indicating that a family member has gone out, an image g306 indicating that a notice has been given that the front door is unlocked, and an image g307 indicating a response to the notice that the front door is unlocked. An image corresponding to the person who issued the notice is displayed in association with the image g301 indicating that a scene batch processing has been instructed. This allows other family members to understand who has operated the device, according to this embodiment.

[0056] The example shown in Fig. 8 is an example, and is not limited thereto. The operation history screen g300 includes an image indicating that a family member has returned home as a result of operating each device, a button image for returning to the previous screen from the operation history screen g300 (or erasing the display), and the like.

[0057] (Example of bulk settings) The collective setting for collectively setting the operation states of a plurality of devices for each scene will be described with reference to Fig. 9 and Fig. 10. Fig. 9 and Fig. 10 are diagrams showing an example of a collective setting screen for collectively setting the operation states of a plurality of devices for each scene according to this embodiment.

[0058] This will be described with reference to Fig. 9. In the main screen g100A, the collective setting button image g150 further includes an already set "I'm leaving" operation button image g153 and the like, and a "View more" button image g155, for example, that is selected when adding a new scene.

[0059] When the user selects the "View more" button image g155, the control unit 304 displays the first screen g400A for adding a new scene. The first screen g400A for adding a new scene includes an area g410 for displaying the progress of the setting, and a scene adding area g420. The area g410 for displaying the progress of the setting includes a progress status image g411, and a "Next" button image g412 for moving to the next setting screen. The scene adding area g420 includes a scene list button image g421 in which the application has preset settings such as device selection, and a custom button image g422 for the user to create a scene.

[0060] When the user selects one of the scene list button image g421 and the custom button image g422 in the scene addition area g420 of the first screen g400A for adding a new scene, and then selects the "Next" button image g412, the control unit 304 causes the second screen g400B for adding a new scene to be displayed. The second screen g400B for adding a new scene includes an area g410 for displaying the progress of the setting, and an action timing setting area g430. The action timing setting area g430 includes a time setting area g431 for starting the action, and an image g432 for selecting the day of the week to be operated.

[0061] When the user selects the "Next" button image g412 after setting the time and day on the second screen g400B for adding a new scene, the control unit 304 displays the third screen g400C for adding a new scene (FIG. 10). The explanation will be continued by moving to FIG. 10. When the devices inside and outside the house are connected to the gateway GW, the server 4 automatically creates each scene. The third screen g400C for adding a new scene is also an example of a scene automatically created by the server 4 in this way. The third screen g400C for adding a new scene includes an area g410 for displaying the progress of the setting, and an area g440 for setting the device and the operation content. The area g440 for setting the device and the operation content includes, for example, an image g441 showing the device name and the space in which it is installed, a button image g442 for deleting the device from the scene, an image g443 showing the state of the device controlled by the start of the scene operation, a button image g444 for changing the state of the emergency, and an add button image g445 for adding another device to the scene.

[0062] When the user selects the "Next" button image g412 on the third screen g400C for adding a new scene without making any changes or after making any changes, the control unit 304 displays the fourth screen g400D for adding a new scene. The fourth screen g400D for adding a new scene includes an area g410 for displaying the progress of the setting, and a scene setting image g450. The scene setting image g450 includes a button image g451 for selecting an image corresponding to the scene, and an area g452 for setting the name of the scene. As the image corresponding to the scene, an image prepared in advance by the application can be used, or an image stored in the terminal 3 can be selected. When the user selects the "Complete" button image g413 on the fourth screen g400D for adding a new scene after making any settings, the control unit 304 returns to the main screen g100B.

[0063] (Example of processing procedure) A description will now be given of an example of a processing procedure of the terminal 3. Fig. 11 is a flowchart of a processing procedure of the terminal 3 according to this embodiment.

[0064] (Step S1) The control unit 304 starts an application.

[0065] (Step S2) The control unit 304 acquires the detection values ​​detected by each sensor and the state information of each device from the server 4 via the network NW.

[0066] (Step S3) The control unit 304 acquires weather forecast information for the area in which the house is located from the server 4 via the network NW. The control unit 304 may acquire the weather forecast information from the server 4 at predetermined intervals.

[0067] (Step S4) The control unit 304 acquires at-home / out-of-home status information indicating whether each family member is at home or out from the server 4 via the network NW. The control unit 304 acquires at-home / out-of-home status information from the server 4 at a predetermined interval or when the information is changed.

[0068] (Step S5) The control unit 304 causes the display unit 307 to display a main screen based on the information acquired from the server 4.

[0069] (Step S6) The control unit 304 determines whether or not the selection button image has been selected by the user. If the control unit 304 determines that the selection button image has been selected (step S6; YES), the control unit 304 proceeds to the process of step S7. If the control unit 304 determines that the selection button image has not been selected (step S6; NO), the control unit 304 repeats the process of step S6.

[0070] (Step S7) Control unit 304 causes display unit 307 to display a screen corresponding to the selected button image.

[0071] (Step S8) The control unit 304 determines whether the device settings on each screen have been changed. If the control unit 304 determines that the device settings on each screen have been changed (Step S8; YES), the control unit 304 proceeds to processing of step S9. If the control unit 304 determines that the device settings on each screen have not been changed (Step S8; NO), the control unit 304 proceeds to processing of step S10.

[0072] (Step S9) The control unit 304 transmits the changed settings and information indicating the devices to the server 4 via the network NW. After processing, the control unit 304 proceeds to processing in step S10. The server 4 receives the changed settings and information indicating the devices, creates an operation state change instruction for the devices based on the received information, and transmits the created operation state change instruction to the gateway GW via the network NW. The gateway GW transmits an instruction to the devices included in the received operation state change instruction.

[0073] (Step S10) The control unit 304 determines whether or not the back button image has been selected by the user. If the control unit 304 determines that the back button image has been selected (step S10; YES), the control unit 304 proceeds to the process of step S11. If the control unit 304 determines that the back button image has not been selected (step S10; NO), the control unit 304 repeats the process of step S8.

[0074] (Step S11) The control unit 304 displays on the display unit 307 the screen before the back button was selected, and returns to the process of step S6.

[0075] 9 is an example, and is not limited to this. The control unit 304 performs, for example, a process selected on the screen, or displays or updates information received from the server 4.

[0076] In this embodiment, the room-by-room display mode on the main screen allows you to grasp the status of the entire house and whether family members are at home or home, the device list display mode allows you to grasp the status of installed devices and give simple control instructions and batch processing instructions, and the camera list display mode allows you to view a list of indoor and outdoor camera images.

[0077] <Second Example> In the first embodiment, an example of one house has been described, but the number of houses whose status can be viewed or set may be two or more. For example, the status of the house where elderly parents live, the status of a vacation home, etc. may also be displayed on the screen using an application.

[0078] Fig. 12 is a diagram showing a case where a screen is selected for each house according to this embodiment. In the example of Fig. 12, when there is a house registered other than the home, a display image g116 of a second house is displayed on the weather information image g110 of the main screen. Such a display image g116 of a second house is displayed on each of the main screens g100, g100A, and g100B.

[0079] In the case where there are multiple registered houses, when the user selects the display image g116 of the second house, a house list screen g100a is displayed. The house list screen g100a includes a house list image g180, and displays other images such as the weather information image g110, for example, in a blurred manner. In the house list image g180, a checked house is the selected house. When another house is selected, the application switches the main screen, etc. to that of the selected house according to the control of the control unit 304.

[0080] As a result, according to this embodiment, the user can check the status of, for example, his / her parent's house or vacation home in addition to his / her own home, and can operate them according to the purpose. As a result, according to this embodiment, the user can monitor and control other houses without changing the user registration or logging in again for each house.

[0081] A program for realizing all or part of the functions of the control unit 304 in the present disclosure may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to perform all or part of the processing performed by the control unit 304. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. The term "computer system" also includes a WWW system equipped with a homepage providing environment (or display environment). The term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into a computer system. The term "computer-readable recording medium" also includes those that hold a program for a certain period of time, such as volatile memory (RAM) inside a computer system that becomes a server or client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line.

[0082] The above program may be transmitted from a computer system in which the program is stored in a storage device or the like to another computer system via a transmission medium, or by transmission waves in the transmission medium. A "transmission medium" that transmits a program refers to a medium that has the function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The above program may be for realizing part of the above-mentioned functions. It may also be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0083] Although the form for carrying out the present disclosure has been described using embodiments, the present disclosure is in no way limited to such embodiments, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present disclosure. [Explanation of symbols]

[0084] 1...information processing system, 2...household equipment, 3...terminal, 4...server, NW...network, 301...first communication unit, 302...second communication unit, 303...GPS receiver, 304...control unit, 305...storage unit, 306...operation unit, 307...display unit, 308...sound pickup unit, 309...photographing unit, 310...speaker, g100, g100A, g100B...main screen, g110...weather information image, g120...family home / out display image, g130...room-specific information display image, g140...display mode switching image of main screen, g300...operation history screen

Claims

1. A display unit; an operation unit for detecting an operation result of any one of the family members who are members of the same household, whether living together or separately; a control unit that generates, as a first image, a weather information image including an image depicting a plurality of different weather conditions based on weather forecast information acquired via a network and time, generates, as a second image, an at-home status of each of the family members, and generates, as a third image, an status of each of the control target devices in a plurality of spaces within the house grounds, and causes the display unit to display a main screen that displays the first image, the second image, and the third image on a single screen; Equipped with the control unit displays, on the main screen as the first image, at least one weather information image selected from a plurality of types of weather information images based on the weather forecast information; The control unit arranges the first image in an image area occupying at least a part of the main screen. Information processing device.

2. The first image is a video showing information about the weather condition. The information processing device according to claim 1 .

3. the main screen includes an equipment list button image for switching to an equipment list screen showing the status of the control target equipment within the house premises, and a camera list button image for switching to a camera list screen displaying images captured by cameras within the house premises, The control unit is When the device list button image is detected by the operation unit, the main screen is switched to the device list screen; when the camera list button image is detected by the operation unit, switching from the main screen to the camera list screen; The information processing device according to claim 1 .

4. the main screen includes an operation history list button image for displaying an operation history screen for the control target device of each of the family members; The control unit is When the operation history list button image is detected by the operation unit, the main screen is switched to the operation history screen.

4. The information processing device according to claim 1.

5. the main screen includes a batch setting button image for displaying a batch setting screen for collectively setting the plurality of control target devices according to a usage scene, A sound pickup unit for acquiring a voice of one of the family members; A sensor for detecting a condition within the house site, The control unit is When the batch setting button image is detected by an operation of the operation unit, the main screen is switched to the batch setting screen; When a selection button image of the usage scene included in the collective setting screen is detected by the operation unit, when a voice instruction is detected by a voice recognition process for the acoustic signal acquired by the sound collection unit, when the sensor detects something, and when a predetermined date and time is reached, the control unit controls the plurality of control target devices set on the collective setting screen. The information processing device according to claim 1 .

6. when the operation unit detects that an image corresponding to one room has been selected in the area of ​​the second image on the main screen, the control unit switches to a room screen related to the selected room, the room screen includes at least one of an image in which images corresponding to the control target devices in the room are arranged on the image of the room, an image showing the operating state of the control target devices, the temperature and humidity of the room acquired from the control target devices, an image captured by a camera installed in the room, and an image for selecting a combination of settings for each of the control target devices in the room; when the operation unit detects that an image corresponding to the control-target device has been selected on the room screen, the control unit switches to a device setting screen related to the selected control-target device; the device setting screen includes a setting image of the control target device corresponding to the type of the control target device; The information processing device according to claim 1 .

7. The control unit displays, on the main screen, information indicating that the family member has gone out. The information processing device according to claim 1 .

8. The control unit displays, within the main screen, a separate home selection button image that displays a division home screen related to another house managed by the user, and when the operation unit detects that the separate home selection button image has been selected, switches from the main screen to the division home screen. The information processing device according to claim 1 .

9. The computer a weather information image including an image depicting a plurality of different weather conditions based on weather forecast information and time acquired via a network is generated as a first image, the at-home status of each family member of the same house, whether living together or separately, is generated as a second image, the status of each control target device in each space within the house grounds is generated as a third image, and a main screen displaying the first image, the second image, and the third image on a single screen is displayed on a display unit; displaying at least one weather information image selected from a plurality of types of weather information images based on the weather forecast information on the main screen as the first image; placing the first image in an image area occupying at least a part of a background image on the main screen; Information processing methods.

10. On the computer, a first image is generated as a weather information image including an image depicting a plurality of different weather conditions based on weather forecast information and time acquired via a network, a second image is generated showing the at-home status of each family member of the same house whether they live together or separately, a third image is generated showing the status of each of a plurality of spaces within the house grounds, and a main screen is displayed on a display unit that displays the first image, the second image, and the third image on a single screen; displaying at least one weather information image selected from a plurality of types of weather information images based on the weather forecast information on the main screen as the first image; placing the first image in an image area occupying at least a part of a background image on the main screen; program.

Images