Information processing device, information processing system, operation setting method, and operation setting program

Abstract

To provide a terminal, an operation setting device, an operation setting method, and a program capable of automatically generating and providing a combination of settings for a plurality of devices.SOLUTION: A control device includes a terminal and a display unit, and the control unit displays, on the display unit, a selection screen for a plurality of scenes set as scenes frequently used by users, determines a scene selected by the users from the plurality of scenes, displays, on the display unit, a control target device registered in a home system from among control target devices included in collective setting set in advance for the selected scene, and displays, on the display unit, a button image for transmitting information for changing a state of the control target device.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a terminal device, an operation setting device, an operation setting method, and a program. [Background technology]

[0002] In recent years, technologies have been used to automatically control various devices installed in homes, etc., either at home or remotely. These devices include, for example, lighting devices, air conditioning devices, and front door locks. When a family lives in a home, there are multiple users who remotely control the devices, and there are also multiple rooms in which the devices are installed.

[0003] In such a system, the user operates the settings on the screen of a smartphone or the like that the user owns, and controls the devices by grouping them into sections (see, for example, Patent Document 1). Sections can be, for example, living room, kitchen, bedroom, entrance hall, etc. In such a system, there is a central setting function that allows the settings of multiple devices to be operated collectively as one. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2020-009211 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the conventional technology, users had to select and combine devices they wanted to configure from among multiple devices, and create settings for each device themselves, which led to problems such as users not understanding how to use such bulk configuration or finding the configuration cumbersome.

[0006] The present disclosure has been made in consideration of the above-mentioned problems, and aims to provide a terminal device, an operation setting device, an operation setting method, and a program that can automatically generate and provide combinations of settings for multiple devices. [Means for solving the problem]

[0007] In order to achieve the above object, a terminal device according to one aspect of the present disclosure includes a control unit and a display unit, and the control unit displays on the display unit a selection screen for multiple scenes set as scenes frequently used by the user, determines a scene selected by the user from the multiple scenes, displays on the display unit the controlled devices registered in the home system from among the controlled devices included in the collective settings previously set for the selected scene, and displays on the display unit a button image that transmits information to change the state of the controlled devices. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating a configuration example of a terminal according to the embodiment. [Figure 3] FIG. 10 is a diagram illustrating an example of a main screen in a room-by-room display mode of the application according to the embodiment. [Figure 4] 10A and 10B are diagrams illustrating an example of a main screen of an application in a device list display mode and a camera list display mode according to an embodiment. [Figure 5] 10 is a diagram showing an example of a collective setting screen for collectively setting the operating states of a plurality of devices for each scene according to the embodiment; FIG. [Figure 6] 10 is a diagram showing an example of a collective setting screen for collectively setting the operating states of a plurality of devices for each scene according to the embodiment; FIG. [Figure 7] FIG. 10 is a diagram illustrating an example of a notification in a family monitoring notification setting according to an embodiment. [Figure 8] FIG. 10 is a diagram showing an example of a setting screen for family monitoring notification setting according to the embodiment. [Figure 9] 10A and 10B are diagrams illustrating an example of a notification in the setting of a notification to check whether a door is locked when going out according to the embodiment. [Figure 10] 10A and 10B are diagrams illustrating examples of warning images in the setting for notifying a user to check whether a door is locked when the user goes out according to the embodiment. [Figure 11] FIG. 10 is a diagram illustrating an example of a setting screen for setting a notification to check whether a door is locked when going out according to the embodiment. [Figure 12] FIG. 10 is a diagram showing an example of a notification in the home monitoring notification setting according to the embodiment. [Figure 13] 10A and 10B are diagrams illustrating examples of warning images in home monitoring notification settings according to an embodiment. [Figure 14] FIG. 10 is a diagram showing an example of a setting screen for home monitoring notification setting according to an embodiment. [Figure 15] 10A and 10B are diagrams illustrating an example of a notification in the bad weather open notification according to the embodiment. [Figure 16] 10A and 10B are diagrams illustrating examples of warning images in home monitoring notification settings according to an embodiment. [Figure 17] FIG. 10 is a diagram illustrating an example of a setting screen for bad weather open notification setting according to the embodiment. [Figure 18] FIG. 10 is a diagram illustrating an example of a heatstroke risk notification according to the embodiment. [Figure 19] FIG. 10 is a diagram showing an example of a setting screen for heatstroke risk notification setting according to the present embodiment. [Figure 20] 10 is a flowchart of a processing procedure of a server according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present disclosure will be described with reference to the accompanying drawings. In the drawings used in the following description, the scale of each component is appropriately changed so that each component can be recognized.

[0010] FIG. 1 is a diagram showing an example of the configuration of an information processing system 1 according to this embodiment. The information processing system 1 includes a home appliance 2, a terminal 3, and a server 4. The home appliance 2, the terminal 3, and the server 4 are connected via a network NW. The network NW is, for example, the Internet. The devices possessed by each family member and openings (locks, windows, shutters, open / close sensors, etc.) correspond to control target devices.

[0011] The house devices 2 are controllable devices (hereinafter simply referred to as "devices"), sensors, etc. in multiple spaces within the house premises. In the example of FIG. 1, the house has multiple spaces, such as a living room, kitchen, bathroom, entrance, children's room, study, and bedroom. For example, the living room is equipped with air conditioning equipment, lighting equipment, automatically openable and closable electric windows, a camera for capturing images of the interior, automatically openable and closable electric shutters, sensors 21, and a gateway GW. The sensors include, for example, temperature sensors, humidity sensors, door and window open / close sensors, illuminance sensors, human detection sensors, and lock and window open / close sensors. The human detection sensors and lock and window open / close sensors correspond to the human detection device 22. The human detection device 22 is installed within the house premises. The locks, windows, shutters, open / close sensors, etc. correspond to openings. Each device in the room communicates with the terminal 3 and the server 4 via the gateway GW. The gateway GW and each device and sensor are connected wirelessly or by wire. Other devices installed in the house include, for example, an electric lock, a hot water heater, an air purifier, a humidifier, a dehumidifier, an outdoor camera, a doorbell, a smart speaker, etc. Each device has a wired or wireless communication function. Each of the house devices 2 is connected to the gateway GW via a network HN between the gateway GW and the device.

[0012] The gateway GW transmits the operating status and setting status of each device installed in the home device 2, as well as sensor detection values, etc. to the server 4 via the network NW. The gateway GW receives instructions for each device transmitted by the server 4, and outputs or transmits the received information to each device.

[0013] The terminal 3 is, for example, a smartphone, tablet, dedicated terminal, etc., owned by a user Us who is a member of the same house, for example, a family member, whether they live together or separately. The terminal 3 detects the results of operations performed by the user Us and transmits the detected results of operations to the server 4 via the network NW. The terminal 3 receives the operating status and setting status of each device installed in the home appliances 2 transmitted by the server 4, as well as sensor detection values, and displays the received information. The user Us operates the application screen displayed on the terminal 3 to ascertain, for example, the status of the house, the status of each room in the house, whether family members are at home or out, etc., and gives instructions for the operation of the devices in each room.

[0014] The application configures each device in the house, operates the devices, checks the device status, provides operation history for the devices, provides environmental (weather) information, provides various alerts, and provides information indicating whether family members living in the house are at home or out.

[0015] The server 4 includes a communication unit 401 that communicates with the gateway GW and the terminal 3 via the network NW, a control unit 402, and a storage unit 403 that stores information received from the terminal 3 and the gateway GW. The server 4 acquires the operating status and setting status of each device installed in the home appliance 2, as well as sensor detection values, and stores the acquired information for, for example, seven days. The server 4 determines whether a family member is at home or out based on location information received from the terminal 3 carried by each family member, and transmits the determination result to the gateway GW via the network NW. The server 4 creates instructions for each device installed in the home appliance 2 based on the operation result received from the terminal 3, and transmits the created instructions to the gateway GW via the network NW. The server 4 acquires weather information for the area where the house is located via the network NW, and transmits the acquired weather information to the terminal 3 via the network NW.

[0016] The house configuration, the devices and sensors of the house devices 2, etc. shown in FIG. 1 are merely examples, and are not limited to these.

[0017] (Example of terminal configuration) An example of the configuration of the terminal 3 will now be described. Fig. 2 is a diagram showing an example of the configuration of the terminal 3 according to this embodiment. As shown in Fig. 2, the terminal 3 includes a first communication unit 301, a second communication unit 302, a GPS receiver 303, a control unit 304, a storage unit 305, an operation unit 306, a display unit 307, a sound collection unit 308, an image capture unit 309, and a speaker 310. The first communication unit 301, the second communication unit 302, the GPS receiver 303, the control unit 304, and the storage unit 305 are connected via a BUS.

[0018] The first communication unit 301 transmits and receives information using, for example, a communication network conforming to a fourth-generation communication standard or a fifth-generation communication standard. The first communication unit 301 outputs information received from the server 4 to the control unit 304. The first communication unit 301 transmits information output by the control unit 304 to the server 4.

[0019] The second communication unit 302 transmits and receives information using, for example, a wireless LAN (Local Area Network). The first communication unit 301 outputs information received from the server 4 to the control unit 304. The first communication unit 301 transmits information output by the control unit 304 to the server 4. In this way, the terminal 3 transmits and receives information to and from the server 4 using the first communication unit 301 or the second communication unit 302.

[0020] The GPS receiver 303 outputs information received from GPS (Global Positioning System) satellites to the control unit 304. Note that devices that emit GPS information include not only smartphones and tablets, but also, for example, smartwatches and mobile phones. In addition, when viewing one account on multiple transmitting devices, the device has a function that allows the user to select which device to prioritize.

[0021] The control unit 304 acquires an application and stores the acquired application in the storage unit 305. The control unit 304 acquires the application from an application provider site or the server 4. The application may be a web application provided by the server 4. The control unit 304 acquires information output by the first communication unit 301 or the second communication unit 302 and displays it on the display unit 307. The control unit 304 determines the current location of the terminal 3 based on information output by the GPS receiver 303. The control unit 304 may also determine the current location based on communication between the first communication unit 301 and a base station. The control unit 304 transmits an operation result output by the operation unit 306 to the server 4 via the first communication unit 301. The control unit 304 performs voice recognition processing on the acoustic signal output by the sound collection unit 308 to acquire a user's instruction, and transmits the acquired user's instruction to the server 4 via the first communication unit 301.

[0022] The storage unit 305 stores applications, user information, identification information of the terminal 3, and the like.

[0023] The operation unit 306 is, for example, a touch panel sensor provided on the display unit 307. The operation unit 306 detects the result of an operation performed by the user and outputs the detected operation result to the control unit 304.

[0024] The display unit 307 displays image information output by the control unit 304. The image information is an image of each screen of an application. The display unit 307 is, for example, a liquid crystal display device, an organic EL (Electro Luminescence) display device, or the like.

[0025] The sound collection unit 308 is a microphone. The sound collection unit 308 outputs the collected sound signal to the control unit 304. The collected sound signal includes an instruction by a voice signal from the user.

[0026] The image capturing unit 309 is a camera using a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor. The image capturing unit 309 outputs the captured image to the control unit 304.

[0027] The speaker 310 outputs an acoustic signal output by the control unit 304. The acoustic signal is, for example, a warning sound or a warning audio signal.

[0028] (Example of application screen) An example of an application screen will be described. The main screen of the application will be described using Fig. 3 and Fig. 4. Fig. 3 is a diagram showing an example of a main screen g100 in room-specific display mode of the application according to this embodiment. The screens in Fig. 3 and Fig. 4 are merely examples, and the present invention is not limited to these.

[0029] Such applications can be used by family members, for example, who have been authorized by a representative user (e.g., the head of household) and added via the application. The representative user registers when starting to use the application and can, for example, add a house, family members, rooms, and add devices to the house. In addition, the representative can grant detailed rights (viewing / operating rights, viewing only rights, hidden rights) to each added family member. This allows you to secure areas that you do not want them to enter, even when watching over them.

[0030] As shown in Fig. 3, the main screen g100 in the room-specific display mode includes, for example, a weather information image g110, a family at home / out display image g120, a room-specific information display image g130, and a main screen display mode switching image g140. The weather information image g110 corresponds to the first image, the family at home / out display image g120 corresponds to the second image, and the room-specific information display image g130 corresponds to the third image. That is, in this embodiment, the main screen displays at least the weather information image g110, the family at home / out display image g120, and the room-specific information display image g130 on a single screen. The main screen in Fig. 3 is also the screen in the room-specific display mode.

[0031] The weather information image g110 includes, for example, an image g111 showing the weather in the area where the house is located, an image g112 showing information about the area where the house is located, an image g113 showing the temperature in the area where the house is located, a menu display button image g114, and an operation history button image g115 showing the operation history and the history of family outings. These images are generated or selected by the control unit 402 of the server 4 based on the acquired weather forecast information. The acquired weather forecast information includes, for example, a weather code and icon, temperature, relative humidity, wind direction, wind speed, precipitation amount, sunrise time, sunset time, and one-week weather forecast information.

[0032] The family at home / away display image g120 includes, for example, an image g121 indicating that each family member or resident living in the house is at home, and an image g122 indicating that each family member or resident is away. Images g121 and g122 may be icons or photos set by the family member. While four people are displayed in FIG. 3, the number of people displayed may be five or more, and more people may be displayed by scrolling horizontally. The display order may be a predetermined order, or at home and away may be grouped and displayed separately.

[0033] The room-specific information display image g130 includes, for example, an image g131 that displays, for each room, a lighting state g132 and a temperature state g133. The images included in the room-specific information display image g130 are not limited to these and may also include the operating state of air conditioning equipment, etc.

[0034] The display mode switching image g140 on the main screen includes, for example, a room-specific display mode selection button image g141, a device list display mode selection button image g142, and a camera list display mode selection button image g143. The device list display mode selection button image g142 corresponds to the device list button image, and the camera list display mode selection button image g143 corresponds to the camera list button image. The number of display modes is not limited to three, and may be two, four, or more.

[0035] 4 shows examples of the main screens of the application according to this embodiment in the device list display mode and the camera list display mode. The main screen g100A in the device list display mode will be described. As shown in FIG. 4, the main screen g100A in the device list display mode includes, for example, a weather information image g110, a family member at home / out display image g120, a batch setting button image g150, a device list display image g160, and a main screen display mode switching image g140.

[0036] The batch setting button image g150 includes, for example, a "good night" operation button image g151, a "good night" operation button image g152, a "I'm leaving" operation button image g153, and a "I'm home" operation button image g154. The "good night" operation button image g151 is an operation button that, when selected, collectively sets nighttime settings for each device in the house. The "good night" operation button image g152 is an operation button that, when selected, collectively sets sleeping settings for multiple devices in the house. The "I'm leaving" operation button image g153 is an operation button that, when selected, collectively sets out out-of-home settings for multiple devices in the house. The "I'm home" operation button image g154 is an operation button that, when selected, collectively sets out return home settings for multiple devices in the house. The batch setting button image g150 may include a button image that automatically creates settings for multiple devices according to a usage scenario when multiple specified devices are connected.

[0037] The device list display image g160 includes, for example, images g161 to g165 that display each device in the house and the device name. The device list display image g160 can display multiple devices by, for example, vertically scrolling in response to a user operation. The images g161 to g165 that display device names include, for example, an image g166 that indicates the device status. This image g166 that indicates the device status is also a button image. By operating this button image, the user can easily switch, for example, between ON (on state) and OFF (off state). Each of the images g161 to g165 that display device names is also a button image. When this button image is selected by the user, the screen transitions to a detailed status display and a setting screen for the selected device. The order in which the devices are displayed may be a pre-set order, for example, an order set by the user, or an order sorted by the user by device name.

[0038] The main screen g100B in the camera list display mode will now be described. The main screen g100B in the camera list display mode includes, for example, a weather information image g110, a family at home / out display image g120, a captured image list image g170, and a main screen display mode switching image g140.

[0039] The captured image list image g170 includes images g171 to g176 for each camera. The images g171 to g176 may be still images or videos. The images g171 to g176 may be real-time images currently being captured, or may be recorded images. In the case of recorded images, playback or fast-forward playback may be possible in response to the operation of a play button image g177. The images captured by the cameras are transmitted by the gateway GW to the server 4, and the server 4 provides them to the terminal 3.

[0040] (Example of bulk setting) Batch setting for collectively setting the operating states of multiple devices for each scene will be described with reference to Fig. 5 and Fig. 6. Fig. 5 and Fig. 6 are diagrams showing examples of batch setting screens for collectively setting the operating states of multiple devices for each scene according to this embodiment.

[0041] This will be explained using Figure 5. On the main screen g100A, the batch setting button image g150 further includes an already set "I'm leaving" operation button image g153 and the like, as well as a "See more" button image g155, for example, that is selected when adding a new scene.

[0042] When the user selects the "View more" button image g155, the control unit 304 displays the first screen g400A for adding a new scene. The first screen g400A for adding a new scene includes an area g410 that displays the progress of the settings, and a scene adding area g420. The area g410 that displays the progress of the settings includes a progress image g411 and a "Next" button image g412 for moving to the next settings screen. The scene adding area g420 includes a scene list button image g421 in which the application has pre-set device selection, etc., and a custom button image g422 that allows the user to create a scene.

[0043] When the user selects one of the scene list button image g421 and the custom button image g422 in the scene addition area g420 of the first screen g400A for adding a new scene, and then selects the "Next" button image g412, the control unit 304 displays the second screen g400B for adding a new scene. The second screen g400B for adding a new scene includes an area g410 for displaying the progress of the setting, and an operation timing setting area g430. The operation timing setting area g430 includes an area g431 for setting the time at which the operation is to be started, and an image g432 for selecting the day of the week to be operated.

[0044] When the user selects the “Next” button image g412 after setting the time and day of the week on the second screen g400B for adding a new scene, the control unit 304 displays the third screen g400C for adding a new scene (FIG. 6). Moving on to FIG. 6, the explanation continues. Each scene is automatically created by the server 4 when devices inside and outside the home are connected to the gateway GW. The third screen g400C for adding a new scene is also an example of a scene automatically created by the server 4. The third screen g400C for adding a new scene includes an area g410 for displaying the progress of the setting and an area g440 for setting the device and its operation details. The area g440 for setting the device and its operation details includes, for example, an image g441 indicating the device name and the space in which it is installed, a button image g442 for deleting the device from the scene, an image g443 indicating the status of the device controlled by starting the scene operation, a button image g444 for changing the status of the device, and an add button image g445 for adding another device to the scene.

[0045] When the user selects the "Next" button image g412 on the third screen g400C for adding a new scene without making any changes or after making any changes, the control unit 304 displays the fourth screen g400D for adding a new scene. The fourth screen g400D for adding a new scene includes an area g410 for displaying the progress of the settings and a scene setting image g450. The scene setting image g450 includes a button image g451 for selecting an image corresponding to the scene and an area g452 for setting the name of the scene. The image corresponding to the scene can be an image prepared in advance by the application, or an image stored in the terminal 3 can be selected. When the user selects the "Done" button image g413 on the fourth screen g400D for adding a new scene after making the settings, the control unit 304 returns to the main screen g100B.

[0046] Examples of collective scene settings are family monitoring notification, door lock check notification when going out, home monitoring notification, bad weather left open notification, and heatstroke risk notification. The collective scene settings are not limited to these. Other collective scene settings include, for example, wake-up setting, return home setting, and sleep setting. As described below, the control unit 402 of the server 4 automatically generates these rules when the combination of paired control target devices is included in the collective settings stored in advance.

[0047] An example of the procedure for pairing connection when registering a controlled device will be described. When a controlled device is newly installed on the premises of a house, the user opens the device addition screen of the application. The user operates the device addition screen to select the button image corresponding to the device they want to add. The user turns on the power of the device and presses, for example, a pairing button provided on the device. The device sends a pairing request to terminal 3. Terminal 3 sends the received pairing request to the gateway GW. This completes pairing between the device and the gateway GW. For example, a well-known method is used as the pairing protocol and method.

[0048] (Family monitoring notification) The family monitoring notification will be described with reference to FIGS. 7 and 8. FIG. 7 is a diagram showing an example of a notification in the family monitoring notification setting according to this embodiment. When the terminal 3 is in a locked state, the control unit 304 displays a notification image g501 of a family member going out (for example, "Mayumi has gone out") on the lock screen g500A. This notification is detected by the server 4 based on the location information of the terminal 3 possessed by "Mayumi," and upon detection, the notification is transmitted to the terminals 3 of other family members via the network NW. Upon receiving the notification, the control unit 304 of the terminal 3 displays it at a predetermined position on the application screen. The family monitoring notification corresponds to a first predetermined rule. The control unit 402 of the server 4 automatically creates a first predetermined rule when the terminals 3 possessed by each family member are connected to a predetermined network. The network NW corresponds to the predetermined network.

[0049] When the lock screen g500A is unlocked, the control unit 304 displays a notification image g117 in the area of ​​the weather information image g110 on the main screen g100, for example, to notify the user that a notification has been received. When the user selects this notification image g117, the control unit 304 displays a notification result image g510, for example, superimposed on the main screen g100. The notification result image g510 may be a separate screen. The notification result image g510 includes an out-of-home image g511 that notifies the user of the out-of-home status and includes an image corresponding to the out-of-home family member, and an OK button image g512 that the user selects to delete the image after confirming the status. When the OK button image g512 is selected, the control unit 304 deletes the notification result image g510. According to this embodiment, these notifications can notify the user that a family member has gone out.

[0050] 8 is a diagram showing an example of a setting screen for family monitoring notification settings according to this embodiment. The setting screen g500B includes a setting area g521 for setting whether or not to use this collective setting notification, a setting area g522 for setting which family members to notify when they leave the home, and a setting area g523 for setting which family members to notify when they return home. Such collective settings are automatically generated by the server 4 when each of the family members' terminals 3 is connected to the network NW. As shown in the setting screen g500B, the user can disable such collective settings so that they are not used, and can also change the notification recipients from the automatically set state (setting whether to enable or disable each recipient).

[0051] The out-of-home determination screen g500C includes a map image g531 of the determination range for determining whether the user is out or at home, and an area description area g532. The user can change the size of the determination area from the initial state by operating the screen. In the area description area g532, the initial address is the address of the house, but the address can also be entered manually using, for example, a software keyboard.

[0052] (Door lock check notification when leaving the house) The locking notification before leaving the home will be described with reference to FIGS. 9 to 11. FIG. 9 is a diagram showing an example of a notification in the locking notification setting according to this embodiment. When the terminal 3 is locked, the control unit 304 displays an image g601 (e.g., "You forgot to start the door"), which is a warning notification regarding locking, on the lock screen g600A. The control unit 402 of the server 4 detects this warning based on the detection value detected by the human detection device when all family members are out, based on the location information of the terminals 3 carried by the registered family members, and upon detection, transmits the warning to each family member's terminal 3 via the network NW. When receiving the warning, the control unit 304 displays it at a predetermined position on the application screen. The locking notification before leaving the home corresponds to a second predetermined rule. The control unit 402 of the server 4 automatically creates a second predetermined rule when the terminal 3 carried by each family member and an opening are connected to a predetermined network. The network NW and the network HN between the gateway GW and the device on the house premises correspond to the predetermined network.

[0053] When the lock screen g600A is unlocked, the control unit 304 displays, for example, a warning image g118 in the area of ​​the weather information image g110 on the main screen g100, notifying that a warning has been issued.

[0054] When the user selects this warning image g118, the control unit 304 displays a warning image g610 or g620, for example, superimposed on the main screen g100, as shown in FIG. 10. FIG. 10 is a diagram showing an example of a warning image in the setting for notifying the user to check whether the door is locked when going out according to this embodiment. The warning image g610 or g620 may be a separate screen. When the OK button image g611 or g621 is selected, the control unit 304 erases the warning image g610 or g620. When the "Lock" button image g622 is selected on the warning image g620, the control unit 304 transmits information indicating that the door should be locked to the server 4 via the network NW. When the control unit 402 of the server 4 receives this information from the terminal 3, it transmits a control instruction to the gateway GW via the network NW to control the target device to close. The user can also select a "No" button image g623 to not close the door in response to the warning. For example, the warning image g620 presents the state recommended by the application as the initial state. According to this embodiment, these warnings can notify the user that a program has been forgotten to start.

[0055] FIG. 11 is a diagram illustrating an example of a setting screen for setting notifications to check whether doors are locked when leaving the home according to this embodiment. The setting screen g600B includes a setting area g631 for determining whether to use this collective setting notification, a setting area g632 for determining which family members to notify when leaving the home, and a setting area g633 for determining which openings (devices, sensors) to check when leaving the home. For example, electric locks, electric shutters, electric windows, crescent sensors, door / window sensors, and other opening sensors are set as controlled devices, and the control unit 402 of the server 4 automatically adds them to this list and automatically generates collective settings. The timing of the warning based on this collective setting is determined, for example, based on the location information of the device 3 carried by each family member. Notifications are sent to family members who leave the area set by the family monitoring notification based on the location information of the device 3 carried by each family member. By default, all family members are set as notification targets, but it is possible to change the family members to be notified. The openings that are set as targets for warning when opened are set by default, but it is also possible to change the openings to be detected. Settings are changed, for example, by the head of the household. For this reason, the display of the setting screen and changes to the settings are controlled by the head of the household, who sets authority for each family member, for example, when registering the family members.

[0056] (Home monitoring notification) The home monitoring notification will be described with reference to FIGS. 12 to 14. FIG. 12 is a diagram showing an example of a notification in the home monitoring notification setting according to this embodiment. When the terminal 3 is locked, the control unit 304 displays an image g701 (e.g., "The door was unlocked while you were out"), which is a warning notification regarding locking, on the lock screen g700A. This warning is generated by the control unit 402 of the server 4 based on the location information of the terminals 3 carried by registered family members, based on the detection values ​​detected by a human detection device (such as a human detection sensor or a sensor for detecting whether a lock or window is open or closed) when all family members are out. Upon detection, the control unit 304 of the terminal 3 displays the warning at a predetermined position on the application screen when it receives the warning. The home monitoring notification corresponds to the third rule. The control unit 402 of the server 4 creates a third predetermined rule when the terminals 3, openings, and human detection devices carried by each family member are connected to a predetermined network. The network NW and the network HN between the gateway GW and the device within the house premises correspond to a predetermined network.

[0057] When the lock screen g700A is unlocked, the control unit 304 displays a warning image g118 informing the user that a warning has been issued in the area of ​​the weather information image g110 on the main screen g100, similar to the notification to check if the door is locked when going out.

[0058] When the user selects this warning image g118, the control unit 304 displays warning image g710, g720, or g730, for example, superimposed on the main screen g100, as shown in FIG. 13. FIG. 13 is a diagram showing an example of a warning image in the home monitoring notification setting according to this embodiment. Warning image g710, g720, or g730 may be a separate screen. Warning image g710 is an image displayed when a human detection device, which is a sensor for detecting whether the front door is locked or unlocked, detects that the door has been unlocked. Warning image g720 is an image displayed when a human detection device, which is a sensor for detecting whether the front door is locked or unlocked, detects that the door has been opened. Warning image g730 is an image displayed when a human detection device, which is a camera on the front door, detects human movement within the house premises. According to this embodiment, these warnings can notify the user that the door has been unlocked while they are out.

[0059] The control unit 402 of the server 4 generates and selects these screens based on the detection results of the human detection device transmitted by the gateway GW. When the "Check (images captured by the camera)" button image g732 is selected in the warning image g730, the control unit 304 transmits information indicating closing to the server 4 via the network NW. When the control unit 402 of the server 4 receives this information from the terminal 3, it transmits a control instruction to play back the video captured by the camera to the gateway GW via the network NW. The user can also select the "No" button image g733, which indicates not to check the warning. The captured images are transmitted by the gateway GW to the server 4, and the server 4 provides them to the terminal 3. According to this embodiment, this operation makes it possible to check the images captured by the camera within the house premises.

[0060] 14 is a diagram showing an example of a setting screen for home monitoring notification settings according to this embodiment. The setting screen g700B includes a setting area g741 for setting whether to use the bulk setting notification, a setting area g742 for setting whether to notify while the user is out, and a setting area g743 for setting whether to notify when a human detection device detects a person. For example, when a human detection device is connected to the network via the network NW and gateway GW, the control unit 402 of the server 4 automatically adds it to this list, thereby automatically generating the bulk setting.

[0061] (Severe Weather Alert) The bad weather open door notification will be described with reference to FIGS. 15 to 17. FIG. 15 is a diagram showing an example of the bad weather open door notification according to this embodiment. When the terminal 3 is in a locked state, the control unit 304 displays an image g801 (e.g., "Rain is forecast in one hour. There is an open door") on the lock screen g800A as a warning notification regarding locking doors when bad weather is predicted. The control unit 402 of the server 4 detects this warning based on weather forecast information when a registered family member is out, using location information of the terminal 3 carried by the family member. When it detects that the weather is worsening, it transmits the warning to each family member's terminal 3 via the network NW. When the control unit 304 of the terminal 3 receives the warning, it displays it in a predetermined position on the application screen. The bad weather open door notification corresponds to the fourth rule. The control unit 402 of the server 4 creates a fourth predetermined rule when an opening is connected to a predetermined network. The network NW and the network HN between the gateway GW and the devices on the house premises correspond to a predetermined network. The controlled devices are the same as those for the home monitoring notification, for example.

[0062] When the lock screen g800A is unlocked, the control unit 304 displays a warning image g118 informing the user that a warning has been issued in the area of ​​the weather information image g110 on the main screen g100, similar to the notification to check if the door is locked when going out.

[0063] When the user selects this warning image g118, the control unit 304 displays a warning image g810 or g820, for example, superimposed on the main screen g100, as shown in FIG. 16. FIG. 16 is a diagram showing an example of a warning image in the home monitoring notification setting according to this embodiment. The warning image g810 or g820 may be a separate screen. The warning image g810 is an image displayed when there are no shutters or windows that can be opened or closed automatically. The warning image g820 is an image displayed when there are shutters or windows that can be opened or closed automatically. The control unit 402 of the server 4 generates and selects these screens based on the information of the home devices 2 stored in the storage unit 403. According to this embodiment, these warnings can notify the user that worsening weather is forecast and that there are openings left open.

[0064] When a user selects the "Close (open openings)" button image g821 in the warning image g820, the control unit 304 displays an image g831 corresponding to the selected user, as in the warning image g830, and transmits a control request to close the opening to the server 4 via the network NW. The control unit 402 of the server 4 transmits a control instruction to close the opening to the gateway GW via the network NW based on the received control request. The gateway GW closes the opening based on the received control instruction and transmits a notification of the closure to the server 4 via the network NW. When the control is complete, the control unit 402 of the server 4 displays an image g832 in the warning image g830 indicating the name of the closed device and the completion of the control request. According to this embodiment, this screen allows the user to automatically close the openings that have been left open.

[0065] 17 is a diagram showing an example of a setting screen for setting bad weather open notification according to this embodiment. The setting screen g800B includes a setting area g841 for setting whether or not to use this batch setting notification, a setting area g842 for setting the amount of rainfall, wind speed, etc. to be notified, and a setting area g843 for setting the openings to be notified. For example, when a sensor is connected to the network via the network NW and gateway GW, the control unit 402 of the server 4 automatically adds it to this list and automatically generates the batch setting. The initial setting is to allow notifications one hour before rain or strong winds are forecast, but it is also possible to change this setting to not allow notifications or to change the notification time.

[0066] The house setting screen g800C in Fig. 17 is a screen for setting the address for which pinpoint information of the weather forecast is to be referenced, etc. The house setting may be set by postal code or by inputting the address.

[0067] (Heatstroke risk notification) The heatstroke risk notification will be described with reference to FIGS. 18 and 19. FIG. 18 is a diagram showing an example of the heatstroke risk notification according to this embodiment. When the terminal 3 is in a locked state, the control unit 304 displays an image g901 (e.g., "There is a risk of heatstroke") on the lock screen g900A as a warning notification that there will be a period of heatstroke. The control unit 402 of the server 4 detects this warning based on weather forecast information, and when the temperature reaches or exceeds a set temperature, transmits the warning to each terminal 3 of the family member via the network NW. Upon receiving the warning, the control unit 304 displays it in a predetermined position on the application screen. The heatstroke risk notification corresponds to the fifth rule. The control unit 402 of the server 4 creates the fifth predetermined rule when a temperature and humidity sensor on the house premises is connected to a predetermined network. The network NW and the network HN between the gateway GW on the house premises and the device correspond to the predetermined network. The controlled device is, for example, a temperature sensor or a humidity sensor.

[0068] When the lock screen g900A is unlocked, the control unit 304 displays a warning image g118 informing the user that a warning has been issued in the area of ​​the weather information image g110 on the main screen g100, similar to the notification to check if the door is locked when going out.

[0069] When the user selects this warning image g118, the control unit 304 displays a warning image g910, for example, superimposed on the main screen g100. The warning image g910 may be a separate screen. The control unit 402 of the server 4 generates these screens based on the information about the household devices 2 stored in the storage unit 403. According to this embodiment, these warnings can notify the user of the risk of heatstroke.

[0070] 19 is a diagram showing an example of a setting screen for heatstroke risk notification settings according to this embodiment. The setting screen g900B includes a setting area g941 for setting whether or not to use this bulk setting notification, a setting area g942 for setting the risk level for notification, and a setting area g943 for setting the sensor to be notified. For example, when a sensor is connected to the network via the network NW and gateway GW, the control unit 402 of the server 4 automatically adds it to this list and automatically generates the bulk setting.

[0071] The above-described rules, rule setting screens, notification images, warning images, notification messages, warning messages, etc. are merely examples, and are not limited to these.

[0072] (Example of processing procedure) An example of the processing procedure of the server 4 will be described below. Fig. 20 is a flowchart of the processing procedure of the server 4 according to this embodiment. In the following processing, it is assumed that an application is installed in the terminal 3.

[0073] (Step S1) The control unit 402 stores in the storage unit 403 the initial setting information that the user has performed on the application installed in the terminal 3. The initial setting information includes, for example, the nickname of the house, the address of the house, the nickname and icon or photo of the head of the house (or owner), family members, and information about the space (rooms, etc.) of the house.

[0074] (Step S2) The control unit 402 acquires information on the control target devices installed within the house premises, for example, for each space, and stores the acquired information in the storage unit 403.

[0075] (Step S3) The control unit 402 determines whether or not a predetermined combination of control target devices is connected to the network NW via the gateway GW. If the control unit 402 determines that the predetermined combination of control target devices is connected to the network NW (step S3; YES), the control unit 402 proceeds to the processing of step S4. If the control unit 402 determines that the predetermined combination of control target devices is not connected to the network NW (step S3; NO), the control unit 402 repeats the processing of step S3.

[0076] (Step S4) The control unit 402 automatically generates a predetermined rule according to the predetermined combination.

[0077] (Step S5) The control unit 402 acquires weather forecast information. The control unit 402 acquires weather forecast information, for example, at predetermined times.

[0078] (Step S6) The control unit 402 acquires the state of the control target device, sensor information, etc. The control unit 402 acquires the state of the house device 2, sensor information, etc., at predetermined time intervals, for example.

[0079] (Step S7) The control unit 402 determines whether the acquired information satisfies the notification conditions based on the information set for each rule. If the control unit 402 determines that the acquired information satisfies the notification conditions (step S7; YES), the control unit 402 proceeds to the processing of step S8. If the control unit 402 determines that the acquired information does not satisfy the notification conditions (step S7; NO), the control unit 402 returns to the processing of step S5.

[0080] (Step S8) The control unit 402 transmits a notification or a warning to the terminal 3 via the network NW based on the information set for each rule.

[0081] (Step S9) The control unit 402 determines whether or not a control request in response to the notification or warning has been received from the terminal 3. If the control unit 402 determines that a control request has been received (step S97; YES), the control unit 402 proceeds to the processing of step S10. If the control unit 402 determines that a control request has not been received (step S10; NO), the control unit 402 returns to the processing of step S5.

[0082] (Step S10) The control unit 402 generates a control instruction based on the received control request and transmits the generated control instruction to the gateway GW via the network NW. After transmission, the control unit 402 returns to the processing of step S5.

[0083] As described above, according to this embodiment, the user does not have to go through the trouble of selecting and combining devices to be set and creating settings for each device, and the rules can be used easily.

[0084] A program for implementing all or part of the functions of control unit 402 in the present disclosure may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be loaded into a computer system and executed to perform all or part of the processing performed by control unit 402. Here, "computer system" includes hardware such as an OS and peripheral devices. "Computer system" also includes a WWW system equipped with a homepage provision environment (or display environment). "Computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into computer systems. "Computer-readable recording medium" also includes devices that retain a program for a certain period of time, such as volatile memory (RAM) within a computer system that acts as a server or client when the program is transmitted via a network such as the Internet or a communication line such as a telephone line.

[0085] The above program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium, or by transmission waves in the transmission medium. A "transmission medium" for transmitting a program refers to a medium that has the function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The above program may be one that realizes part of the above-mentioned functions. It may also be a so-called differential file (differential program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0086] The above describes the form for implementing the present disclosure using embodiments, but the present disclosure is not limited to these embodiments in any way, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present disclosure. [Explanation of symbols]

[0087] 1...information processing system, 2...household equipment, 3...terminal, 4...server, NW...network, 301...first communication unit, 302...second communication unit, 303...GPS receiving device, 304...control unit, 305...storage unit, 306...operation unit, 307...display unit, 308...sound collection unit, 309...photography unit, 310...speaker, 401...communication unit, 402...control unit, 403...storage unit, g100, g100A, g100B...main screen, g110...weather information image, g120...family home / out display image, g130...room-specific information display image, g140...main screen display mode switching image, g300...operation history screen

Claims

1. An information processing device having a control unit, The control unit, The information processing device identifies the controlled device connected to the network, From a terminal device connected to the aforementioned information processing device via a network, a scene selected by the user is received from a set of scenes that define predetermined actions performed by a predetermined controlled device under predetermined conditions. Upon receiving the selected scene, the terminal device displays an operation selection unit that selects a specific controlled device and the operation of that specific controlled device corresponding to the selected scene. Information processing device.

2. The specific controlled device is one of the controlled devices connected to the information processing device via a network, which is set in advance based on predetermined conditions. The information processing apparatus according to claim 1.

3. The control unit causes the terminal device to display a predetermined operation of the specific controlled device corresponding to the selected scene. The information processing apparatus according to claim 1 or 2.

4. The control unit causes the terminal device to display an operation timing setting unit which sets the operation execution time, which is the time for the controlled device to perform an operation. The information processing apparatus according to any one of claims 1 to 3.

5. The control unit causes the terminal device to display a control device addition unit that adds a control device other than the displayed specific control device as the specific control device. The information processing apparatus according to any one of claims 1 to 4.

6. When the control unit causes the user to select the scene displayed on the terminal device, it displays the scenes arranged on a time axis. The information processing apparatus according to any one of claims 1 to 5.

7. When the control unit causes the user to select the scene displayed on the terminal device, in addition to the scene, it causes the terminal device to display a custom scene as a scene that the user can select, in which a predetermined operation to be performed by a predetermined controlled device under predetermined conditions is not defined. The information processing apparatus according to any one of claims 1 to 6.

8. When the control unit collectively sets the operation settings of the specific controlled device according to the selected scene, and when predetermined conditions are met, it notifies the user, The information processing apparatus according to any one of claims 1 to 7.

9. From a terminal device connected to an information processing device via a network, scene identification information is obtained that identifies a scene selected by the user of the terminal device. The terminal device displays an operation control selection unit for selecting the operation control of a controlled device connected to the information processing device via a network. In accordance with the rules set for each scene, the controlled device corresponding to the selected scene is selected as the controlled device to be displayed for the user to select. How to configure the operation.

10. A computer, The information processing device and a terminal device connected via a network are used to obtain scene identification information that identifies a scene selected by the user of the terminal device. The terminal device is made to display an operation control selection unit for selecting the operation control of a controlled device connected to the information processing device via a network. In accordance with the rules set for each scene, the controlled device corresponding to the selected scene is selected as the controlled device to be displayed for the user to select. Operation setting program.

11. Information processing device, The aforementioned information processing device and a terminal device connected via a network, Equipped with, The information processing device has a scene identification unit that identifies a scene selected by the user of the terminal device, The terminal device has a display unit that displays an operation control selection unit which selects the operation control of a controlled device connected to the information processing device via a network, The information processing device selects the controlled device corresponding to the selected scene to be displayed on the terminal device for the user to select, in accordance with the rules set for each scene. Information processing system.

Images