Cleaner management program and cleaner management system

Abstract

To grasp cleaning performance while suppressing complication of a configuration and increase in price.SOLUTION: A cleaner management system having a user terminal 1 used by a user of a stick type cleaner 2 with no communication function, which is attached to the terminal holder 20 of the stick type cleaner 2, and a cleaner management device 3 includes: a cleaner identification part 32 for determining whether the user terminal 1 is usable on the basis of identification information on the stick type cleaner 2; an operation status detection part 33 for detecting the operation status of the stick type cleaner 2 when the user terminal is determined to be usable by the cleaner identification part; a map information creation part 36 for creating map information 355 showing the state of cleaning using layout information 353 showing a region to be cleaned by the stick type cleaner 2, tracking information 354 showing the moving history of the stick type cleaner 2, and the operation status; and an output part for outputting the map information.SELECTED DRAWING: Figure 24

Description

[Technical field]

[0001] The present invention relates to a so-called home appliance, in particular a vacuum cleaner, and to an information processing technique for managing the same. [Background technology]

[0002] Currently, home appliances such as vacuum cleaners are used for housework. So-called IoT (Internet of Things) home appliances have been proposed for these home appliances. IoT home appliances are connected to networks such as the Internet and realize various functions and services such as control of operation. For example, Patent Document 1 describes "a more convenient vacuum cleaner and vacuum cleaner management system by enabling operation related to the performance of the vacuum cleaner." More specifically, it describes "a vacuum cleaner management system in which a mobile information terminal, a vacuum cleaner, and a center device are connected via the Internet, the vacuum cleaner is equipped with a sensor that measures the number of rotations and the motor current of a motor controlled by a power converter, and a communication means for transmitting the output of the sensor to the Internet, and the center device inputs the number of rotations and the motor current of the motor obtained from a plurality of vacuum cleaners and transmits information about the vacuum cleaner to the mobile information terminal" (abstract). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-162696 A Summary of the Invention [Problem to be solved by the invention]

[0004] Currently, many home appliances that do not have communication functions are in use. In other words, many home appliances other than IoT home appliances are in use. With such home appliances, there are some functions and services that IOT home appliances can offer that cannot be enjoyed. In addition, IoT home appliances require functions such as communication functions, which may lead to a more complicated structure and higher prices. In particular, it is difficult to grasp the cleaning status, such as how much cleaning has been done. In particular, with manual vacuum cleaners, the cleaning status relies solely on the user's senses and memories, which lacks accuracy.

[0005] Therefore, an object of the present invention is to make it possible to grasp cleaning results while preventing the configuration from becoming complicated and the price from increasing. [Means for solving the problem]

[0006] The configuration of the present invention to solve the above problem comprises a vacuum cleaner identification unit that is used by a user of a vacuum cleaner that does not have communication functions and that determines whether a user terminal, which is a computer attached to a terminal holder of the vacuum cleaner, is usable based on the identification information of the vacuum cleaner, an operation status detection unit that detects the operation status of the vacuum cleaner if the vacuum cleaner identification unit determines that the user terminal is usable, a map information creation unit that creates map information showing the cleaning status using layout information that indicates the area to be cleaned by the vacuum cleaner, tracking information that indicates the movement history of the vacuum cleaner, and the operation status, and a vacuum cleaner management program that functions as an output unit that outputs the map information.

[0007] The present invention also includes a vacuum cleaner management system that is used by a user of a vacuum cleaner that does not have a communication function and has a user terminal attached to a terminal holder of the vacuum cleaner and a vacuum cleaner management device, the vacuum cleaner management system having a vacuum cleaner identification unit that determines whether the user terminal is usable based on identification information of the vacuum cleaner, an operation status detection unit that detects the operation status of the vacuum cleaner if the vacuum cleaner identification unit determines that the user terminal is usable, a map information creation unit that creates map information showing the cleaning status using layout information that indicates the area to be cleaned by the vacuum cleaner, tracking information that indicates the movement history of the vacuum cleaner and the operation status, and an output unit that outputs the map information.

[0008] Furthermore, the present invention also includes a vacuum cleaner management method using the above-mentioned vacuum cleaner management program, vacuum cleaner management system, and each of the devices and subsystems that constitute the vacuum cleaner management system. Effect of the Invention

[0009] According to the present invention, it is possible to realize various functions and services using information processing technology in home appliances, particularly vacuum cleaners, while preventing the configuration from becoming complicated and the price from increasing. [Brief description of the drawings]

[0010] [Figure 1] 1 is a perspective view showing a state in which a stick vacuum cleaner according to an embodiment of the present invention is stored in a charging stand in a stick state. FIG. [Diagram 2] FIG. 1 is a diagram showing a state in which a user terminal 1 is installed on a stick vacuum cleaner 2 in one embodiment of the present invention. [Diagram 3] FIG. 2 is a functional block diagram of a user terminal 1 according to the first embodiment. [Figure 4] FIG. 2 is a hardware configuration diagram of a user terminal 1 in the first embodiment. [Diagram 5] FIG. 11 is a diagram showing user management information 191 used in the first embodiment. [Figure 6] FIG. 11 is a diagram showing cleaner management information 192 used in the first embodiment. [Figure 7]11 is a flowchart showing a cleaning area presentation process flow in the first embodiment. [Figure 8] FIG. 4 is a diagram showing a display screen of AR information in the first embodiment. [Figure 9] FIG. 11 is a system configuration diagram of a vacuum cleaner management system in a second embodiment. [Figure 10] FIG. 11 is a hardware configuration diagram of a cleaner management device 3 in a second embodiment. [Figure 11] FIG. 11 is a diagram showing user management information 351 used in the second embodiment. [Figure 12] FIG. 11 is a diagram showing cleaner management information 352 used in the second embodiment. [Figure 13A] 13 is a flowchart (part 1) showing a cleaning area presentation process flow in the second embodiment. [Figure 13B] 13 is a flowchart (part 2) showing the cleaning area presentation process flow in the second embodiment. [Figure 14] FIG. 11 is a diagram showing a schematic side view of a stick vacuum cleaner 2 with a terminal holder 20 attached thereto in a third embodiment. [Figure 15] 14 showing a state in which the terminal holder 20 in the third embodiment is attached. FIG. [Figure 16] 13 is a diagram showing a first example of a mounting portion 200 in the third embodiment. FIG. [Figure 17] 13 is a diagram showing a second example of the attachment portion 200 in the third embodiment. FIG. [Figure 18] FIG. 13 is a functional block diagram of a user terminal 1 according to a fourth embodiment. [Figure 19] FIG. 13 is a hardware configuration diagram of a user terminal 1 in a fourth embodiment. [Figure 20] FIG. 13 is a diagram showing layout information 193 used in the fourth embodiment. [Figure 21] FIG. 13 is a diagram showing tracking information 194 used in the fourth embodiment. [Figure 22] 13 is a flowchart showing a process flow for presenting map information in the fourth embodiment. [Figure 23A]FIG. 13 is a diagram showing a first example of map information 195 used in the fourth embodiment. [Figure 23B] FIG. 13 is a diagram showing a second example of the map information 195 used in the fourth embodiment. [Figure 24] FIG. 13 is a system configuration diagram of a vacuum cleaner management system in a fifth embodiment. [Diagram 25] FIG. 13 is a hardware configuration diagram of a cleaner management device 3 in a fifth embodiment. [Figure 26] FIG. 13 is a diagram showing layout information 353 used in the fifth embodiment. [Figure 27] FIG. 13 is a diagram showing tracking information 354 used in the fifth embodiment. [Figure 28A] 13 is a flowchart (part 1) showing the flow of a process for presenting map information in the fifth embodiment. [Figure 28B] 23 is a flowchart (part 2) showing the flow of the map information presentation process in the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] An embodiment of the present invention will be described below. In this embodiment, a vacuum cleaner will be taken as an example of a home appliance. In particular, a stick vacuum cleaner will be taken as an example of a manual vacuum cleaner operated by a user. Furthermore, the stick vacuum cleaner of this embodiment does not have a communication function with other devices such as a smartphone or a router. A configuration for realizing a management function related to such a stick vacuum cleaner will be described below.

[0012] 1 is a perspective view showing a stick vacuum cleaner 2 according to this embodiment in a stick state stored in a charging stand 26. Here, the stick vacuum cleaner 2 is configured to include a vacuum cleaner body 21, a handle 22, an extension tube 23, and a vacuum cleaner head 24. The vacuum cleaner body 21 and the vacuum cleaner head 24 are connected via the extension tube 23.

[0013] The vacuum cleaner body 21 is provided with a handle 22 that is held by a user. A terminal holder 20 is provided below the handle 22 on the vacuum cleaner body 21. The terminal holder 20 holds a user terminal 1 such as a smartphone, and may be configured to be separable from the vacuum cleaner body 21, or may be configured as an integral part. In this embodiment, at least a part of the vacuum cleaner management function is executed by the user terminal 1 held in the terminal holder 20. This function (processing flow) will be described in each embodiment.

[0014] The stick vacuum cleaner 2 can be changed to various states for cleaning, such as a handheld state and a stick state. The charging stand 26 in which the stick vacuum cleaner 2 is stored stores the stick vacuum cleaner 2 in the stick state, and is configured with a base member 29, three stand members 28, and a holder member 27. The charging stand 26 can charge the stick vacuum cleaner 2.

[0015] A marker unit 25 such as an AR marker or a nameplate is provided on the cleaner head 24 that faces a cleaning surface such as a floor. Identification information for identifying the stick vacuum cleaner 2 is recorded on this marker unit 25. The identification information may be information for identifying the individual stick vacuum cleaner 2, or information for identifying the type, such as the model, of the stick vacuum cleaner 2. An image is then captured by the user terminal 1 held in the terminal holder 20, and the identification information is read. This process will be described below.

[0016] Fig. 2 is a diagram showing a state in which a user terminal 1 is installed on a stick vacuum cleaner 2 in this embodiment. In this embodiment, as shown in Fig. 2, the user terminal 1 is held in a terminal holder 20 connected to a vacuum cleaner body 21. At this time, the user terminal 1 is held in the terminal holder 20 so that it faces the vacuum cleaner head 24 and the camera can capture an image of the sign section 25. It is preferable that the orientation of the terminal holder 20 is variable and therefore the direction in which the user terminal 1 faces can also be changed accordingly. Furthermore, the camera of the user terminal 1 captures an image of the floor surface to be cleaned by the stick vacuum cleaner 2.

[0017] In this embodiment, the vacuum cleaner management function is executed on the condition that an identification process is performed using the identification information of the sign unit 25 photographed by the user terminal 1. Here, in this embodiment, a process of presenting the cleaning area cleaned by the stick vacuum cleaner 2 is executed as the vacuum cleaner management function. In the following Examples 1 and 2, which are specific examples of this embodiment, the details of this cleaning area presentation process are explained. Furthermore, in Example 3, the structure of the terminal holder 20 is explained in detail. Furthermore, in Examples 4 and 5, examples of creating map information are explained. It is possible to combine at least two of each of the examples. EXAMPLES

[0018] Example 1 is an example in which the cleaning area presentation process is executed by a single user terminal 1. Fig. 3 is a functional block diagram of the user terminal 1 in Example 1. The user terminal 1 has a communication unit 11, a photographing unit 12, a sound collection unit 13, a vacuum cleaner identification unit 14, an operation status detection unit 15, an AR information creation unit 16, an input unit 17, an output unit 18, and a storage unit 19.

[0019] First, the communication unit 11 has a function of communicating via a router or a network and a function of short-distance wireless communication. The photographing unit 12 is realized by a camera or the like and acquires surrounding images. The sound collecting unit 13 is realized by a microphone or the like and acquires surrounding sounds.

[0020] Furthermore, the vacuum cleaner identification unit 14 identifies the stick vacuum cleaner 2 using the image captured by the imaging unit 12. In the first and second embodiments, the image of the label unit 25 captured by the imaging unit 12 is used to identify the identification information recorded in the label unit 25, and the identification is performed using this. Note that an AR (Augmented Reality) marker, a two-dimensional code, or a nameplate can be used as the label unit 25. Here, the identification information is recorded on the nameplate in a visible format.

[0021] Also, the label unit 25 may be omitted, and the stick vacuum cleaner 2 may be identified using the shape of the vacuum cleaner head 24 photographed by the photographing unit 12. When the shape of the vacuum cleaner head 24 is used, the vacuum cleaner identification unit 14 identifies the type of stick vacuum cleaner 2. Furthermore, an RFID (Radio Frequency Identification) tag on which identification information is recorded may be used as the label unit 25. In this case, an RFID reader is provided in the user terminal 1, and the identification information is read by this.

[0022] Furthermore, the operation status detection unit 15 detects the operation status of the stick vacuum cleaner 2, such as the identification of the cleaning area, using the image of the floor surface captured by the image capture unit 12. The AR information creation unit 16 creates AR information using the image of the floor surface captured by the image capture unit 12 and the cleaning area identified by the operation status detection unit 15. Here, the AR information is information created using augmented reality technology. Furthermore, the AR information indicates the cleaning area, and is an example of information provided to related parties including the user. For this reason, the information provided is not limited to AR information, and may be a captured image (including a still image and a video), an animation indicating the cleaning area, or the cleaning area may be indicated by text.

[0023] Furthermore, the input unit 17 accepts various operations from the user. Furthermore, the output unit 18 outputs AR information and the like. The input unit 17 and the output unit 18 may be integrated into one unit, such as a touch panel. Furthermore, the storage unit 19 stores user management information 191 and vacuum cleaner management information 192. These pieces of information will be described after the implementation example of the user terminal 1.

[0024] Next, an implementation example of the user terminal 1 will be described. The user terminal 1 can be realized by various computers such as a smartphone, a tablet, a mobile phone, or a PC. Fig. 4 is a hardware configuration diagram of the user terminal 1 in the first embodiment. In Fig. 4, the user terminal 1 has a camera 101, a microphone 102, a touch panel 103, a processing device 104, a communication device 105, and a storage device 106, which are connected to each other via a communication path.

[0025] First, camera 101 is an example of an implementation of image capturing unit 12, and has an image capturing function. Microphone 102 is an example of an implementation of sound collecting unit 13, and has a sound collecting function. Touch panel 103 is configured to serve both input unit 17 and output unit 18 in FIG. 3, and accepts user operations and displays various information such as AR information. Note that touch panel 103 may be configured separately as an input device and an output device.

[0026] The processing device 104 can be realized by a processor such as a CPU (Central Processing Unit), and executes calculations according to a cleaner management program 107 stored in a storage device 106, which will be described later.

[0027] The vacuum cleaner management program 107 is composed of a vacuum cleaner identification module 108, an operating status detection module 109, and an AR information creation module 110, each for one of its functions. Each of these modules may be realized as an individual program or a partial combination. In particular, the AR information creation module 110 may be realized as a program having an augmented reality function separate from home appliance management. Furthermore, the vacuum cleaner management program 107 may be realized as one function of an integrated management application that manages multiple home appliances.

[0028] Here, the configuration shown in FIG. 3, which performs the same functions as each module, is as follows. Vacuum cleaner identification module 108: Vacuum cleaner identification unit 14 Operation status detection module 109: Operation status detection unit 15 AR information creation module 110: AR information creation unit 16 Therefore, the processing device 104 executes the processes of the vacuum cleaner identification unit 14, the operation status detection unit 15, and the AR information creation unit 16 in accordance with the vacuum cleaner management program 107. The vacuum cleaner management program 107 can be stored in a storage device 106 (to be described later) or other storage media.

[0029] 3, and has a function of communicating via a router or a network and a short-distance wireless communication. Storage device 106 corresponds to storage device 19 in FIG. 3, and stores the above-mentioned vacuum cleaner management program 107, user management information 191, and vacuum cleaner management information 192. For this reason, storage device 106 may be realized by a main storage device such as a memory and a secondary storage device (storage medium) that is a so-called storage. The secondary storage device may be realized by an external HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, or the like.

[0030] Here, the user management information 191 and the cleaner management information 192 will be described. FIG. 5 is a diagram showing the user management information 191 used in the first embodiment. The user management information 191 is information about the user of the user terminal 1. For this reason, the user management information 191 has the following items: user, address, contact information, and owned cleaner, as shown in FIG. 5. Here, the user is information for identifying the user, such as the name and membership number of the user. The address indicates the address of the user. The contact information indicates the contact information of the user, and may be a telephone number or an email address. The owned cleaner is information for identifying the home appliance used by the user, that is, the cleaner. Here, the user management information 191 can be used to manage and authenticate the user in the cleaner management program 107. The user management information 191 may be omitted.

[0031] 6 is a diagram showing cleaner management information 192 used in the first embodiment. The cleaner management information 192 is information for managing the stick cleaner 2, which is a home appliance used by the user. For this reason, as shown in FIG. 6, the cleaner management information 192 has the following items: cleaner, cleaner ID, related party, date and time, AR information, and cleaning record (cleaned area).

[0032] Here, the cleaner indicates the type of the managed object, that is, the cleaner that is the target of the cleaning area presentation process. In the first embodiment, a stick type cleaner 2 is recorded. When there are multiple targets of the cleaning area presentation process, the cleaner management information 192 has multiple records.

[0033] The cleaner ID is identification information for identifying the corresponding cleaner. This cleaner ID is information equivalent to the identification information recorded in the marker unit 25. The related party indicates the related party at the end of the cleaning area. Typical examples of the related party include the user of the user terminal 1 (A in the figure), as well as his / her family and cohabitants. When a commercial vacuum cleaner is used as the target vacuum cleaner, the user's colleagues, managers, customers, etc. can be registered. However, these related parties are merely examples, and any person can be registered by the user's operation, etc. Furthermore, it is desirable to distinguish the user from other related parties among the related parties. This distinction enables the determination of step S9 in the processing flow (FIG. 7) described later. This distinction may be performed by providing an item for the user, or by matching the user management information 191 with the vacuum cleaner management information 192.

[0034] The date and time indicates the date and time when cleaning was performed, or the date and time when the AR information was created. The AR information indicates a log of the AR information created by the AR information creation unit 16. The cleaning history (cleaned area) indicates the area cleaned by the corresponding stick vacuum cleaner 2 based on the AR information. For this reason, the cleaning history (cleaned area) has the items of coordinates and room. Here, the coordinates are coordinates that indicate the area cleaned by the stick vacuum cleaner 2, that is, the trajectory of movement. Furthermore, the room indicates a room that has been cleaned (or has not been cleaned) according to the coordinates. It should be noted that the cleaning history (cleaned area) can be omitted.

[0035] Next, a description will be given of a cleaning area presentation process in the embodiment 1. Fig. 7 is a flowchart showing a cleaning area presentation process flow in the embodiment 1. In the following, the configuration of the user terminal 1 will be described using the configuration shown in Fig. 3.

[0036] First, in step S1, the input unit 17 accepts input from the user and starts up a configuration for the presentation process. For example, the vacuum cleaner management program 107 in Fig. 4 is started up. At this time, the user places the user terminal 1 in the terminal holder 20. As a result, the terminal holder 20 holds the user terminal 1, and the user terminal 1 faces in the downward direction of the stick vacuum cleaner 2 (vacuum cleaner head 24), making it possible to capture an image in this direction.

[0037] In step S2, the photographing unit 12 starts photographing. This photographing is started in response to an instruction from the user, which can be started by an operation on the input unit 17 or a voice instruction picked up by the sound pickup unit 13. The sound pickup unit 13 may also pick up sounds generated when the stick vacuum cleaner 2 is in operation, and the photographing unit 12 may start photographing based on the sounds.

[0038] In step S3, the vacuum cleaner identification unit 14 uses the captured image to recognize the identification information recorded on the label unit 25. If a nameplate is used as the label unit 25, character recognition technology is used to recognize the identification information written in a visible form. If an AR marker or a two-dimensional code is used, well-known technology is used to identify the identification information.

[0039] In the first embodiment, it is also possible not to use the label unit 25. In this case, in step S3, the cleaner identification unit 14 identifies the shape of the cleaner head 24 included in the captured image, and based on this, identifies identification information for identifying the stick vacuum cleaner 2. In this case, the identification information identifies the type of the stick vacuum cleaner 2, such as its model.

[0040] Also, in step S4, the cleaner identification unit 14 judges whether the user terminal 1 held by the terminal holder 20 is usable, that is, whether the cleaning area presentation process in this flowchart is possible. For this purpose, the cleaner identification unit 14 judges whether the cleaner ID corresponding to the recognized identification information is recorded in the cleaner management information 192. As a result, if it is recorded, that is, if it is usable, the process proceeds to step S5. Also, if it is not recorded and cannot be used, the process ends. At this time, it is desirable for the output unit 18 to display that it cannot be used. Thus, in step S4, an identification process using the identification information is executed. Note that if the user terminal 1 is installed in the terminal holder 20, the sign unit 25 can be accurately photographed. For this reason, step S4 also has the significance of the cleaner identification unit 14 judging that the user terminal 1 is correctly attached to the terminal holder 20.

[0041] Furthermore, in step S5, vacuum cleaner identification unit 14 identifies related parties corresponding to the vacuum cleaner ID identified in step S4 from vacuum cleaner management information 192. Furthermore, in step S6, vacuum cleaner identification unit 14 accepts a selection of a destination to which AR information, described below, is to be provided, via input unit 17 and sound collection unit 13. For this purpose, vacuum cleaner identification unit 14 displays the related parties identified in step S5 via output unit 18. Note that the related parties may be output as audio via an audio output unit such as a speaker.

[0042] Furthermore, in step S7, the operational status detection unit 15 detects the operational status of the stick vacuum cleaner 2, such as identifying the cleaning area, by using the image of the floor surface captured by the imaging unit 12. More specifically, the trajectory of the movement of the cleaner head 24 is identified.

[0043] In step S8, the AR information creation unit 16 creates AR information by superimposing the operation status detected by the operation status detection unit 15 on an image showing the cleaning area, which is the floor surface photographed by the photographing unit 12. Here, the created AR information will be described using its display screen. FIG. 8 is a diagram showing a display screen of the AR information in the first embodiment. In FIG. 8, the AR information is displayed on the output unit 18 of the user terminal 1. Then, a trajectory 182 of the cleaner head 24 is superimposed on the photographed image (floor surface 181). Here, the shading of the trajectory 182 indicates the frequency of movement. That is, the darker the area, the more cleaning has been done. In addition, in FIG. 8, the cleaning performance (cleaned area) 183, that is, the date and time, cleaning time, and coordinates are displayed as the operation status. Here, the date and time indicates the current date and time when cleaning is being performed. The cleaning time is the time since the stick vacuum cleaner 2 started cleaning. Furthermore, the coordinates and the location indicating the location are specified according to a position detection unit such as a gyro of the user terminal 1, and these are also displayed.

[0044] 8, user identification information 184 indicates the user (A) of user terminal 1. Note that cleaning history (cleaned area) 183 and user identification information 184 may be omitted. In particular, user identification information 184 may not be displayed on user terminal 1 of user (A) but may be displayed on another user terminal. This concludes the explanation of AR information, and we will return to FIG. 7 to continue the explanation of the processing flow.

[0045] In step S9, the AR information creation unit 16 determines whether the provision destinations accepted in step S6 are only the user or include other people than the user. If the provision destinations include other people than the user, the process proceeds to step S10. If the provision destinations are only the user, the process proceeds to step S11.

[0046] In addition, in step S10, the AR information creation unit 16 notifies the user terminal of the other user of the created AR information using the communication unit 11. At this time, it is desirable that the cleaning record (cleaned area) 183 and the user identification information 184 described in FIG. 8 are also notified. As a result, the display screen shown in FIG. 8 is displayed on the user terminal of the other user. Therefore, the other user can share the cleaning record with the stick vacuum cleaner 2 with the user. This sharing may be realized in real time, or may be shared with a time lag or only the results. The details of these will be described later in Example 2. In addition, in step S11, the AR information creation unit 16 displays the display screen shown in FIG. 8 on the output unit 18.

[0047] Also, in step S12, the AR information creation unit 16 determines whether cleaning with the stick vacuum cleaner 2 has ended. At this time, the end can be determined by an operation from the user to the input unit 17 or a voice instruction to be picked up by the sound collection unit 13. Furthermore, the AR information creation unit 16 may also determine that the sound of the stick vacuum cleaner 2 being operated and picked up by the sound collection unit 13 has stopped. As a result, if cleaning has ended, the process transitions to step S13. If cleaning is continuing, the creation of AR information in step S8 continues. Therefore, the image capture unit 12 continues capturing images and the operation status detection unit 15 continues detecting the operation status.

[0048] Then, in step S13, the AR information creation unit 16 records the created AR information and the cleaning record (cleaned area) indicating the operation status, thereby updating the vacuum cleaner management information 192. Furthermore, it is preferable that the AR information creation unit 16 stops the notification in step S10 and the display in step S11.

[0049] This concludes the description of the first embodiment. According to the first embodiment, it is possible to provide a cleaning area presentation process even for a vacuum cleaner without a communication function, and as a result, the user and other related parties can grasp the cleaning status. However, in the first embodiment, the cleaning area may be presented to a limited extent to the user and other related parties. In this case, steps S6, S9, and S10 are omitted. Furthermore, the presentation of the cleaning area may be made to fixed related parties. In this case, step S9 is omitted, and a transition is made from step S8 to step S10. EXAMPLES

[0050] In the first embodiment, the user terminal 1 alone executes the cleaning area presentation process, whereas in the second embodiment, it cooperates with a vacuum cleaner management device 3 realized by a server or the like. FIG. 9 is a system configuration diagram of the vacuum cleaner management system in the second embodiment. In FIG. 9, the vacuum cleaner management system has a user terminal 1 held by a terminal holder 20 of a stick vacuum cleaner 2, and a vacuum cleaner management device 3, which are connected via a network 5. In this case, the user terminal 1 may be connected to the network 5 via a router 4, or may be connected via another device, or may be connected directly to the network 5.

[0051] In the second embodiment, among the functions of the user terminal 1 described in the first embodiment, the functions and configurations executed by the vacuum cleaner management device 3 can be omitted. For example, at least one of the vacuum cleaner identification unit 14, the operation status detection unit 15, and the AR information creation unit 16 can be omitted.

[0052] Furthermore, the user terminal 1 and the vacuum cleaner management device 3 are connected to the user terminal 1-a and the user terminal 1-b used by the relevant person described in the first embodiment via the router 4 and the network 5. In FIG. 9, the user terminal 1-a is located in the same house as the user terminal 1, and is connected to the user terminal 1 and the vacuum cleaner management device 3 via the router 4. Moreover, the user terminal 1-b is located in a different place (outside the house) from the user terminal 1, and is directly connected to the network 5. The user terminal 1 and the stick vacuum cleaner 2 are the same as those in the first embodiment. Moreover, the user terminal 1-a and the user terminal 1-b may have the same functions as the user terminal 1, or may be configured to omit the vacuum cleaner identification unit 14 to the AR information creation unit 16.

[0053] Next, a description will be given of the vacuum cleaner management device 3, which is a characteristic configuration in the embodiment 2. The vacuum cleaner management device 3 is used by manufacturers and distributors of stick vacuum cleaners 2, and these distributors manage users as members. Next, a description will be given of the configuration of the vacuum cleaner management device 3.

[0054] First, the functional blocks of the vacuum cleaner management device 3 will be described with reference to Fig. 9. The vacuum cleaner management device 3 has a communication unit 31, a vacuum cleaner identification unit 32, an operation status detection unit 33, an AR information creation unit 34, and a storage unit 35. First, the communication unit 31 connects to each user terminal via the network 5.

[0055] Furthermore, the cleaner identification unit 32, the operation status detection unit 33, and the AR information creation unit 34 execute the same processes as the cleaner identification unit 14, the operation status detection unit 15, and the AR information creation unit 16 of the first embodiment. Furthermore, the storage unit 35 stores user management information 351 and cleaner management information 352. Each of these pieces of information will be described later.

[0056] Next, a hardware configuration as an implementation example of the vacuum cleaner management device 3 will be described. The vacuum cleaner management device 3 can be realized by a computer such as a server or a cloud system. Fig. 10 is a hardware configuration diagram of the vacuum cleaner management device 3 in Example 2. In Fig. 10, the vacuum cleaner management device 3 has a processing device 301, a communication device 302, a memory 303, and a secondary storage device 304, which are connected to each other via a communication path.

[0057] First, the processing device 301 can be realized by a processor such as a CPU, and executes calculations according to a vacuum cleaner management program 305 stored in a secondary storage device 304 described later. Also, the communication device 302 corresponds to the communication unit 31 in Fig. 9, connects to the network 5, and communicates with other devices such as the user terminal 1.

[0058] 9. In the memory 303, the vacuum cleaner management program 305 stored in the secondary storage device 304 and information used for processing by the processing device 301 are expanded. In addition, the secondary storage device 304 can be realized by a so-called storage. The secondary storage device 304 stores the vacuum cleaner management program 305, user management information 351, and vacuum cleaner management information 352. In addition, the secondary storage device 304 may be realized by various storage media such as an external HDD (Hard Disk Drive), SSD (Solid State Drive), or memory card, or may be realized by a device separate from the vacuum cleaner management device 3, such as a file server.

[0059] Here, the vacuum cleaner management program 305 is composed of a vacuum cleaner identification module 306, an operating status detection module 307, and an AR information creation module 308, each for one of its functions. Note that each of these modules may be realized as an individual program or a partial combination. In particular, the AR information creation module 308 may be realized as a program having an augmented reality function separate from the home appliance management program. Furthermore, the vacuum cleaner management program 305 may be realized as one function of an integrated management application that manages multiple home appliances.

[0060] Here, the configuration shown in FIG. 9, which performs the same functions as each module, is as follows. Vacuum cleaner identification module 306: Vacuum cleaner identification unit 32 Operation status detection module 307: Operation status detection unit 33 AR information creation module 308: AR information creation unit 34 Therefore, the processing device 301 executes the processes of the vacuum cleaner identification unit 32, the operating status detection unit 33, and the AR information creation unit 34 in accordance with the vacuum cleaner management program 305.

[0061] Here, the cleaner management program 305 executes the same processes as the cleaner management program 107 of the user terminal 1. The cleaner management program 305 can be stored in the secondary storage device 304 or other storage media.

[0062] Next, the user management information 351 and the vacuum cleaner management information 352 will be described. FIG. 11 is a diagram showing the user management information 351 used in the second embodiment. Like the user management information 191, the user management information 351 is information relating to the user of the user terminal 1. Therefore, like the user management information 191, the user management information 351 has the fields of user, address, contact information, and owned vacuum cleaner. However, the user management information 351 targets multiple users such as members. Therefore, the user management information 351 includes records for each of the targeted users.

[0063] 12 is a diagram showing cleaner management information 352 used in the second embodiment. Like the cleaner management information 352, the cleaner management information 352 is information for managing a home appliance used by a user, for example, a stick cleaner 2. For this reason, like the cleaner management information 192, the cleaner management information 352 has the following items: cleaner, cleaner ID, related party, date and time, AR information, and cleaning record (cleaned area).

[0064] However, the vacuum cleaner management information 352 targets multiple users, such as members. Therefore, the vacuum cleaner management information 352 includes records for each vacuum cleaner of the target user. As in the first embodiment, it is desirable to distinguish the users from other related parties. By using the related party item, it becomes possible to identify the related party in step S20 of the processing flow (FIG. 13A) described later. This distinction may be made by providing a user item, or by comparing the user management information 351 with the vacuum cleaner management information 352.

[0065] Next, a cleaning area presentation process in Example 2 will be described. Fig. 13A and Fig. 13B are flowcharts showing a cleaning area presentation process flow in Example 2. In the following, the configuration of the user terminal 1 will be described using the configuration shown in Fig. 3, and the configuration of the vacuum cleaner management device 3 will be described using the configuration shown in Fig. 9.

[0066] First, in steps S1 and S2, the same processes as those in the first embodiment are executed by the user terminal 1. In step S14, the communication unit 11 of the user terminal 1 notifies the vacuum cleaner management device 3 of the image captured in step S2. In response, in step S15, the communication unit 31 of the vacuum cleaner management device 3 accepts the image.

[0067] Then, in step S16, the cleaner identification unit 32 uses the received image to recognize the identification information recorded in the sign unit 25. This process is executed in the same manner as step S3 in the first embodiment. In addition, in step S17, the cleaner identification unit 32 determines whether the user terminal 1 held by the terminal holder 20 is usable, that is, whether the cleaning area presentation process in this flowchart is possible. In other words, the same process as step S4 in the first embodiment is executed. However, in step S17, the cleaner management information 352 is used instead of the cleaner management information 192. As a result, if it is recorded, that is, if it is usable, the process transitions to step S20. In addition, if it is not recorded and therefore cannot be used, the process transitions to step S18.

[0068] Furthermore, in step S18, the vacuum cleaner identification unit 32 notifies the user terminal 1 that the vacuum cleaner cannot be used via the communication unit 31. Then, in step S19, the communication unit 11 of the user terminal 1 accepts the notification of step S18 and displays information that the vacuum cleaner cannot be used on the output unit 18. As a result, this flowchart ends.

[0069] Furthermore, in step S20, cleaner identification unit 32 identifies related parties corresponding to the cleaner ID identified in step S16 from cleaner management information 352. This step can be realized by substantially the same process as step S5, but it is preferable to exclude users from the related parties.

[0070] Furthermore, in step S21, the vacuum cleaner identification unit 32 notifies the user terminal 1 via the communication unit 31 of the related parties identified in step S20. Then, in step S22, the communication unit 11 of the user terminal 1 accepts the related parties, and the output unit 18 displays this. At this time, the output unit 18 displays a message prompting the user to select the related parties to be the recipients. Then, in step S23, the input unit 17 and the sound collection unit 13 accept the selection of the displayed related parties by the user, that is, the selection of the recipients. As a result, in step S24, the communication unit 11 notifies the vacuum cleaner management device 3 of the selected notification destinations.

[0071] Note that steps S20 to S24 may be executed as follows: In step S20, the vacuum cleaner identification unit 32 identifies related parties including the user, and in step S21 notifies related parties including the user via the communication unit 31. In this case, in step S22, the user is displayed as a required person and cannot be removed from the selection.

[0072] Then, in step S25, the vacuum cleaner management device 3 accepts the destination notified in step S24. Next, moving to Fig. 13B, in step S26, the operation status detection unit 33 detects the operation status of the stick vacuum cleaner 2, such as identifying the cleaning area, using the image of the floor surface captured by the imaging unit 12. That is, the same process as in step S7 is executed. Note that this step may be executed by the operation status detection unit 15 of the user terminal 1, and the operation status may be notified to the vacuum cleaner management device 3 via the communication unit 11.

[0073] Furthermore, in step S27, the AR information creation unit 34 creates AR information by superimposing the operation status detected by the operation status detection unit 33 or the operation status detection unit 15 on the image captured by the image capture unit 12. That is, the same process as in step S8 is executed. Then, in step S28, the AR information creation unit 34 notifies the created AR information to the destination user terminals including the user terminal 1, using the communication unit 31. This destination is the destination user terminal accepted in step S25 and the user terminal 1 of the user. For example, the AR information is notified to the user terminal 1-a and the user terminal 1-b in FIG. 9.

[0074] In step S29, the AR information notified by the communication unit 11 of the user terminal 1 is accepted and displayed on the output unit 18. This process is the same as in the first embodiment, and is also executed in a destination user terminal other than the user terminal 1. The notification and display of the AR information to a destination user terminal other than the user terminal 1 may be performed in a manner different from that of the user terminal 1. This will be described later after the description of this flowchart. The display on a terminal other than the user terminal 1 is terminated by an operation of the corresponding user.

[0075] Furthermore, in step S30, the user terminal 1 determines whether cleaning with the stick vacuum cleaner 2 has been completed. This is performed in the same manner as step S12 in the first embodiment, but may be performed by any of the vacuum cleaner identification unit 14, the operation status detection unit 15, or the AR information creation unit 16, or may be performed by other configurations. As a result, if cleaning has been completed, the process proceeds to step S31. If cleaning is continuing, the process of displaying AR information continues. In this case, the user terminal 1 also continues the processes of steps S2 and S14.

[0076] In addition, in step S31, the communication unit 11 sends an end notification indicating that cleaning has ended to the vacuum cleaner management device 3. Then, the display process in the output unit 18 ends. At this time, the processes in steps S2 and S14 also end.

[0077] In step S32, the communication unit 31 of the vacuum cleaner management device 3 receives the end notification, and in response, the AR information creation unit 34 ends creation of the AR information. Then, in step S33, the AR information creation unit 34 updates the vacuum cleaner management information 352 by recording the created AR information and the cleaning record (cleaned area) indicating the operation status.

[0078] Furthermore, in step S34, the AR information creation unit 34 notifies the end notification to the other user terminals of the provision destination other than the user terminal 1 using the communication unit 31. As a result, the display process at the other user terminals ends. This concludes the explanation of this flowchart, but notification and display (another aspect) of the AR information to the user terminals of the provision destination other than the user terminal 1 will be explained.

[0079] 9 are assumed to be the destinations. As described above, the user terminal 1-a is located in the same house as the user terminal 1, and is connected to the user terminal 1 and the vacuum cleaner management device 3 via the router 4. The user terminal 1-b is located in a different place (outside the house) from the user terminal 1, and is directly connected to the network 5.

[0080] First, the user terminal 1-a inside the house is notified and displayed as AR information is created, as is the case with the user terminal 1. This is called real-time processing. Moreover, when cleaning is completed, information showing the result is notified and displayed to the user terminal 1-b outside the house.

[0081] This concludes the description of the second embodiment, but according to the second embodiment, even for a vacuum cleaner without a communication function, the cleaning area presentation process is realized in cooperation with the vacuum cleaner management device 3 such as a server. Therefore, it is possible to utilize appropriate resources and realize efficient processing. EXAMPLES

[0082] Next, a third embodiment relating to the structure of the terminal holder 20 will be described. Fig. 14 is a diagram showing a side view of the stick vacuum cleaner 2 in the third embodiment when the terminal holder 20 is attached thereto. As also explained in Fig. 1, the stick vacuum cleaner 2 has a vacuum cleaner body 21 and a vacuum cleaner head 24, which are connected via an extension tube 23. The vacuum cleaner body 21 is provided with a handle 22 that is held by a user. The lower part of the vacuum cleaner body 21 has a tubular or annular connection part 211 for connecting to the extension tube 23. The stick vacuum cleaner 2 in the third embodiment has a communication function and other information processing functions, and may cooperate with a user terminal 1, a vacuum cleaner management device 3, etc.

[0083] Here, the terminal holder 20 is installed so as to be detachable from the vacuum cleaner body 21, more preferably from the connection part 211. For example, the terminal holder 20 is configured in a ring or tube shape, and is fixed via an adapter or the like that is wound around the connection part 211. The terminal holder 20 may be attached to a place other than the extension tube 23 or the connection part 211. Furthermore, when the extension tube 23 of the stick vacuum cleaner 2 is removed and a separate nozzle (tube) is provided for replacement, the terminal holder 20 may be connected to the nozzle. The separate nozzle is a nozzle that is shorter than the extension tube 23, and includes a nozzle with a brush and a tapered nozzle. It is also preferable that the separate nozzle has a cableless structure in which a cable for controlling the vacuum cleaner head 24 is omitted.

[0084] Next, Fig. 15 is an enlarged view of Fig. 14 showing the state in which the terminal holder 20 in the third embodiment is attached. In Fig. 15, the terminal holder 20 is fixed to the connection part 211 via the attachment part 200. At this time, it is desirable to arrange the holding part 20-1 of the terminal holder 20 so that it is at an angle of approximately 100° from the direction of the connection part 211 and the extension tube 23. However, this angle can be finely adjusted by moving the holding part 20-1 or the arm part 20-2 described later. This allows the image capturing part 12 of the user terminal 1 to capture an image of the cleaner head 24 and the floor surface to be cleaned.

[0085] Here, the terminal holder 20 has at least a holding part 20-1, an arm part 20-2 and a base 20-3, and is attached to the stick vacuum cleaner 2. This attachment is preferably performed via an attachment part 200 that the terminal holder 20 has.

[0086] First, the holding unit 20-1 holds the user terminal 1 in a fixed manner, for example by clamping it. The base 20-3 and the attachment unit 200 are connected, and the terminal holder 20 is fixedly attached to the stick vacuum cleaner 2. The arm unit 20-2 connects the holding unit 20-1 and the base 20-3. In the third embodiment, the base 20-3 or the terminal holder 20 and the attachment unit 200 are configured separately. However, these may be configured as an integrated unit, or may be configured as an integrated unit or separable unit. In other words, the terminal holder 20 in the third embodiment may be configured as the holding unit 20-1, the arm unit 20-2, and the base 20-3, or may be configured by adding the attachment unit 200 to these. This allows the terminal holder 20 to be shared by a plurality of vacuum cleaners, particularly vacuum cleaners with different specifications such as size. As described above, in the third embodiment, the terminal holder 20 having the holding unit 20-1 is detachably attached to the vacuum cleaner body of the stick vacuum cleaner 2.

[0087] Next, an example of the structure of the mounting portion 200 according to the third embodiment will be described with reference to Fig. 16 and Fig. 17. Fig. 16 is a diagram showing a first example of the mounting portion 200 according to the third embodiment. Here, Fig. 16 is a diagram seen from the AA direction shown in Fig. 14. The same applies to Fig. 17.

[0088] In Fig. 16, the lower part of the terminal holder 20 is connected to the mounting part 200. The mounting part 200 has an upper mounting part 200-1, a lower mounting part 200-2a, and a lower mounting part 200-2b, and its cross section is configured to be annular. Here, the lower mounting part 200-2a and the lower mounting part 200-2b move in the direction of the arrow (left and right) to sandwich the connection part 211 together with the upper mounting part 200-1. For this reason, the upper mounting part 200-1 and the lower mounting part 200-2a and the lower mounting part 200-2b are movably connected by pins.

[0089] The lower attachment portion 200-2a and the lower attachment portion 200-2b are fixedly connected with screws or nails, and a force is generated in the left direction in the figure. This causes the attachment portion 200 to tighten the connection portion 211. As a result, the terminal holder 20 connected to the attachment portion 200 is fixed to the connection portion 211.

[0090] Next, Fig. 17 is a diagram showing a second example of the mounting part 200 in the third embodiment. In Fig. 17 as well, the mounting part 200 is connected to the lower part of the terminal holder 20. This mounting part 200 has an upper mounting part 200-1, a lower mounting part 200-2a, and a lower mounting part 200-2b, and its cross section is configured to be annular. Here, the lower mounting part 200-2a and the lower mounting part 200-2b move in the direction of the arrow (left and right) to sandwich the connection part 211 together with the upper mounting part 200-1.

[0091] Here, the upper attachment part 200-1 is connected to the lower attachment part 200-2a and the lower attachment part 200-2b via a spring that generates a force in a tightening direction. In this way, the attachment part 200 tightens the connection part 211. As a result, the terminal holder 20 connected to the attachment part 200 is fixed to the connection part 211.

[0092] With the configuration of the third embodiment described above, the user terminal 1 can be fixedly held in the terminal holder 20. As a result, the user of the stick vacuum cleaner 2 can use the user terminal 1 and benefit from various information processing including information processing related to cleaning. EXAMPLES

[0093] Examples 4 and 5 are examples in which map information showing cleaning results is created and displayed (presentation process). Of these, in Example 4, the user terminal 1 creates the map information by itself. Note that the stick vacuum cleaner 2 and the terminal holder 20 in Examples 4 and 5 are the same as those in Examples 1 to 3, so their explanation will be omitted.

[0094] Fig. 18 is a functional block diagram of the user terminal 1 in the fourth embodiment. In Fig. 18, compared to Fig. 3, a map information creating unit 1001 and a coordinate detection unit 1002 are added, and the AR information creating unit 16 is omitted. However, the AR information creating unit 16 may also be provided in the fourth embodiment. In addition, layout information 193, tracking information 194, and map information 195 are stored in the storage unit 19. Since the other configurations are the same as those in the first embodiment, the following description will focus on the differences.

[0095] First, the map information creation unit 1001 creates map information showing a cleaned map using the cleaned area and the area to be cleaned. The cleaned area can use the movement history (coordinates) of the stick vacuum cleaner 2. The area to be cleaned can use layout information showing the layout of a house or office.

[0096] The coordinate detection unit 1002 may use a so-called gyro, GPS sensor or beacon receiver to detect the position of the stick vacuum cleaner 2. The coordinate detection unit 1002 may be omitted, and the position of the stick vacuum cleaner 2 may be specified using the detection result of the operation status detection unit 15. The layout information 193, tracking information 194 and map information 195 will be described later.

[0097] Next, an implementation example of the user terminal 1 in the fourth embodiment will be described. FIG. 19 is a hardware configuration diagram of the user terminal 1 in the fourth embodiment. In FIG. 19, compared to FIG. 4, a map information creation module 111 and a GPS sensor 112 are added, and the AR information creation module 110 is omitted. However, the AR information creation module 110 may also be provided in the fourth embodiment. In addition, layout information 193, tracking information 194, and map information 195 are stored in the storage device 106. Since other configurations are similar to those in the first embodiment, differences will be described below.

[0098] The map information creation module 111 is a function of the vacuum cleaner management program 107, and is an example of realizing the map information creation unit 1001. However, this may be realized as a program separate from the vacuum cleaner management program 107, or may be realized as a function of an integrated management application that also manages other home appliances. The GPS sensor 112 is an example of realizing the coordinate detection unit 1002 in Fig. 18, and can detect a position by latitude and longitude, which are an example of coordinates. Note that the GPS sensor 112 may be omitted, and the position of the stick vacuum cleaner 2 may be identified using the detection result of the operation status detection module 109.

[0099] Next, the layout information 193, the tracking information 194, and the map information 195 will be described. FIG. 20 is a diagram showing the layout information 193 used in the fourth embodiment. The layout information 193 is information showing the layout of a place of use where the stick vacuum cleaner 2 is used, such as a house or an office. For this reason, the layout information 193 has items of a user and a layout corresponding to the place of use. The user indicates a user of the stick vacuum cleaner 2 at the place of use, for example, a resident of the place. The user item can be omitted. The layout indicates the arrangement of sections such as the floor plan of the corresponding place of use. In the example of FIG. 20, the coordinates of each section (room) are shown, but the format is not limited. The above items are merely examples, and are not limited to these, and some of them can be omitted.

[0100] FIG. 21 is a diagram showing tracking information 194 used in Example 4. The tracking information 194 is information indicating the movement history of the stick vacuum cleaner 2. Therefore, the tracking information 194 has the items of date and time and coordinates of the corresponding stick vacuum cleaner 2. The date and time indicates the date and time of the movement, that is, the date and time when cleaning was performed by the stick vacuum cleaner 2. The coordinates indicate the history of movement when the corresponding vacuum cleaner is operating (cleaning) with those coordinates. The above items are merely examples and are not limited to these, and some of them may be omitted.

[0101] The map information 195 is information that indicates the state of cleaning and is created based on the layout information 193, the tracking information 194, and the operation status (trajectory) of the stick vacuum cleaner 2 detected by the operation status detection unit 15. The map information 195 will be described together with the processing flow.

[0102] Next, the map information presentation process in the fourth embodiment will be described. Fig. 22 is a flowchart showing the map information presentation process flow in the fourth embodiment. The configuration of the user terminal 1 will be described below using the configuration shown in Fig. 18. This process flow has some parts in common with the first embodiment, so the following description will focus on the differences.

[0103] First, steps S1 to S4 are the same as in the first embodiment. Then, if it is determined in step S4 that the device is usable, the process proceeds to step S101. If it is not usable, the process ends. Also, when the device is started in step S1, the coordinate detection unit 1002 starts detecting the coordinates of the stick vacuum cleaner 2.

[0104] Also, in step S101, the operating status detection unit 15 determines whether layout information 193 is stored in the storage unit 19. The determination may be made not only based on the presence or absence of layout information 193, but also based on whether there is layout information 193 including the position detected by the coordinate detection unit 1002. In this case, the layout information 193 includes the coordinates of the location of use. As a result, if there is layout information 193, the process proceeds to step S7. If there is no layout information 193, the process proceeds to step S102.

[0105] Furthermore, in step S102, the operational status detection unit 15 creates corresponding layout information 193 in accordance with the user's operation on the input unit 17, and stores the layout information 193 in the storage unit 19. Then, in step S7, the operational status detection unit 15 detects the operational status of the stick vacuum cleaner 2, similarly to the first embodiment.

[0106] In step S103, the operation status detection unit 15 updates the coordinates and date and time of the tracking information 194 based on the coordinates detected by the coordinate detection unit 1002. In step S104, the operation status detection unit 15 uses the captured image to determine whether the cleaner head 24 is floating above the floor surface. If the cleaner head 24 is floating, it becomes difficult to suck up dust on the floor surface, and it can be considered that cleaning is not being performed. For this reason, in the fourth embodiment, map information is created only when the cleaner head 24 is not floating.

[0107] As a result, if the cleaner head 24 is floating (floating), the process proceeds to step S105. If the cleaner head 24 is not floating (not floating), the process proceeds to step S106. Whether the cleaner head 24 is floating can be determined using well-known image processing techniques. This step may be omitted, and step S106 may be executed. Floating refers to the cleaner head 24 being away from the floor surface by a predetermined distance or more.

[0108] In step S105, the operation status detection unit 15 stops the detection in step S7 or step S103. Then, the determination in step S104 is repeated. Note that in this step, the detection itself may be continued and the operation status detection unit 15 may invalidate the result. This is done for this purpose.

[0109] In step S106, the map information creation unit 1001 creates map information 195 using the layout information 193, the tracking information 194, and the operating status (trajectory) detected in step S7. More specifically, the map information 195 is created by superimposing the tracking information 194 indicating the cleaning results and the operating status (trajectory) detected in step S7 on the layout information 193. In addition, the coordinates detected in step S103 are used as the tracking information 194. As a result, the map information 195 shows the state of cleaning of the cleaning target area such as a house.

[0110] Next, in step S107, the map information creation unit 1001 displays the created map information on the output unit 18. Here, the map information 195 and its display contents are shown in FIG. 23A and FIG. 23B. FIG. 23A is a diagram showing a first example of the map information 195 used in the fourth embodiment. In FIG. 23A, each floor plan is filled with a color according to the cleaning record (track). In FIG. 23A, the living / dining room (LD) is filled with black because it has been cleaned the most. The kitchen (K) and the master bedroom (MBR) are filled with the next darkest color because they have been cleaned the second most after the living / dining room. Furthermore, the children's rooms (BR) at both ends are cleaned less than the kitchen and the master bedroom, so they are displayed even lighter. And the hallway (HALL) and the like are not cleaned, so they are not filled. Here, the map information 195 is created by combining the above-mentioned coordinates and cleaning record (track) with the layout information 193, which is information that is not filled (does not include a track).

[0111] FIG. 23B is a diagram showing a second example of map information 195 used in the fourth embodiment. The map information 195 in FIG. 23B is created by combining the functions of the AR information creation unit 16 in the first embodiment. For this purpose, first, in the map information 195 in FIG. 23B, a color according to the cleaning record is superimposed on the image data for each unit section and displayed. This unit section is recorded as layout information 193. Then, using the functions of the AR information creation unit 16, when the user changes the orientation of the user terminal 1 (the photographing unit 12), the map information 195 is updated according to the change. For this reason, the user can more intuitively grasp the cleaning record. Note that such a display may be realized without using the AR information creation unit 16. That is, the cleaning record may be superimposed on the image data showing the state of the room. Furthermore, map information 195 including both FIG. 23A and FIG. 23B may be created and displayed. In this case, both may be displayed while switching between them, or may be displayed in parallel. Furthermore, the map information 195 may be displayed not only by filling in each unit section or room, but also as line information showing the trajectory of the stick vacuum cleaner 2.

[0112] Furthermore, in step S107, the same display as in the first embodiment may be performed, or this display may be performed by batch processing using map information 195 stored in storage unit 19 after cleaning is completed (step S12 or later). Furthermore, notification may be given appropriately each time (so-called real-time processing).

[0113] Similarly to the first embodiment, the end determination is performed in step S12, and if the cleaning is continuing, the process proceeds to step S103, whereas if the cleaning is completed, the process proceeds to step S108.

[0114] Then, in step S108, the map information creating unit 1001 executes the update process by storing the map information 195 created in step S106 in the storage unit 19. This ends the process of the fourth embodiment. In the fourth embodiment, the map information 195 is created and displayed, so that the user can intuitively understand the cleaning status. Moreover, the fourth embodiment can be combined with any of the first to third embodiments. Furthermore, the cleaning record (cleaned area) of the cleaner management information 192 may be used as the map information 195. In this case, the map information 195 can be omitted. EXAMPLES

[0115] Example 5 is an example in which map information showing the cleaning results of Example 4 is created and displayed (presentation process) in cooperation with a cleaner management device 3 which is realized by a server or the like. The stick cleaner 2 and the terminal holder 20 in Example 5 are the same as those in Examples 1 to 4. The user terminal 1 is also the same as that in Example 4. For this reason, the description thereof will be omitted below. However, at least one of the configurations and information for executing the functions common to the user terminal 1 and the cleaner management device 3 can be omitted.

[0116] Fig. 24 is a system configuration diagram of a vacuum cleaner management system in Example 5. In Fig. 24, compared to Fig. 9, a map information creation unit 36 ​​is added and the AR information creation unit 34 is omitted. However, the AR information creation unit 34 may also be provided in Example 5. In addition, layout information 353, tracking information 354, and map information 355 are stored in the storage unit 19. Since other configurations are similar to those in Example 2, the following description will focus on the differences.

[0117] First, the map information creating unit 36 ​​creates map information showing a cleaned map using the cleaned area and the area to be cleaned, similar to the map information creating unit 1001 of the fourth embodiment. The cleaned area can use the movement history (coordinates) of the stick vacuum cleaner 2. The area to be cleaned can use layout information showing the layout of a house or an office. The layout information 353, tracking information 354, and map information 355 will be described later.

[0118] Next, a hardware configuration as an implementation example of the vacuum cleaner management device 3 will be described. The vacuum cleaner management device 3 can be realized by a computer such as a server or a cloud system. FIG. 25 is a hardware configuration diagram of the vacuum cleaner management device 3 in the fifth embodiment. In FIG. 25, compared to FIG. 10, a map information creation module 309 is added and the AR information creation module 308 is omitted. However, the AR information creation module 308 may also be provided in the fifth embodiment. In addition, layout information 353, tracking information 354, and map information 355 are stored in the storage device 106. Since the other configurations are the same as those in the second embodiment, the differences will be described below.

[0119] The map information creation module 309 is a function of the vacuum cleaner management program 305 and an example of realizing the map information creation unit 36. However, this may be realized as a program separate from the vacuum cleaner management program 305, or may be realized as a function of an integrated management application that also manages other home appliances. Note that, in the fifth embodiment, the user terminal 1 also has a GPS sensor 112, which is an example of realizing the coordinate detection unit 1002. However, the GPS sensor 112 may be omitted, and the position of the stick vacuum cleaner 2 may be identified using the detection result of the operation status detection module 307.

[0120] Next, the layout information 353, tracking information 354, and map information 355 will be described. Fig. 26 is a diagram showing the layout information 353 used in the fifth embodiment. The layout information 353 has the same items as the layout information 193 in the fourth embodiment. However, the layout information 353 includes not only information about the stick vacuum cleaner 2, but also layout information (records) about other places of use. This is for managing multiple users with the vacuum cleaner management device 3.

[0121] FIG. 27 is a diagram showing tracking information 354 used in the fifth embodiment. The tracking information 354 has the same items as the tracking information 194 in the fourth embodiment. However, the tracking information 354 includes not only information about the stick vacuum cleaner 2, but also tracking information (records) about other vacuum cleaners used by the user. This is for managing multiple users with the vacuum cleaner management device 3. The map information 355 is the same information as the map information 195 in the fourth embodiment, and is shown in FIG. 23A and FIG. 23B. Similarly to the layout information 353 and the tracking information 354, the map information 355 is information about multiple vacuum cleaners.

[0122] Next, the map information presentation process in the fifth embodiment will be described. Fig. 28A and Fig. 28B are flowcharts showing the map information presentation process flow in the fifth embodiment. In the following, the configuration shown in Fig. 18 is used as the configuration of the user terminal 1, and the configuration shown in Fig. 19 is used as the configuration of the vacuum cleaner management device 3. This process flow has some parts in common with the second embodiment, so the following description will focus on the differences.

[0123] First, steps S1 to S19 are the same as in the second embodiment. However, when the activation is performed in step S1, the coordinate detection unit 1002 starts detecting the coordinates of the stick vacuum cleaner 2. Then, in step S14, the detected coordinates are also notified. Also, if it is determined in step S17 that the device is usable, the process proceeds to step S35.

[0124] Furthermore, in step S35, the operating status detection unit 33 determines whether layout information 353 including the position detected by the coordinate detection unit 1002 is stored in the storage unit 35. For this reason, the layout information 353 includes the coordinates of the location of use. As a result, if the layout information 353 exists, the process proceeds to step S26. If the layout information 353 does not exist, the process proceeds to step S36.

[0125] Furthermore, in step S36, the operation status detection unit 33 cooperates with the user terminal 1, that is, in accordance with the user's operation on the input unit 17 of the user terminal 1, to create the corresponding layout information 353 and store it in the storage unit 35. Then, in step S26, the operation status detection unit 33 detects the operation status of the stick vacuum cleaner 2, similar to the second embodiment.

[0126] In step S37, the operation status detection unit 33 updates the coordinates and date and time in the corresponding record in the tracking information 354 using the coordinates notified in step S14. In step S38, the operation status detection unit 33 uses the notified image to determine whether the cleaner head 24 is floating above the floor surface. This is executed in the same manner as in step S104 in the fourth embodiment. That is, in the fifth embodiment as well, map information is created only when the cleaner head 24 is not floating.

[0127] As a result, if it is floating (floating), the process proceeds to step S39. If it is not floating (not floating), the process proceeds to step S40. Note that whether the cleaner head 24 is floating can be determined using image processing technology, as in the fourth embodiment. Note that this step may be omitted, and processing may be performed to execute step S40.

[0128] In addition, in step S39, the operation status detection unit 33 stops step S26 and coordinate detection. In the fifth embodiment, in order to stop coordinate detection, the operation status detection unit 33 notifies the user terminal 1 of a stop command using the communication unit 31. Note that in this step, the detection itself may be continued, and the operation status detection unit 15 may invalidate this result. Then, the determination in step S38 is repeated.

[0129] Furthermore, in step S40, the map information creation unit 36 ​​creates map information 355 using the layout information 353, the tracking information 354, and the operating status (trajectory) detected in step S26. More specifically, the map information 355 is created by superimposing the tracking information 354 indicating the cleaning results and the operating status (trajectory) detected in step S26 on the layout information 353. Furthermore, the coordinates detected in step S37 are used as the tracking information 354. As a result, the map information 195 shows the state of cleaning of the cleaning target area such as a house.

[0130] Furthermore, in step S41, the map information creation unit 36 ​​uses the communication unit 31 to notify the user terminal 1 of the created map information 355. Then, in step S42, the output unit 18 of the user terminal 1 displays the map information 355. Here, the display content in this step is the same as in the fourth embodiment.

[0131] Also, steps S30 and S31 are executed in the same manner as in the second embodiment. Therefore, the communication unit 31 of the vacuum cleaner management device 3 receives an end notification from the user terminal 1. Then, in step S43, the map information creation unit 36 ​​of the vacuum cleaner management device 3 ends the creation of the map information 355. Then, in step S44, the map information creation unit 36 ​​executes the update process by storing the map information 355 created in step S40 in the memory unit 35. This ends the processing of the fifth embodiment.

[0132] In the fifth embodiment, the map information 355 is created and displayed in cooperation with the cleaner management device 3 such as a server, so that the user can intuitively grasp the state of cleaning, making effective use of resources. Moreover, the fifth embodiment can be combined with any of the first to fifth embodiments. In particular, the notification of the map information (step S41) may be performed on the user terminal of a related person other than the user. The AR information may also be notified to the core user terminal. Furthermore, the notification of the map information may be performed by batch processing using the map information 355 stored in the storage unit 35 after the cleaning is completed (step S31 or later), or may be notified appropriately each time (so-called real-time processing). Furthermore, the cleaning record (cleaned area) of the cleaner management information 352 may be used as the map information 355. In this case, the map information 355 can be omitted. [Explanation of symbols]

[0133] 1...user terminal, 11...communication unit, 12...photographing unit, 13...sound collection unit, 14...vacuum cleaner identification unit, 15...operation status detection unit, 16...AR information creation unit, 17...input unit, 18...output unit, 19...storage unit, 191...user management information, 192...vacuum cleaner management information, 193...layout information, 194...tracking information, 195...map information, 1001...map information creation unit, 1002...coordinate detection unit, 2...stick type vacuum cleaner, 20...terminal holder, 20-1...holding unit, 20-2...arm unit, 20-3...base, 21...vacuum cleaner main body, 2 2...Handle, 23...Extension tube, 24...Vacuum cleaner head, 25...Sign unit, 26...Charging stand, 27...Holder member, 28...Stand member, 29...Base member, 200...Mounting unit, 211...Connection unit, 3...Vacuum cleaner management device, 31...Communication unit, 32...Vacuum cleaner identification unit, 33...Operation status detection unit, 34...AR information creation unit, 35...Memory unit, 36...Map information creation unit, 351...User management information, 352...Vacuum cleaner management information, 353...Layout information, 354...Tracking information, 355...Map information, 4...Router, 5...Network 5

Claims

1. A user terminal is a computer that is used by a user of a vacuum cleaner that does not have a communication function and is attached to a terminal holder of the vacuum cleaner. a cleaner identification unit that determines whether the user terminal is available for use based on the identification information of the cleaner; an operating status detection unit that detects an operating status of the vacuum cleaner when the vacuum cleaner identification unit determines that the vacuum cleaner is usable; a map information creation unit that creates map information showing a cleaning status by using layout information showing an area to be cleaned by the vacuum cleaner, tracking information showing a movement history of the vacuum cleaner, and the operating status; a vacuum cleaner management program that functions as an output unit that outputs the map information;

2. 2. The vacuum cleaner management program according to claim 1, Furthermore, the user terminal has an image capturing unit that captures an image of at least a part of the vacuum cleaner, The vacuum cleaner identification unit is a vacuum cleaner management program that identifies the vacuum cleaner based on the image captured by the imaging unit.

3. 2. The vacuum cleaner management program according to claim 1, the operating status detection unit determines whether a cleaner head of the vacuum cleaner is floating based on whether the cleaner head is spaced apart from a floor surface by a predetermined distance or more; The map information creating section creates the map information when the cleaner head is not lifted.

4. 4. The vacuum cleaner management program according to claim 3, The operation status detection unit stops detecting the operation status when the cleaner head is lifted.

5. 2. The vacuum cleaner management program according to claim 1, Further, a cleaner identification unit is provided for determining whether the user terminal is available for use based on the identification information of the cleaner, The operating status detection unit detects the operating status of the vacuum cleaner when the vacuum cleaner identification unit determines that the vacuum cleaner is usable.

6. A vacuum cleaner management system is provided for a user of a vacuum cleaner having no communication function, the vacuum cleaner management system having a user terminal attached to a terminal holder of the vacuum cleaner and a vacuum cleaner management device, a cleaner identification unit that determines whether the user terminal is available for use based on the identification information of the cleaner; an operating status detection unit that detects an operating status of the vacuum cleaner when the vacuum cleaner identification unit determines that the vacuum cleaner is usable; a map information creation unit that creates map information showing a cleaning status by using layout information showing an area to be cleaned by the vacuum cleaner, tracking information showing a movement history of the vacuum cleaner, and the operating status; A vacuum cleaner management system having an output unit that outputs the map information.

7. The cleaner management system according to claim 6, Furthermore, the user terminal has an image capturing unit that captures an image of at least a part of the vacuum cleaner, The vacuum cleaner identification unit is a vacuum cleaner management system that identifies the vacuum cleaner based on an image captured by the imaging unit.

8. The cleaner management system according to claim 6, the operating status detection unit determines whether a cleaner head of the vacuum cleaner is floating based on whether the cleaner head is spaced apart from a floor surface by a predetermined distance or more; The map information creation unit creates the map information when the cleaner head is not surfaced.

9. The cleaner management system according to claim 8, The operation status detection unit stops detecting the operation status when the cleaner head is lifted.

10. The cleaner management system according to claim 6, Further, a cleaner identification unit is provided for determining whether the user terminal is available for use based on the identification information of the cleaner, The operating status detection unit detects the operating status of the vacuum cleaner when the vacuum cleaner identification unit determines that the vacuum cleaner is usable.

Images