Information processing system, information processing method, and program

Abstract

To provide an information processing system for accurately identifying each lying-down object person without increasing time and effort of a manager for managing the object person.SOLUTION: In an information processing system 10, a server 100 includes: an acquisition unit for acquiring person information that is information on each of a plurality of lying-down persons acquired from an image; a range setting unit for setting range information that is information on a range on an image surrounding each of the plurality of lying-down persons based on the person information; an association unit for associating the range information and identification information capable of identifying the person information of each of the lying-down person present in the range; and an identification information setting unit for setting the identification information associated with the range information on a predetermined range to the person information of the person lying down in the predetermined range after the person lying down in the predetermined range among the ranges on the image is not recognized to be lying down.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and a program.

Background Art

[0002] A system is disclosed that collects body posture data of multiple subjects during sleep and outputs the posture data in time series (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The sleep check system described in Patent Document 1 collects posture data indicating the body orientation by sensors attached to each of a plurality of subjects, and displays the time-series posture data of each of the plurality of subjects.

[0005] That is, in the sleep check system, in order to identify each subject by attaching a sensor to the subject and collect the posture data of each subject, there is a problem of increasing the labor of attaching a predetermined sensor to each subject. Furthermore, for example, when the subject is an active toddler, attaching a sensor to each subject is a great deal of work for the nursery teacher.

[0006] Therefore, the present invention provides an information processing system that accurately identifies each subject lying down without increasing the labor of an administrator who manages the subjects.

Means for Solving the Problems

[0007] An information processing system according to an aspect of the present invention includes an acquisition unit that acquires human information, which is information regarding each of a plurality of lying persons acquired from an image; a range setting unit that sets range information, which is information regarding a range on the image surrounding each of the plurality of lying persons, based on the human information; an association unit that associates the range information with identification information that can identify the human information of the lying persons existing in the range; and an identification information setting unit that sets the identification information associated with the range information regarding the predetermined range in the human information of the person who was lying in the predetermined range after the person lying in the predetermined range of the ranges on the image is no longer recognized as lying.

[0008] An information processing method according to an aspect of the present invention includes a computer acquiring human information, which is information regarding each of a plurality of lying persons acquired from an image; setting range information, which is information regarding a range on the image surrounding each of the plurality of lying persons, based on the human information; associating the range information with identification information that can identify the human information of the lying persons existing in the range; and setting the identification information associated with the range information regarding the predetermined range in the human information of the person who was lying in the predetermined range after the person lying in the predetermined range of the ranges on the image is no longer recognized as lying.

[0009] A program according to an aspect of the present invention causes a computer to acquire human information, which is information regarding each of a plurality of lying persons acquired from an image; set range information, which is information regarding a range on the image surrounding each of the plurality of lying persons, based on the human information; associate the range information with identification information that can identify the human information of the lying persons existing in the range; and set the identification information associated with the range information regarding the predetermined range in the human information of the person who was lying in the predetermined range after the person lying in the predetermined range of the ranges on the image is no longer recognized as lying.

Advantages of the Invention

[0010] According to the present invention, it is possible to provide an information processing system that accurately identifies each person lying down without increasing the burden on an administrator who manages the target persons.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0012] Embodiments of the present invention will be described with reference to the accompanying drawings. In each figure, those with the same reference numerals have the same or similar configurations.

[0013] ===Information Processing System 10=== <<Overview>> With reference to FIG. 1, the configuration of the information processing system 10 according to the first embodiment will be described. FIG. 1 is a diagram showing the configuration of the information processing system 10.

[0014] The information processing system 10 appropriately assigns identification information to each person lying down based on information (hereinafter referred to as "human information") regarding a plurality of people lying down obtained from, for example, an image.

[0015] Specifically, for example, the information processing system 10 sets identification information for a person lying down within a predetermined range on an image, and then sets the same identification information again for the person lying down within the said predetermined range. In other words, the information processing system 10 re-sets the same identification information as before for a person lying down shown in an image that has returned from outside one end and back to the same range as before. Until now, when a person who has moved outside one end of the image returns, new identification information has been set for that person, so the administrator has had to re-set the same identification information as before for that person each time. In contrast, in the information processing system 10, since the same identification information is automatically set for people lying down in the same range, the administrator's work of re-setting the identification information can be reduced.

[0016] A person lying down includes, for example, children sleeping (taking a nap) in a nursery, the elderly sleeping in a nursing home, and the like. Hereinafter, as an example, a person lying down will be described as a child sleeping in a nursery.

[0017] Human information is, for example, information indicating parts of a person's face such as the position of the eyes, information indicating joints such as hands and shoulders, information indicating the center of gravity and the center point, etc., obtained from an image. That is, human information is information that can be obtained from an image and can be any information that can determine that it is a person. Specifically, human information is preferably, for example, the coordinates of each part of the face, the coordinates of the joints, and the coordinates of the center of gravity and the center point.

[0018] In addition, the information processing system 10 has a function of recording, for example, the orientation of a child's body and its change over time in accordance with a predetermined format to be submitted to the local government. Hereinafter, as an example, the predetermined format will be described as the "nap chart" of the child. The "nap chart" will be described later.

[0019] The information processing system 10 can reduce the labor of nursery teachers because, for example, it automatically creates a nap chart that has hitherto been created manually by nursery teachers.

[0020] As shown in FIG. 1, the information processing system 10 includes, for example, a server 100, a management terminal 200, and a camera device 300, which are connected via a network N. The server 100 acquires various information from the management terminal 200 and the camera device 300 via the network N. Note that the number of the server 100, the management terminal 200, and the camera device 300 connected to the network N is not limited.

[0021] The network N means a communication network that provides a connection path so that the management terminal 200 can transmit and receive data after being connected to the server 100. One or more parts of the network N may be a wired network or a wireless network.

[0022] The server 100 is, for example, a device that appropriately generates a midday nap chart based on human information. The server 100 includes, by way of non-limiting example, a server computer, a personal computer (by way of non-limiting example, a desktop, a laptop, a tablet, etc.), a media computer platform (e.g., a cable, a satellite set-top box, a digital video recorder), a handheld computer device (e.g., a PDA (Personal Digital Assistant), an email client, etc.), or another type of computer, or a communication platform.

[0023] The management terminal 200 is, for example, a terminal operated by a nursery teacher who is an administrator. The management terminal 200 receives, for example, the operation input of the nursery teacher and causes the nap chart to be displayed on the display unit. The management terminal 200 may be any information processing device (computer) that can realize the functions described in each embodiment. The management terminal 200 includes, by way of example and not limitation, smartphones, mobile phones (feature phones), personal computers (e.g., desktops, laptops, tablets, etc.), media computer platforms (e.g., cable, satellite set-top boxes, digital video recorders), handheld computer devices (e.g., PDAs, email clients, etc.), wearable terminals (e.g., glasses-type devices, watch-type devices, etc.), other types of computers, or communication platforms.

[0024] The camera device 300 is installed, for example, inside the nursery and transmits images of the interior to the server 100 at any time. The camera device 300 may be any device having an imaging element (not shown) such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device), and a function of processing an image electrically acquired by the imaging element. Further, the camera device 300 has a function of recording the image and communicating with other devices.

[0025] <<Server 100>> Referring to FIG. 2, the functional configuration of the information processing system 10 will be described. FIG. 2 is a configuration diagram showing an example of the functional configuration of various devices constituting the information processing system 10.

[0026] As shown in FIG. 2, the server 100 includes, for example, functional units such as a storage unit 110, an acquisition unit 120, an inference unit 130, a first identification information setting unit 140, a range setting unit 150, a related unit 160, a second identification information setting unit 180, and a display processing unit 190.

[0027] The storage unit 110 includes, for example, related information D111 and posture information D112. The information stored in the storage unit 110 is, for example, information acquired from each of the functional units described later.

[0028] Referring to FIG. 3, the related information D111 will be described. FIG. 3 is a diagram showing the related information D111. As shown in FIG. 3, the related information D111 may include, for example, items of [child ID], [personal information], [unique range], and [name]. The [child ID] stores a child ID that can uniquely identify each child reflected in the image. The [personal information] stores the coordinates of the personal information acquired at a predetermined time interval, and at least the coordinates of the current personal information. For example, the coordinates of the personal information stored in the [personal information] may be additionally stored at a predetermined time interval together with the time (for example, the time of day). The [unique range] stores, for example, four coordinates that can form a unique range (for example, the coordinates of the four corners of the unique range). For example, when the unique range is circular, the [unique range] may store the coordinates of the center of the circle and the radius. The [name] stores the name of the child.

[0029] Referring to FIG. 4, the posture information D112 will be described. FIG. 4 is a diagram showing the posture information D112. As shown in FIG. 4, the posture information D112 may include, for example, items of [child ID], [name], and [posture]. The [child ID] and [name] have the same content as the [child ID] and [name] of the related information D111 and are respectively associated therewith. The [posture] stores, for example, the time and information regarding the orientation of the child's body at each time (hereinafter referred to as "posture information").

[0030] The acquisition unit 120 acquires various information from other devices, for example. The acquisition unit 120 acquires information transmitted from the management terminal 200 based on, for example, an operation input by a nursery teacher. The acquisition unit 120 also acquires an image showing a sleeping child from the camera device 300.

[0031] The inference unit 130 generates human information of the child in the garden based on, for example, an image showing a sleeping child in the garden. Specifically, the inference unit 130 generates coordinates on the image corresponding to a plurality of locations such as parts of the face and joints of the child shown in the image. Further, the inference unit 130 may specify coordinates on the image indicating the center of gravity and the center point of the child based on the coordinates of, for example, parts of the face and joints of the child shown in the image. The center point is, for example, the coordinates that are the center of the coordinates of the parts of the face and joints of the child and are statistically derived from the center of gravity.

[0032] The inference unit 130 specifies the body orientation of the lying person based on, for example, the human information. Specifically, when the face of the child shown in the image cannot be detected, the inference unit 130 specifies that the body orientation of the child is downward (lying face down). Further, the inference unit 130 may detect facial parts (which may be joints) of the child from the image and specify the body orientation of the child based on the coordinates of each facial part such as the nose, eyes, ears, and mouth. For example, when the right eye and the left eye cannot be seen in the image (for example, when the coordinates on the image corresponding to the right eye and the left eye are not detected), the inference unit 130 may determine that the child is lying face down. Further, the inference unit 130 may determine the body orientation of the child from the scores of each facial part. Note that the method for specifying the body orientation of the lying person in the inference unit 130 is not limited to the above.

[0033] The inference unit 130 associates the human information and the posture information regarding the specified body orientation of the person with the identification information set in the human information described later and stores them in the related information D111 and the posture information D112 of the storage unit 110.

[0034] Note that the inference unit 130 may include a learned model trained to output human information based on, for example, an image showing a lying person. Further, the inference unit 130 may include a learned model trained to specify the body orientation of a lying person based on, for example, the human information.

[0035] Although an example in which the inference unit 130 generates human information has been described, the mode in which human information is generated is not limited to this. For example, the server 100 may acquire human information generated by another device such as the management terminal 200 from the other device.

[0036] In addition, although an example in which the inference unit 130 is a functional unit of the server 100 has been described, the mode of the inference unit 130 is not limited to this. For example, the inference unit 130 may be a functional unit realized by a device different from the server 100. In this case, the server 100 acquires human information and information regarding the body orientation from the different device.

[0037] The first identification information setting unit 140 sets, for example, identification information for identifying a person lying down corresponding to the human information specified by the inference unit 130 in the human information. The first identification information setting unit 140 stores the identification information in the related information D111 of the storage unit 110. Note that the first identification information setting unit 140 may, for example, install identification information on the person lying down and specify the body orientation of the person lying down based on the human information instead of the inference unit 130.

[0038] The range setting unit 150 sets, for example, information (hereinafter referred to as "range information") regarding a range (hereinafter referred to as "unique range") on an image surrounding each of a plurality of people lying down based on the human information.

[0039] The unique range is, for example, a range surrounding a person lying down in the image and is a range formed by virtual lines on software. The unique range may have, for example, a preset area occupied on the image. Specifically, the unique range may be set to indicate, for example, an area slightly larger than the area of a spread-out futon. The unique range is a polygonal or circular range formed by virtual lines, and is preferably a rectangular range, for example.

[0040] Range information is, for example, information that can form a specific range with virtual lines. Specifically, the range information is, for example, information indicating the coordinates on the image at the four corners of the specific range. Also, the range information may be, for example, information indicating the coordinates of a plurality of points for virtually forming the specific range. Further, the range information may be, for example, information indicating a specific range in which the space above the plane of the head and the space below the plane of the feet of a lying person each satisfy a predetermined criterion.

[0041] Hereinafter, as an example, it will be described that four coordinates indicated by range information are virtually connected to virtually set a rectangular specific range. Hereinafter, when simply referring to the "specific range", it means a range that can be virtually set based on the range information. Also, hereinafter, when referring to "existing within the specific range", it means that the coordinates indicating the position of the object exist at the coordinates corresponding to within the specific range.

[0042] That is, the range setting unit 150 can set the coordinates of the four corners that can form a virtual specific range surrounding each lying person, for example, based on the coordinates of the center point of each lying person.

[0043] Also, the range setting unit 150 may set the range information so that the specific range is fixed on the image, for example. Thereby, since the information processing system 10 can set a fixed specific range for the kindergarten child, the identification information can be reset in the second identification information setting unit 180 described later.

[0044] Specifically, the range setting unit 150 may fix and set the specific range based on the human information at that time, for example, when the identification information is set in the human information in the first identification information setting unit 140.

[0045] Further, for example, at the timing when a person lying within a predetermined specific range is no longer recognized as lying down, the range setting unit 150 may set a predetermined specific range so as to be fixed on the image based on the personal information of the person lying within the predetermined specific range at that timing. Thereby, since the information processing system 10 can set a specific range at an appropriate position for a person (such as a nursery child) who is active while sleeping, the identification information can be accurately reset in the second identification information setting unit 180 described later.

[0046] Specifically, when a person lying within a specific range is no longer recognized as lying down, the range setting unit 150 sets a specific range fixed at a predetermined position on the image. The case where a person is no longer recognized as lying down includes cases where a person who was lying within the specific range stands up, a person who was lying within the specific range goes outside the specific range, or a person who was lying within the specific range is hidden by another person on the image.

[0047] Note that, for example, the range setting unit 150 may set the specific range in a fixed manner until an administrator starts and finishes creating a nap chart for nursery children. In this regard, the range setting unit 150 may set the specific range in a fixed manner at a time preset by an administrator, for example, during the nap time of nursery children (for example, from 13:00 to 15:00).

[0048] Further, for example, until a person lying within a specific range is no longer recognized as lying down, the range setting unit 150 may set the specific range so as to move according to the movement of the person lying down. Thereby, since the information processing system 10 can set a specific range at an appropriate position for a person (such as a nursery child) who is active while sleeping, the identification information can be accurately reset in the second identification information setting unit 180 described later.

[0049] Specifically, for example, the range setting unit 150 compares the position indicated by the human information (e.g., the center point) at the first time with the position indicated by the human information at the second time, which is later than the first time, and determines whether there is a change in the position exceeding a predetermined threshold. When it is determined that there is a change in the position exceeding the predetermined threshold, the range setting unit 150 sets a specific range based on the human information at the second time. Alternatively, the range setting unit 150 may set a specific range based on the human information acquired at a predetermined time interval.

[0050] For example, the association unit 160 associates a specific range (range information) with the identification information set for the person lying down within the specific range in the first identification information setting unit 140. Note that the association unit 160 may associate a predetermined unique identification code or an identification code attached to the futon on which the child sleeps with the specific range.

[0051] Specifically, for example, the association unit 160 associates the coordinates of the four corners in the specific range with the identification information set for the person lying down and stores them in the association information D111 in the storage unit 110.

[0052] In addition, for example, the association unit 160 associates information about the name of the child acquired from the management terminal 200 based on an operation input by the administrator to the management terminal 200 (hereinafter referred to as "name information") with the identification information of the person lying down and stores it in the association information D111. Thereby, the identification information, the range information, and the name information of the child are associated with each other.

[0053] For example, the determination unit 170 determines whether a newly detected child (human information) in the image is lying down within a specific range that has already been set.

[0054] Specifically, when the coordinates of the position where the child is lying down (e.g., the coordinates indicated by the human information generated by the inference unit 130) are within the specific range indicated by the range information, the determination unit 170 determines that the child is lying down within the already set specific range.

[0055] Further, the determination unit 170 may, for example, determine whether name information is associated with all the children (human information) in the image. As a result, the information processing system 10 can quickly notify the administrator that there is a child without a set name, so that a napping chart without information leakage can be generated.

[0056] Specifically, when the determination unit 170 refers to the associated information D111 and name information (for example, "Child A") is stored in the "Name" item corresponding to the child ID (for example, "01") in the "Child ID" item, it determines that name information is associated with the child.

[0057] The second identification information setting unit 180, for example, after a person lying down in a predetermined specific range on the image is no longer recognized as lying down, sets the identification information associated with the specific range (range information) in the human information of the person who has lain down in the specific range.

[0058] Specifically, after the four corner coordinates of the specific range and the identification information (for example, "01") are associated in the association unit 160, when the child stands up and the association between the human information and the specific range is released and then the child returns, and the determination unit 170 determines that the child is lying down in the specific range, the identification information (here, "01") initially associated with the human information of the child is set.

[0059] Note that the second identification information setting unit 180 may, for example, maintain (set) the identification information set by the first identification information setting unit 140 in the human information of the child when the child has not exited a predetermined specific range at all after the association in the association unit 160.

[0060] Here, the advantageous effects compared with the conventional technology in the information processing system 10 provided with the above functional units will be described.

[0061] Previously, when a child left and then returned to the image (or when the child reappeared after temporarily disappearing from the image), there was a problem that identification information different from the initially set identification information was set in the personal information of the child. Therefore, it was necessary for the administrator (e.g., a nursery teacher) to manually reset the initial identification information (or name information) for the child, which reduced the work efficiency of the administrator.

[0062] In contrast, in the information processing system 10, for example, when a child returns to the same futon (specific range) after leaving the image, the same identification information and name information as the initially set identification information and name information can be set in the personal information of the child. This can be achieved because in the related unit 160, the specific range (range information) is associated with the identification information and name information set for the child. As a result, even if the child temporarily becomes invisible from the image, it is not necessary for the administrator (e.g., a nursery teacher) to manually reset the identification information for the child. Therefore, the work efficiency of the administrator is improved.

[0063] The display processing unit 190 displays, for example, various information generated by each of the above-described functional units, together with the image acquired from the camera device 300, on the display unit of the management terminal 200.

[0064] With reference to FIGS. 5 and 6, an example of a screen generated by the display processing unit 190 will be described. FIG. 5 is an example of a screen T1 showing a child lying down in a room. FIG. 6 is an example of a screen T2 showing a midday nap chart. Note that in FIG. 5, although a dashed line is represented on the screen, it may not actually appear on the actual screen. Hereinafter, it will be described as not being represented on the screen as an example.

[0065] The display processing unit 190 generates, for example, a screen T1 showing the state of the room where the child is lying down and a screen T2 showing a midday nap chart.

[0066] As shown in FIG. 5, the screen T1 includes, for example, reference objects G1 to G3, name objects N1 to N3, and notification object W.

[0067] The reference objects G1 to G3 indicate, for example, the center of gravity or the center point of each of the children E1 to E3 (human information). The reference objects G1 to G3 serve as a reference for setting the specific range. Note that the reference objects G1 to G3 are not limited to objects indicating the center of gravity or the center point, and may be objects indicating a plurality of points such as facial parts and joints.

[0068] The name objects N1 to N3 indicate, for example, the names of the children E1 to E3. Each of the name objects N1 to N3 is an object displayed near the corresponding reference objects G1 to G3 (coordinates of human information) based on the related information D111.

[0069] The notification object W is an object indicating, for example, that name information is not associated with a person lying down in the specific range. When the display processing unit 190 refers to the related information D111 and determines that no name is set in the name item corresponding to the child ID, the notification object W is displayed near the reference object corresponding to the child ID. The notification object W may be, for example, a question mark or a caution mark as long as it allows the administrator to visually understand that no name is set for the child. By displaying the notification object W to the administrator, the information processing system 10 can suppress work mistakes by the administrator. As a result, a napping chart with appropriate names set for the children is automatically created.

[0070] As shown in FIG. 6, the screen T2 includes, for example, a recording date and time display area T21, a name display area T22, a sleeping posture display area T23, and a caregiver display area T24. The recording date and time display area T21 is an area for displaying the recording date and time, for example. The name display area T22 is an area for displaying name information (the name of the child) corresponding to the child ID of the posture information D112 based on the related information D111, for example. The sleeping posture display area T23 is an area for displaying an object (for example, an arrow) corresponding to information indicating the orientation of each child's body based on the posture information D112, for example. The caregiver display area T24 is an area for displaying the name of the caregiver in charge of recording the sleeping posture of the child at a predetermined time, for example.

[0071] Note that at least a part of the functional units in the server 100 may or may not be realized by one or more computers (for example, cloud computing composed of one or more computers). Also, the functional configuration shown in FIG. 2 is an example, and the server 100 may have a configuration other than these, or may not have some of these configurations. Further, some functions of the server 100 may be realized by the management terminal 200 or the camera device 300.

[0072] <<Modification Example>> The determination unit 170 may determine, for example, whether the posture information satisfies a predetermined condition. When the posture information satisfies the predetermined condition, the determination unit 170 may generate alarm information indicating a predetermined alarm. The predetermined condition is, for example, a condition that the prone state continues for a predetermined time. The determination unit 170 may generate, for example, voice information as the alarm information, or may generate a warning object displayed on the screen. The server 100 transmits the generated alarm information to the management terminal 200. Thereby, the information processing system 10 can promptly notify the caregiver of the abnormal posture of the child, so that an accident can be prevented.

[0073] <<Management Terminal 200>> Returning to FIG. 2, the functional configuration of the management terminal 200 will be described. The management terminal 200 causes, for example, various information acquired from the server 100 to be displayed on the display unit 220. The management terminal 200 includes, for example, functional units such as an acquisition unit 210, a display unit 220, and a transmission unit 230. The acquisition unit 210 acquires various information transmitted from the server 100, for example. The display unit 220 displays various screens transmitted from the server 100, for example. Here, the management terminal 200 causes the display unit 220 to display a name input screen (not shown) for accepting input of the name of a child. The name input screen includes, for example, an input area for inputting the name of the child and a confirmation button for confirming the input content. The transmission unit 230 transmits various information (for example, name information) generated based on an operation input by the administrator to the server 100, for example. Here, when the confirmation button on the name input screen is pressed, the management terminal 200 transmits the name information of the child to the server 100, for example.

[0074] <Camera device 300> Referring to FIG. 2, the functional configuration of the camera device 300 will be described. The camera device 300 includes, for example, a control unit 310 and a transmission unit 320. The control unit 310 includes a function of capturing a moving image and a function of controlling ON / OFF of the capturing. The transmission unit 320 transmits the captured image by, for example, wired or wireless communication.

[0075] <<Processing procedure>> Referring to FIG. 7, the processing procedure of the information processing system 10 will be described. FIG. 7 is a flowchart showing the processing procedure of the information processing system 10. In FIG. 7, as an example, a processing flow in a situation where Mr. A, Mr. B, and Mr. C are taking a nap, Mr. D enters the room late and starts taking a nap on the way, and then Mr. A returns after leaving the room is shown. Hereinafter, the description will be made with appropriate reference to FIGS. 5 and 6.

[0076] First, in step S100, the camera device 300 continuously transmits images to the server 100, for example.

[0077] In step S101, the server 100 generates, for example, human information (such as the coordinates of eyes and the center of gravity) about a lying-down child based on an image. As shown in FIG. 5, the human information may be displayed on the screen as reference objects G1 to G3.

[0078] In step S102, the server 100 sets, for example, identification information (the "child ID" in the related information D111) in the human information.

[0079] In step S103, the server 100 sets, for example, a specific range (the "specific range" in the related information D111) based on the human information. At this time, the server 100 sets, for example, so that the position of the specific range is fixed.

[0080] In step S104, the server 100 associates the identification information with the specific range and stores it in the related information D111 in the storage unit 110. The specific range is, for example, the coordinates shown in the "specific range" item in FIG. 3. Although not displayed on the screen as shown in FIG. 5, it can virtually form a range surrounding the child (the dashed line in FIG. 5). Thereby, when a child who enters the virtual specific range returns after going out of the screen, the server 100 can assign the same identification information.

[0081] In step S105, the management terminal 200 transmits, for example, name information indicating names such as "Child A", "Child B", and "Child C" for each child, which is generated based on an operation input by the administrator, to the server 100.

[0082] In step S106, the server 100 associates the name information with the identification information and stores it in the related information D111 in the storage unit 110. As shown in FIG. 5, the name information is displayed on the screen as name objects N1 to N3. Also, as shown in FIG. 6, the name information is displayed in the name display area T22 as the name of the child.

[0083] In step S107, the server 100 determines whether names are set for all the children lying down on the screen.

[0084] When it is determined that the name is not set (step S107: NO), the server 100 transmits a notification screen including the notification object W to the management terminal 200.

[0085] In step S108, the management terminal 200 causes the notification screen to be displayed on the display unit. The management terminal 200 receives an operation input regarding the name information by the administrator. In this case, the information processing system 10 repeats the process from step S105.

[0086] In step 109, when it is determined that the name is set (step S107: YES), the server 100 records the posture information of each child. Note that the server 100 may start recording the posture information of each child when setting the identification information for each child in step S102.

[0087] In step S110, when a newly lying-down child (human information) is detected in the image, the server 100 determines whether the child has lain down within an existing specific range.

[0088] When it is determined that the child (here, child D) has not lain down within the existing specific range (step S110: NO), the server 100 proceeds to step S102. In this case, after executing step S104, for example, the server 100 transmits a screen (the screen in FIG. 5) with the notification object W attached to the newly lying-down child to the management terminal 200.

[0089] In step S111, when it is determined that the child (here, child A) has lain down within the existing specific range (step S110: YES), the server 100 refers to the related information D111 and sets the identification information (here, child ID "01") and the name information (here, name "A-kun") associated with the range information of the existing specific range for the child (here, child A).

[0090] As a result, the server 100 can set the same identification information (and name information) as the identification information before the child left the screen even for a child who has left the screen (or a child who has been hidden by something on the screen once). Therefore, the information processing system 10 can automatically reset the identification information and name information without having the administrator reset the identification information and name information.

[0091] In step S110, when a newly lying-down child is detected in the image, new identification information may be set for the child once, regardless of whether the child is lying down within the existing specific range. Even in this case, in step S111, the identification information and name information associated with the range information of the existing specific range are set for the child.

[0092] In step S112, the server 100 generates a naptime chart shown in FIG. 6 based on the associated information D111 and the posture information D112. The server 100 transmits information indicating the naptime chart to the management terminal 200. Note that the information indicating the naptime chart may be, for example, code for causing a browser to display an image.

[0093] In step D113, the management terminal 200 displays the naptime chart on the display unit. The management terminal 200 may print and output the naptime chart based on an operation input by the administrator.

[0094] Note that the server 100 may transmit the screens shown in FIGS. 5 and 6 to the administrator terminal 200 at any time after step S102. Thereby, the administrator can check the identification result of the sleeping posture of the infant at any time on the display unit.

[0095] ===Hardware Configuration=== With reference to FIG. 8, an example of the hardware configuration when the server 100, the management terminal 200, and the camera device 300 are realized by a computer 1000 will be described. Note that various functions of the server 100, the management terminal 200, and the camera device 300 can be realized by dividing them among a plurality of devices.

[0096] FIG. 8 is a diagram showing an example of the hardware configuration of a computer. As shown in FIG. 8, the computer 1000 includes, for example, a processor 1001, a memory 1002, a storage device 1003, an input I / F unit 1004, a data I / F unit 1005, a communication I / F unit 1006, and a display unit 1007.

[0097] The processor 1001 is a control unit that controls various processes in the computer 1000 by executing programs stored in the memory 1002.

[0098] The memory 1002 is a storage medium such as a RAM (Random Access Memory). The memory 1002 temporarily stores program codes of programs executed by the processor 1001 and data required during program execution.

[0099] The storage device 1003 is a non-volatile storage medium such as a hard disk drive (HDD) or a flash memory. The storage device 1003 stores an operating system and various programs for realizing the above-described components.

[0100] The input I / F unit 1004 is a device for receiving inputs from a user. Specific examples of the input I / F unit 1004 include a keyboard, a mouse, a touch panel, various sensors, wearable devices, and the like. The input I / F unit 1004 may be connected to the computer 1000 via an interface such as USB (Universal Serial Bus).

[0101] The data I / F unit 1005 is a device for inputting data from the outside of the computer 1000. Specific examples of the data I / F unit 1005 include drive devices for reading data stored in various storage media. The data I / F unit 1005 may be provided outside the computer 1000. In that case, the data I / F unit 1005 is connected to the computer 1000 via an interface such as USB.

[0102] The communication I / F unit 1006 is a device for performing data communication via the Internet N, either wired or wirelessly, with a device external to the computer 1000. It is conceivable that the communication I / F unit 1006 is provided outside the computer 1000. In that case, the communication I / F unit 1006 is connected to the computer 1000 via an interface such as USB, for example.

[0103] The display unit 1007 is a device for displaying various kinds of information. Specific examples of the display unit 1007 include, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, a display of a wearable device, and the like. The display unit 1007 may be provided outside the computer 1000. In that case, the display unit 1007 is connected to the computer 1000 via a display cable or the like, for example. Also, when a touch panel is adopted as the input I / F unit 1004, the display unit 1007 can be configured integrally with the input I / F unit 1004.

[0104] ===Summary=== The information processing system 10 includes an acquisition unit 120 that acquires human information, which is information regarding each of a plurality of lying persons obtained from an image; a range setting unit 150 that sets range information, which is information regarding a specific range (area) on the image surrounding each of the plurality of lying persons, based on the human information; a correlation unit 160 that correlates the range information with identification information that can identify the human information of the lying persons existing in the specific range (area); and a second identification information setting unit 180 (identification information setting unit) that sets, in the human information of the person lying in a predetermined specific range (area), the identification information associated with the range information regarding the predetermined specific range (area) after a person lying in the predetermined specific range (area) is no longer recognized as lying. Thereby, the information processing system 10 can accurately identify each of the target persons lying with a simple system configuration. Further, even if a child temporarily disappears from the image, the administrator (e.g., a nursery teacher) does not need to manually reset the identification information for the child, improving the work efficiency of the administrator.

[0105] Further, the range setting unit 150 of the information processing system 10 sets the range information so that the specific range (area) is fixed on the image based on the human information. Thereby, the information processing system 10 can set a specific fixed range for the child, and thus can appropriately reset the identification information.

[0106] Further, the range setting unit 150 of the information processing system 10 sets the range information so that the predetermined specific range (area) is fixed on the image based on the position indicated by the human information of the person lying in the predetermined specific range (area) at the timing when the person lying in the predetermined specific range (area) is no longer recognized as lying. Thereby, the information processing system 10 can set the specific range at an appropriate position for a person who is active when lying, such as a child, and thus can more accurately reset the identification information.

[0107] In addition, the acquisition unit 120 of the information processing system 10 acquires name information, which is information indicating the name of a person lying down within a predetermined specific range (range) set based on a user's operation input, and the association unit 160 associates the identification information with the name information. Further, the information processing system 10 further includes a display processing unit 190 that causes the display unit to display the name information associated with the identification information in association with a person lying down within a predetermined specific range (range). Thereby, the information processing system 10 can automatically reset the names of the kindergarten children.

[0108] In addition, when the identification information and the name information are not associated with each other in the association unit 160, the display processing unit 190 of the information processing system 10 causes a notification object W (object) indicating that the name information is not associated with a person lying down within a predetermined specific range (range) to be displayed on, for example, the display unit of the management terminal 200. Thereby, the information processing system 10 can quickly notify the administrator that there is a kindergarten child without a set name, so that a napping chart without information leakage can be generated.

[0109] In addition, the acquisition unit 120 of the information processing system 10 acquires information regarding the direction in which a person lying down within a specific range (range) is facing, which is specified based on the personal information of the person lying down within a predetermined specific range (range), and the display processing unit 190 associates the name information with the direction in which the person lying down within the specific range (range) is facing and causes it to be displayed on, for example, the display unit of the management terminal 200. Thereby, the information processing system 10 can automatically generate an accurate napping chart with identification information and names set, thereby improving the work efficiency of the administrator.

[0110] The embodiments described above are for facilitating the understanding of the present invention and are not for limiting and interpreting the present invention. Each element included in the embodiments, as well as their arrangement, materials, conditions, shapes, sizes, etc. are not limited to those exemplified and can be changed as appropriate. Also, it is possible to partially replace or combine the configurations shown in different embodiments.

Explanation of Reference Numerals

[0111] 10... Information processing system, 100... Server, 110... Storage unit, 120... Acquisition unit, 130... Inference unit, 140... First identification information setting unit, 150... Range setting unit, 160... Related unit, 170... Judgment unit, 180... Second identification information setting unit, 190... Display processing unit, 200... Management terminal, 300... Camera device.

Claims

1. An acquisition unit that acquires human information, which is information about each of a plurality of lying people obtained from an image; A range setting unit that sets range information, which is information about a range on the image surrounding each of the plurality of lying people, based on the human information; An association unit that associates the range information with identification information that can identify the human information of the lying people existing in the range; An identification information setting unit that, after a person lying in a predetermined range on the image is no longer recognized as lying, sets the identification information associated with the range information regarding the predetermined range in the human information of the person who was lying in the predetermined range; An information processing system including the above.

2. The range setting unit sets the range information so that the range is fixed on the image based on the human information. The information processing system according to claim 1.

3. At the timing when a person lying in the predetermined range is no longer recognized as lying, the range setting unit sets the range information so that the predetermined range is fixed on the image based on the position indicated by the human information of the person lying in the predetermined range at that timing. The information processing system according to claim 1.

4. The acquisition unit acquires name information, which is information indicating the name of a person lying in the predetermined range, set based on a user's operation input. The association unit associates the identification information with the name information. The information processing system further includes a display processing unit that causes the display unit to display the name information associated with the identification information in association with the person lying in the predetermined range. The information processing system according to any one of claims 1 to 3.

5. When the identification information and the name information are not associated in the association unit, the display processing unit causes the display unit to display an object indicating that the name information is not associated with the person lying within the predetermined range. The information processing system according to claim 4.

6. The acquisition unit acquires information regarding the direction in which a person lying in the predetermined range is facing, specified based on the human information of the person lying in the predetermined range. The display processing unit causes the display unit to display the name information in association with the direction in which the person lying in the predetermined range is facing. The information processing system according to claim 5.

7. A computer Obtaining human information, which is information regarding each of a plurality of lying people obtained from an image; Based on the human information, setting range information, which is information regarding a range on the image surrounding each of the plurality of lying people; Associating the range information with identification information that can identify the human information of the lying people existing in the range; After a person lying in a predetermined range among the ranges on the image is no longer recognized as lying, setting the identification information associated with the range information regarding the predetermined range in the human information of the person who was lying in the predetermined range; An information processing method for executing the above.

8. Causing a computer to: Obtain human information, which is information regarding each of a plurality of lying people obtained from an image; Based on the human information, set range information, which is information regarding a range on the image surrounding each of the plurality of lying people; Associate the range information with identification information that can identify the human information of the lying people existing in the range; After a person lying in a predetermined range among the ranges on the image is no longer recognized as lying, set the identification information associated with the range information regarding the predetermined range in the human information of the person who was lying in the predetermined range; A program for causing the above to be executed.

Images