Information display system, information processing device, and information display method

The information display system addresses the limitation of existing presence detection by using sensors and display devices to notify others of a person's status, improving awareness of their condition and collaboration possibilities.

JP7727934B2Active Publication Date: 2025-08-22PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2021108510
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-06-30
Publication Date
2025-08-22
Estimated Expiration
2041-06-30

AI Technical Summary

Technical Problem

Existing systems only determine the presence of a person in a room but fail to effectively notify others of the person's condition, such as whether they are working alone or collaborating via a communication network.

Method used

An information display system comprising an information processing device that acquires human information through various sensors and a display device on fixtures to notify others of a person's status, using cameras, microphones, wearable devices, and mobile terminals to gather data and display relevant information.

Benefits of technology

Effectively informs those around the person of their condition, enhancing communication and collaboration awareness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007727934000001
    Figure 0007727934000001
  • Figure 0007727934000002
    Figure 0007727934000002
  • Figure 0007727934000003
    Figure 0007727934000003
Patent Text Reader

Abstract

To provide an information display system capable of effectively informing the surroundings of a person's condition.SOLUTION: An information display system 1 includes: an information processing unit 200 that includes a human information acquisition unit for acquiring human information representing the state of a person 30 who is close to a fixture 20; and a display unit 300 that is provided to the fixture 20 to display the human information to notify the surroundings of the status of the person 30.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information display system and an information display method. [Background technology]

[0002] Patent Document 1 discloses a human presence determination system that determines whether or not a person is in a room. The human presence determination system disclosed in Patent Document 1 includes a sensor that is installed in the room and detects changes in the situation in the room, a determination means that determines the presence or absence of a person based on changes in the situation sensed by the sensor, and a display means that displays the usage status of the room. The display means is located on the door of the room. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-74977 Summary of the Invention [Problem to be solved by the invention]

[0004] It is desirable to not only know whether or not a person is in a room, but also to effectively notify those around of the person's condition.

[0005] An object of the present invention is to provide an information display system and an information display method that can effectively notify people around a person of their condition. [Means for solving the problem]

[0006] An information display system according to one aspect of the present invention comprises an information processing device having a human information acquisition unit that acquires human information representing the status of a person in the vicinity of a fixture, and a display device that is provided on the fixture and displays the human information to notify those around it of the status of the person.

[0007] An information display method according to one aspect of the present invention includes the steps of acquiring person information representing the status of a person in the vicinity of a fixture, and notifying those around the person of their status by displaying the person information on a display device provided on the fixture.

[0008] Furthermore, one aspect of the present invention can be realized as a program that causes a computer to execute the information display method, or as a computer-readable non-transitory recording medium storing the program. [Effects of the Invention]

[0009] According to the present invention, the condition of a person can be effectively notified to those around him / her. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing an overview of an information display system according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing a functional configuration of the information display system according to the embodiment. [Figure 3] FIG. 3 is a flowchart showing the operation of the information display system according to the embodiment. [Figure 4] FIG. 4 is a diagram showing an example of the correspondence between image information and a person's state. [Figure 5] FIG. 5 is a diagram showing an example of the correspondence between voice information and a person's state. [Figure 6] FIG. 6 is a diagram showing an example of the correspondence between vital information and a person's condition. [Figure 7] FIG. 7 is a diagram showing an example of the status input screen. [Figure 8A] FIG. 8A is a diagram showing an example of the relationship between the arrangement of fixtures and the state of people. [Figure 8B] FIG. 8B is a diagram showing another example of the relationship between the arrangement of fixtures and the state of people. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an information display system and an information display method according to an embodiment of the present invention will be described in detail with reference to the drawings. Note that each of the embodiments described below represents a specific example of the present invention. Therefore, the numerical values, shapes, materials, components, component arrangements and connection forms, steps, and step sequences shown in the following embodiments are merely examples and are not intended to limit the present invention. Therefore, among the components in the following embodiments, components not recited in the independent claims will be described as optional components.

[0012] Furthermore, each figure is a schematic diagram and is not necessarily an exact illustration. Therefore, for example, the scales of the figures do not necessarily match. Furthermore, in each figure, substantially the same components are given the same reference numerals, and redundant explanations are omitted or simplified.

[0013] (Embodiment) [overview] First, an overview of an information display system according to an embodiment will be described with reference to FIG.

[0014] Fig. 1 is a diagram showing an overview of an information display system 1 according to the present embodiment. The information display system 1 shown in Fig. 1 is a system that displays, on a display device 300, person information that indicates the status of a person 30 who is close to fixture 20.

[0015] The fixtures 20 are used or utilized by the person 30. The fixtures 20 are, for example, chairs 20a and desks 20b. The chair 20a is an example of a movable fixture 20. The movable chair 20a is equipped with wheels 21. The movable fixtures 20 may be autonomously moving, or may be manually moved by the person 30.

[0016] Person 30 is a person who is in proximity to fixture 20. Specifically, person 30 is a person who uses or utilizes fixture 20. For example, in the example shown in FIG. 1, person 30 is seated in chair 20a and is using desk 20b (specifically, operating a computer placed on desk 20b).

[0017] For example, in an office environment, if a person 30 is sitting in chair 20a and operating a computer, it is easy to tell at a glance that the person 30 is working alone. However, with recent advances in IT (Information Technology), there are cases where simply knowing the presence of person 30 is not enough information to be obtained.

[0018] For example, even when person 30 is sitting in chair 20a and working, it may be unclear whether the person is working alone or working in collaboration with others via a communication network (for example, participating in a web conference or attending an online lecture). For example, when person 30 is wearing headphones, the person may be participating in a web conference or may be wearing headphones simply to concentrate alone. In this way, it is not possible to determine the state of person 30 at a glance, and it is not possible to determine whether person 30's work can be interrupted.

[0019] In contrast, in the information display system 1, the information processing device 200 acquires person information indicating the status of the person 30 who is close to the fixture 20. Then, the display device 300 attached to the fixture 20 displays the person information indicating the status of the person 30 who is close to the fixture 20. For example, as shown in FIG. 1 , the display device 300 displays the text "Web conference in progress." In this way, the information display system 1 according to this embodiment can effectively inform those around the person 30 of the status of the person 30.

[0020] [composition] Next, the configuration of the information display system 1 according to this embodiment will be described using Fig. 2 while also referring to Fig. 1 as appropriate. Fig. 2 is a block diagram showing the functional configuration of the information display system 1 according to this embodiment.

[0021] 1 and 2, the information display system 1 includes an information processing device 200 and a display device 300. The information display system 1 also includes fixtures 20.

[0022] The information processing device 200 acquires human information based on information acquired via an information acquisition device such as the camera 110. The information processing device 200 is, for example, a computer device. The information processing device 200 may be a cloud server or a physical server. Communication between the information processing device 200 and each device is performed by wireless communication via, for example, a wireless gateway (not shown). The specific configuration of the information processing device 200 will be described later.

[0023] The display device 300 is provided on the fixture 20. Specifically, the display device 300 is attached to the fixture 20 by a mounting fixture 310. The display device 300 is, for example, a liquid crystal display device or an organic EL (Electroluminescence) device.

[0024] 1, the information display system 1 according to this embodiment includes a mounting fixture 310 for mounting the display device 300 to the fixture 20. The display device 300 is fixed to the mounting fixture 310 with screws or the like. The mounting fixture 310 is, for example, a clip member, and is fixed to the chair 20a or the desk 20b by clamping the backrest or headrest of the chair 20a or the edge of the desk 20b. The mounting fixture 310 makes it easy to attach and detach the display device 300 to and from the fixture 20.

[0025] Note that there is no particular limitation on the specific mounting method using the mounting fixture 310. For example, the mounting fixture 310 may be a string-like member with both ends fixed to the display device 300. The display device 300 may be mounted to the fixture 20 by hooking the string-like mounting fixture 310 onto the fixture 20.

[0026] The display device 300 notifies the surroundings of the status of the person 30 by displaying the person information. Specifically, the display device 300 displays, as the person information, an image including text representing the status of the person 30. The status of the person 30 is represented by the action that the person 30 is taking, such as whether they are in a web conference, on a phone call, or taking a break.

[0027] The information display system 1 includes one or more information acquisition devices for acquiring information for acquiring person information. Specifically, as shown in FIG. 1 , the information display system 1 includes a camera 110, a microphone 120, a wearable device 130, and a mobile terminal 140.

[0028] The camera 110 captures images of the movable fixture 20 and the person 30. The camera 110 is attached to, for example, the ceiling 10 and captures the space below the ceiling 10. As shown in FIG. 1 , the information display system 1 may include multiple cameras 110 installed at different positions and capturing different ranges. The camera 110 includes, for example, an image sensor sensitive to visible light or infrared light, and an optical system such as a lens. The camera 110 transmits image information obtained by capturing the image to the information processing device 200.

[0029] The microphone 120 picks up sounds near the furniture 20. The microphone 120 is attached to the furniture 20, for example. The microphone 120 transmits the picked-up sound information to the information processing device 200. In FIG. 1, the microphone 120 is shown as being attached to the desk 20b, but it may also be attached to the chair 20a.

[0030] The wearable device 130 measures vital information of the person 30. The vital information includes the heart rate, respiratory rate, blood pressure, body temperature, etc. of the person 30. The wearable device 130 is worn by the person 30. The wearable device 130 is a wristwatch-type device, but may also be a device worn on the ear, head, neck, etc. The wearable device 130 transmits the measured vital information to the information processing device 200.

[0031] The mobile terminal 140 is a terminal device carried by the person 30. The mobile terminal 140 is, for example, a smartphone or a tablet terminal. The person 30 operates the mobile terminal 140 to input their own status (for example, an action they are about to take). Alternatively, the person 30 operates the mobile terminal 140 to register their own future plans or schedule. As shown in FIG. 2 , the mobile terminal 140 includes an input unit 141, an information processing unit 142, a display unit 143, and a communication unit 144.

[0032] The input unit 141 receives an operation input from the person 30. The input unit 141 is, for example, a touch sensor, but may also be a physical button. For example, the input unit 141 acquires person information input by the person 30. Alternatively, the input unit 141 acquires schedule registration information input by the person 30.

[0033] The information processing unit 142 processes personal information and schedule registration information acquired via the input unit 141. The information processing unit 142 also processes images displayed on the display unit 143.

[0034] The information processing unit 142 is composed of, for example, a non-volatile memory in which a program is stored, a volatile memory that is a temporary storage area for executing the program, an input / output port, and a processor that executes the program. The functions executed by the information processing unit 142 may be realized by software or by hardware. For example, the information processing unit 142 may be composed of a dedicated arithmetic circuit.

[0035] The display unit 143 displays various images such as a screen for inputting person information and a screen for inputting schedule registration information. The display unit 143 also displays the evaluation result of the person 30. The evaluation result is the result of an evaluation in an incentive system based on the use of the information display system 1. Specifically, the evaluation result is information determined based on the number of times person information is input and / or its content. The display unit 143 is a liquid crystal display panel or an organic EL display panel. The display unit 143 and the input unit 141 form, for example, a touch panel display.

[0036] The communication unit 144 performs wireless communication with the information processing device 200. The wireless communication is Wi-Fi (registered trademark), Bluetooth (registered trademark), mobile communication, etc. The communication unit 144 is configured by a communication adapter, a wireless communication circuit including an antenna, or the like.

[0037] In this embodiment, the communication unit 144 further performs wireless communication with the server device 400. The server device 400 is a management server for schedule information. The server device 400 is a cloud server or a physical server. Note that the function processing unit provided in the server device 400 may be provided in the information processing device 200 or the mobile terminal 140.

[0038] As shown in FIG. 2, the server device 400 includes a communication unit 410, a schedule registration unit 420, and a storage unit 430.

[0039] The communication unit 410 performs wireless communication with each of the mobile terminal 140 and the information processing device 200. The wireless communication may be Wi-Fi (registered trademark), Bluetooth (registered trademark), mobile communication, or the like. The communication unit 410 is configured with a communication adapter, a wireless communication circuit including an antenna, or the like. The communication unit 410 acquires schedule registration information from the mobile terminal 140. In addition, the communication unit 410 reads schedule information 431 from the storage unit 430 and transmits it to the information processing device 200.

[0040] The schedule registration unit 420 generates schedule information 431 of the person 30 based on the registration information acquired via the communication unit 410, and stores the information in the storage unit 430. The schedule information 431 is information that associates the person's planned activities with times.

[0041] The storage unit 430 is a non-volatile storage device such as an HDD (Hard Disk Drive) or an SDD (Solid State Drive). The storage unit 430 stores schedule information 431. The storage unit 430 may store schedule information 431 for multiple people. The schedule information 431 is managed for each person.

[0042] It should be noted that the information display system 1 does not necessarily have to include all of the camera 110, the microphone 120, the wearable device 130, and the mobile terminal 140. For example, the information display system 1 may include only one of the camera 110, the microphone 120, the wearable device 130, and the mobile terminal 140.

[0043] Next, a specific configuration of the information processing device 200 will be described with reference to Fig. 2. As shown in Fig. 2, the information processing device 200 includes a communication unit 210, a determination unit 220, a fixture information acquisition unit 230, a person information acquisition unit 240, and an evaluation unit 250.

[0044] The communication unit 210 communicates with each of the camera 110, microphone 120, wearable device 130, mobile terminal 140, and server device 400 (various devices). The communication unit 210 communicates with the various devices to collect information from the various devices. The communication unit 210 also communicates with the display device 300 to transmit information to be displayed on the display device 300. Each communication is, for example, wireless communication, but may also be wired communication.

[0045] As shown in FIG. 2, the communication unit 210 includes an image acquisition unit 211, an audio acquisition unit 212, a vital sign acquisition unit 213, an input information acquisition unit 214, a schedule information acquisition unit 215, a display information transmission unit 216, and an evaluation information transmission unit 217.

[0046] The image acquisition unit 211 acquires image information obtained by photographing with the camera 110. The audio acquisition unit 212 acquires audio information collected by the microphone 120. The vital sign acquisition unit 213 acquires vital sign information measured by the wearable device 130. The input information acquisition unit 214 acquires person information input by the person 30 via the mobile terminal 140. The schedule information acquisition unit 215 acquires schedule information 431 stored in the storage unit 430 of the server device 400.

[0047] The display information sending unit 216 sends the person information acquired (generated) by the person information acquiring unit 240 to the display device 300. The evaluation information sending unit 217 is an example of an output unit that outputs the evaluation result by the evaluating unit 250. The evaluation information sending unit 217 sends the evaluation result to, for example, the mobile terminal 140. Note that the evaluation information sending unit 217 may also send the evaluation result to an external device other than the mobile terminal 140 (for example, a personal computer of the person 30's boss, etc.).

[0048] The determination unit 220 determines whether or not a person 30 has approached the fixture 20. Specifically, the determination unit 220 determines whether or not a person 30 has approached by performing image processing such as person detection processing on the image information acquired by the image acquisition unit 211. "Approach" means that the person 30 has entered within a predetermined range around the fixture 20. Alternatively, "approach" may mean that the person 30 has touched the fixture 20.

[0049] Note that the determination unit 220 may use other information in addition to or instead of the image information to determine the approach of the person 30. For example, the determination unit 220 may determine that the person 30 has approached the fixture 20 when the audio information acquired by the audio acquisition unit 212 includes the voice of the person 30. By setting the sound pickup range of the microphone 120 to the range near the fixture 20, the accuracy of determining the approach of the person 30 can be improved.

[0050] Alternatively, a contact sensor may be provided on the fixture 20. The communication unit 210 may acquire a detection result from the contact sensor. The determination unit 220 may determine that the person 30 has approached when the contact of the person 30 is detected by the contact sensor.

[0051] Furthermore, the determination unit 220 may transmit a beacon signal to the mobile terminal 140 via a beacon transmitter (not shown), and identify the location of the person 30 carrying the mobile terminal 140 based on the radio wave intensity of a response signal corresponding to the beacon signal. Specifically, the determination unit 220 identifies the location of the person 30 carrying the mobile terminal 140 that transmitted a response signal with radio wave intensity equal to or greater than a predetermined value. The determination unit 220 may determine whether the person 30 has approached the fixture 20 based on the identified location of the person 30 and the location of the fixture 20 indicated by the fixture information.

[0052] Furthermore, the determination unit 220 may determine whether the person 30 has approached the fixture 20 based on the radio wave intensity, without specifying the position of the person 30. For example, the determination unit 220 transmits a beacon signal to the mobile terminal 140 via a beacon transmitter, and determines whether the radio wave intensity of a response signal corresponding to the beacon signal is equal to or greater than a predetermined value. If the radio wave intensity of the response signal is equal to or greater than a predetermined value, the determination unit 220 may determine that the person 30 carrying the mobile terminal 140 has approached the fixture 20.

[0053] The beacon transmitter is a device that is placed near the fixture 20 and transmits a beacon signal. For example, the beacon transmitter is provided in the camera 110, the microphone 120, or the display device 300. Alternatively, the beacon transmitter may be attached to the fixture 20. When the information processing device 200 is placed near the fixture 20, the beacon transmitter may be provided in the information processing device 200.

[0054] The furniture information acquisition unit 230 acquires furniture information indicating at least one of the type, position, and status of the furniture 20. The type of furniture 20 may include not only a general category such as a chair or a desk, but also a model number. The position of the furniture 20 is the position of the furniture 20 within the space, and is identified, for example, based on image information acquired by the image acquisition unit 211. Specifically, the furniture information acquisition unit 230 identifies the position of the furniture 20 by performing image processing such as edge detection on the image information. The status of the furniture 20 may be, for example, the usage status (used or unused), cleaning status (clean or dirty), update status (updated or not updated), etc. Note that, if the furniture 20 is electronically controllable, updating refers to updating a program such as firmware.

[0055] The human information acquisition unit 240 acquires human information. The human information acquisition unit 240 acquires human information when the determination unit 220 determines that a person 30 has approached the fixture 20. For example, the human information acquisition unit 240 generates human information representing the state of the identified person 30 by identifying the state of the person 30 based on information obtained via the communication unit 210. The human information acquisition unit 240 generates the human information based on at least one of image information, audio information, vital sign information, and schedule information. Machine learning may be used to generate the human information. Specific examples of generating human information will be described later.

[0056] When there are multiple people 30 in the vicinity of the fixture 20, the person information acquisition unit 240 acquires person information for each of the multiple people. For example, when the person information acquisition unit 240 determines that multiple people are talking based on audio information, it can determine that the status of each of the multiple people is “talking.”

[0057] The evaluation unit 250 evaluates the person 30 based on the number of times the person information is acquired or the content of the person information. The evaluation is based on an incentive system according to the use of the information display system 1.

[0058] For example, the information display system 1 can determine the reliability of the generated person information by comparing the person information input by the person 30 with the person information generated based on image information or the like. Machine learning or the like can be used to improve the method of generating person information, thereby increasing the reliability of the generated person information. Therefore, the more times the person 30 inputs person information, or the more detailed the content of the information, the more useful the information display system 1 becomes. Therefore, the evaluation unit 250 will evaluate the person 30 more highly, for example, the more frequently the input information acquisition unit 214 acquires person information from the mobile terminal 140, or the more comprehensive the content of the information. The evaluation result includes, for example, points exchangeable for a specified item, personnel evaluation points (evaluation points), or the like.

[0059] The configuration of the information processing device 200 is not limited to the example shown in Fig. 2. For example, the information processing device 200 may not include the determination unit 220, the fixture information acquisition unit 230, and the evaluation unit 250. Furthermore, the communication unit 210 may not include at least one of the image acquisition unit 211, the voice acquisition unit 212, the vital sign acquisition unit 213, the input information acquisition unit 214, the schedule information acquisition unit 215, and the evaluation information transmission unit 217.

[0060] Furthermore, for example, the display information transmitting unit 216 may transmit the fixture information acquired by the fixture information acquiring unit 230 to the display device 300. The display device 300 may display not only the person information but also the fixture information. Alternatively, the display information transmitting unit 216 may transmit the fixture information to the mobile terminal 140. The display unit 143 of the mobile terminal 140 may display the fixture information. This makes it possible to inform the person 30 of the status of the fixtures 20.

[0061] [Operation] Next, the operation of the information display system 1 according to the present embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the operation of the information display system 1 according to the present embodiment. Fig. 3 shows the operation of the information processing device 200.

[0062] 3, in the information display system 1, the communication unit 210 of the information processing device 200 collects information from various devices (S10). Specifically, the communication unit 210 acquires image information, audio information, vital sign information, personal information, schedule information, and the like from each of the camera 110, microphone 120, wearable device 130, mobile terminal 140, and server device 400.

[0063] The camera 110, the microphone 120, and the wearable device 130 each take pictures, collect sound, and measure constantly or periodically. Alternatively, the camera 110, the microphone 120, and the wearable device 130 may take pictures, collect sound, and measure upon receiving a request from the information processing device 200, and transmit the results to the information processing device 200.

[0064] Next, the fixture information acquisition unit 230 acquires fixture information (S12). For example, the fixture information acquisition unit 230 identifies the position of the fixture 20 based on the image information transmitted from the camera 110. The fixture information acquisition unit 230 may also identify the external shape of the fixture 20 based on the image information, and identify the type of the fixture 20 based on the identified external shape.

[0065] Next, the determination unit 220 determines whether the person 30 has approached the fixture 20 (S14). If the person 30 has not approached the fixture 20 (No in S14), the information processing device 200 repeats the process from step S10. Note that step S12 may be omitted if, for example, the position of the fixture 20 has not changed.

[0066] When the person 30 approaches the fixture 20 (Yes in S14), the person information acquisition unit 240 acquires person information (S16). Specifically, the person information acquisition unit 240 generates person information based on at least one of image information, audio information, vital sign information, and schedule information. Alternatively, the person information acquisition unit 240 may acquire person information acquired by the communication unit 210 from the mobile terminal 140.

[0067] Next, the display information transmitting unit 216 of the communication unit 210 transmits the generated person information to the display device 300 for display (S18). Next, the evaluation unit 250 evaluates the person 30 in the incentive system (S20). For example, when the person 30 transmits person information via the mobile terminal 140, evaluation points are added. Next, the evaluation information transmitting unit 217 transmits the evaluation result by the evaluation unit 250 to the mobile terminal 140 (S22).

[0068] The evaluation may be performed at any timing by the evaluation section 250. For example, the evaluation section 250 may perform the evaluation at a predetermined frequency, such as once a week or once a month.

[0069] Through the above processing, the display device 300 displays person information indicating the status of the person 30 who is close to the fixture 20. This makes it possible to effectively inform other people around the fixture 20 and the person 30 of the status of the person 30.

[0070] [Examples of personal information] Next, a specific example of generation (acquisition) of human information by the human information acquisition unit 240 will be described with reference to FIGS. 4 to 8B.

[0071] 4 is a diagram showing an example of the correspondence between image information and a person's state. The person information acquisition unit 240 identifies the position, posture, etc. of the person 30 by analyzing the image information (image or video) acquired from the camera 110. For example, if it is identified from the image information that the person 30 is seated in the chair 20a, the person information acquisition unit 240 identifies the state of the person 30 as "on the phone," "in a web conference," or "working" based on the correspondence shown in FIG.

[0072] In FIG. 4, three states are associated with the state "sitting." The person information acquisition unit 240 selects one of the three states and generates person information representing the selected state. The person information acquisition unit 240 may determine which of the three states the person 30 is in based on other information such as voice information. For example, if the voice information does not include the person 30's speaking voice, the person information acquisition unit 240 may determine that the state of the person 30 is "working."

[0073] 5 is a diagram showing an example of the correspondence relationship between audio information and a person's state. The person information acquisition unit 240 identifies the type of sound by analyzing the audio information acquired from the microphone 120. The type of sound may be, for example, a conversation between one person, a conversation between multiple people, or a typing sound. Based on the identified type of sound, the person information acquisition unit 240 identifies the state of the person 30 by referring to the correspondence information shown in FIG. 5, and generates person information representing the identified state.

[0074] 6 is a diagram showing an example of the correspondence between vital information and a person's state. The person information acquisition unit 240 identifies the state of the person 30 based on the vital information acquired from the wearable device 130, and generates person information representing the identified state. For example, if the vital information includes a heart rate, the person information acquisition unit 240 can identify whether the person is working or taking a break based on the heart rate.

[0075] The correspondence between each piece of information and the person information shown in FIGS. 4 to 6 is determined in advance based on empirical rules and stored in a memory that can be referenced by the person information acquisition unit 240. The correspondence may be updated as appropriate using machine learning. For example, the correspondence between each piece of image information, audio information, and vital sign information and the person information can be optimized by supervised machine learning using the person information input by the person 30 via the mobile terminal 140 as a correct answer. This makes it possible to increase the reliability of the person information even when there is no input via the mobile terminal 140.

[0076] 7 is a diagram showing an example of a status input screen 150. The status input screen 150 is displayed on the display unit 143 of the mobile terminal 140. The status input screen 150 is an image including GUI (Graphical User Interface) objects that allow the person 30 to input a status via the input unit 141. As shown in FIG. 7, the status input screen 150 includes a selection button 151, a decision button 152, a schedule link button 153, and an evaluation confirmation button 154.

[0077] The selection button 151 is a button for selecting the state of the person 30. By presenting a plurality of predetermined options to the person 30, it is possible to accept input of the state of the person 30. Alternatively, instead of the selection button 151, a text box may be displayed and the person 30 may be prompted to input text representing the state.

[0078] The decision button 152 is a button for confirming the state selected by the selection button 151. When the decision button 152 is selected, the information processing unit 142 generates person information representing the state selected by the selection button 151 and transmits the generated person information to the information processing device 200 via the communication unit 144.

[0079] The schedule link button 153 is a button for using schedule information 431 stored in the storage unit 430 of the server device 400. When the person 30 selects the schedule link button 153, the information processing unit 142 transmits an instruction to use the schedule information to the server device 400 via the communication unit 144. The server device 400 transmits the schedule information 431 of the person 30 to the information processing device 200 via the communication unit 410.

[0080] The evaluation confirmation button 154 is a button for confirming the evaluation result transmitted from the information processing device 200. When the person 30 selects the evaluation confirmation button 154, the display unit 143 displays the evaluation result.

[0081] It should be noted that the status input screen 150 is not limited to the example shown in Fig. 7. The status input screen 150 does not have to include the schedule link button 153 and the evaluation confirmation button 154. The status input screen 150 only needs to include an appropriate GUI object for inputting the status.

[0082] The person information acquisition unit 240 can also identify the state of the person 30 based on the furniture information generated by the furniture information acquisition unit 230. Figures 8A and 8B are diagrams each showing an example of the relationship between the arrangement of furniture and the state of a person.

[0083] For example, as shown in FIG. 8A, chairs are arranged in the same direction (downward in the figure) relative to each of a plurality of desks. Also, a plurality of chairs are arranged facing the same direction (upward). This type of arrangement is often seen when listening to someone speaking, such as in a class or lecture. Therefore, when such an arrangement is made, the person information acquisition unit 240 determines that the person's state is "listening."

[0084] 8B, multiple desks are arranged in a group, and multiple chairs are arranged around them. This type of arrangement is often seen when holding a meeting, etc. Therefore, when such an arrangement is made, the person information acquisition unit 240 determines that the person's status is "in a meeting."

[0085] For example, correspondence information indicating the correspondence between the arrangement of a plurality of fixtures and the state of a person is stored in a memory that can be referenced by the person information acquisition unit 240. Note that the correspondence may be updated as appropriate using machine learning or the like. This can increase the reliability of the person information.

[0086] [Effects, etc.] As described above, the information display system 1 of this embodiment comprises an information processing device 200 having a person information acquisition unit 240 that acquires person information representing the status of a person 30 in the vicinity of the fixture 20, and a display device 300 that is provided on the fixture 20 and displays the person information to notify those around it of the status of the person 30.

[0087] This makes it possible to effectively notify those around the person 30 who is close to the fixture 20 of his / her condition.

[0088] Also, for example, the information display system 1 further includes a fixture 20. Also, for example, the fixture 20 is movable. Also, for example, the information processing device 200 further includes a determination unit 220 that determines whether or not a person 30 has approached the fixture 20. When the determination unit 220 determines that the person 30 has approached the fixture 20, the person information acquisition unit 240 acquires person information that represents the state of the person 30.

[0089] In particular, in the case of movable fixtures 20, the fixtures 20 may be moved, so by determining the proximity of person 30 to the fixtures 20, it is possible to increase the certainty that the information displayed on the display device 300 represents the state of person 30.

[0090] Moreover, for example, the information processing device 200 further includes a furniture information acquisition unit 230 that acquires furniture information indicating at least one of the type, position, and state of the furniture 20.

[0091] This makes it possible to identify the state of person 30 based on the arrangement of fixtures 20, for example.

[0092] Furthermore, for example, the information display system 1 further includes a camera 110 that is installed on the ceiling 10 of the space in which the fixtures 20 are present and captures images of the fixtures 20. The fixture information acquisition unit 230 may acquire the fixture information based on the image information acquired by the camera 110.

[0093] This makes it possible to identify the state of the person 30 with high accuracy based on the image information.

[0094] Moreover, for example, the information processing device 200 further includes a communication unit 210 that communicates with a server device 400 that stores schedule information 431 of the person 30. The person information acquisition unit 240 may acquire person information based on the schedule information 431 acquired by the communication unit 210.

[0095] As a result, by using the schedule information 431, it is not necessary to install the camera 110, the microphone 120, etc., and the information display system 1 can be configured simply.

[0096] Furthermore, for example, the information display system 1 further includes a microphone 120 that collects sounds near the fixture 20. The person information acquisition unit 240 may acquire person information based on the voice of the person 30 collected by the microphone 120.

[0097] This makes it possible to accurately identify the state of the person 30 based on the voice information.

[0098] Furthermore, for example, the information display system 1 further includes a wearable device 130 that measures vital information of the person 30. The person information acquisition unit 240 may acquire the person information based on the vital information measured by the wearable device 130.

[0099] This makes it possible to accurately identify the condition of the person 30 based on the vital sign information.

[0100] Moreover, for example, the information display system 1 further includes a mobile terminal 140 to which the person 30 inputs person information. The person information acquisition unit 240 may acquire the person information input to the mobile terminal 140.

[0101] This allows the person 30 to input the person information, thereby making it possible to extremely increase the reliability of the person information.

[0102] For example, the information display system 1 further includes a mounting fixture 310 for mounting the display device 300 to the fixture 20.

[0103] This allows the display device 300 to be attached to a variety of fixtures 20.

[0104] Furthermore, for example, the person information acquisition unit 240 may acquire person information for each of a plurality of people who are close to the fixture 20.

[0105] Furthermore, for example, the person information acquisition unit 240 may acquire person information based on the positional relationship of a plurality of fixtures including the fixture 20.

[0106] This makes it possible to accurately identify the state of the person 30 based on the relative positions of the multiple fixtures 20.

[0107] Furthermore, for example, the information processing device 200 further includes an evaluation unit 250 that evaluates the person 30 based on the number of times the person information is acquired or the content of the person information, and an evaluation information transmission unit 217 that outputs the evaluation result by the evaluation unit 250 to an external device.

[0108] This allows for an incentive to be given to the person 30, thereby making it possible to improve the information display system 1 effectively.

[0109] Furthermore, for example, the information display method according to the present embodiment includes the steps of acquiring person information indicating the status of person 30 who is close to fixture 20, and notifying the surroundings of the status of person 30 by displaying the person information on display device 300 provided on fixture 20. Furthermore, for example, the program according to the present embodiment is a program that causes a computer to execute the information display method.

[0110] This makes it possible to effectively inform those around the person of their condition, similar to the information display system 1 described above.

[0111] (others) Although the information display system and the information display method according to the present invention have been described based on the above-mentioned embodiment, the present invention is not limited to the above-mentioned embodiment.

[0112] For example, fixture 20 may not be movable, but may be installed and fixed in place.

[0113] For example, the fixture 20 may be a simple private room. A simple private room is a private booth that is installed after the completion of a building. A simple private room is, for example, a private booth for remote work that is installed in a public place such as a train station. A simple private room may also be a portable toilet.

[0114] Furthermore, it is possible to add new fixtures or delete existing fixtures 20 from the information display system 1. In other words, a specific fixture 20 is not a required component of the information display system 1. The information display system 1 can be formed by attaching the display device 300 to the target fixture via the mounting fixture 310.

[0115] Furthermore, for example, the example in which the display device 300 is attached to the fixture 20 via the mounting fixture 310 has been shown, but this is not limiting. The display device 300 may be provided on the fixture 20. For example, the display device 300 may be provided so as to be embedded in the outer surface of the fixture 20.

[0116] Furthermore, for example, the display device 300 has been described as displaying text representing the status of the person 30 as person information, but this is not limiting. The display device 300 may be a light source device capable of changing the light emission mode, such as the light color or light intensity. For example, the display device 300 may emit light in a specific first color when the person 30 is using the fixture 20, and emit light in a second color different from the first color when the person 30 is near the fixture 20 but is not using the fixture 20. In this way, the display device 300 may display person information using only differences in the emitted light color, without using text or images.

[0117] Furthermore, the communication method between the devices described in the above embodiments is not particularly limited. When wireless communication is performed between the devices, the wireless communication method (communication standard) is, for example, short-range wireless communication such as ZigBee (registered trademark), Bluetooth (registered trademark), or wireless LAN (Local Area Network). Alternatively, the wireless communication method (communication standard) may be communication via a wide area communication network such as the Internet. Furthermore, wired communication may be performed between the devices instead of wireless communication. Specifically, wired communication is communication using power line communication (PLC) or a wired LAN.

[0118] In addition, in the above-described embodiment, a process executed by a specific processing unit may be executed by another processing unit. Furthermore, the order of multiple processes may be changed, or multiple processes may be executed in parallel. Furthermore, the allocation of components included in the information display system to multiple devices is one example. For example, components included in one device may be included in another device.

[0119] For example, the processing described in the above embodiments may be realized by centralized processing using a single device (system), or may be realized by distributed processing using multiple devices. Furthermore, the processor that executes the program may be a single processor or multiple processors. That is, centralized processing or distributed processing may be performed.

[0120] In the above embodiments, all or some of the components such as the control unit may be configured with dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU (Central Processing Unit) or a processor reading and executing a software program recorded on a recording medium such as a hard disk drive or semiconductor memory.

[0121] Furthermore, components such as the control unit may be configured with one or more electronic circuits, each of which may be a general-purpose circuit or a dedicated circuit.

[0122] The one or more electronic circuits may include, for example, a semiconductor device, an integrated circuit (IC), or a large scale integration (LSI). The IC or LSI may be integrated on a single chip or on multiple chips. Although the IC or LSI is referred to here as an IC or LSI, the name may vary depending on the degree of integration, and may be called a system LSI, a very large scale integration (VLSI), or an ultra large scale integration (ULSI). Also, a field programmable gate array (FPGA), which is programmed after the LSI is manufactured, can be used for the same purpose.

[0123] Furthermore, the general or specific aspects of the present invention may be realized as a system, an apparatus, a method, an integrated circuit, or a computer program. Alternatively, the present invention may be realized as a computer-readable non-transitory recording medium such as an optical disk, a HDD, or a semiconductor memory on which the computer program is stored. Alternatively, the present invention may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0124] In addition, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art would think of, and forms realized by arbitrarily combining the components and functions of each embodiment within the scope of the present invention. [Explanation of symbols]

[0125] 1 Information display system 20 Fixtures 20a Chair 20b desk 30 people 110 Camera 120 Microphone 130 Wearable Devices 140 mobile devices 200 Information processing device 210 Communications Department 220 Judgment section 230 Fixture Information Acquisition Department 240 Person Information Acquisition Department 250 Evaluation Department 300 display device 310 Mounting fixture 400 Server device 431 Schedule Information

Claims

1. an information processing device including a person information acquisition unit that acquires person information representing the status of a person close to a fixture; A display device is provided on the fixture and displays the person information to notify the surroundings of the person's status, The person information acquisition unit acquires the person information based on at least one of image information obtained by photographing the fixture or the person, audio information including audio in the vicinity of the fixture, vital sign information of the person, schedule information of the person, and a positional relationship of a plurality of fixtures including the fixture. Information display system.

2. an information processing device including a person information acquisition unit that acquires person information representing the status of a person close to a fixture; A display device that is provided on the fixture and displays the person information to notify the surroundings of the person's status; a terminal device including an input unit that accepts input of the person information and a communication unit that transmits the person information accepted by the input unit to the information processing device; the personal information acquisition unit acquires the personal information transmitted from the communication unit; Information display system.

3. the display device displays an image including text indicating the person's status as the person information.

3. The information display system according to claim 1 or 2.

4. Further, the fixture is provided, The information display system according to any one of claims 1 to 3.

5. The fixture is movable. The information display system according to claim 4 .

6. The information processing device further includes a determination unit that determines whether a person has approached the fixture, The person information acquisition unit acquires the person information representing the state of the person when the determination unit determines that the person has approached the fixture. The information display system according to any one of claims 1 to 5.

7. The information processing device further includes a fixture information acquisition unit that acquires fixture information indicating at least one of the type, position, and status of the fixture. The information display system according to any one of claims 1 to 6.

8. Further, a mounting fixture is provided for mounting the display device to the fixture. The information display system according to any one of claims 1 to 7.

9. The person information acquisition unit acquires the person information of each of a plurality of people who are close to the fixture, The information display system according to any one of claims 1 to 8.

10. The person information acquisition unit acquires the person information based on a positional relationship of a plurality of fixtures including the fixture. The information display system according to any one of claims 1 to 9.

11. The information processing device further comprises: an evaluation unit that evaluates the person based on the number of times the person information has been acquired or the content of the person information; an output unit that outputs the evaluation result by the evaluation unit to an external device, The information display system according to any one of claims 1 to 10.

12. a person information acquisition unit that acquires person information representing the status of a person in proximity to the fixture; A transmitter that is provided on the fixture and transmits the person information to a display device that displays the person information and notifies the surroundings of the person's status, The person information acquisition unit acquires the person information based on at least one of image information obtained by photographing the fixture or the person, audio information including audio in the vicinity of the fixture, vital sign information of the person, schedule information of the person, and a positional relationship of a plurality of fixtures including the fixture. Information processing device.

13. A step in which a computer acquires person information representing the status of a person in proximity to the fixture; The computer notifies the surroundings of the state of the person by displaying the person information on a display device provided on the fixture, In the step of acquiring the person information, the person information is acquired based on at least one of image information obtained by photographing the fixture or the person, audio information including audio in the vicinity of the fixture, vital sign information of the person, schedule information of the person, and a positional relationship of a plurality of fixtures including the fixture. Information display method.

14. A program that causes a computer to execute the information display method according to claim 13.

Citation Information

Patent Citations

  • Intelligent furniture and control method

    CN112586909A

  • Electronic display system

    JP2012100139A

  • Person presence / absence determination system

    JP2019074977A

  • Stay situation display system and stay situation display method

    JP2019144917A