Information processing system, information processing device, and information processing method

JP7668485B2Active Publication Date: 2025-04-25PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2021108504
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-06-30
Publication Date
2025-04-25
Estimated Expiration
2041-06-30

AI Technical Summary

Technical Problem

Existing detection systems require relocation or addition of detection means when the layout or zone changes, leading to inaccurate position detection if not updated.

Method used

An information processing system attached to regularly arranged power feed ports on a ceiling, utilizing information acquisition terminals that communicate with a central device to acquire and process object information, generating maps and detecting positions of objects and individuals.

Benefits of technology

Facilitates easy installation and accurate acquisition of spatial information, including floor maps and object positions, with the ability to update maps when layouts change.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000017_0000
    Figure 00000017_0000
  • Figure 00000018_0000
    Figure 00000018_0000
  • Figure 00000019_0000
    Figure 00000019_0000
Patent Text Reader

Abstract

To provide an information processing system that can be easy to install and simply obtain information in a space.SOLUTION: An information processing system 1 includes: a plurality of information acquisition terminals 100 that are attached to a plurality of power feeding ports regularly arranged on a ceiling 10 of a space, and that each acquire thing information on one or more things existing within a predetermined range around the corresponding power feeding port; and an information processing device 200. The information processing device 200 includes: a communication unit 210 that obtains the thing information from at least one of the plurality of information acquisition terminals 100 by communicating with the plurality of information acquisition terminals 100; and an output unit 230 that outputs output information obtained from the thing information.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing device, and an information processing method. [Background technology]

[0002] BACKGROUND ART Conventionally, a technique has been disclosed in which a detection means provided on a ceiling panel of a grid ceiling detects the position of a person or object to be detected with graded accuracy (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-108137 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the invention described in Patent Document 1 requires the addition or relocation of detection means in accordance with changes in the layout or zones within a floor. If the addition or relocation of detection means is not performed, there is a risk that accurate position detection will not be possible.

[0005] Therefore, an object of the present invention is to provide an information processing system, an information processing device, and an information processing method that are easy to install and that can easily acquire information within a space. [Means for solving the problem]

[0006] An information processing system according to one aspect of the present invention includes a plurality of information acquisition terminals attached to a plurality of power supply outlets regularly arranged on the ceiling of a space, each of which acquires object information about one or more objects present within a predetermined range around the corresponding power supply outlet, and an information processing device. The information processing device includes a communication unit that communicates with the plurality of information acquisition terminals to acquire the object information from at least one of the plurality of information acquisition terminals, and an output unit that outputs output information obtained from the object information.

[0007] An information processing device according to one embodiment of the present invention is attached to a plurality of power supply outlets arranged regularly on the ceiling of a space, and includes a communication unit that communicates with a plurality of information acquisition terminals that acquire object information about one or more objects located within a predetermined range around the corresponding power supply outlet, thereby acquiring the object information from at least one of the plurality of information acquisition terminals, and an output unit that outputs output information obtained from the object information.

[0008] An information processing method according to one aspect of the present invention includes a step of acquiring object information from at least one of a plurality of information acquisition terminals attached to a plurality of power supply outlets arranged regularly on the ceiling of a space, each of which acquires object information regarding one or more objects located within a predetermined range around the corresponding power supply outlet, by communicating with the plurality of information acquisition terminals; and a step of outputting output information obtained from the object information.

[0009] Furthermore, one aspect of the present invention can be realized as a program that causes a computer to execute the information processing method, or as a computer-readable non-transitory recording medium storing the program. [Effects of the Invention]

[0010] According to the information processing system etc. of the present invention, installation is easy and information within a space can be easily obtained. [Brief explanation of the drawings]

[0011] [Figure 1]FIG. 1 is a diagram showing a configuration of an information processing system according to the first embodiment. [Figure 2] FIG. 2 is a perspective view showing an example of a system ceiling. [Figure 3A] FIG. 3A is a perspective view showing an example of the arrangement of information acquisition terminals on a system ceiling. [Figure 3B] FIG. 3B is a perspective view showing another example of the arrangement of information acquisition terminals on a system ceiling. [Figure 4] FIG. 4 is a diagram illustrating an example of the terminal-related information. [Figure 5] FIG. 5 is a flowchart showing the floor map generation process performed by the information processing system according to the first embodiment. [Figure 6] FIG. 6 is a diagram for explaining the floor map generation process. [Figure 7] FIG. 7 is a flowchart showing the detected object position display process performed by the information processing system according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing an example of a floor map on which a terminal image is superimposed. [Figure 9] FIG. 9 is a diagram illustrating a configuration of an information processing system according to the second embodiment. [Figure 10] FIG. 10 is a flowchart showing the linking process with BIM data performed by the information processing system according to the second embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a floor map on which images representing detected fixtures are superimposed. [Figure 12] FIG. 12 is a diagram illustrating an application example of the information processing system according to the first or second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] An information processing system, an information processing device, and an information processing method according to embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Note that each of the embodiments described below represents a specific example of the present invention. Therefore, the numerical values, shapes, materials, components, component arrangements and connection forms, steps, and step orders shown in the following embodiments are merely examples and are not intended to limit the present invention. Therefore, among the components in the following embodiments, components not recited in independent claims will be described as optional components.

[0013] Furthermore, each figure is a schematic diagram and is not necessarily an exact illustration. Therefore, for example, the scales of the figures do not necessarily match. Furthermore, in each figure, substantially the same components are given the same reference numerals, and redundant explanations are omitted or simplified.

[0014] (Embodiment 1) [composition] First, the configuration of an information processing system according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing the configuration of an information processing system 1 according to this embodiment.

[0015] 1, the information processing system 1 includes a plurality of information acquisition terminals 100 and an information processing device 200. The plurality of information acquisition terminals 100 are attached to a plurality of power supply outlets regularly arranged on a ceiling 10. The ceiling 10 is a system ceiling.

[0016] 2 is a perspective view showing an example of a ceiling 10, showing the ceiling 10 as viewed diagonally upward from the space directly below the ceiling 10. As shown in FIG. 2, the ceiling 10 includes support members 11 arranged in a lattice pattern and a plurality of ceiling panels 12 supported by the support members 11.

[0017] The support member 11 is a member with an inverted T-shaped cross section, and is also called a T-bar. The top end of the inverted T is fixed to the structural material of the building. In plan view, the support member 11 has a lattice shape, that is, it extends in two directions that are perpendicular to each other. The lattice-shaped support member 11 has multiple openings in which ceiling panels 12 are placed. The lattice is spaced at equal intervals, and the multiple openings are square or rectangular and of the same size.

[0018] The ceiling panel 12 is placed on the horizontal bar of the T-shape of the support member 11, and is thereby supported by the support member 11. The ceiling panel 12 is provided with functional parts that perform predetermined functions. The functional parts are, for example, lighting fixtures, fire alarms, speakers, air conditioning outlets, etc.

[0019] A plurality of power feed ports are regularly arranged on the ceiling 10. "Regularly arranged" means arranging them according to a certain rule, for example, arranging them at equal intervals. For example, the plurality of power feed ports are arranged in a planar grid pattern on the ceiling surface. Planar grid patterns include a square grid, rectangular grid, hexagonal grid, oblique grid, and parallelepiped grid. The spacing between the power feed ports in one direction may be different from the spacing in another direction different from the one direction.

[0020] Specifically, the multiple power feed ports are arranged on either the support member 11 or the multiple ceiling panels 12. For example, the multiple power feed ports are arranged at the center of each of the multiple ceiling panels 12. Alternatively, the multiple power feed ports are arranged at intersections of the support member 11, or at the centers of each side of the support member 11, or both.

[0021] The power inlet is, for example, a Universal Serial Bus (USB) socket. The power inlet supplies power to a terminal that is plugged in. Note that the power inlet may also be a socket into which a terminal plug is inserted to supply commercial power.

[0022] An information acquisition terminal 100 is attached to each of the multiple power feed ports. That is, the information acquisition terminals 100 are arranged regularly on the ceiling 10. Note that the information acquisition terminals 100 do not have to be attached to all of the power feed ports provided on the ceiling 10. For example, the information acquisition terminals 100 may be arranged only in a number of power feed ports that are selected by thinning out all of the power feed ports so that they are spaced at equal intervals.

[0023] 3A and 3B are perspective views each showing an example of arrangement of information acquisition terminals 100 on a ceiling 10. In the example shown in Fig. 3A, the information acquisition terminals 100 are arranged at equal intervals between power supply ports provided on a plurality of ceiling panels 12. In the example shown in Fig. 3B, the information acquisition terminals 100 are arranged at equal intervals between power supply ports provided on a support member 11.

[0024] The information acquisition terminal 100 is a device that acquires object information about one or more objects that exist within a predetermined range around the power outlet that the information acquisition terminal 100 is attached to. The information acquisition terminal 100 is, for example, a USB dongle, and has a predetermined information acquisition function.

[0025] The one or more objects include, for example, furniture 21 such as a desk and a chair as shown in FIG. 1. The objects are, for example, stationary objects, but may also be mobile objects. For example, the one or more objects may include a mobile terminal 22 carried by a person 23, or the person 23 itself. In other words, the objects may be not only inanimate objects but also living objects. The mobile terminal 22 is an example of a mobile terminal that can move in the space below the ceiling 10. The mobile terminal 22 is, for example, a smartphone or a tablet terminal. The mobile terminal may also be an autonomous mobile object such as a robot vacuum cleaner.

[0026] 1, the information acquisition terminal 100 includes a communication unit 110 and an imaging unit 120. Although not shown in FIG. 1, the information acquisition terminal 100 includes a connection terminal that is connected to a power outlet.

[0027] The communication unit 110 communicates with the information processing device 200. The communication with the information processing device 200 is wired communication and / or wireless communication. For example, the wired communication is serial communication via USB, but it may also be power line communication (PLC). The wireless communication is Wi-Fi (registered trademark), Bluetooth (registered trademark), mobile communication, or the like. The communication unit 110 is configured by a communication adapter, a wireless communication circuit including an antenna, or the like.

[0028] Furthermore, the communication unit 110 is an example of a wireless communication unit, and may perform wireless communication with the mobile terminal 22. The communication unit 110 periodically transmits a beacon signal and receives a response signal from the mobile terminal 22 that has received the transmitted beacon signal. The reception strength of the response signal at this time can be used to calculate the position of the mobile terminal 22. The reception strength of the response signal is an example of communication information that indicates the communication status with the mobile terminal 22.

[0029] The imaging unit 120 captures an image of a predetermined range. Fig. 1 shows an imaging range 121 captured by the imaging unit 120. The imaging range 121 is, for example, a range centered vertically below the information acquisition terminal 100. Part of the imaging ranges 121 of adjacent information acquisition terminals 100 overlap. The imaging unit 120 is, for example, an image sensor having sensitivity to visible light or infrared light.

[0030] The image information obtained by the imaging unit 120 and / or the communication information obtained by the communication unit 110 are transmitted to the information processing device 200 as object information.

[0031] The information processing device 200 acquires object information from at least one of the multiple information acquisition terminals 100. The information processing device 200 is, for example, a computer device. The information processing device 200 may be a cloud server or a physical server. Communication between the information processing device 200 and the multiple information acquisition terminals 100 is performed, for example, via a wireless gateway (not shown). As shown in FIG. 1 , the information processing device 200 includes a communication unit 210, an information processing unit 220, an output unit 230, and a storage unit 240.

[0032] The communication unit 210 communicates with the multiple information acquisition terminals 100 to acquire object information from at least one of the multiple information acquisition terminals 100. The object information includes image information and / or communication information. The communication unit 210 is configured with a communication adapter, a wireless communication circuit including an antenna, or the like.

[0033] The information processing unit 220 acquires the terminal-related information 241 from the storage unit 240, and generates output information indicating the position of an object within the space based on the acquired terminal-related information 241 and the object information acquired by the communication unit 210. In this embodiment, the output information includes map information indicating the planar layout of the space. The information processing unit 220 generates map information (for example, a floor map) by synthesizing the image information obtained for each information acquisition terminal 100 based on the position of each information acquisition terminal 100 indicated by the terminal-related information 241.

[0034] Furthermore, the information processing unit 220 identifies the position of the mobile terminal 22 on the map information based on the position of each information acquisition terminal 100 indicated by the terminal-related information 241 and the communication information obtained for each information acquisition terminal 100. The information processing unit 220 superimposes a terminal image representing the mobile terminal 22 at the identified position on the map information.

[0035] The terminal image includes, for example, personal information of the person 23 who carries the mobile terminal 22. The personal information is, for example, the name, affiliation, and ID of the person 23. The information processing unit 220 identifies the personal information of the person 23 who carries the mobile terminal 22 based on at least one of the communication information and the image information. The information processing unit 220 generates a terminal image including the identified personal information and superimposes it on the map information.

[0036] The information processing unit 220 is composed of, for example, a non-volatile memory in which a program is stored, a volatile memory that is a temporary storage area for executing the program, an input / output port, and a processor that executes the program. The functions executed by the information processing unit 220 may be realized by software or by hardware. For example, the information processing unit 220 may be composed of a dedicated arithmetic circuit.

[0037] The output unit 230 outputs output information obtained from the object information. As shown in FIG.

[0038] The display unit 231 displays output information. Specifically, the display unit 231 displays map information. The display unit 231 is, for example, a liquid crystal display device or an organic EL (Electroluminescence) device.

[0039] The transmitting unit 232 transmits the output information to an external server. The transmitting unit 232 is configured with a communication adapter, a wireless communication circuit including an antenna, etc. Note that the transmitting unit 232 and the communication unit 210 may be configured with common hardware resources.

[0040] The storage unit 240 stores the terminal-related information 241. The storage unit 240 is a non-volatile storage device such as a hard disk drive (HDD) or a solid state drive (SDD). The storage unit 240 does not have to be provided in the information processing device 200. For example, the storage unit 240 may be provided in an external server communicably connected to the information processing device 200.

[0041] The terminal-related information 241 is information indicating the correspondence between the multiple information acquisition terminals 100 and the multiple power feed ports, and the position of each of the multiple power feed ports. The terminal-related information 241 is generated when the information acquisition terminal 100 is attached to the power feed port and stored in the storage unit 240. The information acquisition terminal 100 is generated by the information processing unit 220, but may be generated by another device different from the information processing device 200.

[0042] FIG. 4 is a diagram showing an example of the terminal-related information 241. FIG. 4 shows a plurality of information acquisition terminals 100 when the ceiling surface is viewed in plan. The information processing unit 220 sets two-dimensional coordinates for the ceiling surface, thereby making it possible to identify a position within the ceiling surface. Furthermore, each of the plurality of information acquisition terminals 100 is assigned unique identification information (such as "C11" shown in FIG. 4). The information processing unit 220 generates the terminal-related information 241 by associating the identification information of the information acquisition terminal 100 with the coordinates within the ceiling surface.

[0043] As described above, the power outlets to which the information acquisition terminals 100 are attached are arranged regularly. Therefore, once the coordinates of one power outlet are identified, the coordinates of the remaining power outlets can be easily identified. For example, if the power outlets are arranged at intervals of "100" in both the vertical and horizontal directions, the coordinates of each power outlet can be determined based on the coordinates (100, 100) of the top left power outlet, as shown in FIG. 4.

[0044] After being attached to the power outlet, the information acquisition terminal 100 transmits its own identification information to the information processing device 200 in response to a registration request from the information processing device 200's information processing unit 220. At this time, the information acquisition terminal 100 transmits the identification information (for example, "C11" or "C21" shown in FIG. 4) to the information processing device 200 using multi-hop. That is, the information acquisition terminal 100 transmits the identification information in a relay manner using other information acquisition terminals 100 as repeaters. This allows the information processing device 200 to sequentially receive the identification information from the multiple information acquisition terminals 100. Because the information acquisition terminals 100 are regularly arranged, the information processing unit 220 can identify the installation location of the information acquisition terminal 100 that is the sender of the identification information based on the order in which the information is received. The information processing unit 220 associates the identification information of each of the multiple information acquisition terminals 100 with its coordinates, and stores the associated information in the storage unit 240 as terminal-related information 241.

[0045] [Operation] Next, the operation of the information processing system 1 according to the present embodiment will be described.

[0046] The operations of the information processing system 1 mainly include a process of generating a floor map (map information) and a process of displaying the position of a detected object. First, the process of generating a floor map will be described below with reference to FIG.

[0047] [Generate floor map] FIG. 5 is a flowchart showing the floor map generation process performed by the information processing system 1 according to this embodiment.

[0048] 5, the information processing device 200 registers the identification information and positions of a plurality of information acquisition terminals 100 (S10). Specifically, the information processing unit 220 acquires the identification information transmitted from the information acquisition terminals 100 attached to each power feed outlet, identifies the position (coordinates) of the attached power feed outlet, and stores the identification information and the position (coordinates) in association with each other in the storage unit 240.

[0049] Next, the information processing unit 220 acquires image information from each of the multiple information acquisition terminals 100 (S12). In each information acquisition terminal 100, the imaging unit 120 constantly or periodically captures images of the imaging range 121. Alternatively, the imaging unit 120 may capture images only when requested by the information processing unit 220.

[0050] The communication unit 110 of each information acquisition terminal 100 associates image information obtained by imaging with its own identification information and transmits the associated information to the information processing device 200. The information processing unit 220 acquires the image information and the identification information via the communication unit 210. Since the identification information is associated with the image information, the information processing unit 220 can determine from which information acquisition terminal 100 the acquired image information was obtained.

[0051] Next, the information processing section 220 generates a floor map by synthesizing the obtained image information (S14). Figure 6 is a diagram for explaining the floor map generation process.

[0052] As shown in FIG. 6 , image information 311, 312, 321, and 322 are obtained for each information acquisition terminal 100. In this embodiment, the imaging ranges 121 of adjacent information acquisition terminals 100 partially overlap, so that common portions are included at the edges of each piece of image information. The information processing unit 220 generates the floor map 300 by adjusting and synthesizing the size and orientation of each piece of image information so that the common portions match. At this time, the position of each piece of image information corresponds to the position of the information acquisition terminal 100, so adjustments can be made easily. The information processing unit 220 stores the generated floor map 300 in the storage unit 240.

[0053] 5, the output unit 230 displays or outputs the generated floor map 300 (S16). For example, the display unit 231 displays the floor map 300. Alternatively, the transmission unit 232 may transmit the floor map 300 to an external server.

[0054] In this way, since image information obtained by actual imaging is used, it is possible to generate a floor map 300 that represents the actual situation. For example, the positions of furniture 21 such as desks and chairs can be reflected in the floor map 300.

[0055] [Detected object location display] Next, the detected object position display process will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the detected object position display process by the information processing system 1 according to this embodiment. In the following, a person 23 will be described as an example of the detected object.

[0056] 7, the information processing device 200 acquires communication information of the mobile terminal 22 from the multiple information acquisition terminals 100 (S20). Specifically, the information processing unit 220 acquires, via the communication unit 210, communication information indicating the reception strength of the response signal from an information acquisition terminal 100 that has communicated with the mobile terminal 22, among the multiple information acquisition terminals 100.

[0057] Next, the information processing unit 220 identifies the position of the mobile terminal 22 based on the acquired communication information (S22). For example, the information processing unit 220 acquires communication information from at least three information acquisition terminals 100, and identifies the position of the mobile terminal 22 (the position of the person 23) by the principle of triangulation based on the reception strength indicated by each piece of communication information. Alternatively, the information processing unit 220 may identify the position of the information acquisition terminal 100 that has the strongest reception strength as the position of the mobile terminal 22.

[0058] Next, the information processing unit 220 acquires image information from each of the multiple information acquisition terminals 100 (S24). The information processing unit 220 may acquire image information only from information acquisition terminals 100 in the vicinity of the location of the mobile terminal 22. Note that the information processing unit 220 may identify the location of the person 23 carrying the mobile terminal 22 by analyzing the acquired image information.

[0059] Next, the information processing unit 220 identifies the person 23 who carries the mobile terminal 22 (S26). Specifically, the information processing unit 220 identifies personal information of the person 23 based on at least one of the communication information and the image information.

[0060] For example, the storage unit 240 stores personal information such as the face, name, and affiliation of the person 23. The information processing unit 220 detects the face of the person 23 by analyzing image information, and identifies the name, affiliation, and so on of the person 23 based on the detected face. Alternatively, identification information of the mobile terminal 22 and personal information of the holder thereof may be stored in association with each other. The communication information may include the identification information of the mobile terminal 22, and the information processing unit 220 may identify the personal information of the holder from the identification information included in the communication information.

[0061] Next, the information processing unit 220 superimposes the terminal image including the identified personal information on the floor map 300, and the display unit 231 displays the floor map 300 (S28). Fig. 8 is a diagram showing an example of the floor map 300 on which the terminal image 400 is superimposed. The terminal image 400 is superimposed on the floor map 300 at a position where the mobile terminal 22 or person 23 is identified. The terminal image 400 also includes personal information of the identified person 23 (for example, a personal name such as "Mr. A").

[0062] In this way, the position of person 23 can be displayed on floor map 300. By repeatedly superimposing terminal image 400, it is possible to generate and record the behavior history of person 23. Furthermore, instead of person 23, the position of a mobile terminal such as a robot vacuum cleaner may be identified, and the terminal image may be superimposed and displayed at the identified position.

[0063] Note that the acquisition of image information (S24) may not be performed. Alternatively, the acquisition of communication information (S20) may not be performed, and the information processing unit 220 may identify the positions of the mobile terminal 22 and the person 23 based on the image information. Furthermore, the information processing unit 220 may not identify personal information (S26).

[0064] [Effects, etc.] As described above, the information processing system 1 according to this embodiment includes a plurality of information acquisition terminals 100 attached to a plurality of power supply outlets regularly arranged on the ceiling 10 of a space, each of which acquires object information about one or more objects present within a predetermined range around the corresponding power supply outlet, and an information processing device 200. The information processing device 200 includes a communication unit 210 that acquires object information from at least one of the plurality of information acquisition terminals 100 by communicating with the plurality of information acquisition terminals 100, and an output unit 230 that outputs output information obtained from the object information.

[0065] As a result, since the power supply ports are arranged regularly, installation is easy as it is only necessary to attach the information acquisition terminal 100 to each power supply port. Furthermore, after the information acquisition terminal 100 is attached, the regularity of the arrangement can be utilized, making it easy to acquire information within the space.

[0066] Furthermore, for example, the information processing device 200 further includes an information processing unit 220 that acquires terminal-related information 241 from a memory unit 240 that stores terminal-related information 241 indicating the correspondence between the multiple information acquisition terminals 100 and the multiple power feed outlets and the positions of each of the multiple power feed outlets, and generates output information indicating the positions of one or more objects in space based on the acquired terminal-related information 241 and object information.

[0067] As a result, since the multiple power outlets are arranged in a regular pattern, the position of each power outlet can be easily identified. In other words, the positions of the multiple information acquisition terminals 100 can also be easily identified, making it easy to identify the position of an object from the object information.

[0068] Furthermore, for example, each of the multiple information acquisition terminals 100 includes an imaging unit 120 that captures an image of the imaging range 121. The object information includes image information obtained by the imaging unit 120.

[0069] This makes it possible to obtain image information within the imaging range 121, and the image information can be used to generate the floor map 300 and identify the positions of the fixtures 21 and people 23, for example.

[0070] Furthermore, for example, the output information includes map information representing a planar layout of the space. The information processing unit 220 generates map information (for example, a floor map 300) by synthesizing the image information obtained for each information acquisition terminal 100 based on the position of each information acquisition terminal 100 indicated by the terminal-related information 241.

[0071] This makes it possible to generate a floor map 300 that reflects the actual arrangement of the fixtures 21. If the arrangement of the fixtures 21 is changed, the floor map 300 can be updated.

[0072] Also, for example, one of the one or more objects is a mobile terminal that can move within a space. Each of the multiple information acquisition terminals 100 includes a communication unit 110 that performs wireless communication with the mobile terminal. The object information includes communication information that indicates the state of communication with the mobile terminal by the communication unit 110. The information processing unit 220 further specifies the position of the mobile terminal on the map information based on the position of each information acquisition terminal 100 indicated by the terminal-related information 241 and the communication information obtained for each information acquisition terminal 100, and superimposes a terminal image 400 representing the mobile terminal at the specified position on the map information.

[0073] This allows the location of the mobile terminal to be identified using the communication information and displayed superimposed on the floor map 300.

[0074] Furthermore, for example, the mobile terminal is a portable terminal 22 carried by a person 23. The information processing unit 220 identifies personal information of the person 23 carrying the portable terminal 22 based on at least one of the communication information and the image information, and generates a terminal image 400 including the identified personal information.

[0075] This makes it possible to generate a behavior history of the person 23 who carries the mobile terminal 22.

[0076] Furthermore, for example, the output unit 230 includes a display unit 231 that displays the output information.

[0077] This makes it possible to display, for example, a floor map 300, and to present information to the user or administrator of the information processing system 1 in a visually easy-to-understand manner.

[0078] Furthermore, for example, the output unit 230 includes a transmission unit 232 that transmits the output information to an external server.

[0079] This allows for application in a variety of situations, for example, by transmitting predetermined output information to an external server. Specific application examples will be described later.

[0080] Furthermore, for example, the ceiling 10 is a system ceiling including support members 11 arranged in a grid pattern and a plurality of ceiling panels 12 supported by the support members 11. The plurality of power supply ports are arranged on either the support members 11 or the plurality of ceiling panels 12.

[0081] This allows multiple power supply ports to be easily arranged regularly.

[0082] Furthermore, for example, an information processing method according to this embodiment includes the steps of acquiring object information from at least one of a plurality of information acquisition terminals 100 attached to a plurality of power supply outlets regularly arranged on a ceiling 10 of a space, each of which communicates with the plurality of information acquisition terminals 100 and acquires object information about one or more objects present within a predetermined range around the corresponding power supply outlet, and outputting output information obtained from the object information. Furthermore, for example, a program according to this embodiment is a program that causes a computer to execute the above information processing method.

[0083] As a result, the information processing method or program according to the present embodiment can achieve the same effects as the information processing system 1.

[0084] (Embodiment 2) Next, a second embodiment will be described.

[0085] The information processing system according to the second embodiment differs from the first embodiment in that it uses BIM (Building Information Modeling) data. The following description will focus on the differences from the first embodiment, and the description of the commonalities will be omitted or simplified.

[0086] [composition] First, the configuration of an information processing system according to this embodiment will be described with reference to Fig. 9. Fig. 9 is a diagram showing the configuration of an information processing system 2 according to this embodiment.

[0087] 9, the information processing system 2 differs from the information processing system 1 shown in Fig. 1 in that it includes an information processing device 500 instead of the information processing device 200. The information processing device 500 includes an information processing unit 520 instead of the information processing unit 220. In addition, BIM data 542 is stored in the memory unit 240 of the information processing device 500.

[0088] BIM data 542 is a collection of various data related to a building. Specifically, BIM data 542 integrates not only data showing the layout, shape, and dimensions of a building, such as three-dimensional CAD (Computer Aided Design) drawings, but also data showing individual components that make up the building (e.g., ceiling 10) and data showing multiple pieces of equipment installed in the building (e.g., fixtures 21). BIM data 542 is created when the architectural design, structural design, and equipment design for a building are completed, and includes various information related to the design, structure, and equipment of the building.

[0089] The information processing unit 520 extracts map information representing the planar layout of the space from the BIM data 542. That is, in this embodiment, the information processing unit 520 uses the BIM data 542 to generate a floor map.

[0090] Furthermore, the information processing unit 520 generates a fixture image representing the shape and orientation of the fixture 21 based on the object information related to the fixture 21. Specifically, the information processing unit 520 identifies the shape and orientation of the fixture 21 by performing image processing such as edge detection on the image information obtained from the information acquisition terminal 100. Alternatively, the information processing unit 520 may identify the shape and orientation of the fixture 21 by reading the two-dimensional code 30 attached to the fixture 21. For example, the information processing unit 520 may identify the shape, position, and orientation of the fixture 21 based on the size and orientation of the two-dimensional code 30 included in the image information obtained by imaging by the imaging unit 120.

[0091] 9, the fixture 21 is provided with a two-dimensional code 30 that can be imaged by the imaging unit 120. The two-dimensional code 30 is a so-called QR code (registered trademark). The two-dimensional code 30 may include access information to a web page indicating the type (e.g., model number) and management number of the fixture 21, or to a file for an administrator.

[0092] The furniture image is an image including the planar shape (for example, only the outline) of the furniture 21. The information processing unit 520 superimposes the generated furniture image onto the position of the furniture 21 on the floor map in accordance with the orientation of the furniture 21.

[0093] Furthermore, in this embodiment, the information processing unit 520 may update the BIM data 542 based on the type and position of the fixtures 21. For example, the information processing unit 520 updates the BIM data 542 when the arrangement of the fixtures 21 is changed. This allows the actual arrangement of the fixtures 21 to be reflected in the BIM data 542, and the BIM data 542 can be kept up to date.

[0094] [Operation] Next, the operation of the information processing system 2 according to this embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the operation of the information processing system 2 according to this embodiment.

[0095] 10, the information processing unit 520 acquires information about the fixture 21 from each of the multiple information acquisition terminals 100 (S30). Specifically, the information processing unit 520 acquires, from each information acquisition terminal 100, image information obtained by capturing an image of the fixture 21.

[0096] Next, the information processing unit 520 acquires a floor map from the BIM data 542 (S32).

[0097] Next, the information processing unit 520 analyzes the acquired image information to identify the position, shape, orientation, type, etc. of the fixture 21 (S34). For example, the information processing unit 520 performs image processing such as edge detection on the image information to identify the position, shape, orientation, and type of the fixture 21. Furthermore, if the image information includes a two-dimensional code 30, the information processing unit 520 may identify the type of fixture 21 by referring to a web page or file accessible from the two-dimensional code 30.

[0098] Next, the information processing unit 520 superimposes the fixture image on the floor map. The display unit 231 displays the floor map on which the fixture image is superimposed (S36). FIG. 11 is a diagram showing an example of a floor map 600 on which a fixture image 610 representing the detected fixture 21 is superimposed. The floor map 600 is obtained from the BIM data 542. The fixture image 610 is an image that represents the shape of the fixture 21 in a specified position and in a specified orientation of the fixture 21. The fixture image 610 also includes the type of the fixture 21 (for example, a model number or control number).

[0099] 10, the information processing unit 520 updates the BIM data 542 (S38). For example, the information processing unit 520 changes the placement position of the fixture 21 to the identified position. This makes it possible to update the BIM data 542 to the latest state.

[0100] [Effects, etc.] As described above, in the information processing system 2 according to the present embodiment, the one or more objects include fixtures 21 arranged in the space. The information processing unit 520 generates a fixture image 610 representing the shape and orientation of the fixture 21 based on object information related to the fixture 21, extracts map information representing the planar layout of the space from the BIM data 542, and superimposes the fixture image 610 on the position of the fixture 21 in the extracted map information. The output unit 230 outputs the map information (for example, a floor map 600) on which the fixture image 610 is superimposed as output information.

[0101] This allows for linking with BIM data 542 to access detailed information on the layout of the space and the fixtures 21.

[0102] Furthermore, for example, the information processing unit 520 identifies the type and position of the fixture 21 based on image information including the fixture 21, and updates the BIM data 542 based on the identification results.

[0103] For example, when the fixtures 21 are moved to a position different from when the building was first used (when the BIM data 542 was generated), or when new fixtures 21 are placed, the information processing unit 520 updates or newly registers the position of the fixtures 21. This allows the BIM data 542 to be kept up to date.

[0104] Furthermore, for example, the fixture 21 is provided with a two-dimensional code 30 that can be imaged by the imaging unit 120. The information processing unit 520 identifies the type of fixture 21 based on image information including the two-dimensional code 30.

[0105] This allows more specific information about the fixture 21 to be registered on a website that can be accessed using the two-dimensional code 30, making it easy to obtain a lot of information about the fixture 21.

[0106] As in the first embodiment, the information processing unit 520 may superimpose the terminal image 400 on a floor map 600 extracted from the BIM data 542 created in advance. Alternatively, the information processing unit 520 may superimpose the furniture image 610 on a floor map obtained by synthesizing image information.

[0107] (Application example) Next, an application example of the information processing system 1 or 2 according to each of the above-described embodiments will be described with reference to Fig. 12. Fig. 12 is a diagram showing an application example of the information processing system according to the first or second embodiment.

[0108] FIG. 12 shows a plurality of buildings 711, 712, and 713 to which the information processing system 1 or 2 is applied. A plurality of information acquisition terminals 100 are arranged in each of the buildings 711 to 713. The information processing device 200 or 500 acquires object information from each of the plurality of information acquisition terminals 100, and performs tasks such as generating a floor map, detecting mobile terminals, and identifying fixtures. The information processing device 200 or 500 generates output information based on the object information, and transmits the generated output information to an external server 700. Communication between the information processing device 200 or 500 and the external server 700 is, for example, API (Application Programming Interface) communication.

[0109] The external server 700 is a server for providing predetermined services to users. For example, the external server 700 uses information such as a floor map, furniture layout, and / or human detection results to provide a building user 721 with a service of presenting available furniture (e.g., desks, chairs, and workspaces) and / or the location of a specific person.

[0110] Alternatively, the external server 700 may provide a building manager 722 with a service that assists in furniture placement planning and furniture utilization analysis. Alternatively, the external server 700 may provide a service that controls an autonomous mobile robot 723. The autonomous mobile robot 723 cleans floors, delivers goods, or performs security duties.

[0111] Not only floor maps but also information on the placement of people and / or fixtures can be used, making it possible to provide high-quality services.

[0112] (others) The information processing system, information processing device, and information processing method according to the present invention have been described above based on the above-mentioned embodiment, but the present invention is not limited to the above-mentioned embodiment.

[0113] For example, the regular arrangement of the multiple power feed ports is not limited to an arrangement at equal intervals. For example, the multiple power feed ports may be arranged periodically according to a predetermined rule. Specifically, a first power feed port row consisting of multiple power feed ports arranged at equal intervals at a first interval along a first direction and a second power feed port row consisting of multiple power feed ports arranged at equal intervals at a second interval (different from the first interval) along the first direction may be arranged alternately and repeatedly in the second direction (a direction intersecting or perpendicular to the first direction). Furthermore, for example, the multiple power feed ports may be arranged side by side with the first interval and the second interval alternately repeated. The same applies to the arrangement of the multiple information acquisition terminals 100.

[0114] Furthermore, for example, the imaging ranges 121 of the imaging units 120 of adjacent information acquisition terminals 100 may not overlap with each other. The boundaries of adjacent imaging ranges 121 may coincide with each other, or there may be a predetermined gap between them. Even if the imaging ranges 121 do not overlap, the information processing device 200 can easily combine image information based on the regularity of the arrangement of the information acquisition terminals 100. For example, the information processing device 200 may generate a floor map by complementing the portions not included in the imaging ranges 121.

[0115] Also, for example, the ceiling 10 does not have to be a system ceiling, but may be a board ceiling or a beam-frame ceiling.

[0116] Furthermore, in the above-described embodiments, the processing performed by a specific processing unit may be performed by another processing unit. The order of multiple processes may be changed, or multiple processes may be performed in parallel. The allocation of components included in the information processing system 1 or 2 to multiple devices is an example. For example, components included in one device may be included in another device.

[0117] For example, the processing described in the above embodiments may be realized by centralized processing using a single device (system), or may be realized by distributed processing using multiple devices. Furthermore, the processor that executes the program may be a single processor or multiple processors. That is, centralized processing or distributed processing may be performed.

[0118] In the above embodiments, all or some of the components such as the control unit may be configured with dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU (Central Processing Unit) or a processor reading and executing a software program recorded on a recording medium such as a hard disk drive or semiconductor memory.

[0119] Furthermore, the components such as the information processing unit 220 or 520 may be configured with one or more electronic circuits. Each of the one or more electronic circuits may be a general-purpose circuit or a dedicated circuit.

[0120] The one or more electronic circuits may include, for example, a semiconductor device, an integrated circuit (IC), or a large scale integration (LSI). The IC or LSI may be integrated on a single chip or on multiple chips. Although the IC or LSI is referred to here as an IC or LSI, the name may vary depending on the degree of integration, and may be called a system LSI, a very large scale integration (VLSI), or an ultra large scale integration (ULSI). Also, a field programmable gate array (FPGA), which is programmed after the LSI is manufactured, can be used for the same purpose.

[0121] Furthermore, the general or specific aspects of the present invention may be realized as a system, an apparatus, a method, an integrated circuit, or a computer program. Alternatively, the present invention may be realized as a computer-readable non-transitory recording medium such as an optical disk, a HDD, or a semiconductor memory on which the computer program is stored. Alternatively, the present invention may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0122] In addition, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art would think of, and forms realized by arbitrarily combining the components and functions of each embodiment within the scope of the present invention. [Explanation of symbols]

[0123] 1, 2 Information Processing System 10 Ceiling 11 Support member 12 Ceiling Panel 21 Fixtures 22 Mobile devices 23 people 30 QR Code 100 Information Acquisition Terminal 110 Communications Department (Wireless Communications Department) 120 Imaging unit 121 Imaging range (predetermined range) 200, 500 Information processing equipment 210 Communications Department 220, 520 Information Processing Unit 230 Output section 231 Display section 232 Transmitter 240 Storage section 241 Device-related information 300, 600 floor map 311, 312, 321, 322 Image information 400 terminal images 542 BIM data 610 Fixtures Images 700 External Servers

Claims

1. a plurality of information acquisition terminals attached to a plurality of power supply ports regularly arranged on the ceiling of the space, each of which acquires object information regarding one or more objects present within a predetermined range around the corresponding power supply port; an information processing device, The information processing device includes: a communication unit that communicates with the plurality of information acquisition terminals to acquire the object information from at least one of the plurality of information acquisition terminals; an output unit that outputs output information obtained from the object information, Information processing system.

2. the information processing device further includes an information processing unit that acquires terminal-related information from a storage unit that stores terminal-related information indicating a correspondence between the plurality of information acquisition terminals and the plurality of power supply ports and a position of each of the plurality of power supply ports, and generates the output information indicating a position of the one or more objects in the space based on the acquired terminal-related information and the object information. The information processing system according to claim 1 .

3. each of the plurality of information acquisition terminals includes an imaging unit that images the predetermined range; The object information includes image information obtained by the imaging unit. The information processing system according to claim 2 .

4. the output information includes map information representing a planar layout of the space; the information processing unit generates the map information by synthesizing image information obtained for each of the information acquisition terminals based on the positions of the information acquisition terminals indicated by the terminal-related information. The information processing system according to claim 3 .

5. The one or more objects include furniture arranged in the space; The information processing unit generating a fixture image representing the shape and orientation of the fixture based on the object information relating to the fixture; Extracting map information representing a planar layout of the space from BIM (Building Information Modeling) data; The image of the fixture is superimposed on the position of the fixture in the extracted map information; The output unit outputs the map information on which the fixture image is superimposed as the output information. The information processing system according to claim 3 .

6. one of the one or more objects is a mobile terminal that is movable within the space; each of the plurality of information acquisition terminals includes a wireless communication unit that performs wireless communication with the mobile terminal; the object information includes communication information indicating a communication state between the wireless communication unit and the mobile terminal, The information processing unit further Identifying the location of the mobile terminal on the map information based on the location of each of the information acquisition terminals indicated by the terminal-related information and the communication information obtained for each of the information acquisition terminals; superimposing a terminal image representing the mobile terminal at the specified position on the map information; 6. The information processing system according to claim 4 or 5.

7. the mobile terminal is a portable terminal carried by a person, the information processing unit identifies personal information of the person carrying the mobile terminal based on at least one of the communication information and the image information, and generates the terminal image including the identified personal information. The information processing system according to claim 6.

8. The one or more objects include furniture arranged in the space; The information processing unit identifies the type and position of the fixtures based on the image information including the fixtures, and updates BIM (Building Information Modeling) data based on the identification result. The information processing system according to any one of claims 3 to 7.

9. The fixture is provided with a two-dimensional code that can be imaged by the imaging unit, The information processing unit identifies the type of the fixture based on the image information including the two-dimensional code. The information processing system according to claim 8 .

10. the output unit includes a display unit that displays the output information. The information processing system according to any one of claims 1 to 9.

11. the output unit includes a transmission unit that transmits the output information to an external server. The information processing system according to any one of claims 1 to 10.

12. the ceiling is a system ceiling including support members arranged in a grid pattern and a plurality of ceiling panels supported by the support members, The plurality of power supply ports are arranged on either the support member or the plurality of ceiling panels. The information processing system according to any one of claims 1 to 11.

13. a communication unit attached to a plurality of power supply ports regularly arranged on the ceiling of the space, the communication unit communicating with a plurality of information acquisition terminals each acquiring object information relating to one or more objects present within a predetermined range around the corresponding power supply port, and acquiring the object information from at least one of the plurality of information acquisition terminals; an output unit that outputs output information obtained from the object information, Information processing device.

14. a step of communicating with a plurality of information acquisition terminals attached to a plurality of power supply outlets regularly arranged on the ceiling of the space, each of which acquires object information regarding one or more objects present within a predetermined range around a corresponding power supply outlet, and acquiring the object information from at least one of the plurality of information acquisition terminals; and outputting output information obtained from the object information. Information processing methods.

15. A program that causes a computer to execute the information processing method according to claim 14.