Information processing device, information processing system, mobile communication terminal, information processing method, and recording medium

Abstract

An information processing device according to the present disclosure comprises an acquisition unit, an identification unit, an association unit, and a notification unit. The acquisition unit acquires, from each mobile communication terminal, communication identification information of each mobile communication terminal and specific information of a mobile object moving together with each mobile communication terminal. The identification unit detects an object from sensing data generated by a sensor, and identifies specific information of the detected object on the basis of the sensing data. The association unit identifies a combination of the mobile object and the detected object, which correspond to each other, by collating the specific information of the mobile object with the specific information of the detected object. The association unit associates, with the detected object, the communication identification information associated with the mobile object corresponding to the detected object. The notification unit performs notification to the detected object using the communication identification information associated with the detected object.

Description

Information Processing Apparatus, Information Processing System, Mobile Communication Terminal, Information Processing Method, and Recording Medium

[0001] This disclosure relates to an information processing apparatus, an information processing system, a mobile communication terminal, an information processing method, a program, and a recording medium.

[0002] A technique related to this disclosure is disclosed in Patent Document 1. The technique disclosed in Patent Document 1 identifies the IP (Internet Protocol) address of a vehicle whose registration number has been detected based on an image, based on a management table that associates each registration number of a plurality of vehicles with the IP address of each vehicle. Then, the technique communicates with the vehicle using the identified IP address.

[0003] International Publication No. 2020 / 148863

[0004] There is a need for a technique that performs various notifications based on a sensor for a specific object among at least one object detected by the sensor. By performing notifications not uniformly for all of the at least one detected object, but for a specific object that is the notification target among them, the effect of the notification can be enhanced.

[0005] An example of the purpose of this disclosure is to provide a new technique for realizing a notification for a specific object among at least one object detected by a sensor.

[0006] According to one aspect of this disclosure, an information processing apparatus is provided, which includes: acquisition means for acquiring, from each mobile communication terminal, mobile communication terminal information that associates the communication identification information of each mobile communication terminal with the unique information of a moving object that moves together with each mobile communication terminal; identification means for detecting an object from the sensing data generated by a sensor and identifying the unique information of the detected object based on the sensing data; association means for identifying a combination of the moving object and the detected object corresponding to each other by comparing the unique information of the moving object with the unique information of the detected object, and associating the communication identification information associated with the moving object corresponding to the detected object with the detected object; and notification means for performing a notification to the detected object using the communication identification information associated with the detected object.

[0007] Furthermore, according to one aspect of this disclosure, an information processing method is provided in which one or more computers acquire mobile communication terminal information from each mobile communication terminal, which is obtained by linking the communication identification information of each mobile communication terminal with the specific information of a moving object that moves with each mobile communication terminal; detect an object from sensing data generated by a sensor; identify the specific information of the detected object based on the sensing data; identify a corresponding combination of the moving object and the detected object by comparing the specific information of the moving object with the specific information of the detected object; link the communication identification information associated with the moving object corresponding to the detected object to the detected object; and use the communication identification information linked to the detected object to notify the detected object.

[0008] Furthermore, according to one aspect of this disclosure, a program is provided that causes a computer to function as: an acquisition means for acquiring mobile communication terminal information, which is obtained from each mobile communication terminal by linking the communication identification information of each mobile communication terminal with the specific information of a moving object that moves together with each mobile communication terminal; an identification means for detecting an object from sensing data generated by a sensor and identifying the specific information of the detected object based on the sensing data; an identification means for identifying corresponding combinations of the moving object and the detected object by comparing the specific information of the moving object with the specific information of the detected object, and linking the communication identification information associated with the moving object corresponding to the detected object to the detected object; and a notification means for notifying the detected object using the communication identification information linked to the detected object.

[0009] Furthermore, according to one aspect of this disclosure, a mobile communication terminal is provided, comprising: a first acquisition means for acquiring specific information of a moving object that moves together with the device; a second acquisition means for acquiring notification information and specific information of the notified object from an external device; and a processing means for comparing the specific information of the moving object with the specific information of the notified object and, if a match is found, processing the notification information as information addressed to the device.

[0010] One example of this disclosure illustrates a new technology that enables notification of a specific object among at least one object detected by a sensor.

[0011] Figure 1 is a diagram showing an example of a functional block diagram of an information processing device. Figure 2 is a flowchart showing an example of the processing flow of an information processing device. Figure 3 is a diagram illustrating an example of the overall structure of an information processing system. Figure 4 is a diagram showing an example of the hardware configuration of an information processing device. Figure 5 is a diagram schematically showing an example of the information processed by an information processing device. Figure 6 is a diagram schematically showing another example of the information processed by an information processing device. Figure 7 is a diagram schematically showing another example of the information processed by an information processing device. Figure 8 is a diagram illustrating the movement trajectory information processed by an information processing device. Figure 9 is a diagram illustrating an example of the processing performed by an information processing device. Figure 10 is a diagram showing another example of a functional block diagram of an information processing device. Figure 11 is a diagram illustrating another example of the overall structure of an information processing system. Figure 12 is a diagram showing another example of a functional block diagram of an information processing device. Figure 13 is a diagram showing an example of a functional block diagram of a mobile communication terminal. Figure 14 is a flowchart showing an example of the processing flow of a mobile communication terminal.

[0012] The embodiments of this disclosure will be described below with reference to the drawings. In this disclosure, the drawings are associated with one or more embodiments. In all drawings, similar components are denoted by the same reference numerals, and their descriptions are omitted where appropriate.

[0013] <<First Embodiment>> Figure 1 is a functional block diagram showing an overview of the information processing device 10. Figure 2 is a flowchart showing an example of the processing flow executed by the information processing device 10.

[0014] As shown in Figure 1, the information processing device 10 includes an acquisition unit 11, a identification unit 12, a linking unit 13, and a notification unit 14. These functional units execute the processes shown in the flowchart of Figure 2.

[0015] In S10, the acquisition unit 11 acquires mobile communication terminal information from each mobile communication terminal, which is a combination of the communication identification information of each mobile communication terminal and the specific information of the mobile object moving together with each mobile communication terminal.

[0016] In S11, the identification unit 12 detects an object from the sensing data generated by the sensor and identifies the unique information of the detected object based on the sensing data. Hereinafter, the object detected from the sensing data generated by the sensor may be referred to as the "sensor-detected object".

[0017] In S12, the linking unit 13 identifies corresponding combinations of moving objects and sensor-detected objects by comparing the unique information of the moving object indicated by the mobile communication terminal information acquired in S10 with the unique information of the sensor-detected object identified in S11. Then, the linking unit 13 links the communication identification information associated with a moving object corresponding to a sensor-detected object to that sensor-detected object.

[0018] In S13, the notification unit 14 uses the communication identification information associated with the sensor-detected object to notify the sensor-detected object.

[0019] Thus, the information processing device 10 has the characteristic of "acquiring mobile communication terminal information that links the communication identification information of each mobile communication terminal with the specific information of the mobile object that moves together with each mobile communication terminal."

[0020] According to this information processing device 10, the acquired mobile communication terminal information can be used to identify the correspondence between a moving object that moves with each mobile communication terminal and a sensor-detected object detected by the sensor. Based on this identification result, the information processing device 10 can then identify the communication identification information of the mobile communication terminal associated with the moving object corresponding to each sensor-detected object. The information processing device 10 can then use the communication identification information identified for each sensor-detected object to send various notifications to each sensor-detected object.

[0021] Furthermore, the information processing device 10 has the characteristic of acquiring the above-mentioned mobile communication terminal information "from each mobile communication terminal".

[0022] Users of the notification service implemented by the information processing device 10 can receive various benefits by notifying the information processing device 10 of their mobile communication terminal information. For example, users can receive various notifications based on the sensors via their mobile communication terminals. As a result, users can protect themselves and their mobile objects from accidents, etc. Therefore, it is thought that users will proactively notify the information processing device 10 of unique information that can identify themselves and their mobile objects with high accuracy. For this reason, the information processing device 10, which acquires mobile communication terminal information from each mobile communication terminal, can efficiently acquire mobile communication terminal information that can identify each mobile object with high accuracy.

[0023] Furthermore, in a configuration where mobile communication terminal information is acquired from each mobile communication terminal, the inconvenience of the information processing device 10 acquiring information of individuals who are not users of the notification service implemented by the information processing device 10 can be suppressed. With such an information processing device 10, the processing burden on the computer can be reduced compared to acquiring information of an unspecified number of individuals indiscriminately. In addition, privacy issues arising from acquiring information of an unspecified number of individuals indiscriminately can also be mitigated.

[0024] Thus, the information processing device 10 realizes a new technology that enables notification of a specific object among at least one object (sensor-detected object) detected by the sensor.

[0025] <<Second Embodiment>> <Overview> The information processing device 10 of the second embodiment is a concrete implementation of the configuration of the information processing device 10 of the first embodiment. The information processing device 10 uses attribute information (specific information) of the moving object and the sensor-detected object to identify the correspondence between the moving object and the sensor-detected object. This will be explained in detail below.

[0026] <Configuration and Overall Structure of the Information Processing System> First, the configuration and overall structure of the information processing system, including the information processing device 10, will be explained using Figure 3. The information processing system includes the information processing device 10, the wireless communication device 1, and the sensor 2. The information processing system may further include a mobile communication terminal 20.

[0027] Wireless communication device 1 communicates wirelessly with mobile communication terminals 20 located within its communication area 3 (area where radio waves can reach), and obtains mobile communication terminal information from each mobile communication terminal 20. Mobile communication terminal information is information that links the communication identification information (e.g., IP address, etc.) of each mobile communication terminal 20 with the specific information of the moving object 4 that moves with each mobile communication terminal 20. In Figure 3, a car and a person are shown as examples of moving objects 4.

[0028] The wireless communication device 1 can communicate with surrounding mobile communication terminals 20 by employing various wireless communication methods. An example of the wireless communication method used by the wireless communication device 1 is local 5G, but it is not limited to this. The wireless communication device 1 can be configured, for example, as a base station having an antenna, a power supply unit, and a control unit.

[0029] The wireless communication device 1 can transmit mobile communication terminal information received from the mobile communication terminal 20 to the information processing device 10 via a communication network 6 such as the Internet. The wireless communication device 1 may employ MEC (Multi-access Edge Computing) technology when transmitting information to the information processing device 10.

[0030] The wireless communication device 1 can be installed in various locations. It may be installed outdoors or indoors. For example, it may be installed on roads, at intersections, curves, accident-prone areas, etc. It may also be installed in indoor passageways or rooms.

[0031] Sensor 2 senses part or all of the communication area 3 of wireless communication device 1 and generates sensing data. Sensor 2 then transmits the sensing data to information processing device 10 via a communication network 6 such as the Internet.

[0032] Sensor 2 is installed in a position and orientation that allows it to sense part or all of the communication area 3. Similar to wireless communication equipment 1, sensor 2 may be installed outdoors or indoors. One sensor 2 or two or more sensors may be used to sense the communication area 3 of one wireless communication equipment 1. Also, one type of sensor 2 or two or more types of sensors may be used to sense the communication area 3 of one wireless communication equipment 1.

[0033] Examples of sensor 2 include, but are not limited to, cameras, microphones, LiDAR, and radar. The camera may detect visible light and create images, or it may detect electromagnetic waves of other frequencies, such as infrared light, and create images. The camera may also be equipped with a depth-sensing sensor. The camera may generate moving images or still images. The camera may also be a monocular camera or a stereo camera.

[0034] The camera can capture (sens) part or all of the communication area 3 and generate an image (sensing data) that includes the moving object 4 present within the communication area 3. The microphone can collect (sens) sound in the communication area 3 and generate audio data (sensing data) that includes the sound emitted by the moving object 4 present within the communication area 3. The LiDAR and radar can scan (sens) part or all of the communication area 3 and generate scan data (sensing data) that includes the components of reflected waves from the moving object 4 present within the communication area 3. The scan data may be an image or data before imaging.

[0035] The mobile communication terminal 20 has the function of communicating wirelessly with the wireless communication device 1. Furthermore, the mobile communication terminal 20 can connect to a communication network 6, such as the Internet, via the wireless communication device 1, for example.

[0036] When the mobile communication terminal 20 enters the communication area 3 and becomes capable of communicating with the wireless communication device 1, it transmits mobile communication terminal information to the wireless communication device 1.

[0037] Examples of mobile communication terminals 20 include portable devices carried by people, such as smartphones, smartwatches, tablet devices, mobile phones, personal computers, smart glasses, and wearable devices. Other examples of mobile communication terminals 20 include devices mounted on manned or unmanned mobile vehicles.

[0038] The mobile communication terminal 20 moves together with the mobile object 4. The mobile object 4 includes at least one of a person, a manned mobile body, and an unmanned mobile body.

[0039] A manned mobile vehicle is a vehicle designed to carry a person, and examples include, but are not limited to, automobiles, bicycles, motorcycles, micromobility vehicles, wheelchairs, buses, trains, and trucks. Manned mobile vehicles may also be equipped with autonomous driving or remote driving functions.

[0040] An unmanned mobile vehicle is a mobile vehicle that does not carry a person, and examples include, but are not limited to, unmanned aircraft and robots with autonomous mobility capabilities (e.g., robots that transport objects).

[0041] The information processing device 10 is, for example, a server. The information processing device 10 may also be a cloud server. Based on the mobile communication terminal information received from the wireless communication device 1 and the sensing data received from the sensor 2, the information processing device 10 identifies the correspondence between the moving object 4 indicated by the received mobile communication terminal information and the sensor-detected object detected from the sensing data. Based on this identification result, the information processing device 10 associates communication identification information for communicating with each sensor-detected object. Specifically, the information processing device 10 associates the communication identification information of the mobile communication terminal 20 that moves together with the moving object 4 corresponding to each sensor-detected object with each sensor-detected object. Thereafter, the information processing device 10 uses the communication identification information associated with each sensor-detected object to send notifications to each sensor-detected object.

[0042] The configuration of the information processing device 10 will be described in detail below.

[0043] <Hardware Configuration of Information Processing Apparatus 10> First, an example of the hardware configuration of information processing apparatus 10 will be described. Each functional unit of information processing apparatus 10 is realized by an arbitrary combination of hardware and software. It is understood by those skilled in the art that there are various modifications to the method and apparatus for realizing this. Software includes programs stored in advance at the stage of shipping the apparatus, programs downloaded from a recording medium such as a CD (Compact Disc), or a server on the Internet, and the like.

[0044] Figure 4 is a block diagram illustrating the hardware configuration of information processing apparatus 10. As shown in Figure 4, information processing apparatus 10 includes a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. Information processing apparatus 10 may not have the peripheral circuit 4A. Note that information processing apparatus 10 may be composed of a plurality of physically and / or logically separated apparatuses. In this case, each of the plurality of apparatuses can have the above-described hardware configuration.

[0045] Bus 5A is a data transmission path for the processor 1A, the memory 2A, the peripheral circuit 4A, and the input / output interface 3A to transmit and receive data to and from each other. The processor 1A is an arithmetic processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The memory 2A is a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The input / output interface 3A includes an interface for acquiring information from an input device, an external device, an external server, an external sensor, a camera, etc., and an interface for outputting information to an output device, an external device, an external server, etc. Further, the input / output interface 3A includes an interface for connecting to a communication network such as the Internet. The input device is, for example, a keyboard, a mouse, a microphone, a physical button, a touch panel, etc. The output device is, for example, a display, a projection device, a speaker, a printer, a mailer, etc. The processor 1A can issue commands to each module and perform operations based on their calculation results.

[0046] <Functional Configuration of Information Processing Apparatus 10> Next, the functional configuration of the information processing apparatus 10 will be described in detail. FIG. 1 is an example of a functional block diagram of the information processing apparatus 10. As shown in the figure, the information processing apparatus 10 includes an acquisition unit 11, a specification unit 12, an association unit 13, and a notification unit 14.

[0047] The acquisition unit 11 acquires mobile communication terminal information in which the communication identification information of each mobile communication terminal 20 is associated with the unique information of the moving object 4 that moves together with each mobile communication terminal 20 from each mobile communication terminal 20. Since the mobile communication terminal 20 and the moving object 4 have been described in <Configuration and Overall Image of Information Processing System>, the description here will be omitted.

[0048] The communication identification information is information used to realize communication with a specific mobile communication terminal 20 among a plurality of mobile communication terminals 20. The information processing apparatus 10 uses the communication identification information to notify a specific mobile communication terminal 20 among a plurality of mobile communication terminals 20.

[0049] An example of communication identification information is an IP address. Other communication identification information may be an email address or a mobile phone number. In this case, the information processing device 10 can send notifications to a specific mobile communication terminal 20 among multiple mobile communication terminals 20 by sending emails or short messages. Alternatively, the communication identification information may be user identification information that identifies users of the notification service provided by the information processing device 10 to each other. In this example, each mobile communication terminal 20 has an application for the notification service provided by the information processing device 10 installed. The mobile communication terminal 20 then logs into the application using user identification information. In this case, the information processing device 10 can send notifications to a specific mobile communication terminal 20 among multiple mobile communication terminals 20 by sending notifications via the application using user identification information. For example, push notifications or notifications on the My Page after logging into the app can be used.

[0050] The unique information of each moving object 4 is specific to each moving object 4 and is used to distinguish each moving object 4 from other moving objects 4.

[0051] The unique information of the moving object 4 is compared with the unique information of the sensor-detected object identified by the sensor 2. For this reason, it is preferable that the unique information of the moving object 4 be information that can be identified by the sensor 2. An example of the unique information of the moving object 4 is the attribute information of the moving object 4. Other examples of the unique information of the moving object 4 will be described in the following embodiment.

[0052] The attribute information of the moving object 4 is information unique to the moving object 4 and includes one or more types of information. Multiple moving objects 4 may be identified by one type of attribute information, or multiple moving objects 4 may be identified by a combination of multiple types of attribute information.

[0053] The attribute information of the moving object 4 may include at least one of the following, for example. Note that the examples of attribute information given here are merely examples and are not limited to those given here. - Type of mobile object 4 (e.g., person, car, bicycle, motorcycle, micromobility, wheelchair, bus, train, truck, unmanned aerial vehicle, autonomous mobile robot, etc.) - Manufacturer / distributor of mobile object 4 - Model number of mobile object 4 (including vehicle type, etc.), size, shape (including 3D / 2D design drawings) - Color and pattern of mobile object 4 - Operating sound of mobile object 4 (engine sound) - Position, size, and shape of parts attached to mobile object 4 - Gender of person (mobile object 4) - Age group of person (mobile object 4) - Nationality of person (mobile object 4) - Height of person (mobile object 4) - Build of person (mobile object 4) - Gait of person (mobile object 4) - Facial information of person (mobile object 4) (facial features) - Type of possessions of person (mobile object 4) (e.g., backpack, handbag, umbrella, suitcase, etc.) - Manufacturer / distributor of the person's (moving object 4) possessions - Size and shape of the person's (moving object 4) possessions - Color and pattern of the person's (moving object 4) possessions - Type of clothing the person (moving object 4) is wearing (e.g., dress, trousers, shorts, skirt, shoes, sandals, high heels, cap, knit hat, etc.) - Manufacturer / distributor of the clothing the person (moving object 4) is wearing - Size and shape of the clothing the person (moving object 4) is wearing - Color and pattern of the clothing the person (moving object 4) is wearing

[0054] Next, the means by which the acquisition unit 11 acquires the above-described mobile communication terminal information from each mobile communication terminal 20 will be explained.

[0055] When the mobile communication terminal 20 enters the communication area 3 of the wireless communication device 1 and becomes able to communicate with the wireless communication device 1, it transmits mobile communication terminal information to the wireless communication device 1. The wireless communication device 1 then transmits the mobile communication terminal information received from the mobile communication terminal 20 to the information processing device 10. In this way, the acquisition unit 11 acquires mobile communication terminal information from the mobile communication terminal 20 via the wireless communication device 1 in response to the mobile communication terminal 20 entering the communication area 3 of the wireless communication device 1.

[0056] The acquisition unit 11 may generate and manage a list as shown in Figure 5 based on the acquired mobile communication terminal information. The list shown in Figure 5 is a list of mobile communication terminals 20 (e.g., mobile communication terminals 20 connected to wireless communication device 1) that are located within the communication area 3 and are in a state where they can communicate with the wireless communication device 1. In the list shown in Figure 5, communication identification information and the specific information of the mobile object 4 are linked. The acquisition unit 11 can register the information acquired from each mobile communication terminal 20 in the list shown in Figure 5. Furthermore, if a specific mobile communication terminal 20 in the list moves outside the communication area 3 and becomes unable to communicate with the wireless communication device 1 (e.g., when the connection with wireless communication device 1 is terminated), the acquisition unit 11 can delete the information of that mobile communication terminal 20 from the list in Figure 5. The acquisition unit 11 can receive notification from the wireless communication device 1 that it has become unable to communicate with a specific mobile communication terminal 20 (e.g., when the connection with wireless communication device 1 has been terminated).

[0057] Next, an example of a means by which the mobile communication terminal 20 acquires attribute information (specific information) of the mobile object 4 will be described. The mobile communication terminal 20 can acquire mobile communication terminal information by at least one of the following first acquisition example and second acquisition example.

[0058] ○First Acquisition Example In the first acquisition example, the user inputs and registers attribute information of the mobile object 4 to the mobile communication terminal 20. For example, the user can register attribute information of the mobile object 4, whose content does not change significantly in a short period of time, at the time they start using the notification service provided by the information processing device 10.

[0059] Examples of attribute information for such a mobile object 4 include the following: • Manufacturer / distributor of mobile object 4 • Model number (including vehicle type, etc.), size, and shape of mobile object 4 (including 3D / 2D design drawings) • Color and pattern of mobile object 4 • Operating sound of mobile object 4 (engine sound) • Position, size, and shape of parts attached to mobile object 4 • Gender of person (mobile object 4) • Age group of person (mobile object 4) • Nationality of person (mobile object 4) • Height of person (mobile object 4) • Build of person (mobile object 4) • Gait of person (mobile object 4) • Facial information of person (mobile object 4) (facial features)

[0060] Furthermore, users can register attribute information of the moving object 4, whose contents may change significantly in a short period of time, each time it changes. Examples of such attribute information for the moving object 4 include the following: • Color and pattern of the person's (moving object 4's) possessions • Type of clothing worn by the person (moving object 4) (e.g., dress, trousers, shorts, skirt, shoes, sandals, high heels, cap, knit hat, etc.) • Manufacturer / distributor of the clothing worn by the person (moving object 4) • Size and shape of the clothing worn by the person (moving object 4) • Color and pattern of the clothing worn by the person (moving object 4)

[0061] There are various means of receiving attribute information of the moving object 4 from the user. For example, the mobile communication terminal 20 can receive such input via an "application for notification services provided by the information processing device 10" installed on its device. The mobile communication terminal 20 may also accept user input in which the attribute information of the moving object 4 is directly entered as text or the like. Alternatively, the mobile communication terminal 20 may accept user input in which the attribute information of the moving object 4 is selected from a set of pre-prepared options. In addition, the mobile communication terminal 20 may accept input of an image taken of the moving object 4. The mobile communication terminal 20 or the information processing device 10 may then analyze the image to estimate the attribute information of the moving object 4.

[0062] The mobile communication terminal 20 can store attribute information of the mobile object 4, acquired by means such as this, in advance within its own device. Then, when the mobile communication terminal 20 enters the communication area 3 of the wireless communication device 1 and becomes capable of communicating with the wireless communication device 1, it can transmit the attribute information of the mobile object 4, which it had stored in advance, along with the communication identification information it had stored in advance, to the wireless communication device 1.

[0063] In addition, the mobile communication terminal 20 may, upon entering the communication area 3 of the wireless communication device 1 and becoming capable of communicating with the wireless communication device 1, notify the user to prompt input of attribute information of the mobile object 4. For example, if the mobile communication terminal 20 enters the communication area 3 of the wireless communication device 1 and becomes capable of communicating with the wireless communication device 1, and the attribute information of the mobile object 4 is not registered in its own device, it may notify the user. The mobile communication terminal 20 can make such notification via an output device such as a display, speaker, or vibrator. If the attribute information of the mobile object 4 is input in response to the notification, the mobile communication terminal 20 may transmit the input attribute information of the mobile object 4 to the wireless communication device 1.

[0064] Furthermore, the mobile communication terminal 20 can acquire communication identification information using widely known technology and store it within its own device.

[0065] ○Second Acquisition Example In the second acquisition example, attribute information of the mobile object 4 is registered in the storage device of the mobile communication terminal 20 from the time of shipment of the mobile communication terminal 20. Then, when the mobile communication terminal 20 enters the communication area 3 of the wireless communication device 1 and becomes capable of communicating with the wireless communication device 1, it can transmit the attribute information of the mobile object 4, which was stored in advance, to the wireless communication device 1, along with the communication identification information that was stored in advance.

[0066] Examples of such attribute information include the following. Note that the registered information may be updated after registration. In this case, the mobile communication terminal 20 is, for example, a terminal installed in the aforementioned manned or unmanned mobile vehicle from the time of shipment. ・Manufacturer / distributor of the mobile object 4 ・Model number (including vehicle type, etc.), size, and shape (including 3D / 2D design drawings) of the mobile object 4 ・Color and pattern of the mobile object 4 ・Operating sound of the mobile object 4 (engine sound) ・Position, size, and shape of parts attached to the mobile object 4

[0067] Furthermore, "acquisition" includes at least one of the following: the device retrieving data or information stored in another device or storage medium (active acquisition), and the device inputting data or information output from another device into its own device (passive acquisition). Examples of active acquisition include making a request to another device and receiving a reply, and accessing and reading data from another device or storage medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Moreover, acquisition may also involve selecting and acquiring data or information from among the received data or information, or selecting and receiving data or information that has been distributed.

[0068] Returning to Figure 1, the identification unit 12 detects an object from the sensing data generated by the sensor 2 and identifies the unique information of the detected sensor-detected object based on the sensing data. The sensor 2 and sensing data were explained in <Configuration and Overall Picture of the Information Processing System>, so their explanation is omitted here.

[0069] The sensor-detected object-specific information is unique to each sensor-detected object and is used to distinguish each sensor-detected object from other sensor-detected objects.

[0070] The unique information of the sensor-detected object is compared with the unique information of the moving object 4 described above. For this reason, it is preferable that the unique information of the sensor-detected object be of the same type as the unique information of the moving object 4 described above. An example of the unique information of the sensor-detected object is the attribute information of the sensor-detected object. The attribute information of the sensor-detected object is of the same type as the attribute information of the moving object 4 described above. Further examples of the unique information of the sensor-detected object will be described in the following embodiment.

[0071] The identification unit 12 acquires sensing data generated by the sensor 2. The identification unit 12 then analyzes the acquired sensing data to detect the sensor-detected object. Furthermore, the identification unit 12 identifies the unique information of the detected sensor-detected object by analyzing the acquired sensing data. The data analysis that enables object detection and identification of the object's unique information can be achieved using widely known technologies.

[0072] For example, by using image analysis technology to analyze images (images generated by cameras, LiDAR, radar, etc.), it is possible to detect sensor-detected objects within the image and identify various attribute information (specific information) of the sensor-detected objects. Furthermore, by using sound source location estimation technology to analyze sounds detected by a microphone, it is possible to identify the sensor-detected object that emitted the sound detected by the microphone (the sound source).

[0073] The identification unit 12 may generate and manage a list as shown in Figure 6 based on the identification results. The list shown in Figure 6 is a list of sensor-detected objects detected within the communication area 3. In the list shown in Figure 6, the identification information of the sensor-detected object ("Detected Object Identification Information" in the figure) and the unique information of the sensor-detected object ("Detected Object Unique Information" in the figure) are linked. The identification unit 12 assigns the identification information of the sensor-detected object to any sensor-detected object newly detected from the sensing data. The identification unit 12 then links the unique information of the newly detected sensor-detected object with the identification information of the sensor-detected object assigned to it and registers it in the list shown in Figure 6. The identification unit 12 may also track the detected sensor-detected object within the sensing data (e.g., images). When a detected sensor-detected object is no longer detected in the sensing data, the identification unit 12 can delete the information of that sensor-detected object from the list in Figure 6.

[0074] Returning to Figure 1, the linking unit 13 identifies corresponding combinations of moving object 4 and sensor-detected object by comparing the unique information of the moving object 4 with the unique information of the sensor-detected object. Then, the linking unit 13 links the communication identification information associated with a moving object 4 that corresponds to a sensor-detected object to that sensor-detected object.

[0075] "The corresponding moving object 4 and the sensor-detected object" are the same object. The matching of specific information to identify such corresponding combinations of moving object 4 and sensor-detected objects is achieved using widely known techniques.

[0076] For example, the linking unit 13 may identify combinations of moving objects 4 and sensor-detected objects whose unique information completely matches as corresponding combinations of moving objects 4 and sensor-detected objects. Alternatively, the linking unit 13 may identify combinations of moving objects 4 and sensor-detected objects whose similarity of their unique information satisfies a predetermined condition (e.g., above a threshold) as corresponding combinations of moving objects 4 and sensor-detected objects. The calculation of similarity can be achieved using widely known techniques. Note that the examples given here are merely examples and are not limited to these examples.

[0077] The linking unit 13 may generate and manage a list like the one shown in Figure 7 based on the identified results. The list shown in Figure 7 is a combined list of the list in Figure 5 and the list in Figure 6. In the list shown in Figure 7, the detection results and mobile communication terminal information are linked. The detection results show the detection results of the sensor-detected object by the identification unit 12 (see Figure 6). The detection results are information that links the identification information of the sensor-detected object ("Identification information of the detected object" in the figure) and the unique information of the sensor-detected object ("Unique information of the detected object" in the figure). The mobile communication terminal information shows the acquisition results of mobile communication terminal information by the acquisition unit 11 (see Figure 5). The mobile communication terminal information is information that links the communication identification information and the unique information of the mobile object 4. The linking unit 13 can generate a list like the one shown in Figure 7 by linking the mobile communication terminal information and detection results of the corresponding mobile object 4 and sensor-detected object.

[0078] Furthermore, the timing of detecting a moving object 4 as a sensor-detectable object and the timing of acquiring mobile communication terminal information from a mobile communication terminal 20 moving with that object 4 do not necessarily coincide. Detection as a sensor-detectable object may occur first, or it may occur later. Therefore, as shown in Figure 7, there may be detection results that are not associated with mobile communication terminal information, or mobile communication terminal information that is not associated with the detection results.

[0079] When the acquisition unit 11 acquires new mobile communication terminal information, the linking unit 13 can register the new mobile communication terminal information in the list shown in Figure 7 accordingly. For example, the linking unit 13 compares the unique information of the mobile object 4 indicated by the newly acquired mobile communication terminal information with the unique information of the sensor-detected object registered in the list shown in Figure 7. At this time, the linking unit 13 can also use the unique information of a sensor-detected object that is not linked to any mobile communication terminal information as a target for comparison. If the linking unit 13 finds unique information of a sensor-detected object that matches the unique information of the mobile object 4 indicated by the newly acquired mobile communication terminal information, it registers the newly acquired mobile communication terminal information linked to the detection result of that sensor-detected object. On the other hand, if the linking unit 13 finds no unique information of a sensor-detected object that matches the unique information of the mobile object 4 indicated by the newly acquired mobile communication terminal information, it registers the newly acquired mobile communication terminal information without linking it to the detection result of any sensor-detected object. Matching in this context means that the specific information matches each other, or that the degree of similarity between the specific information satisfies the predetermined conditions mentioned above.

[0080] Furthermore, when a new sensor-detected object is detected by the identification unit 12, the linking unit 13 can register the detection result (identification information and unique information) of the new sensor-detected object in the list shown in Figure 7. For example, the linking unit 13 compares the unique information of the new sensor-detected object with the unique information of the moving object 4 registered in the list shown in Figure 7. At this time, the linking unit 13 can also use the unique information of a moving object 4 that is not linked to any detection result as the target for comparison. If the linking unit 13 finds unique information of a moving object 4 that matches the unique information of the new sensor-detected object, it registers the detection result of the new sensor-detected object linked to the mobile communication terminal information of that moving object 4. On the other hand, if the linking unit 13 finds no unique information of a moving object 4 that matches the unique information of the new sensor-detected object, it registers the detection result of the new sensor-detected object without linking it to any mobile communication terminal information. Matching here means that the unique information matches each other, or that the similarity of the unique information satisfies the predetermined conditions mentioned above.

[0081] Furthermore, when the sensor-detected object detected by the identification unit 12 is no longer detected in the sensing data, the linking unit 13 can accordingly delete the detection result of that sensor-detected object and the mobile communication terminal information linked to that sensor-detected object from the list in Figure 7.

[0082] The linking unit 13 can create a list, for example, as shown in Figure 7, to link each sensor-detected object and register the communication identification information of the mobile communication terminal 20 linked to the corresponding moving object 4.

[0083] Furthermore, as shown in Figure 7, the linking unit 13 can be linked to each sensor-detected object to register not only "specific information of the sensor-detected object" but also "specific information of the moving object 4". The sensor-detected object and the moving object 4 that correspond to each other are the same object. Therefore, it is expected that the specific information of the sensor-detected object and the moving object 4 that correspond to each other will basically be the same. However, the specific information of the moving object 4 notified from the mobile communication terminal 20 and the specific information of the sensor-detected object identified by the analysis of the sensing data may not necessarily match. By linking these two sets of specific information to the sensor-detected object, the specific information of that sensor-detected object is enriched. As a result, by using this enriched specific information, it becomes possible to detect sensor-detected objects with higher accuracy.

[0084] Returning to Figure 1, the notification unit 14 notifies the sensor-detected object using the communication identification information associated with the sensor-detected object. That is, when the notification unit 14 notifies a first sensor-detected object, which is a specific sensor-detected object among at least one sensor-detected object, it refers to the list shown in Figure 7, for example, to identify the communication identification information associated with the first sensor-detected object. Then, the notification unit 14 uses the identified communication identification information to notify the first sensor-detected object.

[0085] The notification unit 14 can determine which sensor-detected object to notify from among at least one sensor-detected object based on the sensing data generated by the sensor 2. The notification unit 14 can also determine the content of the notification for the target object based on the sensing data generated by the sensor 2.

[0086] The analysis of sensing data to determine the notification target and notification content can be achieved using widely known technologies. For example, the notification unit 14 may input sensing data into a pre-generated predictive AI (Artificial Intelligence) model that detects potential risks and obtain its output. The output can indicate, for example, the presence or absence of each of a predefined number of potential risks, and the sensor-detected object, etc., that is the target of an existing potential risk. Potential risks include, but are not limited to, collision accidents and rollover accidents. The notification content may be, for example, a warning about an existing potential risk.

[0087] Next, an example of the processing flow of the information processing device 10 will be explained using the flowchart in Figure 2. Note that the purpose here is to explain the processing flow. Details of each process have been described above, so explanations will be omitted here as appropriate.

[0088] In S10, the information processing device 10 obtains mobile communication terminal information from each mobile communication terminal 20, which is obtained by linking the communication identification information of each mobile communication terminal 20 with the specific information of the mobile object 4 that moves together with each mobile communication terminal 20.

[0089] In S11, the information processing device 10 detects an object from the sensing data generated by the sensor 2 and identifies the unique information of the detected object (sensor-detected object) based on the sensing data.

[0090] In S12, the information processing device 10 identifies corresponding (identical) combinations of mobile object 4 and sensor-detected object by comparing the unique information of the mobile object 4 indicated by the mobile communication terminal information acquired in S10 with the unique information of the sensor-detected object identified in S11. Then, the information processing device 10 associates the communication identification information associated with a mobile object 4 that corresponds to a sensor-detected object with that sensor-detected object.

[0091] In S13, the information processing device 10 notifies the sensor-detected object using the communication identification information associated with the sensor-detected object.

[0092] <Effects and Effects> The information processing device 10 of the second embodiment can achieve the same effects and effects as the information processing device 10 of the first embodiment.

[0093] Furthermore, the information processing device 10 can identify corresponding combinations of moving object 4 and sensor-detected objects (which are the same object) by matching them using attribute information (specific information) of the objects (including the moving object 4 and the sensor-detected object). With such an information processing device 10, the correspondence between the moving object 4 and the sensor-detected object can be identified with high accuracy.

[0094] Furthermore, as shown in Figure 7, the information processing device 10 can associate not only the sensor-detected object's unique information but also the unique information of the corresponding moving object 4 with the sensor-detected object. Although the corresponding sensor-detected object and the moving object 4 are the same object, the unique information of the moving object 4 notified from the mobile communication terminal 20 and the unique information of the sensor-detected object identified through the analysis of sensing data may not always match. By associating these two sets of unique information with the sensor-detected object, the unique information of that sensor-detected object is enriched. As a result, by utilizing this enriched unique information, it becomes possible to detect sensor-detected objects with higher accuracy.

[0095] <<Third Embodiment>> The information processing device 10 of the third embodiment uses operating state information (specific information) of the moving object and the sensor-detected object to identify the correspondence between the moving object and the sensor-detected object. This will be explained in detail below.

[0096] Figure 1 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11, a identification unit 12, a linking unit 13, and a notification unit 14.

[0097] The acquisition unit 11 acquires information about the operating state of the moving object 4 as specific information about the moving object 4.

[0098] The operating status information is information indicating the operating state of the moving object 4. The mobile communication terminal 20 detects the operating state of the moving object 4 using various sensors and transmits the operating status information indicating the detection result (operating state of the moving object 4) to the wireless communication device 1. The operating status information transmitted by the mobile communication terminal 20 to the wireless communication device 1 may include information indicating the timing (date and time, etc.) of each operating state.

[0099] Examples of sensors for detecting the motion state of the moving object 4 include, but are not limited to, acceleration sensors, velocity sensors, and pressure sensors. Various motion states of the moving object 4 can be detected using such sensors. For example, examples of detected motion states of the moving object 4 include, but are not limited to, being stopped, moving at a speed greater than or equal to a first speed, moving at a speed less than or equal to a first acceleration, decelerating at a speed less than or equal to a second acceleration, going down stairs, going up stairs, etc.

[0100] The operating state of the moving object 4 may change. Therefore, the mobile communication terminal 20 can repeatedly transmit operating state information to the wireless communication device 1 while it is within the communication area 3. For example, the mobile communication terminal 20 may transmit the latest operating state information to the wireless communication device 1 at predetermined intervals. Alternatively, the mobile communication terminal 20 may transmit the latest operating state information to the wireless communication device 1 each time the operating state of the moving object 4 changes.

[0101] The identification unit 12 can generate specific information indicating the operating state of the sensor-detected object based on the sensing data generated by the sensor 2. The specific information generated by the identification unit 12 may include information indicating the timing (date and time, etc.) when the sensor-detected object is in each operating state.

[0102] The identification unit 12 can identify the operating state of the sensor-detected object by analyzing sensing data using widely known technologies. For example, the identification unit 12 can identify the aforementioned operating state of the sensor-detected object by analyzing an image (an image generated by a camera, LiDAR, radar, etc.) in which the sensor-detected object is captured.

[0103] The linking unit 13 identifies corresponding combinations of sensor-detected objects and moving objects 4 by comparing the operating state of the sensor-detected object with the operating state of the moving object 4. The linking unit 13 can identify sensor-detected objects and moving objects 4 that are in the same operating state at the same time as corresponding sensor-detected objects and moving objects 4.

[0104] Other configurations of the information processing device 10 can be the same as those in the first and second embodiments. Furthermore, an example of the configuration of the information processing system is as described in the second embodiment.

[0105] The information processing device 10 of the third embodiment can achieve the same effects as the information processing device 10 of the first and second embodiments. Furthermore, the information processing device 10 can identify corresponding combinations of moving object 4 and sensor-detected objects (which are the same object) by matching them using operational state information (specific information) of the objects (including the moving object 4 and the sensor-detected object). With such an information processing device 10, the correspondence between the moving object 4 and the sensor-detected object can be identified with high accuracy.

[0106] <<Fourth Embodiment>> The information processing device 10 of the fourth embodiment uses movement trajectory information (specific information) of the moving object and the sensor-detected object to identify the correspondence between the moving object and the sensor-detected object. This will be explained in detail below.

[0107] Figure 1 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11, a identification unit 12, a linking unit 13, and a notification unit 14.

[0108] The acquisition unit 11 acquires information about the movement trajectory of the moving object 4 as unique information of the moving object 4.

[0109] The movement trajectory information is information that shows the movement trajectory of the moving object 4. The movement trajectory information shows the shape of the movement trajectory M, as shown in Figure 8. The mobile communication terminal 20 detects the movement trajectory of the moving object 4 using various sensors and transmits the movement trajectory information showing the result of the detection (the movement trajectory of the moving object 4) to the wireless communication device 1. The movement trajectory information that the mobile communication terminal 20 transmits to the wireless communication device 1 may include information indicating the timing (date and time, etc.) of each movement trajectory.

[0110] Examples of sensors used to detect the movement trajectory of the moving object 4 include, but are not limited to, acceleration sensors and position detection sensors (such as GPS (Global Positioning System) sensors). When using an acceleration sensor, the movement trajectory of the moving object 4 can be determined without communication with other devices. For this reason, it is preferable that the movement trajectory of the moving object 4 can be detected even in environments where communication with other devices is difficult, such as inside a tunnel. Determining the movement trajectory using an acceleration sensor can be achieved using widely known technologies.

[0111] The movement trajectory of the moving object 4 may change. Therefore, the mobile communication terminal 20 can repeatedly transmit movement trajectory information to the wireless communication device 1 while it is within the communication area 3. For example, the mobile communication terminal 20 may transmit movement trajectory information showing the movement trajectory for the most recent predetermined time period (e.g., the last few seconds) to the wireless communication device 1 at predetermined intervals.

[0112] The identification unit 12 can generate unique information indicating the movement trajectory of the sensor-detected object based on the sensing data generated by the sensor 2. The unique information generated by the identification unit 12 may include information indicating the timing (date and time, etc.) when the sensor-detected object is on each movement trajectory.

[0113] For example, the identification unit 12 may identify the movement trajectory of a sensor-detected object by tracking the position of the sensor-detected object in an image (an image generated by a camera, LiDAR, radar, etc.) in which the sensor-detected object was detected. Alternatively, the identification unit 12 may identify the movement trajectory of a sensor-detected object based on the history of the position of the sensor-detected object detected by LiDAR, radar, etc. The identification unit 12 identifies the shape of the movement trajectory M as shown in Figure 8.

[0114] The linking unit 13 identifies corresponding combinations of sensor-detected objects and moving objects 4 by comparing the movement trajectory of the sensor-detected object with the movement trajectory of the moving object 4. The linking unit 13 can identify sensor-detected objects and moving objects 4 that are moving on the same trajectory at the same time as corresponding sensor-detected objects and moving objects 4. "Same movement trajectory" means, for example, that the similarity of the shapes of the movement trajectories is above a predetermined threshold. The calculation of the similarity of the shapes of the movement trajectories can be achieved using widely known techniques.

[0115] Other configurations of the information processing device 10 can be the same as those in the first to third embodiments. An example of the configuration of the information processing system is as described in the second embodiment.

[0116] The information processing device 10 of the fourth embodiment can achieve the same effects as the information processing device 10 of the first to third embodiments. Furthermore, the information processing device 10 can identify corresponding combinations of moving object 4 and sensor-detected objects (which are the same object) by matching them using movement trajectory information (specific information) of objects (including moving object 4 and sensor-detected objects). With such an information processing device 10, the correspondence between moving object 4 and sensor-detected objects can be identified with high accuracy.

[0117] <<Fifth Embodiment>> The information processing device 10 of the fifth embodiment identifies the correspondence between a moving object and a sensor-detected object using unique information, which is at least one, for example, multiple, of the attribute information, operating state information, and movement trajectory information of the moving object and the sensor-detected object. This will be explained in detail below.

[0118] Figure 1 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11, a identification unit 12, a linking unit 13, and a notification unit 14.

[0119] The acquisition unit 11 acquires at least one, or for example, more of the following as unique information of the moving object 4: attribute information of the moving object 4, operating state information of the moving object 4, and movement trajectory information of the moving object 4. The acquisition unit 11 can acquire this information using the methods described in the second to fourth embodiments.

[0120] The identification unit 12 generates specific information based on the sensing data generated by the sensor 2, indicating at least one, for example, of the attributes, operating state, and movement trajectory of the object detected by the sensor. The identification unit 12 can generate this information using the methods described in the second to fourth embodiments.

[0121] The linking unit 13 identifies corresponding combinations of sensor-detected objects and moving objects 4 by comparing the unique information of the moving object 4 with the unique information of the sensor-detected object as described above. For example, the linking unit 13 can identify corresponding combinations of sensor-detected objects and moving objects 4 (which are the same object) by comparing multiple pieces of information, including attribute information, operating state information, and movement trajectory information of the objects (including the moving object 4 and the sensor-detected object). By using more information for comparison, the combinations of corresponding moving objects 4 and sensor-detected objects can be identified with high accuracy.

[0122] For example, the linking unit 13 may identify combinations of moving objects 4 and sensor-detected objects where multiple pieces of unique information perfectly match each other as corresponding combinations of moving objects 4 and sensor-detected objects. Alternatively, the linking unit 13 may identify combinations of moving objects 4 and sensor-detected objects where the similarity of multiple pieces of unique information satisfies a predetermined condition (e.g., above a threshold) as corresponding combinations of moving objects 4 and sensor-detected objects. The calculation of similarity can be achieved using widely known techniques. Note that the examples given here are merely examples and are not limited to these examples.

[0123] Other configurations of the information processing device 10 can be the same as those in the first to fourth embodiments. Furthermore, an example of the configuration of the information processing system is as described in the second embodiment.

[0124] The information processing device 10 of the fifth embodiment can achieve the same effects as the information processing device 10 of the first to fourth embodiments. Furthermore, the information processing device 10 can identify corresponding (identical) combinations of sensor-detected objects and moving objects 4 by matching multiple pieces of attribute information, operating state information, and movement trajectory information of the objects (including the moving object 4 and the sensor-detected object). By performing such a matching using more information, the correspondence between the moving object 4 and the sensor-detected object can be identified with high accuracy.

[0125] <<Sixth Embodiment>> In the sixth embodiment, as shown in Figure 9, wireless communication equipment 1 and sensors 2 are installed at each of the multiple monitoring locations. The information processing device 10 then adds at least a portion of the information listed in the first list, which is generated in relation to the first monitoring location, to the second list, which is generated in relation to the second monitoring location. The first and second lists are lists like those shown in Figure 7, which are generated by the linking unit 13. In this way, the information processing device 10 has the function of transferring at least a portion of the information generated in relation to one monitoring location to other monitoring locations. This will be explained in detail below.

[0126] Figure 10 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11, a identification unit 12, a linking unit 13, a notification unit 14, and a handover unit 15.

[0127] The acquisition unit 11 acquires mobile communication terminal information from multiple wireless communication devices 1 installed at multiple monitoring locations. The acquisition unit 11 may also generate and manage a "list of mobile communication terminals 20 that are located within each communication area 3 and are in a state where they can communicate with each wireless communication device 1" for each monitoring location, as shown in Figure 5.

[0128] For example, the identification unit 12 may generate a "list of mobile communication terminals 20 that are located within the communication area 3 of the first wireless communication device 1 installed at the first monitoring location and are in a state where they can communicate with the first wireless communication device 1," as shown in Figure 5, corresponding to the first monitoring location. Alternatively, the identification unit 12 may generate a "list of mobile communication terminals 20 that are located within the communication area 3 of the second wireless communication device 1 installed at the second monitoring location and are in a state where they can communicate with the second wireless communication device 1," as shown in Figure 5, corresponding to the second monitoring location.

[0129] The identification unit 12 acquires sensing data from multiple sensors 2 installed at multiple monitoring locations and identifies specific information of sensor-detected objects based on each sensing data. The identification unit 12 may also generate and manage a "list of sensor-detected objects detected within the communication area 3" as shown in Figure 6 for each monitoring location.

[0130] For example, the identification unit 12 may generate a "list of sensor-detected objects detected within the communication area 3 of the first wireless communication device 1 installed at the first monitoring target location" as shown in Figure 6, corresponding to the first monitoring target location. Alternatively, the identification unit 12 may generate a "list of sensor-detected objects detected within the communication area 3 of the second wireless communication device 1 installed at the second monitoring target location" as shown in Figure 6, corresponding to the second monitoring target location.

[0131] The linking unit 13 matches the unique information of the moving object 4 with the unique information of the sensor-detected object for each monitored location, and identifies the corresponding combination of the moving object 4 and the sensor-detected object. The linking unit 13 can then generate and manage a "list of sensor-detected objects linked to the detection results of the sensing data and the mobile communication terminal information received from the mobile communication terminal 20" for each monitored location, as shown in Figure 7.

[0132] For example, the identification unit 12 can generate a "list of sensor-detected objects detected from sensing data acquired from a sensor 2 installed at the first monitoring target location," as shown in Figure 7, corresponding to the first monitoring target location. The identification unit 12 can also generate a "list of sensor-detected objects detected from sensing data acquired from a sensor 2 installed at the second monitoring target location," as shown in Figure 7, corresponding to the second monitoring target location.

[0133] The handover unit 15 retrieves at least a portion of the information contained in the first list, which is generated in accordance with the first monitored location, from the first list. The handover unit 15 then adds the information retrieved from the first list to the second list, which is generated in accordance with the second monitored location. The first list and the second list are lists like those shown in Figure 7, which are generated by the linking unit 13.

[0134] The first monitored location is the location from which the information is transferred. The second monitored location is the location to which the information is transferred.

[0135] The handover unit 15 can determine the first monitored location from among multiple monitored locations by various means. For example, the handover unit 15 may determine the monitored location where one of the sensor-detected objects listed in the list shown in Figure 7 has been removed from the list (moved outside the communication area 3) as the first monitored location. Alternatively, the handover unit 15 may determine all of the multiple monitored locations as the first monitored location in a predetermined order at a predetermined processing timing. The predetermined processing timing is, for example, every predetermined time, but is not limited to this.

[0136] Furthermore, the handover unit 15 can determine a second monitoring target location from among multiple monitoring target locations by various means. The handover unit 15 can determine a second monitoring target location based on the first monitoring target location determined as the processing target. The handover unit 15 may determine one second monitoring target location corresponding to one first monitoring target location, or it may determine multiple second monitoring target locations.

[0137] For example, the handover unit 15 may determine a second monitoring target location as a monitoring target location that is located within a predetermined distance from each first monitoring target location, corresponding to each first monitoring target location.

[0138] In addition, the handover unit 15 may determine the second monitoring target position based on the direction of movement of the sensor-detected object (a sensor-detected object that has moved outside the communication area 3) that has been removed from the list of first monitoring target positions shown in Figure 7. For example, the handover unit 15 may determine the nearest monitoring target position located ahead in the direction of movement of the sensor-detected object as the second monitoring target position. There are various means for identifying the monitoring target position located ahead in the direction of movement. An example is described below, but is not limited to this.

[0139] For example, the handover unit 15 may specify the direction of movement of a sensor-detected object that has been removed from the list shown in Figure 7 as an angle from 0 to 360° (e.g., north is 0°). Similarly, the handover unit 15 may specify the direction from the first monitored target position toward each monitored target position as an angle from 0 to 360° (e.g., north is 0°). Furthermore, the handover unit 15 may specify a monitored target position where the difference between the above direction of movement and the direction from the first monitored target position toward the monitored target position is less than or equal to a threshold as a monitored target position located further along the direction of movement.

[0140] After determining the first and second monitoring locations as described above, the handover unit 15 adds at least a portion of the information listed in Figure 7 for the first monitoring location to the list shown in Figure 7 for the second monitoring location. For example, the handover unit 15 can add information about sensor-detected objects (sensor-detected objects that have moved outside the communication area 3) that have been removed from the list shown in Figure 7 for the first monitoring location to the list shown in Figure 7 for the second monitoring location. The information about sensor-detected objects (sensor-detected objects that have moved outside the communication area 3) that have been removed from the list shown in Figure 7 for the first monitoring location includes at least one of the detection results and mobile communication terminal information shown in Figure 7.

[0141] The identification unit 12 may use the information transferred from the first monitored location to the second monitored location (specific information of the moving object 4 and specific information of the sensor-detected object) to detect the sensor-detected object from the sensing data generated at the second monitored location. Subsequently, the identification unit 12 may identify the specific information of the detected sensor-detected object based on the sensing data generated at the second monitored location.

[0142] Furthermore, the linking unit 13 may link to the sensor-detected object that has been transferred from the first monitoring target position to the second monitoring target position and register the unique information of that sensor-detected object based on the sensing data generated at the second monitoring target position. In this case, the unique information of the moving object 4, the unique information of that sensor-detected object based on the sensing data generated at the first monitoring target position, and the unique information of that sensor-detected object based on the sensing data generated at the second monitoring target position are registered in association with that sensor-detected object.

[0143] Even for the same sensor-detected object, the unique information identified based on sensing data generated at the first monitoring location may not necessarily match the unique information identified based on sensing data generated at the second monitoring location. For example, the unique information identified based on sensing data generated at each monitoring location may differ depending on the orientation of the sensor-detected object relative to sensor 2, the distance between sensor 2 and the sensor-detected object, the surrounding environment, the sensing environment, etc. By registering both the unique information of the sensor-detected object identified at these different monitoring locations in association with the sensor-detected object, the unique information of that sensor-detected object is enriched. As a result, by utilizing this enriched unique information, it becomes possible to detect sensor-detected objects with higher accuracy.

[0144] Other configurations of the information processing device 10 can be the same as those in the first to fifth embodiments. An example of the configuration of the information processing system is as described in the second embodiment.

[0145] The information processing device 10 of the sixth embodiment can achieve the same effects as the information processing device 10 of the first to fifth embodiments. Furthermore, the information processing device 10 can transfer at least a portion of the information generated in response to one monitored location to other monitored locations. With such an information processing device 10, information that has been generated once can be effectively utilized.

[0146] Furthermore, the information processing device 10 can determine a first monitored location from which information will be transferred and a second monitored location from which information will be transferred through the process described above. By appropriately determining the first and second monitored locations, the transfer of unnecessary information can be suppressed, and the processing burden on the computer can be reduced.

[0147] Furthermore, the information processing device 10 can, for example, transfer information about a sensor-detected object that has moved outside the communication area 3 of the original monitored location to another monitored location. By transferring only such information, the transfer of unnecessary information can be suppressed, thereby reducing the processing load on the computer.

[0148] Furthermore, the information processing device 10 can register both the unique information of the sensor-detected object identified at the source monitoring location and the unique information of the sensor-detected object identified at the destination monitoring location, linking them to the sensor-detected object. With such an information processing device 10, the more information is transferred, the more the unique information of the sensor-detected object can be enriched.

[0149] <<Seventh Embodiment>> <Overview> The information processing device 10 of the seventh embodiment realizes a new technology that enables notification of a specific object among at least one object detected by a sensor, using a method different from that of the information processing device 10 of the first to sixth embodiments. This will be explained in detail below.

[0150] <Configuration and Overall Structure of the Information Processing System> The configuration and overall structure of the information processing system, including the information processing device 10, will be explained using Figure 11. This explanation will focus on the differences from the information processing systems of the first to sixth embodiments. Configurations identical to those of the information processing systems of the first to sixth embodiments will be omitted as appropriate.

[0151] In the seventh embodiment, no notification of mobile communication terminal information is made from the mobile communication terminal 20 to the wireless communication device 1. Each mobile communication terminal 20 stores specific information of the moving object 4 that moves together with each mobile communication terminal 20.

[0152] The information processing device 10 identifies specific information of the sensor-detected object based on the sensing data generated by the sensor 2. When it decides to notify a sensor-detected object, the information processing device 10 broadcasts the notification information and the specific information of the sensor-detected object to be notified to the wireless communication device 1.

[0153] A mobile communication terminal 20 located within the communication area 3 of the wireless communication device 1 receives information broadcast from the wireless communication device 1. The mobile communication terminal 20 then determines whether the received notification information is intended for its own device based on the result of comparing the received sensor-detected object's specific information with the pre-stored specific information of the mobile object 4.

[0154] <Hardware configuration of the information processing device 10> The configuration can be the same as the configuration described in the second embodiment.

[0155] <Hardware Configuration of Mobile Communication Terminal 20> An example of the hardware configuration of the mobile communication terminal 20 will be described. Each functional part of the mobile communication terminal 20 is realized by any combination of hardware and software. It will be understood by those skilled in the art that there are various variations in the method and apparatus of realization. The software includes programs that are stored in advance from the stage of shipment of the device, as well as programs downloaded from recording media such as CDs or from servers on the Internet. An example of the hardware configuration of the mobile communication terminal 20 is shown in Figure 4. The definitions of each element in Figure 4 were explained in the second embodiment, so the explanation is omitted here.

[0156] <Functional Configuration of Information Processing Device 10> Next, the functional configuration of the information processing device 10 will be described in detail. Figure 12 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has a specific unit 12 and a notification unit 14. Note that the information processing device 10 does not have an acquisition unit 11 and a linking unit 13.

[0157] The configuration of the specific part 12 is the same as in the first to sixth embodiments.

[0158] The notification unit 14 sends a predetermined notification to a specific sensor-detected object among the at least one sensor-detected object detected by the identification unit 12. When the notification unit 14 sends a notification to a first sensor-detected object among the at least one sensor-detected object, it identifies the specific information of the first sensor-detected object by referring to a list, for example, shown in Figure 6. The notification unit 14 then broadcasts the notification information and the specific information of the identified first sensor-detected object (notification target object) to the wireless communication device 1. The notification information indicates the content of the notification to the first sensor-detected object. The determination of the notification target and notification content can be achieved by the same process as described in the second embodiment.

[0159] <Functional Configuration of Mobile Communication Terminal 20> Next, the functional configuration of the mobile communication terminal 20 will be described in detail. Figure 13 is an example of a functional block diagram of the mobile communication terminal 20. As shown in the figure, the mobile communication terminal 20 has a first acquisition unit 21, a second acquisition unit 22, and a processing unit 23.

[0160] The first acquisition unit 21 acquires specific information of the moving object 4 that moves together with the device (mobile communication terminal 20). In the second to fourth embodiments, an example of means by which the mobile communication terminal 20 acquires specific information of the moving object 4 has been described. The first acquisition unit 21 can acquire specific information of the moving object 4 that moves together with the device (mobile communication terminal 20) by employing these means.

[0161] The second acquisition unit 22 acquires notification information and specific information of the notified object from an external device. Specifically, the second acquisition unit 22 can receive notification information broadcast by the wireless communication device 1 and specific information of the notified object.

[0162] The processing unit 23 compares the unique information of the moving object 4 with the unique information of the notified object, and if a match is found, processes the notification information as information addressed to its own device. The comparison of the unique information of the moving object 4 with the unique information of the notified object is achieved using widely known techniques.

[0163] For example, the processing unit 23 may determine that a match exists if the unique information of each device is a perfect match. Alternatively, the processing unit 23 may determine that a match exists if the similarity of the unique information of each device satisfies a predetermined condition (e.g., above a threshold). The calculation of similarity can be achieved using widely known techniques. Note that the examples given here are merely examples and are not limited to these examples.

[0164] When processing notification information as information addressed to its own device, the processing unit 23 can, for example, notify the user of that notification information. For example, the processing unit 23 may notify the user by outputting the notification information via the output device of the mobile communication terminal 20.

[0165] In addition, when processing notification information as information addressed to the device itself, the processing unit 23 can, for example, input the notification information to the control device of the moving object 4. The control device of the moving object 4 controls the operation of the moving object 4 (stopping, decelerating, accelerating, starting, changing course, etc.). The control device of the moving object 4 can determine the operation of the moving object 4 based on the input notification information. This processing by the control device of the moving object 4 can be realized using widely known technology.

[0166] On the other hand, if the notification information is not processed as information addressed to the device itself, the processing unit 23 will not send the notification to the user or input the notification information to the control device of the moving object 4. In this case, the processing unit 23 may discard the notification information or otherwise.

[0167] Next, an example of the processing flow of the mobile communication terminal 20 will be explained using the flowchart in Figure 14. Note that the purpose here is to explain the processing flow. Details of each process have been described above, so explanations will be omitted here as appropriate.

[0168] In S20, the mobile communication terminal 20 acquires specific information about the moving object 4 that moves with its device. In S21, the mobile communication terminal 20 acquires notification information and specific information about the notified object from an external device (wireless communication device 1). Then, in S22, the specific information about the moving object 4 is compared with the specific information about the notified object.

[0169] If the specific information of the moving object 4 matches the specific information of the notified object (Yes in S23), the mobile communication terminal 20 processes the acquired notification information as information addressed to its own device (S24). On the other hand, if the specific information of the moving object 4 does not match the specific information of the notified object (No in S23), the mobile communication terminal 20 does not process the acquired notification information as information addressed to its own device (S25).

[0170] <Effects> According to the information processing device 10 of the seventh embodiment, notification can be made to a specific object among at least one object detected by the sensor using a method different from that of the first to sixth embodiments. In this method, the matching of specific information is performed by each mobile communication terminal 20, rather than by the information processing device 10. By distributing the processing among multiple mobile communication terminals 20, the processing burden on the information processing device 10 can be reduced.

[0171] <<Modification>> Here, a modification applicable to the first to seventh embodiments will be described. In the first to seventh embodiments, the information processing device 10 was a server, but the information processing device 10 may be a local device installed at each monitored location. In this case, an information processing device 10 is installed at each monitored location. The information processing device 10 installed at each monitored location performs processing corresponding to each monitored location. The same effects and advantages as in the first to seventh embodiments can be achieved in this modification as well.

[0172] Although this disclosure has been described above with reference to embodiments, this disclosure is not limited to the embodiments described above. Various modifications to the structure and details of this disclosure are possible, which can be understood by those skilled in the art within the scope of this disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0173] Furthermore, the flowcharts used in the above description show multiple steps (processes) in sequence. However, the execution order of the steps performed in each embodiment is not limited to the order in which they are described. In each embodiment, the order of the illustrated steps can be changed to the extent that it does not impede the content.

[0174] Some or all of the above embodiments may also be described as follows, but are not limited to the following: 1. An information processing device having: an acquisition means for acquiring mobile communication terminal information from each mobile communication terminal, which is obtained by linking the communication identification information of each mobile communication terminal with the specific information of a mobile object that moves together with each mobile communication terminal; an identification means for detecting an object from sensing data generated by a sensor and identifying the specific information of the detected object based on the sensing data; an identification means for identifying a corresponding combination of the mobile object and the detected object by comparing the specific information of the mobile object with the specific information of the detected object, and linking the communication identification information associated with the mobile object corresponding to the detected object to the detected object; and a notification means for notifying the detected object using the communication identification information linked to the detected object. 2. 1. The information processing device according to claim 1, wherein the moving object includes at least one of a person, a manned moving object, and an unmanned moving object, and the specific information of the moving object includes at least one of attribute information of the moving object, operating state information of the moving object, and movement trajectory information of the moving object. 3. The information processing device according to claim 1 or 2, wherein the acquisition means acquires mobile communication terminal information from the mobile communication terminal located within the communication area of ​​the wireless communication device, and the identification means detects an object from the sensing data generated by the sensor sensing within the communication area. 4. The information processing device according to any one of claims 1 to 3, wherein the identification means detects an object from first sensing data generated by a first sensor sensing within the first communication area of ​​a first wireless communication device, identifies the specific information of the detected object based on the first sensing data, and the linking means generates a first list showing the detected object and the specific information of the detected object, and registers the communication identification information linked to each of the detected objects listed in the first list. 5. The information processing apparatus according to 4, wherein the linking means links to each of the detected objects listed in the first list and registers the specific information of the corresponding moving object.6. An information processing device according to 4 or 5, further comprising a transfer means for obtaining at least a portion of the information described in the first list from the first list and adding it to a second list, wherein the second list is a list generated based on second sensing data generated by a second sensor that senses within the second communication area of ​​a second wireless communication device, and indicates an object detected based on the second sensing data and specific information of the detected object. 7. An information processing system comprising the information processing device according to 3 and a wireless communication device that receives information from a mobile communication terminal located within the communication area. 8. An information processing method comprising: one or more computers acquiring mobile communication terminal information from each mobile communication terminal, which is a combination of the communication identification information of each mobile communication terminal and the specific information of a moving object moving with each mobile communication terminal; detecting an object from sensing data generated by a sensor; identifying the specific information of the detected object based on the sensing data; identifying corresponding combinations of the moving object and the detected object by comparing the specific information of the moving object with the specific information of the detected object; linking the communication identification information associated with the moving object corresponding to the detected object to the detected object; and using the communication identification information linked to the detected object to notify the detected object. 9. A program that causes a computer to function as: an acquisition means for acquiring mobile communication terminal information from each mobile communication terminal, which is obtained by linking the communication identification information of each mobile communication terminal with the specific information of a moving object that moves with each mobile communication terminal; an identification means for detecting an object from sensing data generated by a sensor and identifying the specific information of the detected object based on the sensing data; an identification means for identifying corresponding combinations of the moving object and the detected object by comparing the specific information of the moving object with the specific information of the detected object, and linking the communication identification information associated with the moving object corresponding to the detected object to the detected object; and a notification means for notifying the detected object using the communication identification information linked to the detected object.10. A mobile communication terminal comprising: a first acquisition means for acquiring specific information of a moving object that moves together with the device; a second acquisition means for acquiring notification information and specific information of the notified object from an external device; and a processing means for comparing the specific information of the moving object with the specific information of the notified object and, if a match is found, processing the notification information as information addressed to the device.

[0175] Some or all of the appendices 2 to 6, which are dependent on the information processing device described in appendice 1 above, may also be dependent on the information processing method in appendice 8 and the program in appendice 9 in the same dependent relationship as between appendice 1 and appendices 2 to 6. Furthermore, without departing from the embodiments described above, some or all of the configurations described as appendices can be realized in various hardware, software, various recording means for recording software, or systems.

[0176] This application claims priority based on Japanese Patent Application No. 2024-167074, filed on 26 September 2024, and incorporates all of its disclosures herein.

[0177] 1 Wireless communication device 2 Sensor 3 Communication area 4 Moving object 6 Communication network 10 Information processing device 11 Acquisition unit 12 Identification unit 13 Linking unit 14 Notification unit 15 Transfer unit 20 Mobile communication terminal 21 First acquisition unit 22 Second acquisition unit 23 Processing unit 1A Processor 2A Memory 3A Input / Output I / F 4A Peripheral circuit 5A Bus

Claims

1. An information processing device comprising: an acquisition means for acquiring mobile communication terminal information from each mobile communication terminal, which is obtained by linking the communication identification information of each mobile communication terminal with the specific information of a mobile object that moves together with each mobile communication terminal; an identification means for detecting an object from sensing data generated by a sensor and identifying the specific information of the detected object based on the sensing data; an identification means for identifying corresponding combinations of the mobile object and the detected object by comparing the specific information of the mobile object with the specific information of the detected object, and linking the communication identification information associated with the mobile object corresponding to the detected object to the detected object; and a notification means for notifying the detected object using the communication identification information linked to the detected object.

2. The information processing apparatus according to claim 1, wherein the moving object includes at least one of a person, a manned moving object, and an unmanned moving object, and the specific information of the moving object includes at least one of attribute information of the moving object, operating state information of the moving object, and movement trajectory information of the moving object.

3. The information processing apparatus according to claim 1 or 2, wherein the acquisition means acquires mobile communication terminal information from the mobile communication terminal located within the communication area of ​​the wireless communication device, and the identification means detects an object from the sensing data generated by the sensor sensing within the communication area.

4. The information processing apparatus according to any one of claims 1 to 3, wherein the identification means detects an object from first sensing data generated by a first sensor that senses within a first communication area of ​​a first wireless communication device, identifies specific information of the detected object based on the first sensing data, and the linking means generates a first list showing the detected object and the specific information of the detected object, and registers the communication identification information linked to each of the detected objects listed in the first list.

5. The information processing apparatus according to claim 4, wherein the linking means is linked to each of the detected objects listed in the first list, and the specific information of the corresponding moving object is registered.

6. The information processing device according to claim 4 or 5, further comprising a transfer means for obtaining at least a portion of the information described in the first list from the first list and adding it to a second list, wherein the second list is a list generated based on second sensing data generated by a second sensor that senses within a second communication area of ​​a second wireless communication device, and the second list indicates an object detected based on the second sensing data and specific information of the detected object.

7. An information processing system comprising: an information processing device according to claim 3; and a wireless communication device that receives information from a mobile communication terminal located within a communication area.

8. An information processing method comprising: one or more computers acquiring mobile communication terminal information from each mobile communication terminal, which is obtained by linking the communication identification information of each mobile communication terminal with the specific information of a moving object that moves with each mobile communication terminal; detecting an object from sensing data generated by a sensor; identifying the specific information of the detected object based on the sensing data; identifying a corresponding combination of the moving object and the detected object by comparing the specific information of the moving object with the specific information of the detected object; linking the communication identification information associated with the moving object corresponding to the detected object to the detected object; and using the communication identification information linked to the detected object to notify the detected object.

9. The information processing method according to claim 8, wherein the moving object includes at least one of a person, a manned moving body, and an unmanned moving body, and the specific information of the moving object includes at least one of attribute information of the moving object, operating state information of the moving object, and movement trajectory information of the moving object.

10. The information processing method according to claim 8 or 9, wherein in the process of acquiring the mobile communication terminal information, the mobile communication terminal information is acquired from the mobile communication terminal located within the communication area of ​​the wireless communication device, and in the process of identifying the specific information, an object is detected from the sensing data generated by the sensor sensing within the communication area.

11. The information processing method according to any one of claims 8 to 10, wherein in the process of identifying the specific information, an object is detected from first sensing data generated by a first sensor that senses within a first communication area of ​​a first wireless communication device, the specific information of the detected object is identified based on the first sensing data, and in the process of associating the communication identification information with the detected object, a first list showing the detected object and the specific information of the detected object is generated, and the communication identification information is registered as associated with each of the detected objects listed in the first list.

12. The information processing method according to claim 11, wherein the process of linking the communication identification information to the detected object is to link it to each of the detected objects listed in the first list and register the specific information of the corresponding moving object.

13. The information processing method according to claim 11 or 12, wherein one or more computers obtain at least a portion of the information described in the first list from the first list and add it to a second list, the second list being a list generated based on second sensing data generated by a second sensor sensing within a second communication area of ​​a second wireless communication device, and indicating an object detected based on the second sensing data and specific information of the detected object.

14. A recording medium that records a program causing a computer to function as: an acquisition means for acquiring mobile communication terminal information, which is obtained from each mobile communication terminal by linking the communication identification information of each mobile communication terminal with the specific information of a moving object that moves with each mobile communication terminal; an identification means for detecting an object from sensing data generated by a sensor and identifying the specific information of the detected object based on the sensing data; an identification means for identifying corresponding combinations of the moving object and the detected object by comparing the specific information of the moving object with the specific information of the detected object, and linking the communication identification information associated with the moving object corresponding to the detected object to the detected object; and a notification means for notifying the detected object using the communication identification information linked to the detected object.

15. The recording medium according to claim 14, wherein the moving object includes at least one of a person, a manned moving body, and an unmanned moving body, and the specific information of the moving object includes at least one of attribute information of the moving object, operating state information of the moving object, and movement trajectory information of the moving object.

16. The recording medium according to claim 14 or 15, wherein the acquisition means acquires mobile communication terminal information from the mobile communication terminal located within the communication area of ​​the wireless communication device, and the identification means detects an object from the sensing data generated by the sensor sensing within the communication area.

17. The recording medium according to any one of claims 14 to 16, wherein the identifying means detects an object from first sensing data generated by a first sensor that senses within a first communication area of ​​a first wireless communication device, identifies specific information of the detected object based on the first sensing data, and the linking means generates a first list indicating the detected object and the specific information of the detected object, and registers the communication identification information linked to each of the detected objects listed in the first list.

18. The recording medium according to claim 17, wherein the linking means is linked to each of the detected objects listed in the first list, and the specific information of the corresponding moving object is registered.

19. The recording medium according to claim 17 or 18, wherein the program causes the computer to function as a transfer means for obtaining at least a portion of the information described in the first list from the first list and adding it to a second list, the second list being a list generated based on second sensing data generated by a second sensor sensing within a second communication area of ​​a second wireless communication device, and indicating an object detected based on the second sensing data and specific information of the detected object.

20. A mobile communication terminal comprising: a first acquisition means for acquiring specific information of a moving object that moves together with the device; a second acquisition means for acquiring notification information and specific information of the notified object from an external device; and a processing means for comparing the specific information of the moving object with the specific information of the notified object and, if a match is found, processing the notification information as information addressed to the device.

Images