Introduction support system, introduction support method, and program

The introduction support system addresses the challenge of pre-introduction status unknown by generating and displaying facility-ready robot scenarios, enhancing the integration process.

JP2025165064APending Publication Date: 2025-11-04TOYOTA JIDOSHA KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024068920
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-22
Publication Date
2025-11-04

AI Technical Summary

Technical Problem

The challenge in introducing robots, such as self-driving vehicles, into a facility is the inability to grasp their operating status before introduction.

Method used

An introduction support system and method that uses a computer to acquire request and facility information, generate content information showing the robot's state in the facility, and display it on a user's terminal to support the introduction process.

Benefits of technology

Enables users to intuitively visualize the robot's operation in the facility, facilitating informed decision-making and effective robot integration.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025165064000001_ABST
    Figure 2025165064000001_ABST
Patent Text Reader

Abstract

To provide an introduction support system, an introduction support method, and a program capable of properly supporting the introduction of a robot.SOLUTION: An introduction support method according to an embodiment acquires requirement information related to introduction of a robot from robot introduction applicants, acquires facility information related to the layout of a facility where the robot is introduced, acquires robot information related to the robot desired to be introduced according to the requirement information, creates content information representing the introduced state of the robot at the facility referring to the facility information and the robot information, and transmits the data to display the content information to the introduction applicants. The introduction support method can create the content information using a machine learning model such as a deep learning.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an introduction support system, an introduction support method, and a program. [Background technology]

[0002] Patent Document 1 discloses a system for managing autonomous vehicles within a hospital. Within the hospital, the autonomous vehicles transport medical supplies, medicines, linens, specimens, meals, and the like. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2023-81320 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when introducing robots such as self-driving vehicles into a facility, there is a problem in that it is not possible to grasp the operating status of the robot in the facility before introducing it. [Means for solving the problem]

[0005] The introduction support method of this embodiment uses a computer to acquire request information regarding robot introduction from a person wishing to introduce a bot, acquire facility information regarding the layout of the facility where the robot will be introduced, acquire robot information regarding the robot that is desired to be introduced in accordance with the request information, refer to the facility information and the robot information to create content information showing the state of the robot introduced in the facility, and send data for displaying the content information to the terminal of the person wishing to introduce the bot.

[0006] The introduction support system of this embodiment uses a computer to acquire request information regarding robot introduction from a person wishing to introduce a robot, acquire facility information regarding the layout of the facility where the robot will be introduced, acquire robot information regarding the robot that the person wishes to introduce in accordance with the request information, refer to the facility information and the robot information to create content information that shows the state of the robot after it has been introduced in the facility, and send data for displaying the content information to the terminal of the person wishing to introduce the robot.

[0007] The program according to this embodiment is a program that causes a computer to execute an introduction support method, and the introduction support method includes the steps of acquiring request information regarding robot introduction from a person wishing to introduce a robot, acquiring facility information regarding the layout of the facility where the robot will be introduced, acquiring robot information regarding the robot that the person wishes to introduce in accordance with the request information, creating content information that indicates the state of the robot introduced in the facility by referring to the facility information and the robot information, and transmitting data for displaying the content information to the person wishing to introduce the robot. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to provide an introduction support system, an introduction support method, and a program that can appropriately support the introduction of a robot. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a schematic diagram illustrating the overall configuration of a management system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a block diagram showing the configuration of an introduction support system. [Figure 3] FIG. 10 is a diagram showing an image of content information. [Figure 4] 1 is a flowchart showing an introduction support method. DETAILED DESCRIPTION OF THE INVENTION

[0010] The present invention will be described below through embodiments of the invention, but the invention according to the claims is not limited to the following embodiments. Furthermore, not all of the configurations described in the embodiments are necessarily essential means for solving the problems.

[0011] The introduction support system according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a schematic diagram showing the overall configuration of the introduction support system. The introduction support system 1 includes an introduction support device 100 and a user terminal 400.

[0012] The user terminal 400 is a tablet computer, a smartphone, a personal computer, or the like. The user terminal 400 may be any information processing device capable of wireless or wired communication. The user U1 is a robot introduction applicant who wishes to introduce the robots 200 and 201. For example, the user U1 is the owner, manager, or area manager of a facility, and wishes to introduce the robots 200 and 201 that perform various services (also called tasks). The user U1 operates the user terminal 400 to introduce the robots 200 and 201 into the facility. The user U1 uses the user terminal 400 to input information required for introduction.

[0013] The user terminal 400 is connected to the introduction support device 100 via a network 600 such as the Internet. The user terminal 400 and the introduction support device 100 transmit and receive data via wireless or wired communication. The introduction support device 100 is used by a supplier P1. The introduction support device 100 is an information processing device such as a tablet computer, a smartphone, or a personal computer.

[0014] The introduction support device 100 and the user terminal 400 can be implemented as a device capable of executing a program, such as a central processing unit (CPU). Various functions can also be realized by the program. The introduction support device 100 and the user terminal 400 have a communication interface for connecting to the network 600.

[0015] The supplier P1 supplies the robots 200, 201 to the user U1 based on an introduction request from the user U1. The supplier P1 is, for example, a sales company, manufacturing company, sales agent, intermediary, or maintenance company of the robot 200. The supplier P1 may also supply multiple types of robots 200, 201. The supply of the robots by the supplier P1 may take the form of sales, leasing, rental, or the like. The supplier P1 may also supply an accessory unit 300, which will be described later.

[0016] The robots 200 and 201 are, for example, autonomous mobile robots that perform services such as transportation, cleaning, security, and guidance. The robots 200 and 201 autonomously move around medical and welfare facilities such as hospitals, rehabilitation centers, nursing homes, and elderly care facilities. The robots 200 and 201 can also be used in commercial facilities such as shopping malls. The robots 200 and 201 have wheels, a chassis, a motor, sensors, a battery, a controller, and the like.

[0017] The robot 200 performs a service by being used in combination with an accessory unit 300. Different accessory units 300 are prepared depending on the service. The robot 201 is a transport robot that performs transport services independently. For example, the robot 201 is equipped with a storage unit for storing items to be transported, and transports the items without using an accessory unit 300. The robots 200 and 201 transport medicines, specimens, medical records, medical equipment, and the like.

[0018] The attachment unit 300 is used in combination with the robot 200 to perform each service. For example, when the robot 200 performs a transport service to transport an object, the attachment unit 300 becomes a transport unit transported by the robot 200. The attachment unit 300 for transport is a wheeled wagon or cart, inside which the object can be loaded. The carriage portion of the robot 200 serves as a stage on which the wagon or the like is mounted.

[0019] The robot 200 has a lifting function for lifting the accessory unit 300. When the carriage portion of the robot 200 enters under the accessory unit 300, the lifting stage or the like lifts the accessory unit 300. This allows the robot 200 to carry the item housed in the accessory unit 300 to its destination. By attaching the accessory unit 300, the robot 200 becomes capable of performing transportation services. The accessory unit 300 for transportation is used for serving and clearing food in restaurants, medical and welfare facilities, etc. The transport unit may also be used for transporting parts in factories, transporting specimens in hospitals, transporting linen in hotels, etc.

[0020] Furthermore, the robot 200 can also provide services other than the transportation service together with other attachment units 300. For example, other services include cleaning services, security services, and guidance services. Therefore, the transportation attachment units 300 include cleaning attachment units, security attachment units 300, and guidance attachment units 300. The robot 200 is equipped with any one of the attachment units. In other words, the attachment units 300 are detachable from the robot 200. The robot 200 is equipped with an attachment unit 300 according to the service to be performed.

[0021] The cleaning attachment unit 300 is a unit for cleaning facilities. The cleaning attachment unit 300 has a vacuum cleaner that sucks up dirt and the like. Alternatively, the cleaning attachment unit 300 has a brush, a floor wiping pad, a mop, and the like. When the robot 200 moves with the cleaning attachment unit 300 attached, the floor surface is cleaned. In other words, the floor surface is cleaned in the area where the robot 200 moves. By attaching the cleaning attachment unit 300, the robot 200 can perform a cleaning service. Furthermore, the cleaning attachment unit 300 may be a remotely controllable robot vacuum cleaner. In this case, the robot 200 performs a cleaning service by remotely controlling the cleaning attachment unit 300 via wireless communication.

[0022] The security accessory unit 300 is a unit for guarding a facility. The security accessory unit 300 has various sensors for detecting intruders and abnormalities, for example. For example, the security accessory unit 300 has sensors such as a camera, an infrared camera, a distance sensor, a light sensor, a heat sensor, and a smoke sensor. The security accessory unit 300 may also have a lighting device for illuminating intruders or abnormal locations. The accessory unit 300 may also have an alarm function for issuing an alert when an abnormality is detected. By attaching the security accessory unit 300 to the robot 200, the robot 200 becomes able to perform security services.

[0023] The guidance accessory unit 300 is a unit for guiding visitors to a facility. For example, the guidance accessory unit 300 provides guidance to visitors to the facility on routes to their destinations. The guidance accessory unit 300 has an input device that allows the visitor to input their destination. The input device has a touch panel and buttons. The input device also has a microphone for voice input. The robot 200 moves to the destination to guide the visitor. The guidance accessory unit 300 may have a display device for displaying the route and a speaker for outputting the route as voice.

[0024] In this way, by using the attachment unit 300 in combination with the robot 200, the robot 200 can perform a plurality of different services. In other words, the robot 200 performs a service according to the attached attachment unit 300. Of course, the number of types of robots that can be introduced is not limited to two. For example, the number of types of robots may be one, or three or more. Furthermore, robots that perform services other than transportation services may be introduced. Dedicated robots that perform various services such as cleaning services, security services, and guide services may be introduced.

[0025] Furthermore, the supplier P1 uses the introduction support device 100 to support the introduction of the robot to the user U1. Specifically, the introduction support device 100 generates an image showing the state of the facility after the robot is introduced. The image may be a moving image or a still image. The introduction support device 100 transmits this image to the user terminal 400 as content information.

[0026] By displaying an image of the content information on the user terminal 400, the user U1 can check how the robot operates in the facility before the robot is introduced. By enabling the prospective user to intuitively grasp the image of the robot being introduced in the facility, the introduction of the robot can be supported. In other words, since the user U1 can easily imagine the state after introduction, the introduction support device 100 can appropriately support the introduction.

[0027] The processing in the introduction support device 100 will be explained below with reference to Fig. 2. Fig. 2 is a block diagram showing the configuration of the introduction support system 1. Note that the introduction support device 100 or the user terminal 400 is not limited to being a single physical device, and may be distributed across multiple devices.

[0028] As described above, the user terminal 400 is an information processing terminal such as a smartphone. The user terminal 400 includes a communication unit 401, a processing unit 402, a storage unit 403, a display unit 404, an input unit 405, and an imaging unit 406. The communication unit 401 has a communication interface such as a Wi-Fi (registered trademark) router. The communication unit 401 transmits and receives data to the communication unit 105 of the introduction support device 100. The communication unit 401 transmits facility information and request information, which will be described later, to the introduction support device 100.

[0029] The processing unit 402 has a processor and the like. The storage unit 403 has storage devices such as a memory, a hard disk drive, and an SSD (Solid State Drive). The storage unit 403 stores programs, various settings, and the like. The processing unit 402 executes the programs recorded in the storage unit 403, thereby performing various processes.

[0030] The display unit 404 has a display device that displays information to the user U1. The display unit 404 displays the processing results of the processing unit 402, data received from the introduction support device 100, etc. The input unit 405 has input devices such as a touch panel, keyboard, and mouse. The input unit 405 accepts data input from the user U1. That is, the data is input by the user U1 operating the touch panel or the like. The request information and facility information are input by the user U1 operating the input unit 405.

[0031] The input unit 405 may also include a microphone for voice input. The imaging unit 406 includes a camera for capturing images of the inside of the facility. The imaging unit 406 may not be provided in the user terminal 400, but may be provided in another device. In other words, the images of the facility may be data captured by another camera device such as a surveillance camera. Input to the user terminal 400 may be text input, touch panel input, selection input, voice input, input in response to voice AI (Artificial Intelligence), etc.

[0032] The introduction support device 100 includes a request information acquisition unit 101, a facility information acquisition unit 102, a robot information acquisition unit 103, a content information generation unit 104, and a communication unit 105. The introduction support device 100 is a server computer or the like that collects data from a user terminal 400. The processor of the introduction support device 100 executes a program stored in the memory to perform the following processing.

[0033] User U1 operates the input unit 405 to input request information regarding robot introduction. The request information acquisition unit 101 acquires the request information sent from the user terminal 400. The request information may include information indicating the robot to be introduced. For example, the request information is information indicating the model number, type, etc. of the robot 200 in the facility. Alternatively, the request information may include information regarding the service to be performed by the robot 200 in the facility. The request information may include the number of robots to be introduced. The request information may include information such as the type of service, frequency, service range, and service time. The request information may include information regarding the accessory unit 300 to be used for the service.

[0034] The request information may include information about the facility to be introduced. For example, the request information may include information about the type, size, area, number of floors, and name of the facility. The request information acquisition unit 101 acquires the request information transmitted from the user terminal 400.

[0035] User U1 operates the input unit 405 to input facility information related to the layout of the facility where the robot will be installed. For example, the facility information is an image of the facility. Still images and moving images captured by the imaging unit 406 serve as the facility information. The facility information is not limited to images of the actual facility, but may also be CG (Computer Graphic) images, etc. Alternatively, the facility information may be map information or design data showing the layout of the facility. The facility information acquisition unit 102 acquires the facility information transmitted from the user terminal 400. The facility information may also be a web page or SNS (Social Network Service) address for the facility, etc. In this case, the facility information acquisition unit 102 can acquire an image of the facility from the web page.

[0036] The communication unit 105 receives data transmitted from the user terminal 400. The communication unit 105 has a communication interface such as a Wi-Fi (registered trademark) router. The request information acquisition unit 101 extracts request information included in the received data. The facility information acquisition unit 102 extracts facility information included in the received data.

[0037] The robot information acquisition unit 103 acquires robot information regarding the robot desired to be introduced in response to the request information. First, the robot information acquisition unit 103 identifies the robot to be introduced based on the request information. For example, if the request information includes the type and model number of the robot, the robot information acquisition unit 103 identifies the robot. If the request information includes the type of service to be provided, the robot information acquisition unit 103 identifies a robot capable of performing the service. The robot information acquisition unit 103 acquires information about the robot to be introduced. The robot information includes images, such as still images or moving images, of the robot to be introduced. Furthermore, the robot information is not limited to images of the actual robot, but may also be CG images, etc. The robot information may include the size and color of the robot. The robot information may also include information about the accessory unit 300 to be used for the service. Furthermore, the introduction support device 100 may have a database in which images of each robot are registered.

[0038] The robot information acquisition unit 103 may identify the robots to be deployed using a machine learning model generated by deep learning. That is, the machine learning model may receive request information as input and output the type and number of robots to be deployed. For example, if the request information includes information such as the type and size of the facility, the robot information acquisition unit 103 may calculate the type and number of robots to be deployed from this information.

[0039] The content information generation unit 104 creates content information showing the state in which a robot has been introduced into a facility, by referencing the facility information and the robot information. The content information is an image showing the state in which a robot is operating within a facility. The image of the content information may be a still image or a moving image. FIG. 3 is a diagram showing an example of an image of the content information. Specifically, FIG. 3 is an image showing a robot 201 traveling through a passageway within a facility 700. In the image of the content information, the robot 201 is traveling through a passageway where pedestrians H10, H20, and H30 are present. This allows the user U1 to intuitively grasp the image of a robot being introduced into a facility, which can help the user make a decision about introducing a robot.

[0040] The content information generating unit 104 generates content information by superimposing an image of the robot on an image of the facility. In other words, the content information generating unit 104 generates a composite image obtained by combining an image of the facility and an image of the robot as content information. Note that the content information is not limited to images of the actual facility and robot, and may be CG images, etc. Furthermore, the content information may be a moving image showing a robot performing a service in the facility.

[0041] Furthermore, if user U1 wishes to introduce multiple robots 200, 201, images of the multiple robots 200, 201 may be superimposed on an image of the facility. For example, the content information generation unit 104 generates, as content information, an image of two or more robots operating in the facility. In this case, user U1 can grasp the state in which two or more robots are operating simultaneously. The content information generation unit 104 may generate content information by superimposing an image of each robot on the image of the facility. In this case, user U1 can grasp the state in which each robot is operating from separate images. Also, an image of robot 200 operating together with attachment unit 300 may be generated.

[0042] The content information generation unit 104 may generate content information using a generation AI. The content information generation unit 104 may generate video that becomes content information using a machine learning model such as a convolutional neural network (CNN). By using the generation AI, it is possible to embed an image of a robot into an image of a facility. The image of the content information may be a CG image or the like.

[0043] When communication unit 105 transmits data for displaying content information to user terminal 400, communication unit 401 of user terminal 400 receives the data. Note that the data for displaying content information may be video data or image data of the content, or may be data indicating a web address of a server or the like to which the content has been uploaded.

[0044] When the user terminal 400 downloads the content information, the display unit 404 displays the content information. Alternatively, when the user terminal 400 accesses the web address of the server, the display unit 404 displays an image indicated by the content information. In this way, the user U1 who wishes to introduce the robot can check how the robot will look in the facility 700 before introducing the robot. This can encourage consideration of introducing the robot.

[0045] The user terminal 400 that receives the data for displaying the content information does not have to be the same device physically as the user terminal 400 that transmits the request information, but may be a different device. Also, the user terminal 400 that receives the content information does not have to be the same device physically as the user terminal 400 that displays the content information, but may be a different device.

[0046] Furthermore, the user terminal 400 that displays the content information may be a head-mounted display, a hologram display, a projector, or the like. The content information may include data for performing VR (Virtual Reality) display, AR (Augmented Reality) display, or MR (Mixed Reality) display. In this case, the display unit 404 may use a head-mounted display or smart glasses to display the video image indicated in the content information.

[0047] The introduction support method will be described using Figure 4. Figure 4 is a flowchart showing the introduction support method. The request information acquisition unit 101 acquires request information from a person who wishes to introduce a robot (S11). The facility information acquisition unit 102 acquires facility information related to the layout of the facility where the robot will be introduced (S12). The robot information acquisition unit 103 acquires robot information related to the robot that is desired to be introduced in response to the request information (S13). The content information generation unit 104 refers to the facility information and the robot information to create content information indicating the state in which the robot has been introduced in the facility (S14). The communication unit 105 transmits data for displaying the content information to the user terminal 400 (S15).

[0048] Furthermore, some or all of the processes performed by the introduction support device 100, the user terminal 400, and the like can be implemented as a computer program. Such programs can be stored on various types of non-transitory computer-readable media and provided to a computer. Non-transitory computer-readable media include various types of tangible recording media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The programs may also be provided to a computer by various types of temporary computer-readable media. Examples of temporary computer-readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable media can be provided to a computer via wired communication paths such as electric wires and optical fibers, or via wireless communication paths.

[0049] The present invention is not limited to the above-described embodiment, and can be modified as appropriate within the scope of the invention. [Explanation of symbols]

[0050] 100 Installation support device 200, 201 Robot 300 Accessory Unit 400 User Terminals 600 Network 700 facilities U1 User (those who wish to implement) P1 Supplier

Claims

1. Using a computer, Obtaining request information regarding the introduction of robots from those who wish to introduce robots, acquiring facility information regarding the layout of the facility in which the robot will be installed; Acquire robot information regarding the robot desired to be introduced in response to the request information; creating content information indicating a state in which the robot has been introduced in the facility by referring to the facility information and the robot information; The introduction support method includes transmitting data for displaying the content information to the terminal of the person who wishes to introduce the content.

2. The introduction support method according to claim 1 , wherein the content information includes data for performing VR display, AR display, or MR display.

3. The introduction support method according to claim 1 or 2, wherein the content information is generated using a generation AI.

4. Using a computer, Obtaining request information regarding the introduction of robots from those who wish to introduce robots, acquiring facility information regarding the layout of the facility in which the robot will be installed; Acquire robot information regarding the robot desired to be introduced in response to the request information; creating content information indicating a state in which the robot has been introduced in the facility by referring to the facility information and the robot information; An introduction support system that transmits data for displaying the content information to the terminal of the person who wishes to introduce the content.

5. A program for causing a computer to execute an introduction support method, The introduction support method includes: acquiring request information regarding the introduction of a robot from a person who wishes to introduce the robot; acquiring facility information regarding the layout of a facility in which the robot will be introduced; acquiring robot information relating to a robot desired to be introduced in response to the request information; creating content information indicating a state in which the robot is introduced in the facility by referring to the facility information and the robot information; and transmitting data for displaying the content information to the person who wishes to introduce the content. program.

Citation Information

Patent Citations

  • In-hospital autonomous driving vehicle management system

    JP2023081320A