Remote robot system and method for controlling the remote robot system
The remote robot system addresses the challenge of user interaction by incorporating interest detection and feedback mechanisms to adapt robot operations based on user behavior, ensuring personalized and responsive experiences.
Patent Information
- Application Number
- JP2021068229
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-04-14
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-04-14
AI Technical Summary
Existing remote robot systems, such as telepresence robots, struggle to appropriately respond to users' interests and reactions due to the guide and participants being remotely located, limiting the system's ability to provide personalized and engaging experiences.
A remote robot system equipped with a first remote terminal for controlling the robot and a second remote terminal for user interaction, featuring an interest detection unit that analyzes user behavior and feedback mechanisms to adjust the robot's operations based on detected user interests, including operation state, utterance state, and attention state, allowing for accurate interest detection and responsive control.
Enables the remote robot system to appropriately respond to users' interests, providing personalized experiences by detecting and reacting to user interactions, ensuring the guide can adapt the tour to meet participants' preferences and reactions.
Smart Images

Figure 0007585946000001 
Figure 0007585946000002 
Figure 0007585946000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a remote robotic system and a method for controlling a remote robotic system. [Background technology]
[0002] In recent years, it has become possible for users to remotely control autonomous robots from an operating terminal. One example of such a robot is a telepresence robot equipped with a camera, microphone, monitor, etc., which allows users to communicate remotely and have simulated experiences. Furthermore, as remote services such as web conferencing services become more widespread, it is expected that robots capable of remote control and remote communication will be widely used.
[0003] In relation to user operations, for example, Patent Document 1 discloses a technology for analyzing a user's web page browsing behavior by a heat map in an analysis server device. Also, Patent Document 2 discloses a technology for specifying a user's area of interest for diagnosis in an image processing device that displays medical images such as X-ray CT images. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2016-224583 A [Patent Document 2] JP 2014-50465 A Summary of the Invention [Problem to be solved by the invention]
[0005] By utilizing robots such as telepresence robots, it is possible to hold remote sightseeing tours where users can participate remotely and have a simulated sightseeing experience. For example, in a remote robot system for remote sightseeing tours, a tour guide (operator) remotely controls the robot, and users (participants) participating in the tour communicate with the guide remotely. However, in such a remote robot system, since the guide and users are remote, it is difficult to respond appropriately to each user. Note that the technology disclosed in Patent Document 1 analyzes web page browsing, and the technology disclosed in Patent Document 2 specifies a diagnostic area of a medical image, and these problems cannot be solved.
[0006] The present invention has been made to solve the above problems, and provides a remote robot system and a control method for a remote robot system that can respond appropriately to a user. [Means for solving the problem]
[0007] A remote robot system according to one aspect of the present invention includes a robot that performs a predetermined operation including collecting local information about the surroundings, a first remote terminal that can remotely control the operation of the robot, and a second remote terminal that can remotely communicate with the first remote terminal, the second remote terminal including an information output unit that outputs the local information acquired from the robot to a user, and an interest detection unit that detects the interest of the user in the output local information. This makes it possible to detect the interest of the user of the second remote terminal, and therefore to grasp the interest of the user and respond appropriately to the user even when the first remote terminal and the second remote terminal are separated from each other.
[0008] The interest detection unit may detect an operation state of the user with respect to the output local information, and detect the interest of the user based on the detected operation state. Furthermore, the operation state may include an operation position, an operation count, or an operation time of the user's operation on a display screen displaying the local information. This makes it possible to accurately detect the interest of the user according to the operation state of the user.
[0009] The interest detection unit may detect the user's vocal state in response to the output local information, and detect the user's interests based on the detected vocal state. The vocal state may include a sound pressure of the voice uttered by the user, a vocal time, or a recognition result of the voice. This makes it possible to accurately detect the user's interests according to the state of the voice uttered by the user.
[0010] The interest detection unit may detect the user's attention state with respect to the output local information, and detect the user's interest based on the detected attention state. The attention state may include the user's face direction, the user's line of sight direction, attention position, or attention time. This allows the user's interest to be detected with high accuracy according to the user's attention state.
[0011] The second remote terminal may further include a notification unit that notifies the first remote terminal of interest information indicating the detected interest, thereby making it possible to reliably feed back the user's interests detected by the second remote terminal to the first remote terminal.
[0012] The first remote terminal may also include an interest output unit that outputs the notified interest information. The interest output unit may highlight a position corresponding to the interest information on a display screen that displays the local information. The interest output unit may also display a change in the interest information over time on a display screen that displays the local information. This allows the first remote terminal to grasp the interests of the user of the second remote terminal at a glance.
[0013] The first remote terminal may also include a remote control determination unit that determines a remote control method for the robot based on the notified interest information. The remote control determination unit may determine a movement method for the robot, including a movement direction, a movement path, or a movement speed of the robot, based on the interest information. The remote control determination unit may also determine an information acquisition method for the robot, including an image capture direction or a sound pickup direction of the robot, based on the interest information. This allows the robot to be remotely controlled appropriately according to the interests of the user of the second remote terminal.
[0014] According to one aspect of the present invention, there is provided a method for controlling a remote robot system, which includes a robot that performs a predetermined operation including collecting local information about the surroundings, a first remote terminal that can remotely control the operation of the robot, and a second remote terminal that can remotely communicate with the first remote terminal, in which the second remote terminal outputs the local information acquired from the robot to a user and detects the user's interest in the output local information. This makes it possible to detect the interest of the user of the second remote terminal, and therefore to grasp the interest of the user and appropriately respond to the user even when the first remote terminal and the second remote terminal are apart from each other. Effect of the Invention
[0015] According to the present invention, it is possible to provide a remote control robot system and a control method for a remote control robot system that can respond appropriately to a user. [Brief description of the drawings]
[0016] [Figure 1] 1 is a configuration diagram showing a configuration example of a remote robot system according to a first embodiment. [Diagram 2] FIG. 1 is an external perspective view showing an example of the external configuration of a robot according to a first embodiment. [Diagram 3] 1 is a block diagram showing an example of a functional configuration of a robot according to a first embodiment. FIG. [Figure 4] 4 is a block diagram showing an example of a functional configuration of a guide terminal in accordance with the first embodiment. FIG. [Diagram 5] 4 is an image diagram showing a configuration example of a display screen of a guide terminal in accordance with the first embodiment. FIG. [Figure 6] 4 is a block diagram showing an example of a functional configuration of a participant terminal according to the first embodiment. FIG. [Figure 7] 4 is an image diagram showing a configuration example of a display screen of a participant terminal according to the first embodiment. FIG. [Figure 8] FIG. 4 is a sequence diagram showing an example of the operation of the remote robot system according to the first embodiment. [Figure 9] 4 is an image diagram showing an example of a screen display of a guide terminal in accordance with the first embodiment. FIG. [Figure 10] 4 is an image diagram showing an example of a screen display of a guide terminal in accordance with the first embodiment. FIG. [Figure 11A] 4 is an image diagram showing an example of a screen display of a guide terminal in accordance with the first embodiment. FIG. [Figure 11B] 4 is an image diagram showing an example of a screen display of a guide terminal in accordance with the first embodiment. FIG. [Figure 12] 4 is an image diagram showing an example of a screen display of a guide terminal in accordance with the first embodiment. FIG. [Figure 13] FIG. 11 is a block diagram showing an example of a functional configuration of a guide terminal in accordance with the second embodiment. [Figure 14]FIG. 11 is a sequence diagram showing an example of the operation of the remote robot system according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In each drawing, the same elements are given the same reference numerals, and repeated explanations will be omitted as necessary. Note that the present invention will be described through the embodiments, but the invention according to the claims is not limited to the following embodiments. Also, not all of the configurations described in the embodiments are necessarily essential as means for solving the problems.
[0018] (Embodiment 1) First, a first embodiment of the present invention will be described. Fig. 1 shows a configuration example of a remote control robot system 10 according to this embodiment. As shown in Fig. 1, the remote control robot system 10 according to this embodiment includes a robot 100, a guide terminal (first remote terminal) 200, a plurality of participant terminals (second remote terminals) 300 (e.g., 300-1 to 300-3), and a system server 400.
[0019] The remote robot system 10 is a system in which a guide (tour guide) G operates a guide terminal 200 to remotely control a robot 100 in a tourist spot (first environment), and a participant P can experience a simulated sightseeing tour through the remotely controlled robot 100. In the remote robot system 10, a plurality of participants P (e.g., P1 to P3) and the guide G connect to the robot 100, which is, for example, a telepresence robot, through terminal devices, and can enjoy a remote sightseeing tour through the robot 100 while sharing the video / audio acquired by the robot 100. One of the users connected to the robot 100 is the guide G, who remotely controls the robot 100 to explain the tourist spot while changing the robot's traveling direction and viewing angle. The participant P enjoys sightseeing from a remote location while watching the video / audio of the robot 100 and the guide G. In this case, the guide G needs to guide the participant P according to his / her interests, but it is difficult to observe the participant P's reactions on the connection terminal of the guide G, making it difficult to provide an appropriate guide. Therefore, in this embodiment, the interests of the participant P are detected, and the detected interests are then fed back to the guide G, enabling the guide G to provide tour guidance, etc. in accordance with the interests of the participant P.
[0020] It should be noted that a plurality of robots 100 may be provided to allow each participant to remotely control or experience a simulated experience. Also, a plurality of guide terminals 200 may be provided to allow a plurality of guides G to remotely control a plurality of robots 100.
[0021] As shown in FIG. 1, the robot 100, the guide terminal 200, and the multiple participant terminals 300 are placed in separate environments (first environment, second environment, and third environment), and are connected to a system server 400 via a wireless router 600 and the Internet 500. For example, the system server 400 provides the robot 100, the guide terminal 200, and the participant terminal 300 with data, processing, services, and the like required for remote control and remote communication. For example, the wireless router 600 and the robot 100, the guide terminal 200, and the participant terminal 300 can communicate with each other via a wireless LAN, but communication may also be performed via mobile phone communication such as LTE (Long Term Evolution) or 5G (5th Generation Mobile Communication System). By using mobile phone communication for communication with the robot 100, the places where the robot 100 can be used are expanded, so that the robot 100 can be remotely controlled in various places. In that case, the wireless router 600 may be a base station for mobile phone communication.
[0022] The robot 100 can execute predetermined operations in the first environment, including collecting local information (including images, sounds, etc.) of the surroundings. The robot 100 is remotely controlled via a system server 400 connected to the Internet 500 by a guide G, who is a remote operator in a second environment away from the first environment, operating a guide terminal 200 (operation terminal). The robot 100 receives various operation signals from the guide terminal 200 and executes movement operations, image capture operations, etc. The guide G and participant P can also communicate remotely via the robot 100.
[0023] The robot 100 captures an image of the space around the robot 100 with a camera 131 (imaging unit) and transmits the captured image (video) to the guide terminal 200 and the participant terminal 300 via the Internet 500. In addition, the robot 100 collects audio around the robot 100 with a microphone 132 and transmits the collected audio to the guide terminal 200 and the participant terminal 300 via the Internet 500. In addition, the robot 100 receives audio from the guide terminal 200 and the participant terminal 300 via the Internet 500 and outputs the received audio from a speaker 133. The robot 100 can also perform a grasping action with the hand 124 in accordance with the operation of the guide terminal 200. This makes it possible to realize various simulated experiences during a sightseeing tour.
[0024] In this embodiment, the Internet 500 is used as the connecting network, but other networks such as an intranet may also be used. Also, the robot 100 and the guide terminal 200 or participant terminal 300 may be directly connected by short-range communication such as Bluetooth (registered trademark) without going through a network. In other words, remote control or remote communication may be performed without going through the Internet 500 or the system server 400.
[0025] The guide terminal 200 is a terminal operated by a guide G in the second environment, remotely controls the robot 100, and also remotely communicates with the participant terminals 300 and the robot 100. The participant terminals 300 (e.g., 300-1 to 300-3) are terminals operated by participants P (e.g., participants P1 to P3) in the third environment (e.g., environment 3-1 to environment 3-3), and remotely communicate with the guide terminal 200, other participant terminals 300, and the robot 100.
[0026] The guide terminal 200 and the participant terminal 300 are, for example, tablet terminals, and have display panels 201 and 301 on which touch panels are arranged in an overlapping manner. The display panels 201 and 301 display captured images received from the robot 100, allowing the guide G and participant P to indirectly visually recognize the state of the spatial area around the robot 100. In other words, the display panel 201 is an information output unit that outputs local information of the robot 100 to the guide G, and the display panel 301 is an information output unit that outputs local information of the robot 100 to the participant P (user).
[0027] Furthermore, the guide terminal 200 and the participant terminal 300 output the sound received from the robot 100, allowing the guide G and the participant P to indirectly hear the sound around the robot 100. The guide G can generate various operation signals for operating the robot 100 by operating the guide terminal 200 via a touch panel. The generated operation signals are transmitted to the robot 100 via the Internet 500.
[0028] The participant terminal 300 also includes an interest detection unit 321 that detects the interest of the participant P in the output local information of the robot 100. The interest detection unit 321 generates interest information indicating the interest of the participant P in response to the participant P's operation on the display screen of the display panel 301 via a touch panel. The generated interest information is transmitted to the guide terminal 200 via the Internet 500. The guide terminal 200 also includes an interest analysis unit 221 that analyzes the interest information received from the participant terminal 300. The analyzed interests of the participant P are displayed on the display panel 201. The display panel 201 also serves as an interest output unit that outputs the interests of the participant P.
[0029] 2 is a perspective view showing an example of the external configuration of the robot 100 according to this embodiment. As shown in FIG 2, the robot 100 according to this embodiment includes a cart unit 110 and a main body unit 120 as main parts.
[0030] The cart unit 110 supports, within a cylindrical housing, two drive wheels 111 and one caster 112, each of which comes into contact with the traveling surface. The two drive wheels 111 are arranged so that their rotational axes coincide with each other. Each drive wheel 111 is independently rotated by a motor (not shown). The caster 112 is a driven wheel, and is provided such that a pivot axis extending vertically from the cart unit 110 is separated from the rotational axis of the wheel to support the wheel, and follows the moving direction of the cart unit 110.
[0031] The cart unit 110 also includes a laser scanner 134 on the periphery of the upper surface. The laser scanner 134 scans a certain range in the horizontal plane for each step angle, and outputs whether or not an obstacle exists in each direction. Furthermore, if an obstacle exists, the laser scanner 134 outputs the distance to the obstacle.
[0032] The main body 120 mainly includes a trunk 121 mounted on the upper surface of the cart 110, a head 122 placed on the upper surface of the trunk 121, an arm 123 supported on the side of the trunk 121, and a hand 124 installed at the tip of the arm 123. The arm 123 and the hand 124 are driven via a motor (not shown) to grasp an object to be grasped. The trunk 121 can rotate around a vertical axis relative to the cart 110 by the driving force of the motor (not shown).
[0033] Head 122 mainly includes camera 131, microphone 132, speaker 133, and display panel 141. Camera 131 is arranged, for example, on the front of head 122 so that the imaging direction is the front direction of head 122. Camera 131 may be a two-dimensional camera or a stereo camera. For example, in the case of a stereo camera, two camera units having the same angle of view are arranged apart from each other, and imaging signals captured by each camera unit are output.
[0034] The microphone 132 is disposed, for example, on the front of the head 122 so that the sound collection direction is the front direction of the head 122. The microphone 132 may be a unidirectional microphone or an omnidirectional microphone. The speaker 133 is disposed, for example, on the front or side of the head 122 so that the output direction is the front direction of the head 122. The speaker 133 may be a monaural speaker or a stereo speaker.
[0035] The display panel 141 is disposed on the front of the head 122 so that the display direction faces the front of the head. The display panel 141 is, for example, a liquid crystal panel, and displays the face of a set character as animation, or displays information about the robot 100 as text or icons. Displaying the face of a character on the display panel 141 can give people around the user the impression that the display panel 141 is a pseudo-face. The display panel 141 can also display images of the guide G and participant P received from the guide terminal 200 and participant terminal 300.
[0036] Head 122 can rotate around a vertical axis relative to torso 121 by the driving force of a motor (not shown). Therefore, camera 131 can capture images in any direction, microphone 132 can pick up sounds in any direction, speaker 133 can output sounds in any direction, and display panel 141 can present display contents in any direction.
[0037] Fig. 3 is a block diagram showing an example of a functional configuration of the robot 100 according to this embodiment. As shown in Fig. 3, the robot 100 includes, as functional blocks, a control unit 150, a cart driving unit 142, an upper body driving unit 143, a memory 160, a communication unit 170, and a GPS unit 135 in addition to the display panel 141, the camera 131, the microphone 132, the speaker 133, and the laser scanner 134 described above.
[0038] Note that, here, we will explain the main elements related to remote operation and remote communication by the guide terminal 200 and the participant terminal 300. However, other elements may also be included as part of the configuration of the robot 100 as necessary, and other elements that contribute to remote operation and remote communication may also be added.
[0039] The control unit 150 is, for example, a CPU (Central Processing Unit), and executes control programs read from the memory 160 to control the entire robot 100 and various arithmetic processing. The control unit 150 also serves as a function execution unit that executes various arithmetic operations and controls related to control.
[0040] The control unit 150 is stored in, for example, a control unit provided in the body 121. The cart drive unit 142 includes the drive wheels 111, and a drive circuit and a motor for driving the drive wheels 111. The control unit 150 executes rotation control of the drive wheels by sending a drive signal to the cart drive unit 142. The control unit 150 also receives a feedback signal from an encoder or the like from the cart drive unit 142 to grasp the moving direction and moving speed of the cart unit 110.
[0041] Upper body drive unit 143 includes arm 123, hand 124, torso 121, head 122, and drive circuits and motors for driving these. Control unit 150 realizes gripping motions and gestures by sending drive signals to upper body drive unit 143. Control unit 150 also receives feedback signals from an encoder or the like from upper body drive unit 143 to grasp the positions and movement speeds of arm 123 and hand 124, and the orientations and rotation speeds of torso 121 and head 122.
[0042] The display panel 141 receives and displays an image signal generated by the control unit 150. The control unit 150 generates an image signal of a character or the like based on information in the memory 160, information to be received, and the like, and displays the image on the display panel 141. For example, if the display panel 141 includes a touch panel, the display panel 141 outputs a touch signal to the control unit 150.
[0043] The camera 131 captures an image, for example, in front of the robot 100 in accordance with a request from the control unit 150, and outputs an imaging signal generated by the imaging to the control unit 150. The control unit 150 performs image processing using the imaging signal from the camera 131, and converts the imaging signal into a captured image in accordance with a predetermined format.
[0044] The microphone 132 collects sounds around the robot 100 in response to a request from the control unit 150, and outputs an audio signal generated by the collected sounds to the control unit 150. The control unit 150 performs audio processing using the audio signal from the microphone 132, and converts the imaging signal according to a predetermined format.
[0045] The speaker 133 outputs, for example, audio transmitted from the guide terminal 200 or the participant terminal 300. The control unit 150 outputs audio signals received from the guide terminal 200 or the participant terminal 300 to the speaker 133 via the communication unit 170, and the speaker 133 outputs the audio signal from the control unit 150 to the surroundings.
[0046] The laser scanner 134 detects whether or not an obstacle exists in the moving direction of the robot 100 in accordance with a request from the control unit 150, and outputs a detection signal that is the detection result to the control unit 150. The GPS unit 135 detects the position of the robot 100 based on a GPS signal received from a GPS (Global Positioning System) satellite in accordance with a request from the control unit 150, and outputs a position signal (position information) that is the detection result to the control unit 150. Note that the position of the robot 100 may be detected by other methods instead of GPS.
[0047] The memory 160 is a non-volatile storage medium, and for example, a solid state drive is used. The memory 160 stores various parameter values, functions, lookup tables, and the like used for control and calculation, in addition to a control program for controlling the robot 100. For example, the memory 160 stores a map DB 161, which is a database of map information describing the space of a first environment in which the robot 100 is scheduled to move autonomously. The map DB 161 is stored by acquiring target map information from, for example, the system server 400, in accordance with the movement range of the robot 100.
[0048] The communication unit 170 is, for example, a wireless LAN unit, and performs wireless communication with the wireless router 600. The communication unit 170 transmits and receives control signals, data, and the like to and from the guide terminal 200 and the participant terminal 300 via the wireless router 600. For example, the communication unit 170 receives a designation signal or an operation instruction sent from the guide terminal 200 and outputs it to the control unit 150. The designation signal is a signal that requests a captured image or a sound signal generated by the guide terminal 200 by designating a spatial area that the user wants to observe. Furthermore, the communication unit 170 transmits a captured image acquired by the camera 131 and a sound acquired by the microphone 132 to the guide terminal 200 and the participant terminal 300 under the control of the control unit 150. The communication unit 170 transmits position information detected by the GPS unit 135 to the guide terminal 200 and the participant terminal 300, and may also transmit map information stored in the map DB 161 to the guide terminal 200 and the participant terminal 300. The communication unit 170 also receives images and sounds sent from the guide terminal 200 and the participant terminal 300 , and outputs them to the control unit 150 .
[0049] Fig. 4 is a block diagram showing an example of a functional configuration of the guide terminal 200 according to this embodiment. As shown in Fig. 4, the guide terminal 200 includes, as functional blocks, a calculation unit 220, a display panel 201, an input unit 202, a microphone 203, a speaker 204, a camera 205, a memory 230, and a communication unit 240.
[0050] Note that, here, the main elements related to remote control of the robot 100 and remote communication between the robot 100 and the participant terminal 300 will be described, but as necessary, the guide terminal 200 may also include other elements, and other elements that contribute to the processing for remote control and remote communication may also be added.
[0051] The calculation unit (control unit) 220 is, for example, a CPU, and executes various calculation processes and controls the entire guide terminal 200 by executing a control program read from the memory 230. The display panel 201 is, for example, a liquid crystal panel, and displays, for example, captured images and map information sent from the robot 100 and the participant terminal 300, captured images captured by the camera 205, etc.
[0052] The input unit 202 includes a touch panel arranged so as to be superimposed on the display panel 201, and push buttons provided on the periphery of the display panel 201. The input unit 202 generates an operation signal in response to an operation of the guide G and outputs the operation signal to the calculation unit 220.
[0053] The microphone 203 collects sounds around the guide terminal 200 in response to a request from the calculation unit 220, and outputs an audio signal generated by the collected sounds to the calculation unit 220. The speaker 204 outputs sounds sent from, for example, the robot 100 or the participant terminal 300. The camera 205 collects an image of, for example, the guide G in front of the guide terminal 200 (in front of the display panel 201) in response to a request from the calculation unit 220, and outputs an image signal generated by the image pickup to the calculation unit 220.
[0054] The memory 230 is a non-volatile storage medium, such as a solid state drive. The memory 230 stores various parameter values, functions, lookup tables, and the like used for control and calculation, in addition to a control program for controlling the guide terminal 200.
[0055] The communication unit 240 is, for example, a wireless LAN unit, and performs wireless communication with the wireless router 600. The communication unit 240 transmits and receives control signals, data, and the like to and from the robot 100 and the participant terminal 300 via the wireless router 600. For example, the communication unit 240 receives captured images, audio signals, map information, and the like sent from the robot 100 and the participant terminal 300, and outputs them to the calculation unit 220. The communication unit 240 also cooperates with the calculation unit 220 to transmit designation signals, operation signals, captured images, audio signals, and the like to the robot 100 and the participant terminal 300.
[0056] The calculation unit 220 also functions as a functional calculation unit that executes various processes and calculations. For example, the calculation unit 220 includes an interest analysis unit 221 and a display control unit 222. The interest analysis unit 221 analyzes the interests of the participant P based on interest information sent from the participant terminal 300. The display control unit 222 displays the analysis results of the interests of the participant P on the display panel 201. For example, information indicating the interests of the participant P is superimposed on a captured image or the like displayed on the display panel 201. It can be said that the display control unit 222 and the display panel 201 cooperate to configure an output unit that outputs interests.
[0057] Fig. 5 shows a configuration example of a guide screen 210 displayed on the display panel 201 of the guide terminal 200 according to this embodiment. As shown in Fig. 5, for example, the guide screen 210 includes a robot image display area 211, a map display area 212, a guide image display area 213, a participant image display area 214, a control panel display area 215, and an interest display area 216. Note that the display of each area in Fig. 5 is merely an example, and is not limited to these.
[0058] The robot image display area 211 displays a captured image of the surroundings of the robot 100 captured and transmitted by the robot 100. In addition, the robot image display area 211 displays, for example, a heat map according to the interests of the participant P superimposed on the captured image of the robot 100.
[0059] The map display area 212 displays map information and position information of the surroundings of the robot 100 transmitted by the robot 100. The map display area 212 displays, for example, information on tourist spots and the like around the robot 100, the current location, travel route, destination, direction, and the like of the robot 100.
[0060] The guide image display area 213 displays a captured image (guide image) mainly including the face of the guide G (pilot) captured by the camera 205. The participant image display area 214 displays captured images (participant images) mainly including the faces of multiple participants P captured and transmitted by multiple participant terminals 300.
[0061] The operation panel display area 215 displays a operation panel for operating (remotely controlling) the robot 100. The operation panel includes buttons for operating the movement direction and movement speed of the robot 100, the camera orientation, and the like.
[0062] The interest display area 216 displays information related to the interests of the participant P. The interest display area 216 displays, for example, a level meter showing the level of the interest and a graph showing the change in the interest over time.
[0063] Fig. 6 is a block diagram showing an example of a block configuration of a participant terminal 300 according to this embodiment. As shown in Fig. 6, the participant terminal 300 includes, as functional blocks, a calculation unit 320, a display panel 301, an input unit 302, a microphone 303, a speaker 304, a camera 305, a memory 330, and a communication unit 340.
[0064] Note that, here, we will explain the main elements related to remote communication with the robot 100, the guide terminal 200, and other participant terminals 300. However, the participant terminal 300 may also include other elements, and other elements that contribute to the processing for remote communication may also be added.
[0065] The calculation unit (control unit) 320 is, for example, a CPU, and executes various calculation processes and controls the entire participant terminal 300 by executing a control program read from the memory 330. The display panel 301 is, for example, a liquid crystal panel, and displays, for example, captured images and map information sent from the robot 100, the guide terminal 200, and other participant terminals 300, captured images captured by the camera 305, and the like.
[0066] The input unit 302 includes a touch panel superimposed on the display panel 301, a push button provided on the periphery of the display panel 301, etc. The input unit 302 generates an operation signal in response to an operation of the participant P, and outputs the operation signal to the calculation unit 320.
[0067] The microphone 303 collects sounds around the participant terminal 300 in response to a request from the calculation unit 320, and outputs an audio signal generated by the collected sounds to the calculation unit 320. The speaker 304 outputs sounds sent from, for example, the robot 100, the guide terminal 200, or other participant terminals 300. The camera 305 collects an image of, for example, the participant P in front of the participant terminal 300 (in front of the display panel 301) in response to a request from the calculation unit 320, and outputs an image signal generated by the image pickup to the calculation unit 320.
[0068] The memory 330 is a non-volatile storage medium, such as a solid state drive. The memory 330 stores a control program for controlling the participant terminal 300, as well as various parameter values, functions, lookup tables, and the like used for control and calculation.
[0069] The communication unit 340 is, for example, a wireless LAN unit, and performs wireless communication with the wireless router 600. The communication unit 340 transmits and receives control signals, data, and the like to and from the robot 100, the guide terminal 200, and the other participant terminals 300 via the wireless router 600. For example, the communication unit 340 receives captured images, audio signals, and map information sent from the robot 100, the guide terminal 200, and the other participant terminals 300, and outputs them to the calculation unit 320. The communication unit 340 also cooperates with the calculation unit 320 to transmit captured images, audio signals, and the like to the guide terminal 200 and the other participant terminals 300.
[0070] The calculation unit 320 also functions as a functional calculation unit that executes various processes and calculations. For example, the calculation unit 320 includes an interest detection unit 321 and an interest notification unit 322. The interest detection unit 321 detects the interests of the participant P in response to an input operation or the like of the participant P. The interest notification unit 322 notifies the guide terminal 200 of interest information indicating the detected interests via the communication unit 340.
[0071] Fig. 7 shows an example of the configuration of a participant screen 310 displayed on the display panel 301 of the participant terminal 300 according to this embodiment. As shown in Fig. 7, for example, the participant screen 310 includes a robot image display area 311, a map display area 312, a participant's own image display area 313, a other participant image display area 314, and a guide image display area 315. Note that the display of each area in Fig. 7 is merely an example, and is not limited to these.
[0072] The robot image display area 311 displays a captured image of the surroundings of the robot 100 captured and transmitted by the robot 100. The map display area 312 displays map information and position information of the surroundings of the robot 100 transmitted by the robot 100. The map display area 312 displays, for example, information on tourist spots and the like around the robot 100, the current location, travel route, destination, direction, and the like of the robot 100.
[0073] The own participant image display area 313 displays a captured image (own participant image) mainly including the face of the own participant P operating the participant terminal 300, captured by the camera 305. The other participant image display area 314 displays a captured image (other participant image) mainly including the face of the other participant P operating the other participant terminal 300, captured by and transmitted from the other participant terminal 300. The guide image display area 315 displays a captured image (guide image) mainly including the face of the guide G, captured by and transmitted from the guide terminal 200.
[0074] Fig. 8 shows an example of the operation of the remote robot system 10 according to this embodiment. As shown in Fig. 8, the guide terminal 200 transmits an operation signal for remotely operating the robot 100 to the robot 100 in response to an operation by the guide G (S101). In the guide terminal 200, when the guide G operates the operation panel displayed in the operation panel display area 215 of the guide screen 210, the calculation unit 220 generates an operation signal indicating control of movement, imaging, etc. in response to the operation by the guide G, and transmits the operation signal to the robot 100 via the communication unit 240.
[0075] Next, the robot 100 moves and captures images in response to the operation signal (S102), and transmits position information and captured images to the guide terminal 200 and the multiple participant terminals 300 (S103). In the robot 100, when the communication unit 170 receives an operation signal from the guide terminal 200, the control unit 150 controls the driving of the cart drive unit 142 and the upper body drive unit 143 in response to the received operation signal, and controls the image capturing operation of the camera 131, etc. The control unit 150 transmits the captured image captured by the camera 131 and position information (latitude, longitude, etc.) detected by the GPS unit 135 to the guide terminal 200 and the multiple participant terminals 300 via the communication unit 170. In addition, map information and voices of the surroundings of the robot 100 are transmitted to the guide terminal 200 and the multiple participant terminals 300 as necessary.
[0076] In addition, the robot 100 may transmit location information and captured images to each of the guide terminal 200 and the multiple participant terminals 300, or the robot 100 may transmit location information and captured images to the guide terminal 200, and then the guide terminal 200 may transfer the location information and captured images to the multiple participant terminals 300.
[0077] Next, the guide terminal 200 and the multiple participant terminals 300 output the information received from the robot 100 (S104). In the guide terminal 200, when the communication unit 240 receives the position information and the captured image from the robot 100, the calculation unit 220 (display control unit 222) displays the received captured image of the robot 100 in the robot image display area 211 of the guide screen 210, and displays the received position information of the robot 100 in the map display area 212. Furthermore, when the guide terminal 200 has received map information from the robot 100, it updates the map information in the map display area 212, and when it has received an audio signal, it outputs audio from the speaker 204.
[0078] Similarly to the guide terminal 200, in the participant terminal 300, when the communication unit 340 receives position information and a captured image from the robot 100, the calculation unit 320 displays the received captured image of the robot 100 in the robot image display area 311 of the participant screen 310, and displays the received position information of the robot 100 in the map display area 312. Furthermore, when the participant terminal 300 has received map information from the robot 100, it updates the map information in the map display area 312, and when it has received an audio signal, it outputs audio from the speaker 304.
[0079] Next, the multiple participant terminals 300 detect the interests of each participant P in response to the operation of each participant P (S105), and transmit interest information indicating the detected interests to the guide terminal 200 (S106). The interest detection unit 321 of the participant terminal 300 detects the interests of the participant P based on, for example, the operation state, vocalization state, attention state, etc. of the participant P. Any of the operation state, vocalization state, attention state, etc. may be used, or any multiple states may be used. When the interest detection unit 321 detects an interest, the interest notification unit 322 transmits information on the detected interests (each state) to the guide terminal 200 via the communication unit 340.
[0080] For example, the interest detection unit 321 detects the operation state of the participant P on the display (output) of the participant screen 310, and detects the interests of the participant P based on the detected operation state. For example, the interest notification unit 322 may transmit interest information including the detected operation state. The detected operation state includes operation elements such as the operation position, the number of operations, and the operation time of the participant P on the participant screen 310 displaying information about the robot 100. Any one of the operation elements may be used, or any multiple operation elements may be used. The detected operation may be a touch operation on the touch panel of the display panel 301, or a mouse pointer movement or a click operation by a mouse operation.
[0081] When detecting the operation position, a specific position operated on the participant screen 310 may be detected, or a predetermined area including the operated position may be detected. For example, the participant screen 310 may be divided into several areas, and a divided area including the operated position may be detected. The interest detection unit 321 detects the operated position or area in the robot image display area 311 or the map display area 312.
[0082] When detecting the number of operations, the number of touches or the number of mouse clicks in a predetermined period may be detected. When detecting the operation time, the duration of touch (long press time) or the duration of click may be detected. For example, when the number of touches in a predetermined area is greater than a predetermined threshold or the duration of touch is long, the interest detection unit 321 may detect and transmit that the interest in the corresponding area is high (excited).
[0083] Furthermore, the interest detection unit 321 detects the participant P's vocal state in response to the display of the participant screen 310, and detects the participant P's interests based on the detected vocal state. The interest notification unit 322 may transmit interest information including the detected vocal state. The detected vocal state includes vocal elements such as the sound pressure of the voice uttered by the participant P, the vocalization time, and the voice recognition result (keywords). Any of the vocal elements may be used, or any multiple vocal elements may be used.
[0084] The interest detection unit 321 detects, for example, the sound pressure of the voice of the participant P by the microphone 303. The sound pressure of the voice uttered by the participant P by the microphone 303 may be detected to detect excitement such as "Oh!" or "Amazing!". When detecting the duration of the voice utterance, the interest detection unit 321 may detect the duration for which a predetermined sound pressure continues. For example, the interest detection unit 321 may detect that the interest of the participant P is increasing when the sound pressure of the participant P is higher than a predetermined threshold or when a predetermined sound pressure continues for a predetermined time.
[0085] The interest detection unit 321 may detect a predetermined voice by voice recognition. For example, when the voice of the participant P detected by the microphone 303 is recognized as a predetermined voice indicating excitement such as "Oh!" or "Amazing", it may be detected that the interest of the participant P is increasing. In this case, it is preferable to recognize a predetermined keyword related to the interest. For example, it may be a keyword related to the name of a building or a tourist spot in the vicinity of the robot 100. Furthermore, it is not limited to a positive keyword for interest (excitement), and a negative keyword may be detected. Note that, when the participant terminal 300 is performing remote communication, a vocal state for interest may be detected with the remote communication voice muted.
[0086] Furthermore, the interest detection unit 321 may detect the participant's state of attention to the display of the participant screen 310, and detect the interest of the participant P based on the detected state of attention. The interest notification unit 322 may transmit interest information including the detected state of attention. The detected state of attention includes attention elements such as the face direction of the participant P, the direction of the gaze of the participant P, the attention position, and the attention time. Any one of the attention elements may be used, or any multiple attention elements may be used.
[0087] For example, the interest detection unit 321 detects the face direction of the participant P from an image of the camera 305, and detects the gaze direction of the participant P by providing a gaze sensor. The interest detection unit 321 estimates the attention position (or the attention area) on the participant screen 310 from the face direction and gaze direction of the participant P. When detecting the attention time, the interest detection unit 321 may detect the time during which a certain face, gaze direction, or attention position continues. For example, when the same face, gaze direction, or attention position continues for a certain time, the interest detection unit 321 may detect that the interest of the participant P in the position (orientation) is increasing. Furthermore, the interest detection unit 321 may detect the facial expression of the participant P by image recognition, not limited to the face direction of the participant P. For example, a positive expression or a negative expression may be detected.
[0088] Next, the guide terminal 200 displays the interest information received from the multiple participant terminals 300 (S107). In the guide terminal 200, when the communication unit 240 receives the interest information from the multiple participant terminals 300, the interest analysis unit 221 analyzes the interests of the multiple participants P based on the received interest information, and the display control unit 222 displays the analysis result on the guide screen 210. The interest analysis unit 221 performs aggregation processing and statistical processing on the operation state, vocalization state, attention state, etc. of the participant P, detects the part on the screen that the participant P is paying attention to, detects the situation in which the participant P is excited, and displays the detection result so that the guide G can recognize it. The statistical processing includes processing of the sum, average value, median value, maximum value, minimum value, etc., and includes statistics for each position (area) of the screen and statistics for each time. For example, on the guide screen 210 that displays the information of the robot 100, a position corresponding to the interest information may be highlighted, or a change in the interest information over time may be displayed. As an example of highlighting a position, a heat map may be superimposed on the robot image display area 211 of the guide screen 210, and as an example of displaying a change over time, a level meter or a graph may be displayed in the interest display area 216 of the guide screen 210. It is preferable to display in a manner according to the degree (level) of interest indicated by the interest information. For example, the degree of interest is a value based on the number of operations and operation time in an operation state of multiple participants, sound pressure and speech time in a speech state, attention time in an attention state, and the like, and each element may be weighted. The statistical results of all participants may be displayed together, or the statistical results for each participant may be displayed in a recognizable manner. The number of participants who have shown interest may be displayed in a recognizable manner.
[0089] 9 is an example of displaying the analysis result of the interest information by a heat map. As shown in FIG. 9, the display control unit 222 displays a heat map according to the interest information in the robot image display area 211 of the guide screen 210, for example. The heat map may be displayed on the captured image in the robot image display area 211, or on the map information in the map display area 212. The distribution of interests is visually displayed so as to overlap with the part of the captured image or map information where the attention of the participant P is focused (the part where interest is high). For example, an area where interest is high (where interest is concentrated) is displayed in red, and the shade or color is changed according to the level of attention (interest).
[0090] FIG. 10 is an example of displaying the analysis result of the interest information in a figure such as a circle. As shown in FIG. 10, the display control unit 222 displays, for example, a circular frame in the robot image display area 211 of the guide screen 210 according to the interest information. The circular frame may be displayed on the captured image in the robot image display area 211 or on the map information in the map display area 212. The circular frame is displayed so as to surround a part (excited part) in the captured image or map information that is attracting the attention of the participant P. For example, an area with high interest (where interest is concentrated) is displayed in a red frame, and the color, size, thickness, etc. of the frame are changed according to the level of attention (interest). Note that the shape is not limited to a circle, and any other shape may be used.
[0091] 11A and 11B are examples of displaying the analysis results of interest information using a level meter. As shown in FIG. 11A and FIG. 11B, the display control unit 222 displays, for example, a level meter with a level according to the interest information in the interest display area 216 of the guide screen 210. The level meter displays the level (high or low) of the current interest (excitement). As shown in FIG. 11A, when the current interest is low, the level meter shows a low level, and as shown in FIG. 11B, when the current interest is high, the level meter shows a high level. The level meter may display different colors depending on the level.
[0092] Fig. 12 is an example of displaying the analysis results of the interest information in the form of a graph. As shown in Fig. 12, the display control unit 222 displays a graph of the level according to the interest information in the interest display area 216 of the guide screen 210, for example. The graph displays the change in excitement over time. As shown in Fig. 12, the interest level is displayed in a line graph in chronological order to display the relative change in excitement. This is not limited to a line graph, and may be a bar graph or other graph. The graph may be displayed in different colors according to the level or change over time.
[0093] As shown in FIG. 8, next, the guide terminal 200 transmits an operation signal for remotely operating the robot 100 to the robot 100 in response to the operation of the guide G, similar to S101 (S108). The guide G grasps the interests of the participant P from the interest information displayed on the guide screen 210, and operates the operation panel in the operation panel display area 215 of the guide screen 210 to move the robot 100 in a direction of higher interest, for example. The calculation unit 220 generates an operation signal in response to the operation of the guide G, and transmits the operation signal to the robot 100 via the communication unit 240. Thereafter, the robot 100 performs a moving operation, an imaging operation, or the like in response to the operation signal, similar to S102.
[0094] As described above, in this embodiment, the remote robot system that enables remote sightseeing tours and the like is provided with a function for detecting the interests of participants, and further, a function for presenting the detection results to the connection terminal of the guide. As a result, even if the guide and participants are remotely separated, feedback can be provided to the guide as to where the participants are paying attention and what they are interested in. This allows the guide to explain the areas of interest, or to move the robot to obtain detailed information. Therefore, it is possible to implement a tour that meets the participants' (users') requests while grasping their reactions, etc., and thus to respond appropriately to the participants.
[0095] (Embodiment 2) Next, a second embodiment of the present invention will be described. In this embodiment, an example in which the operation of the robot in the remote robot system of the first embodiment is automatically controlled in accordance with the interests of the participants will be described.
[0096] Fig. 13 is a block diagram showing an example of a functional configuration of the guide terminal 200 according to this embodiment. As shown in Fig. 13, the guide terminal 200 includes a control method determination unit 223 in the calculation unit 220. The other configuration is the same as in the first embodiment. The control method determination unit (remote control determination unit) 223 determines a control method (remote operation method) for the robot 100 based on the interest information notified from the participant terminal 300, that is, according to the interests of the participant P analyzed by the interest analysis unit 221.
[0097] FIG. 14 shows an example of the operation of the remote robot system 10 according to this embodiment. In FIG. 14, S101 to S107 are the same as those in the first embodiment. Following S107, the guide terminal 200 determines a control method for the robot 100 according to the interest information of the participant P (S110), and transmits an operation signal for the determined control method to the robot 100 (S108). When the interest analysis unit 221 analyzes the interest information of the participant P and the display control unit 222 displays the analysis result, the control method determination unit 223 determines a control method for the robot 100 according to the analyzed interest information of the participant P. Note that the display of the interest information may be omitted and the control method may be determined in S110.
[0098] For example, the control method determination unit 223 determines the movement method of the robot 100, including the movement direction, movement path, movement speed, etc. of the robot 100. The control method determination unit 223 may automatically select a route with a high interest from among a plurality of tour routes according to the analyzed interest information. For example, if many participants P are looking at a specific building, a route that passes near the building is selected. The control method determination unit 223 may also control the movement speed of the robot 100 according to the analyzed interest information. For example, the speed of the robot 100 may be adjusted according to the level of interest, and the viewing time of the part with interest may be longer and the viewing time of the part with less interest may be shorter. In a place with high interest, the speed may be reduced or the movement may be stopped.
[0099] Furthermore, the control method determination unit 223 may determine an information acquisition method for the robot 100, including an image capturing direction of the robot 100, a sound collecting direction, and the like. The control method determination unit 223 may control the image capturing direction of the camera 131 of the robot 100 to automatically face the direction of the robot's interest, or may zoom in on the image capturing range of the camera 131, depending on the analyzed interest information. Similarly, the sound collecting direction of the microphone 132 may be controlled to face the direction of the robot's interest.
[0100] The robot 100 may be automatically controlled by transmitting an operation signal according to the determined control method, or the determined control method may be displayed on the guide screen 210 to recommend a moving route or the like of the robot 100 to the guide G. Also, the determination of the control method and the execution of the control may be performed by other devices, not limited to the guide terminal 200.
[0101] As described above, in the present embodiment, the remote robot system is configured to determine the robot control method according to the interests of the participants. This makes it possible to automatically control the robot according to the interests of the participants, and to respond appropriately to the participants.
[0102] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the present invention. For example, in the above-described embodiment, an example of using the remote robot system for a remote sightseeing tour has been described, but the remote robot system may be used for other purposes other than remote sightseeing tours. For example, the remote robot system may be used to remotely search for a missing person such as a lost child, or to remotely check on the condition of a family member. When a robot is remotely operated by multiple remote users, the above-described embodiment can be effectively used when it is unclear where to focus the remote operation.
[0103] Each configuration in the above-described embodiments may be configured by hardware or software, or both, and may be configured by one piece of hardware or software, or may be configured by multiple pieces of hardware or software. The function (processing) of each device may be realized by a computer having a CPU, memory, etc. For example, a program for performing the method (control method) in the embodiment may be stored in a storage device, and each function may be realized by executing the program stored in the storage device by a CPU.
[0104] These programs include instructions (or software codes) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The programs may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The programs may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, a transitory computer-readable medium or a communication medium includes electrical, optical, acoustic, or other forms of propagated signals. [Explanation of symbols]
[0105] 10 Remote Robot System 100 Robots 110 Bogie section 111 Drive wheel 112 Caster 120 Main body 121 Torso 122 Head 123 Arm 124 Hands 131 Camera 132 Mike 133 Speaker 134 Laser Scanner 135 GPS unit 141 Display Panel 142 Bogie drive unit 143 Upper body drive unit 150 Control section 160 Memory 161 Map DB 170 Communication Unit 200 Guide terminal 201 Display Panel 202 Input Unit 203 Mike 204 Speaker 205 Camera 210 Guide Screen 211 Robot image display area 212 Map display area 213 Guide image display area 214 Participant image display area 215 Control panel display area 216 Interests Display Area 220 Arithmetic section 221 Interest Analysis Department 222 Display control unit 223 Control Method Decision Unit 230 Memory 240 Communication Unit 300 participant terminals 301 Display Panel 302 Input Unit 303 Mike 304 Speaker 305 Camera 310 Participant screen 311 Robot image display area 312 Map display area 313 Self-participant image display area 314 Other participants image display area 315 Guide image display area 320 Arithmetic unit 321 Interest Detection Unit 322 Interest Notification Department 330 Memory 340 Communication Unit 400 System Server 500 Internet 600 Wireless Router
Claims
1. A remote robotic system for a remote sightseeing tour, comprising: A robot that performs a predetermined action including collecting local information about surrounding tourist spots; a guide terminal used by a tour guide and capable of remotely controlling the operation of the robot; a participant terminal used by a participant of the tour and capable of remote communication with the guide terminal; The participant terminal includes: an information output unit that outputs the local information acquired from the robot to the participants; a detection unit that detects an operation state, a speech state, and an attention state of the participant with respect to the output local information; a notification unit that notifies the guide terminal of the detected operation state, speech state, and attention state of the participant; Equipped with The guide terminal includes: an analysis unit that analyzes the operation state, the speech state, and the attention state of the notified participant; a level output unit that outputs a level of attention or enthusiasm of the participants for the local information based on a result of the analysis; A remote robotic system comprising:
2. The operation state includes an operation position, an operation count, or an operation time of the participant's operation on a display screen that displays the local information. The telerobotic system of claim 1 .
3. The speech state includes a sound pressure of the voice uttered by the participant, a speaking time, or a recognition result of the voice.
3. A remote robotic system according to claim 1 or 2.
4. The attention state includes the participant's face direction, the participant's gaze direction, attention position, or attention time. A remote robotic system according to any one of claims 1 to 3.
5. the level output unit displays the level of attention or excitement of the participants using a heat map on a display screen displaying the local information.
5. A telerobotic system according to any one of claims 1 to 4.
6. the level output unit displays a temporal change in the level of attention or excitement of the participants on a display screen displaying the local information.
6. A telerobotic system according to any one of claims 1 to 5.
7. the guide terminal includes a remote control determination unit that determines a remote control method for the robot based on a result of the analysis.
7. A telerobotic system according to any one of claims 1 to 6.
8. The remote control determination unit determines a movement method of the robot, including a movement direction, a movement path, or a movement speed of the robot, based on the analysis result.
8. The telerobotic system of claim 7.
9. The remote control determination unit determines an information acquisition method for the robot, including an image capturing direction of the robot or an audio pickup direction of the robot, based on the analysis result.
9. A remote robotic system according to claim 7 or 8.
10. A robot that performs a predetermined action including collecting local information about surrounding tourist spots; a guide terminal used by a tour guide and capable of remotely controlling the operation of the robot; A control method for a remote robot system for a remote sightseeing tour, the control method comprising: The participant terminal includes: outputting the local information acquired from the robot to the participant; Detecting an operation state, a speech state, and an attention state of the participant with respect to the output local information; notifying the guide terminal of the detected operation state, speech state, and attention state of the participant; The guide terminal includes: Analyze the operation state, speech state, and attention state of the notified participant; outputting a level of attention or enthusiasm of the participants for the local information based on a result of the analysis; A method for controlling a remote robotic system.
Citation Information
Patent Citations
Image processor and region of interest setting method
JP2014050465A
Analysis server device, analysis program
JP2016224583A
Teleoperation device, method and program
JP2017054475A
Remote control type mobile robot and robot control system
JP2019005819A
Information processing apparatus, movable body, remote control system, information processing method, and program
JP2020005147A
