Information processing device, information processing program, and information processing method

Abstract

To provide an information processing device capable of realizing a remote conversation with a consideration of a privacy.SOLUTION: In an avatar remote conversation system (10), a moving robot (14), an operator terminal (16), and a server (18) are linked by a network (12). The robot contains a display (30), a camera (40 and 42), a microphone (48), and a speaker (50), and has a conversation with a user who faces the robot with an operator whose avatar (28) is displayed on the display. A data of a video image photographed by the camera and sound picked up by the microphone are transmitted to a server. In the server, the video image and the sound excluding a specific person such as a user are subjected to an anonymization processing to transmit it to a terminal of the operator. Therefore, in a display (78) and a speaker (74) of the terminal of the operator, since the video image and the sound of a person other than the specific person is clouded or muted, privacy of a person who does not intend to join a conversation with the avatar is protected.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing program, and an information processing method, and more particularly to an information processing device, an information processing program, and an information processing method for providing services to a user and receiving the services from the user by means of an avatar. [Background technology]

[0002] Patent Document 1 discloses a robot that moves while displaying an image of the operator's face on a display. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2020-004182 Summary of the Invention [Problem to be solved by the invention]

[0004] In the technology of Patent Document 1, people who are caught in the camera of a mobile robot may be seen by a third party even if they do not want to, so consideration of privacy is desirable.

[0005] Therefore, a primary object of the present invention is to provide a novel information processing device, an information processing program, and an information processing method.

[0006] Another object of the present invention is to provide an information processing device, an information processing program, and an information processing method that enable interaction with an avatar that takes privacy into consideration. [Means for solving the problem]

[0007] To achieve the above-mentioned objectives, the present invention employs the following configuration: Note that the reference symbols and supplementary explanations in parentheses indicate the correspondence with the embodiments described to aid in understanding the present invention, and do not limit the present invention in any way.

[0008] The first embodiment is an information processing device in a remote dialogue system in which an operator terminal and a robot are linked via a network and an operator of the operator terminal dialogues with a user through the robot, the information processing device comprising: a receiving means for receiving video data from a camera of the robot; Register people who do not need to be anonymized in a database in advance, Video data received by the receiving means The system performs image recognition processing on the images, and identifies people who are registered in a database among the people included in the video data as people who do not need to be anonymized, and determines that other people should be anonymized. The information processing device includes a determination means, an anonymization means that applies anonymization processing to the video data of a person when the determination means determines that the video data contains video of the person who should be anonymized, and a transmission means that transmits transmission data including the video data to which the anonymization processing has been applied by the anonymization means to an operator terminal.

[0009] In the first embodiment, an information processing device (18: a reference number illustrating a corresponding part in the embodiment, but not limiting; the same applies below) is linked to a robot (14) and an operator terminal (16) via, for example, a network (12), and constitutes a remote dialogue system in which an operator of the operator terminal (16) remotely dialogues with a user through the robot (14). As an example, a remote dialogue system is constituted in which the operator's own avatar (28) is displayed on a display (30) provided on the robot (14) and the operator dialogues with a user facing the display (30). The information processing device (18) includes receiving means (82, 104a, S3) for receiving video data from cameras (40, 42) of the robot (14). The determining means (82, 104b, 104c, S11) Register people who do not need to be anonymized in a database in advance, Video data received by the receiving means The system performs image recognition processing on the video data, and identifies people who are registered in a database as people who do not need to be anonymized, and determines that other people should be anonymized. When the determination means determines that the video data contains a video of a person who should be anonymized, the anonymization means (82, 104d, S13) applies anonymization processing to the video data of the person. The transmission means (82, 104e, S17) transmits transmission data including the video data to which the anonymization processing has been applied by the anonymization means to the operator terminal.

[0010] According to the first embodiment, the video of a person who should be anonymized is anonymized, so that the privacy of a person who has no intention of participating in the dialogue between the operator's avatar and the user can be protected.

[0011] A second embodiment is an information processing device dependent on the first embodiment, in which the robot further includes a microphone, and the receiving means receives voice data from the microphone; The determination means recognizes and processes the voice data received by the receiving means, and identifies, from among the persons included in the voice data, persons registered in the database as persons who do not need to be anonymized, and determines other persons as persons who should be anonymized; When the judgment means determines that the voice data contains the voice of a person who should be anonymized, the anonymization means applies anonymization processing to the voice data of that person, and the transmission means transmits transmission data including the voice data to which the anonymization processing has been applied by the anonymization means to the operator terminal.

[0012] In the second embodiment, the voice data of a person who should be anonymized is also anonymized, so that the protection of the privacy of the person who should be anonymized is further strengthened.

[0013] A third embodiment is an information processing apparatus dependent on the first or second embodiment, and the determining means comprises: Based on the database The system includes a person specifying means for specifying people who may be de-anonymized, and people other than those specified by the person specifying means are considered to be people who should be anonymized.

[0014] In the third embodiment, the video and / or audio of people other than those who do not need to be anonymized is securely anonymized.

[0015] A fourth embodiment is an information processing program for an information processing device in a remote dialogue system in which an operator terminal and a robot are linked via a network and an operator of the operator terminal dialogues with a user through the robot, the information processing program comprising: a CPU of the information processing device; receiving means for receiving video data from a camera of the robot; Register people who do not need to be anonymized in a database in advance, Video data received by the receiving means The system performs image recognition processing on the images, and identifies people who are registered in a database among the people included in the video data as people who do not need to be anonymized, and determines that other people should be anonymized. The information processing program functions as a judgment means, an anonymization means that applies anonymization processing to the video data of a person when the judgment means determines that the video data contains video of a person who should be anonymized, and a transmission means that transmits transmission data including the video data to which the anonymization processing has been applied by the anonymization means to an operator terminal.

[0016] The fifth embodiment is a remote dialogue system in which an operator terminal and a robot are linked via a network, and an operator of the operator terminal communicates with a user through the robot. Executed by an information processing device in An information processing method, comprising: a receiving step of receiving video data from a camera of a robot; Register people who do not need to be anonymized in a database in advance, Video data received in the receiving step The system performs image recognition processing on the images, and identifies people who are registered in a database among the people included in the video data as people who do not need to be anonymized, and determines that other people should be anonymized. The information processing program includes a determination step, an anonymization step that applies anonymization processing to the video data of a person when it is determined in the determination step that the video data contains video of the person to be anonymized, and a transmission step that transmits transmission data including the video data to which the anonymization processing has been applied in the anonymization step to an operator terminal.

[0017] The fourth and fifth embodiments can also achieve the same effects as the first embodiment. [Effects of the Invention]

[0018] According to this invention, the video and / or audio of a person who does not intend to participate in a dialogue with an avatar is anonymized, thereby protecting the privacy of that person.

[0019] The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description of the preferred embodiments with reference to the drawings. [Brief explanation of the drawings]

[0020] [Figure 1] FIG. 1 is an illustrative view showing an outline of an avatar remote dialogue system according to an embodiment of the present invention. [Figure 2] 2 is a block diagram showing the electrical configuration of the robot shown in FIG. [Figure 3] FIG. 3 is a block diagram showing the electrical configuration of the operator terminal shown in FIG. [Figure 4] FIG. 4 is a block diagram showing the electrical configuration of the server shown in FIG. [Figure 5]FIG. 5 is an illustrative view showing an example of a memory map of the memory of the server shown in FIG. [Figure 6] FIG. 6 is a flowchart showing an example of the information processing operation of the server shown in FIG. DETAILED DESCRIPTION OF THE INVENTION

[0021] Referring to FIG. 1, the avatar remote dialogue system 10 of this embodiment uses an avatar remote control platform system (CA: Cybernetic Avatar), which is a platform for remote operators to provide services using avatars (remotely controlled CG agents).

[0022] However, this invention does not necessarily have to be based on the avatar remote operation infrastructure system, but is generally a system in which the avatar of the operator of the operator terminal 16 is displayed on the robot 14 via the network 12, or the robot 14 itself is used as the operator's avatar, and remote dialogue between the avatar and the user can be realized with the involvement of the server 18. In the embodiment of Fig. 1, the server 18 is configured to perform the functions of the infrastructure system described above.

[0023] The robot 14 used in this embodiment is an autonomously mobile so-called telepresence (or telexistence) robot, such as the product name "Double 3" manufactured by Double Robotics, Inc. However, it should be noted in advance that the robot 14 is not limited to such a specific robot, and a robot such as that disclosed in Patent Document 1 can also be used.

[0024] In the embodiment, the robot 14 can communicate with an operator terminal 16 connected (wirelessly or wired) to the network 12. The operator terminal 16 is a general-purpose computer used by an operator who remotely controls the robot 14. The operator uses the operator terminal 16 to send commands to the robot 14 to cause it to execute tasks. The operator can also use the operator terminal 16 to send voice to the robot 14 and output voice from the robot 14, thereby interacting with a person or persons present near the robot 14.

[0025] The robot 14 includes a base 20, and an ultrasonic sensor 22, which is one of the movement sensors, is provided on the front of the base 20. Furthermore, left and right movement wheels 24L and 24R are rotatably provided on both ends of the base 20.

[0026] An upwardly extending pole 26 is provided on the top surface of the base 20, and a touch display 30 capable of displaying an operator's avatar 28 is provided at the top end of the pole 26. This touch display (hereinafter simply referred to as "display") 30 is equipped with a camera, microphone, speaker, etc., and details will be explained with reference to the block diagram shown in FIG. 2. The robot 14 is a battery-powered robot, and the battery is housed, for example, in the pole 26.

[0027] In this embodiment, the robot 14 can communicate with an operator terminal 16 connected to the network 12. The operator terminal 16 is a general-purpose computer used by an operator who remotely controls the robot 14. The operator uses the operator terminal 16 to transmit video and audio to the robot 14, displays his / her own avatar 28 (FIG. 1) on the display 30 of the robot 14, and interacts with users to provide services.

[0028] Here, "services" include, for example, private tutoring, product sales, tourist information, and the like, which can be provided using the avatar remote dialogue system 10 of this embodiment, and are registered in advance in a service management database 106a (FIG. 5) described later. An "operator" is a person who displays an avatar on the display 30 in this avatar remote dialogue system 10 and provides a service such as sales through the avatar, and is registered in advance in an operator management database 106b (FIG. 5) described later. A "user" is a person who, in the avatar remote dialogue system 10 of this embodiment, receives a service provided by an avatar while interacting with the operator's avatar 28 while facing the display 30, and is a person or persons who are registered in advance in a user management database 106c (FIG. 5) described later.

[0029] In addition, by receiving video data (moving images or still images) and audio data transmitted from the robot 14 at the operator terminal 16 and outputting the video and audio at the operator terminal 16, the operator can see the area around the robot 14, understand the situation around the robot 14, and interact with the user facing the display 30 of the robot 14.

[0030] It should be noted that controlling the movement of the robot 14 using the operator terminal 16 is already well known, and is not essential to the present invention, so a detailed description of the remote control will be omitted here.

[0031] As is well known, the display 30 has a touch panel on the surface of the display that displays the image (or built in), and by touching it, you can point to a location on the display 30.

[0032] The server 18 is an information processing device such as a computer, and in this embodiment, anonymizes information (video and / or audio) from the video captured by the cameras 40 and / or 42 (FIG. 2) of the robot 14, the information being from the operator of the operator terminal 16, i.e., a person who does not intend to participate in a dialogue with the avatar 28 displayed on the display 30.

[0033] 2 is a block diagram of the robot 14. Here, the robot 14 will be described with reference to FIG. 2 to the extent necessary for explaining the embodiment.

[0034] The robot 14 further includes a CPU 32 and a memory 34. The memory 34 includes RAM, ROM, HDD (hard disk drive), etc., although details are not shown. A bus 36 is connected to the CPU 32, and the RAM, ROM, HDD, etc. of the memory 34 are electrically connected to this bus 36. The CPU 32 executes computer programs to perform operations such as anonymization processing and autonomous movement, which will be described later.

[0035] The communication unit 38 communicates with the operator terminal 16 and the server 18 via the network 12 to exchange video data and audio data.

[0036] The robot 14 is provided with an omnidirectional camera 40 and a user camera 42, which are connected to the bus 36 via a camera interface (I / F). The omnidirectional camera 40 is not shown in Fig. 1, but is provided, for example, above the display 30, and captures the background of the user interacting with the avatar 28 (Fig. 1) on the display 30. However, the omnidirectional camera 40 is not essential.

[0037] The user camera 42 is, for example, two cameras spaced apart laterally (a stereo camera) and captures an image of a user facing the display 30 and interacting with the operator's avatar 28. The camera can pan, tilt, and zoom as needed. The camera I / F 44 may be provided with a processor that automatically performs pan, tilt, and zoom functions, as well as white balance and exposure control, in the omnidirectional camera 40 and the user camera 42.

[0038] The laser rangefinder 46 is provided for purposes such as tracking a specific person, and the laser rangefinder 56 described below is for the autonomous movement of the robot 14.

[0039] The robot 14 further includes a microphone 48, which can collect a wide range of sounds by arranging, for example, six microphones. This microphone 48, like the speaker 50, is provided, for example, built into the display 30. The speaker 50 outputs the voice of the operator who is conversing with the user in front of the robot 14. The microphone 48 and the speaker 50 are connected to the bus 36 via an audio I / F 52.

[0040] 1 is connected to the bus 36 via a movement sensor I / F 54. A laser rangefinder 56 is further connected to this movement sensor I / F 54. The laser rangefinder 56 may also serve as the laser rangefinder 46. In other words, one laser rangefinder may be used when the robot 14 is moving and when the robot 14 is stopped and a conversation is being conducted by the avatar 28.

[0041] An inertial measurement unit 58 is also connected to the movement sensor I / F 54. This inertial measurement unit 58 is a device that detects three-dimensional inertial motion (translational and rotational motion in three orthogonal axis directions), detecting translational motion using an acceleration sensor and rotational motion using an angular velocity (gyro) sensor.

[0042] A motor driver 60 is also connected to the bus 36. This motor driver 60 controls the right wheel motor 62R and the left wheel motor 62L in accordance with instructions from the CPU 32. In other words, the CPU 34 controls the right wheel motor 62R and the left wheel motor 62L using the motor driver 60 based on data indicating the situation obtained from the movement sensor I / F 54 and the motor driver 60. However, since this invention is not directly related to the movement of the robot 14 itself, further explanation will be omitted here.

[0043] 3 is a block diagram of the operator terminal 16. The operator terminal 16 is a general-purpose computer, but here, the configuration of the operator terminal 16 will be described with reference to FIG. 3 to the extent necessary for explaining the embodiments.

[0044] The operator terminal 16 includes a CPU 64 and a memory 66. The memory 66 includes RAM, ROM, HDD, etc., although details are not shown. The CPU 64 is connected to a bus 68, and the RAM, ROM, HDD, etc. of the memory 66 are electrically connected to this bus 68. The CPU 64 performs necessary operations by executing a computer program.

[0045] The operator terminal 16 includes a microphone 72 and a speaker 74, which are connected to the bus 68 via an audio I / F 70. The operation unit 76 includes a touch display and a keyboard, not shown. Using the microphone 72, speaker 74, and operation unit 76, the operator displays his or her own avatar 28 ( FIG. 1 ) on the display 30 of the robot 14 and engages in remote dialogue with a user facing the display 30.

[0046] The communication unit 80 communicates with the robot 14 and the server 18 via the network 12 to exchange video data and audio data.

[0047] The display 78 displays images of the user and the like captured by the omnidirectional camera 40 and the user camera 42 of the robot 14 after the server 18 has performed anonymization processing as described below.

[0048] Fig. 4 is a block diagram of the server 18. The server 18 is a general-purpose computer, but here, the configuration of the server 18 will be described with reference to Fig. 4 to the extent necessary for explaining the embodiment.

[0049] The server 18 includes a CPU 82 and a memory 84. The memory 84 includes RAM, ROM, HDD, etc., although details are not shown. A bus 86 is connected to the CPU 82, and the RAM, ROM, HDD, etc. of the memory 84 are electrically connected to this bus 86. The CPU 82 executes a computer program to perform necessary operations such as anonymization processing.

[0050] The server 18 includes a microphone 90 and a speaker 92, which are connected to the bus 86 via an audio I / F 88. The operation unit 94 includes a touch display and a keyboard, although not shown.

[0051] The communication unit 96 communicates with the robot 14 and the operator terminal 16 via the network 12 to exchange video data and audio data. In particular, it receives video data and audio data from the robot 14 and transmits the video data and audio data, after anonymizing them as necessary, to the operator terminal 16.

[0052] The display 98 displays images of the user and the like captured by the omnidirectional camera 40 and the user camera 42 of the robot 14.

[0053] Fig. 5 is a diagram illustrating an example of a memory map of the memory 84 (RAM) of the server 18 shown in Fig. 4. As shown in Fig. 5, the memory 84 includes a program storage area 100 and a data storage area 102. The program storage area 100 stores programs necessary for the server as well as programs necessary for the anonymization processing of the present invention.

[0054] That is, the program storage area 100 includes a receiving program 104a, a person identification program 104b, a person detection program 104c, an anonymization program 104d, a transmission program 104e, and the like.

[0055] The receiving program 104 a is a program that controls the communication unit 96 to receive video data and audio data from the robot 14 via the network 12 .

[0056] The person identification program 104b is a program for identifying a person who may be de-anonymized based on user data previously registered in the user management database 106b of the data storage area 102. Specifically, possible methods include registering a face image of the user in the user management database 106c of the server 18, operation by the user himself / herself (for example, registration using a smartphone or by operating an operation unit (not shown) provided on the robot 14), or wearing an ID tag indicating the user ID.

[0057] Furthermore, there is also a method of identification based on the location of the robot 14, i.e., the user. For example, it can be determined whether the location is a place that requires specific anonymization or whether it is an anonymization exclusion zone (e.g., a monitoring zone). However, the location of the robot 14, i.e., the user, can be detected based on information from a location detection means such as a GPS provided on the robot 14, or a floor sensor provided on the movement path of the robot 14.

[0058] The person detection program 104c is a program for detecting and tracking information contained in the video data and audio data from the robot 14, relating to the person identified by the person identification program 104b, such as the person's facial image and speech. Specifically, it is conceivable to track the person by performing image recognition processing on video data from the omnidirectional camera 40 or user camera 42 provided on the robot 14. Alternatively, the position of the person can be tracked by a laser rangefinder 46 (and / or 56) (FIG. 2) provided on the robot 14. Then, the face position coordinates of the person identified by the person identification program 104b who does not need to be anonymized and other people who should be anonymized are passed to the anonymization program 104d. 。 The anonymization program 104d is a program for applying anonymization processing to video and / or audio of persons other than the identified person, based on the position coordinates of the faces of the person who does not need to be anonymized and other persons who should be anonymized, contained in the video and audio data from the robot 14.

[0059] The transmission program 104e is a program for transmitting the video and / or audio anonymized by the anonymization program 104d to the operator terminal 16 of the operator who is the user's conversation partner.

[0060] The data storage area 102 also includes a service management database 106a, an operator management database 106b, a user management database 106c, a received data area 106d that temporarily stores video and audio data received from the robot 14, and a transmitted data area 106e that temporarily stores transmitted data to be transmitted to the operator terminal 16.

[0061] As described above, the service management database 106a is a database in which various services that can be provided by the avatar remote dialogue system 10 of the embodiment are registered in advance by the operator who is the service provider.

[0062] As described above, the operator management database 106b is a database in which various information about operators who provide services to users through the avatar remote dialogue system 10 of the embodiment is registered in advance. The various information about the operator includes basic data such as the operator's name, address, or whereabouts, and operator ID, images such as an image of the operator's face, and services that can be provided. Furthermore, if the service is a tutoring service, for example, the operator includes not only individual tutors but also the company that operates the tutoring service. In other words, not only individuals but also organizations such as companies can be registered in the operator management database 106b.

[0063] As described above, the user management database 106c is a database in which various information about people who will receive services provided through avatars by the avatar remote dialogue system 10 of the embodiment is registered in advance. The various user information includes basic data such as the user's name, address, or residence, and user ID, images such as a facial image of the user, and the services to be provided. Furthermore, if the service is, for example, the sale of goods, users include not only individuals but also businesses that purchase the goods to be sold. In other words, not only individuals but also organizations such as companies can be registered in the user management database 106c.

[0064] However, the embodiment described below with reference to the flowchart in FIG. 6 is premised on an individual user.

[0065] In the avatar remote dialogue system 10 of the embodiment, when an operator logs in to the server 18 through the operator terminal 16, the server 18 refers to the operator management database 106b for the login information and performs authentication processing, and if the authentication is successful, the operator terminal 16 can log in to the server 18. Meanwhile, when a user approaches, for example, the display 30 of the robot 14, the user camera 42 of the robot 14 captures an image of the user's face. The facial image is sent to the server 18. The server 18 refers to the user management database 106c and performs authentication processing for the user, and if the authentication is successful, the user can log in to the server 18. After that, the services provided by the operator and received by the user are determined.

[0066] In this way, in the first step S1 of FIG. 6, the server 18 determines the combination of the operator, the user, and the service.

[0067] Then, in step S3, the server 18 starts acquiring video data from the two cameras 40 and 42 of the robot 14 and audio data from the microphone 48. That is, the video data and audio data are transmitted from the communication unit 38 of the robot 14 to the communication unit 96 of the server 18 via the network 12. The server 18 receives the data and temporarily stores it as received data in the received data area 106d.

[0068] In the next step S5, the server 18 (CPU 82) identifies people who do not need to be anonymized from among the people included in the video data and audio data of the received data in accordance with the person identification program 104b (FIG. 5). For example, people who are registered in the server 18 as operators or users, and people facing the camera 42 of the robot 14 can be referred to as "people who do not need to be anonymized" here.

[0069] In the next step S7, the server 18 detects information derived from the individual person indicated by the acquired (received) video data and audio data, that is, video such as a facial image and audio picked up by the microphone 48. In other words, the server 18 associates each person captured by the cameras 40 and 42 of the robot 14 with the video data and audio data of that person, and stores the data for each person in the received data area 106d.

[0070] Thereafter, steps S9 to S15 are repeatedly executed to perform the necessary anonymization processing.

[0071] That is, first, in step S9, information (video data and audio data) derived from individual people is selected in sequence, and in step S11, it is determined whether the selected information is information about a person that needs to be anonymized. This determination is made, for example, in accordance with person identification program 104b and person detection program 104c. In other words, by identifying a person who does not need to be anonymized using person identification program 104b and detecting information about that specific person using person detection program 104c, it is possible to determine whether the information selected in step S9 is information about that specific person.

[0072] In the next step S13, the server applies anonymization processing to the information, video, and audio derived from the person. Note that "anonymization" here can be defined as processing that makes the person unrecognizable (or difficult to recognize) based on the video and / or audio.

[0073] A specific method for anonymizing the video may involve applying mosaic or blurring to the face image (or upper body, etc.) of the person in the video data from the robot 14.

[0074] Alternatively, a prepared character image or CG image may be superimposed on the image of the person, or the image of the person may be replaced with the character image or CG image.

[0075] Specific methods for anonymizing audio include reducing the volume of the audio data, replacing it with voice-altered data, or muting the audio depending on the content of the speech.

[0076] In either case, the information may be anonymized and may remain in the server 18 as collected data, such as the sex and age of individuals other than the specific person.

[0077] Thereafter, in step S15, the server 18 determines whether the processes of steps S11 and S13 have been performed for all of the individual persons stored in step S7, i.e., whether all of the information has been checked. For example, it can determine whether all of the information has been checked by counting the number of individual persons detected in step S7 using a counter (not shown).

[0078] In step S17, the server 18 temporarily stores the transmission data including the anonymized video data and / or audio data in the transmission data area 106e (FIG. 5), and transmits the transmission data to the operator terminal 16.

[0079] The operator terminal 16 receives this transmission data via the communication unit 78, outputs audio based on the audio data included in the received data from the speaker 74, and displays video based on the video data included in the received data on the display 78. Therefore, the video displayed on the display 80 of the operator terminal 16 and / or the audio output from the speaker 74 are anonymized as necessary, making it possible to realize a remote dialogue that takes into consideration the privacy of people who do not intend to participate in the dialogue between the operator and the user via the operator terminal 16.

[0080] In step S13 of the above embodiment, the anonymization process is performed on both the video and the audio, but the anonymization process may be performed on only one of them, or at least the video may be anonymized.

[0081] Furthermore, the above embodiment has been described as a system in which an image of the avatar 28 is displayed on the display 30 provided on the robot 14 and the avatar 28 and the user can remotely interact with each other.

[0082] However, this invention can also be applied to a remote dialogue system in which the robot 14 itself functions as an avatar for the operator. For example, like SOTA (https: / / www.vstone.co.jp / products / sota / ) or Erica (https: / / www.irl.sys.es.osaka-u.ac.jp / projects / erica) (both product names), it is possible to remotely control a robot without a display and have a dialogue with a person (user) through the robot.

[0083] Furthermore, the present invention can also be applied to a remote dialogue system in which a CG character remotely controlled by an operator is displayed on a screen and a dialogue takes place between the operator and a person (user) in front of the character (the CG character plays the role of the operator's avatar). [Explanation of symbols]

[0084] 10...Avatar remote dialogue system 12...Network 14. Robot 16...Operator terminal 18...server 30...Display 32, 64, 82...CPU 40...Omnidirectional camera 42...User camera 46...Laser rangefinder 48, 72, 90...Mike 50, 74, 92...speakers 104d...Anonymization program

Claims

1. An information processing device in a remote dialogue system in which an operator terminal and a robot are linked via a network, and an operator of the operator terminal dialogues with a user through the robot, receiving means for receiving video data from the camera of said robot; a determination means for registering in advance in a database persons who do not need to be anonymized, performing image recognition processing on the video data received by said receiving means, identifying persons registered in said database among persons included in said video data as persons who do not need to be anonymized, and determining other persons as persons who should be anonymized; an anonymization means for applying an anonymization process to the video data of a person when the determination means determines that the video data contains a video of the person to be anonymized; and an information processing apparatus comprising: a transmitting means for transmitting, to the operator terminal, transmission data including video data to which anonymization processing has been applied by the anonymization means.

2. The robot further comprises a microphone; the receiving means receives audio data from the microphone, the determination means performs recognition processing on the voice data received by the receiving means, and identifies, among the persons included in the voice data, persons registered in the database as persons who do not need to be anonymized, and determines other persons as persons who should be anonymized; 2. The information processing device according to claim 1, wherein when the determination means determines that the voice data contains the voice of a person who should be anonymized, the anonymization means applies an anonymization process to the voice data of the person, and the transmission means transmits transmission data including the voice data to which the anonymization process has been applied by the anonymization means to the operator terminal.

3. 3. The information processing device according to claim 1, wherein the determining means includes a person identifying means for identifying a person who may be de-anonymized based on the database, and a person other than a person identified by the person identifying means is set as the person to be anonymized.

4. An information processing program for an information processing device in a remote dialogue system in which an operator terminal and a robot are linked via a network and an operator of the operator terminal dialogues with a user through the robot, the information processing program comprising: receiving means for receiving video data from the camera of said robot; a determination means for registering in advance in a database persons who do not need to be anonymized, performing image recognition processing on the video data received by said receiving means, identifying persons registered in said database among persons included in said video data as persons who do not need to be anonymized, and determining other persons as persons who should be anonymized; an anonymization means for applying an anonymization process to the video data of a person when the determination means determines that the video data contains a video of the person to be anonymized; and an information processing program that causes the information processing program to function as a transmitting means that transmits, to the operator terminal, transmission data including video data to which anonymization processing has been applied by the anonymization means.

5. 1. An information processing method executed by an information processing device in a remote dialogue system in which an operator terminal and a robot are linked via a network, and an operator of the operator terminal dialogues with a user through the robot, comprising: a receiving step of receiving video data from a camera of the robot; a determination step of registering in advance in a database people who do not need to be anonymized, performing image recognition processing on the video data received in the receiving step, identifying people registered in the database among people included in the video data as people who do not need to be anonymized, and determining that other people should be anonymized; an anonymization step of applying an anonymization process to the video data of a person when it is determined in the determination step that the video data includes a video of the person to be anonymized; and An information processing method including a transmitting step of transmitting, to the operator terminal, transmission data including video data to which anonymization processing has been applied in the anonymization step.

Images