Device, robot, method and computer program product for communicating with users
By using the camera and driving mechanism to determine the dead corner area in the remote operation robot, moving the device and outputting sound, the problem of operator instructions being noticed is solved, and the effect of the remote operation robot in assisted discipline is improved.
Patent Information
- Application Number
- CN201910121277.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-02-28
- Filing Date
- 2019-02-19
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2039-02-19
AI Technical Summary
In the existing remote operation robot technology, the operator's instructions are easily noticed by the robot's conversation subject, which leads to the child's rebellious psychology when the guardian is instructed, affecting the discipline effect.
A device is designed, equipped with a camera, a driving mechanism, a speaker and a processor. By determining whether the current position is in the dead corner area of the conversation object, moving the device to the dead corner area and outputting sound, diverting the attention of the conversation object, thereby avoiding the operator's attention. Instructions are noted.
It effectively prevents children from paying attention to the robot's actions when instructed by the guardian, reduces the rebellious psychology and improves the effectiveness of discipline.
Smart Images

Figure CN110202586B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a device capable of remote operation, etc. Background Art
[0002] Various methods for remotely operating robots have been proposed in the past. For example, Patent Document 1 discloses a robot control system, which aims to reduce the number of remote operations by the operator as much as possible, constructs a database based on the action history information of the robot during remote operation, detects the conversation status between the dialogue partner and the robot, refers to the database corresponding to the detected conversation status, and causes the robot to perform conversation actions based on autonomous control based on the referenced database.
[0003] Patent Document 1: Japanese Patent Application Publication No. 2009-131914 Summary of the invention
[0004] However, Patent Document 1 does not take any measures to prevent the robot operator's instructions to the robot from being noticed by the person with whom the robot is interacting, so further improvement is needed.
[0005] A device involved in a technical solution of the present disclosure is a device for communicating with a user, which comprises:
[0006] A camera for acquiring images of the surroundings of the device;
[0007] a driving mechanism for driving the device;
[0008] speaker;
[0009] Memory; and
[0010] processor;
[0011] the processor,
[0012] In a case where an application of the device is remotely started based on an instruction of the first user, judging whether the current position of the device is included in a blind spot area of the second user based on the image, the blind spot area being an area that does not include the sight line direction of the second user and is sandwiched by a second semi-line and a third semi-line, the second semi-line being a semi-line obtained by moving the first semi-line clockwise by a predetermined angle based on the first semi-line, the third semi-line being a semi-line obtained by moving the first semi-line counterclockwise by the predetermined angle based on the first semi-line, the first semi-line being a semi-line obtained by extending a line segment connecting the position of the first user and the position of the second user from the second user in a direction opposite to the first user;
[0013] If it is determined that the current position of the device is not included in the blind spot area, setting a target point included in the blind spot area;
[0014] controlling the driving mechanism to move the device to the target location;
[0015] The speaker is enabled to output sound corresponding to the application.
[0016] According to the present disclosure, it is possible to prevent the instruction of the first user to the device from being noticed by the second user. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 It is a diagram showing an example of the configuration of a robot equipped with the device in the embodiment of the present disclosure.
[0018] Figure 2 Yes means Figure 1 A flowchart of an example of processing of the robot shown.
[0019] Figure 3 Yes means Figure 2 Flowchart of details of the process of S102.
[0020] Figure 4 This is a diagram showing an example of a blind spot area.
[0021] Figure 5 Yes means Figure 1 A diagram showing an example of the appearance of a robot shown.
[0022] Figure 6 Observing from behind Figure 5 The resulting diagram of the interior of the robot is shown. DETAILED DESCRIPTION
[0023] (The process of implementing a technical solution disclosed in the present invention)
[0024] The inventors have conducted research on robots that assist guardians such as mothers in disciplining their children. For example, the robot can send a message to the child to tidy up the room or urge them to study, or can read picture books to the child. In order to make the robot take such actions, the guardian needs to take out a portable terminal such as a smartphone and input a start instruction for an application for making the robot take such actions.
[0025] However, when the guardian slowly takes out the smartphone and inputs the start instruction, the child's attention will be drawn to it, so the child will notice that the robot's actions are based on the guardian's instructions. This will not only make the child feel disappointed, but also encourage the child's rebellious psychology towards the guardian, and it may not be possible to expect a sufficient disciplinary effect.
[0026] In the above-mentioned Patent Document 1, the operator operates a terminal device connected to the robot via a network, so the person who becomes the dialogue partner of the robot is in a remote place and is not in an environment where the operator's operation can be visually recognized. Therefore, the above-mentioned problem does not occur in Patent Document 1. Furthermore, the present inventors have found that the above-mentioned technical problem does not exist in the past.
[0027] Therefore, the inventors of the present invention have found that when a first user as an operator inputs an instruction to start an application, the above-mentioned technical problem can be solved by causing the robot to take an action to divert the second user's attention from the first user to the robot immediately after the instruction.
[0028] The present disclosure has been made based on such knowledge, and provides a technology capable of preventing an instruction given by a first user to a robot (device) from being noticed by a second user.
[0029] A device of a technical solution of the present disclosure is a device for communicating with a user, comprising:
[0030] A camera for acquiring images of the surroundings of the device;
[0031] a driving mechanism for driving the device;
[0032] speaker;
[0033] Memory; and
[0034] processor,
[0035] the processor,
[0036] In a case where an application of the device is remotely started based on an instruction of the first user, judging whether the current position of the device is included in a blind spot area of the second user based on the image, the blind spot area being an area that does not include the sight line direction of the second user and is sandwiched by a second semi-line and a third semi-line, the second semi-line being a semi-line obtained by moving the first semi-line clockwise by a predetermined angle based on the first semi-line, the third semi-line being a semi-line obtained by moving the first semi-line counterclockwise by the predetermined angle based on the first semi-line, the first semi-line being a semi-line obtained by extending a line segment connecting the position of the first user and the position of the second user from the second user in a direction opposite to the first user;
[0037] If it is determined that the current position of the device is not included in the blind spot area, setting a target point included in the blind spot area;
[0038] controlling the driving mechanism to move the device to the target location;
[0039] The speaker is enabled to output sound corresponding to the application.
[0040] According to this configuration, when the application of the device is started based on the instruction of the first user, if the device is not in the blind spot area of the second user, the device moves to the blind spot area. In this way, the line of sight of the second user can be shifted from the direction in which the first user can be recognized to the direction in which the first user cannot be recognized. As a result, the attention of the second user can be shifted from the first user to the device, and the instruction of the first user to the device can be prevented from being noticed by the second user.
[0041] In the above configuration, the first user may be a guardian of the second user.
[0042] According to this configuration, it is possible to prevent the guardian's instructions to the device from being noticed by the second user.
[0043] In the above configuration, when the processor determines that the current position of the device is included in the blind spot area, the processor may cause the speaker to output a sound corresponding to the application without moving the device.
[0044] According to this configuration, even without moving the device to the blind spot area, the device outputs sound, thereby making it possible to divert the second user's attention from the first user to the device.
[0045] The present disclosure can also be implemented as a robot equipped with such an apparatus, a method having each characteristic step included in such an apparatus, and a computer program for causing a computer to execute each characteristic step. Moreover, it is needless to say that such a computer program can be circulated via a non-transient recording medium such as a CD-ROM that can be read by a computer or a communication network such as the Internet.
[0046] In addition, the embodiment described below represents a specific example of the present disclosure. The numerical values, shapes, constituent elements, steps, the order of steps, etc. shown in the following embodiment are examples and are not intended to limit the present disclosure. In addition, among the constituent elements in the following embodiments, for constituent elements not recorded in the independent claims representing the highest concept, they are set as arbitrary constituent elements and described. In addition, in all embodiments, the various contents can also be combined.
[0047] (Implementation Method)
[0048] (Overall composition)
[0049] Figure 1 It is a diagram showing an example of the configuration of a robot in an embodiment of the present disclosure. Figure 1 The robot shown includes a sensor input unit 100 , a behavior execution unit 200 , and an output unit 300 .
[0050] The sensor input unit 100 includes an image input unit 101. The image input unit 101 is composed of a camera that obtains images of the robot's surroundings. Here, the image input unit 101 can be composed of a panoramic camera that can obtain 360-degree images of the robot, or can be composed of a normal camera that can obtain images within a predetermined viewing angle. In the present disclosure, the image input unit 101 obtains images of the robot's surroundings at, for example, a predetermined frame rate (for example, 60 frames per second). In addition, the image input unit 101 can also be composed of, for example, a stereo camera or a depth camera that can measure the distance to objects located in the surroundings. The depth camera is a camera that can detect the distance of an object for each of a plurality of pixels by measuring the time it takes for infrared light irradiated to the surroundings to be reflected by the object and return.
[0051] The behavior execution unit 200 includes an instruction receiving unit 201 , a position coordinate acquiring unit 202 , a positional relationship determining unit 203 , a walking position determining unit 204 , a robot walking unit 205 , a voice synthesizing unit 206 , and an application executing unit 207 .
[0052] The elements constituting the action execution unit 200 are realized by executing a program for performing action processing through a processor such as a CPU. The program for performing action processing is stored in a memory incorporated into the robot or incorporated into a memory of a terminal connected to the robot in a communicative manner, and is executed by a processor. In addition, all the elements constituting the action execution unit 200 may also be installed on the same robot or the same terminal. Alternatively, all the elements constituting the action execution unit 200 may also be individually installed on other terminals and / or servers connected through any network such as optical fiber, wireless, and public telephone lines, and realized by performing communication. In addition, the action execution unit 200 may also install some elements on the robot and the remaining elements on the server.
[0053] The instruction receiving unit 201 has a communication line for communicating with a portable terminal held by a first user who remotely operates the robot and a processor for controlling the communication line, and receives instructions from the first user to the robot. In the present disclosure, the instruction receiving unit 201 receives an instruction from the first user to start an application that assists in disciplining a second user and an instruction from the first user to the robot during the execution of the application. Here, the first user is, for example, a guardian of the second user (e.g., a mother, father, or grandparent), and the second user is a child. In addition, in the present disclosure, a toddler is particularly assumed as a child.
[0054] The application of assisting in discipline is, for example, an application in which the robot performs actions for making the child master predetermined living habits, such as urging the child to tidy up the room. Here, if the robot suddenly speaks "please tidy up the room", it may cause the second user to be disgusted.
[0055] Therefore, the application of assisting discipline can not only adopt the application of making the robot speak to instruct the second user to tidy up the room, but also adopt the application of making the robot fully attract the attention of the second user and then make the robot send a message to urge the second user to tidy up the room. Specifically, the application can make the robot take the following actions. First, the robot speaks to the second user to guess riddles or chat, and after attracting the attention of the second user, it urges the second user to tidy up the room. In addition, the robot also sends encouraging messages to the second user during the second user's tidying operation. And, at the end of the tidying, the robot sends a message praising the second user.
[0056] As the portable terminal held by the first user, for example, a smart phone, a tablet computer, or a mobile phone can be used. In addition, the first user can also use a fixed personal computer to input an application startup instruction instead of the portable terminal. In addition, the portable terminal and the robot are connected in a wireless manner such as Wifi (registered trademark) or Bluetooth (registered trademark) to enable communication. However, this is an example, and the portable terminal and the robot can also be connected by wire.
[0057] The position coordinate acquisition unit 202 receives the image data from the image input unit 101, extracts the feature quantity from the image data, estimates the robot's own position based on the extracted feature quantity, and constructs an environment map around the robot. In addition, the position coordinate acquisition unit 202 extracts the first user and the second user from the image data, and estimates the positions of the extracted first user and the second user.
[0058] In addition, SLAM (Simultaneous Localization and Mapping) is known as a technology for generating an environment map while estimating one's own position in an unknown environment. Therefore, the position coordinate acquisition unit 202 may estimate its own position, the positions of the first user and the second user, and construct an environment map using SLAM.
[0059] In addition, SLAM can also be applied to any image data obtained by a single-lens camera, a depth camera or a stereo camera. Therefore, even if the image input unit 101 is composed of any camera among a single-lens camera, a depth camera and a stereo camera, the position coordinate acquisition unit 202 can also apply SLAM and perform self-position estimation.
[0060] In the present disclosure, the environment map is composed of two-dimensional map data including two axes of vertical and horizontal when the robot is viewed from directly above. Therefore, the robot's own position, the positions of the first user and the second user are composed of two-dimensional coordinate data. However, this is an example, and the environment map can also be composed of three-dimensional map data including three axes of vertical, horizontal and height. In this case, the robot's own position, the positions of the first user and the second user are respectively composed of three-dimensional coordinate data.
[0061] In addition, the position coordinate acquisition unit 202 may extract the first user and the second user from the image data by comparing the feature values of the first user and the second user pre-stored in the memory with the image data, and estimate the positions of the first user and the second user based on the coordinate data on the extracted image data. In addition, as the feature values of the first user and the second user, for example, the feature values of the faces and the body shapes of the first user and the second user may be used.
[0062] When the application is activated by the application execution unit 207 , the positional relationship determination unit 203 determines whether the robot is located in the blind spot area of the second user.
[0063] Figure 4 : is a diagram showing an example of a blind spot area α. The blind spot area α is a fan-shaped area that does not include the sight line direction 41 of the second user and is sandwiched by a second semi-line 44 and a third semi-line 45, wherein the second semi-line 44 is a semi-line obtained by moving the first semi-line 43 clockwise by a predetermined angle θ / 2 based on the first semi-line 43, and the third semi-line 45 is a semi-line obtained by moving the first semi-line 43 counterclockwise by a predetermined angle θ / 2 based on the first semi-line 43, wherein the first semi-line 43 is a semi-line obtained by extending a line segment 42 connecting the position P1 of the first user and the position P2 of the second user from the position P2 of the second user in a direction opposite to the position P1 of the first user.
[0064] Here, the blind spot area α is an area on the opposite side of the position P2 from the first user, and is an area where the first user leaves the visual field of the second user when the visual field of the second user at the position P2 is within the blind spot area α. Therefore, the predetermined angle θ formed by the second half straight line 44 and the third half straight line 45 can be an angle at which the first user does not enter the visual field of the second user at the position P2, and can be, for example, a value of 30 degrees, 45 degrees, or 60 degrees.
[0065] Specifically, when the instruction receiving unit 201 receives the instruction to start the application, the position relationship determination unit 203 draws the current position P3 of the robot and the positions P1 and P2 of the first user and the second user respectively on the environment map. Furthermore, the position relationship determination unit 203 sets the blind spot area α at the position P2 based on the drawn positions P1 and P2. Furthermore, if the current position P3 is outside the blind spot area α, the position relationship determination unit 203 determines that the robot is not within the blind spot area α, and if the current position P3 is within the blind spot area α, the position relationship determination unit 203 determines that the robot is within the blind spot area α.
[0066] Return reference to Figure 1 When the position relationship determination unit 203 determines that the robot is not located in the blind spot area α, the travel position determination unit 204 sets the target position P4 of the robot in the blind spot area α. Figure 4 As the target position P4, for example, a position on the first semi-straight line 43 at a distance from the second user to the robot that is a predetermined distance appropriate for the robot and the second user to communicate can be used. For example, as the target position P4, a position on the first semi-straight line 43 at a distance of 50 cm, 1 m, 2 m, etc. from the position P2 of the second user can be used. However, this is an example.
[0067] In addition, Figure 4 In the example, the target position P4 is set on the first semi-line 43 to make the second user's line of sight 41 be directed in the opposite direction to the first user's line of sight under the assumption that the second user's line of sight 41 is on the line segment 42. However, the actual line of sight of the second user may not necessarily be on the line segment 42. Therefore, in the case of adopting a configuration capable of detecting the actual line of sight of the second user, the walking position determination unit 204 sets the semi-line extending from the position P2 in the opposite direction to the detected line of sight as the first semi-line 43'. If the first semi-line 43' is included in the blind spot area α, the target position P4 may be set on the first semi-line 43'. On the other hand, if the first semi-line 43' is not located in the blind spot area α, if the target position P4 is set on the first semi-line 43', since the target position P4 becomes located outside the blind spot area α, the walking position determination unit 204 may set the target position P4 on the first semi-line 43.
[0068] Furthermore, the actual line of sight direction of the second user may be extracted from the video data by, for example, applying line of sight detection processing by the position coordinate acquisition unit 202 .
[0069] Return reference to Figure 1The robot walking unit 205 outputs a walking command to the actuator control unit 302 for moving the robot to the target position P4 set by the walking position determination unit 204. Here, the walking command is, for example, a command to rotate the robot so that the front direction of the robot faces the extension direction of the first semi-line 43 and to make the robot walk from the current position P3 to the target position P4.
[0070] The application execution unit 207 starts the corresponding application when receiving an instruction to start the application through the instruction receiving unit 201. In addition, the application execution unit 207 outputs a walking command for making the robot walk to the robot walking unit 205 and a speech command for making the robot speak to the speech synthesis unit 206 as needed.
[0071] The speech synthesis unit 206 generates speech data for causing the robot to speak in accordance with the speech command output from the application execution unit 207 , and outputs the generated speech data to the speech output unit 301 .
[0072] The output unit 300 includes a sound output unit 301 and an actuator control unit 302. The sound output unit 301 converts the sound data generated by the sound synthesis unit 206 into a sound signal and outputs it from a speaker. The actuator control unit 302 controls the actuator or motor of the robot so that the robot walks according to the walking command generated by the application execution unit 207 or the robot walking unit 205.
[0073] Furthermore, when the action execution unit 200 is installed in a terminal that can be connected to the robot in a wireless or wired manner, and the sound output unit 301 and the actuator control unit 302 are installed in the robot, the sound output unit 301 may receive the sound data sent from the sound synthesis unit 206 via wired or wireless. In addition, the actuator control unit 302 may receive the walking command sent from the robot walking unit 205 via wired or wireless.
[0074] Figure 2 Yes means Figure 1 A flowchart of an example of processing of the robot shown. Figure 3 Yes means Figure 2 A detailed flowchart of the process of S102 is shown below.
[0075] Below, refer to Figure 2 , Figure 3 as well as Figure 4 , describes the processing when the robot starts the application.
[0076] When the instruction receiving unit 201 receives the application startup instruction from the first user and the application execution unit 207 starts the application for assisting the second user in the discipline ("Yes" in S101), the positional relationship determination unit 203 proceeds to S102. On the other hand, if the application is not started ("No" in S101), the process is on standby in S101. Here, the startup instruction is sent from the portable terminal to the robot by the first user inputting the operation to the portable terminal carried by the first user.
[0077] In S102, if Figure 4 As shown, the position relationship determination unit 203 determines whether the robot is located in the blind spot area α of the second user. When the robot is not located in the blind spot area α ("No" in S101), the walking position determination unit 204 sets the target position P4 of the robot in the blind spot area α, and the robot walking unit 205 moves the robot to the set target position P4 (S103).
[0078] Reference Figure 4 The robot walking unit 205 generates a walking command for rotating the robot so that the front direction of the robot faces the extension direction of the first semi-line 43 and for moving the robot from the current position P3 to the target position P4, and outputs the command to the actuator control unit 302. Thus, the robot rotates so that the front direction of the robot faces the extension direction of the first semi-line 43, and then starts moving to the target position P4.
[0079] Next, the robot walking unit 205 determines whether the robot has reached the target position P4 (S104). When the robot reaches the target position P4 ("Yes" in S104), the application execution unit 207 causes the robot to start speaking to the second user (S105). On the other hand, if the robot has not reached the target position P4 ("No" in S104), the robot walking unit 205 continues the movement of the robot. Here, when the robot starts walking, the robot walking unit 205 sets a speed change pattern of the robot from the current position P3 to the target position P4, and moves the robot to the target position P4 according to the set speed change pattern. Here, as a speed change pattern, for example, a pattern can be adopted in which the robot is gradually accelerated from the current position P3 to the first distance, the robot is made to walk at a certain speed from the first distance to the second distance in front of the target position P4, and the robot is gradually decelerated from the second distance to the target position P4 so that the speed becomes 0 at the target position P4. Thereby, the robot can be moved smoothly toward the target position P4 and can be stopped accurately at the target position P4.
[0080] Next, use Figure 3 right Figure 2The details of the processing of S102 are described below. In S201, the positional relationship determination unit 203 obtains the coordinate data of the current position P3 of the robot calculated by the positional coordinate acquisition unit 202 based on the image data from the positional coordinate acquisition unit 202. In S202, the positional relationship determination unit 203 obtains the coordinate data of the position P2 of the second user calculated by the positional coordinate acquisition unit 202 based on the image data from the positional coordinate acquisition unit 202. In S203, the positional relationship determination unit 203 obtains the coordinate data of the position P1 of the first user calculated by the positional coordinate acquisition unit 202 based on the image data.
[0081] In S204, the position relationship determination unit 203 depicts the positions P1 and P2 of the first user and the second user and the current position P3 of the robot in the environment map constructed by the position coordinate acquisition unit 202, and sets a blind spot area α at the position P2. Then, the position relationship determination unit 203 determines whether the current position P3 of the robot is within the blind spot area α. If it is not within the blind spot area α ("No" in S204), the process is transferred to Figure 2 On the other hand, if the current position P3 of the robot is within the blind spot area α (“Yes” in S204), the process is transferred to Figure 2 S105.
[0082] Next, the use case of the robot disclosed in the present invention is described. The first user, the second user, and the robot are in a space where they can see each other (for example, in the same room), and the second user is playing with toys. The first user wants the second user to quickly put away the toys, so he takes out the portable terminal and inputs a start instruction for the application used to urge the child to put away the toys. At this time, the second user's attention will be transferred to the portable terminal taken out by the first user, and the line of sight will be directed toward the first user.
[0083] Here, consider the case where the robot does not exist in the blind spot area α of the second user and does not move to the blind spot area α. In this case, when the robot starts the application according to the startup instruction and starts to speak to the second user, since the first user is in the field of vision of the second user, the second user's attention remains in a state of being directed toward the first user, and the possibility that the second user will not respond to the robot's speech increases. In addition, since the second user visually recognizes that the first user is operating the portable terminal, it is also likely that the second user will notice that the subsequent speech of the robot is caused by the instructions of the first user. In this case, the second user will feel disappointed and / or rebellious towards the first user, and the second user is likely to not respond to the robot's speech.
[0084] Therefore, in the present disclosure, when an application startup instruction is given, if the robot is not located in the blind spot area α of the second user, the robot moves to the blind spot area α. As a result, the robot can guide the second user's line of sight to the blind spot area α located on the opposite side of the first user. Therefore, the first user is no longer in the field of vision of the second user, and the second user's attention is immediately transferred from the first user to the robot. Moreover, in this state, the robot starts to speak, so the robot can make the second user listen to its own speech attentively. As a result, the robot can successfully guide the second user to organize the toys and can smoothly assist in discipline.
[0085] On the other hand, in the present disclosure, when an application start instruction is issued, if the robot is located in the blind spot area α of the second user, the robot is spoken without moving. The reason is that when the robot is located in the blind spot area α, when the second user turns to the robot due to the robot's speech, the first user is no longer in the second user's field of vision, and even without moving the robot, the second user's attention can be diverted from the first user to the robot.
[0086] (robot)
[0087] Next, Figure 1 The mechanical structure of the robot shown is described below. Figure 5 Yes means Figure 1 FIG. 1 is a diagram showing an example of the appearance of the robot 1. Figure 5 As shown, the robot 1 includes a spherical main frame 401, a first spherical crown 402, and a second spherical crown 406. The main frame 401, the first spherical crown 402, and the second spherical crown 406 constitute a sphere as a whole. That is, the robot 1 has a spherical shape.
[0088] In addition, if Figure 5 As shown, the robot 1 includes a pair of cameras 101A on the first spherical crown 402 and the second spherical crown 406, and includes a microphone 102 and a speaker 301A on the first spherical crown 402. The camera 101A is equivalent to Figure 1 The image input unit 101 shown is provided on the first spherical crown portion 402 and the second spherical crown portion 406 such that the optical axis faces the front side of the robot 1 .
[0089] exist Figure 5 , an example in which the camera 101A is composed of a stereo camera is shown, but when the camera 101A is composed of a depth camera or a single-lens camera, the camera 101A is provided in either the first spherical crown portion 402 or the second spherical crown portion 406. The speaker 301A will be Figure 1The sound signal output by the sound output unit 301 is output to the external space. The microphone 102 acquires the surrounding sound of the robot 1 .
[0090] Figure 6 Observing from behind Figure 5 The figure shows the interior of the robot 1. The first spherical crown portion 402 and the second spherical crown portion 406 are connected by a shaft 115 extending in the lateral direction. On the other hand, the shaft 115 and the main frame 401 are not fixed together.
[0091] The main frame 401 includes a fixed first gear 116, a second gear 117 meshing with the first gear 116, a motor 118 connected to the second gear 117, and a frame 119 fixing the motor 118. Since the frame 119 is suspended from the shaft 115, the frame 119 does not rotate even if the shaft 115 rotates.
[0092] When the motor 118 is driven, the second gear 117 connected to the motor 118 rotates, and its power is transmitted to the first gear 116 meshed with the second gear 117. As a result, the main frame 401 to which the first gear 116 is fixed rotates synchronously with the drive of the motor 118. Therefore, when the motor 118 rotates in the forward direction, the robot 1 moves forward, and when the motor 118 rotates in the backward direction, the robot 1 moves backward.
[0093] The motor 118 is an example of an actuator. Figure 1 The robot 1 is rotated under the control of the actuator control unit 302 shown. Thus, the actuator control unit 302 can move the robot 1 forward or backward. The main frame 401, the first gear 116, the second gear 117, and the motor 118 are examples of a moving mechanism.
[0094] The counterweight 114 is mounted on the frame 119 via a pair of arms 123. The pair of arms 123 clamp the counterweight 114 at the lower end, and the upper end is mounted on the frame 119 in a manner that can rotate freely in the moving direction of the robot 1 relative to the frame 119. Inside the frame 119, a motor (not shown) is installed to swing the pair of arms 123 in the sway direction. Thus, when the counterweight 114 is swung to the right when viewed from the back, if the main frame 401 is rotated in the forward direction, the robot 1 turns right. On the other hand, when the counterweight 114 is swung to the left when viewed from the back, if the main frame 401 is rotated in the forward direction, the robot 1 turns left. Figure 1 The actuator control unit 302 shown in the figure can make the robot 1 turn right by driving the motor 118 in the forward direction while the motor (not shown) is rotated to the right by a predetermined angle. Similarly, the actuator control unit 302 can make the robot 1 turn left by driving the motor 118 in the forward direction while the motor (not shown) is rotated to the left by a predetermined angle.
[0095] The motor 121 is a motor for rotating the shaft 115. When the motor 121 rotates forward, its rotational force is transmitted to the shaft 115 via the belt 122, and the shaft 115 rotates downward relative to the pitch direction. On the other hand, when the motor rotates backward, its rotational force is transmitted to the shaft 115 via the belt 122, and the shaft 115 rotates upward relative to the pitch direction. As a result, the first spherical crown portion 402 and the second spherical crown portion 406 mounted on the shaft 115 and the display portion for displaying the eyes and mouth of the robot 1 mounted on the arm 113 rotate in conjunction. As a result, the direction of the eyes and mouth of the robot 1 and the direction of the optical axis of the camera 101A are changed downward or upward in the pitch direction.
[0096] The present disclosure can adopt the following modified examples.
[0097] (1) In the above embodiment, a robot is used. Figure 5 as well as Figure 6 The robot shown is spherical, but the present disclosure is not limited to this and can also be applied to other robots.
[0098] (2) This disclosure applies to Figure 1 The robot shown in the figure is an example, but it can also be applied to general devices including robots. As devices, home appliances such as televisions and audio equipment are included.
[0099] (3) In the above embodiment, an application that assists in discipline is used as the application, but the present disclosure is not limited to this. For example, an application that assists in all types of education including discipline may be used.
[0100] (4) The applications described in the above embodiments may be multiple, for example, depending on the content of the discipline. In this case, the first user may select any one of the multiple applications. Specifically, the robot stores multiple applications in the memory, and when the first user uses the portable terminal to input a start instruction for a certain application, the application may be started. Examples of the content of the discipline include tidying up, cleaning, studying, bathing, and going to the toilet.
[0101] Description of symbols
[0102] 41: sight direction, 42: line segment, 43, 43': first semi-line, 44: second semi-line, 45: third semi-line, 100: sensor input unit, 101: image input unit, 101A: camera, 115: axis, 118: motor, 200: action execution unit, 201: instruction receiving unit, 202: position coordinate acquisition unit, 203: position relationship judgment unit, 204: walking position judgment unit, 205: robot walking unit, 206: sound synthesis unit, 207: application execution unit, 300: output unit, 301: sound output unit, 301A: speaker, 302: actuator control unit, α: blind spot area.
Claims
1. A device for communicating with a user, comprising: A camera for acquiring images of the surroundings of the device; a driving mechanism for driving the device; speaker; Memory; as well as processor, the processor, In a case where an application of the device is remotely started based on an instruction of the first user, judging whether the current position of the device is included in a blind spot area of the second user based on the image, the blind spot area being an area that does not include the sight line direction of the second user and is sandwiched by a second semi-line and a third semi-line, the second semi-line being a semi-line obtained by moving the first semi-line clockwise by a predetermined angle based on the first semi-line, the third semi-line being a semi-line obtained by moving the first semi-line counterclockwise by the predetermined angle based on the first semi-line, the first semi-line being a semi-line obtained by extending a line segment connecting the position of the first user and the position of the second user from the second user in a direction opposite to the first user; If it is determined that the current position of the device is not included in the blind spot area, setting a target point included in the blind spot area; controlling the driving mechanism to move the device to the target location; The speaker is enabled to output sound corresponding to the application.
2. The device according to claim 1, The first user is a guardian of the second user.
3. The device according to claim 1, When the processor determines that the current position of the device is included in the blind spot area, the processor causes the speaker to output a sound corresponding to the application without moving the device.
4. A robot for communicating with a user, having: A camera for acquiring images of the device's surroundings; a driving mechanism for driving the device; speaker; Memory; and processor, the processor, In a case where an application of the device is remotely started based on an instruction of the first user, judging whether the current position of the device is included in a blind spot area of the second user based on the image, the blind spot area being an area that does not include the sight line direction of the second user and is sandwiched by a second semi-line and a third semi-line, the second semi-line being a semi-line obtained by moving the first semi-line clockwise by a predetermined angle based on the first semi-line, the third semi-line being a semi-line obtained by moving the first semi-line counterclockwise by the predetermined angle based on the first semi-line, the first semi-line being a semi-line obtained by extending a line segment connecting the position of the first user and the position of the second user from the second user in a direction opposite to the first user; If it is determined that the current position of the device is not included in the blind spot area, setting a target point included in the blind spot area; controlling the driving mechanism to move the device to the target location; The speaker is enabled to output sound corresponding to the application.
5. A method performed by a device for communicating with a user, The device comprises a camera, a processor, a speaker and a moving mechanism. The method include: In a case where an application of the device is remotely started based on an instruction of the first user, judging whether the current position of the device is included in a blind spot area of the second user based on an image of the periphery of the device obtained by the camera, the blind spot area being an area that does not include the sight line direction of the second user and is sandwiched by a second semi-line and a third semi-line, the second semi-line being a semi-line obtained by moving the first semi-line clockwise by a predetermined angle based on the first semi-line, the third semi-line being a semi-line obtained by moving the first semi-line counterclockwise by the predetermined angle based on the first semi-line, the first semi-line being a semi-line obtained by extending a line segment connecting the position of the first user and the position of the second user from the second user in a direction opposite to the first user; If it is determined that the current position of the device is not included in the blind spot area, setting a target point included in the blind spot area; controlling the moving mechanism to move the device to the target location; as well as The speaker is enabled to output sound corresponding to the application.
6. A computer program product comprising a computer program, the program being configured to cause a computer to execute the method according to claim 5.
