Assistance terminal

Abstract

Provided is an assistance terminal capable of improving the ease of work of a worker. This assistance terminal is carried by a worker, is capable of voice interaction, and is capable of exchanging information with another assistance terminal that is carried by a worker different from said worker and is capable of voice interaction. The assistance terminal comprises: an interaction unit that, for the voice interaction, presents an assistance voice included in work information at an output timing and recognizes a work-related input voice at an input timing; a distance computation unit that computes the distance to another assistance terminal; a calculation unit that calculates a priority score; an information exchange unit that exchanges information including the priority score with the other assistance terminal; and a coordination unit that, when the other assistance terminal is located within a coordination distance, shares the priority score with the other assistance terminal, and when the priority score is higher than that of the other assistance terminal, controls the output timing at which the assistance voice is presented by the other assistance terminal.

Description

Support terminal

[0001] The present disclosure relates to a support terminal that supports the work of field workers.

[0002] Patent Document 1 discloses a field support system that supports field work. The field support system includes a wearable computer worn by a worker. The wearable computer has a voice guidance function and notifies the work manual by voice. The worker can work according to the manual without looking at the screen display.

[0003] Japanese Patent Application Laid-Open No. 2002-287815

[0004] Multiple workers may each wear the wearable computer described in Patent Document 1 and gather at one place to work. In this case, the multiple wearable computers notify voice individually. Therefore, the voices may overlap, causing the workers to be confused and the work may not proceed smoothly.

[0005] The present disclosure has been made to solve the above problems. The object of the present disclosure is to provide a support terminal that can improve the workability of workers.

[0006] The support terminal according to the present disclosure is a terminal that is possessed by a worker, can perform voice dialogue, and can exchange information with another support terminal that can perform voice dialogue and is possessed by another worker different from the worker. As the voice dialogue, a support voice included in work information is notified at an output timing, and an input voice related to work is recognized at an input timing. It includes a dialogue unit, a distance calculation unit that calculates the distance to another support terminal, a calculation unit that calculates a priority score, an information exchange unit that exchanges information including the priority score with another support terminal, and when another support terminal exists within a cooperative distance, shares the priority score with the other support terminal, and when the priority score is higher than that of the other support terminal, a cooperation unit that controls the output timing at which the support voice is notified by the other support terminal.

[0007] According to this disclosure, the worker hears support voices through voice interaction. Furthermore, if multiple support terminals are within a cooperative distance, the support terminal controls the timing of the output of support voices to other support terminals. This improves the worker's work efficiency.

[0008] This is a functional block diagram of the support system in Embodiment 1. This is a table explaining the items considered in the priority score calculated by the support terminal in Embodiment 1. This is a flowchart showing an example of the operation of the support terminal until it determines the mode in Embodiment 1. This is a diagram showing the progression of processing performed by two support terminals in the support system in Embodiment 1. This is a functional block diagram of the support system in Embodiment 2. This is a hardware configuration diagram of the support terminal in Embodiment 1 or 2.

[0009] The embodiments for implementing this disclosure will be described with reference to the attached drawings. In each drawing, the same or corresponding parts are denoted by the same reference numerals. The explanation of such parts will be simplified or omitted as appropriate.

[0010] Embodiment 1. Figure 1 is a functional block diagram of the support system in Embodiment 1.

[0011] As shown in Figure 1, the support system 1 includes multiple support terminals 2. The number of support terminals 2 included in the support system 1 can be any number, as long as it is two or more. Each of the multiple support terminals 2 has the same configuration. For example, a support terminal 2 may be a laptop computer or a smartphone.

[0012] For example, support system 1 is used in workplaces where multiple workers perform maintenance, inspection, construction, manufacturing, etc. The following describes an example of support system 1 being used in the maintenance of an elevator. Note that support system 1 may also be used in the maintenance of an escalator. Each worker carries their own support terminal 2.

[0013] Support terminal 2 can exchange information with other support terminals 2. Support terminal 2 is a device capable of voice interaction regarding work. Specifically, as voice interaction, support terminal 2 notifies the worker holding it of specific work procedures at the timing of the work procedures to be performed. The worker performs the work referring to the support voice. Instead of inputting various numerical values ​​etc. measured during maintenance work via buttons etc., the worker emits them as input voice. As voice interaction, support terminal 2 performs speech recognition to analyze the input voice and extract information from the input voice. Support terminal 2 stores the information contained in the input voice as work history. In this way, support terminal 2 supports the worker's work in a dialogue format that outputs and recognizes voice.

[0014] The support terminal 2 includes, as functions, an input unit 10, a display unit 11, an audio output unit 12, an information exchange unit 13, and a support unit 14. The input unit 10 is an interface that accepts information input. The input unit 10 includes a microphone that detects sound. The input unit 10 may also include buttons that accept physical operation. The display unit 11 is a screen that displays information. The display unit 11 controls the information to be displayed.

[0015] The audio output unit 12 is an interface that outputs sound. The audio output unit 12 includes a speaker that announces sounds within the audible range. The audible range is the frequency band of sound waves that humans can hear.

[0016] The information exchange unit 13 is an interface for exchanging information with other support terminals 2. That is, the information exchange unit 13 transmits information to other support terminals 2 and receives information from other support terminals 2. The information exchange unit 13 may use radio waves or sound waves to exchange information.

[0017] When radio waves are used, the information exchange unit 13 includes an antenna for transmitting and receiving electromagnetic waves. When sound waves are used, the information exchange unit 13 includes a speaker for transmitting sound waves and a microphone for receiving sound waves.

[0018] The following describes an example in which the information exchange unit 13 exchanges information using sound waves. For example, the information exchange unit 13 transmits information using sound waves of a specific frequency. In this case, the information exchange unit 13 may transmit information by changing the frequency of the sound waves. For example, the information exchange unit 13 exchanges information by transmitting and receiving sound waves with frequencies that are not in the audible range. For example, the information exchange unit 13 transmits and receives positioning sounds, which are sound waves with frequencies that are not in the audible range.

[0019] The support unit 14 performs voice interaction via the input unit 10 and the voice output unit 12. The support unit 14 includes a storage unit 15, a history unit 16, and a dialogue unit 17. The storage unit 15 stores work information. The work information includes work procedures related to the work performed by the worker. The work information includes information necessary for voice interaction, such as the timing based on the work procedure, the output timing when support voice is announced, and the input timing when input voice is recognized.

[0020] The history unit 16 stores history information of work support. The history information includes the history of support voices output based on work information and the history of recognized input voices. For example, when a worker completes half of the work through voice interaction, the history information includes support voices that were communicated to the worker, support voices that were not communicated to the worker, and work information extracted from the input voices from the worker.

[0021] The dialogue unit 17 virtually implements the voice agent of the AI ​​that performs voice dialogue. In standalone operation mode, the dialogue unit 17, as a voice agent, notifies the support voice included in the work procedure of the work information via the voice output unit 12 when it is time to output the support voice. In standalone operation mode, the dialogue unit 17, as a voice agent, recognizes the input voice included in the work procedure of the work information via the input unit 10 when it is time to input the input voice. The dialogue unit 17 analyzes the recognized input voice and extracts information. The dialogue unit 17 may always accept recognition of input voice, or it may accept recognition of input voice when a specific trigger word is input to the input unit 10. However, in order to suppress malfunctions caused by the input voice, the following description will focus on the case where the dialogue unit 17 starts recognizing the input voice at the input timing.

[0022] Support terminal 2 communicates with the worker who possesses it by coordinating its various functions and controlling output and input timings according to the work procedures included in the work information. In some cases, multiple workers may gather at close range to perform the work. In such cases, multiple support terminals 2 operating in standalone mode may simultaneously broadcast various support voices based on their own work information. Furthermore, input voice from one worker to their own support terminal 2 may be recognized by another support terminal 2 held by a different worker. In this case, there is a risk of confusion in the work.

[0023] In the support system 1 of this embodiment, cooperative operation is performed between support terminals 2 that are close to each other. In the cooperative operation mode in which cooperative operation is performed, the multiple support terminals 2 are divided into one leader terminal and one or more non-leader terminals. The support terminal 2 that becomes the leader terminal controls the output timing and input timing of the voice dialogue of the support terminals 2 that become non-leader terminals. The support unit 14 includes a distance calculation unit 18, a calculation unit 19, and a coordination unit 20 as functions to realize such cooperative operation.

[0024] The distance calculation unit 18 calculates the distance to other support terminals 2. For example, the distance calculation unit 18 calculates the distance to other support terminals 2 based on the positioning sound transmitted and received by the information exchange unit 13.

[0025] The calculation unit 19 calculates a priority score. The priority score is an indicator value of the device's priority in cooperative operation mode. A higher priority score indicates that the device is more suitable to be a leader terminal in cooperative operation mode.

[0026] The coordination unit 20 switches the voice dialogue mode. Specifically, if the distance to the other support terminal 2 is greater than the coordination distance, the coordination unit 20 switches the voice dialogue mode to standalone operation mode. If the distance to the other support terminal 2 is within the coordination distance, the coordination unit 20 switches to coordinate operation mode. For example, the coordination distance can be set to a distance at which conversation is possible, such as 2m or 5m.

[0027] In cooperative operation mode, the cooperative unit 20 sets up a cooperative group consisting of one or more other support terminals 2 located within the cooperative distance. Within the cooperative group, the cooperative unit 20 shares the priority score calculated by the calculation unit 19 via the information exchange unit 13.

[0028] If a support terminal 2 included in a cooperative group has the highest priority score, the cooperative unit 20 switches the voice interaction mode to leader terminal mode. If a support terminal 2 included in a cooperative group does not have the highest priority score, i.e., is ranked second or lower, the cooperative unit 20 switches the voice interaction mode to non-leader terminal mode.

[0029] When in non-reader terminal mode, the cooperation unit 20, as a non-reader terminal, receives operation commands from the reader terminal via the information exchange unit 13. In this case, the cooperation unit 20 controls the dialogue unit 17 based on the operation commands.

[0030] When in leader terminal mode, the coordination unit 20, as a leader terminal, transmits operation commands from the information exchange unit 13. The operation commands include the output timing for each support voice included in the work information. That is, when the coordination unit 20 has the highest priority score in the coordination group, it controls the output timing at which support voices are announced on other support terminals 2 included in the coordination group. The coordination unit 20 may also transmit operation commands that reflect not only the work information, but also its own history information and the history information stored on other support terminals 2. For example, the coordination unit 20 may create and transmit an operation command assuming that the work for support voices already output on other support terminals 2 has been completed.

[0031] Furthermore, the operation command may include information indicating that the input voice should not be recognized. In this case, the cooperation unit 20 causes the dialogue unit 17 to recognize the voice at the moment another worker speaks. That is, the support terminal 2, which is the reader terminal, recognizes all input voices.

[0032] Furthermore, the operation command may include the input timing of the input voice included in the work information. That is, the cooperation unit 20 may control the input timing at which other support terminals 2 recognize the input voice related to the work.

[0033] The operation of the cooperation unit 20 described above is performed similarly in the cooperation unit 20 of the other support terminals 2.

[0034] Next, the priority score calculated by the calculation unit 19 will be explained using Figure 2. Figure 2 is a table that explains the items considered in the priority score calculated by the support terminal in Embodiment 1.

[0035] The calculation unit 19 calculates a priority score based on one or more influencing items. The table in Figure 2 lists examples of influencing items in each row. For example, the priority score is the sum of at least one of several individual priority scores calculated for each of the influencing items shown in the table.

[0036] The first influencing factor is the worker's role. The worker's role refers to the work role of the person holding the support terminal 2 in this task. Worker roles include work supervisor, sub-work leader, work executor, work assistant, etc. The calculation unit 19 calculates individual priority scores so that the score is higher according to the worker's role. For example, the individual priority score of the support terminal 2 held by the work supervisor will be the highest. The individual priority score of the support terminal 2 held by the work assistant will be the lowest.

[0037] The second influencing factor is that the work information for the current task is stored in the memory unit 15. If the work information for the current task is stored in the memory unit 15, the worker is considered to be a worker who is significantly involved in the current task, so the calculation unit 19 calculates an individual priority score that is higher than if the work information for the current task were not stored in the memory unit 15.

[0038] The third influencing factor is the worker's job title or years of experience. The calculation unit 19 calculates individual priority scores such that the higher the job title of the worker possessing the support terminal 2, the higher the score. The calculation unit 19 also calculates individual priority scores such that the longer the years of experience of the worker possessing the support terminal 2, the higher the score.

[0039] The fourth influencing factor is the sound pressure of the input audio from the first speaker. The first speaker is the speaker of the audio first detected by the input unit 10 after the distance from the other support terminal 2 becomes within the cooperative distance. The calculation unit 19 acquires the sound pressure of this first speaker. The sound pressure often indicates the sensitivity of the input unit 10 in detecting audio. Furthermore, the sound pressure is a measured value that reflects the distance between the support terminal 2 and the first speaker.

[0040] If the sound pressure is low, there may be a problem with the microphone in the input unit 10. Such a support terminal 2 should not be used as a reader terminal.

[0041] Also, for example, when multiple workers gather, the worker who speaks first is likely to have a higher work role. Also, at this time, it may be arranged that the worker with the highest work role speaks first. When the first speaker holds the support terminal 2, the sound pressure of the first speaker acquired by the support terminal 2 is relatively high. When the first speaker does not hold the support terminal 2, the sound pressure of the first speaker acquired by the support terminal 2 is relatively low.

[0042] The calculation unit 19 calculates an individual priority score or a priority score based on the sound pressure of the voice from the first speaker. For example, the calculation unit 19 calculates the individual priority score such that the higher the sound pressure of the voice from the first speaker, the higher the score.

[0043] Also, the calculation unit 19 may set the determination regarding the sound pressure as a knockout condition. When the knockout condition is satisfied, the calculation unit 19 calculates the lowest priority score so as not to become the leader terminal. For example, the calculation unit 19 may calculate the priority score such that the score is the lowest when the sound pressure of the voice from the first speaker is less than a specified sound pressure threshold value as the knockout condition.

[0044] As the fifth influencing item, the specifications or operating states of the support terminal 2 are listed. The fifth influencing item is used as a knockout condition. The calculation unit 19 calculates an operation score. The operation score is an index value reflecting the specifications or operating states of the support terminal 2. The higher the specifications of the support terminal 2 or the better the operating state, the higher the operation score. For example, the calculation unit 19 calculates the operation score such that the score is the lowest when an abnormality such as a processing crash has occurred in the previous processing of the support terminal 2. The calculation unit 19 may calculate the priority score such that the score is the lowest when the operation score is less than a specified operation threshold value as the knockout condition.

[0045] Further, when calculating the individual priority score, the calculation unit 19 may change the weighting for each influence item. Weighting means the magnitude of the influence that the difference in each influence item has on the priority score. For example, for the first influence item and the second influence item, the weighting is the heaviest "large". For the third influence item, the weighting is "medium". For the fourth influence item, the weighting is the lightest "small". Note that the fourth influence item can also be a knockout condition. The fifth influence item has no weighting but can be a knockout condition.

[0046] A specific example of the influence by weighting will be described. When the role of the first worker who holds the first support terminal 2a is higher than the role of the second worker who holds the second support terminal 2b, let the difference between the individual priority score based on the first influence item calculated by the first support terminal 2a and the individual priority score based on the first influence item calculated by the second support terminal 2b be score A. Also, when the number of years of experience of the first worker is longer than the number of years of experience of the second worker, let the difference between the individual priority score based on the third influence item calculated by the first support terminal 2a and the individual priority score based on the third influence item calculated by the second support terminal 2b be score B. Since the weighting of the first influence item is "large" and the weighting of the third influence item is "medium", basically, score A is larger than score B. That is, the height of the position has a greater influence on the priority score than the length of the number of years of experience.

[0047] Among these influence items, the calculation unit 19 calculates the priority score by reflecting at least one of them.

[0048] Next, the specific operations of the support terminal 2 will be described using FIGS. 3 and 4. FIG. 3 is a flowchart showing an example of the operations of the support terminal until it determines the mode in the first embodiment. FIG. 4 is a diagram showing the transition of the processes performed by the two support terminals in the support system in the first embodiment.

[0049] The flowchart in Figure 3 shows the actions performed by one of the support terminals 2. The flowchart in Figure 3 may be started at any time while the support terminal 2 is running. For example, this flowchart may be started when the support terminal 2 starts up. This flowchart may also be started each time a predetermined waiting time has elapsed since the last time the actions in this flowchart were performed.

[0050] In step S01, the information exchange unit 13 of the support terminal 2 transmits a positioning sound. At this time, the information exchange unit 13 may also receive the positioning sound.

[0051] Subsequently, in step S02, the distance calculation unit 18 calculates the distance to the other support terminal 2 using the result of the operation performed in step S01. If there are no other support terminals 2 nearby, the distance calculation unit 18 may calculate a constant value larger than the cooperative distance as the distance to the other support terminal 2.

[0052] Subsequently, in step S03, the coordination unit 20 determines whether or not another support terminal 2 exists within the coordination distance.

[0053] In step S03, if no other support terminal 2 is present within the cooperation distance, in step S04, the cooperation unit 20 switches the voice dialogue mode to standalone operation mode. After that, the flowchart operation ends.

[0054] In step S03, if other support terminals 2 exist within the cooperation distance, in step S05, the cooperation unit 20 sets up a cooperation group that includes itself and the other support terminals 2 that exist within the cooperation distance.

[0055] Subsequently, in step S06, the calculation unit 19 calculates the priority score. Alternatively, the calculation unit 19 may wait for a certain period after step S05 to detect the sound pressure of the first speaker's voice before calculating the priority score.

[0056] Subsequently, in step S07, the information exchange unit 13 transmits a sound wave indicating the priority score calculated in step S06. The information exchange unit 13 receives a sound wave from another support terminal 2 included in the cooperation group, which indicates the priority score of that other support terminal 2. That is, the information exchange unit 13 exchanges the priority score with the other support terminal 2.

[0057] Subsequently, in step S08, the coordination unit 20 determines whether its own priority score is the highest among the support terminals 2 included in the coordination group.

[0058] In step S08, if the priority score is the highest, in step S09, the cooperation unit 20 sets the voice interaction mode to the leader terminal mode of the cooperative operation mode. After that, the flowchart operation ends.

[0059] If, in step S08, the priority score of the unit is not the highest, that is, if there is another support terminal 2 with a higher priority score than the unit itself, the operation in step S10 is performed. In step S10, the cooperation unit 20 sets the voice dialogue mode to the non-leader terminal mode of the cooperative operation mode. After that, the operation of the flowchart ends.

[0060] Following this flowchart, each support terminal 2 engages in voice interaction based on its own mode. In the operations from step S05 onward, other support terminals 2 included in the cooperation group perform similar operations. That is, the other support terminals 2 are either in leader terminal mode or non-leader terminal mode. A support terminal 2 in non-leader terminal mode may identify a support terminal 2 in leader terminal mode, or it may simply follow the operation commands without identifying a support terminal 2 in leader terminal mode.

[0061] Furthermore, a support terminal 2 in non-leader terminal mode included in the cooperative group may detect when a support terminal 2 in leader terminal mode has moved beyond the release distance. The release distance may be the same as the cooperative distance or may be longer than the cooperative distance. If it is detected that a support terminal 2 in leader terminal mode has moved beyond the release distance, one or more support terminals 2 included in the cooperative group may each perform the actions shown in the flowchart of Figure 3. That is, when the leader terminal moves away, the cooperative group may perform an action to determine a new leader terminal.

[0062] Figure 4 schematically illustrates the processing performed by the first support terminal 2a, which acts as the leader terminal, and the second support terminal 2b, which acts as the non-leader terminal. Each process is illustrated to proceed from top to bottom.

[0063] First, when the distance between the first support terminal 2a and the second support terminal 2b falls within the coordination distance, the first support terminal 2a determines in process P11 that the second support terminal 2b is within the coordination distance. In this case, in process P21, the second support terminal 2b determines that the first support terminal 2a is within the coordination distance.

[0064] Subsequently, in processes P12 and P22, the first support terminal 2a and the second support terminal 2b exchange priority scores. In this example, the first support terminal 2a is assumed to have a higher priority score than the second support terminal 2b. Processes P12 and beyond show the process when the priority score of the first support terminal 2a is higher than that of the second support terminal 2b.

[0065] Subsequently, in process P13, the first support terminal 2a sets itself as a leader terminal and enters leader terminal mode. In process P23, the second support terminal 2b sets itself as a non-leader terminal and enters non-leader terminal mode. For the first support terminal 2a, the second support terminal 2b becomes the other support terminal 2.

[0066] Subsequently, in process P24, the coordination unit 20 of the second support terminal 2b transmits the work information for the current task stored in its own memory unit 15 to the first support terminal 2a as other work information for the first support terminal 2a. In process P14, the coordination unit 20 of the first support terminal 2a aggregates the other work information received from the second support terminal 2b with the work information for the current task stored in its own memory unit 15 and stores it in its own memory unit 15.

[0067] Subsequently, in process P15, the coordination unit 20 of the first support terminal 2a issues output timing and input timing commands to its dialogue unit 17 based on the aggregated work information. The coordination unit 20 of the first support terminal 2a also generates an operation command to control the output timing or input timing of the second support terminal 2b based on the aggregated work information. The first support terminal 2a transmits the generated operation command to the second support terminal 2b via the information exchange unit 13.

[0068] Subsequently, in process P16, the dialogue unit 17 of the first support terminal 2a engages in voice dialogue based on the operation command issued in process P15. In process P25, the dialogue unit 17 of the second support terminal 2b notifies the operation information stored in the memory unit 15 at the output timing included in the operation command. The dialogue unit 17 of the second support terminal 2b may also recognize the input voice content based on the operation information stored in the memory unit 15 at the input timing included in the operation command.

[0069] The first support terminal 2a and the second support terminal 2b repeat processes P15, P16, and P25 until the work is completed.

[0070] Once the work is completed, in processes P17 and P26, the information exchange unit 13 of the first support terminal 2a and the information exchange unit 13 of the second support terminal 2b exchange and synchronize the history information stored in the history unit 16. In this state, the first support terminal 2a and the second support terminal 2b have the same history information, including each other's work history, stored in them. Although not shown in the figures, at least one of the first support terminal 2a and the second support terminal 2b saves the stored history information to the maintenance company's centralized device at the maintenance company's office.

[0071] The timing of processes P17 and P26 is arbitrary. For example, when the support terminal 2 exchanges priority scores, it may exchange history information in the background and synchronize it with each other.

[0072] According to Embodiment 1 described above, the support terminal 2 includes a dialogue unit 17, a distance calculation unit 18, a calculation unit 19, an information exchange unit 13, and a cooperation unit 20 as its functions. The dialogue unit 17 engages in voice dialogue with the worker using support voice. As a result, the worker can obtain and input work-related information from the support terminal 2 hands-free. Furthermore, if another support terminal 2 is present within the cooperation distance and the priority score is the highest, the cooperation unit 20 controls the output timing at which support voice is broadcast on the other support terminal 2. As a result, it is possible to avoid situations where the worker cannot hear voices related to their own work. Consequently, the worker's work efficiency can be improved.

[0073] Furthermore, this type of coordination control is automatically performed according to the distance between support terminal 2 and other support terminals 2. For example, workers do not need to pre-configure settings for the leader terminal or set which support terminal 2 will be the leader terminal each time they gather. As a result, voice communication can be performed quickly and accurately even in a constantly changing work environment, thereby improving the workers' productivity.

[0074] Furthermore, if the coordination unit 20 is a leader terminal, it may be configured not to recognize input voice on other support terminals 2. In this case, the coordination unit 20 causes the dialogue unit 17 to recognize the voice at the moment another worker emits input voice. That is, within the coordination group, all voice recognition is performed by the support terminal 2 that is the leader terminal. Therefore, it is possible to prevent the voice of one worker from being recognized by a support terminal 2 held by another worker, thus preventing the recording of inappropriate input voice.

[0075] Furthermore, if the coordination unit 20 is a reader terminal, it may control the input timing of other support terminals 2. This prevents the voice of one worker from being recognized by a support terminal 2 held by another worker, thus preventing the recording of inappropriate input voice.

[0076] Furthermore, the calculation unit 19 can calculate a priority score based on various influencing factors. Therefore, the support system 1 can designate the most effective support terminal 2 at any given moment as the leader terminal without having to explicitly set the priority of each support terminal 2 in advance.

[0077] Specifically, the calculation unit 19 calculates priority scores so that the score is higher according to the worker's role in the current task. In many tasks, the task supervisor is responsible for giving work instructions. By calculating priority scores according to roles, the support terminal 2 of the worker with greater responsibility is more likely to become the leader terminal. As a result, workers can easily recognize the leader terminal.

[0078] Furthermore, the calculation unit 19 calculates a priority score so that the score is higher when the work information for the current task is stored. The work information for the current task is often stored at least on the support terminal 2 of the work supervisor. For this reason, the support terminal 2 of the worker with greater responsibility is more likely to become the leader terminal.

[0079] Furthermore, the calculation unit 19 calculates priority scores such that the higher the worker's job rank or the longer their years of experience, the higher the score. As a result, the support terminal 2 of a worker with a high job rank or long years of experience is more likely to become the leader terminal. Consequently, workers can smoothly recognize the leader terminal.

[0080] Furthermore, the calculation unit 19 calculates a priority score based on the sound pressure of the first voice detected after the distance to other support terminals 2 becomes within the cooperative distance. For example, the calculation unit 19 calculates the priority score such that the higher the sound pressure of the voice, the higher the score. In this case, it is highly likely that the owner of support terminal 2 is the person in charge of the work. Also, it is highly likely that the voice detection sensitivity of the input unit 10 is good. For example, if the sound pressure of the voice is lower than the sound pressure threshold, the calculation unit 19 calculates the priority score such that the score is lowest as a knockout condition. In this case, it is highly likely that the detection sensitivity of the input unit 10 is poor. Therefore, it is possible to suppress support terminals 2 with poor equipment conditions from becoming the leader terminal.

[0081] Furthermore, the calculation unit 19 calculates a priority score so that the lowest score is obtained when the operation score is lower than the abnormal threshold as a knockout condition. The operation score will be low when the specifications of the support terminal 2 are insufficient, when there is an abnormality in the internal equipment, etc. Therefore, it is possible to avoid a support terminal 2 that is not suitable to be the leader terminal among multiple support terminals 2 becoming the leader terminal.

[0082] Furthermore, the information exchange unit 13 exchanges information with other support terminals 2 using sound waves. The information exchange unit 13 may also emit positioning sounds, which are sound waves used to measure distance. The distance calculation unit 18 calculates the distance to other support terminals 2 based on the positioning sounds from other support terminals 2. When multiple support terminals 2 are within each other's cooperative distance, interference may occur with radio wave communication. Also, there may be many devices that emit radio waves in the surrounding area. Moreover, work may be performed in an environment where the network configuration is unknown. For example, work may be performed in a location where it is difficult to connect a relay device that mediates communication between support terminals 2 and the support terminals 2. On the other hand, since the support terminals 2 are based on voice interaction, they have pre-installed interfaces for transmitting and receiving sound waves. By performing information exchange and distance measurement using sound waves, information can be exchanged more stably and quickly than when using radio waves. In particular, the frequency at which information is exchanged may be pre-set to a specific frequency. In this case, the support terminals 2 can quickly exchange information without separating it from support voice, etc.

[0083] Furthermore, the sound waves emitted from the information exchange unit 13 may be at frequencies outside the audible range. In this case, the support terminal 2 can exchange information without the operator being aware of the sound waves transmitted through communication.

[0084] The distance calculation unit 18 may also be capable of measuring the height position inside the elevator shaft. In this case, the distance calculation unit 18 may measure the height position based on a barometer installed on the support terminal 2. In this case, the distance calculation unit 18 exchanges height position information with other support terminals 2 via the information exchange unit 13. The distance calculation unit 18 may calculate the difference between its own height position and the height position of other support terminals 2 as the distance to other support terminals 2. Considering that communication is done by voice, the horizontal distance between workers inside the elevator shaft is close. The distance calculation unit 18 can easily calculate the distance to other support terminals 2 by considering the difference in height positions as the distance to other support terminals 2.

[0085] Furthermore, the support terminal 2 is further equipped with a history unit 16 that stores history information. The information exchange unit 13 exchanges history information with other support terminals 2 and synchronizes the history information with that of other support terminals 2. As a result, the support terminal 2 that has become the leader terminal can assign tasks while considering the progress of the entire task and can output more appropriate support voice. In addition, even if only one of the support terminals 2, for example, only the support terminal 2 that was not the leader terminal, returns to the office or other location where the work history is registered after the work is completed, that support terminal 2 can register all the history information. As a result, the work efficiency of the workers can be improved.

[0086] The distance calculation unit 18 may calculate the distance to other support terminals 2 based on the radio waves transmitted and received by the information exchange unit 13.

[0087] Embodiment 2. Figure 5 is a functional block diagram of the support system in Embodiment 2. Parts identical or corresponding to those in Embodiment 1 are denoted by the same reference numerals. Descriptions of these parts are omitted.

[0088] In Embodiment 2, the support terminal 2 comprises a model storage unit 30, a model generation unit 31, and a model integration unit 32. The customized model is stored in the model storage unit 30.

[0089] The customized model is a dialogue engine used in the dialogue unit 17, and is used for voice dialogue. The customized model is a dialogue engine in which each parameter is customized to suit the characteristics of voice dialogue with a worker holding the support terminal 2. For example, the customized model includes a speech recognition engine. For example, in the customized model, when performing speech recognition, parameters of acoustic features are set to suit the worker, such as emphasizing or attenuating only specific frequency bands. For example, in the customized model, parameters for smooth dialogue, such as the timing of pauses in speech, the length of pauses in speech, and the length of a single utterance, are set to suit the worker.

[0090] The model generation unit 31 stores the content of the dialogue with the worker. Based on past voice dialogues with the worker, the model generation unit 31 uses machine learning to determine the parameters of the customized model. In other words, the model generation unit 31 generates a customized model, which is a dialogue model specifically tailored to the worker who possesses the support terminal 2. The model generation unit 31 stores the generated customized model in the model storage unit 30.

[0091] When the model integration unit 32 enters leader terminal mode, it obtains parameters of other customized models from other support terminals 2, which are non-leader terminals in the cooperative group. The model integration unit 32 integrates the customized model stored in its own model storage unit 30 with the other customized models from the other support terminals 2 to generate an integrated customized model. Specifically, for example, the model integration unit 32 calculates integrated parameters by taking the average or median of each parameter of its own customized model and each parameter of the other customized models, and uses these as parameters for the integrated customized model.

[0092] When in reader terminal mode, the dialogue unit 17 uses the integrated customization model as its dialogue engine to perform voice dialogue. In particular, when in reader terminal mode and control is in place to prevent non-reader terminals from recognizing input voice, the dialogue unit 17 should use the integrated customization model as its dialogue engine to perform voice dialogue.

[0093] According to Embodiment 2 described above, the support terminal 2 uses a customized model to perform voice dialogue. As a result, the support terminal 2 can communicate with the user accurately and smoothly. On the other hand, the support terminal 2, which is a leader terminal, may recognize the input voice of another worker who is holding another support terminal 2. In this case, the parameters of the original customized model may become an obstacle to voice dialogue with that other worker. Therefore, the support terminal 2, which is a leader terminal, obtains other customized models from other support terminals 2 that are not leader terminals. After that, the support terminal 2 generates an integrated customized model and uses it for dialogue. As a result, the support terminal 2 can communicate smoothly with multiple workers included in the collaborative group.

[0094] Furthermore, when the model integration unit 32 is in reader terminal mode, it may store other customized models without integrating them. In this case, the dialogue unit 17 may switch to and use other customized models stored in other support terminals 2 corresponding to the input timing for each speaker. Even in this case, the support terminal 2, which is the reader terminal, can perform voice dialogue with higher accuracy.

[0095] Next, an example of the hardware constituting the support terminal 2 will be described using Figure 6. Figure 6 is a hardware configuration diagram of the support terminal in Embodiment 1 or 2.

[0096] Each function of the support terminal 2 can be realized by a processing circuit. For example, the processing circuit includes at least one processor 100a and at least one memory 100b. For example, the processing circuit includes at least one dedicated hardware 200.

[0097] When the processing circuit comprises at least one processor 100a and at least one memory 100b, each function of the support terminal 2 is realized by software, firmware, or a combination of software and firmware. At least one of the software and firmware is written as a program. At least one of the software and firmware is stored in at least one memory 100b. At least one processor 100a realizes each function of the support terminal 2 by reading and executing the program stored in at least one memory 100b. At least one processor 100a is also called a central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, or DSP. For example, at least one memory 100b is a non-volatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, EEPROM, magnetic disk, flexible disk, optical disk, compact disk, minidisc, DVD, etc.

[0098] If the processing circuit includes at least one dedicated hardware 200, the processing circuit may be implemented as, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof. For example, each function of the support terminal 2 may be implemented by a processing circuit. For example, each function of the support terminal 2 may be implemented together by a processing circuit.

[0099] For each function of the support terminal 2, some may be implemented by dedicated hardware 200, and others by software or firmware. For example, the functions of the dialogue unit 17 may be implemented by a processing circuit as dedicated hardware 200, while functions other than those of the dialogue unit 17 may be implemented by at least one processor 100a reading and executing a program stored in at least one memory 100b.

[0100] In this way, the processing circuit realizes each function of the support terminal 2 using hardware 200, software, firmware, or a combination thereof.

[0101] As described above, the support terminal related to this disclosure can be used in workplaces where multiple workers perform maintenance work, inspection work, construction work, manufacturing work, etc.

[0102] 1 Support system, 2 Support terminal, 2a First support terminal, 2b Second support terminal, 10 Input unit, 11 Display unit, 12 Audio output unit, 13 Information exchange unit, 14 Support unit, 15 Storage unit, 16 History unit, 17 Dialogue unit, 18 Distance calculation unit, 19 Calculation unit, 20 Cooperation unit, 30 Model storage unit, 31 Model generation unit, 32 Model integration unit, 100a Processor, 100b Memory, 200 Hardware

Claims

1. A support terminal that is held by a worker, capable of voice interaction, and capable of exchanging information with another support terminal that is held by a worker other than the said worker, comprising: a dialogue unit that, as voice interaction, notifies support voices included in work information at the output timing and recognizes input voices related to work at the input timing; a distance calculation unit that calculates the distance to the other support terminal; a calculation unit that calculates a priority score; an information exchange unit that exchanges information including the priority score with the other support terminal; and a coordination unit that, when the other support terminal is within a coordination distance, shares the priority score with the other support terminal and controls the output timing at which support voices are notified on the other support terminal when the priority score is higher than that of the other support terminal.

2. The support terminal according to claim 1, wherein the calculation unit calculates the priority score such that the score is higher according to the role of the worker in the current task.

3. The support terminal according to claim 1 or claim 2, further comprising a storage unit for storing the work information, wherein the calculation unit calculates the priority score such that the score is higher when the work information for the current work is stored in the storage unit.

4. The support terminal according to any one of claims 1 to 3, wherein the calculation unit calculates the priority score such that the score increases as the worker's job rank increases or as the worker's years of experience increase.

5. The support terminal according to any one of claims 1 to 4, further comprising an input unit for detecting sound, wherein the calculation unit calculates the priority score based on the sound pressure of the sound first detected by the input unit after the distance to the other support terminal becomes within the cooperation distance.

6. The support terminal according to claim 5, wherein the calculation unit calculates the priority score such that the score increases as the sound pressure of the voice first detected by the input unit increases after the distance to the other support terminal becomes within the cooperation distance.

7. The support terminal according to claim 5 or 6, wherein the calculation unit calculates the priority score such that the score is lowest when the sound pressure of the voice first detected by the input unit is lower than a predetermined sound pressure threshold after the distance to the other support terminal has become within the coordination distance.

8. The support terminal according to any one of claims 1 to 7, wherein the calculation unit calculates the priority score such that the score is as low as possible when the operation score, which increases as the better the operation state of the device is, is smaller than a predetermined abnormal threshold.

9. The support terminal according to any one of claims 1 to 8, wherein the information exchange unit transmits a positioning sound as a sound wave for measuring distance, and the distance calculation unit calculates the distance to the other support terminal based on the positioning sound from the other support terminal.

10. The support terminal according to claim 9, wherein the information exchange unit transmits sound waves with frequencies that are not within the audible range that humans can hear as the positioning sound.

11. The support terminal according to any one of claims 1 to 10, wherein the work information is information relating to work performed in the elevator shaft, and the distance calculation unit calculates the distance to the other support terminal based on the height position.

12. The support terminal according to any one of claims 1 to 11, wherein the information exchange unit exchanges information with the other support terminal by transmitting and receiving sound waves.

13. The support terminal according to claim 12, wherein the information exchange unit exchanges information with the other support terminal by transmitting and receiving sound waves at frequencies that are not within the audible range that humans can hear.

14. A support terminal according to any one of claims 1 to 13, further comprising: a history unit that stores history information including the history of the support voice output based on the work information and the history of the recognized input voice, wherein the information exchange unit exchanges other history information stored in the other support terminal to synchronize the history information stored in the history unit with the other history information.

15. The support terminal according to any one of claims 1 to 14, further comprising: a model generation unit that generates a customized model including a dialogue engine that performs voice dialogue corresponding to the characteristics of the worker's dialogue, based on voice dialogue with the worker; and a model integration unit that generates an integrated customized model by integrating another customized model corresponding to the other support terminal obtained from the other support terminal and the customized model generated by the model generation unit, wherein the dialogue unit performs voice dialogue using the integrated customized model when the priority score is higher than that of the other support terminal.

16. The support terminal according to any one of claims 1 to 15, wherein the coordination unit controls the other support terminal not to recognize input voice when the priority score is higher than that of the other support terminal, and causes the dialogue unit to recognize voice at the timing when the other worker emits input voice.

17. The support terminal according to any one of claims 1 to 15, wherein the coordination unit controls the input timing at which the other support terminal recognizes input voice related to the work when the priority score is higher than that of the other support terminal.

Images