Information processing method, information processing device, and information processing system
The information processing method dynamically adjusts communication modalities based on work status to ensure effective and non-disruptive information delivery, addressing the challenge of presenting information to workers in various work situations without interfering with their tasks.
Patent Information
- Application Number
- PCT/JP2024/007876
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-17
- Filing Date
- 2024-03-01
- Publication Date
- 2024-11-21
AI Technical Summary
Workers at a work site often face difficulties in receiving information due to their work situation, which can interfere with their tasks, especially during dangerous operations, manual work, or conversations, as traditional information presentation methods may be distracting or impractical.
An information processing method that determines the most appropriate communication modal for a worker based on their work status, adjusting presentation strength and modality (visual, auditory, tactile) to minimize interference, such as prioritizing auditory for manual tasks and visual/tactile in noisy environments.
Enables effective and non-disruptive information presentation to workers by adapting communication modalities to their work situation, ensuring information is conveyed without hindering their tasks, thereby improving work efficiency and safety.
Smart Images

Figure JP2024007876_21112024_PF_FP_ABST
Abstract
Description
Information processing method, information processing device, and information processing system
[0001] The present disclosure relates to an information processing method and the like performed by an information processing device.
[0002] Patent Document 1 proposes a system that is useful for analyzing the direction of safety management measures and facilitating communication and dissemination. In this system, data on hazard prediction activities is accumulated and the data is read and written.
[0003] Japanese Patent Application Laid-Open No. 2021-101376
[0004] However, even if information is presented to workers at the work site, it may be difficult for the workers to receive the information, or the presentation of the information may interfere with the workers' work.
[0005] Therefore, the present disclosure provides an information processing method and the like that can appropriately determine a communication modal for a worker.
[0006] An information processing method according to one aspect of the present disclosure is an information processing method performed by an information processing device, and includes the steps of acquiring candidate information indicating a plurality of communication modal candidates, acquiring work status information indicating a work status of a worker, and determining a communication modal for the worker from the plurality of communication modal candidates based on the work status.
[0007] These comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.
[0008] The information processing method according to one aspect of the present disclosure makes it possible to appropriately determine the communication modal for a worker.
[0009] FIG. 1 is a conceptual diagram showing an example of construction and visualization of a dynamic map of a work site in an embodiment. FIG. 2 is a conceptual diagram showing an example of analysis of a work situation in an embodiment. FIG. 3 is a work process diagram showing an example of a work process in an embodiment. FIG. 4 is a conceptual diagram showing an example of zero-distance communication in an embodiment. FIG. 5 is a conceptual diagram showing an example of the relationship between a work situation and information presentation in an embodiment. FIG. 6 is a conceptual diagram showing example attributes of a communication modal in an embodiment. FIG. 7 is a relationship diagram showing a specific example of the relationship between a work situation and a communication modal in an embodiment. FIG. 8 is a conceptual diagram showing an example configuration of an information processing system in an embodiment. FIG. 9 is a conceptual diagram showing an example configuration of a wearable device in an embodiment. FIG. 10 is a block diagram showing an example configuration of an information processing device in an embodiment. FIG. 11 is a block diagram showing an example implementation of an information processing device in an embodiment. FIG. 12 is a flowchart showing an example operation of an information processing device in an embodiment.
[0010] For example, a work manager may remotely provide guidance to a worker at a work site, and information for the guidance is presented to the worker at the work site.
[0011] However, even if information is presented to a worker at a work site, depending on the worker's work situation, the worker may have difficulty receiving the information or the information may interfere with the worker's work. For example, if a worker is performing dangerous work or working with their hands, the information presented may interfere with the worker's work if it significantly affects the worker's senses. Also, for example, if a worker is talking, it may be difficult for the worker to receive information presented by sound.
[0012] Therefore, the information processing method of Example 1 according to one aspect of the present disclosure may be an information processing method performed by an information processing device, and may include the steps of acquiring candidate information indicating a plurality of communication modal candidates, acquiring work status information indicating the work status of a worker, and determining a communication modal for the worker from the plurality of communication modal candidates based on the work status.
[0013] This makes it possible to determine the communication modal for the worker based on the worker's work status. Therefore, it is possible to appropriately determine the communication modal for the worker. Therefore, it is possible to appropriately present information to the worker.
[0014] Furthermore, the information processing method of Example 2 according to one aspect of the present disclosure may be the information processing method of Example 1, wherein the presentation intensity of the communication modal determined when the work status information indicates that the worker is performing dangerous work as the work status is lower than the presentation intensity of the communication modal determined when the work status information indicates that the worker is not performing dangerous work as the work status.
[0015] This makes it possible to reduce the impact that the information presentation has on a worker performing dangerous work, and therefore to prevent the information presentation from interfering with the work.
[0016] Furthermore, the information processing method of Example 3 according to one aspect of the present disclosure may be the information processing method of Example 1 or Example 2, wherein the presentation intensity of the communication modal determined when the work status information indicates that the worker is working with his or her hands as the work status is lower than the presentation intensity of the communication modal determined when the work status information indicates that the worker is not working with his or her hands as the work status.
[0017] This makes it possible to reduce the impact of the information presentation on a worker who is working with their hands, and therefore to prevent the information presentation from interfering with the work.
[0018] Furthermore, the information processing method of Example 4 according to one aspect of the present disclosure may be any of the information processing methods of Examples 1 to 3, wherein in the step of determining the communication modality, if the work status information indicates that the work status is that the worker is working with his or her hands, the communication modality is determined by prioritizing a communication modal candidate that uses hearing from among the plurality of communication modal candidates.
[0019] This makes it possible to prioritize the auditory communication modality for workers who are working with their hands. This makes it possible to prevent information presentation from interfering with manual work. This also makes it possible to appropriately present information to workers who are working with their hands.
[0020] Furthermore, the information processing method of Example 5 according to one aspect of the present disclosure may be any of the information processing methods of Examples 1 to 4, wherein in the step of determining the communication modality, if the work status information indicates that the worker is in conversation as the work status, the communication modality is determined by prioritizing at least one of a communication modality candidate that uses vision and a communication modality candidate that uses tactile sense from the plurality of communication modality candidates.
[0021] This makes it possible to prioritize the visual or tactile communication modality for a worker who is engaged in a conversation. This makes it possible to prevent information presentation from interfering with the conversation. This also makes it possible to appropriately present information to a worker who is engaged in a conversation.
[0022] Furthermore, an information processing method of Example 6 according to one aspect of the present disclosure may be any of the information processing methods of Examples 1 to 5, wherein in the step of determining the communication modality, if the work situation information indicates that the noise level in the worker's workspace as the work situation is higher than a first threshold, the communication modality is determined by prioritizing at least one of a communication modality candidate that uses vision and a communication modality candidate that uses tactile sense from the plurality of communication modality candidates.
[0023] This makes it possible to prioritize the visual or tactile communication modality for workers in a workspace with a high noise level, thereby making it possible to appropriately present information to workers in a workspace with a high noise level.
[0024] Furthermore, the information processing method of Example 7 according to one aspect of the present disclosure may be any of the information processing methods of Examples 1 to 6, wherein in the step of determining the communication modality, if the work situation information indicates that the noise level in the worker's workspace as the work situation is lower than a second threshold, the communication modality is determined by prioritizing a communication modal candidate that uses hearing from the multiple communication modal candidates.
[0025] This makes it possible to prioritize the auditory communication modality for workers in low-noise workspaces. Furthermore, auditory communication modalities are expected to be relatively less likely to interfere with work. Therefore, it becomes possible to appropriately present information to workers in low-noise workspaces.
[0026] Furthermore, the information processing method of Example 8 according to one aspect of the present disclosure may be any of the information processing methods of Examples 1 to 7, further including a step of acquiring sensing information indicating sensing results of the worker or the worker's workspace, wherein the step of acquiring the work status information acquires the work status information based on the sensing information.
[0027] This makes it possible to appropriately determine the communication modality for the worker based on the work situation corresponding to the sensing results.
[0028] Furthermore, the information processing method of Example 9 according to one aspect of the present disclosure may be any of the information processing methods of Examples 1 to 8, further including a step of acquiring work process information indicating the work process of the worker, wherein the step of acquiring the work status information acquires the work status information based on the work process information.
[0029] This makes it possible to appropriately determine the communication modality for the worker based on the work situation corresponding to the work process.
[0030] Furthermore, the program of Example 10 according to one aspect of the present disclosure may be a program for causing the information processing device to perform any one of the information processing methods of Examples 1 to 9.
[0031] This makes it possible to make an information processing device perform the above information processing method in accordance with a program.
[0032] Furthermore, an information processing device according to Example 11 of one aspect of the present disclosure may be an information processing device including a candidate acquirer that acquires candidate information indicating a plurality of communication modal candidates, a situation acquirer that acquires work situation information indicating the work situation of a worker, and a determiner that determines a communication modal for the worker from the plurality of communication modal candidates based on the work situation.
[0033] This makes it possible to determine the communication modal for the worker based on the worker's work status. Therefore, it is possible to appropriately determine the communication modal for the worker. Therefore, it is possible to appropriately present information to the worker.
[0034] Furthermore, an information processing system according to Example 12 of one aspect of the present disclosure may be an information processing system that includes the information processing device according to Example 11 and a wearable device worn by the worker, and the wearable device presents information to the worker via the communication modal.
[0035] This makes it possible to appropriately present information to workers via the wearable device.
[0036] Furthermore, these comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.
[0037] Hereinafter, embodiments will be described with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, the arrangement and connection of the components, steps, the order of steps, and the like shown in the following embodiments are merely examples and are not intended to limit the scope of the claims.
[0038] Here, a construction site is mainly assumed as the work site. However, the work site is not limited to a construction site and may be a factory, office, school, facility, home, etc. Furthermore, various tasks in these various environments are assumed as work.
[0039] FIG. 1 is a conceptual diagram showing an example of construction and visualization of a dynamic map of a work site in this embodiment. For example, various information obtained from sensing information is superimposed on a blueprint to construct a dynamic map. Specifically, work site photos and 3D measurement results may be acquired and superimposed on the blueprint. Furthermore, worker messages and material recognition results may be acquired and superimposed on the blueprint. Furthermore, work status information and biometric information may be acquired and superimposed on the blueprint.
[0040] Such a dynamic map can be provided to a worker or a manager as actuation information and used to manage the work site and work progress. Also, such a dynamic map may be used as a basis for information communication.
[0041] For example, the work status of a worker may be estimated using a machine learning model from a camera image, which is a sensing result. Alternatively, the work status of a worker may be estimated based on sounds obtained from a microphone, biometric information obtained from a biometric sensor, and human movement information obtained from a human presence sensor. Alternatively, the work status may be identified from work processes, such as a work plan, obtained as input information.
[0042] FIG. 2 is a conceptual diagram showing an example of work situation analysis in this embodiment. For example, the work situation is analyzed by bone detection from a camera image, which is a sensing result. Specifically, the skeletal state of the worker is estimated from the camera image. Then, the worker's posture is estimated from the skeletal state of the worker. Then, the work situation, such as the worker's movements or actions, is estimated from the worker's posture. Note that FIG. 2 shows an example of work situation analysis, and work situation analysis may be performed using other methods.
[0043] FIG. 3 is a work process diagram showing an example of a work process in this embodiment. In FIG. 3, the work process includes a work date and time, a work space, and a work content. The work process may be determined for each worker or for each work space. The work status of the worker may be estimated based on such a work process. Furthermore, the work status of the worker may be estimated based on a combination of the work process and sensing information.
[0044] 4 is a conceptual diagram showing an example of zero-distance communication in this embodiment. For example, AR (Augmented Reality) is introduced into information communication between a worker at a work site and a manager at a remote location.
[0045] Specifically, information input into the wearable device of a worker at the work site is presented to a remote supervisor via the wearable device of the remote supervisor, and information input into the wearable device of the remote supervisor is presented to the worker at the work site via the wearable device of the worker at the work site.
[0046] This allows information communication between the workers at the work site and the remote supervisor to take place as if the remote supervisor were actually at the work site. This type of communication, which does not feel like distance, is also called zero-distance communication. For example, this allows the remote supervisor to present information for work to the workers at the work site.
[0047] However, depending on the worker's work situation, it may be difficult for the worker to receive the information, or the presentation of the information may interfere with the worker's work.
[0048] 5 is a conceptual diagram showing an example of the relationship between the work status and the presentation of information in the embodiment. For example, there is no problem in presenting information to a waiting worker.
[0049] However, presenting information in a manner that has a large impact on a worker performing dangerous work, such as working at heights, can interfere with the work. Also, presenting information in a manner that has a large impact on a worker performing manual work, such as transporting a heavy object, can interfere with the work. In particular, in this case, presenting information that is perceived visually or tactilely can interfere with the work. Also, presenting information that is perceived auditorily to a worker who is having a conversation, such as a worker in a meeting, can interfere with the conversation.
[0050] Therefore, the information processing system in this embodiment determines a communication modality for presenting information to a worker based on the worker's work status. Note that the communication modality corresponds to the manner, format, style, means, method, etc. of communication, and may be replaced with these expressions.
[0051] 6 is a conceptual diagram showing an example of attributes of a communication modal in this embodiment. As shown in FIG. 6, a communication modal may have attributes such as a presentation type and a presentation intensity.
[0052] For example, the presentation types include visual, auditory, and tactile. That is, a communication modality using visual, auditory, or tactile sensations may be applied to present information.
[0053] In a visual communication modal, information that is perceived by the sight, such as an image, is presented. Note that the image may be text or may include text. In an auditory communication modal, information that is perceived by the sense of hearing, such as sound, is presented. In a tactile communication modal, information that is perceived by the sense of touch, such as vibration, is presented.
[0054] The presentation intensity may be high, medium, or low. The higher the presentation intensity, the greater the impact of the information presentation on the worker's senses. The lower the presentation intensity, the less the impact of the information presentation on the worker's senses. For example, the higher the presentation intensity, the more frequently the information may be presented.
[0055] Furthermore, in a visual communication modality, the higher the presentation intensity, the larger the image may be presented. Alternatively, the higher the presentation intensity, the higher the color intensity (saturation) of the image presented. For example, even with the same hue and brightness, a higher saturation makes the image clearer, and conversely, a lower saturation makes the image less clear. Alternatively, when the presentation intensity is high, the image may be presented closer to the center of the visual field.
[0056] In a communication modality using the auditory sense, the higher the presentation intensity, the louder the sound that is presented. In a communication modality using the tactile sense, the higher the presentation intensity, the stronger the vibration that is presented (applied).
[0057] FIG. 7 is a relationship diagram showing a specific example of the relationship between the work situation and the communication modal in this embodiment.
[0058] For example, when performing dangerous work, a communication modality with low presentation intensity may be applied to present information. When performing manual work, a communication modality with low presentation intensity and using the auditory sense may be applied to present information. When performing conversation, a communication modality using the visual or tactile sense may be applied to present information.
[0059] Furthermore, when the noise level in the workspace is high, a visual or tactile communication modality may be applied to present information, and when the noise level in the workspace is low, an auditory communication modality may be applied to present information.
[0060] For example, noise cancellation can be used to reduce noise levels at construction sites. However, noise cancellation can also suppress work noise, potentially hindering safe and efficient work. Therefore, if the noise level in a work space is high, it is useful to present information using visual or tactile communication modalities without noise cancellation.
[0061] Fig. 8 is a conceptual diagram showing an example of the configuration of an information processing system according to this embodiment. The information processing system 100 shown in Fig. 8 includes an information processing device 110, a sensor device 120, wearable devices 130 and 140, a mobile device 150, and an information processing terminal 160. The information processing system 100 may include only some of these components, or may include additional components. In this example, the information processing device 110 is capable of communicating with the other components. Furthermore, communication may be possible between the other components.
[0062] The information processing system 100 may also include multiple components of the same type. For example, the information processing system 100 may include multiple wearable devices 130 and multiple mobile devices 150 for multiple workers.
[0063] The information processing device 110 is a device for processing information. The information processing device 110 may be a device expressed as a computer, a server, a communication support device, or the like. For example, the information processing device 110 acquires candidate information indicating a plurality of communication modal candidates and work status information indicating the work status of a worker. Then, the information processing device 110 determines a communication modality for the worker from the plurality of communication modal candidates based on the work status of the worker.
[0064] For example, the multiple communication modal candidates correspond to the multiple presentation types and multiple presentation intensities shown in Fig. 6. The multiple communication modal candidates may be determined based on the characteristics of the wearable device 130 of each worker, or may be determined in advance regardless of the characteristics of the wearable device 130 of each worker.
[0065] Furthermore, the information processing device 110 may allow information to be presented to the worker only in the determined communication modality. The information processing device 110 may control the wearable device 140 and the information processing terminal 160 of the manager, and the wearable device 130 of the worker, so that information is presented to the worker in the determined communication modality.
[0066] For example, the information processing device 110 may relay only information corresponding to the determined communication modality from the manager's wearable device 140 or the information processing terminal 160 to the worker's wearable device 130. Furthermore, the information processing device 110 may notify the manager via the manager's wearable device 140 or the information processing terminal 160 to input only information corresponding to the determined communication modality.
[0067] Here, the information corresponding to the visual communication modality may be an image. The image may be text or may include text. The information corresponding to the auditory communication modality may be sound. The information corresponding to the tactile communication modality may be a vibration pattern.
[0068] Furthermore, the information processing device 110 may cause the worker's wearable device 130 to present information in the determined communication modality. Specifically, the information processing device 110 may control the worker's wearable device 130 so that information is not presented in any communication modality other than the determined communication modality.
[0069] The information processing device 110 may be included in the administrator's wearable device 140 or may be integrated with the administrator's information processing terminal 160 .
[0070] The sensor device 120 is a device for performing sensing. The sensor device 120 may be a camera, a microphone, a biosensor, a human presence sensor, or the like. For example, the sensor device 120 senses a worker or the worker's workspace. The sensor device 120 then outputs sensing information indicating the sensing results. The information processing device 110 may acquire the sensing information from the sensor device 120 and acquire work status information based on the sensing information.
[0071] The sensor device 120 may be installed in the workspace of the worker, carried by the worker, or included in the wearable device 130 of the worker.
[0072] The wearable device 130 is a device worn by a worker. For example, the wearable device 130 receives information from the manager's wearable device 140 or information processing terminal 160. The wearable device 130 may receive information via the information processing device 110. Then, the wearable device 130 presents the information to the worker in a communication modality determined by the information processing device 110.
[0073] The mobile device 150 is a device for inputting information. The mobile device 150 may be a device expressed as a mobile terminal, a smartphone, or the like. For example, a worker may input work process information or work status information of the worker into the mobile device 150. The mobile device 150 may then transmit the work process information or work status information to the information processing device 110.
[0074] The wearable device 140 is a device worn by the manager. For example, the wearable device 140 acquires information from the manager or from the manager's surroundings. Here, the wearable device 140 acquires information corresponding to the communication modalities determined by the information processing device 110. The wearable device 140 then transmits the information to the worker's wearable device 130. The wearable device 140 may transmit the information to the worker's wearable device 130 via the information processing device 110.
[0075] The information processing terminal 160 is a device for inputting information. The information processing terminal 160 may be a device expressed as a computer, a personal computer, or the like. For example, the administrator inputs information corresponding to the communication modal determined by the information processing device 110 into the information processing terminal 160. The information processing terminal 160 then transmits the information to the wearable device 130 of the worker. The information processing terminal 160 may transmit the information to the wearable device 130 of the worker via the information processing device 110.
[0076] Furthermore, for example, the manager may input work process information indicating a work process into the information processing terminal 160. Then, the information processing terminal 160 may transmit the work process information to the information processing device 110. The information processing device 110 may acquire work status information based on the work process information.
[0077] Fig. 9 is a conceptual diagram showing an example of the configuration of the wearable device 130 shown in Fig. 8. The wearable device 130 includes smart glasses 131, a sound output device 132, a camera 133, a sound collector 134, and a smart watch 135.
[0078] The smart glasses 131 are a device that can be worn like glasses, and present an image to a worker wearing the smart glasses 131 by displaying the image on the glasses. For example, a worker wearing the smart glasses 131 can visually recognize an image superimposed on the real world. In other words, the smart glasses 131 visually recognize the presentation target information as an image.
[0079] The sound output device 132 is a device that presents sound. Specifically, the sound output device 132 is a wearable device like earphones or headphones, and presents sound to the worker wearing the sound output device 132. In other words, the sound output device 132 allows the information to be presented to be audibly recognized as sound.
[0080] The camera 133 is a device that acquires images of the real world. For example, the images acquired by the camera 133 may be transmitted to the information processing device 110. The information processing device 110 may then recognize the work status of the worker based on the images acquired by the camera 133. The images acquired by the camera 133 may also be transmitted to the wearable device 140 of the manager. The wearable device 140 of the manager may then present the images acquired by the camera 133 to the manager.
[0081] The sound collector 134 is a device that acquires sound. For example, the sound acquired by the sound collector 134 may be transmitted to the information processing device 110. The information processing device 110 may then recognize the work status of the worker based on the sound acquired by the sound collector 134. The sound acquired by the sound collector 134 may also be transmitted to the wearable device 140 of the manager. The wearable device 140 of the manager may then present the sound acquired by the sound collector 134 to the manager.
[0082] The smartwatch 135 is a device that presents vibrations. Specifically, the smartwatch 135 is a device that can be worn like a wristwatch, and presents vibrations to the worker wearing the smartwatch 135. In other words, the smartwatch 135 allows the worker to tactilely recognize the presentation target information as vibrations.
[0083] Furthermore, the smartwatch 135 may present the presentation target information as an image or as sound to the worker wearing the smartwatch 135. The smartwatch 135 may also acquire sound. In other words, the smartwatch 135 may play the same role as the smart glasses 131, the sound emitter 132, and the sound collector 134.
[0084] Note that the wearable device 130 does not need to include all of the components shown in Fig. 9. For example, the wearable device 130 may be smart glasses 131, a sound output device 132, or a smart watch 135. The wearable device 130 may also include additional components.
[0085] Furthermore, the administrator's wearable device 140 may have the same components as the worker's wearable device 130, or may have different components from the worker's wearable device 130.
[0086] Fig. 10 is a block diagram showing an example of the configuration of the information processing device 110 shown in Fig. 8. In Fig. 10, the information processing device 110 includes a candidate acquirer 111, a situation acquirer 112, and a determiner 113.
[0087] The candidate acquirer 111 is a processing circuit that acquires candidate information indicating multiple communication modal candidates. The candidate acquirer 111 may acquire candidate information individually for each worker, or may acquire candidate information common to multiple tasks.
[0088] For example, the candidate acquirer 111 may acquire predetermined candidate information from a storage device or the like of the information processing device 110. Alternatively, the candidate acquirer 111 may acquire characteristic information indicating characteristics of the wearable device 130 of the worker from the wearable device 130. Then, the candidate acquirer 111 may acquire candidate information based on the characteristic information.
[0089] The situation acquirer 112 is a processing circuit that acquires work situation information indicating the work situation of the worker. For example, the situation acquirer 112 may acquire sensing information from the sensor device 120 and acquire the work situation information based on the sensing information. In this case, the situation acquirer 112 may acquire the work situation information from the sensing information based on the bone detection shown in FIG. 2.
[0090] Furthermore, the situation acquirer 112 may identify, from the sensing information, whether or not the worker is performing dangerous work, or may identify, from the sensing information, whether or not the worker is performing manual work. A machine learning model or pattern matching may be used for these identifications. The situation acquirer 112 may acquire, as the work situation, work situation information indicating whether or not the worker is performing dangerous work, or may acquire, as the work situation, work situation information indicating whether or not the worker is performing manual work.
[0091] Similarly, the situation acquirer 112 may identify from the sensing information whether the worker is talking or not, and acquire work situation information indicating whether the worker is talking or not, as the work situation. The situation acquirer 112 may identify from the sensing information the noise level in the worker's workspace, and acquire work situation information indicating the noise level in the worker's workspace, as the work situation.
[0092] Alternatively, the situation acquirer 112 may acquire work process information indicating the work process of the worker from the manager's information processing terminal 160, and acquire work status information based on the work process information. Specifically, the situation acquirer 112 may estimate the work status based on the work location and work content indicated by the work process information. Then, the situation acquirer 112 may acquire work status information indicating the estimated work status.
[0093] The determiner 113 is a processing circuit that determines a communication modality for the worker from a plurality of communication modal candidate options based on the worker's work situation. Specifically, the determiner 113 determines the communication modality by selecting a communication modality from the plurality of communication modal candidate options. The determiner 113 may combine two or more of the plurality of communication modal candidate options and determine the combination as the communication modality.
[0094] The determiner 113 may also determine the worker's communication acceptance level based on the worker's work status. Then, the determiner 113 may determine the communication modal for the worker based on the worker's communication acceptance level.
[0095] For example, the determiner 113 may select one of a candidate communication modality using vision, a candidate communication modality using hearing, and a candidate communication modality using touch, and may determine the communication modality by adjusting the presentation intensity of the selected candidate communication modality based on the worker's acceptance of communication.
[0096] With the above configuration, the information processing device 110 can determine the communication modal for the worker based on the work situation of the worker. Therefore, it is possible to appropriately determine the communication modal for the worker. Therefore, it is possible to appropriately present information to the worker.
[0097] Fig. 11 is a block diagram showing an implementation example of the information processing device 110 shown in Fig. 10. In Fig. 11, the information processing device 110 includes a processor 116 and a memory 117. Multiple components of the information processing device 110 shown in Fig. 10 may be implemented by the processor 116 and the memory 117 shown in Fig. 11.
[0098] The processor 116 is a dedicated or general-purpose processor for performing information processing according to the present disclosure, and is a processor that can access the memory 117. The processor 116 may be a processing circuit. The processor 116 may also be a processor such as a CPU. The processor 116 may also be a collection of multiple processors.
[0099] The candidate obtainer 111, the situation obtainer 112, and the determiner 113 shown in FIG.
[0100] The memory 117 is a dedicated or general-purpose memory that stores information for the processor 116 to perform the information processing of the present disclosure. The memory 117 may be a storage circuit. The memory 117 may be connected to the processor 116 or may be included in the processor 116. The memory 117 may be a collection of multiple memories. The memory 117 may also be a magnetic disk, an optical disk, or the like, and may be expressed as a storage or a recording medium, or the like. The memory 117 may also be a non-volatile memory or a volatile memory.
[0101] For example, the memory 117 may store candidate information, work status information, sensing information, work process information, or presentation target information. The memory 117 may also store a program for the processor 116 to perform the information processing of the present disclosure.
[0102] Fig. 12 is a flowchart showing an example of the operation of the information processing device 110 shown in Fig. 10. First, the candidate acquirer 111 acquires candidate information indicating a plurality of communication modal candidates (S101). Furthermore, the situation acquirer 112 acquires work situation information indicating the work situation of the worker (S102). Then, the determiner 113 determines a communication modal for the worker from the plurality of communication modal candidates based on the work situation (S103).
[0103] This makes it possible to determine the communication modal for the worker based on the worker's work status. Therefore, it is possible to appropriately determine the communication modal for the worker. Therefore, it is possible to appropriately present information to the worker.
[0104] For example, the presentation intensity of the communication modal determined when the work status information indicates that the worker is performing dangerous work may be lower than the presentation intensity of the communication modal determined when the work status information indicates that the worker is not performing dangerous work. This makes it possible to reduce the impact of information presentation on the worker performing dangerous work. Therefore, it is possible to prevent information presentation from interfering with the work.
[0105] Furthermore, for example, the presentation intensity of the communication modal determined when the work status information indicates that the worker is working with his or her hands may be lower than the presentation intensity of the communication modal determined when the work status information indicates that the worker is not working with his or her hands. This makes it possible to reduce the impact of information presentation on a worker working with his or her hands. Therefore, it is possible to prevent information presentation from interfering with the work.
[0106] Furthermore, for example, when the work status information indicates that the worker is working with his / her hands, the determiner 113 may determine the communication modality by prioritizing a candidate communication modality using hearing from among multiple candidate communication modalities. This makes it possible to preferentially determine a communication modality using hearing for a worker working with his / her hands. Therefore, it is possible to prevent information presentation from interfering with the manual work. Furthermore, it is possible to appropriately present information to a worker working with his / her hands.
[0107] In addition, for example, the work status information may indicate that the workers are engaged in a conversation. In this case, the determiner 113 may determine the communication modality by prioritizing at least one of a visual communication modality candidate and a tactile communication modality candidate from among the multiple communication modality candidates.
[0108] This makes it possible to prioritize the visual or tactile communication modality for a worker who is engaged in a conversation. This makes it possible to prevent information presentation from interfering with the conversation. This also makes it possible to appropriately present information to a worker who is engaged in a conversation.
[0109] Furthermore, for example, the work status information may indicate that the noise level in the worker's workspace is higher than the first threshold. In this case, the determiner 113 may determine the communication modality by prioritizing at least one of a visual communication modality candidate and a tactile communication modality candidate from among the multiple communication modality candidates.
[0110] This makes it possible to prioritize the visual or tactile communication modality for workers in a workspace with a high noise level, thereby making it possible to appropriately present information to workers in a workspace with a high noise level.
[0111] Furthermore, for example, the work status information may indicate that the noise level in the worker's workspace is lower than the second threshold. In this case, the determiner 113 may determine the communication modality by prioritizing a communication modality candidate that uses hearing from among the multiple communication modality candidates.
[0112] This makes it possible to prioritize the auditory communication modality for workers in low-noise workspaces. Furthermore, auditory communication modalities are expected to be relatively less likely to interfere with work. Therefore, it becomes possible to appropriately present information to workers in low-noise workspaces.
[0113] The second threshold may or may not be equal to the first threshold. For example, the second threshold may be smaller than the first threshold. When the noise level in the worker's workspace is between the first and second thresholds, the communication modality may be determined without prioritizing any of the visual, auditory, and tactile senses. The first and second thresholds may also be determined based on the volume or range of a person's voice.
[0114] Furthermore, for example, the situation acquirer 112 may acquire sensing information indicating the sensing results of the worker or the worker's workspace. Then, the situation acquirer 112 may acquire work situation information based on the sensing information. This makes it possible to appropriately determine the communication modal for the worker based on the work situation corresponding to the sensing results.
[0115] Furthermore, for example, the situation acquirer 112 may acquire work process information indicating the work process of the worker. Then, the situation acquirer 112 may acquire work status information based on the work process information. This makes it possible to appropriately determine the communication modal for the worker based on the work status corresponding to the work process.
[0116] Although the information processing system and the information processing device have been described above according to the embodiments, the information processing system and the information processing device are not limited to the embodiments. Modifications conceivable by those skilled in the art may be made to the embodiments, and multiple components in the embodiments may be combined in any manner.
[0117] For example, a process performed by a specific component in an embodiment may be performed by another component instead of the specific component. Furthermore, the order of multiple processes may be changed, or multiple processes may be performed in parallel. Furthermore, ordinal numbers such as "first" and "second" used in the description may be changed, removed, or newly assigned as appropriate. These ordinal numbers do not necessarily correspond to a meaningful order, and may be used to identify elements.
[0118] Furthermore, although the above description mainly describes an information processing method for appropriately presenting information to workers at a construction site, the scope of application of the information processing system and information processing device disclosed herein is not limited to construction sites. The information processing system and information processing device disclosed herein can be applied to various work sites.
[0119] Furthermore, an information processing method including steps performed by each component of the information processing system and the information processing device may be executed by any system or device. That is, this information processing method may be executed by the above-mentioned information processing system or information processing device, or may be executed by another system or device.
[0120] For example, a part or all of the information processing method may be executed by a computer including a processor, a memory, an input / output circuit, etc. In this case, the information processing method may be executed by the computer executing a program for causing the computer to execute the information processing method.
[0121] For example, the above program causes a computer to execute an information processing method including the steps of acquiring candidate information indicating a plurality of communication modal candidates, acquiring work status information indicating the work status of a worker, and determining a communication modal for the worker from the plurality of communication modal candidates based on the work status.
[0122] The above program may also be recorded on a non-transitory computer-readable recording medium such as a CD-ROM.
[0123] Furthermore, each component of the information processing system and the information processing device may be configured with dedicated hardware, general-purpose hardware that executes the above-mentioned programs, or a combination of these. The general-purpose hardware may be configured with a memory in which the programs are recorded and a general-purpose processor that reads and executes the programs from the memory. Here, the memory may be a semiconductor memory or a hard disk, and the general-purpose processor may be a CPU.
[0124] Furthermore, the dedicated hardware may be configured with a memory and a dedicated processor, etc. For example, the dedicated processor may refer to the memory and execute the information processing method described above.
[0125] Furthermore, each component of the information processing system and the information processing device may be an electric circuit. These electric circuits may form a single electric circuit as a whole, or may be separate electric circuits. Furthermore, these electric circuits may correspond to dedicated hardware, or may correspond to general-purpose hardware that executes the above-mentioned programs, etc.
[0126] The present disclosure is applicable to an information processing method for determining a communication modality to be used for presenting information to workers, and is applicable to systems for presenting information to workers at construction sites, etc.
[0127] 100 Information processing system 110 Information processing device 111 Candidate acquirer 112 Situation acquirer 113 Decider 116 Processor 117 Memory 120 Sensor device 130, 140 Wearable device 131 Smart glasses 132 Sound output device 133 Camera 134 Sound receiver 135 Smart watch 150 Mobile device 160 Information processing terminal
Claims
1. An information processing method performed by an information processing device, comprising the steps of: acquiring candidate information indicating a plurality of communication modal candidates; acquiring work status information indicating a work status of a worker; and determining a communication modality for the worker from the plurality of communication modal candidates based on the work status.
2. The information processing method of claim 1, wherein the presentation intensity of the communication modal determined when the work status information indicates that the worker is performing dangerous work as the work status is lower than the presentation intensity of the communication modal determined when the work status information indicates that the worker is not performing dangerous work as the work status.
3. An information processing method as described in claim 1 or 2, wherein the presentation intensity of the communication modal determined when the work status information indicates that the worker is working with his or her hands as the work status is lower than the presentation intensity of the communication modal determined when the work status information indicates that the worker is not working with his or her hands as the work status.
4. An information processing method as described in claim 1 or 2, wherein in the step of determining the communication modal, when the work status information indicates that the worker is working with his / her hands as the work status, the communication modal is determined by giving priority to a communication modal candidate that uses hearing from among the multiple communication modal candidates.
5. An information processing method as described in claim 1 or 2, wherein in the step of determining the communication modal, when the work status information indicates that the worker is engaged in a conversation as the work status, the communication modal is determined by prioritizing at least one of a communication modal candidate using vision and a communication modal candidate using touch from the multiple communication modal candidate.
6. An information processing method as described in claim 1 or 2, wherein in the step of determining the communication modality, when the work status information indicates that the noise level in the worker's workspace as the work status is higher than a first threshold, the communication modality is determined by prioritizing at least one of a communication modality candidate using vision and a communication modality candidate using touch from the multiple communication modality candidates.
7. An information processing method as described in claim 1 or 2, wherein in the step of determining the communication modal, when the work status information indicates that the noise level in the worker's workspace as the work status is lower than a second threshold, the communication modal is determined by giving priority to a communication modal candidate that uses hearing from the multiple communication modal candidate.
8. An information processing method as described in claim 1 or 2, further comprising a step of acquiring sensing information indicating sensing results of the worker or the worker's workspace, wherein in the step of acquiring work status information, the work status information is acquired based on the sensing information.
9. An information processing method according to claim 1 or 2, further comprising a step of acquiring work process information indicating a work process of the worker, wherein in the step of acquiring work status information, the work status information is acquired based on the work process information.
10. A program for causing an information processing device to carry out the information processing method according to claim 1 or 2.
11. An information processing device comprising: a candidate acquirer that acquires candidate information indicating a plurality of communication modal candidates; a situation acquirer that acquires work situation information indicating a work situation of a worker; and a determiner that determines a communication modality for the worker from the plurality of communication modal candidates based on the work situation.
12. An information processing system comprising: the information processing device according to claim 11; and a wearable device worn by the worker, the wearable device presenting information to the worker via the communication modal.
Citation Information
Patent Citations
Workflow system and operation method of workflow system
JP2008146520A
Server device
JP2014044512A
Moving support information presentation control device, method and program
JP2019212108A
