Work support method and work support device
The work support system enhances task-specific sounds and manages noise interference by amplifying and then reducing specific sounds, addressing the issue of disruptive noise in task performance.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- NISSAN MOTOR CO LTD
- Filing Date
- 2024-11-06
- Publication Date
- 2026-05-19
AI Technical Summary
Existing systems fail to distinguish between click sounds and noise of similar frequencies, leading to disruptive noise output that hinders workers' tasks.
A work support system that enhances specific sounds corresponding to correctly performed tasks and reduces or stops amplification after a predetermined time to minimize noise interference.
Suppresses work disruption by selectively amplifying task-specific sounds and reducing noise output, ensuring smooth task execution.
Smart Images

Figure 2026082031000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a work support method and a work support device.
Background Art
[0002] A connector fitting guarantee system is known that includes a microphone disposed in a fitting zone near the location where an operator fits a connector, and an output unit connected to the microphone and a speaker that provides feedback to the operator based on a signal received from the microphone. The microphone detects a click sound that occurs when the connector is properly fitted and the latch of one connector latches onto the corresponding connector, and the speaker amplifies and outputs the click sound so that it is easy for the operator to hear (Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In the above prior art, when noise having the same frequency as the click sound is detected, the click sound and the noise cannot be discriminated, so the amplified noise is output from the speaker. Therefore, while noise having the same frequency as the click sound is being detected, the operator has to keep listening to the amplified noise and there is a problem that the work cannot be properly performed.
[0005] The problem to be solved by the present invention is to provide a work support method and a work support device that can suppress the work of the operator from being hindered by noise output from the speaker.
Means for Solving the Problems
[0006] The present invention solves the above problem by outputting ambient sound acquired by a microphone to a worker through a speaker, and when a specific sound having a frequency corresponding to a predetermined sound that occurs when a predetermined task performed by the worker is performed properly is detected from the ambient sound, a process is executed to enhance the specific sound, and when a predetermined time has elapsed since the start of the process to enhance the specific sound, the degree to which the specific sound is enhanced is reduced or the process to enhance the specific sound is stopped. [Effects of the Invention]
[0007] According to the present invention, it is possible to suppress the disruption of workers' work due to noise output from the speaker. [Brief explanation of the drawing]
[0008] [Figure 1] Block diagram showing one embodiment of the work support system according to the present invention. [Figure 2] Figure 1 is a perspective view showing an example of a worker wearing a microphone and speaker. [Figure 3] Figure 1 is a flowchart showing an example of the processing procedure in the work support system. [Figure 4] Figure 1 is a flowchart showing another example of the processing procedure in the work support system. [Modes for carrying out the invention]
[0009] Embodiments of the present invention will be described below with reference to the drawings.
[0010] [Configuration of the work support system] Figure 1 is a block diagram showing one embodiment of the work support system according to the present invention. The work support system of this embodiment is a group of devices for outputting support information (hereinafter also simply referred to as support information) to support the work of a worker. The worker is not particularly limited as long as it is a person who performs work, and includes workers engaged in assembly work in a vehicle assembly plant (hereinafter also simply referred to as workers), mechanics engaged in vehicle maintenance at a vehicle dealership (hereinafter also referred to as dealers) (hereinafter also simply referred to as mechanics), and so on.
[0011] Each worker performs their assigned task. A assigned task is a series of tasks with predetermined procedures, and its content is not particularly limited, as long as a predetermined sound is produced when the assigned task is performed correctly. Performing the assigned task correctly means that the task assigned to the worker was carried out (or completed) according to the predetermined procedures. The predetermined sound includes all sounds generated from the object of the assigned task, objects associated with the object of the assigned task, and tools used by the worker in the assigned task, and is predetermined for each assigned task. Workers confirm whether the assigned task was performed correctly (whether it was completed according to the procedures) by listening to the generated predetermined sound.
[0012] One example of a prescribed task is when a worker mates a connector connected to a sensor with a connector connected to a controller. In this case, the "click" sound (click noise) that occurs when the connector latches properly mate is the prescribed sound (hereinafter also simply referred to as the prescribed sound) that occurs when the prescribed task performed by the worker is performed correctly. Another example of a prescribed task is when a worker attaches a resin clip to a wire harness to secure the wire harness to the vehicle body or engine. In this case, the "click" sound that occurs when the lock pin of the clip moves to the fixed position is the prescribed sound.
[0013] Another example of a designated task is when a worker assembles a pair of parts that are joined by a snap fit. In this case, the designated sound is the "click" sound that occurs when the protrusion of one part properly fits into the recess of the other part. Yet another example of a designated task is when a mechanic tightens a bolt using a signal-type torque wrench (hereinafter also simply referred to as a signal-type torque wrench) that emits a sound when the desired torque is reached. In this case, the designated sound is the sound emitted by the signal-type torque wrench when the desired torque is reached.
[0014] As shown in Figure 1, the work support system 10 of this embodiment includes a microphone 11, a speaker 12, and a work support device 20. These devices are connected communicatively by known means such as wired or wireless LAN, and exchange information with each other. The work support device 20 may be integrated with the microphone 11 or speaker 12, or it may be located at a distance from the microphone 11 and speaker 12 (for example, in a remote location).
[0015] Microphone 11 acquires ambient sound as sound data. Examples of microphones 11 include stand microphones, close-contact microphones, and shotgun microphones. Microphone 11 may be either directional or omnidirectional. Microphone 11 is positioned to detect a predetermined sound.
[0016] The position where a predetermined sound can be detected is predetermined for each predetermined task. For example, if the predetermined task is to mat a pair of connectors, the microphone 11 is positioned near the position where the connectors are mated (for example, near the hand of the worker holding the connectors). As another example, if the predetermined task is to attach a resin clip to a wire harness, the microphone 11 is positioned near the attachment position of the clip. As yet another example, if the predetermined task is to tighten a bolt using a signal-type torque wrench, the microphone 11 is positioned near the signal-type torque wrench (for example, on the upper arm of the worker holding the signal-type torque wrench).
[0017] The speaker 12 converts electrical signal energy into acoustic energy and emits it into space. For example, as shown in FIG. 1, the speaker 12 converts the signal output from the work support device 20 into sound and emits (outputs) it. The type of the speaker 12 is not particularly limited, and it may be a bookshelf type, a floor type, or the like. Also, earphones, headphones, or the like may be used as the speaker 12. The speaker 12 can be disposed at an appropriate position within a range where the sound output from the speaker 12 can be appropriately recognized by the operator.
[0018] The microphone 11 and the speaker 12 are, for example, worn on the operator (or the operator's clothing). The means for wearing the microphone 11 and the speaker 12 on the operator is not particularly limited. For example, the microphone 11 is physically fixed to the operator by a band provided with a snap fastener or a buckle. Also, the microphone 11 may be adhered to the operator with an adhesive tape. When using earphones (or headphones) as the speaker 12, it is worn on the operator by a wearing method defined for each earphone (or headphones).
[0019] FIG. 2 is a perspective view showing an example of an operator wearing the microphone 11 and the speaker 12. The operator 30 shown in FIG. 2 is a worker, and is attaching a wire harness 33 to an engine 32 on a workbench 31. The microphone 11 is worn on the upper right arm of the operator 30 by a band provided with a snap fastener. The microphone 11 shown in FIG. 2 acquires the sound around the microphone 11 (hereinafter also referred to as environmental sound). The environmental sound includes, for example, the fitting sound generated when the operator 30 fits the connector of the wire harness 33. Also, the operator 30 is wearing earphones 12a as the speaker 12 on the right ear.
[0020] Returning to FIG. 1, the work support device 20 controls the devices constituting the work support system 10 to cooperate and output support information. The work support device 20 acquires sound data of ambient sound (hereinafter also referred to as ambient sound information) from the microphone 11 at a predetermined time interval (for example, every 0.1 to 1 millisecond). Further, the work support device 20 outputs the generated signal to the speaker 12, and the speaker 12 outputs sound that supports the work of the worker 30 to the worker 30.
[0021] The work support device 20 is, for example, a computer, and includes a CPU (Central Processing Unit) which is a processor, a ROM (Read Only Memory) in which a program is stored, and a RAM (Random Access Memory) that functions as an accessible storage device. The CPU executes the program stored in the ROM and is an operation circuit for realizing the functions of the work support device 20. Note that, instead of or together with the CPU, an MPU (Micro Processing Unit), an ASIC (Application Specific Integrated Circuit), etc. may be used.
[0022] [Function of Work Support Device] A program for outputting support information is stored in the ROM of the work support device 20, and by the CPU of the work support device 20 executing the program, sound (support information) that supports the work of the worker 30 is output from the speaker 12. In FIG. 1, as functional blocks for outputting sound that supports the work of the worker 30, a sound collection unit 21, an enhancement unit 22, and an output unit 23 are extracted and shown for convenience.
[0023] The sound collection unit 21 acquires ambient sound information from the microphone 11, performs frequency analysis on the acquired ambient sound information, and determines whether the ambient sound contains a sound having a frequency corresponding to a predetermined sound (hereinafter also referred to as a specific sound) (that is, whether a specific sound is detected from the ambient sound). The frequency corresponding to the predetermined sound means a frequency that is the same as or similar to the frequency of the predetermined sound.
[0024] For example, the sound collection unit 21 performs frequency analysis on the waveform of the ambient sound information (sound data of the ambient sound) and extracts frequency components and their amplitudes. Next, the sound collection unit 21 determines whether or not there are components within a range of ±1 to 5% from the frequency of a predetermined sound (hereinafter also referred to as the similar range) among the extracted frequency components. If it is determined that there are components within the similar range among the extracted frequency components, the sound collection unit 21 determines that the ambient sound contains the specific sound. On the other hand, if it is determined that there are no components within the similar range among the extracted frequency components, the sound collection unit 21 determines that the ambient sound does not contain the specific sound.
[0025] If the sound collection unit 21 determines that the ambient sound does not contain a specific sound, the output unit 23 outputs the ambient sound acquired by the microphone 11 directly to the worker 30 through the speaker 12. On the other hand, if the sound collection unit 21 determines that the ambient sound contains a specific sound, the amplification unit 22 performs a process to amplify the specific sound (hereinafter also referred to as the amplification process).
[0026] The amplification unit 22 performs amplification processing based on information about a specific sound (hereinafter also referred to as specific sound information) input from the sound collection unit 21. The specific sound information includes, for example, information about the results of frequency analysis of ambient sound information. As amplification processing, the amplification unit 22 increases the amplitude of the specific sound. Alternatively, or in addition to this, the amplification unit 22 may also decrease the amplitude of sounds other than the specific sound as amplification processing. The ambient sound on which amplification processing has been performed is output to the output unit 23 as amplification-processed ambient sound information. The output unit 23 outputs the ambient sound with the specific sound amplified from the speaker 12 to the worker 30.
[0027] For example, if the predetermined task is to mate a connector connected to a sensor with a connector connected to a controller, the sound collection unit 21 determines whether the ambient sound acquired by the microphone 11 contains a sound (hereinafter also referred to as a specific sound corresponding to the click sound) that has the same or similar frequency as the click sound that occurs when the connector latch is properly mated. If the specific sound corresponding to the click sound is not detected in the ambient sound, it is determined that the ambient sound does not contain the specific sound corresponding to the click sound, and the output unit 23 outputs the ambient sound, in which the specific sound corresponding to the click sound is not amplified, to the worker 30 from the speaker 12. On the other hand, if the specific sound corresponding to the click sound is detected in the ambient sound, it is determined that the ambient sound contains the specific sound corresponding to the click sound. In this case, the amplification unit 22 performs amplification processing to amplify the specific sound corresponding to the click sound in the ambient sound, and the output unit 23 outputs the ambient sound, in which the specific sound corresponding to the click sound has been amplified, to the worker 30 from the speaker 12. As a result, if a clicking sound occurs, an amplified clicking sound is output from speaker 12, allowing the worker to easily confirm whether the connector has been properly mated.
[0028] The sound collection unit 21 detects specific sounds based on frequency components extracted from ambient sounds, and therefore cannot distinguish between a predetermined sound and noise having a frequency corresponding to the predetermined sound (hereinafter also referred to as corresponding noise). As a result, the specific sound may be either the predetermined sound or the corresponding noise, and the amplification unit 22 may amplify the corresponding noise through amplification processing. When the output unit 23 continuously outputs ambient sounds (or ambient sounds after amplification processing) from the speaker 12, if the ambient sounds contain corresponding noise, the worker 30 will continue to hear ambient sounds with amplified corresponding noise and will not be able to continue working.
[0029] Therefore, the amplification unit 22 reduces the degree to which a specific sound is emphasized or stops the amplification process when a predetermined time has elapsed since the start of the amplification process. The predetermined time can be set appropriately according to the length of the specific sound, for example, 0.5 to 2 seconds. Reducing the degree to which a specific sound is emphasized includes at least one of reducing the rate at which the specific sound is amplified and reducing the rate at which the amplitude of sounds other than the specific sound is reduced. If the amplification process by the amplification unit 22 is stopped, the ambient sound acquired by the microphone 11 is output directly to the worker 30 from the speaker 12.
[0030] For example, if the predetermined task is to mate a connector connected to a sensor with a connector connected to a controller, and the output unit 23 is outputting ambient sound from the speaker 12 that is an amplified version of a specific sound corresponding to a click sound, the amplification unit 22 determines whether a predetermined time has elapsed since the start of the amplification process. If it is determined that the predetermined time has not elapsed since the start of the amplification process, the output unit 23 continues to output ambient sound from the speaker 12 that is an amplified version of the specific sound corresponding to the click sound. On the other hand, if it is determined that the predetermined time has elapsed since the start of the amplification process, the amplification unit 22 stops executing the amplification process, and the output unit 23 outputs ambient sound from the speaker 12 that is not an amplified version of the specific sound corresponding to the click sound to the worker 30.
[0031] The specified sound may include the mating sound generated when mating a pair of connectors (a pair of wire harness connectors) that connect a wire harness, and the attachment sound generated when attaching clips that secure components such as wire harnesses to the vehicle body or power source. The power source is the power source of the vehicle and includes at least one of the engine and the battery. The clips are, for example, resin rivets.
[0032] The output unit 23 may set the volume (in dB) of the specific sound output from the speaker 12 to 0 if a predetermined time has elapsed since the enhancement unit 22 started the enhancement process. Alternatively, the output unit 23 may stop outputting the specific sound from the speaker 12 or cut off the output signal corresponding to the specific sound if a predetermined time has elapsed since the enhancement unit 22 started the enhancement process. For example, the output unit 23 outputs ambient sound with the specific sound silenced from the speaker 12. Furthermore, if the sound collection unit 21 continues to detect the specific sound from the ambient sound after setting the volume of the specific sound output from the speaker 12 to 0 or stopping the output of the specific sound, the output unit 23 will continue to set the volume of the specific sound output from the speaker 12 to 0 or stop the output of the specific sound until the volume of the specific sound detected from the ambient sound (i.e., the actual volume of the specific sound) decreases.
[0033] The output unit 23 may set the volume of the specific sound output from the speaker 12 to a predetermined volume greater than 0 and less than the volume of the specific sound at the predetermined time elapsed since the amplification unit 22 started amplification processing, after a predetermined time has elapsed since the amplification unit 22 started amplification processing. Furthermore, if the sound collection unit 21 continues to detect the specific sound from the ambient sound after the output unit 23 has set the volume of the specific sound output from the speaker 12 to a predetermined volume, the output unit 23 maintains the volume of the specific sound output from the speaker 12 at the predetermined volume. By maintaining the volume of the specific sound output from the speaker 12 at a predetermined volume after a predetermined time has elapsed since the start of amplification processing, even if the voices of the conversations between the workers 30 correspond to the specific sound, it is possible to avoid the voices of the workers 30 being amplified or silenced, thereby suppressing interference with the conversations between the workers 30.
[0034] [Processing in the work support system] Referring to Figures 3-4, the procedure for information processing by the work support device 20 will be explained. The processes described below are executed by the processor (CPU) of the work support device 20 at predetermined time intervals (for example, every 0.1 to 1 millisecond).
[0035] Figure 3 is a flowchart showing an example of a processing procedure in the work support system 10.
[0036] First, in step S1, the work support device 20 acquires ambient sound from the microphone 11 around the worker 30, and in the following step S2, it performs frequency analysis of the acquired ambient sound. In step S3, the work support device 20 determines whether or not a specific sound is included in the acquired ambient sound. If it is determined that the specific sound is not included in the acquired ambient sound (step S3: No), the process proceeds to step S8, and the work support device 20 outputs the acquired ambient sound from the speaker 12. On the other hand, if it is determined that the specific sound is included in the acquired ambient sound (i.e., the specific sound was detected from the acquired ambient sound) (step S3: Yes), the process proceeds to step S4.
[0037] In step S4, the work support device 20 performs a process to enhance the detected specific sound, and in the following step S5, outputs the ambient sound with the specific sound enhanced from the speaker 12. In step S6, the work support device 20 determines whether a predetermined time has elapsed since the start of the process to enhance the specific sound. If it is determined that the predetermined time has not elapsed since the start of the process to enhance the specific sound (step S6: No), the process proceeds to step S5. On the other hand, if it is determined that the predetermined time has elapsed since the start of the process to enhance the specific sound (step S6: Yes), the process proceeds to step S7, where the work support device 20 reduces the degree to which the specific sound is enhanced or stops the process to enhance the specific sound.
[0038] In step S7, the work support device 20 may set the volume of the specific sound output from speaker 12 to 0 if it reduces the degree to which the specific sound is emphasized. Alternatively, in step S7, the work support device 20 may stop outputting the specific sound from speaker 12 instead of reducing the degree to which the specific sound is emphasized.
[0039] Next, Figure 4 is a flowchart showing another example of a processing procedure in the work support system 10.
[0040] First, in step S11, the work support device 20 acquires ambient sounds from the microphone 11 around the worker 30, and in the following step S12, it determines whether or not the acquired ambient sounds contain a specific sound. If it is determined that the acquired ambient sounds do not contain a specific sound (step S12: No), the process proceeds to step S18, where the work support device 20 outputs the acquired ambient sounds from the speaker 12. On the other hand, if it is determined that the acquired ambient sounds contain a specific sound (i.e., a specific sound was detected from the acquired ambient sounds) (step S12: Yes), the process proceeds to step S13.
[0041] In step S13, the work support device 20 outputs ambient sound in which the specific sound has been amplified from the speaker 12, and in the following step S14, it determines whether a predetermined time has elapsed since the start of the process of amplifying the specific sound contained in the ambient sound. If it is determined that the predetermined time has not elapsed since the start of the process of amplifying the specific sound (step S14: No), the process proceeds to step S13. On the other hand, if it is determined that the predetermined time has elapsed since the start of the process of amplifying the specific sound (step S14: Yes), the process proceeds to step S15, and the work support device 20 reduces the rate at which the specific sound is amplified.
[0042] In step S16, the work support device 20 determines whether a specific sound is continuously detected from the acquired ambient sound. If it is determined that a specific sound is continuously detected from the acquired ambient sound (step S16: Yes), the process proceeds to step S19, where the work support device 20 reduces or maintains the amplification rate of the specific sound. Conversely, if it is determined that a specific sound is no longer detected from the acquired ambient sound (step S16: No), the process proceeds to step S17, where the work support device 20 stops amplifying the specific sound contained in the ambient sound.
[0043] In step S15, the work support device 20 may mute the specific sound included in the ambient sound if it reduces the rate at which it amplifies the specific sound. In this case, in step S17, the work support device 20 may stop mute the specific sound included in the ambient sound instead of stopping the amplification of the specific sound included in the ambient sound.
[0044] [Embodiments of the present invention] According to this embodiment, when ambient sound acquired by the microphone 11 is output to the worker 30 from the speaker 12, if a specific sound having a frequency corresponding to a predetermined sound that occurs when a predetermined task performed by the worker 30 is performed properly is detected from the ambient sound, a process is performed to emphasize the specific sound, and when a predetermined time has elapsed since the start of the process, the degree to which the specific sound is emphasized is reduced or the process is stopped. A work support method and a work support device 20 that executes the work support method are provided. This makes it possible to suppress the disruption of the worker 30's work by noise output from the speaker 12.
[0045] In the work support method and work support device 20 of this embodiment, the microphone 11 and the speaker 12 are attached to the worker 30, and the predetermined sound includes the mating sound generated when a pair of wire harness connectors are mated and the attachment sound generated when a clip that secures the part to the vehicle body or power source is attached to the part. This makes it possible to detect specific sounds more accurately.
[0046] In the work support method and work support device 20 of this embodiment, when the predetermined time has elapsed since the start of the process, the volume of the specific sound output from the speaker 12 is set to 0 or the output of the specific sound is stopped. This further suppresses the disruption of the worker's work by noise output from the speaker 12.
[0047] In the work support method and work support device 20 of this embodiment, if the specific sound is continuously detected from the ambient sound after the volume of the specific sound output from the speaker 12 has been set to 0 or the output of the specific sound has been stopped, the volume of the specific sound output from the speaker 12 has been set to 0 or the output of the specific sound has been stopped until the volume of the specific sound detected from the ambient sound decreases. This further reduces the disruption of the worker's work by noise output from the speaker 12.
[0048] In the work support method and work support device 20 of this embodiment, when a predetermined time has elapsed since the start of the process, the volume of the specific sound output from the speaker 12 is set to a predetermined volume that is greater than 0 and less than the volume of the specific sound at the predetermined time after the start of the process. After setting the volume of the specific sound output from the speaker 12 to the predetermined volume, if the specific sound is continuously detected from the ambient noise, the volume of the specific sound output from the speaker 12 is maintained at the predetermined volume. This prevents the worker 30's work from being hindered by noise output from the speaker 12, while also preventing the workers from hindering each other's conversations. [Explanation of Symbols]
[0049] 10…Work support system 11… Microphone 12...Speaker 12a… Earphones 20…Work support device 21…Sound collection section 22...Emphasis part 23…Output section 30…Worker 31...Workbench 32… Engine 33…Wire harness
Claims
1. In a work support method performed by a work support device, The aforementioned work support device is When ambient sounds acquired by a microphone are output to a worker through a speaker, if a specific sound having a frequency corresponding to a predetermined sound that occurs when a predetermined task performed by the worker is performed properly is detected from the ambient sounds, a process is executed to emphasize the specific sound. A work support method that, when a predetermined time has elapsed since the start of the process, reduces the degree to which the specific sound is emphasized or stops the process.
2. The microphone and speaker are attached to the worker. The work support method according to claim 1, wherein the predetermined sound includes a mating sound generated when a pair of wire harness connectors are mated together, and a mounting sound generated when a clip for fixing the part to the vehicle body or power source is attached to the part.
3. The work support method according to claim 1 or 2, wherein when the predetermined time has elapsed since the start of the process, the work support device sets the volume of the specific sound output from the speaker to 0 or stops the output of the specific sound.
4. The work support method according to claim 3, wherein if the work support device continues to detect the specific sound from the ambient sound after setting the volume of the specific sound output from the speaker to zero or stopping the output of the specific sound, the work support device sets the volume of the specific sound output from the speaker to zero or stops the output of the specific sound until the volume of the specific sound detected from the ambient sound decreases.
5. The aforementioned work support device is When the predetermined time has elapsed since the start of the process, the volume of the specific sound output from the speaker is set to a predetermined volume that is greater than 0 and less than the volume of the specific sound at the time the predetermined time has elapsed since the start of the process. The work support method according to claim 1 or 2, wherein, after setting the volume of the specific sound output from the speaker to the predetermined volume, if the specific sound is continuously detected from the ambient sound, the volume of the specific sound output from the speaker is maintained at the predetermined volume.
6. An output unit that outputs ambient sounds acquired by a microphone to the worker through a speaker, The system includes an enhancement unit that, when a specific sound having a frequency corresponding to a predetermined sound that occurs when a predetermined task performed by the worker is properly carried out is detected from the ambient sound, performs a process to enhance the specific sound. The enhancement unit is a work support device that, when a predetermined time has elapsed since the start of the process, reduces the degree to which the specific sound is emphasized or stops the process.