Method of presenting know-how

Abstract

Improve the technique for presenting know-how. [Solution] A method for presenting know-how executed by an information processing device, comprising: acquiring text information and first video information relating to an operation that includes know-how; identifying a video section corresponding to the text information from the first video information; and outputting the identified video section in association with the text information.

Description

Technical Field

[0001] The present disclosure relates to a know-how presentation method including video information.

Background Art

[0002] Conventionally, there has been disclosed a technique of acquiring video data, audio data, and sensor data of a first user related to the execution of a task, correlating the video data with the audio data and the sensor data for processing to generate training information from an updated domain model, and using the training information when training a second user (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Although Patent Document 1 discloses applying a machine learning system to correlate video data with audio data and sensor data, identification, presentation, etc. of videos corresponding to text information related to know-how have not been considered at all. That is, there has been room for improvement in the know-how presentation technology. Here, know-how refers to specific or specialized knowledge, techniques, methods, and information, and is typically transmitted by explanations using words, images, actions, etc. Examples of know-how targets include operations such as screwing and assembly, applications, software operations, and business execution procedures, but are not limited thereto.

[0005] In view of such circumstances, an object of the present disclosure is to improve the know-how presentation technology.

Means for Solving the Problems

[0006] A method for presenting know-how according to one embodiment of this disclosure is: A method for presenting know-how that an information processing device can execute, To obtain text information and video information related to the operation, including know-how, From the aforementioned first video information, identify the video section corresponding to the aforementioned text information, The identified video section is output in association with the aforementioned text information. Includes. [Effects of the Invention]

[0007] According to one embodiment of this disclosure, the technique for presenting know-how is improved. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram illustrating the schematic configuration of an information processing device. [Figure 2] This is a flowchart showing the operation of an information processing device. [Modes for carrying out the invention]

[0009] The embodiments of this disclosure will be described below.

[0010] (Summary of the embodiment) The outline and configuration of this embodiment will be described with reference to Figure 1.

[0011] The know-how presentation method according to this embodiment is performed by the information processing device 10. The information processing device 10 is any device used by each user. For example, a general-purpose electronic device such as a personal computer, smartphone, tablet terminal, or wearable device, or a dedicated electronic device, can be used as the information processing device 10.

[0012] First, an overview of this embodiment will be described, and details will be described later. The information processing device 10 acquires text information and first video information related to operations, including know-how. The information processing device 10 also identifies a video section from the first video information that corresponds to the text information. The information processing device 10 also outputs the identified video section in association with the text information.

[0013] Thus, according to this embodiment, text information and first video information related to the operation are acquired, and the video section corresponding to the text information is output in association with the text information. Therefore, the know-how presentation technology is improved in that the text information related to the operation and the corresponding video section are presented in association.

[0014] Next, the components of the information processing device 10 will be described in detail. As shown in Figure 1, the information processing device 10 comprises a control unit 11, a storage unit 12, an input unit 13, an output unit 14, and a communication unit 15. The control unit 11 includes at least one processor. The processor is a general-purpose processor such as a CPU, or a dedicated processor specialized for a specific process. The control unit 11 controls each part of the information processing device 10 and executes processes related to the operation of the information processing device 10. The storage unit 12 includes at least one semiconductor memory, etc. The semiconductor memory is, for example, RAM or ROM. The storage unit 12 functions, for example, as a main memory or auxiliary memory. The storage unit 12 stores data used in the operation of the information processing device 10 and data obtained by the operation of the information processing device 10. The input unit 13 includes at least one input interface. The input interface may be, for example, a physical key, a touchscreen, a sound sensor that accepts voice input, or a camera that accepts gesture input. The input unit 13 accepts operations to input data used in the operation of the information processing device 10. The output unit 14 includes at least one output interface. The output interface is, for example, a display for outputting information as video, or a speaker for outputting information as audio. The output unit 14 outputs data obtained by the operation of the information processing device 10. The communication unit 15 includes at least one external communication interface. The communication interface may be either a wired communication interface or a wireless communication interface. In the case of wired communication, the communication interface is, for example, a LAN or USB. In the case of wireless communication, the communication interface is, for example, an interface compatible with a mobile communication standard such as 5G, or an interface compatible with short-range wireless communication. The communication unit 15 receives data used in the operation of the information processing device 10 and transmits data obtained by the operation of the information processing device 10.

[0015] The functions of the information processing device 10 are realized by executing a program according to this embodiment on a processor corresponding to the control unit 11. In other words, the functions of the information processing device 10 are realized by software. The program causes the computer to function as the information processing device 10 by having the computer execute the operations of the information processing device 10. In other words, the computer functions as the information processing device 10 by executing the operations of the information processing device 10 according to the program. In this embodiment, the program can be recorded on a recording medium that can be read by a computer. The recording medium that can be read by a computer includes non-temporary computer-readable media, such as a magnetic recording device or semiconductor memory. The program can be distributed, for example, by selling, transferring, or lending a portable recording medium such as a DVD on which the program is recorded. Alternatively, the program can be distributed by storing the program in the storage of an external server and transmitting the program from the external server to another computer. The program can also be provided as a program product. Some or all of the functions of the information processing device 10 may be realized by a dedicated circuit corresponding to the control unit 11. In other words, some or all of the functions of the information processing device 10 may be realized by hardware.

[0016] Referring to Figure 2, the operation of the information processing device 10 according to this embodiment will be described. First, the control unit 11 of the information processing device 10 acquires text information and first video information related to operations, including know-how (step S1). Any method can be used to acquire the text information and first video information related to operations. For example, the control unit 11 may acquire the text information and first video information related to operations via the input unit 13. Alternatively, the control unit 11 may acquire the text information and first video information related to operations from an external device via the communication unit 15 and the network. The text information related to operations is text information relating to know-how. For example, the text information may be know-how related to the assembly work of a certain product (for example, know-how related to the operation of the hands during assembly work). In this case, the first video information may be a video in which multiple pieces of know-how related to the assembly work of a certain product are mixed (for example, know-how related to the operation of the hands during assembly work and know-how related to the operation of the feet during assembly work). The operations in the assembly work may be operations in the assembly work related to automobile manufacturing, for example, such as the assembly of engine parts, the installation of door panels, the mounting of tires, etc.

[0017] Next, the control unit 11 identifies a video segment corresponding to the text information from the first video information (step S2). Any method can be used to identify the video segment corresponding to the text information. For example, the control unit 11 may divide the first video information into multiple video segments based on the audio content and body part movements of the first video information, and then identify the video segment based on the divided video segments and the text information. Alternatively, the control unit 11 may identify the video segment by, for example, extracting a video from the text of the explanation where a specific keyword appears. Specifically, for example, the control unit 11 may identify the video segment by detecting a scene change, such as when the subject of the movement switches from the hands to the feet. Also, for example, if the text information is know-how related to the method of hand movements among the know-how related to the assembly work of a certain product, the video segment showing the know-how related to the method of hand movements may be identified.

[0018] Subsequently, the control unit 11 outputs the specified video segment in association with the text information (step S3). For example, the control unit 11 may output know-how adjusted by a user interface via the output unit 14 of the information processing apparatus 10. When know-how is output based on the text information, the font size, font type, character color, background color, line spacing, etc. may be adjusted according to the priority of the know-how so that the content with higher priority is emphasized and displayed. Here, the priority refers to an item indicating a numerical value or category that can be compared in terms of high and low, which may be set in some way when acquiring and inputting know-how in advance, and may be set by the judgment of an expert, or may be set according to the usage frequency, usage pattern, etc. Note that the specified video segment and the text information described above may be associated and stored in a database or the like.

[0019] As described above, the information processing apparatus 10 according to the present embodiment acquires text information and first video information regarding an operation including know-how. Further, the information processing apparatus 10 specifies a video segment corresponding to the text information from the first video information. Further, the information processing apparatus 10 outputs the specified video segment in association with the text information.

[0020] According to such a configuration, the know-how presentation technology is improved in that the text information regarding the operation and the corresponding video segment are associated and the information is presented.

[0021] Although the present disclosure has been described based on the drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present disclosure. For example, the functions included in each component or each step, etc. can be rearranged so as not to be logically contradictory, and it is possible to combine or divide a plurality of components or steps, etc. into one.

[0022] For example, the above embodiment shows an example of presenting know-how related to the assembly work of a certain product, but it is not limited to this. The first video information may be any action, such as actions related to sports, actions related to dance, actions related to martial arts, actions related to acting, etc. For example, actions related to sports may include, for example, a soccer shot, a tennis serve, a golf swing, etc.

[0023] For example, the first video information may be a recording of the actions of the first user. The first user may be an expert. Furthermore, the control unit 11 of the information processing device 10 may include a step of acquiring the second video information of the second user in real time. The second user may be any person. For example, the second user may be a beginner or an expert. The control unit 11 may output suggestions such as alerts via the output unit 14, etc., based on the difference between the first video information and the second video information. This makes it possible to present the second user with information related to the difference between the first video information and the second video information.

[0024] Furthermore, when outputting suggestions, the timing of the suggestion notification may be adjusted based on the magnitude of the difference between the first video information and the second video information. For example, if the magnitude of the difference is greater than or equal to a threshold, the control unit 11 may immediately output the suggestion via the output unit 14, etc. This allows the second user to be informed in a timely manner that the work processes are significantly different, such as when the work processes are completely different. On the other hand, if the magnitude of the difference is less than a threshold, the control unit 11 may output the suggestion via the output unit 14, etc., after a predetermined time. This reduces the frequency of notifications when the work processes are not significantly different, and prevents a decrease in work efficiency.

[0025] Furthermore, when outputting suggestions, the control unit 11 may adjust the content of the suggestions based on the attribute information of the second user. For example, if the second user's proficiency level is below a threshold, the control unit 11 may limit the content of the suggestions to only items with a priority higher than or equal to the threshold. Alternatively, if the second user's proficiency level is above a threshold, the control unit 11 may increase the content of the suggestions.

[0026] Furthermore, when outputting suggestions, the control unit 11 may adjust the content of the alert according to the growth level based on the second user's video history. For example, if the second user's growth level is below a threshold, the control unit 11 may limit the content of the suggestions to only items with a priority higher than the threshold. Alternatively, if the second user's growth level is above a threshold, the control unit 11 may increase the content of the suggestions. The control unit 11 may also output the second user's growth level. The growth level may be calculated by a score based on, for example, the amount of change in the magnitude of the difference, the range of fluctuation, the variance, etc. For example, it may output that the difference has decreased compared to a week ago, or that the variance of the difference has decreased and stabilized.

[0027] Furthermore, in the embodiment described above, it is also possible to have an embodiment in which the configuration and operation of the information processing device 10 are distributed among multiple computers that can communicate with each other. [Explanation of symbols]

[0028] 10: Information processing unit, 11: Control unit, 12: Storage unit, 13: Input unit, 14: Output unit, 15: Communication unit

Claims

1. A method for presenting know-how that an information processing device can execute, To obtain text information and first video information related to the operation, including know-how, From the first video information, identify the video section corresponding to the text information, The identified video section is output in association with the aforementioned text information. A method of presenting know-how, including the following.

2. A method for presenting know-how as described in claim 1, A method for presenting know-how, wherein the first video information includes information on actions related to work processes, actions in sports, actions related to dance, actions related to martial arts, and actions related to acting.

3. A method for presenting know-how as described in claim 1, A method for presenting know-how, comprising dividing the first video information into multiple video segments based on the audio content and body part movements of the first video information, and identifying the video segments based on the divided video segments and the text information.

4. A method for presenting know-how according to claim 1, wherein the first video information is a recording of the actions of a first user, To acquire second video information from a second user in real time, A method for presenting know-how that provides suggestions based on the difference between the first video information and the second video information.

5. A method for presenting know-how according to claim 4, wherein the timing of the suggestion notification is adjusted based on the magnitude of the difference.

Images