Information processing device and information processing program

Abstract

To properly train foreign workers.SOLUTION: An information processing device 1 includes a control unit 11 and a display unit 14. The control unit 11 includes a language selection unit 111 as means for selecting a usage language from a plurality of types of languages, a custom teaching video display unit 112 as means for displaying a custom teaching video 121 that teaches the customs of a predetermined country on the display unit 14, a work manual display unit 113 as means for displaying at least one of characters and images of a work manual 122 on the display unit 14, and a work procedure video display unit 114 as means for displaying a work procedure video 123 obtained by visualizing contents of the work manual 122 on the display unit 14. The language type of the custom teaching video 121, the characters of the work manual 122, and the work procedure video 123 is the usage language selected by the language selection unit 111.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and an information processing program.

Background Art

[0002] There is known a terminal device that displays vehicle manual information prepared in a server on a display unit of the terminal device (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, foreign workers may be in charge of work at various work sites. In this case, there is a problem that it is difficult for foreign workers to understand if the work manual is written in Japanese.

[0005] Therefore, one aspect of the present invention aims to provide a technology capable of appropriately educating foreign workers.

Means for Solving the Problems

[0006] In order to solve the above problems, an information processing apparatus according to the present invention includes a control unit and a display unit. The control unit includes means for selecting a language to be used from among a plurality of language types, and means for causing the display unit to display a custom teaching video for teaching the customs of a predetermined country, and the language type of the custom teaching video may be the language to be used.

[0007] The information processing apparatus according to the present invention has a control unit and a display unit. The control unit includes means for selecting a language to be used from among a plurality of language types, means for causing at least one of characters and images of a predetermined work manual to be displayed on the display unit, and means for causing a work procedure video obtained by visualizing the content of the work manual to be displayed on the display unit. The language types of the characters and the work procedure video may be the language to be used.

[0008] The information processing apparatus according to the present invention has a control unit and a display unit. The control unit includes means for selecting a language to be used from among a plurality of language types, means for causing a habit teaching video for teaching the habits of a predetermined country to be displayed on the display unit, means for causing at least one of characters and images of a predetermined work manual to be displayed on the display unit, and means for causing a work procedure video obtained by visualizing the content of the work manual to be displayed on the display unit. The language types of the habit teaching video, the characters, and the work procedure video may be the language to be used.

[0009] In the information processing apparatus according to the present invention, it is essential to view the habit teaching video a predetermined number of times, and after viewing the predetermined number of times, viewing becomes essential at a predetermined cycle and / or viewing becomes essential by setting by an administrator.

[0010] In the information processing apparatus according to the present invention, it is essential to view the work procedure video a predetermined number of times, and after viewing the predetermined number of times, viewing becomes essential at a predetermined cycle and / or viewing becomes essential by setting by an administrator.

[0011] The information processing apparatus according to the present invention may further include an imaging unit. The control unit further includes means for comparing a post-work image captured by the imaging unit of the state after the operator has performed the work with a model image captured in advance of a model when performing the work according to the work manual, and evaluating the degree of coincidence between the post-work image and the model image.

[0012] The information processing apparatus according to the present invention may be configured such that it is essential to view the operation procedure video according to the degree of coincidence between the post-operation image and the template image.

[0013] Further, the information processing program according to the present invention is a program for causing an information processing apparatus having a control unit and a display unit to execute information processing, and includes a process of selecting a language to be used from among a plurality of language types, a process of causing the display unit to display a custom teaching video for teaching the customs of a predetermined country, a process of causing the display unit to display at least one of the characters and images of a predetermined work manual, and a process of causing the display unit to display an operation procedure video obtained by visualizing the content of the work manual, and the information processing apparatus is caused to execute the processes such that the language types of the custom teaching video, the characters, and the operation procedure video are the language to be used.

Advantages of the Invention

[0014] According to the present invention, on one aspect, it becomes possible to appropriately educate foreign workers.

Brief Description of the Drawings

[0015]

Figure 1

Figure 2

Figure 3

Figure 4

Embodiments for Carrying Out the Invention

[0016] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0017] (Overall Configuration and Functional Configuration) FIG. 1 is a block diagram showing the functional configuration of an information processing apparatus 1 according to an embodiment as an example of a specific configuration mode of the information processing apparatus according to the present invention.

[0018] The information processing apparatus 1 is an electronic device used by workers in various work sites. The information processing apparatus 1 may be used, for example, by workers responsible for work in hotels, accommodation facilities, restaurants, department stores, factories, hospitals, educational facilities, office buildings, commercial facilities, condominiums, construction sites, and nursing facilities.

[0019] The information processing apparatus 1 includes a control unit 11, a storage unit 12, an input unit 13, a display unit 14, a sound output unit 15, an imaging unit 16, and a communication unit 17, and these components are electrically connected so that signals can be input and output to and from each other via a bus 19 inside the information processing apparatus 1. The information processing apparatus 1 may further include components other than the above-described components. The information processing apparatus 1 may further include, for example, a sound input unit such as a microphone.

[0020] For example, a predetermined application (information processing program) may be installed in a portable information terminal (PDA: Personal Digital Assistant) such as a smartphone or a tablet terminal so that the portable information terminal functions as the information processing apparatus 1. The information processing apparatus 1 may alternatively be a personal computer device such as a desktop type or a server device, or may be a network system in which a portable information terminal and a server device are connected so that they can communicate with each other via a communication network 9.

[0021] The control unit 11 performs various arithmetic processes related to the information processing apparatus 1 and controls the overall operation. The control unit 11 may be configured to include, for example, a central processing unit (CPU).

[0022] The control unit 11 reads a predetermined program (including an information processing program) stored in the storage unit 12 and executes processing according to the program, thereby realizing various functions related to the information processing apparatus 1. That is, various functions related to the information processing apparatus 1 are specifically realized by information processing by software (including an information processing program) stored in the storage unit 12 being executed by the control unit 11, which is an example of hardware, and can be executed as each functional unit included in the control unit 11. The control unit 11 is not limited to being single, and may be configured to have a plurality of control units 11 for each function. Further, the control unit 11 may be a combination of a plurality of control units.

[0023] The storage unit 12 may be constituted by an arbitrary storage medium and stores various information and data. The storage unit 12 may be, for example, a storage device such as a solid state drive (SSD) that stores various programs and the like related to the information processing apparatus 1 executed by the control unit 11, or a read-only memory (ROM) that similarly stores various programs and the like, or a random access memory (RAM) that stores information and data temporarily required for the calculation of the program, etc., and may also be a combination thereof.

[0024] The storage unit 12 also stores a habit teaching video 121, a work manual 122, and a work procedure video 123, and stores a model image database 124.

[0025] The input unit 13 has a function as an input interface that receives an input operation by a user of the information processing apparatus 1. The input unit 13 may be included in the housing of the information processing apparatus 1 (in other words, integrated with the housing), or may be externally attached. The input unit 13 may be constituted by, for example, various input keys and operation keys for inputting numerical values / data and instructing operations / actions.

[0026] The input unit 13 receives an operation input made by a user of the information processing apparatus 1 (in other words, a user of a service realized by an information processing program; the same applies hereinafter), and transmits the operation input as a command signal to the control unit 11 via the bus 19. Then, the control unit 11 executes predetermined control and calculations as necessary.

[0027] The display unit 14 has a function as an output interface that visually displays various information to the user of the information processing apparatus 1 as images (still images, moving images), characters, and the like. The display unit 14 may be included in the housing of the information processing apparatus 1 (in other words, integrated with the housing), or may be externally attached. The display unit 14 may be configured by, for example, a liquid crystal display or an EL (Electro Luminescence) display. The display unit 14 displays, for example, the habit teaching video 121, the work manual 122, and the work procedure video 123.

[0028] The input unit 13 and the display unit 14 may be configured as a touch panel or a touch display that integrally provides the functions of these input unit 13 and display unit 14 (specifically, the functions as an input interface and an output interface).

[0029] The sound output unit 15 is a device having a function of outputting sound. The sound output unit 15 may be configured by, for example, a speaker.

[0030] The imaging unit 16 is a device having a function of imaging a shooting range that changes according to the orientation and posture of the information processing apparatus 1 (specifically, the lens of the imaging unit 16), the distance from the shooting target, and the zoom magnification, and acquiring imaging image data. The imaging unit 16 may be configured by a mechanism (specifically, a camera) including, for example, a lens and an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

[0031] The communication unit 17 has a function as a communication interface for the communication network 9 that connects the information processing apparatus 1 and the communication network 9 so that communication is possible. The communication unit 17 performs communication processing with an external device connected so as to be able to communicate via the communication network 9.

[0032] The communication network 9 is a communication line network composed of, for example, the Internet, a mobile communication network, various wireless communication lines, wired communication lines, etc., and may include a LAN (Local Area Network), a WAN (Wide Area Network), an intranet, and Ethernet (registered trademark), etc. The communication network 9 may include a wireless network or a wired network.

[0033] (Processing content) The information processing apparatus 1 according to the embodiment has a control unit 11 and a display unit 14. The control unit 11 includes a language selection unit 111 as means for selecting a language to be used from among a plurality of language types, a custom teaching video display unit 112 as means for causing the display unit 14 to display a custom teaching video 121 for teaching the customs of a predetermined country, a work manual display unit 113 as means for causing the display unit 14 to display at least one of the characters and images of a work manual 122, and a work procedure video display unit 114 as means for causing the display unit 14 to display a work procedure video 123 obtained by visualizing the content of the work manual 122. The language types of the custom teaching video 121, the characters of the work manual 122, and the work procedure video 123 are the language to be used selected by the language selection unit 111.

[0034] In addition, the information processing program according to the embodiment is a program for causing the information processing apparatus 1 having the control unit 11 and the display unit 14 to execute information processing. The program includes a process of selecting a language to be used from among a plurality of language types, a process of causing the display unit 14 to display a custom teaching video 121 for teaching the customs of a predetermined country, a process of causing the display unit 14 to display at least one of the characters and images of a predetermined work manual 122, and a process of causing the display unit 14 to display a work procedure video 123 obtained by visualizing the content of the work manual 122. The information processing apparatus 1 is caused to execute these processes, and the language types of the custom teaching video 121, the characters of the work manual 122, and the work procedure video 123 are the language selected as described above.

[0035] The control unit 11 of the information processing apparatus 1 includes a language selection unit 111, a custom teaching video display unit 112, a work manual display unit 113, a work procedure video display unit 114, and a work evaluation unit 115. Each unit provided in the control unit 11 can also be said to be each functional unit implemented in the control unit 11.

[0036] Each functional unit of the control unit 11 is realized and generated by the control unit 11 reading and executing a predetermined program (including the information processing program) stored in the storage unit 12. Note that "transmission" in the description of the present invention includes the exchange of information and data performed via storage in the storage unit 12 and reading from the storage unit 12.

[0037] (Language Selection Unit) The language selection unit 111 has a function of selecting a language to be used from among a plurality of language types and setting it as the language type to be used in the information processing apparatus 1.

[0038] For example, when the information processing apparatus 1 is started by the user of the information processing apparatus 1 or when the use of a service realized by the information processing program is started, the language selection unit 111 causes the display unit 14 to display a list of the language types available in the information processing apparatus 1.

[0039] Then, the user of the information processing apparatus 1 selects the type of language used by the user from a list of types of available languages via the input unit 13.

[0040] The types of languages that can be used in the information processing apparatus 1 may be preset in consideration of, for example, the nationalities of the workers who are assumed to be the users of the information processing apparatus 1 and who are in charge of work at various work sites.

[0041] The number of types of languages that can be used in the information processing apparatus 1 may be any number as long as it is 2 or more.

[0042] The language selection unit 111 stores the type of language selected by the user of the information processing apparatus 1 in the storage unit 12 as the language in use.

[0043] The selection of the language in use may be made each time the information processing apparatus 1 is started up or each time the use of a service realized by an information processing program is started, or it may not be made until a change in the type of language is requested after it has been made once.

[0044] (Custom Teaching Video Display Unit) The custom teaching video display unit 112 has a function of causing the display unit 14 to display a custom teaching video 121 that teaches the customs of a predetermined country.

[0045] The custom teaching video 121 is a video that explains and teaches (in other words, educates) customs and unique customs that vary by country. The custom teaching video 121 may be, for example, a video that explains and teaches preferable attitudes, actions, and appropriate attitudes and actions in the customs of a predetermined country in "common situations" and "scenes and situations that are likely to occur" assumed at the work site where the information processing apparatus 1 is used.

[0046] The habit teaching video 121 may be a video that explains and teaches preferably favorable attitudes, actions, and appropriate attitudes and actions in a given country regarding communication with managers and colleagues at the work site, and communication with customers (e.g., customers of a hotel or accommodation facility) at the work site.

[0047] The type of the given country covered in the habit teaching video 121 may be, for example, the country where the information processing apparatus 1 is used. The type of the given country covered in the habit teaching video 121 may include the country assumed as the nationality of the people with whom there are many opportunities to come into contact at the work site where the information processing apparatus 1 is used.

[0048] Specifically, for example, when the information processing apparatus 1 is used by a worker in charge of work at a hotel or accommodation facility in Japan, the habit teaching video 121 may be content that explains and teaches habits in Japan. Also, when the information processing apparatus 1 is used by a worker in charge of work at a hotel or accommodation facility in Japan and many people from country X use the said hotel or accommodation facility, the habit teaching video 121 may include content that explains and teaches habits in country X.

[0049] The number of types of the given countries covered in the habit teaching video 121 may be one or a plurality. In the example shown in FIG. 1, the habit teaching video 121 is represented as one block in the storage unit 12, but a plurality of habit teaching videos for each country may be stored in the storage unit 12.

[0050] The habit teaching video 121 may be in a mode of being played as a video, or may be in a mode such as a slide show in which still images (in other words, slides) are continuously displayed while being switched. In the description of the present invention, electronic data in a mode such as a slide show in which still images (slides) are continuously displayed while being switched is also assumed to be included in the habit teaching video 121.

[0051] The habit teaching video 121 includes at least one of subtitles and audio in addition to the image. In the description of the present invention, various character information projected on the display unit 14 together with the image (still image, moving image) is referred to as "subtitles", and character information that can also be classified into modes such as "subtitle super", "telop", and "bubble" is also referred to as "subtitles". In the description of the present invention, furthermore, various speech information output from the sound output unit 15 together with the image (still image, moving image) is referred to as "audio", and speech information that can also be classified into modes such as "narration" and "dialogue" is also referred to as "audio".

[0052] When the habit teaching video 121 includes subtitles, the subtitles of the habit teaching video 121 are prepared as text data for each type of language that can be used in the information processing apparatus 1 (that is, for each type of language for which a list is displayed on the display unit 14 by the language selection unit 111) and stored in the storage unit 12.

[0053] The habit teaching video display unit 112 refers to the type of language stored as the use language in the storage unit 12 by the language selection unit 111, selects the text data of the type of that language, and displays subtitles together with the image of the habit teaching video 121 on the display unit 14.

[0054] Alternatively, habit teaching videos including subtitles for each type of language may be prepared in advance and stored in the storage unit 12, and the habit teaching video display unit 112 may refer to the type of language stored as the use language in the storage unit 12 by the language selection unit 111, select a habit teaching video including subtitles of the type of that language, and display the image and subtitles on the display unit 14.

[0055] When the habit teaching video 121 includes audio, the audio of the habit teaching video 121 is prepared as audio data for each type of language that can be used in the information processing apparatus 1 (that is, for each type of language for which a list is displayed on the display unit 14 by the language selection unit 111) and stored in the storage unit 12.

[0056] The habit teaching video display unit 112 refers to the type of language stored in the storage unit 12 as the language to be used by the language selection unit 111, selects the audio data of the type of the language, and causes the image of the habit teaching video 121 to be displayed on the display unit 14 and the audio to be output from the audio output unit 15.

[0057] Alternatively, habit teaching videos including audio for each type of language may be prepared in advance and stored in the storage unit 12. The habit teaching video display unit 112 refers to the type of language stored in the storage unit 12 as the language to be used by the language selection unit 111, selects the habit teaching video including the audio of the type of the language, and causes the image to be displayed on the display unit 14 and the audio to be output from the audio output unit 15.

[0058] As described above, for the habit teaching video 121, the type of language of at least one of the subtitle and the audio is the language to be used. In this regard, the type of language of the habit teaching video 121 is the language to be used.

[0059] The habit teaching video 121 may be made mandatory to be viewed a predetermined number of times. Further, after viewing a predetermined number of times, viewing may be made mandatory at a predetermined period and / or by setting by an administrator.

[0060] Specifically, for example, when an operator starts using the information processing apparatus 1 (in other words, when starting to use the service realized by the information processing program), the habit teaching video 121 may be made mandatory to be viewed a predetermined number of times according to, for example, the following a) or b).

[0061] a) When trying to use the service realized by the information processing program when starting daily work, it is mandatory to view the habit teaching video 121 at the beginning of using the service until the service is used a predetermined number of times (in other words, the number of days). (a) It is essential to watch the habit teaching video 121 at least once a day during a predetermined period (number of days). In this case, the number of days in the predetermined period corresponds to the number of times.

[0062] The predetermined number of times (days) in the above (a) is not limited to a specific value. For example, it may be once (one day), or it may be two or more times (two or more days). Also, the predetermined period in the above (i) is not limited to a specific number of days. For example, it may be one day, or it may be two or more days.

[0063] Also, after watching the habit teaching video 121 a predetermined number of times, it may be made essential to watch the habit teaching video 121 at a predetermined cycle. The predetermined cycle is not limited to a specific period. For example, it may be three days, ten days, or one month or more.

[0064] After watching the habit teaching video 121 a predetermined number of times, it may be made essential to watch the habit teaching video 121 by setting by the administrator. For example, for workers who do not have the attitudes, actions, or appropriate attitudes and actions that are habitually preferred in a predetermined country from the perspective of the administrator, it may be made essential to watch the habit teaching video 121 by setting by the administrator. Examples of the administrator include those in a position to supervise work at the work site and those in a position to manage workers.

[0065] The setting by the administrator regarding the viewing of the habit teaching video 121 may be directly operated by the administrator on the information processing device 1 for each worker, or may be remotely performed by a device (for example, the administrator's portable information terminal) capable of communicating with the information processing device 1 for each worker via the communication network 9.

[0066] In the example shown in the figure, the habit teaching video 121 is stored in the storage unit 12. However, the habit teaching video 121 may be stored in a server (not shown). In this case, the information processing apparatus 1 and the server are connected so as to be able to communicate with each other via a communication network 9 including the Internet or the like. Then, the information processing apparatus 1 downloads and uses the habit teaching video 121 (and also text data and audio data) stored in the server.

[0067] (Work manual display unit) The work manual display unit 113 has a function of causing the display unit 14 to display at least one of characters and images (still images) of a predetermined work manual 122.

[0068] The work manual 122 is a material for explaining and teaching the content of work at the work site where the information processing apparatus 1 is used. The work manual 122 may be a material in which sorting and classification including, for example, work targets, work items, and work contents are used, and the contents of various works at each of various work sites are sorted and explained for each work.

[0069] The work target is, for example, equipment or devices as the target for carrying out work. Note that "one's own clothing" may be included as a work target, and a check of personal appearance may be included in the work manual 122.

[0070] The work item is a detail of the work to be carried out for each work target. A plurality of work items may be included for one work target (in other words, they may be associated and sorted).

[0071] The work content is the detailed content and explanation of the specific work for each work item.

[0072] Specifically, for example, when the information processing apparatus 1 is used by a worker in charge of cleaning work in a hotel or accommodation facility, the work manual 122 may include the content shown in FIG. 2.

[0073] In the example shown in FIG. 2, in the work manual 122, a sorting classification including the work target, work items, and work content is used to organize the content of the cleaning work in a hotel / accommodation facility.

[0074] In the example shown in FIG. 2, specifically, as work targets, it includes one's own clothing, collection work before entering the room and cleaning, the bed, the toilet, the bathtub / sink / bathroom, the interior of the room, and the setting and check-out of the facilities.

[0075] The work manual 122 includes at least one of text and images (still images) that explain and teach the content of the work at the work site.

[0076] When the work manual 122 includes text, the text of the work manual 122 is prepared as text data for each type of language that can be used in the information processing apparatus 1 (i.e., for each type of language whose list is displayed on the display unit 14 by the language selection unit 111) and stored in the storage unit 12.

[0077] The work manual display unit 113 refers to the type of language stored as the used language in the storage unit 12 by the language selection unit 111, selects the text data of the type of that language, and displays the text (as subtitles) on the display unit 14. In addition, when the work manual 122 also includes images, the text and images are displayed on the display unit 14.

[0078] The work manual 122 may also include voice. When the work manual 122 includes voice, the voice of the work manual 122 is prepared as voice data for each type of language that can be used in the information processing apparatus 1 (i.e., for each type of language whose list is displayed on the display unit 14 by the language selection unit 111) and stored in the storage unit 12.

[0079] In this case, the operation manual display unit 113 refers to the type of language stored in the storage unit 12 as the language to be used by the language selection unit 111, selects the voice data of the type of the language, and causes at least one of the characters and images (still images) of the operation manual 122 to be displayed on the display unit 14 and causes the voice to be output from the voice output unit 15.

[0080] Alternatively, an operation manual including voices for each type of language may be prepared in advance and stored in the storage unit 12. The operation manual display unit 113 refers to the type of language stored in the storage unit 12 as the language to be used by the language selection unit 111, selects the operation manual including the voice of the type of the language, and causes at least one of the characters and images (still images) to be displayed on the display unit 14 and causes the voice to be output from the voice output unit 15.

[0081] Note that in the example shown in the figure, the operation manual 122 is stored in the storage unit 12. However, the operation manual 122 may be stored in a server (not shown). In this case, the information processing apparatus 1 and the server are connected so as to be able to communicate with each other via a communication network 9 including the Internet or the like. Then, the information processing apparatus 1 downloads and uses the operation manual 122 (and voice data) stored in the server.

[0082] (Operation procedure video display unit) The operation procedure video display unit 114 has a function of causing the display unit 14 to display an operation procedure video 123 obtained by visualizing the content of the operation manual 122 (specifically, the content of the operation arranged in the operation manual 122).

[0083] The operation procedure video 123 is a video that visualizes at least a part of the content of the operation manual 122. The operation procedure video 123 may be, for example, a video that specifically explains and teaches the operation content of each operation item organized in the operation manual 122 by means of video for each operation item. In the example shown in FIG. 1, the operation procedure video 123 is represented as one block in the storage unit 12. However, for example, a plurality of operation procedure videos for each operation item may be stored in the storage unit 12.

[0084] The operation procedure video 123 may be in a mode of being played as a video, or may be in a mode such as a slide show in which still images (in other words, slides) are continuously displayed while being switched. In the description of the present invention, it is assumed that the electronic data in a mode such as a slide show in which still images (slides) are continuously displayed while being switched is also included in the operation procedure video 123.

[0085] The operation procedure video 123 includes at least one of subtitles and voice in addition to the image.

[0086] When the operation procedure video 123 includes subtitles, the subtitles of the operation procedure video 123 are prepared as text data for each type of language that can be used in the information processing apparatus 1 (that is, for each type of language for which a list is displayed on the display unit 14 by the language selection unit 111) and stored in the storage unit 12.

[0087] The operation procedure video display unit 114 refers to the type of language stored as the used language in the storage unit 12 by the language selection unit 111, selects the text data of the type of language, and displays subtitles together with the image of the operation procedure video 123 on the display unit 14.

[0088] Alternatively, operation procedure videos including subtitles for each type of language may be prepared in advance and stored in the storage unit 12. The operation procedure video display unit 114 refers to the type of language stored as the used language in the storage unit 12 by the language selection unit 111, and may select an operation procedure video including subtitles of the type of language and display the image and subtitles on the display unit 14.

[0089] When the operation procedure video 123 includes audio, the audio of the operation procedure video 123 is prepared as audio data for each type of language that can be used in the information processing apparatus 1 (that is, for each type of language for which a list is displayed on the display unit 14 by the language selection unit 111) and stored in the storage unit 12.

[0090] The operation procedure video display unit 114 refers to the type of language stored as the used language in the storage unit 12 by the language selection unit 111, selects the audio data of the type of that language, and causes the image of the operation procedure video 123 to be displayed on the display unit 14 and the audio to be output from the audio output unit 15.

[0091] Alternatively, operation procedure videos including audio for each type of language may be prepared in advance and stored in the storage unit 12, and the operation procedure video display unit 114 refers to the type of language stored as the used language in the storage unit 12 by the language selection unit 111, selects an operation procedure video including audio of the type of that language, and causes the image to be displayed on the display unit 14 and the audio to be output from the audio output unit 15.

[0092] As described above, for the operation procedure video 123, the type of language of at least one of the subtitle and the audio is the used language, and in this regard, the type of language of the operation procedure video 123 is the used language.

[0093] The operation procedure video 123 may be made mandatory to be viewed a predetermined number of times. Further, after viewing the predetermined number of times, viewing may be made mandatory at a predetermined period and / or by setting by an administrator.

[0094] Specifically, for example, when an operator starts using the information processing apparatus 1 (in other words, when starting to use a service realized by an information processing program), the operation procedure video 123 may be made mandatory to be viewed a predetermined number of times according to, for example, the following a or b.

[0095] a) When attempting to use a service realized by an information processing program at the start of daily work, it is essential to watch the operation procedure video 123 at the beginning of using the service until the service is used a predetermined number of times (in other words, days). b) During a predetermined period (days), it is essential to watch the operation procedure video 123 at least once a day. In this case, the number of days in the predetermined period corresponds to the number of times.

[0096] The predetermined number of times (days) in a) above is not limited to a specific value. For example, it may be once (one day), or it may be two or more times (two or more days). Also, the predetermined period in b) above is not limited to a specific number of days. For example, it may be one day, or it may be two or more days.

[0097] Also, after watching the operation procedure video 123 a predetermined number of times, it may be made essential to watch the operation procedure video 123 at a predetermined cycle. The predetermined cycle is not limited to a specific period. For example, it may be three days, ten days, or one month or more.

[0098] After watching the operation procedure video 123 a predetermined number of times, it may be made essential to watch the operation procedure video 123 by setting by the administrator. For example, for a worker who cannot perform the work as defined in the operation manual 122 as seen by the administrator, it may be made essential to watch the operation procedure video 123 by setting by the administrator. As the administrator, for example, a person in a position to supervise work at the work site can be cited.

[0099] The setting by the administrator regarding the viewing of the operation procedure video 123 may be directly operated by the administrator on the information processing device 1 for each worker, or it may be remotely performed by a device (for example, the administrator's mobile information terminal) capable of communicating with the information processing device 1 for each worker via the communication network 9.

[0100] In the example shown in the figure, the operation procedure video 123 is stored in the storage unit 12. However, the operation procedure video 123 may be stored in a server (not shown). In this case, the information processing apparatus 1 and the server are connected so as to be able to communicate with each other via a communication network 9 including the Internet and the like. Then, the information processing apparatus 1 downloads and uses the operation procedure video 123 (as well as text data and audio data) stored in the server.

[0101] (Operation evaluation unit) The operation evaluation unit 115 has a function of comparing a post-operation image obtained by imaging, by the imaging unit 16, the state after the operator has performed an operation with reference to the operation manual 122, with a model image obtained in advance by imaging in advance a model of the state when the operation is performed as defined in the operation manual 122, and evaluating the degree of coincidence between the post-operation image and the model image.

[0102] The comparison between the model image and the post-operation image is performed for the operations (specifically, for example, operation items) organized in the operation manual 122.

[0103] Therefore, the post-operation image is obtained by an operator who has learned the content of the operation with reference to the operation manual 122 and the operation procedure video 123 performing the operation for the operations organized in the operation manual 122, and imaging the state after the operation for each object on which the operation is to be performed for each operation.

[0104] The model image is prepared in advance as an image of the model after performing a predetermined operation according to the operation manual 122 for the operations organized in the operation manual 122. The model image is, that is, an image obtained by photographing the correct state (in other words, the state that should be) for each object on which the operation is to be performed for each operation when the operation is performed as defined in the operation manual 122.

[0105] The reference image may be prepared in correspondence with, for example, the work object and work item organized in the work manual 122. The reference image may be prepared for only one specific work object or work item organized in the work manual 122, or may be prepared for each of a plurality of work objects or work items organized in the work manual 122 (that is, a plurality of reference images may be prepared).

[0106] Specifically, for example, when the information processing apparatus 1 is used by a worker in charge of cleaning work in a hotel or accommodation facility, as the reference image, images of the correct state (in other words, the state that should be) of the bed, toilet, bath (bathroom) / washstand / bathroom, desk, and each part of the room when the work is performed as defined in the work manual 122 may be prepared.

[0107] As the reference image, specifically, images such as the following A to E when the work is performed as defined in the work manual 122 may be prepared.

[0108] A) An image of the correct state of the bed sheet Specifically, an image in which the folds, folding methods, and arrangement methods of the sheet can be clearly distinguished B) An image of the correct state of the toilet paper in the toilet Specifically, an image in which the folding method of the tip part of the toilet paper can be clearly distinguished C) An image of the correct state of the amenity set in the bathroom Specifically, an image in which the positions and orientations of the constituent articles of the amenity set can be clearly distinguished D) An image of the correct state of the tea set on the desk Specifically, an image in which the positions and orientations of the constituent articles of the tea set can be clearly distinguished

[0109] The reference image is recorded and stored in the reference image database 124 stored in the storage unit 12 after being associated with each of the operations organized in the operation manual 122. Information (for example, each combination of the operation target, operation item, and operation content organized in the operation manual 122) for specifying the reference image in association with each of the operations organized in the operation manual 122 is referred to as "operation specification information".

[0110] That is, in the reference image database 124, combined data of one set or a plurality of sets of operation specification information and reference images is recorded and stored. Note that a plurality of reference images may be combined for one piece of operation specification information.

[0111] The operation evaluation unit 115 reads out the reference image from the reference image database 124 stored in the storage unit 12 and uses it for comparison and evaluation with the post-operation image.

[0112] When the evaluation by the operation evaluation unit 115 is performed, first, a user of the information processing apparatus 1 (in other words, an operator in charge of a predetermined operation) selects, via the input unit 13, any one of the operations organized in the operation manual 122 (for example, any one of the combinations of the operation target, operation item, and operation content organized in the operation manual 122; that is, the operation specification information), and inputs that the said operation has been completed.

[0113] Next, as reference acquisition processing, the operation evaluation unit 115 specifies and reads out and acquires the reference image combined with the operation specification information selected by the user (operator) of the information processing apparatus 1 from among the combined data of the operation specification information and the reference image recorded and stored in the reference image database 124 stored in the storage unit 12.

[0114] Subsequently, as reference display processing, the operation evaluation unit 115 causes the reference image acquired by the reference acquisition processing to be displayed on the display unit 14.

[0115] FIG. 3 is a diagram showing an example of the reference image displayed on the display unit 14.

[0116] The operation evaluation unit 115 also starts the shooting by the imaging unit 16, and superimposes and displays on the display unit 14 the image captured by the imaging unit 16 (referred to as the "actual captured image") and the template image.

[0117] The operation evaluation unit 115, for example, superimposes and displays on the display unit 14 the template image with the background made transparent, that is, set and processed to be semi-transparent, on the actual captured image. At this time, the transmittance of the template image, that is, the degree of darkness / lightness, is adjustable, and the transmittance of the template image may be adjusted via the input unit 13 by the user so that both the template image and the actual captured image are easy to view.

[0118] The actual captured image captured by the imaging unit 16 may be displayed as a color image (RGB image), and the template image may be displayed as a grayscale image (luminance image) in a background-transparent state (semi-transparent).

[0119] On the display unit 14, the template image in a background-transparent state is fixedly displayed, and the shooting range of the actual captured image changes and is displayed according to the orientation and posture of the information processing apparatus 1 (specifically, the lens of the imaging unit 16).

[0120] FIG. 4 is a diagram showing an example in which the template image of FIG. 3 is superimposed and displayed on the actual captured image on the display unit 14. In FIG. 4, the black solid line represents the actual captured image, and the gray solid line represents the template image.

[0121] The user (operator) of the information processing apparatus 1 adjusts the orientation and posture of the information processing apparatus 1 (specifically, the lens of the imaging unit 16), the distance from the shooting target (specifically, the target on which the operation is performed), and the zoom magnification so that the actual captured image captured by the imaging unit 16 displayed on the display unit 14 matches the template image.

[0122] When the user (operator) of the information processing apparatus 1 presses the shutter of the imaging unit 16 (specifically, operates via the input unit 13) when the actual captured image captured by the imaging unit 16 and displayed on the display unit 14 matches or almost matches the reference image. Thereby, the post-operation image is acquired. The work evaluation unit 115 stores the captured image data of the post-operation image in the storage unit 12.

[0123] As an evaluation process, the work evaluation unit 115 performs image analysis on the reference image acquired by the reference acquisition process and the post-operation image stored in the storage unit 12, and compares the reference image with the post-operation image to evaluate the degree of matching.

[0124] The method for evaluating the degree of matching between two images by image analysis is not limited to specific procedures and methods. For example, any method may be selected after considering the accuracy of analysis and evaluation and the processing load on the control unit 11 (specifically, the central processing unit) due to the operations involved in the analysis. The method for evaluating the degree of matching between two images by image analysis may be a procedure or method that uses machine learning, or a procedure or method that does not use machine learning.

[0125] As a method for evaluating the degree of matching between two images, for example, the following methods a to c can be mentioned. When evaluating the degree of matching between two images, for the reference image, the original image (for example, a color image (RGB image)) without any settings or processing for being displayed on the display unit 14 by being superimposed on the actual captured image may be used.

[0126] a) A method of deriving a hash value of an image using Perceptual Hash, Difference Hash, etc. to measure the degree of matching of the images. b) A method of measuring the correlation value of an image to derive the correlation value of the image and measuring the degree of matching of the images. (e) A method of passing two images through the same convolutional neural network (CNN) and deriving the similarity of the outputs using cosine similarity or Euclidean distance to measure the degree of image matching.

[0127] The work evaluation unit 115 evaluates the degree of matching between the template image and the post-work image. For the two images, for example, the following evaluations of the degree of matching such as (a) to (e) may be performed.

[0128] (a) Evaluation of the state of the bed sheets Specifically, the degree of matching regarding the position and shape of the folds of the sheets, as well as the flatness of the sheets (i.e., no wrinkles or creases) is evaluated. (b) Evaluation of the state of the toilet paper in the toilet Specifically, the degree of matching regarding the position and shape of the fold at the tip of the toilet paper is evaluated. (c) Evaluation of the state of the amenity set in the bathroom Specifically, the degree of matching regarding the number, shape, position, and orientation of each component item of the amenity set is evaluated. (d) Evaluation of the state of the tea set on the desk Specifically, the degree of matching regarding the number, shape, position, and orientation of each component item of the tea set is evaluated.

[0129] In the comparison between the post-work image and the template image, it may be determined whether there is dirt on the object of work in the post-work image (for example, the glass surface or sash of the window on the floor, the upper surface of the desk, the bathtub curtain in the bathroom, the toilet bowl in the toilet).

[0130] Depending on the result of the evaluation by the work evaluation unit 115, specifically, depending on the degree of matching between the post-work image and the template image, it may be made essential to view the work procedure video 123.

[0131] For example, when the degree of matching between the post-operation image and the template image for a certain operation of a certain worker does not reach a predetermined level that is determined in advance, it may be made essential for the worker to view the operation procedure video 123 related to the operation.

[0132] In this case, the operation evaluation unit 115 may, for example, make it impossible to perform input operations such as the end of other operations unless the operation procedure video 123 related to the operation is viewed.

[0133] (Function and effect) According to the information processing apparatus 1 and the information processing program according to the embodiment, since the types of the habit teaching video 121, the characters of the operation manual 122, and the language of the operation procedure video 123 are the languages to be used, it is possible to appropriately educate foreign workers.

[0134] As described above, the embodiments of the present invention have been described. However, the specific configuration aspects of the present invention are not limited to the above embodiments, and forms in which modifications and changes within the scope not departing from the gist of the present invention are added to the above embodiments are also included in the present invention.

[0135] For example, in the above embodiment, the information processing apparatus 1 is provided with the habit teaching video display unit 112, the operation manual display unit 113, and the operation procedure video display unit 114. However, the information processing apparatus 1 may be provided with the habit teaching video display unit 112 while not being provided with the operation manual display unit 113 and the operation procedure video display unit 114, or may be provided with the operation manual display unit 113 and the operation procedure video display unit 114 while not being provided with the habit teaching video display unit 112.

[0136] Also, in the above embodiment, the information processing apparatus 1 is provided with the communication unit 17. However, the information processing apparatus 1 having the communication unit 17 is not an essential configuration in the present invention.

[0137] In the above-described embodiment, each functional unit is implemented in the control unit 11 of the information processing apparatus 1. However, an external server computer connected so as to be able to communicate with the information processing apparatus 1 via the communication network 9 may be configured to include at least a part of the functions provided in the information processing apparatus 1 in the above-described embodiment, and the processing in the above-described embodiment may be executed by an ASP (Application Service Provider) type service.

Explanation of Signs

[0138] 1 Information processing apparatus 11 Control unit 111 Language selection unit 112 Habit teaching video display unit 113 Work manual display unit 114 Work procedure video display unit 115 Work evaluation unit 12 Storage unit 121 Habit teaching video 122 Work manual 123 Work procedure video 124 Model image database 13 Input unit 14 Display unit 15 Sound output unit 16 Imaging unit 17 Communication unit 19 Bus 9 Communication network

Claims

1. A control unit and a display unit are provided. The control unit is A means for selecting a language from among a plurality of language varieties; A means for displaying a customs teaching video on the display unit, the customs teaching video being used to teach the customs of a specific country; The language type of the habit teaching video is the language used; 23. An information processing apparatus comprising:

2. A control unit and a display unit are provided. The control unit is A means for selecting a language from among a plurality of language varieties; a means for displaying at least one of characters and images of a predetermined operation manual on the display unit; a means for displaying a work procedure video on the display unit, the work procedure video being a visualization of the contents of the work manual; The language type of the characters and the work procedure video is the language used; 23. An information processing apparatus comprising:

3. A control unit and a display unit are provided. The control unit is A means for selecting a language from among a plurality of language varieties; A means for displaying a customs teaching video on the display unit, the customs teaching video being used to teach the customs of a specific country; a means for displaying at least one of characters and images of a predetermined operation manual on the display unit; a means for displaying a work procedure video on the display unit, the work procedure video being a visualization of the contents of the work manual; The language types of the habit teaching video, the text, and the work procedure video are the language used; 23. An information processing apparatus comprising:

4. The habit teaching video is, It is mandatory to watch it a certain number of times. After the predetermined number of viewings, viewing becomes mandatory at a predetermined interval and / or viewing becomes mandatory as set by an administrator; 4. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

5. The above-mentioned work procedure video is It is mandatory to watch it a certain number of times. After the predetermined number of viewings, viewing becomes mandatory at a predetermined interval and / or viewing becomes mandatory as set by an administrator; 4. The information processing apparatus according to claim 2, wherein the information processing apparatus is a computer.

6. The imaging unit further includes: The control unit is The apparatus further includes a means for comparing a post-task image captured by the imaging unit of a state after the worker has performed the work with a model image captured in advance of a model of the state when the worker performs the work according to the work manual, and evaluating a degree of agreement between the post-task image and the model image.

4. The information processing apparatus according to claim 2, wherein the information processing apparatus is a computer.

7. Depending on the degree of agreement between the post-task image and the model image, it becomes necessary to watch the work procedure video.

7. The information processing apparatus according to claim 6,

8. A program for causing an information processing device having a control unit and a display unit to execute information processing, A process of selecting a language from among a plurality of language types; A process of displaying a customs teaching video that teaches the customs of a predetermined country on the display unit; A process of displaying at least one of characters and images of a predetermined operation manual on the display unit; a process of displaying a work procedure video on the display unit, the work procedure video being a visualization of the contents of the work manual; The language types of the habit teaching video, the text, and the work procedure video are the language used; 2. An information processing program comprising:

Images