Multi-language navigation device, multi-language navigation system, and multi-language navigation program

Abstract

To provide a multi-language navigation device, a multi-language navigation system, and a multi-language navigation program which can provide a multi-language navigation operating instruction so that a presenter can give a navigation operating instruction meaningfully.SOLUTION: A navigation server 10 includes: terminal setting means for setting one of a plurality of terminal devices 30 to be a host terminal and the other terminal devices to be participant terminals; screen capturing means for capturing one of divided screens displayed in the host terminal as a navigation screen when a navigation operating instruction is being provided by using the divided screen; copy translation means for making a copy of the navigation screen, translating navigation letters to other navigation letters, and generating a translation navigation screen in which the display of the navigation letters are replaced by the display of the other navigation letters; and distribution means for distributing the translation navigation screen to each terminal device 30.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a multilingual navigation device, a multilingual navigation system, and a multilingual navigation program that enable a presenter to give participants operational instructions for navigation in multiple languages ​​in parallel. [Background technology]

[0002] Conventionally, there is known a technology related to a system (also called a conference system) in which a plurality of users can hold a conference (meeting), business negotiation, medical treatment, education, training, etc., in an online format while simultaneously referring to screen displays using their respective terminal devices. For example, Patent Document 1 discloses an online conference support device that promotes smooth two-way communication and supports efficient and appropriate output of results by eliminating the need for tasks such as setting and canceling screen sharing when each participant holds a conference while sharing their screen. Patent Document 2 also discloses an electronic conference control device that manages a split screen image generated from a common screen image shared at a plurality of locations and a screen image generated at each location in relation to the split screen image.

[0003] In a conventional conference system, a display screen may be divided into a plurality of areas in order for a plurality of users to simultaneously participate in a conference (meeting) etc. As a conventional technique related to screen division, for example, Patent Document 3 discloses a screen division display device that displays an operation screen in a desired divided area without the user being aware of whether each divided area of ​​the display screen is focused or not. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2022-74159 A [Patent Document 2] JP 2007-226352 A [Patent Document 3] JP 2018-128814 A Summary of the Invention [Problem to be solved by the invention]

[0005] Generally, multiple users participate in a conference system, and some users work in international business environments. In such cases, users of different nationalities often participate in the conference system, and the users may not have the necessary technical knowledge, or even if they have the necessary technical knowledge, they may only understand their native language and may not be familiar with the languages ​​necessary to communicate with other users. There are very few users who have the necessary technical knowledge and are familiar with multiple languages. For this reason, it is becoming more and more difficult for users working in international business environments to communicate using conventional conference systems.

[0006] In particular, in the field of software technology (including the field of technology using software), new software technologies are released in different languages ​​around the world, and users want to understand such technologies in their preferred language. However, when learning and understanding the new software technology, it is essential for engineers with different native languages ​​to communicate with each other, but due to language barriers, the desire to understand the new software technology in one's preferred language may not be realized.

[0007] When a user wants to learn about a new software technology from an engineer in another country and deepen his / her understanding, the above-mentioned conference system may be used. In this case, the engineer in the other country acts as a presenter and the user acts as a participant, and the explanation is given using a screen on the conference system that has icons, operation buttons, and other software-based facilities (also called software facilities).

[0008] In this case, even if the participants' native language is different from that of the presenter and the participants are unable to follow the presenter's on-screen instructions or explanations using the operation of software equipment (also referred to as operation instructions, and in this invention, the presenter's navigation of the participants (for example, the act of transmitting information such as guidance, direction, and instruction in a primarily one-way (but also partially two-way) manner from the presenter to the participants, and the operation instructions for navigation are also referred to as "navigation operation instructions") and fully understand the presenter's operation instructions, the presenter prefers to use his or her own native language. In that case, if a conventional conference system was used, there was a risk that the language barrier would prevent the participants from gaining a deeper understanding of the new software.

[0009] As described above, in conventional conference systems, due to the language barrier between users, there is a risk that the results of online conferences (meetings), business negotiations, classes, etc., cannot be fully achieved. In this regard, in the conventional conference support device disclosed in Patent Document 1, information such as voices uttered by each participant and texts inputted are translated into the language that each user can handle and outputted to each user in real time. However, when a navigation operation explanation is given, information is mainly transmitted in one direction from the presenter to the participants, so that the presenter wishes to give an explanation of the navigation operation while checking how the explanation is displayed on the user's terminal device in order to make the explanation meaningful, but this cannot be realized with the conventional conference support device. That is, in the conventional conference support device, each participant can only check the display in the language that he or she can handle while sharing the screen, so that the presenter cannot check the display in other languages. In addition, when the presenter, for example, inputs text in rapid succession, it is extremely difficult to accurately grasp which text input corresponds to which display.

[0010] The present invention has been made to solve the above-mentioned problems, and has an object to provide a multilingual navigation device, a multilingual navigation system, and a multilingual navigation program that enable navigation operation instructions to be given in multiple languages ​​and for presenters to provide meaningful explanations of navigation operation so that online conferences, business negotiations, guidance, classes, etc. can be fully achieved even when multiple users speaking different languages ​​participate. [Means for solving the problem]

[0011] In order to solve the above problems, the present invention provides a multilingual navigation device that is connected to a plurality of terminal devices using a display device via a network and provides each of the plurality of terminal devices with multilingual navigation using the display device, the multilingual navigation device including a terminal setting means for setting one of the plurality of terminal devices as a host terminal where a navigation operation explanation is given using the display device and all of the plurality of terminal devices other than the host terminal as participant terminals where the navigation operation explanation is viewed using the display device, a screen capture means for capturing one of the split screens as a navigation screen when a navigation operation explanation is given using one of the split screens that are displayed in two on the display device of the terminal device set as the host terminal, and a translation navigation screen that duplicates the navigation screen captured by the screen capture means, translates navigation characters that are characters included in the navigation screen into different navigation characters in a language different from the navigation language in which the navigation characters are translated, and replaces the display of the navigation characters with the display of the different navigation characters, and displays a translated navigation screen on the other split screen. a reproduction translation means for generating a translation navigation screen as shown in FIG. 1, a distribution means for distributing the translated navigation screen to the organizer terminal and all of the participant terminals and distributing the navigation screen to all of the participant terminals except the organizer terminal so that multilingual navigation is performed at the organizer terminal and all of the participant terminals using the navigation screen and the translated navigation screen, and a language selection means for selecting a organizer language used at the organizer terminal and a participant language which is a language used at each of the participant terminals, the reproduction translation means using the organizer language and the participant language selected by the language selection means as the navigation language and the other language, respectively, to translate navigation characters into other navigation characters and generate the translated navigation screen for each of the participant terminals, and the distribution means distributes all of the translated navigation screens generated by the reproduction translation means to the organizer terminals so that the translated navigation screens generated using the participant language selected at each of the participant terminals are displayed one by one on the other of the split screens of the organizer terminal.

[0012] It is preferable that the above multilingual navigation device further comprises a translation pattern setting means for setting a combination of the organizer language selected by the language selection means and the participant language as a translation pattern for each participant terminal, a translation pattern storage means for storing the translation pattern set by the translation pattern setting means, and a translation pattern storage control means for storing the translation pattern set by the translation pattern setting means in the translation pattern storage means, and the replication translation means determines the organizer language and the participant language in accordance with the translation pattern stored in the translation pattern storage means.

[0013] Furthermore, it is preferable to further have a layout change means for performing a layout change to change the size of the display area for the navigation characters to a size corresponding to the length of the alternative navigation characters when the length of the navigation characters differs from the length of the alternative navigation characters.

[0014] The present invention provides a multilingual navigation system having a plurality of terminal devices using a display device, and a multilingual navigation device that provides multilingual navigation using the display device to each of the plurality of terminal devices, the multilingual navigation device comprising: a terminal setting means for setting one of the plurality of terminal devices as an organizer terminal where a navigation operation explanation is given using the display device, and setting all of the plurality of terminal devices other than the organizer terminal as participant terminals where the navigation operation explanation is viewed using the display device; a screen capture means for capturing one of the split screens as a navigation screen when a navigation operation explanation is being given using one of the split screens that are split into two and displayed on the display device of the terminal device set as the organizer terminal; and a translation navigation screen that duplicates the navigation screen captured by the screen capture means, translates navigation characters contained in the navigation screen into different navigation characters in a language different from the navigation language in which the navigation characters are in, and replaces the display of the navigation characters with the display of the different navigation characters, and displays a translated navigation screen on the split screen. The multilingual navigation system includes a reproduction translation means for generating a translation navigation screen to be displayed on the other side of the split screen of the organizer terminal, a distribution means for distributing the translated navigation screen to the organizer terminal and all of the participant terminals and distributing the navigation screen to all of the participant terminals except the organizer terminal so that multilingual navigation is performed at all of the organizer terminals and participant terminals using the navigation screen and the translated navigation screen, and a language selection means for selecting a organizer language used at the organizer terminal and a participant language which is a language used at each of the participant terminals, the reproduction translation means using the organizer language and the participant language selected by the language selection means as the navigation language and the other language, respectively, to translate navigation characters into different navigation characters and generate the translated navigation screen for each of the participant terminals, and the distribution means distributes all of the translated navigation screens generated by the reproduction translation means to the organizer terminals so that the translated navigation screens generated using the participant language selected at each of the participant terminals are displayed one by one on the other side of the split screen of the organizer terminal.

[0015] In the above-mentioned multilingual navigation system, it is preferable that the multiple terminal devices have display control means that executes display control such that one of the split screens displayed on each display device is an organizer screen on which navigation operation instructions are given, and the other is a participant screen on which the navigation operation instructions are viewed.

[0016] In addition, it is preferable that a screen selection means is further provided for causing a terminal device set as an organizer terminal among the terminal devices to select one of the translation navigation screens distributed by the distribution means as a selected translation navigation screen to be displayed on the participant screen, and that the display control means performs display switching so that the translation navigation screen selected using the screen selection means is displayed on the participant screen.

[0017] The present invention provides a multilingual navigation program for causing a computer to function as a multilingual navigation device that is connected via a network to a plurality of terminal devices using a display device and provides multilingual navigation using the display device to each of the plurality of terminal devices, the program including a terminal setting means for setting the computer to one of the plurality of terminal devices as a host terminal where a navigation operation explanation is given using the display device and all of the plurality of terminal devices other than the host terminal as participant terminals where the navigation operation explanation is viewed using the display device, a screen capture means for capturing one of the split screens as a navigation screen when a navigation operation explanation is being given using one of the split screens displayed in two on the display device of the terminal device set as the host terminal, and a translation navigation means for duplicating the navigation screen captured by the screen capture means, translating navigation characters that are characters included in the navigation screen into different navigation characters in a language different from the navigation language in which the navigation characters are written, and replacing the display of the navigation characters with the display of the different navigation characters. a reproduction translation means for generating a translation screen so that the translation screen is displayed on the other side of the split screen, a distribution means for distributing the translated navigation screen to the organizer terminal and all of the participant terminals and distributing the navigation screen to all of the participant terminals except the organizer terminal so that multilingual navigation is executed at the organizer terminal and all of the participant terminals using the navigation screen and the translated navigation screen, and a language selection means for selecting a organizer language used at the organizer terminal and a participant language which is a language used at each of the participant terminals, the reproduction translation means using the organizer language and the participant language selected by the language selection means as the navigation language and the other language, respectively, to translate navigation characters into different navigation characters and generate a translated navigation screen for each of the participant terminals, and the distribution means for distributing all of the translated navigation screens generated by the reproduction translation means to the organizer terminals so that the translated navigation screens generated using the participant language selected at each of the participant terminals are displayed one by one on the other side of the split screen of the organizer terminal.

[0018] The present invention is a multilingual navigation program for causing a computer to function as a multilingual navigation device that provides multilingual navigation using a display device to one or more terminal devices using a display device and connected via a network, the computer comprising a terminal setting means for setting one of the plurality of terminal devices as an organizer terminal where a navigation operation explanation is given using the display device and all of the plurality of terminal devices other than the organizer terminal as participant terminals where the navigation operation explanation is viewed using the display device, a screen capture means for capturing one of the split screens as a navigation screen when the navigation operation explanation is being given using one of the split screens displayed in two on the display device of the terminal device set as the organizer terminal, and a navigation screen captured by the screen capture means for duplicating the navigation screen and translating navigation characters contained in the navigation screen into different navigation characters in a language different from the navigation language in which the navigation characters are written, a duplication translation means for generating a translated navigation screen in which the display of navigation characters is replaced with the display of alternative navigation characters to be displayed on the other side of the split screen, a distribution means for distributing the translated navigation screen to the organizer terminal and all of the participant terminals and distributing the navigation screen to all of the participant terminals excluding the organizer terminal so that multilingual navigation is performed at the organizer terminal and all of the participant terminals using the navigation screen and the translated navigation screen, and a language selection means for selecting a organizer language used at the organizer terminal and a participant language which is a language used at each of the participant terminals, the duplication translation means using the organizer language and the participant language selected by the language selection means as the navigation language and the alternative language, respectively, to translate the navigation characters into the alternative navigation characters to generate a translated navigation screen for each of the participant terminals, and the distribution means for displaying the translated navigation screens generated using the participant language selected at each of the participant terminals one by one on the other side of the split screen at the organizer terminal,A multilingual navigation program is provided that distributes all translated navigation screens generated by the duplication translation means to the organizer terminal.

[0019] In addition, in the multilingual navigation program, it is preferable that the computer further functions as a translation pattern setting means for setting a combination of the organizer language selected by the language selection means and the participant language as a translation pattern for each participant terminal, and a translation pattern storage control means for storing the translation pattern set by the translation pattern setting means in the translation pattern storage means, and the replication translation means determines the organizer language and the participant language in accordance with the translation pattern stored in the translation pattern storage means. Effect of the Invention

[0020] As described above in detail, the present invention provides a multilingual navigation device, a multilingual navigation system, and a multilingual navigation program that enable navigation operation instructions to be given in multiple languages ​​and that enable a presenter to give meaningful navigation operation instructions. [Brief description of the drawings]

[0021] [Figure 1] 1 is a system configuration diagram of a multilingual navigation system including a navigation server according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram mainly showing the internal configuration of a navigation server. [Diagram 3] FIG. 2 is a block diagram showing the internal configuration of a member terminal device. [Figure 4] 2 is a system configuration diagram of a business management system constructed in a navigation server. [Diagram 5] FIG. 2 is a functional block diagram showing the main configuration of a software development management module constituting the business management system and a member terminal device. [Figure 6]FIG. 2 is a functional block diagram showing the main configuration of a multilingual navigation module built in a dialog work process of a software development management module. [Figure 7] FIG. 2 is a functional block diagram showing the main configuration of a multilingual navigation module built in a background work process of the software development management module. [Figure 8] 13 is a process chart showing, in chronological order, the operation procedures of a translation and duplication distribution process included in the multilingual navigation process. [Figure 9] FIG. 1A is a diagram showing member terminal devices constituting a multilingual navigation system together with the languages ​​designated for each of them, and FIG. 1B is a diagram showing a case in which two languages ​​are designated for each of the member terminal devices. [Figure 10] FIG. 1A is a diagram showing an example of a split screen displayed on a member terminal device constituting a multilingual navigation system, and FIG. 1B is a diagram showing another split screen. [Figure 11] 10 is a flowchart showing an example of an operation procedure of a navigation preparation process. [Figure 12] 13 is a flowchart showing an example of an operation procedure of a multilingual navigation process. [Figure 13] FIG. 1A shows a list of languages ​​that can be selected as the host language and the participant language, and FIG. 1B shows an example of a translation pattern stored in a translation pattern storage means. [Figure 14] 13 is a process chart showing a time series of an operation procedure of a duplicate translation and distribution process according to a modified example. [Figure 15] FIG. 13 is a diagram showing an example of a split screen displayed on each terminal device when multilingual navigation is provided. [Figure 16] FIG. 1 is a diagram showing an example of a case where a screen is shared in a conventional conference support system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Note that the same elements are designated by the same reference numerals, and duplicated explanations will be omitted.

[0023] (Overall configuration of the multilingual navigation system) First, the configuration of a multilingual navigation system 1 including a multilingual navigation server 10 according to an embodiment of the present invention will be described.

[0024] Figure 1 is a system configuration diagram of a multilingual navigation system 1. As shown in Figure 1, the multilingual navigation system 1 has a multilingual navigation server (hereinafter also referred to as "navigation server") 10 and multiple member terminal devices 30 (mobile member terminal devices 30A, 30B, 30C, 30D, and 30E in Figure 1) operated by members who use the multilingual navigation described below, which are connected to each other via the Internet N1.

[0025] The navigation server 10 processes data according to a multilingual navigation program and provides multilingual navigation to each of the member terminal devices 30A, 30B, 30C, 30D, and 30E. The multilingual navigation is realized by applying the present invention. All participating members can use the multilingual navigation by using the respective member terminal devices 30A, 30B, 30C, 30D, and 30E. Multilingual navigation means navigation in which navigation operation instructions are given in parallel in two or more languages ​​(also called multiple languages). In multilingual navigation, a presenter gives navigation operation instructions in a language of his / her choice, and all participating members can view and listen to the navigation operation instructions in their own language of choice.

[0026] The member terminal device 30 receives and transmits data to and from the navigation server 10 .

[0027] In the multilingual navigation system 1, the navigation server 10 executes the following processes a), b), and c). a) A copy of the navigation screen displayed on the member terminal device 30 (liquid crystal display unit 35) of the presenter who is providing the navigation operation explanation b) The navigation text included in the navigation screen is translated from the presenter's specified presenter language (host language) to a different navigation text in the participant's language to generate a translated navigation screen. c) Distributing the translation navigation screen to each member terminal device 30

[0028] In the multilingual navigation system 1, when a participant of the member terminal device 30A gives a navigation operation explanation as a presenter, the navigation screen displayed on the display device (liquid crystal display unit 35) of the member terminal device 30A is captured in real time and copied according to the number of member terminal devices 30 (30B, 30C, 30D, 30E) used by the other participants. At that time, the characters (navigation characters) included in the captured navigation screen are translated from the presenter language to the language (participant language) specified by the other participant (Attendee), and a translated navigation screen is generated. The translated navigation screen is distributed to the member terminal devices 30 (30B, 30C, 30D, 30E) used by the participants. Then, each participant can view the navigation operation explanation while visually checking the characters in the participant language specified by himself / herself. Therefore, in the multilingual navigation system 1, there is no decrease in efficiency due to differences in language, and the results of online conferences (meetings), business negotiations, lessons, etc. can be fully achieved. In addition, all of the translated navigation screens generated for each member terminal device 30 (30B, 30C, 30D, 30E) are distributed to the organizer terminal (member terminal device 30A), and a participant at member terminal device 30A selects one of the distributed translated navigation screens to display on liquid crystal display unit 35. The participant at member terminal device 30A (presenter) can provide an explanation of the navigation operation while checking all of the translated navigation screens one by one.

[0029] (Configuration of navigation server 10) Next, the configuration of the navigation server 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing mainly the internal configuration of the navigation server 10.

[0030] The navigation server 10 has a central processing unit (CPU) 11, a read only memory (ROM) 12, and a random access memory (RAM) 13. The CPU 11 operates according to a program stored in the ROM 12, and inputs data obtained by operating a keyboard 19 or a mouse 20 via a keyboard controller (KBC) 17 through a main bus 19A, while inputting and outputting signals with other components, thereby controlling the operation of the entire navigation server 10. A business management system 99, which will be described later, is built in the navigation server 10, and the business management system 99 includes a software development management module 101 incorporating multilingual navigation modules 130 and 140. The CPU 11 executes various processes according to the business management system 99. The ROM 12 stores a basic input / output system (BIOS), a control program, and permanent data. The RAM 13 stores data used when the CPU 11 operates, and programs such as the business management system 99.

[0031] In addition, the navigation server 10 includes a hard disk drive (HDD) 14 , a communication control unit 15 , a communication processing unit 16 , and a video controller 18 .

[0032] The hard disk drive 14 stores middleware such as an OS (Operating System), a business management system 99, and a Web server program. The hard disk drive 14 also stores programs such as the business management system 99, a database (DB) shown in Fig. 4 that is required for executing the programs, and other storage units, DBs, and files.

[0033] The communication control unit 15 operates according to instructions from the CPU 11 to control connection and disconnection of lines for communication with the member terminal devices 30 and a server (not shown). The communication processing unit 16 operates according to instructions from the communication control unit 15 to transmit and receive data via the Internet N1.

[0034] The video controller 18 controls image display on a display device (not shown) to display screens used for various settings.

[0035] (Business Management System) In the navigation server 10, necessary programs are installed, various databases are formed, and so on, to construct a business management system 99. The business management system 99 is constructed using an integrated information system for Enterprise Resource Planning (ERP) (also called an "ERP system", for example, a solution system provided by SAP Inc. (SAP is a registered trademark)). FIG. 4 is a system configuration diagram of the business management system 99 constructed in the navigation server 10. The illustrated business management system 99 is a system for managing software development work in a software development company, and includes a software development management module 101 having a function as an application server in the ERP system, and a human resources management module 102.

[0036] 4, in the business management system 99, a software development management module 101 and a human resources management module 102 each access a dictionary DB 105, a translation pattern TBL 106, a development management master 107, and a human resources management master 108 under the control of a database management system, and execute processes such as updating their respective data. The multilingual navigation program according to this embodiment is incorporated in the software management development module 101 as multilingual navigation modules 130 and 140, which will be described later.

[0037] The dictionary DB 105 stores dictionary data used for translating navigation characters, which will be described later. The dictionary data stores dictionary data using languages ​​that can be specified as presenter languages ​​or participant languages ​​(in this embodiment, five languages: English, Japanese, Chinese, Korean, and German). The translation pattern table 106 (TBL) is a translation pattern storage means, and stores translation patterns, which will be described later. The development management master 107 and the personnel management master 108 store data used for software development management and in-house personnel management, respectively.

[0038] (Software Development Management Module) 5, the software development management module 101 has a dispatcher 121, a gateway 122, a dialog work process 123, an update work process 124, an enqueue work process 125, a background work process 126, and a spool work process 127. Of these, the dialog work process 123 and the background work process 126 incorporate multilingual navigation modules 130 and 140, which will be described later, respectively.

[0039] The dispatcher 121 accepts operations using a GUI (Graphical User Interface) (mouse operations, keyboard operations, also called screen operations) from each member terminal device 30 (30A, 30B, 30C, 30D, 30E). The dispatcher 121 calls a work process (corresponding work process) according to the accepted processing content from the work processes 123 to 127 while controlling the use of the CPU 11 in a time-sharing manner, and assigns execution rights. When a large amount of screen operations is input from each member terminal device 30 (30A, 30B, 30C, 30D, 30E) but all of the work processes 123 to 127 are in use, the dispatcher 121 puts the processing into a standby state until each of the work processes 123 to 127 becomes available. The gateway 122 executes mutual communication between management modules (in the case of FIG. 4, the software development management module 101 and the personnel management module 102).

[0040] The dialogue work process 123 executes front-end processing such as screen display, data input through screen operations, instruction input, and display change according to screen operations. As shown in Fig. 6, the dialogue work process 123 incorporates a multilingual navigation module 130, which will be described later.

[0041] The update work process 124 executes data updates in response to database update requests. The enqueue work process 125 executes processing to lock the relevant data when the update work process 124 executes database update processing. The background work process 126 executes data processing that does not require screen operations or screen displays. As shown in FIG. 7, the background work process 126 incorporates a multilingual navigation module 140, which will be described later. The spool work process 127 executes print processing by, for example, passing the data stored in the database to a printer (not shown).

[0042] (Multilingual navigation module) The multilingual navigation module 130 can be formed, for example, by adding it to the dialog work process 123 through add-on development. As shown in Fig. 6, the multilingual navigation module 130 has a screen display control unit 131, a translation pattern setting unit 132, a navigation screen capture unit 133, a navigation screen delivery unit 134, a translated navigation screen acquisition unit 135, and a translated navigation screen distribution unit 136.

[0043] The screen display control unit 131 is a part that executes processes required for screen display of each member terminal device 30 (30A, 30B, 30C, 30D, 30E), and has an initial screen display unit 131a. The initial screen display unit 131a displays an initial input screen required for initial setting of the multilingual navigation on each member terminal device 30 (30A, 30B, 30C, 30D, 30E).

[0044] The translation pattern setting unit 132 sets a translation pattern, which will be described later, and stores the set translation pattern in the translation pattern table 106. The navigation screen capture unit 133 captures in real time (performs screen capture) a screen (corresponding to the "navigation screen" of the present invention) displayed on a host screen 156, which will be described later, on the liquid crystal display unit 35 of the presenter terminal device (member terminal device 30A) when the navigation operation explanation is being given on the presenter terminal device (member terminal device 30A). The navigation screen delivery unit 134 delivers the navigation screen captured by the navigation screen capture unit 133 to the navigation screen acquisition unit 142 of the multilingual navigation module 140. The translation navigation screen acquisition unit 135 acquires a translation navigation screen, which will be described later, from the translation navigation screen delivery unit 145 of the multilingual navigation module 140. The translation navigation screen distribution unit 136 has a function as a distribution means, and distributes the acquired translation navigation screen to the host terminal (member terminal device 30A) and the corresponding member terminal devices 30B, 30C, 30D, and 30E. At this time, the translated navigation screen distribution unit 136 distributes all of the translated navigation screens generated by the navigation screen translation / replacement unit 144 (described later) and acquired by the translated navigation screen acquisition unit 135 to the member terminal device 30A (host terminal) (for example, online storage is used at this time). When distributing the translated navigation screen to the member terminal devices 30B, 30C, 30D, and 30E, the translated navigation screen distribution unit 136 also distributes the navigation screen (see FIG. 8). As a result, multilingual navigation is executed in the member terminal devices 30A, 30B, 30C, 30D, and 30E using the navigation screen and the translated navigation screen.

[0045] The multilingual navigation module 140 can be formed, for example, by adding it to the background work process 126 through add-on development. As shown in Fig. 7, the multilingual navigation module 140 has a translation pattern reading unit 141, a navigation screen acquisition unit 142, a navigation screen duplicating unit 143, a navigation screen translation / replacement unit 144, and a translated navigation screen delivery unit 145.

[0046] The translation pattern reading unit 141 reads the translation pattern stored in the translation pattern TBL 106 from the translation pattern TBL 106. The navigation screen acquisition unit 142 acquires the navigation screen from the navigation screen delivery unit 134. The navigation screen duplication unit 143 duplicates the acquired navigation screen a number of times according to the number of member terminal devices 30 (30B, 30C, 30D, 30E) serving as participant terminals. The navigation screen translation / replacement unit 144, together with the navigation screen duplication unit 143, functions as a duplication translation means according to the present invention, and executes the following processes a), b), and c): a) for each of the duplicated navigation screens, extracts the characters (navigation characters) contained therein; b) translates the characters (navigation characters) into different navigation characters in a language different from the language of the characters (navigation language). In this case, the navigation screen translation / replacement unit 144 uses the organizer language and each participant language as the navigation language and the different language, respectively. c) For each navigation screen, the display of the included characters (navigation characters) is replaced with the display of characters in the translated participant language (another navigation characters) to generate a translated navigation screen. The translated navigation screen delivery unit 145 delivers the translated navigation screen to the translated navigation screen acquisition unit 135. In the above b) and c), the navigation screen translation / replacement unit 144 determines the organizer language and each participant language according to a translation pattern stored in the translation pattern TBL 106 described later. The above characters (navigation characters) are translated from the determined organizer language to characters in the participant language (another navigation characters). The translation of the navigation characters is performed for the purpose of changing the display of characters on the navigation screen from the organizer language to the participant language. Commands used for computer control (e.g., "cd", "dir", "ipconfig", etc.) may be displayed as is without being translated, or only the display on the screen may be changed from the organizer language to the participant language (without changing the command itself to eliminate any effect on computer control).

[0047] (Configuration of Member Terminal Device 30) As shown in FIG. 1, the member terminal device 30 has a connection environment to the Internet N1 and can communicate with the navigation server 10. In this embodiment, the member terminal devices 30 (30A, 30B, 30C, 30D, 30E) are mobile, and are assumed to be portable notebook personal computers having a liquid crystal display unit 35 as a display device. The member terminal devices 30 (30A, 30B, 30C, 30D, 30E) correspond to a plurality of terminal devices using the liquid crystal display unit 35, but the member terminal device 30 may be a fixed terminal device, such as a stationary personal computer, to which a separate liquid crystal display device (not shown) is connected and used. The member terminal device 30 may also be, for example, a highly functional mobile phone (also called a smartphone) or a tablet-type terminal device.

[0048] 3, the member terminal device 30 has a CPU 31, a ROM 32, a RAM 33, a data storage unit 34, and a liquid crystal display unit 35. The member terminal device 30 also has a voice conversion processing unit 36, a communication control unit 37, a communication processing unit 38a, a wireless communication unit 38b, a speaker 39, and a microphone 40. A GUI (Graphical User Interface, also called ERP GUI, e.g. SAP GUI for Windows, SAP GUI for Java (Windows and Java are registered trademarks)) used in the ERP system is installed in the member terminal device 30. By using the ERP GUI, each member can use the ERP system by operating the screen displayed on the liquid crystal display unit 35 using a mouse or keyboard (also called screen operation), and can use multilingual navigation.

[0049] Moreover, the ERP GUI installed in each member terminal device 30 incorporates a split screen generating unit that generates split screen 155 (or split screen 158) described below, and a display control unit that displays split screen 155 (or split screen 158). Furthermore, member terminal device 30 may have a split pattern determining unit that determines the split pattern when a split screen is formed according to data specified by a member. The split pattern is a pattern (mode) when the display screen is divided, and can be specified as either the pattern of split screen 155 (upper / lower split pattern) or the pattern of split screen 158 (left / right split pattern). Then, the display control unit can display split screen 155 or split screen 158 according to the split pattern determined by the split pattern determining unit.

[0050] The CPU 31 operates according to a program stored in the ROM 32 and controls the overall operation of the member terminal device 30. The ROM 32 stores a control program executed by the CPU 31. The RAM 33 stores a communication control program for performing data communication, data necessary for the CPU 31 to execute the program, and the like.

[0051] The data storage unit 34 stores various data and application programs. The liquid crystal display unit 35 has an LCD (Liquid Crystal Display) and a drive unit, and is an image display unit that displays images such as characters, figures, and symbols. The voice conversion processing unit 36 ​​expands voice data and outputs it to the speaker 39, while converting and compressing an analog voice signal input from the microphone 40 into digital voice data and inputting it to the communication processing unit 38a. The communication control unit 37 operates upon instruction from the CPU 31 and controls connection and disconnection of a line for data communication. The communication processing unit 38a operates according to instructions from the communication control unit 37 and executes data transmission and reception via the Internet N1. The wireless communication unit 38b is a wireless communication unit that executes data transmission and reception by wireless according to the control of the communication control unit 37. The speaker 39 is a voice output unit that outputs voice, and the microphone 40 inputs voice such as the contents of a user's conversation and converts it into an electric signal.

[0052] Then, the CPU 31 executes processing according to screen operations for multilingual navigation in accordance with the ERP GUI.

[0053] In the multilingual navigation system 1, the navigation server 10 executes a multilingual navigation process described later, thereby providing multilingual navigation to the member terminal devices 30A, 30B, 30C, 30D, and 30E. When the multilingual navigation is provided, in a navigation preparation process described later, one of the member terminal devices 30A, 30B, 30C, 30D, and 30E (in this embodiment, the member terminal device 30A) is set as a presenter terminal (host terminal in the present invention), and the other terminal devices (in this embodiment, the member terminal devices 30B, 30C, 30D, and 30E) except for the member terminal device 30A are set as participant terminals. In the member terminal device 30A set as the presenter terminal, a navigation operation explanation is given using the liquid crystal display unit 35.

[0054] When the multilingual navigation process is executed in the multilingual navigation system 1, the navigation server 10 executes a navigation preparation process in accordance with the flowchart shown in FIG.

[0055] (Navigation preparation process) In the navigation server 10, all members, including the presenter, can use their name and password to log in to the multilingual navigation system 1. After logging in, when any of the members clicks on the icon of the multilingual navigation system 1, the navigation server 10 starts a navigation preparation process.

[0056] When the navigation preparation process is started, the CPU 11 advances the process to step 1 and operates as a terminal setting means to set the presenter terminal and the participant terminal (terminal device on which the navigation operation explanation is viewed). At this time, the initial screen display unit 131a of the screen display control unit 131 is operated to display an initial input screen (not shown) on the liquid crystal display unit 35 of each member terminal device 30 (30A, 30B, 30C, 30D, 30E). In step 1, the presenter terminal and the participant terminal are set by each team member using the initial input screen.

[0057] Next, when the process proceeds to step 2, the CPU 11 operates as a language selection means and executes a presenter language selection process. The CPU 11 causes the presenter language to be selected using a GUI (Presenter GUI 41A, see FIG. 5) in the member terminal device 30A. In the multilingual navigation system 1, one of Japanese, English, Chinese, Korean, and German is selected as the presenter language. When the process proceeds to the next step 3, it is determined whether or not the attendee language selection process is being executed. If the attendee language selection process is being executed, the process proceeds to step 4, where the processes of the member terminal devices 30B, 30C, 30D, and 30E of the team members (participants, Attendees) who are executing the attendee language selection process are blocked (by the enqueue work process 125), and then the process returns to step 3. If the participant language selection process has not been executed, the process proceeds to step 5, where the CPU 11 operates as a language selection means and executes the participant language selection process using GUI 41B, GUI 41C, GUI 41D, and GUI 41E to allow the participant language to be selected.

[0058] Next, the process proceeds to step 6, where it is determined whether the participant language selection process for all participants has been completed. If the selection process is completed, the process proceeds to step 7, but if not, the process returns to step 3. In step 7, a translation pattern setting process is executed, and then in step 8, a translation pattern acquisition process is executed, and the process proceeds to step 9, where the process waits until the display of the split screen is completed in each of the member terminal devices 30A, 30B, 30C, 30D, and 30E. Although not shown, in step 6, if the participant language selection process for all participants has not been completed before a predetermined time (e.g., one minute) has elapsed, the language of the participant for whom the selection process was not executed may be set as the host language.

[0059] In the translation pattern setting process, the CPU 11 operates as a translation pattern setting means and a translation pattern storage control means. In this case, the combination of the host language and participant language selected by the CPU 11 executing steps 2 to 5 is set as a translation pattern for each participant terminal (member terminal devices 30B, 30C, 30D, 30E), and the set translation pattern is stored in the translation pattern TBL 106 under the control of the CPU 11.

[0060] As described above, in the multilingual navigation system 1, Japanese, English, Chinese, Korean, and German are set as languages ​​that can be selected by members. Therefore, as shown in FIG. 13(A), 20 language patterns are prepared for any two of these languages. For example, as shown in FIG. 9(A), if English is selected as the organizer language in the member terminal device 30A (organizer terminal) and Japanese is selected in the member terminal device 30B (participant terminal), the translation pattern for the member terminal device 30B is set to "EJ" as shown in FIG. 13(B). In this case, the translation pattern "EJ" is the translation pattern for the member terminal device 30B, and needs to be differentiated from the translation patterns for the other member terminal devices 30C, 30D, and 30E. Therefore, the "B" for the member terminal device 30B is added, and the translation pattern is stored as "BEJ" in the translation pattern TBL 106 (the same applies to the other member terminal devices 30C, 30D, and 30E).

[0061] On the other hand, after the navigation preparation process is started, in the member terminal devices 30A, 30B, 30C, 30D, and 30E, a split screen 155 or a split screen 158, which will be described later, is displayed on each display device (liquid crystal display unit 35) by a split screen display control process.

[0062] Then, when the display of the split screen 155 or the split screen 158 is completed in the member terminal devices 30A, 30B, 30C, 30D, and 30E, the process proceeds to step 10 in Fig. 11, where the multilingual navigation process described later is executed. After that, the navigation preparation process ends.

[0063] Once the presenter terminal and participant terminal are set and the host language and participant language are selected for each, the languages ​​used in each member terminal device 30A, 30B, 30C, 30D, and 30E can be, for example, English (host language), Japanese, Chinese, Korean, and German (participant language), as shown in Figure 9 (A).

[0064] As shown in FIG. 10(A), the split screen 155 is a screen that is split into two and displayed on each liquid crystal display unit 35, and has a host screen 156 and a participant screen 157. The host screen 156 is a screen on which the presenter gives an explanation of the navigation operation. The host screen 156 during the explanation of the navigation operation is captured as the navigation screen. The participant screen 157 is a screen on which the explanation of the navigation operation is mainly viewed by each participant (member), and displays a translated navigation screen using each participant's language. The split screen 155 allows the presenter to mainly view the navigation screen and the translated navigation screen while comparing them side by side. In FIG. 10(A), the size of the display area of ​​the host screen 156 is equal to the size of the display area of ​​the participant screen 157. The host screen 156 and the participant screen 157 each have a combo box 155a, a toolbar 155b, and a language display unit 155c.

[0065] The split screen 155 in FIG. 10(A) is split into two, vertically, but as shown in FIG. 10(B), it can also be split into two horizontally, into a split screen 158. The split screen 158 has a host screen 159 and a participant screen 160. The host screen 159 and the participant screen 160 each have a combo box 155a, a toolbar 155b, and a language display section 155c. The host screen 159 displays a navigation screen, similar to the host screen 156. The participant screen 160 displays a translation navigation screen, similar to the participant screen 157. Both of FIGS. 10(A) and (B) show host screens 157 and 160 displayed on the member terminal device 30B as an example.

[0066] In the illustrated split screen 155, the display area of ​​the organizer screen 156 and the display area of ​​the participant screen 157 are the same size, but the display area of ​​the organizer screen 156 and the display area of ​​the participant screen 157 may be different in size (for example, the display area of ​​the organizer screen 156 is larger than the display area of ​​the participant screen 157).

[0067] (Multilingual navigation processing) In the navigation server 10, the CPU 11 executes the multilingual navigation process according to the flowchart shown in Fig. 12. When the CPU 11 starts the multilingual navigation process, the process proceeds to step 11 and waits until an operation input is made using the presenter screen (Presenter screen), and when an operation input is made using the presenter screen (Presenter screen), the process proceeds to step 12 and a duplicate translation distribution process, which will be described later, is executed. Thereafter, the process proceeds to step 13, where it is determined based on the operation input on the presenter screen (based on data entered by the operation input using the presenter screen) whether or not an instruction to end navigation has been given. If an instruction to end navigation has been given, the multilingual navigation process ends, but if no instruction to end navigation has been given, the process returns to step 11.

[0068] (Replication translation distribution process) Then, the multilingual navigation modules 130 and 140 operate according to the procedure shown in the process chart of FIG. 8, thereby executing the duplicate translation and distribution process.

[0069] The multilingual navigation modules 130 and 140 execute a duplicate translation distribution process when there is an operation input using the presenter screen (mouse operation on the presenter screen, input processing using a keyboard, etc.). FIG. 8 shows a schematic process procedure when duplicate translation distribution processes Nt1 and Nt2 are executed in order. The duplicate translation distribution process Nt1 is a process when there is character input on a combo box together with mouse operation when a navigation operation explanation is being given using the presenter screen (Presenter screen). The duplicate translation distribution process N2 shows a process when there is text input by keyboard operation together with mouse operation when a navigation operation explanation is being given using the presenter screen (Presenter screen). In the duplicate translation distribution process Nt1, the navigation screen B1 is captured, and in the duplicate translation distribution process Nt2, the navigation screen T1 is captured, but since both are common processes, the duplicate translation distribution process will be mainly explained using the duplicate translation distribution process Nt1 as an example.

[0070] When the presenter is using the organizer screen to explain navigation operations and inputs characters into the combo box along with mouse operations, the navigation screen capture unit 133 of the multilingual navigation module 130 captures in real time, as the navigation screen B1, a screen including the movement of the mouse pointer according to the mouse operations of the presenter. Next, the navigation screen delivery unit 134 delivers the navigation screen B1 to the navigation screen acquisition unit 142 of the multilingual navigation module 140 via the dispatcher 121 (delivery i0 in FIG. 8).

[0071] Then, when the navigation screen acquisition unit 142 acquires the navigation screen B1, the navigation screen duplication unit 143 duplicates the navigation screen B1 a number of times (four times in this embodiment) corresponding to the number of participant terminals (member terminal devices 30B, 30C, 30D, 30E).

[0072] Next, the navigation screen translation / replacement unit 144 executes the following processes a), b), and c) for the navigation screen B1. a) For each of the duplicated navigation screens B1, extract the characters contained therein (for example, an optical character reader). b) Determine the organizer language and each participant language according to the translation pattern stored in the translation pattern TBL 106, and translate the characters therein (in this case, the characters entered in the combo box, which correspond to the navigation characters) into characters in each participant language (separate navigation characters). c) For each of the navigation screens B1, replace the display of the included characters with the display of the translated characters in the participant language, and generate translated navigation screens RB1 to RB4 corresponding to each of the member terminal devices 30B, 30C, 30D, and 30E. In the duplicate translation distribution process Nt2, translated navigation screens RT1 to RT4 are generated.

[0073] Then, the translated navigation screen delivery unit 145 delivers the generated translated navigation screens RB1 to RB4 together with the navigation screens B1 to B4 to the translated navigation screen acquisition unit 135 (delivery R0 in FIG. 8). In the duplicate translation distribution process Nt2, the translated navigation screens RT1 to RT4 are delivered to the translated navigation screen acquisition unit 135 together with the navigation screens T1 to T4 (delivery R0 in FIG. 8).

[0074] When the translated navigation screen acquisition unit 135 acquires the four types of translated navigation screens RB1 to RB4, the translated navigation screen distribution unit 136 distributes the acquired translated navigation screens RB1 to RB4 together with the navigation screen B1 to the corresponding member terminal devices 30B, 30C, 30D, and 30E (distribution i1 in FIG. 8). In this way, in each of the member terminal devices 30B, 30C, 30D, and 30E, the translated navigation screens RB1 to RB4 are displayed on the participant screen (for example, participant screen 157 in FIG. 10(A)) of the respective display devices (liquid crystal display units 35) in a form including character display translated into the respective selected languages. In the duplicated translated distribution process Nt2, the translated navigation screens RT1 to RT4 are distributed together with the navigation screens T1 to T4 to the member terminal devices 30B, 30C, 30D, and 30E.

[0075] In this case, as shown in FIG. 10A, a split screen 155 is displayed on the member terminal devices 30B, 30C, 30D, and 30E used by the participants. The upper organizer screen 156 is a display area for a GUI in the organizer's language and screen operations by the presenter (for example, character input in the combo box described above). The lower participant screen 157 is a display area for a GUI in the participant's language and translation navigation screens RB1 to RB4 (RT1 to RT4) in the participant's language. The translation navigation screens RB1 to RB4 displayed on the participant screen 157 are different in the displayed text language from the navigation screens B1 to B4 displayed on the organizer screen 156, but the displayed content is the same. However, each member can only visually view the translation navigation screens RB1 to RB4 and cannot operate the screens using a mouse or keyboard.

[0076] The split screen 155 is also displayed on the member terminal device 30A used by the presenter. The navigation screen B1 created by the presenter himself is displayed on the upper organizer screen 156. At this time, all of the translation navigation screens RB1 to RB4 generated by the navigation screen translation / replacement unit 144 are distributed to the member terminal device 30A so that the translation navigation screens RB1 to RB4 are displayed one by one on the participant screen 157 of the member terminal device 30A (i2 in FIG. 8). Correspondingly, it is preferable to provide a screen selection button (not shown) as a screen selection means on the split screen 155 of the member terminal device 30A. Then, it is preferable to make it possible to select any one of the distributed translation navigation screens RB1 to RB4 as a selected translation navigation screen using the screen selection button, and to execute display switching so that the selected translation navigation screen (any one of the translation navigation screens RB1 to RB4) selected using the screen selection button is displayed on the participant screen 157. In this way, it is possible to check on the participant screen 157 how the characters input by the presenter in the navigation operation explanation using the organizer screen 156 are displayed in another language.

[0077] Then, for example, in the split screen 155 shown in FIG. 10(A), following the presenter's mouse operation, it is assumed that characters in English, "tool", are input on the combo box 155a of the host screen 156. At this time, as shown in FIG. 15, on the host screen 156, characters e1 of "tool" and a figure e2 corresponding to that "tool" are displayed. On the navigation screen B1, in addition to the screen including the movement of a mouse pointer (not shown), the screen including the character input on the combo box 155a is included. The translation navigation screens RB1 to RB4 also include the screen including the movement of the mouse pointer common to the navigation screen B1 and a figure e12 common to the figure e2 (by screen capture and duplication). However, since the navigation screen B1 includes the characters e1 in English of "tool", these are extracted by the navigation screen translation / replacement unit 144. Also, since the participant language of the member terminal device 30B is Japanese, the characters e1 are translated into "tool". Further, a navigation screen including a combo box in which the display of the characters e1 of "tool" is replaced with the display of the characters e11 of "tool" is generated as the translation navigation screen RB1 (the translation navigation screens RB2 to RB4 are also generated in the same manner for each participant language), and the translation navigation screen RB1 is displayed on the participant screen 157 in the split screen 155. FIG. 15 shows the case where the translation navigation screen RB1 is selected as the selected translation navigation screen in the member terminal device 30A. Also, since all of the translation navigation screens RB1 to RB4 are distributed to the member terminal device 30A, by performing display switching using the screen selection button, in addition to the translation navigation screen RB1, the translation navigation screens RB2, RB3, and RB4 can be displayed one by one.

[0078] The participants can view the navigation screen by the organizer in the language that they specify, translated by the organizer, on the participant screen 157 on each of the member terminal devices 30B, 30C, 30D, and 30E. This eliminates the difficulty in understanding caused by the difference in language. In addition, in the member terminal device 30A, the translated navigation screens RB1 to RB4 are displayed one by one on the participant screen 157, and the presenter can view all of them. Therefore, the presenter can provide an explanation of the navigation operation while checking how the explanation is displayed on the member terminal devices 30B, 30C, 30D, and 30E, thereby making the explanation of the navigation operation meaningful. In particular, on the split screen 155, the organizer screen 156 and the participant screen 157 are arranged vertically, and the navigation screen B1 and the translated navigation screen RB1 (RB2, RB3, RB4) are displayed in parallel in real time on each of them. Therefore, even if text input is performed in rapid succession, the correspondence between each input text and its translation is clearly displayed, so that both the presenter and each member can easily check the translation.

[0079] In this respect, the multilingual navigation system 1 of the present application is different from the case where screen sharing is performed by the terminal devices 630, 631, and 632 by the processing of the conference server 700 in the conventional conference system, as shown in FIG. 16. The terminal device 630 has a character display unit 556 and a graphic display unit 557, and a character display screen f1 and a graphic display screen f2 are displayed on them, respectively. Since screen sharing is performed on the character display screen f1 and the graphic display screen f2 on the terminal devices 630, 631, and 632, the character display screen f1 and the graphic display screen f2 are also displayed on the terminal devices 631 and 632, respectively, but in the terminal devices 631 and 632, character translation (from English to Japanese and Chinese, respectively) has been performed, so that "tool" is translated to "tool" and "tool" respectively. However, in any of the terminal devices 630, 631, and 632, the character display screen f1 is merely displayed in the language selected respectively, so it is not possible to confirm how it will be displayed on other terminal devices.

[0080] (Effects of navigation servers, multilingual navigation systems, and multilingual navigation programs) The multilingual navigation system 1 of this embodiment is used in a multilingual (or multinational) environment for business communication between team members, employees, and personnel from different companies within a company, online conferences (meetings), business negotiations, medical treatment, education, training, various support services, knowledge transfer, and the like.

[0081] The multilingual navigation system 1 allows, for example, an engineer to directly communicate with a user who speaks a different native language, or an engineer to directly communicate with a user who speaks a different native language without the assistance of an interpreter or translator. Participants can also directly communicate with engineers who speak a different native language without the assistance of an interpreter or translator. The multilingual navigation system 1 allows participants to learn about software and other technologies directly from engineers in their preferred language.

[0082] In the multilingual navigation system 1, an ERP GUI (e.g., SAP GUI) is installed in each member terminal device 30. For example, when the presenter gives a technical explanation of software, the presenter can give a navigation operation explanation and technical explanation using a preferred language (host language in the above case). On the other hand, the participants can select a preferred language (participant language in the above case) different from the presenter and listen to the detailed technical explanation while viewing the participant screen displayed in that language.

[0083] In this case, when the presenter performs operations such as commands, text input, and mouse operations on the navigation screen, these are replicated in real time and displayed on the participant screen in the participant's language.

[0084] By using the multilingual navigation system 1, language barriers are eliminated when acquiring, following, learning, implementing, or collaborating with other members on not only new and advanced technologies but also existing technologies.

[0085] This makes communication between and within companies smoother and easier, thereby increasing the productivity of employees and within the company.

[0086] This will allow software professionals and technical experts to be trained domestically, thereby reducing and reducing dependency on other countries for technical expertise in various software fields.

[0087] Meanwhile, companies struggle to find or train professionals who are bilingual or multilingual, and spend a huge amount of time and money on them. Therefore, many projects are transferred to foreign countries where there is no language barrier. However, by using the multilingual navigation system 1, such a problem can be solved efficiently.

[0088] In the multilingual navigation system 1, after the presenter finishes his / her explanation, one of the participants may become the presenter and provide a separate navigation operation explanation. One of the participants may start sharing his / her own screen and give a separate presentation in his / her own participating language, and the other participants may view the operation explanation while referring to the translated navigation screen in their preferred language.

[0089] In a multilingual navigation system, each participant may be able to select two or more languages ​​based on their own preference so that they can follow the presenter's input commands, instructions, and operating instructions on the display devices in parallel on their respective screens.

[0090] Participants can then increase or decrease their screen size to suit their selection, and the presenter and other participants can minimize or maximize their screen size according to their selection.

[0091] Furthermore, in the multilingual navigation system, navigation operation instructions for the split screen 155 (both the host screen 156 and the participant screen 157) may be recorded so that even if a participant misses the meeting, they can view the navigation operation instructions later.

[0092] The multilingual navigation program executed by the CPU 11 can be recorded on various recording media such as magnetic recording media, CD-ROMs, and DVDs, or can be downloaded from a server (not shown) via a network. The navigation server 10 can be configured not only by a server device, but also by a virtual server built on a cloud computing service. AWS (Amazon Web Service) can be used as the cloud computing service (AWS, Amazon, and Amazon Web Service are registered trademarks).

[0093] (Variation 1) In the above embodiment, the navigation system 1 is configured by the navigation server 10 and the member terminal devices 30 (30A, 30B, 30C, 30D, 30E). Alternatively, a navigation system (not shown) may be configured by a plurality of member terminal devices 30 (30A, 30B, 30C, 30D, 30E) without the navigation server 10.

[0094] For example, one of the member terminal devices 30 (member terminal device 30A) may have the functions of the navigation server 10, and the other member terminal devices 30 (30B, 30C, 30D, 30E) may operate as the above-mentioned member terminal devices 30 (30B, 30C, 30D, 30E). The member terminal devices 30 (30A, 30B, 30C, 30D, 30E) are connected via the Internet N1 and can communicate with each other. In this case, by installing a multilingual navigation program in the member terminal device 30A, the member terminal device 30A operates as the multilingual navigation device of the present invention, and the other member terminal devices 30B, 30C, 30D, 30E operate as the multiple terminal devices of the present invention. Then, multilingual navigation is provided to the member terminal devices 30 (30B, 30C, 30D, 30E), so that one of the member terminal devices 30 (30B, 30C, 30D, 30E) (for example, member terminal device 30B) can be set as the organizer terminal, and the other member terminal devices 30C, 30D, 30E can be set as participant terminals.

[0095] Also, the member terminal device 30A may operate as a multilingual navigation device in the present invention and may be set as the organizer terminal. The other member terminal devices 30B, 30C, 30D, and 30E may be set as participant terminals.

[0096] A multilingual navigation program may be installed in all of the member terminal devices 30 (30A, 30B, 30C, 30D, 30E), and multilingual navigation may be provided to the member terminal devices 30 (30A, 30B, 30C, 30D, 30E). In this case, one of the member terminal devices 30 (30A, 30B, 30C, 30D, 30E) (for example, the member terminal device 30A) may operate as the navigation server 10 and be set as the organizer terminal, and the other member terminal devices 30B, 30C, 30D, 30E may be set as the participant terminal. Instead of the member terminal device 30A, one of the member terminal devices 30B, 30C, 30D, 30E may operate as the navigation server 10 and be set as the organizer terminal.

[0097] (Variation 2) In the above embodiment, the navigation screen of the member terminal device 30A is duplicated by the navigation screen duplication unit 143 to generate a translation navigation screen. In this case, when the navigation characters are translated into different navigation characters, the length of the navigation characters may differ from the length of the different navigation characters. For example, when "Language" is translated into "Language", the length of "Language" differs from the length of "Language", and the translation navigation screen may be displayed inappropriately. For this reason, it is preferable to newly provide a layout modification unit 146 in the multilingual navigation module 140, and when the difference between the length of the navigation characters and the length of the different navigation characters becomes equal to or greater than a certain size, the layout modification unit 146 executes a layout modification. When the layout modification unit 146 executes a layout modification, the layout of the navigation screen is changed, and then the navigation screen translation / replacement unit 144 generates a translation navigation screen (modified translation navigation screens tRB1 to tRB4, tRT1 to tRT4 described later). By changing the layout, the size of the display area for the navigation characters is changed to a size corresponding to the length of the separate navigation characters, so that on the translation navigation screen, the size of the display area for the separate navigation characters is displayed with the length after the layout change.

[0098] In this case, in the above-mentioned duplicate translation distribution process, after the process b) is performed by the navigation screen translation and replacement unit 144, when the difference between the length of the navigation character and the length of the alternative navigation character becomes equal to or larger than a certain size, the layout change unit 146 executes the layout change, and then the process c) is executed by the navigation screen translation and replacement unit 144. Then, as shown in FIG. 14, modified translation navigation screens tRB1 to tRB4 and tRT1 to tRT4 are generated from each navigation screen B1. By executing the layout change by the layout change unit 146, even if there is a difference between the length of the navigation character and the length of the alternative navigation character, the translation navigation screen is appropriately displayed. At this time, the ERP system includes a plurality of layouts as input and output screens. Therefore, a screen with a layout corresponding to the presenter's operation is captured each time, and after the screen is captured, it is matched with the screen layout corresponding to the user's language (participant language), and the layout change is executed. At this time, the operations on the upper organizer screen 156 are mirrored and displayed on the changed translation navigation screens tRB1 to tRB4 and tRT1 to tRT4, but the members cannot perform screen operations such as mouse operations or command input on the lower participant screen 157.

[0099] In the above description, one language is selected as the organizer language and the participant language, but two or more languages ​​(second languages) may be selected (specified) as an optional function. In that case, for example, as shown in Fig. 9(B), the languages ​​used in each of the member terminal devices 30A, 30B, 30C, 30D, and 30E can be Japanese and Korean, Chinese and Japanese, Korean and Chinese, and German and Japanese, respectively.

[0100] In the above description, the navigation server 10 has the navigation screen capture unit 133, and the navigation screen capture unit 133 captures the navigation screen. Each member terminal device 30 may have a screen capture unit equipped with a function of capturing the navigation screen by the navigation screen capture unit 133. In that case, the screen capture unit of each member terminal device 30 captures the navigation screen and transmits it to the navigation server 10, thereby realizing the same multilingual navigation as described above. In the above description, the business management system 99 constructed with an ERP system is used as an example. An example of an ERP system is a solution system provided by SAP, but the business management system 99 and the multilingual navigation program may be generated using other ERP systems (ERP NetSuite (a system of Oracle, NetSuite and Oracle are registered trademarks). In addition, the multilingual navigation program may be generated using a program to which the multilingual navigation program can be applied, such as CAD software (3D or 2D), or the multilingual navigation program may be generated using an integrated CRM platform.

[0101] In addition, the multilingual navigation program according to the present invention preferably has a self-check mode for navigation, as described below. For example, it is preferable that the multilingual navigation program is installed in the member terminal device 30A, so that a member of each member terminal device 30 can, as a presenter, use the organizer screen 156 to give an explanation of the navigation operation while checking in advance the translation navigation screen displayed on the participant screen 157. In this way, the member can check for himself how the explanation of the navigation operation will be displayed on another member's member terminal device 30 (for example, member terminal device 30B).

[0102] The above description is of the preferred embodiment of the present invention, and does not limit the present invention's device and method, and various modifications can be easily implemented. Furthermore, the present invention also includes devices or methods that are configured by appropriately combining the components, functions, features, or method steps in each embodiment.

[0103] In the above description, examples are given in which Japanese, English, Chinese, Korean, or German is specified as the presenter language or participant language, but other languages ​​(e.g., Spanish, French, Arabic, etc.) may also be specified. [Industrial Applicability]

[0104] By applying the present invention, navigation operation instructions can be provided in multiple languages, enabling a presenter to provide meaningful navigation operation instructions. The present invention can be used in the fields of multilingual navigation devices, multilingual navigation systems, and multilingual navigation programs. [Explanation of symbols]

[0105] 1...multilingual navigation system, 10...navigation server, 11, 31...CPU, 30, 30A, 30B, 30C, 30D, 30E...member terminal device, 35...liquid crystal display unit, 106...translation pattern table, 101...software development management module, 123...dialog work process, 126...background work process, 130, 140...multilingual navigation module, 132...translation pattern setting unit, 133...navigation screen capture unit, 136...translated navigation screen distribution unit, 143...navigation screen duplication unit, 144...navigation screen translation / replacement unit, 155, 158...split screen, 156, 159...organizer screen, 157, 160...participant screen.

Claims

1. A multilingual navigation device that is connected to a plurality of terminal devices using a display device via a network and provides multilingual navigation using the display device to each of the plurality of terminal devices, a terminal setting means for setting one of the plurality of terminal devices as a host terminal through which the navigation operation explanation is given using the display device, and setting all of the plurality of terminal devices excluding the host terminal as participant terminals through which the navigation operation explanation is viewed using the display device; a screen capture means for capturing, when the navigation operation explanation is being given using one of the split screens displayed in a two-part manner on the display device of the terminal device set in the organizer terminal, one of the split screens as a navigation screen; a duplicating translation means for duplicating the navigation screen captured by the screen capturing means, translating navigation characters that are characters included in the navigation screen into different navigation characters in a different language from the navigation language in which the navigation characters are translated, and replacing the display of the navigation characters with the display of the different navigation characters to generate a translated navigation screen to be displayed on the other of the split screens; a distribution means for distributing the translation navigation screen to the organizer terminal and all of the participant terminals and distributing the navigation screen to all of the participant terminals except the organizer terminal so that the multilingual navigation can be executed at the organizer terminal and all of the participant terminals using the navigation screen and the translation navigation screen; a language selection means for selecting a host language used at the host terminal and a participant language which is a language used at each of the participant terminals; the replica translation means translates the navigation characters into the other navigation characters by using the host language and the participant language selected by the language selection means as the navigation language and the other language, respectively, to generate the translation navigation screen according to each of the participant terminals; The distribution means distributes all of the translated navigation screens generated by the reproduction translation means to the organizer terminal so that the translated navigation screens generated using the participant language selected at each of the participant terminals are displayed one by one on the other of the split screens at the organizer terminal.

2. a translation pattern setting means for setting a combination of the host language selected by the language selection means and the participant language as a translation pattern for each of the participant terminals; a translation pattern storage means for storing the translation pattern set by the translation pattern setting means; a translation pattern storage control means for storing the translation pattern set by the translation pattern setting means in the translation pattern storage means, 2. A multilingual navigation device according to claim 1, wherein said replica translation means determines said host language and said participant language in accordance with said translation pattern stored in said translation pattern storage means.

3. 3. The multilingual navigation device according to claim 1, further comprising a layout change means for executing a layout change to change a size of a display area of ​​the navigation characters to a size corresponding to the length of the alternative navigation characters when a length of the navigation characters differs from a length of the alternative navigation characters.

4. A multilingual navigation system having a plurality of terminal devices using a display device, and a multilingual navigation device that provides multilingual navigation using the display device to each of the plurality of terminal devices, the multilingual navigation device has a terminal setting means for setting one of a plurality of terminal devices as a host terminal at which a navigation operation explanation is given using the display device, and for setting all of the plurality of terminal devices excluding the host terminal as participant terminals at which the navigation operation explanation is viewed using the display device; a screen capture means for capturing, when the navigation operation explanation is being given using one of the split screens displayed in a two-part manner on the display device of the terminal device set in the organizer terminal, one of the split screens as a navigation screen; a duplicating translation means for duplicating the navigation screen captured by the screen capturing means, translating navigation characters that are characters included in the navigation screen into different navigation characters in a different language from the navigation language in which the navigation characters are translated, and replacing the display of the navigation characters with the display of the different navigation characters to generate a translated navigation screen to be displayed on the other of the split screens; a distribution means for distributing the translation navigation screen to the organizer terminal and all of the participant terminals and distributing the navigation screen to all of the participant terminals except the organizer terminal so that the multilingual navigation can be executed at the organizer terminal and all of the participant terminals using the navigation screen and the translation navigation screen; a language selection means for selecting a host language used at the host terminal and a participant language which is a language used at each of the participant terminals; the replica translation means translates the navigation characters into the other navigation characters by using the host language and the participant language selected by the language selection means as the navigation language and the other language, respectively, to generate the translation navigation screen according to each of the participant terminals; A multilingual navigation system in which the distribution means distributes all of the translated navigation screens generated by the reproduction translation means to the organizer terminal so that the translated navigation screens generated using the participant language selected at each of the participant terminals are displayed one by one on the other of the split screens at the organizer terminal.

5. 5. The multilingual navigation system according to claim 4, wherein the plurality of terminal devices have a display control means that executes display control such that one of the split screens displayed on each of the display devices is an organizer screen on which the navigation operation explanation is given, and the other is a participant screen on which the navigation operation explanation is viewed.

6. a screen selection means for causing a terminal device set as the host terminal among the terminal devices to select one of the translation navigation screens distributed by the distribution means as a selected translation navigation screen to be displayed on the participant screen, 6. The multilingual navigation system according to claim 5, wherein the display control means executes display switching so that the translation navigation screen selected by the screen selection means is displayed on the participant screen.

7. A multilingual navigation program for causing a computer to function as a multilingual navigation device that is connected to a plurality of terminal devices using a display device via a network and provides multilingual navigation using the display device to each of the plurality of terminal devices, the program comprising: a terminal setting means for setting one of the plurality of terminal devices as a host terminal through which the navigation operation explanation is given using the display device, and setting all of the plurality of terminal devices excluding the host terminal as participant terminals through which the navigation operation explanation is viewed using the display device; a screen capture means for capturing, when the navigation operation explanation is being given using one of the split screens displayed in a two-part manner on the display device of the terminal device set in the organizer terminal, one of the split screens as a navigation screen; a duplicating translation means for duplicating the navigation screen captured by the screen capturing means, translating navigation characters that are characters included in the navigation screen into different navigation characters in a different language from the navigation language in which the navigation characters are translated, and replacing the display of the navigation characters with the display of the different navigation characters to generate a translated navigation screen to be displayed on the other of the split screens; a distribution means for distributing the translation navigation screen to the organizer terminal and all of the participant terminals and distributing the navigation screen to all of the participant terminals except the organizer terminal so that the multilingual navigation can be executed at the organizer terminal and all of the participant terminals using the navigation screen and the translation navigation screen; functioning as a language selection means for selecting a host language used in the host terminal and a participant language which is a language used in each of the participant terminals; the replica translation means translates the navigation characters into the other navigation characters by using the host language and the participant language selected by the language selection means as the navigation language and the other language, respectively, to generate the translation navigation screen according to each of the participant terminals; The distribution means is a multilingual navigation program that distributes all of the translated navigation screens generated by the replica translation means to the organizer terminal so that the translated navigation screens generated using the participant language selected at each of the participant terminals are displayed one by one on the other of the split screens at the organizer terminal.

8. A multilingual navigation program for causing a computer to function as a multilingual navigation device that provides multilingual navigation using a display device to one or more terminal devices using a display device and connected via a network, the multilingual navigation program comprising: a terminal setting means for setting one of the plurality of terminal devices as a host terminal through which the navigation operation explanation is given using the display device, and setting all of the plurality of terminal devices excluding the host terminal as participant terminals through which the navigation operation explanation is viewed using the display device; a screen capture means for capturing, when the navigation operation explanation is being given using one of the split screens displayed in a two-part manner on the display device of the terminal device set in the organizer terminal, one of the split screens as a navigation screen; a duplicating translation means for duplicating the navigation screen captured by the screen capturing means, translating navigation characters that are characters included in the navigation screen into different navigation characters in a different language from the navigation language in which the navigation characters are translated, and replacing the display of the navigation characters with the display of the different navigation characters to generate a translated navigation screen to be displayed on the other of the split screens; a distribution means for distributing the translation navigation screen to the organizer terminal and all of the participant terminals and distributing the navigation screen to all of the participant terminals except the organizer terminal so that the multilingual navigation can be executed at the organizer terminal and all of the participant terminals using the navigation screen and the translation navigation screen; functioning as a language selection means for selecting a host language used in the host terminal and a participant language which is a language used in each of the participant terminals; the replica translation means translates the navigation characters into the other navigation characters by using the host language and the participant language selected by the language selection means as the navigation language and the other language, respectively, to generate the translation navigation screen according to each of the participant terminals; The distribution means is a multilingual navigation program that distributes all of the translated navigation screens generated by the replica translation means to the organizer terminal so that the translated navigation screens generated using the participant language selected at each of the participant terminals are displayed one by one on the other of the split screens at the organizer terminal.

9. The computer a translation pattern setting means for setting a combination of the host language selected by the language selection means and the participant language as a translation pattern for each of the participant terminals; a translation pattern setting unit that stores the translation pattern set by the translation pattern setting unit in a translation pattern storage unit; 8. The multilingual navigation program according to claim 7, wherein said replica translation means determines said host language and said participant language in accordance with said translation pattern stored in said translation pattern storage means.

Images