Information processor, information processing method and program
The information processing device guides selection buttons using voice input and a database to simplify complex firefighting command tasks, enhancing operational efficiency for both novice and expert operators.
Patent Information
- Application Number
- JP2024050854
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-27
- Publication Date
- 2025-10-09
Smart Images

Figure 2025150134000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]
[0002] In recent years, various technologies have been considered for command operations to dispatch emergency vehicles or to command activities at the scene in response to emergency calls such as disasters like fires, landslides, and floods, or emergency calls, as well as for supporting on-site activities. For example, in firefighting activities, a firefighting command system is used in which a commander issues commands to firefighters. With a firefighting command system, a commander can perform tasks such as listening to information related to emergency calls, organizing a dispatch unit, and creating instructions for firefighters.
[0003] As an example of such a firefighting command system, Patent Document 1 discloses a technology that searches a word dictionary using a string of characters entered by a commander based on the contents of a handwritten notepad containing the details of the caller's interview, and then appropriately displays the obtained keywords (common words used within the station) on a display screen that displays multiple items of information related to the incident (case). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2000-181606 Summary of the Invention [Problem to be solved by the invention]
[0005] Firefighting command duties include selecting the appropriate item from a display screen that displays a large number of items, and this operation requires skill.However, due to the recent increase in the complexity of command duties, there are many situations in which this skill is difficult to master.
[0006] Therefore, the present invention has been made in consideration of the above problems, and an object of the present invention is to provide a new and improved information processing device, information processing method, and program that can support the acquisition of command duties. [Means for solving the problem]
[0007] In order to solve the above problem, according to one aspect of the present invention, there is provided an information processing device comprising: a display control unit that controls the display of a screen; and a determination unit that determines a selection button associated with one or more words obtained from input information based on one or more words obtained from the input information and a database in which the one or more words are associated with selection buttons displayed on the screen, wherein the display control unit displays a guidance message on the screen to encourage selection of the determined selection button.
[0008] The input information may be information input by voice input.
[0009] The one or more words obtained from the input information may be obtained by dividing a character string obtained by converting the voice data obtained by the voice input into text.
[0010] The display control unit may perform control to display a guidance display pointing to the selected selection button.
[0011] The determination unit may search the database for a selection button that is most frequently associated with one or more words obtained from the input information.
[0012] The database may be prepared for each display screen, and the determination unit may refer to the database corresponding to the displayed screen to determine which selection button prompts selection from among the selection buttons displayed on the screen.
[0013] The one or more words obtained from the input information may be stored in a memory unit, the display control may control the display of a next screen depending on the selection of a selection button, and the determination unit may use the one or more words stored in the memory unit when determining which selection button will prompt a selection from among the selection buttons displayed on the next screen.
[0014] The determination unit may control the guidance display when the operator is not at an expert level.
[0015] When the operator is at an expert level, the information processing device may not control the guidance display, but may determine the screen to transition to based on one or more words based on voice input and a database in which the screen is associated with one or more words, and perform screen transition control.
[0016] The screen to be transitioned to may be a final screen in a series of screen transitions, and the information processing device may perform control to skip intermediate screens and display the final screen.
[0017] The screen may be a screen related to fire and emergency command operations.
[0018] In addition, according to another aspect of the present invention to solve the above problem, there is provided an information processing method including: a processor controlling the display of a screen; determining a selection button associated with one or more words obtained from input information based on one or more words obtained from the input information and a database in which selection buttons displayed on the screen are associated with one or more words; and displaying a guidance message on the screen to encourage selection of the determined selection button.
[0019] In addition, according to another aspect of the present invention to solve the above problem, a program is provided which causes a computer to function as a display control unit that controls the display of a screen, and a determination unit that determines a selection button associated with one or more words obtained from input information based on one or more words obtained from the input information and a database in which the selection buttons displayed on the screen are associated with one or more words, and the display control unit displays a guidance display on the screen to encourage selection of the determined selection button. [Effects of the Invention]
[0020] As described above, the present invention makes it possible to support the acquisition of command duties. [Brief explanation of the drawings]
[0021] [Figure 1] FIG. 1 is an explanatory diagram illustrating an overview of an information processing system 1 according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating an example of a functional configuration of a commander terminal 20 according to the present embodiment. [Figure 3] FIG. 10 is a diagram showing an example of a guidance display according to the present embodiment. [Figure 4] 10 is a flowchart showing an example of the flow of operation processing of the information processing system according to the present embodiment. [Figure 5] FIG. 2 is a screen transition diagram of each screen related to fire and emergency command operations according to this embodiment. [Figure 6] FIG. 2 is a screen transition diagram of each screen related to fire and emergency command operations according to this embodiment. [Figure 7] FIG. 10 is a diagram showing an example of a display of route search results. [Figure 8] 10 is a flowchart showing an example of the flow of operation processing for operational support related to fire and emergency command work according to this embodiment. [Figure 9] 10 is an example of a display screen relating to a fire and emergency command service according to another embodiment of the present invention. [Figure 10] 10 is a flowchart illustrating an example of an operational process for operational support related to fire and emergency command work according to another embodiment. [Figure 11] FIG. 9 is a block diagram showing an example of a hardware configuration of an information processing device 900 according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0022] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.
[0023] In addition, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different numbers after the same reference numeral. However, when there is no need to particularly distinguish between multiple components having substantially the same functional configuration, only the same reference numeral is used to distinguish each of the multiple components.
[0024] <1. Overview of an Information Processing System According to an Embodiment of the Present Invention> An embodiment of the present invention relates to a technology for supporting the acquisition of command duties in command duties in response to emergency calls. In this embodiment, the present invention will be described by taking as an example a firefighting emergency command system used for command duties in firefighting operations and command duties in response to emergency calls such as ambulance requests. The application of the present invention is not limited to firefighting emergency support systems. For example, the present invention may also be applied to an air traffic control system in air traffic control operations. The emergency call is not limited to calls such as 119, but can broadly include calls requesting instructions on how to respond to an emergency from a command room or a commander located at a location different from the scene.
[0025] FIG. 1 is an explanatory diagram illustrating an overview of an information processing system 1 according to one embodiment of the present invention. As shown in FIG. 1, the information processing system 1 includes a command control device 10, a commander terminal 20 (20a, 20b, 20c, . . .), and a large display device 30. These are arranged in a command room. The command control device 10, the commander terminal 20, and the large display device 40 are configured to be able to communicate with each other via a network 6. The command control device 10, the commander terminal 20, and the large display device 40 may also be configured to be able to communicate with external devices via a network 7. Examples of external devices include a fire station terminal 50 arranged in a fire station, a firefighter terminal 52 used by firefighters and emergency personnel, and an in-vehicle terminal 54 installed in an emergency vehicle such as a fire engine or an ambulance.
[0026] The command control device 10 communicates with a relay switch of a fixed telephone network (not shown) or a relay router of an IP telephone network via a telephone line or an IP line, and functions as a telephone switch that receives emergency calls such as 119. The command control device 10 also transfers the received calls to the dispatcher terminal 20 via the network 6.
[0027] The commander terminal 20 is an information processing terminal operated by the commander 2. The commander 2 uses the commander terminal 20 to perform command tasks such as creating commands to the team members in response to the emergency call. Specifically, when the command control device 10 transfers an emergency call to the commander terminal 20, the commander terminal 20 notifies the caller of the arrival of the emergency call on the display screen of the commander terminal 20. The commander 2 starts a call and listens to the caller. The call may be made via an earphone microphone worn on the head of the commander 2. Furthermore, when the emergency call is started, the commander terminal 20 controls the display screen to display a screen related to fire and emergency command.
[0028] The commander terminal 20 transmits the command content created by the operation of the commander 2 to the station terminal 50, the crew terminal 52, or the in-vehicle terminal 54 via the command control device 10. The commander terminal 20 can also communicate with the station terminal 50, the crew terminal 52, or the in-vehicle terminal 54 via the command control device 10 and make a call.
[0029] The large display device 30 is installed in the command room and displays various information such as information on ongoing disaster incidents or the activity status of vehicles under its jurisdiction under the control of the command control device 10. The large display device 30 allows relevant parties in the command room, including the commander, to simultaneously view the same screen and share information.
[0030] The fire station terminal 50 is an information processing terminal located in a fire station. The fire station terminal 50 displays information received from the command control device 10 or the commander terminal 20 via the network 7 on a display screen. The firefighter terminal 52 is an information processing terminal used by firefighters working at the disaster site. The firefighter terminal 52 is realized by, for example, a smartphone, a mobile phone terminal, or the like. The firefighters can use the firefighter terminal 52 to talk to the commander 2 in the command room and hear the command content directly. The vehicle-mounted terminal 54 is an information processing terminal mounted on an emergency vehicle such as a fire engine or an ambulance. The vehicle-mounted terminal 54 has a position measurement function and may transmit current position information to the command control device 10. The vehicle-mounted terminal 54 may also display information on the command content received from the command control device 10 or the commander terminal 20 via the network 7 on a display screen.
[0031] (Identifying issues) Here, firefighting command work involves selecting the appropriate item from a display screen that displays a large number of items, and such operations require skill, but due to the recent increase in the complexity of command work, there are many situations where it is difficult to master this skill.
[0032] Therefore, the inventors of the present invention have devised an embodiment of the present invention with the above-mentioned circumstances in mind. According to the embodiment of the present invention, it is possible to support the acquisition of dispatching duties during dispatching duties. Specifically, when a dispatcher 2 performs dispatching duties using a dispatcher terminal 20, the dispatcher terminal 20 displays a guide for item selection operations based on information input by the dispatcher 2. This allows the dispatcher 2 to complete the task and, by performing selection operations sequentially according to the guide display, to memorize the order of item selection operations and acquire dispatching duties. Below, an example of the functional configuration and operation of the dispatcher terminal 20 according to the embodiment of the present invention will be sequentially described in detail.
[0033] 2. Configuration of the Dispatcher Terminal 20 2 is a diagram showing an example of the functional configuration of the commander terminal 20 according to this embodiment. The commander terminal 20 has a communication unit 210, an operation input unit 220, a display unit 230, a control unit 240, a voice input / output unit 250, and a storage unit 260.
[0034] (Communication unit 210) The communication unit 210 functions as a transmitter and a receiver for transmitting and receiving information to and from other devices. For example, the communication unit 210 communicates with the command control device 10 and receives voice data of an emergency call transferred from the command control device 10 and location information of an emergency vehicle.
[0035] (Operation input unit 220) The operation input unit 220 is configured to be operated by an operator (dispatcher 2) of the dispatcher terminal 20 to input instructions or information to the dispatcher terminal 20. The operation input unit 220 is realized by, for example, a mouse, a keyboard, a touch panel, or the like.
[0036] (Display section 230) The display unit 230 displays a screen related to a fire and emergency command. The display unit 230 may be configured integrally with the operation input unit 220. For example, the display unit 230 may be a touch panel display.
[0037] (control unit 240) The control unit 240 is mainly composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), etc., and controls the overall operation of the commander terminal 20.
[0038] The control unit 240 also functions as a display control unit 241 , a text analysis processing unit 242 , and a guidance content determination unit 243 .
[0039] The display control unit 241 controls the screen displayed on the display unit 230. For example, the display control unit 241 displays on the display unit 230 a screen relating to fire and emergency command work.
[0040] The text analysis processing unit 242 converts the voice data of the operation content related to the command task of the commander 2 input from the voice input / output unit 250 into text and analyzes the text. Specifically, the text analysis processing unit 242 breaks down the text string into words. In this embodiment, when the commander 2 gets stuck in operating a screen related to the command task, the commander 2 inputs the operation content he or she wants to operate (operation content) by voice. The text analysis processing unit 242 breaks down the text string obtained by converting the voice of the commander 2 into words and outputs the broken down words to the guidance content determination unit 243.
[0041] The guidance content determination unit 243 determines guidance content to be displayed on the command task screen based on the analysis result (specifically, one or more words obtained by decomposing the character string) by the text analysis processing unit 242. More specifically, the guidance content determination unit 243 determines guidance content by referring to word dictionary data stored in the word dictionary data DB 262 of the storage unit 260. The word dictionary data is a database in which a plurality of synonymous words that can be used to infer the meaning of each selection button displayed on the command task screen are associated with each selection button. An example of the word dictionary data is shown in Table 1 below.
[0042] [Table 1]
[0043] The guidance content determination unit 243 searches for words and determines the selection button n to which guidance is to be given. It is assumed that multiple words will be obtained from the commander's input voice, and the guidance content determination unit 243 searches the word dictionary data for the selection button n that matches all or the most of the multiple words.
[0044] The word dictionary data shown in Table 1 above is an example, and the present embodiment is not limited to this. The word dictionary data may be data in which a plurality of analogous words are associated with each piece of position information of a selection button on the display screen.
[0045] The word dictionary data can be prepared for each display screen. The guidance content determination unit 243 uses the word dictionary data of the currently displayed display screen to determine the selection button n to which guidance is to be given on that display screen.
[0046] The information on the determined guidance content is output to the display control unit 221. The display control unit 221 performs display control to guide the instructor to select the determined selection button n. Fig. 3 is a diagram showing an example of guidance display according to this embodiment.
[0047] As shown in FIG. 3 , when a large number of selection buttons 602 are displayed on the display screen 600, an inexperienced dispatcher 2 may become stuck in the operation because he or she does not know which selection button 602 is appropriate for the purpose. In this case, when the dispatcher 2 vocally inputs the operation content (purpose), the dispatcher terminal 20 estimates the selection button to be selected. Then, as shown in FIG. 3 , a guidance display G pointing to the selection button 602n is displayed to prompt the dispatcher to select, for example, the selection button 602n. The guidance display G is, for example, an arrow image. Note that the guidance display method is not limited to this. For example, the guidance display method may be some kind of image pointing to the selection button 602n, or the selection button 602n may be displayed in a different color, flash, or have a motion, or the color of the selection buttons other than the selection button 602n may be lighter, or the display may be controlled so that the selection button 602n is larger than the other selection buttons. The dispatcher 2 intuitively recognizes that the selection button 602n should be selected and selects it by tapping, clicking, or the like.
[0048] (Audio input / output unit 250) The audio input / output unit 250 has a function as an audio input unit that inputs audio and a function as an audio output unit that outputs audio. The audio input / output unit 250 may be realized, for example, by an earphone microphone worn on the head of the commander 2. In this case, the audio input / output unit 250 is communicatively connected to the control unit 240 via the communication unit 210 in a wired or wireless manner.
[0049] The voice input / output unit 250 receives voice input of operation details related to the command service from the commander 2. The voice input / output unit 250 also outputs voice data of the emergency call transferred from the command control device 10.
[0050] (Storage unit 260) The storage unit 260 has a function of temporarily or permanently storing various data such as data related to the processing of the control unit 240 and operation program files of the control unit 240. The storage unit 260 has a processing data storage unit 261 and a word dictionary data DB (database) 262. The processing data storage unit 261 stores data related to processing. For example, the processing data storage unit 261 stores voice data of the commander 2, character strings obtained by converting the voice data into text, results of text analysis (plurality of words obtained by breaking down the character strings), and information on selection buttons determined as targets for selection guidance. Furthermore, the word dictionary data DB 262 stores word dictionary data. For example, the word dictionary data DB 262 stores word dictionary data for each display screen.
[0051] An example of the configuration of the commander terminal 20 according to this embodiment has been described above. Note that the configuration of the commander terminal 20 according to this embodiment is not limited to the example shown in Fig. 2. For example, the commander terminal 20 may be configured by multiple devices.
[0052] <3. Operation processing> Next, the operation processing of the information processing system according to this embodiment will be specifically described with reference to Fig. 4. Fig. 4 is a flowchart showing an example of the flow of the operation processing of the information processing system according to this embodiment.
[0053] As shown in FIG. 4, first, the display control unit 241 of the dispatcher terminal 20 displays an initial screen on the display unit 230 as a screen related to the dispatching service (step S103).
[0054] Next, if there is a voice input from the commander 2 (step S106 / Yes), the text analysis processing unit 242 converts the voice of the commander 2 input from the voice input / output unit 250 into text and analyzes the acquired character string (step S109). It is assumed that the commander 2 will input the operation content (purpose) by voice when he / she does not know the operation.
[0055] Next, the guidance content determination unit 243 determines a selection button to guide the commander 2 to make a selection from among the multiple selection buttons displayed on the initial screen, based on the words obtained by dividing the character string in the text analysis processing unit 242 and the word dictionary data (step S112). At this time, the guidance content determination unit 243 may use the word dictionary data corresponding to the initial screen.
[0056] Next, the display control unit 241 controls the display to guide the user to select the selection button determined by the guidance content determination unit 243 (step S115). For example, the display control unit 241 controls to display a guidance display pointing to the determined selection button. This allows the dispatcher 2 to intuitively grasp the selection button to be selected, and enables the dispatcher 2 to perform the task even if he or she is not an experienced dispatcher, and also to learn which selection button to select according to the purpose.
[0057] On the other hand, the commander terminal 20 can also accept a normal click operation instead of a voice input. In the above step S106, if no voice input is performed (step S106 / No), the commander terminal 20 can accept a click operation on a selection button (step S118). A click operation is an operation normally assumed in fire and emergency command work, and is an operation in which the commander 2 selects a selection button at his or her own discretion using, for example, a mouse or a keyboard. Although it is referred to as a "click" here, if the display unit 230 is a touch panel display, it may also be a tap operation.
[0058] If the command task is completed by selecting the selection button (step S121 / Yes), the process ends.
[0059] On the other hand, if the command task is not completed (step S121 / No), the display control unit 241 controls the display to transition to the next screen in response to the selection of the selection button (step S124). Similarly, on the next screen, the dispatcher terminal 20 controls the guidance display to support the command task in response to the voice input of the dispatcher 2 (steps S106 to S115).
[0060] Voice input may be performed each time a new screen is displayed, or the results of text analysis based on the initial voice input (multiple words obtained by breaking down a character string) may be stored in the processing data storage unit 261, and when the screen transitions, the guidance content determination unit 243 may use the results of text analysis based on the voice input stored in the processing data storage unit 261 to refer to the word dictionary data DB 262 for the word dictionary data corresponding to the transitioned screen and determine the selection button to be navigated to.
[0061] The guidance content determination unit 243 may determine the selection buttons based on the results of text analysis based on the voice input each time a screen is displayed, or may determine all selection buttons on each screen to be transitioned to until the goal is achieved when first determining the selection buttons based on the results of text analysis based on the voice input. Information on the selected selection buttons on each screen is stored in the processing data storage unit 261.
[0062] Furthermore, the control unit 240 may store the voice data of the commander 2 in the processing data storage unit 261.
[0063] <4. Specific Examples> Next, a more specific example of the application of the present invention to firefighting and emergency command work will be described.
[0064] 5 and 6 are screen transition diagrams of the various screens relating to the fire and emergency command service according to this embodiment. First, when the fire and emergency command service is started on the commander terminal 20, an initial screen (first screen) 610 as shown on the left side of Fig. 5 is displayed under the control of the display control unit 241. The initial screen 610 displays selection buttons such as an aerial photo button 612a, a route search button 612b, a 3D building map button 612c, and a highway map 612d.
[0065] Here, if the dispatcher 2a is not an expert, but for example an apprentice operator with low expertise, he or she may not know which selection button to select first for the purpose of operation and may become stuck in the operation. In this case, the dispatcher 2a inputs the operation he or she wants to perform by voice. For example, he or she may input by voice, "I would like to instruct vehicle A (vehicle number) on the route to 2-chome." In this case, the dispatcher terminal 20 converts the input voice data into text and decomposes the character string obtained by the text conversion to obtain multiple words. For example, by decomposing the character string, words such as "2-chome," "route," "vehicle A (vehicle number)," and "instructions" are obtained.
[0066] Then, the commander terminal 20 searches the word dictionary data for the plurality of words and determines the selection button. An example of the word dictionary data used here, stored in the word dictionary data DB 262, corresponding to the initial screen 610 is shown in Table 2 below.
[0067] [Table 2]
[0068] The dispatcher terminal 20 performs a word search by referring to the word dictionary data shown in Table 2 above, and obtains as a search result the "route search" button associated with "2-chome," "route," and "Vehicle A (vehicle number)." Here, as an example, a search is performed for the selection button associated with the most frequently used word among multiple words.
[0069] 5, a guidance display G1 pointing to the route search button 612b is displayed on the initial screen 610. This allows the dispatcher 2a to select the route search button 612b to carry out the task, and also allows the dispatcher 2a to learn which button to select in what situation.
[0070] In response to selection of the route search button 612b, a destination selection screen (second screen) 620 is then displayed, as shown on the right side of Fig. 5. The destination selection screen 620 displays selection buttons such as a 1st chome button 622a, a 2nd chome button 622b, a 3rd chome button 622c, and a 4th chome button 622d.
[0071] On this screen, too, a guidance display G2 is displayed indicating the selection button to be selected for the purpose (here, the second button 622b) based on the analysis result of the initial voice input. This allows the dispatcher 2a to intuitively and quickly know the correct selection button and carry out the task. The dispatcher terminal 20 stores the analysis result of the initial voice input in the processing data storage unit 261, and searches for the selection button by referring to the word dictionary data DB 262 for word dictionary data such as the following Table 3 that corresponds to the destination selection screen 620.
[0072] [Table 3]
[0073] However, this embodiment is not limited to this, and if the commander 2a gets stuck while looking at the destination selection screen 620 and voice input is made again, the commander terminal 20 may analyze the voice data input by the voice input and control the display of the guidance display G2.
[0074] The display control of the guidance display G is similarly performed on each subsequent screen. For example, in response to selection of the second button 622b displayed on the destination selection screen 620 shown on the right of FIG. 5, a vehicle selection screen (third screen) 630 shown on the left of FIG. 6 is then displayed. A large number of emergency vehicle buttons 632 are displayed on the vehicle selection screen 630. Each emergency vehicle button 632 is assigned a vehicle number. The dispatcher terminal 20 uses the word dictionary data corresponding to the vehicle selection screen 630 to search for words included in the analysis result of the initial voice input and acquires the associated selection button (here, the ambulance 004 button 632n). Then, the dispatcher terminal 20 displays a guidance display G3 pointing to the ambulance 004 button 632n, as shown on the left of FIG. 6.
[0075] Next, in response to selection of the ambulance 004 button 632n, a route display screen (fourth screen) 640 shown on the right side of Fig. 6 is displayed. In this case, the dispatcher terminal 20 refers to the word dictionary data stored in the word dictionary data DB 262, as shown in Table 4 below, and performs control to display a guidance display G4 pointing to the route display button 642a.
[0076] [Table 4]
[0077] When the route display button 642a is selected, the dispatcher terminal 20 executes a route search to the destination set on the destination selection screen 620, and displays the searched route on a map on the route display screen 640. The dispatcher terminal 20 may request an external device (for example, a route search server (not shown) connected to the network 6) to execute the search. The dispatcher terminal 20 may also set the starting point to the fire station where vehicle A is waiting, or the current location of vehicle A. The dispatcher terminal 20 may acquire current location information of vehicle A, for example, from the command control device 10. Current location information is sent to the command control device 10 via the network 7 from the on-board terminal 54 installed in each emergency vehicle.
[0078] 7 is a diagram showing an example of the display of the route search result. As shown in FIG. 7, a route R to the destination is displayed on a map image 643 displayed on a route display screen 640. Finally, the dispatcher terminal 20 performs control to display a guidance display G5 pointing to a route send button 642b. When the route send button 642b is selected, the dispatcher terminal 20 transmits the route information to the in-vehicle terminal 54 of vehicle A or a predetermined team member terminal 52 via the command control device 10.
[0079] The operational processing of the specific example explained above will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the flow of operational processing for operational support related to fire and emergency command work according to this embodiment.
[0080] As shown in FIG. 8, first, the display control unit 241 of the dispatcher terminal 20 displays an initial screen on the display unit 230 as a screen related to the dispatching service (step S203).
[0081] Next, if there is voice input from the commander 2a (step S206 / Yes), the text analysis processing unit 242 converts the voice of the commander 2a input from the voice input / output unit 250 into text and analyzes the acquired character string (step S209).
[0082] Next, the text analysis processing unit 242 stores the analysis result in the processed data storage unit 261 (step S212).
[0083] Next, the guidance content determination unit 243 determines a selection button to guide the commander 2a to make a selection from among the multiple selection buttons displayed on the initial screen based on the words obtained by dividing the character string in the text analysis processing unit 242 and the word dictionary data (step S215).
[0084] Next, the display control unit 241 controls the display so as to guide the user to select the selection button determined by the guidance content determination unit 243 (step S218).
[0085] If the selection button is selected (step S221 / Yes) and the command task is completed (step S224 / Yes), the process ends.
[0086] If the selection button is not selected (step S221 / No), the commander terminal 20 waits until the selection button is selected.
[0087] If a selection button is selected (step S221 / Yes) and the command task is not completed (step S224 / No), the display control unit 241 performs control to display the next screen in accordance with the selection of the selection button (step S227). Similarly, on the next screen, the dispatcher terminal 20 performs guidance display control to support the command task in accordance with the voice input of the dispatcher 2a (steps S215 to S227). In this case, in step S215, the guidance content determination unit 243 may refer to word dictionary data corresponding to the displayed screen and determine the selection button to be guided to, based on the analysis result of the character string of the voice data stored in the processed data storage unit 261 in step S212 (specifically, a plurality of words obtained by dividing the character string).
[0088] On the other hand, the dispatcher terminal 20 can also accept a normal click operation instead of a voice input. In the above step S206, if a voice input is not performed (step S206 / No), the dispatcher terminal 20 can accept a click operation of the selection button (step S230).
[0089] When the selection button is clicked (selected) and the command task is completed (step S233 / Yes), the process ends.
[0090] On the other hand, if the command task is not completed (step S233 / No), the display control unit 241 controls to display the next screen in response to clicking (selection) of the selection button (step S236). Similarly, on the next screen, if there is a voice input from the commander 2, the commander terminal 20 controls the guidance display to support the command task in response to the voice input (steps S209 to S227), and can also accept normal click operations (steps S230 to S236).
[0091] The operational processing for operational support related to fire and emergency command work according to this embodiment has been specifically described above. Note that the operational processing according to this embodiment is not limited to the content and order of each step shown in FIG. 8. For example, after the screen transitions by the processing shown in step S227, new voice input may be performed by the commander 2a. The commander terminal 20 may search the word dictionary data by adding the analysis result of the new voice data to the analysis result of the initially input voice data.
[0092] Furthermore, if there is no associated selection button as a result of searching the word dictionary data, the dispatcher terminal 20 may not display the guidance display G, or may prompt the dispatcher 2a to input the missing information.
[0093] In the above-described embodiment, it has been explained that word dictionary data is prepared for each screen, but the present embodiment is not limited to this, and a plurality of screens that have a transition relationship (i.e., a group of screens with a defined display order, such as a series of screen transitions related to command work) may be treated as a set, and word dictionary data corresponding to the set may be prepared. This enables the guidance content determination unit 243 to determine the selection button to be guided to on each of the screens that make up the series of screen transitions in response to the initial voice input.
[0094] <5. Other embodiments> In the above-described embodiment, support for operations related to fire and emergency command work by the trainee-level commander 2a has been described. The information processing system 1 according to this embodiment can further support operations related to fire and emergency command work by the expert-level commander 2b by reducing the effort required for the operations and enabling the operations to be performed more efficiently.
[0095] Fig. 9 shows an example of a display screen relating to a fire and emergency command service according to another embodiment of the present invention. In Fig. 9, display control will be described in the case where a commander 2b, who is an expert at operations relating to command services, inputs a voice command.
[0096] First, when a fire and emergency command service is started on the commander terminal 20, an initial screen 610 such as that shown on the left side of FIG. 9 is displayed, similarly to the embodiment described with reference to FIG.
[0097] Here, the expert-level dispatcher 2b inputs the operation content (purpose) by voice. For example, the dispatcher 2b inputs by voice, "I would like to instruct vehicle A (vehicle number) on the route to 2-chome." In this case, the dispatcher terminal 20 converts the input voice data into text and decomposes the character string obtained by the text conversion to obtain multiple words. For example, by decomposing the character string, words such as "2-chome," "route," "vehicle A (vehicle number)," and "instructions" are obtained.
[0098] The dispatcher terminal 20 then searches the word dictionary data for multiple words and determines the screen to transition to. The word dictionary data used in another embodiment is data in which multiple analogous words that allow for analogy of the screen related to the dispatch service to be displayed are associated with each screen. The control unit 240 of the dispatcher terminal 20 also functions as a transition screen determination unit that determines the screen to transition to.
[0099] An example of word dictionary data used in another embodiment is shown in the following Table 5. In the word dictionary data according to another embodiment, analogous words are associated with all display screens that can be displayed as screens related to command work.
[0100] [Table 5]
[0101] In Table 5 above, display screens A1 to A3, destination selection screen to route display screen, and display screens C1 to C3, etc. are assumed to be screens that are displayed by sequential screen transitions following the initial screen 610, depending on the selected selection button. For example, when the route search button 612b on the initial screen 610 is selected, the destination selection screen is displayed, and once a destination is selected, the vehicle selection screen is displayed, and once a vehicle is selected, the route display screen is displayed. The route display screen corresponds to the final display screen in each series of screen transition groups related to dispatch work (i.e., a group of screens with a defined display order). The dispatcher terminal 20 searches for one of the final display screens in a screen search using word dictionary data.
[0102] For example, the dispatcher terminal 20 performs a word search by referring to the word dictionary data shown in Table 5 above, and obtains as search results a "Route Display" screen associated with "2-chome," "Route," "Vehicle A (Vehicle number)," and "Instructions."
[0103] Then, the dispatcher terminal 20 displays a route display screen 640 as shown on the right side of Fig. 9. A route R to the destination is displayed on a map image 643 of the route display screen 640. After checking the contents of the screen, the dispatcher 2b selects the route send button 642b and ends the dispatch task.
[0104] As described above, in another embodiment, after displaying the initial screen 610, the dispatcher terminal 20 performs control in response to voice input from the expert-level dispatcher 2b to skip intermediate display screens (destination selection screen 620 and vehicle selection screen 630) and display the final display screen, the route display screen 640. The route display screen 640 displays a route display button 642a, but the dispatcher terminal 20 automatically performs a route search based on the initial voice input so that the selection operation of this button can also be skipped, and the route search result is displayed on the route display screen 640.
[0105] In this way, in another embodiment, by skipping the display screens in between, it is possible to reduce the effort required for the instructor 2b to perform the operation, and to support the instructor 2b in performing the operation more efficiently.
[0106] If the voice-input information is insufficient, the dispatcher terminal 20 may transition to an intermediate screen associated with the missing information. Specifically, the dispatcher terminal 20 first checks whether the multiple words used for search obtained from the input voice data include words corresponding to all items associated with any of the final screens. For example, in the case of the route display screen shown in Table 5, all items associated with the final screen include the operation purpose (route, road, etc., and guidance, instructions, or indication, etc.), the destination (1st block, 2nd block, or 3rd block, etc.), and vehicle information (Vehicle A, Vehicle B, or Vehicle C, etc.). Next, if there is missing information, the dispatcher terminal 20 controls to display an intermediate screen associated with the missing information (specifically, a screen where the missing information is entered). For example, if there is missing vehicle information, the dispatcher terminal 20 controls to display the vehicle selection screen 630.
[0107] FIG. 10 is a flowchart showing an example of operational processing for operational support related to fire and emergency command work according to another embodiment.
[0108] As shown in FIG. 10, first, the dispatcher terminal 20 performs a login process for the dispatcher 2 (step S303). In the login, the dispatcher 2 inputs his / her name (ID) and information on whether or not he / she is at an expert level. The information on whether or not he / she is at an expert level may be information such as rank, position, presence or absence of expertise, or business level. The information on whether or not he / she is at an expert level may be stored in advance in a predetermined external device (for example, the command control device 10) in association with the name (ID). In this case, the dispatcher terminal 20 may transmit the ID, etc. input on the login screen to the command control device 10 to request verification, and may obtain information on whether or not he / she is at an expert level from the command control device 10 when obtaining the verification result.
[0109] Next, the dispatcher terminal 20 displays an initial screen on the display unit 230 as a screen related to the dispatching service (step S306).
[0110] Next, if the dispatcher 2 is not at the expert level (step S309 / No), the dispatcher terminal 20 performs operation support processing for the apprentice level, that is, the operation processing (guidance display control) as described in FIG. 4 or FIG. 8 (step S328).
[0111] On the other hand, if the commander 2 is at an expert level (step S309 / Yes), the commander terminal 20 performs operation assistance processing for an expert level (steps S312 to S325).
[0112] Specifically, first, when there is voice input from the expert-level commander 2b (step S312 / Yes), the commander terminal 20 converts the input voice of the commander 2b into text and analyzes the acquired character string (step S315).
[0113] Next, the commander terminal 20 determines the screen to transition to based on the words obtained by dividing the character string and the word dictionary data (step S318).
[0114] Next, the dispatcher terminal 20 performs display control to transition to the determined screen (step S321). Note that the dispatcher terminal 20 may also perform processing to acquire information necessary for the transition screen. For example, when transitioning to a route display screen 640 that displays the route search results to the destination on a map, the dispatcher terminal 20 performs a route search process, transitions to the route display screen 640, and displays the route search results on the route display screen 640.
[0115] On the other hand, the dispatcher terminal 20 can also accept a normal click operation instead of a voice input. In the above step S312, if a voice input is not performed (step S312 / No), the dispatcher terminal 20 can accept a click operation of a selection button by the dispatcher 2b (step S325). The dispatcher terminal 20 controls the display to transition to the next screen in response to the click of the selection button (step S321).
[0116] Then, when the command operation is completed (step S324 / Yes), the processing ends. For example, the screen displayed in the above step S321 is the final screen (e.g., the route display screen 640), and the command operation ends when the confirm button or the route send button 642b is finally selected by the dispatcher 2b. When the route send button 642b is selected, the dispatcher terminal 20 may transmit the route search results to the in-vehicle terminal 54 installed in the target vehicle via the command control device 10.
[0117] On the other hand, if the command task has not been completed (step S324 / No), the process returns to step S312.
[0118] An example of the operation process according to another embodiment has been described above.
[0119] <6. Hardware configuration example> Next, a description will be given of the hardware configuration used in at least one of the command terminal 20 and the command control device 10 according to this embodiment. The operation of the command terminal 20 or the command control device 10 is realized by cooperation between software and the hardware described below.
[0120] 11 is a block diagram showing an example of a hardware configuration of an information processing device 900 according to this embodiment. The information processing device 900 is an example of a hardware configuration applied to at least one of the command terminal 20 and the command control device 10 according to this embodiment.
[0121] The information processing device 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a host bus 904, a bridge 905, an external bus 906, an interface 907, an input device 908, an output device 909, a storage device 910, a drive 911, and a communication device 913.
[0122] The CPU 901 functions as an arithmetic processing unit and a control unit, and controls the overall operation of the information processing device 900 in accordance with various programs. The CPU 901 may also be a microprocessor. The ROM 902 stores programs used by the CPU 901, calculation parameters, etc. The RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, etc. These are interconnected by a host bus 904 that is composed of a CPU bus, etc. The CPU 901, ROM 902, and RAM 903 work together to realize the functions of, for example, the control unit 240 of the commander terminal 20.
[0123] The host bus 904 is connected to an external bus 906, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 905. It is not necessary to configure the host bus 904, bridge 905, and external bus 906 separately, and these functions may be implemented on a single bus.
[0124] The input device 908 is composed of input means such as a mouse, keyboard, touch panel, button, switch, or microphone that allows the operator to input information, and an input control circuit that generates an input signal based on the operator's input and outputs it to the CPU 901. By operating this input device 908, the operator operating the information processing device 900 can input various data to the information processing device 900 and instruct the information processing device 900 to perform processing operations.
[0125] The output device 909 includes, for example, a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, or a lamp, and an audio output device such as a speaker.
[0126] The storage device 910 is a device for storing data. The storage device 910 may include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, and a deleting device for deleting data recorded on the storage medium. The storage device 910 realizes, for example, the memory unit 260 of the commander terminal 20 (the memory unit 260 having the processing data memory unit 261 and the word dictionary data DB 262).
[0127] The drive 911 is a reader / writer for a storage medium, and is externally attached to the information processing device 900. The drive 911 reads information recorded on a removable storage medium 912, such as an attached magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 903. The drive 911 can also write information to the removable storage medium 912.
[0128] The communication device 913 is a communication interface configured with a communication device for performing communication, etc. The communication device 913 realizes the communication unit 210 of the commander terminal 20, for example.
[0129] The hardware configuration of the information processing device 900 is not limited to the configuration shown in Fig. 11. For example, the information processing device 900 may not include the communication device 913 when communicating via a connected external communication device. Furthermore, the information processing device 900 may not include, for example, the input device 908 or the output device 909. Furthermore, for example, part or all of the configuration shown in Fig. 11 may be realized by one or more ICs (Integrated Circuits).
[0130] <7. Supplementary Information> Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to these examples. It is clear that a person skilled in the art to which the present invention pertains can conceive of various modifications and alterations within the scope of the technical ideas set forth in the claims, and it is understood that these also naturally fall within the technical scope of the present invention.
[0131] For example, the above embodiment is based on the premise that the commander 2 inputs voice, but the present invention is not limited to this. The commander terminal 20 may also accept text input by the commander 2 operating the operation input unit 220. In this case, the text analysis processing unit 242 performs an analysis process on the input text (character string) and acquires multiple words.
[0132] It is also possible to create one or more computer programs for causing hardware such as a CPU, ROM, and RAM built into the command terminal 20 or the command control device 10 to perform the functions of the command terminal 20 or the command control device 10. A computer-readable storage medium storing the one or more computer programs is also provided. [Explanation of symbols]
[0133] 10 Command and control device 20. Dispatcher terminal 210 Communications Department 220 Operation input section 230 Display section 240 Control Unit 241 Display control unit 242 Text analysis processing section 243 Guidance content determination section 250 Audio input / output section 260 Storage section 261 Processing data storage unit 262 Word Dictionary Data DB 50 Police Station Terminals 52 Team Member Terminal 54 In-vehicle terminal
Claims
1. a display control unit that controls the display of the screen; a determination unit that determines a selection button associated with one or more words obtained from the input information based on one or more words obtained from the input information and a database in which selection buttons displayed on the screen are associated with one or more words; Equipped with the display control unit performs on the screen a guidance display that prompts the user to select the determined selection button. Information processing device.
2. The information processing apparatus according to claim 1 , wherein the input information is information input by voice input.
3. The information processing apparatus according to claim 2 , wherein the one or more words obtained from the input information are obtained by dividing a character string obtained by converting voice data obtained by the voice input into text.
4. The information processing device according to claim 1 , wherein the display control unit performs control to display a guidance display pointing to the selected selection button.
5. The information processing apparatus according to claim 1 , wherein the determination unit searches the database for a selection button that is most frequently associated with one or more words acquired from the input information.
6. The database is prepared for each display screen, the determination unit refers to a database corresponding to the displayed screen and determines a selection button that prompts selection from among the selection buttons displayed on the screen; The information processing device according to claim 1 .
7. The one or more words obtained from the input information are stored in a storage unit; the display control performs control to display a next screen in response to selection of a selection button; the determination unit uses the one or more words stored in the storage unit when determining a selection button to prompt a selection from among the selection buttons displayed on the next screen. The information processing device according to claim 6 .
8. The information processing apparatus according to claim 1 , wherein the determination unit controls the guidance display when the operator is not at an expert level.
9. 2. The information processing device according to claim 1, wherein when an operator is at an expert level, the information processing device does not control the guidance display, but determines the screen to transition to based on one or more words based on voice input and a database in which the screens are associated with the one or more words, and performs screen transition control.
10. the screen to be transitioned to is the final screen in a series of screen transitions, The information processing device according to claim 9 , wherein the information processing device performs control to skip intermediate screens and display the final screen.
11. The information processing device according to any one of claims 1 to 10, wherein the screen is a screen related to firefighting and emergency command work.
12. The processor: Controlling the display of the screen; determining a selection button associated with one or more words obtained from the input information based on one or more words obtained from the input information and a database in which selection buttons displayed on the screen are associated with one or more words; displaying a guidance message on the screen to prompt the user to select the determined selection button; An information processing method, including:
13. Computer, a display control unit that controls the display of the screen; a determination unit that determines a selection button associated with one or more words obtained from the input information based on one or more words obtained from the input information and a database in which selection buttons displayed on the screen are associated with one or more words; It functions as the display control unit performs on the screen a guidance display that prompts the user to select the determined selection button. program.
Citation Information
Patent Citations
Information input device and information input system provided with the device
JP2000181606A