Information processing device and control method

An information processing device addresses the burden on station staff by providing answers to frequently asked questions along passenger routes, enhancing efficiency and reducing direct inquiries.

WO2026009447A1PCT designated stage Publication Date: 2026-01-08MITSUBISHI ELECTRIC CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/031126
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-07-01
Filing Date
2024-08-30
Publication Date
2026-01-08

AI Technical Summary

Technical Problem

The burden on information providers, such as station staff, is increased due to frequent inquiries from passengers in places like train stations, leading to inefficiencies in providing information.

Method used

An information processing device that acquires and analyzes questions and routes of inquirers, controlling displays to provide answers along the inquirers' routes, reducing the need for direct interaction.

Benefits of technology

Reduces the burden on information providers by allowing passengers to receive answers on displays along their routes, minimizing direct inquiries and potentially reducing system costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024031126_08012026_PF_FP_ABST
    Figure JP2024031126_08012026_PF_FP_ABST
Patent Text Reader

Abstract

An information processing device (100) has an acquisition unit (120) and a control unit (160). The acquisition unit (120) acquires an answer to a question asked in the past, and a route of a questioner of the question. The control unit (160) executes a first control process for performing control to display the answer on at least one display present on the route, or a second control process for performing control such that a terminal having a display displays the answer while moving on the route.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing device and control method

[0001] The present disclosure relates to an information processing device and a control method.

[0002] Many people are present in places such as train stations. A technology has been proposed in which a robot present in a place such as a train station displays advertisements (see Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2020-3668

[0004] Incidentally, there are information providers at places such as stations. For example, if the place is a station, the information provider is a station staff member. Many questioners may ask questions to the information provider. In such cases, the burden on the information provider increases.

[0005] The purpose of this disclosure is to reduce the burden on information providers.

[0006] According to one aspect of the present disclosure, there is provided an information processing device, the information processing device including: an acquisition unit that acquires answers to previously asked questions and a route taken by a person who asked the questions; and a control unit that executes a first control process that controls at least one display on the route to display the answers, or a second control process that controls a device having a display to display the answers while moving along the route.

[0007] According to the present disclosure, the burden on information providers can be reduced.

[0008] FIG. 1 is a diagram showing a provision system of embodiment 1. FIG. 2 is a diagram showing hardware possessed by an information processing device of embodiment 1. FIG. 3 is a block diagram showing functions of an information processing device of embodiment 1. FIG. 4 is a diagram showing an example of a station premises of embodiment 1. FIG. 5 is a diagram showing examples of a total question table and a tally table of embodiment 1. FIG. 6 is a sequence diagram showing a generation process of the tally table of embodiment 1. FIG. 7 is a diagram showing a provision system of embodiment 2. FIG. 8 is a block diagram showing functions of an information processing device of embodiment 2. FIG. 9 is a diagram showing examples of a movement table and a question and answer table of embodiment 2.

[0009] Hereinafter, an embodiment will be described with reference to the drawings.

[0010] Embodiment 1. Fig. 1 is a diagram showing a provision system according to embodiment 1. The provision system includes an information processing device 100, a terminal 200, surveillance cameras 301 and 302, and displays 401 to 406. The information processing device 100, the terminal 200, the surveillance cameras 301 and 302, and the displays 401 to 406 communicate with each other via a network. The network may be a wired network or a wireless network.

[0011] The information processing device 100 is a device that executes the control method. For example, the terminal 200 has a microphone and a display. The surveillance cameras 301 and 302 are imaging devices. FIG. 1 shows two surveillance cameras. The number of surveillance cameras is not limited to two. The displays 401 to 406 are devices that provide information. FIG. 1 shows six displays. The number of displays is not limited to six.

[0012] Next, the hardware of the information processing device 100 will be described. Fig. 2 is a diagram showing the hardware of the information processing device of embodiment 1. The information processing device 100 is also called a computer. The information processing device 100 has a processor 101, a volatile storage device 102, a non-volatile storage device 103, and a communication interface 104.

[0013] The processor 101 controls the entire information processing device 100. For example, the processor 101 is a central processing unit (CPU) or a field programmable gate array (FPGA). The processor 101 may be a multiprocessor. The information processing device 100 may also include a processing circuit.

[0014] The volatile storage device 102 is a main storage device of the information processing device 100. For example, the volatile storage device 102 is a RAM (Random Access Memory). The nonvolatile storage device 103 is an auxiliary storage device of the information processing device 100. For example, the nonvolatile storage device 103 is a HDD (Hard Disk Drive) or an SSD (Solid State Drive). The communication interface 104 communicates with the surveillance cameras 301 and 302 and the displays 401 to 406.

[0015] Next, a description will be given of the functions of the information processing device 100. Fig. 3 is a block diagram showing the functions of the information processing device of embodiment 1. The information processing device 100 has a storage unit 110, an acquisition unit 120, an analysis unit 130, a tally generation unit 140, an identification unit 150, and a control unit 160.

[0016] The storage unit 110 may be realized as a storage area secured in the volatile storage device 102 or the non-volatile storage device 103. The storage unit 110 may also be called a memory. Some or all of the acquisition unit 120, analysis unit 130, tally generation unit 140, identification unit 150, and control unit 160 may be realized by processing circuits. Furthermore, some or all of the acquisition unit 120, analysis unit 130, tally generation unit 140, identification unit 150, and control unit 160 may be realized as program modules executed by the processor 101.

[0017] The storage unit 110 may store a total questions table 111 and a tally table 112. The total questions table 111 and the tally table 112 will be described later. The functions of the acquisition unit 120, the analysis unit 130, the tally generation unit 140, the identification unit 150, and the control unit 160 will be described later.

[0018] The tally table 112 is generated based on the total question table 111. A specific example of the process of generating the tally table 112 will be described below.

[0019] FIG. 4 is a diagram showing an example of a station premises in the first embodiment. FIG. 14 shows areas 11 to 17 in the station premises. Areas 11 to 17 are referred to as areas A to G. Terminal 200 is installed in area D. Surveillance camera 301 is installed in area B. For example, surveillance camera 301 captures images of areas A to D. Surveillance camera 302 is installed in area F. For example, surveillance camera 302 captures images of areas E to G. Surveillance cameras may also be installed in each of areas A to G. Displays 401 to 406 are installed in areas A to C and E to G.

[0020] Terminal 200 is a terminal that receives an inquiry from a questioner. FIG. 1 shows questioner 10. Questioner 10 walks toward terminal 200. Surveillance camera 301 captures an image of questioner 10. Questioner 10 makes an inquiry to terminal 200. For example, the inquiry may be about alternative transportation or an event being held within a station. Terminal 200 displays a response to the inquiry on the display of terminal 200. For example, the response may indicate that alternative transportation is being held or the venue of the event. Terminal 200 transmits the inquiry and content information indicating the response to information processing device 100. Surveillance camera 301 transmits an image of the questioner to information processing device 100.

[0021] The acquisition unit 120 acquires the inquiry content (i.e., the question content) and information on the content indicating the answer from the terminal 200. The acquisition unit 120 also acquires video of the questioner from the surveillance camera 301. The analysis unit 130 analyzes the questioner's route based on the video of the questioner. For example, the analysis unit 130 detects the questioner's route "Area C - Area B - Area D." The acquisition unit 120 registers the inquiry content and information on the content indicating the answer in the total questions table 111. The analysis unit 130 also registers the questioner's route in the total questions table 111. An example of the total questions table 111 is shown below.

[0022] 5 is a diagram showing examples of a total question table and a tally table according to embodiment 1. The total question table 111 has fields for ID (identifier), time, route, question content, and answer content ID. The ID field indicates an identifier. The time field indicates the time when information was registered in the total question table 111. The route field indicates the route of the questioner. The question content field indicates the question content. The answer content ID field indicates the identifier of the content that indicates the answer to the question.

[0023] Old information registered in the total question table 111 may be deleted after a predetermined time has elapsed, so that new information remains in the total question table 111.

[0024] As shown in FIG. 5, every time the terminal 200 receives a question, the route of the questioner, the content of the question, etc. are registered in the total question table 111.

[0025] The tally generation unit 140 tally the information in the total question table 111. As a result, the tally generation unit 140 can generate the tally table 112. The tally table 112 includes fields for ID, number of questions, answer content ID, and route. The ID field indicates an identifier. The number of questions field indicates the number of questions. The answer content ID field indicates the identifier of content that indicates the answer to the question. The route field indicates the route of the questioner.

[0026] Next, the process of generating the tally table 112 will be explained using a sequence. FIG. 6 is a sequence diagram showing an example of the process of generating the tally table in embodiment 1. In FIG. 6, it is assumed that the surveillance camera 301 captures an image of the questioner. (Step ST101) The surveillance camera 301 captures an image of the questioner. (Step ST102) The terminal 200 receives an inquiry from the questioner. (Step ST103) The terminal 200 displays a response to the inquiry on the display of the terminal 200. Note that the displayed content may be information consisting of text only, or may also include information including pictures. (Step ST104) The surveillance camera 301 transmits an image of the questioner to the information processing device 100.

[0027] (Step ST105) Terminal 200 transmits the inquiry content and information on the content indicating the answer to information processing device 100. (Step ST106) Acquisition unit 120 of information processing device 100 acquires the inquiry content, information on the content indicating the answer, and video of the questioner. (Step ST107) Analysis unit 130 of information processing device 100 analyzes the questioner's route based on the video of the questioner. (Step ST108) Acquisition unit 120 of information processing device 100 registers the inquiry content and information on the content indicating the answer in total questions table 111. In addition, analysis unit 130 registers the questioner's route in total questions table 111. Every time terminal 200 receives a question, steps ST101 to ST108 are executed.

[0028] (Step ST109) After a predetermined period of time has elapsed since the information was first registered in the total questions table 111, the tally generation unit 140 of the information processing device 100 tally the information in the total questions table 111. This allows the tally generation unit 140 to generate the tally table 112. In this manner, the tally table 112 is generated. Then, answers to questions that have been asked in the past are registered in the tally table 112.

[0029] Furthermore, after the questioner views the answer displayed on the terminal 200, the information processing device 100 may display the answer on a display located along the route along which the questioner is moving. For example, after the questioner views the answer displayed on the terminal 200, the questioner moves to areas F and G. The surveillance camera 302 captures an image of the questioner. The surveillance camera 302 transmits the image to the information processing device 100. The analysis unit 130 analyzes the image to detect the questioner's route, "area F - area G." Then, when the information processing device 100 acquires from the surveillance camera 301 an image of the questioner viewing the answer displayed on the terminal 200, it performs control to display the answer on the displays 405 and 406. As a result, the displays 405 and 406 display the answer. By displaying the answer on the displays 405 and 406, the questioner does not need to return to the terminal 200 if he or she forgets the answer.

[0030] Next, a process for displaying answers on the display will be described. The identification unit 150 identifies the answer to the most frequently asked question and the route taken by the person who asked the question based on the tally table 112. That is, the identification unit 150 identifies the answer to the most frequently asked question in a predetermined period of time and the route taken by the person who asked the question. For example, in the case of FIG. 5, the identification unit 150 identifies the record with ID "B001."

[0031] The acquisition unit 120 acquires the identified answer and the identified route from the identification unit 150. The control unit 160 performs control so that the identified answer is displayed on at least one display located on the identified route. Specifically, the control unit 160 transmits information about the answer and a display instruction to a display located on the route. As a result, the display displays the answer.

[0032] A specific example of the control process will be described. The content ID of the answer to the most frequently asked question is assumed to be ANS005. The route is assumed to be "area C - area B - area D." The control unit 160 transmits the content of ANS005 and a display instruction to the terminal 200 and displays 402, 403. As a result, the terminal 200 and displays 402, 403 display the content of ANS005.

[0033] The control unit 160 may also perform control so that the question and the answer are displayed on at least one display on the route. The above process by the control unit 160 is also referred to as a first control process.

[0034] According to the first embodiment, the information processing device 100 performs control so that the answer to the most frequently asked question is displayed on at least one display present on the route of the asker of the question. That is, before the asker asks the question to the information provider, the information processing device 100 performs control so that the answer is displayed on at least one display present on the route. As the asker moves along the route, the asker visually recognizes the answer displayed on a display present on the route. Therefore, the asker does not ask the question to the information provider. Therefore, fewer questions are asked of the information provider. In this way, the information processing device 100 can reduce the burden on the information provider. For example, if the information provider is a station employee, the burden on the station employee is reduced.

[0035] Second Embodiment Next, a second embodiment will be described. In the second embodiment, differences from the first embodiment will be mainly described. In the second embodiment, descriptions of commonalities with the first embodiment will be omitted. In the first embodiment, the case where the terminal 200 is fixed is shown. In the second embodiment, the case where the terminal moves is described.

[0036] FIG. 7 is a diagram showing a provision system according to a second embodiment. The provision system includes an information processing device 100 and terminals 200a_1 and 200a_2. The information processing device 100 and the terminals 200a_1 and 200a_2 communicate with each other via a network. FIG. 7 shows two terminals. The number of terminals may be three or more. Furthermore, the terminals 200a_1 and 200a_2 are collectively referred to as terminal 200a.

[0037] The terminal 200a is a mobile terminal. For example, the terminal 200a has a camera, a display, a microphone, a speaker, and a touch panel. The terminal 200a can have a voice dialogue with a user. The terminal 200a accepts an inquiry from a questioner. The terminal 200a also captures an image of the questioner. The terminal 200a analyzes the route of the questioner based on the captured image. The terminal 200a displays a response to the inquiry. The terminal 200a transmits the route, the content of the inquiry, and the response to the information processing device 100.

[0038] 8 is a block diagram showing the functions of the information processing apparatus according to embodiment 2. The storage unit 110 may store a transfer table 113 and a question and answer table 114.

[0039] The acquisition unit 120 registers the route in the movement table 113. The analysis unit 130 may also analyze the route. When the analysis unit 130 analyzes the route, the acquisition unit 120 acquires the video from the terminal 200a. The analysis unit 130 then analyzes the route using the video. The acquisition unit 120 registers the inquiry content and the answer in the question and answer table 114. Examples of the movement table 113 and the question and answer table 114 are shown below.

[0040] 9 is a diagram showing examples of a movement table and a question and answer table according to the second embodiment. The movement table 113 has fields for ID, time, terminal ID, and route. The ID field indicates an identifier. The time field indicates the time when the information was registered. The terminal ID field registers the ID of the terminal that transmitted the information to the information processing device 100. For example, terminal ID "MT001" is the identifier of terminal 200a_1. Terminal ID "MT002" is the identifier of terminal 200a_2. The route field indicates the route of the questioner.

[0041] The question and answer table 114 has the following fields: ID, time, terminal ID, question content, and answer content ID. The ID field indicates an identifier. The time field indicates the time when the information was registered. The terminal ID field registers the ID of the terminal that sent the information to the information processing device 100. The question content field indicates the question content. The answer content ID field indicates the identifier of the answer.

[0042] The tally generation unit 140 generates the total questions table 111 based on the transfer table 113 and the question and answer table 114. After a predetermined period of time has elapsed, the tally generation unit 140 tally the information in the total questions table 111. In this way, the tally generation unit 140 can generate the tally table 112.

[0043] The identification unit 150 identifies the answer to the most frequently asked question and the route taken by the person asking the question based on the aggregation table 112. That is, the identification unit 150 identifies the answer to the most frequently asked question in a predetermined period of time and the route taken by the person asking the question. The acquisition unit 120 acquires the identified answer and the identified route from the identification unit 150.

[0044] The control unit 160 controls the terminal 200a to display the identified answer while moving along the identified route. Specifically, the control unit 160 transmits an instruction to move along the identified route, information about the answer, and a display instruction. As a result, the terminal 200a displays the information about the answer on the display of the terminal 200a while moving along the identified route. Note that, for example, the terminal 200a that receives an instruction from the information processing device 100 may be the terminal 200a_1 or the terminal 200a_2.

[0045] Furthermore, the control unit 160 may control the terminal 200a to display the specified answer and question while the terminal 200a moves along the specified route. The above process by the control unit 160 is also referred to as a second control process.

[0046] According to the second embodiment, the terminal 200a displays the identified answer while moving along the identified route. That is, before the questioner asks the information provider the question, the information processing device 100 controls the terminal 200a to display information about the answer while moving along the route. As the questioner moves along the route, the questioner visually checks the answer displayed by the terminal 200a. Therefore, the questioner does not ask the information provider the question. Therefore, fewer questions are asked of the information provider. In this way, the information processing device 100 can reduce the burden on the information provider. Furthermore, the terminal 200a displays information about the answer while moving along the route. Therefore, a display does not need to be installed along the route. This reduces the cost of the information providing system.

[0047] Embodiment 3 Next, embodiment 3 will be described. In embodiment 3, differences from embodiment 2 will be mainly described. Furthermore, in embodiment 3, descriptions of matters common to embodiment 2 will be omitted.

[0048] It is assumed that terminal 200a is displaying an answer in response to an instruction from information processing device 100. Terminal 200a captures an image of a user viewing the answer using a camera of terminal 200a. Terminal 200a measures the cumulative viewing time of the answer over a predetermined period. In other words, the cumulative viewing time is the total value of the time spent viewing by one or more users. Terminal 200a transmits the cumulative viewing time to information processing device 100.

[0049] The acquisition unit 120 acquires the cumulative viewing time from the terminal 200a. When the cumulative viewing time is equal to or greater than a predetermined threshold, the control unit 160 instructs the terminal 200a to continue displaying. When the cumulative viewing time is less than the threshold, the control unit 160 performs control to stop the display on the terminal 200a or control to reduce the frequency of movement of the terminal 200a. In particular, when performing control to stop the display on the terminal 200a, the control unit 160 transmits an instruction to stop the display to the terminal 200a. When performing control to reduce the frequency of movement of the terminal 200a, the control unit 160 transmits an instruction to the terminal 200a to reduce the frequency of movement.

[0050] In this way, if the answer (i.e., the content) is not viewed, the information processing device 100 can stop displaying the content that the user is not interested in. If the frequency of movement of the terminal 200a decreases, the information processing device 100 can reduce the power consumption of the terminal 200a.

[0051] The terminal 200a may use a camera of the terminal 200a to count the number of users who viewed the answer during a predetermined period. The terminal 200a may transmit the number to the information processing device 100. The acquisition unit 120 acquires the number from the terminal 200a. If the number is equal to or greater than a predetermined threshold, the control unit 160 instructs the terminal 200a to continue displaying the answer. If the number is smaller than the threshold, the control unit 160 performs control to stop the display on the terminal 200a or to reduce the frequency of movement of the terminal 200a. If the answer has not been viewed, the information processing device 100 can stop the display of content that the user is not interested in. If the frequency of movement of the terminal 200a decreases, the information processing device 100 can reduce the power consumption of the terminal 200a.

[0052] The terminal 200a may transmit information indicating whether or not the touch panel of the terminal 200a has been operated within a predetermined period to the information processing device 100. The acquisition unit 120 acquires the information from the terminal 200a. If the touch panel has not been operated, the control unit 160 performs control to stop the display of the terminal 200a or control to reduce the frequency of movement of the terminal 200a. If the display of the terminal 200a is stopped, the information processing device 100 can stop displaying content that the user is not interested in. If the frequency of movement of the terminal 200a decreases, the information processing device 100 can reduce the power consumption of the terminal 200a.

[0053] The terminal 200a may transmit to the information processing device 100 information indicating whether or not the user has had a voice interaction with the terminal 200a within a predetermined period. The acquisition unit 120 acquires the information from the terminal 200a. When a voice interaction is not being performed, the control unit 160 performs control to stop the display of the terminal 200a or control to reduce the frequency of movement of the terminal 200a. When the display of the terminal 200a is stopped, the information processing device 100 can stop displaying content that the user is not interested in. When the frequency of movement of the terminal 200a decreases, the information processing device 100 can reduce the power consumption of the terminal 200a.

[0054] In the above, the case where the information processing device 100 generates the tally table 112 has been described. The tally table 112 may be generated by an external device. The external device is a device that exists outside the information processing device 100. For example, the external device is a cloud server. The illustration of the external device is omitted. Furthermore, at least one of the total question table 111 and the tally table 112 may be generated by an information provider.

[0055] In the above description, the identification unit 150 identifies the answer to the most frequently asked question and the route of the asker of the question based on the tally table 112. The identification process may be performed by an external device. When the external device performs the identification process, the acquisition unit 120 acquires the identified answer and the identified route from the external device.

[0056] The above describes a case where the answer to the most frequently asked question and the route taken by the asker of the question are identified. The identified answer does not have to be the answer to the most frequently asked question. For example, the identified answer may be the answer to the second most frequently asked question.

[0057] The first to third embodiments have been described as being implemented within a train station. The first to third embodiments may also be implemented in a home improvement store, a mall, an amusement park, etc. For example, if the first to third embodiments are implemented in a home improvement store, a mall, an amusement park, etc., the information provider is a guide at the home improvement store, the mall, the amusement park, etc.

[0058] The embodiments are merely examples, and various modifications are possible within the scope of the present disclosure. Furthermore, the features of the embodiments can be combined with each other as appropriate.

[0059] 10 Questioner, 11-17 Areas, 100 Information Processing Device, 101 Processor, 102 Volatile Storage Device, 103 Non-volatile Storage Device, 104 Communication Interface, 110 Storage Unit, 111 Total Question Table, 112 Aggregation Table, 113 Movement Table, 114 Question and Answer Table, 120 Acquisition Unit, 130 Analysis Unit, 140 Aggregation Generation Unit, 150 Identification Unit, 160 Control Unit, 200 Terminal, 200a Terminal, 301, 302 Surveillance Cameras, 401-406 Displays.

Claims

1. An information processing device having: an acquisition unit that acquires answers to questions that have been asked in the past and the route of the person who asked the question; and a control unit that executes a first control process that controls so that the answer is displayed on at least one display located on the route, or a second control process that controls so that the answer is displayed on a terminal having a display while moving along the route.

2. The information processing device according to claim 1, wherein the question is the most frequently asked question in a predetermined period of time.

3. An information processing device as described in claim 1 or 2, wherein the acquisition unit acquires the cumulative viewing time of the answer over a predetermined period from the terminal, and the control unit performs control to stop the display of the terminal or control to reduce the frequency of movement of the terminal when the cumulative viewing time is less than a predetermined threshold.

4. An information processing device as described in claim 1 or 2, wherein the acquisition unit acquires from the terminal the number of users who viewed the answer during a predetermined period, and the control unit performs control to stop displaying the terminal or control to reduce the frequency of movement of the terminal if the number is smaller than a predetermined threshold.

5. An information processing device according to claim 1 or 2, wherein the acquisition unit acquires from the terminal information indicating whether or not the touch panel of the terminal has been operated within a predetermined period, and the control unit performs control to stop the display of the terminal or control to reduce the frequency of movement of the terminal when the touch panel has not been operated.

6. An information processing device as described in claim 1 or 2, wherein the acquisition unit acquires information indicating whether or not the user has had a voice interaction with the terminal within a predetermined period, and the control unit performs control to stop the display of the terminal or control to reduce the frequency of movement of the terminal when the voice interaction is not being performed.

7. A control method in which an information processing device acquires an answer to a question that has been asked in the past and the route of the person who asked the question, and executes a first control process to control the device to display the answer on at least one display located on the route, or a second control process to control a terminal having a display to display the answer while moving along the route.

Citation Information

Patent Citations

  • Robot milage system and milage point assignment method

    JP2008140004A

  • Display device, content display method, and program

    JP2015064513A

  • Digital signage controller, method for controlling digital signage, program, and recording medium

    JP2019035615A

  • Guide system

    JP2020176960A

  • Information processing system, information processing program, information processing apparatus, and information processing method

    JP2021064039A