Information presentation device, information presentation method, and program

The information presentation device dynamically adjusts screen layouts based on user positions, enhancing user experience by optimizing display content for multi-user interactions.

JP7602179B2Active Publication Date: 2024-12-18NIPPON TELEGRAPH & TELEPHONE CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023520656
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-05-12
Publication Date
2024-12-18
Estimated Expiration
2041-05-12

AI Technical Summary

Technical Problem

Existing information presentation devices fail to dynamically adjust screen layouts based on the positional relationship between users, particularly in multi-user scenarios, leading to suboptimal viewing experiences.

Method used

An information presentation device that acquires user position information and dynamically determines screen layouts based on the positional relationship between users, using methods such as microphone, camera, or Bluetooth to estimate positions, and adjusts display content accordingly.

Benefits of technology

Enables dynamic screen layout adjustments that match the characteristics of the conversation, improving user experience without complex operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007602179000001
    Figure 0007602179000001
  • Figure 0007602179000002
    Figure 0007602179000002
  • Figure 0007602179000003
    Figure 0007602179000003
Patent Text Reader

Abstract

An information presentation device (1), according to the present invention, comprises: a positional relation estimation unit (11) that acquires information about the position of a user, and estimates the positional relationship of the user with respect to a display; and a screen layout determination unit (12) that dynamically determines a screen layout according to the positional relationship, and outputs display information based on the screen layout to a display (13).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information presentation device, an information presentation method, and a program. [Background technology]

[0002] Conventionally, in an information presentation device in which a person serving (hereinafter, referring to, for example, a customer service staff member) and a conversation partner (hereinafter, referring to the counterpart of the person serving, referring to a customer making an inquiry in a customer service scene) communicate and exchange information to be communicated, such as text, text information expressing the conversation partner's intentions and some of the person serving's corresponding replies and answers as text information that the conversation partner can understand are displayed simultaneously on the same screen of a single display. In addition, in an interlingual dialogue device, which is an example of an information presentation device, utterances of a person serving and a conversation partner who speak different languages ​​are translated and displayed simultaneously on the same screen of a single display as text information that enables communication between the two. Furthermore, a process is performed in which the display direction of only the display portion related to the conversation partner on one display screen is rotated to make the text information to be communicated to the conversation partner easier to see.

[0003] For example, Patent Document 1 describes an interlingual dialogue device that enables communication between users (hereinafter, conversation participants, a collective term for the respondent and the conversation partner) who use different languages ​​on each of a plurality of terminal units, and Patent Document 2 describes a dialogue processing method that enables communication between users who use different languages. Patent Document 3 describes an information display device that includes a means for displaying information to be transmitted by a respondent to a conversation partner by inverting the display method of the information on the information display device so that the information to be transmitted is displayed in an orientation that is easy for the conversation partner to view. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2004-355226 A [Patent Document 2] JP 2005-322145 A [Patent Document 3] JP 2001-195049 A Summary of the Invention [Problem to be solved by the invention]

[0005] Patent Documents 1 and 2 propose ways to facilitate smooth communication, such as translation, but do not consider the user's position or a method for dynamically controlling the layout based on that. Patent Document 3 also considers the ease of viewing information for users by inverting the display of information, but does not consider dynamic control of the screen layout in response to changes in the user's position.

[0006] In view of the above circumstances, an object of the present invention is to provide an information presentation device, an information presentation method, and a program that are capable of dynamically changing a screen layout in accordance with the positional relationship of a user. [Means for solving the problem]

[0007] In order to solve the above problem, an information presentation device in one embodiment is an information presentation device that presents information to multiple users via a display, and includes a positional relationship estimation unit that acquires positional information of the users and estimates a positional relationship of the users to the display, and a screen layout determination unit that dynamically determines a screen layout in accordance with the positional relationship and outputs display information based on the screen layout to the display.

[0008] In addition, in order to solve the above problem, an information presentation method according to one embodiment is an information presentation method in an information presentation device that presents information to multiple users via a display, and includes a step of acquiring position information of the user by the information presentation device and estimating a positional relationship of the user to the display, and a step of dynamically determining a screen layout according to the positional relationship, and outputting display information based on the screen layout to the display.

[0009] In order to solve the above problem, a program according to one embodiment causes a computer to function as the information presentation device. Effect of the Invention

[0010] According to the present invention, information can be used in a screen layout that corresponds to the characteristics of the conversation, without complicated operations. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing an example of the configuration of an information presentation device according to a first embodiment. [Figure 2A] FIG. 13 is a schematic diagram showing a screen layout based on an estimated positional relationship. [Figure 2B] FIG. 13 is a schematic diagram showing a screen layout based on an estimated positional relationship. [Diagram 3] 11A and 11B are diagrams illustrating dynamic changes in the screen layout according to positional relationships during dialogue. [Figure 4] 4 is a flowchart showing an example of an information presenting method executed by the information presenting device according to the first embodiment. [Diagram 5] FIG. 11 is a block diagram showing an example of the configuration of an information presentation device according to a second embodiment. [Figure 6] 10 is a flowchart showing an example of an information presenting method executed by an information presenting device according to a second embodiment. [Figure 7] FIG. 13 is a block diagram showing an example of the configuration of an information presentation device according to a third embodiment. [Figure 8]13 is a flowchart showing an example of an information presenting method executed by an information presenting device according to a third embodiment. [Figure 9A] FIG. 13 is a block diagram showing an example of the configuration of an information presentation device according to a fourth embodiment. [Figure 9B] FIG. 13 is a block diagram showing an example of the configuration of an information presentation device according to a fourth embodiment. [Figure 10A] FIG. 1 is a schematic diagram illustrating a display that can be viewed from any position within 360 degrees. [Figure 10B] FIG. 1 is a schematic diagram illustrating a display that can be viewed from any position within 360 degrees. [Figure 11] FIG. 13 is a block diagram showing an example of the configuration of an information presentation device according to a fifth embodiment. [Figure 12] FIG. 1 is a schematic diagram showing how a plurality of devices cooperate to present information. [Figure 13] 13 is a flowchart illustrating an example of an information presenting method executed by an information presenting device according to a fifth embodiment. [Figure 14] FIG. 2 is a block diagram showing a schematic configuration of a computer functioning as an information presentation device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0013] (First embodiment) Fig. 1 is a block diagram showing an example of the configuration of an information display device 1 according to a first embodiment. The information display device 1 shown in Fig. 1 includes a positional relationship estimation unit 11, a screen layout determination unit 12, and a screen display unit 13. Note that the screen display unit 13 may be provided outside the information display device 1.

[0014] The positional relationship estimation unit 11 receives and acquires the user's positional information, and estimates the user's positional relationship with respect to the screen display unit 13 (hereinafter simply referred to as "positional relationship"). Then, the positional relationship estimation unit 11 outputs the positional relationship information indicating the estimated positional relationship to the screen layout determination unit 12. The user's positional information is acquired using a microphone, an environmental camera, Bluetooth (registered trademark), UWB (Ultra Wide Band), or the like that functions in cooperation with the information presentation device 1, and is transmitted to the positional relationship estimation unit 11.

[0015] The screen layout determination unit 12 dynamically determines the screen layout of the information to be presented in accordance with the positional relationship estimated by the positional relationship estimation unit 11. Then, the screen layout determination unit 12 generates display information based on the determined screen layout and outputs it to the screen display unit 13.

[0016] The screen display unit 13 is a display that displays the display information input from the screen layout determination unit 12. The screen display unit 13 is, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The display may be a transmissive display.

[0017] In FIG. 2A and FIG. 2B, the information display device 1 estimates the positional relationship of three users U1, U2, and U3, determines a screen layout based on the estimated positional relationship, and outputs information based on the determined screen layout to the transparent display D (screen display unit 13). In FIG. 2A, user U3 is talking with users U1 and U2 who are side by side across the transparent display D. At this time, normal characters are presented on the screen used by user U3 from the user U3's perspective, and inverted characters are presented on the screen used by users U1 and U2. In FIG. 2B, users U2 and U3 who are side by side are talking with user U1 across the transparent display D. At this time, normal characters are presented on the screen used by users U2 and U3 from the user U2 and U3's perspective, and inverted characters are presented on the screen used by user U1.

[0018] FIG. 3 is a diagram for explaining dynamic change of the screen layout according to the positional relationship during conversation. The positional relationship during conversation includes a form in which the respondent and the conversation partner face each other with one transparent display D between them and view the screen (hereinafter referred to as form A) and a form in which the respondent and the conversation partner view the same screen of one transparent display D side by side (hereinafter referred to as form B) according to the characteristics of the conversation. According to these positional relationships, in form A shown on the left of FIG. 3, a screen layout is presented in which normal characters are presented on the screen of the respondent and inverted characters are presented on the screen of the conversation partner. On the other hand, in form B shown on the right of FIG. 3, a screen layout is presented in which normal characters are presented on the screens of the respondent and the conversation partner. Here, when the positional relationship during the conversation between the respondent and the conversation partner changes, the screen layout is dynamically changed according to the positional relationship. In form B, the viewing direction of the respondent and the conversation partner is the same, making it easy to have a conversation by referring to objects.

[0019] For example, it is possible to start face-to-face interaction with a foreign tourist using mode A, using translation, and then, midway through the conversation, continue the conversation using mode B, using nearby information boards.

[0020] FIG. 4 is a flowchart showing an example of an information display method executed by the information display device 1.

[0021] In step S101, upon receiving user position information, the positional relationship estimation unit 11 estimates the positional relationship.

[0022] In step S102, screen layout determination section 12 determines the screen layout of information to be presented based on the positional relationship estimated by positional relationship estimation section 11.

[0023] In step S 103 , the screen display unit 13 displays information based on the screen layout determined by the screen layout determination unit 12 .

[0024] In step S104, if it is determined that the conversation is continuing, steps S101 to S103 are repeatedly executed, and if the positional relationship during this time changes from form A to form B, or from form B to form A, the screen layout for displaying information is changed accordingly, as shown in Fig. 3. If it is determined that the conversation has ended, the information display is terminated.

[0025] According to the information presentation device 1 of this embodiment, it is possible to dynamically change the screen layout according to the positional relationship, and information can be used in a screen layout that corresponds to the characteristics of the conversation, such as the number of participants and the direction in which the information is viewed, without complicated operations.

[0026] Second Embodiment Next, an example of acquiring user position information using voice will be described as a second embodiment. FIG. 5 is a block diagram showing a configuration example of an information display device 2 according to the second embodiment. The information display device 2 shown in FIG. 5 includes a positional relationship estimation unit 11, a screen layout determination unit 12, a screen display unit 13, a voice acquisition unit 14, a speaker / position estimation unit 15, and a positional relationship DB 16. The information display device 2 is different from the information display device 1 according to the first embodiment in that it further includes the voice acquisition unit 14, the speaker / position estimation unit 15, and the positional relationship DB 16. The same configurations as those of the first embodiment are denoted by the same reference numbers as those of the first embodiment, and descriptions thereof will be omitted as appropriate.

[0027] The voice acquiring unit 14 is a microphone that acquires the user's voice, etc. The voice acquiring unit 14 outputs voice information indicating the acquired voice to the speaker / position estimating unit 15.

[0028] The positional relationship DB 16 stores the user's location and the location of the voice capture unit 14 in association with each other.

[0029] The speaker / position estimation unit 15 estimates the position of a speaker (a user who has spoken at a certain point in time) based on the voice acquired by the voice acquisition unit 14. For example, if the voice acquisition unit 14 is a directional microphone or a microphone array, the speaker / position estimation unit 15 can estimate the position of the speaker based on the volume of the voice. Then, the speaker / position estimation unit 15 outputs position information indicating the estimated speaking position to the positional relationship estimation unit 11, and updates the speaker position information stored in the positional relationship DB 16.

[0030] When the speaker / position estimation unit 15 finishes processing, the positional relationship estimation unit 11 refers to the positional relationship DB 16 and estimates the positional relationship between speakers participating in the conversation. For example, if there are two speakers, A and B, it is estimated that speakers A and B are standing on the same side of the display, with speaker A on the right and speaker B on the left. As another example, it is estimated that speakers A and B are standing on different sides of the display and facing each other. Then, the positional relationship estimation unit 11 outputs positional relationship information indicating the estimated positional relationship to the screen layout determination unit 12.

[0031] FIG. 6 is a flowchart showing an example of an information display method executed by the information display device 2 according to the second embodiment.

[0032] Before the information display device 2 executes the information display method, the user's position and the microphone position are associated with each other and stored in the positional relationship DB 16 as advance preparation.

[0033] In step S201, the voice acquisition unit 14 of the information display device 2 acquires a spoken voice.

[0034] In step S 202 , the speaker / position estimation unit 15 estimates the speaker and its position based on the acquired voice data, and updates the speaker and its position information stored in the positional relationship DB 16 .

[0035] In step S203, the positional relationship estimation unit 11 estimates the positional relationship of speakers participating in the conversation based on the information stored in the positional relationship DB 16.

[0036] In step S204, the screen layout determination unit 12 determines the screen layout of the information to be presented based on the positional relationship estimated by the positional relationship estimation unit 11.

[0037] In step S 205 , the screen display unit 13 displays information based on the screen layout determined by the screen layout determination unit 12 .

[0038] In step S206, if it is determined that the conversation is continuing, steps S201 to S205 are repeatedly executed, and if the positional relationship of the speaker changes during this time from form A to form B, or from form B to form A, the screen layout for displaying information is changed accordingly, as shown in Fig. 3. If it is determined that the conversation has ended, the information display is terminated.

[0039] According to the information display device 2 according to this embodiment, it is possible to obtain the user's position information by a simple method.

[0040] (Third embodiment) Next, an example of acquiring user position information using an image will be described as a third embodiment. FIG. 7 is a block diagram showing a configuration example of an information display device 3 according to a third embodiment. The information display device 3 shown in FIG. 7 includes a positional relationship estimation unit 11, a screen layout determination unit 12, a screen display unit 13, a speaker / position estimation unit 15, a positional relationship DB 16, an image acquisition unit 17, and a face authentication DB 18. The information display device 3 is different from the information display device 2 according to the second embodiment in that it includes an image acquisition unit 17 instead of the voice acquisition unit 14, and further includes a face authentication DB 18. The same configurations as those of the second embodiment are denoted by the same reference numbers as those of the second embodiment, and the description thereof will be omitted as appropriate.

[0041] The image acquisition unit 17 is a camera or the like that acquires image information of a user. The image acquisition unit 17 outputs the acquired image information showing the face of the speaker to be used for face recognition and face authentication to the speaker / position estimation unit 15.

[0042] Here, face authentication refers to an authentication method that identifies an individual based on the positions of characteristic points such as the eyes, nose, and mouth on the face, and the position and size of the face area. On the other hand, face recognition identifies that the person is a person, but does not identify the individual. In other words, face authentication based on the information registered in the face authentication DB 18 makes it possible to distinguish between a customer and a waiter.

[0043] The face recognition DB 18 registers in advance face recognition information required for identifying the person who answers the phone as a specific individual through face recognition.

[0044] The speaker / position estimation unit 15 performs face recognition based on the image information acquired by the image acquisition unit 17, and estimates the user's position information. Then, the speaker / position estimation unit 15 outputs the estimated user's position information to the positional relationship estimation unit 11. The speaker / position estimation unit 15 also updates the user's position information stored in the positional relationship DB 16.

[0045] Furthermore, the speaker / position estimation unit 15 performs face recognition based on the face recognition information registered in the face recognition DB 18 and the image information acquired by the image acquisition unit 17, and estimates the positions of the person who serves the person and other users by distinguishing between them. The person who serves the person is, for example, a customer service staff member, and the other users are, for example, people with whom the person serves the person.

[0046] The positional relationship estimation unit 11, when the processing by the speaker / position estimation unit 15 ends, estimates the positional relationship by referring to the positional relationship DB 16, and outputs the estimated positional relationship to the screen layout determination unit 12. In the above-mentioned second embodiment, since face recognition is not used, the use position of the person who answers the phone and the position of the microphone are linked and stored in the positional relationship DB 16 as advance preparation, but since face recognition is used in the third embodiment, it is not necessary to determine the position of the person who answers the phone in advance.

[0047] The information display device 3 according to the third embodiment may further include the above-mentioned voice acquisition unit 14 in addition to the image acquisition unit 17. The voice acquisition unit 14 outputs voice information indicating the acquired voice to the speaker / position estimation unit 15. This enables the speaker / position estimation unit 15 to estimate the speaking position based on the voice acquired by the voice acquisition unit 14.

[0048] FIG. 8 is a flowchart showing an example of an information display method executed by the information display device 3 according to the third embodiment.

[0049] Before the information display device 3 executes the information display method, information on the person in charge of identifying the person in charge as a specific individual by face recognition is registered in the face recognition DB 18 as a preliminary preparation.

[0050] In step S301, the image acquisition unit 17 of the information display device 3 acquires image information of the face of a speaker for executing face authentication and face recognition.

[0051] In step S302, the speaker / position estimation unit 15 executes face authentication and face recognition to estimate the speaker and its position, and updates the speaker position information stored in the positional relationship DB 16.

[0052] In step S303, the positional relationship estimation unit 11 estimates the positional relationship of speakers participating in the conversation based on the information stored in the positional relationship DB 16.

[0053] In step S304, screen layout determination section 12 determines the screen layout of information to be presented based on the positional relationship estimated by positional relationship estimation section 11.

[0054] In step S 305 , the screen display unit 13 displays information based on the screen layout determined by the screen layout determination unit 12 .

[0055] In step S306, if it is determined that the conversation is continuing, steps S301 to S305 are repeatedly executed, and if the positional relationship during this time changes from form A to form B, or from form B to form A, the screen layout for displaying information is changed accordingly, as shown in Fig. 3. If it is determined that the conversation has ended, the information display is terminated.

[0056] According to the information display device 3 of this embodiment, the user's location information can be acquired by a simple method. In addition, since the respondent and other users can be distinguished, it is possible to present different information to the respondent and other users. In addition, when the image acquisition unit 17 is combined with the voice acquisition unit 14, the user's location information can be acquired with higher accuracy.

[0057] (Fourth embodiment) 9A and 9B are block diagrams showing a configuration example of an information display device 4 according to a fourth embodiment. The information display device 4 according to the fourth embodiment is an information display device having a screen display unit that is not only flat but also has a display that can be viewed from any position in 360 degrees. For this reason, the reference numeral 13' is used for the screen display unit of the information display device 4 instead of 13. FIG. 9A is different from FIG. 5, which is a block diagram of the information display device 2 according to the second embodiment, in that it has a screen display unit 13'. FIG. 9B is different from FIG. 7, which is a block diagram of the information display device 3 according to the third embodiment, in that it has a screen display unit 13'.

[0058] As shown in Fig. 10A, when using a display D that can be viewed from any position in 360 degrees, information is output in normal characters when users U1, U2, and U3 look at the screen from their respective positions. Fig. 10B is a bird's-eye view of Fig. 10A from above.

[0059] According to the information display device 4 of this embodiment, the degree of freedom in the viewing direction can be increased, and for example, it becomes possible to display an aerial image.

[0060] Fifth embodiment FIG. 11 is a block diagram showing a configuration example of an information display device 5 according to a fifth embodiment. The information display device 5 shown in FIG. 11 includes a positional relationship estimation unit 11, a screen layout determination unit 12, a screen display unit 13a, a voice acquisition unit 14, a speaker / position estimation unit 15, a positional relationship DB 16, a screen output distribution unit 19, and a screen position DB 20. The information display device 5 is different from the information display device 2 according to the second embodiment in that the information display device 5 further includes the screen output distribution unit 19 and the screen position DB 20. The same components as those in the second embodiment are denoted by the same reference numerals as those in the second embodiment, and the description thereof will be omitted as appropriate. The information display device 5 is connected to one or more screen display units 13b to 13n.

[0061] The screen position DB 20 stores position information of each of the multiple screen display units 13a to 13n.

[0062] The screen layout determination unit 12 determines the screen layout of each of the screen display units 13a to 13n based on the positional relationship estimated by the positional relationship estimation unit 11 and the positional information stored in the screen position DB 20. Then, the screen layout determination unit 12 outputs to the screen output allocation unit 19 display information based on the screen layout of each of the screen display units 13a to 13n.

[0063] 12, when users U1, U2, and U3 are participating in a conversation, the screen layout determination unit 12 generates display information to be presented to user U1 on the transparent display D1, and generates display information to be presented to users U2 and U3 on the transparent display D2, based on the positional relationship between users U1, U2, and U3 and the positions of transparent displays D1 and D2. In the example shown in Fig. 12, as seen from user U2, normal characters are presented on the screen used by user U2, and inverted characters are presented on the screen used by users U1 and U3.

[0064] The screen output distribution unit 19 distributes and transfers the display information input from the screen layout determination unit 12 to the multiple screen display units 13a to 13n.

[0065] The information display device 5 according to the fifth embodiment may present information in cooperation with a plurality of devices. That is, the information display device 5 may present information on a display of a device owned by a conversation partner and provided outside the information display device 5 in cooperation with the device. In this case, the screen display units 13b to 13n in FIG. 11 refer to displays in a plurality of devices. The devices include mobile information terminals such as smartphones and tablets. In this case, the screen output distribution unit 19 transfers display information to the device by short-distance wireless communication such as Bluetooth and UWB.

[0066] The information presentation device 5 according to the fifth embodiment may further include the above-mentioned image acquisition unit 17 and face authentication DB 18 in addition to the voice acquisition unit 14. The image acquisition unit 17 outputs the acquired image information indicating the face of the speaker used for face recognition and face authentication to the speaker / position estimation unit 15. This enables the speaker / position estimation unit 15 to execute face authentication and face recognition based on the image acquired by the image acquisition unit 17, and estimate the position information of the user.

[0067] FIG. 13 is a flowchart showing an example of an information display method executed by the information display device 5 according to the fifth embodiment.

[0068] Before starting the execution of the information presentation method, the positions of each screen are stored in the screen position DB 20 as a preliminary preparation.

[0069] In step S401, the voice acquisition unit 14 of the information display device 5 acquires a spoken voice.

[0070] In step S 402 , the speaker / position estimation unit 15 estimates the speaker and his / her position, and updates the speaker and his / her position information stored in the positional relationship DB 16 .

[0071] In step S403, the positional relationship estimation unit 11 estimates the positional relationship of speakers participating in the conversation based on the information stored in the positional relationship DB 16.

[0072] In step S 404 , screen layout determination section 12 determines the screen layout of the information to be presented based on the positional relationship estimated by positional relationship estimation section 11 and the positional information of each screen stored in screen position DB 20 .

[0073] In step S405, the screen output distribution unit 19 requests each of the screen display units 13a to 13n to determine the display contents and display output based on the screen layout passed from the screen layout determination unit 12.

[0074] In step S406, the screen display units 13a to 13n output information based on the determined screen layout to the screen.

[0075] In step S407, if it is determined that the conversation is continuing, steps S401 to S406 are repeatedly executed, and if the position of the speaker changes during this time from form A to form B, or from form B to form A, the screen layout for displaying information is changed accordingly, as shown in Fig. 3. If it is determined that the conversation has ended, the information display is terminated.

[0076] The positional relationship estimation unit 11, the screen layout determination unit 12, the speaker / position estimation unit 15, and the screen output allocation unit 19 in the above-mentioned information presentation devices 1, 2, 3, 4, and 5 constitute a part of a control and arithmetic circuit (controller). The control and arithmetic circuit may be constituted by dedicated hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array), or may be constituted by a processor, or may be constituted by including both.

[0077] Also, a computer capable of executing program instructions can be used to function the above-mentioned information presentation devices 1, 2, 3, 4, and 5. FIG. 14 is a block diagram showing a schematic configuration of a computer functioning as the information presentation devices 1, 2, 3, 4, and 5. Here, the computer 100 may be a general-purpose computer, a dedicated computer, a workstation, a PC (Personal Computer), an electronic notepad, or the like. The program instructions may be program code, code segments, or the like for performing necessary tasks.

[0078] 14, the computer 100 includes a processor 110, a ROM (Read Only Memory) 120, a RAM (Random Access Memory) 130, and a storage 140 as memory units, an input unit 150, an output unit 160, and a communication interface (I / F) 170. Each component is connected to each other so as to be able to communicate with each other via a bus 180. The voice acquisition unit 14 in the information presentation devices 2, 4, and 5 and the image acquisition unit 17 in the information presentation devices 3 and 4 may be constructed as the input unit 150, and the screen display unit 13 in the information presentation devices 1, 2, 3, 4, and 5 may be constructed as the output unit 160.

[0079] The ROM 120 stores various programs and various data. The RAM 130 temporarily stores programs or data as a working area. The storage 140 is configured with a HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs including an operating system and various data. In the present invention, the program according to the present invention is stored in the ROM 120 or the storage 140. In addition, the positional relationship DB 16, the face authentication DB 18, and the screen position DB 20 according to the embodiment of the present invention may be constructed as the storage 140.

[0080] Specifically, the processor 110 is a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), a SoC (System on a Chip), etc., and may be composed of multiple processors of the same or different types. The processor 110 reads a program from the ROM 120 or the storage 140, and executes the program using the RAM 130 as a working area, thereby controlling each of the above components and performing various arithmetic processing. At least a part of the processing contents may be realized by hardware.

[0081] The program may be recorded in a recording medium readable by the computer 100. By using such a recording medium, the program can be installed in the computer 100. Here, the recording medium on which the program is recorded may be a non-transitory recording medium. The non-transitory recording medium is not particularly limited, and may be, for example, a CD-ROM, a DVD-ROM, or a USB (Universal Serial Bus) memory. In addition, the program may be downloaded from an external device via a network. The positional relationship DB 16, the face authentication DB 18, and the screen position DB 20 according to the embodiment of the present invention may be constructed in such a recording medium.

[0082] The following supplementary notes are further disclosed regarding the above embodiment.

[0083] (Additional note 1) An information presentation device that presents information to a plurality of users via a display, a control unit that acquires position information of the user, estimates a positional relationship of the user with respect to the display, dynamically determines a screen layout according to the positional relationship, and outputs display information based on the screen layout to the display. An information presentation device comprising: (Additional note 2) The control unit is Acquire a speech of the user; 2. The information presentation device according to claim 1, further comprising: estimating position information of the user based on the spoken voice. (Additional note 3) The control unit is Acquire image information of the user; 2. The information presentation device according to claim 1, further comprising: a face recognition unit configured to recognize the face of the user based on the image information and to update the user's location information. (Additional note 4) A face recognition DB is further provided for registering face recognition information for identifying the person who answers the phone as a specific individual by face recognition, The information presentation device according to claim 3, wherein the control unit performs face authentication based on the face authentication information and the image information, and distinguishes between and estimates the positions of the respondent and other users. (Additional note 5) 5. The information presentation device according to any one of claims 1 to 4, wherein the control unit outputs the display information to a display that can be viewed from any position within 360 degrees. (Additional note 6) A screen position DB for storing position information of a plurality of displays for displaying the display information, The control unit distributes and transfers the display information to the plurality of displays; 6. The information presentation device according to claim 1, further comprising: determining a screen layout for each of the plurality of displays based on the positional relationship and position information of the displays. (Additional note 7) An information presentation method in an information presentation device that presents information to a plurality of users via a display, comprising: The information display device acquiring position information of the user and estimating a positional relationship of the user with respect to the display; dynamically determining a screen layout in accordance with the positional relationship, and outputting display information based on the screen layout to the display; A method of presenting information including: (Additional note 8) A non-transitory storage medium storing a program executable by a computer, the non-transitory storage medium storing the program causing the computer to function as an information presentation device described in any one of appended claims 1 to 6.

[0084] Although the above-mentioned embodiment has been described as a representative example, it is obvious to those skilled in the art that many modifications and substitutions can be made within the spirit and scope of the present invention. Therefore, the present invention should not be interpreted as being limited by the above-mentioned embodiment, and various modifications or changes can be made without departing from the scope of the claims. For example, it is possible to combine multiple building blocks shown in the configuration diagram of the embodiment into one, or to divide one building block. [Explanation of symbols]

[0085] 1,2,3,4,5 Information presentation device 11 Positional relationship estimation unit 12 Screen layout determination section 13, 13', 13a~13n Screen display unit (display) 14 Voice Acquisition Unit 15 Speaker and position estimation unit 16 Location DB 17 Image acquisition section 18 Screen position DB 19 Screen output distribution section 20 Screen position DB 100 Computers 110 Processor 120 ROM 130 RAM 140 Storage 150 Input section 160 Output section 170 Communication Interface (I / F) 180 Bus

Claims

1. An information presentation device that presents information to a plurality of users via a display, a positional relationship estimation unit that acquires position information of the user and estimates a positional relationship of the user with respect to the display; a screen layout determination unit that dynamically determines a screen layout including inverting a part of the information to be presented according to the positional relationship, and outputs the information to be presented on the display based on the screen layout; An information presentation device comprising:

2. A voice acquisition unit that acquires a speech voice of the user; a speaker / position estimation unit that estimates position information of the user based on the spoken voice; The information presentation device according to claim 1 , further comprising:

3. an image acquisition unit that acquires image information of the user; a speaker / position estimation unit that performs face recognition based on the image information to estimate position information of the user; The information presentation device according to claim 1 , further comprising:

4. An information presentation device that presents information to a plurality of users via a display, a positional relationship estimation unit that acquires position information of the user and estimates a positional relationship of the user with respect to the display; A screen layout is dynamically determined according to the positional relationship, and the front is displayed based on the screen layout. a screen layout determination unit that outputs the information to be presented on the display; an image acquisition unit that acquires image information of the user; a speaker / position estimation unit that performs face recognition based on the image information to estimate position information of the user; A face recognition DB that registers face recognition information for identifying a person who answers a call as a specific individual by face recognition, The speaker / position estimation unit performs face authentication based on the face authentication information and the image information, and estimates the positions of the speaker and other users separately.

5. The information presentation device according to claim 1 , wherein the screen layout determination unit outputs the presented information to a display that is viewable from any position within 360 degrees.

6. a screen position DB that stores position information of a plurality of displays that display the presented information; a screen output distribution unit that distributes and transfers the information to be presented to the plurality of displays; Further comprising: The information presentation device according to claim 1 , wherein the screen layout determination unit determines a screen layout of each of the plurality of displays based on the positional relationship and position information of the plurality of displays.

7. An information presentation device that presents information to multiple users via a cylindrical display that can be viewed from any position in 360 degrees, a positional relationship estimation unit that acquires position information of the user and estimates a positional relationship of the user with respect to the display; a screen layout determination unit that determines a screen layout including dynamically rotating a display orientation of the presented information according to the positional relationship, and outputs the presented information to the display based on the screen layout; An information presentation device comprising:

8. An information presentation method in an information presentation device that presents information to a plurality of users via a display, comprising: The information display device acquiring position information of the user and estimating a positional relationship of the user with respect to the display; determining a screen layout including dynamically inverting a part of the information to be presented in accordance with the positional relationship, and outputting the information to be presented on the display based on the screen layout; A method of presenting information that:

9. A program for causing a computer to function as the information presentation device according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Information display device

    JP2001195049A

  • Inter-different language dialog equipment and method

    JP2004355226A

  • Inter-different language dialog processing method and its equipment

    JP2005322145A

  • Device and method for controlling display device, and computer program

    JP2010026327A

  • Display control device, display control method, and program

    WO2015098188A1