Program, display control device, and control method

Abstract

This program causes a display control device to execute a process. The process includes: acquiring character information having undergone conversion through speech recognition; operating in a first display mode for displaying, on a display unit located between a first user and a second user, an image corresponding to a keyword included in the character information; shifting from the first display mode to a second display mode when a first condition is satisfied in the first display mode; and displaying the image on the display unit, in the second display mode in a display manner different from that in the first mode.

Description

Program, display control device and control method Cross-reference to related applications

[0001] This application claims priority to Japanese Patent Application No. 2023-027795, filed on February 24, 2023, the entire disclosure of which is incorporated herein by reference.

[0002] The present disclosure relates to a program, a display control device, and a control method.

[0003] Conventionally, there is known a technique for displaying an image on a display unit (for example, Patent Document 1). The display device described in Patent Document 1 displays a plurality of images in respective display areas, detects a user's operation on the image display area, and changes the image display area and display state in response to the detected user operation.

[0004] International Publication No. 2018 / 025339

[0005] A program according to one embodiment of the present disclosure causes a display control device to perform processing including: acquiring character information converted by voice recognition; operating in a first display mode in which an image corresponding to a keyword included in the character information is displayed on a display unit located between a first user and a second user; transitioning from the first display mode to a second display mode when a first condition is satisfied while in the first display mode; and displaying the image on the display unit in a display manner different from that in the first display mode in the second display mode.

[0006] A display control device according to one embodiment of the present disclosure operates in a first display mode that acquires character information converted by voice recognition and displays an image corresponding to a keyword contained in the character information on a display unit located between a first user and a second user, and includes a control unit that transitions from the first display mode to a second display mode when a first condition is satisfied while in the first display mode, and the control unit displays the image on the display unit in a display manner different from that in the first display mode in the second display mode.

[0007] A control method according to one embodiment of the present disclosure includes: acquiring character information converted by voice recognition; operating in a first display mode in which an image corresponding to a keyword included in the character information is displayed on a display unit located between a first user and a second user; transitioning from the first display mode to a second display mode when a first condition is satisfied while in the first display mode; and displaying the image on the display unit in a display manner different from that in the first display mode in the second display mode.

[0008] 1 is a diagram illustrating a schematic configuration of a display system according to an embodiment of the present disclosure. FIG. 1 is a block diagram of the display system illustrated in FIG. 1. FIG. 2 is a diagram illustrating a configuration of a first display area and a second display area as viewed from a first user. FIG. 3 is a diagram illustrating a configuration of the first display area and the second display area as viewed from a second user. FIG. 4 is a diagram illustrating a first display area initialized in a second display mode. FIG. 5 is a diagram illustrating a display example of the first display area in the second display mode. FIG. 6 is a diagram illustrating a display example of the first display area in another example of the second display mode. FIG. 7 is a diagram illustrating a display example of the first display area in another example of the second display mode. FIG. 8 is a flowchart illustrating a flow of control processing in the first display mode. FIG. 9 is a flowchart illustrating a flow of control processing in the second display mode. FIG. 10 is a flowchart illustrating a flow of control processing in another example of the second display mode. FIG. 11 is a flowchart illustrating a flow of control processing in another example of the second display mode. FIG. 12 is a flowchart illustrating a flow of image deletion processing. FIG. 13 is a flowchart illustrating a flow of transition processing to the first display mode.

[0009] SUMMARY OF THE INVENTION Conventional techniques for displaying images on a display unit have room for improvement. According to an embodiment of the present disclosure, the techniques for displaying images on a display unit can be improved.

[0010] In the present disclosure, the "vertical direction of an image" and the "horizontal direction of an image" may be set according to the content of the image. For example, the vertical direction of an image may be the direction that a user recognizes as the up-down direction of the image based on the content of the image. The horizontal direction of an image may be the direction that a user recognizes as the horizontal direction of the image based on the content of the image. Furthermore, the "aspect ratio of an image" is the ratio between the vertical size and the horizontal size of the image.

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0012] (Configuration of the display system) The display system 1 according to this embodiment as shown in Fig. 1 is used at a counter. The counter where the display system 1 is used is, for example, a counter of a public institution such as a national or local government, a counter of a financial institution, a counter of a medical institution, or a counter of a public transportation facility. However, the display system 1 may also be used at a place other than a counter. For example, the display system 1 may be used in a conference room in a business store or office of a private business operator.

[0013] The display system 1 can support a dialogue between a first user U1 and a second user U2. The first user U1 is a visitor who visits a counter. The first user U1 is, for example, a hearing-impaired person. The second user U2 is a counter clerk in charge of the counter. At such a counter, the first user U1 and the second user U2 face each other.

[0014] As shown in Fig. 1, the display system 1 includes a base material 10 and a projector 20. As shown in Fig. 2, the display system 1 also includes a microphone 30, an input device 40, and an electronic device 50. The electronic device 50 serves as a display control device in the display system 1. The projector 20, the microphone 30, the input device 40, and the electronic device 50 can communicate with each other via communication lines. The communication lines may be configured to include, for example, wired or wireless connections. The projector 20, the microphone 30, the input device 40, and the electronic device 50 may be configured as a single device.

[0015] As shown in FIG. 1 , the substrate 10 is positioned between the first user U1 and the second user U2. The substrate 10 is made of, for example, a transparent material. The vertical length of the substrate 10 may be equal to or greater than the length of the upper body of an average person. The horizontal length of the substrate 10 may be several times the shoulder width of an average person. In recent years, in order to prevent infectious diseases, vinyl curtains or acrylic panels, etc., are sometimes installed between a visitor such as the first user U1 and a counter staff member such as the second user U2 to prevent droplets. Such vinyl curtains or acrylic panels, etc., may be used as the substrate 10.

[0016] 2, the base material 10 includes surfaces 10A and 10B. When the base material 10 is located between a first user U1 and a second user U2, the first user U1 is located on the surface 10B side. The second user U2 is located on the surface 10A side. The base material 10 includes a transparent screen 11.

[0017] 2, the transparent screen 11 is disposed on the surface 10A side of the surface 10A, 10B of the base material 10. As will be described later, the speech content of the second user and the like are projected onto the transparent screen 11 by a projector 20. By projecting the speech content of the second user and the like onto the transparent screen 11, the first user U1, who is hearing impaired, can read and understand the speech content of the second user U2 projected onto the transparent screen 11.

[0018] The transparent screen 11 may be disposed at any position on the base material 10. As an example, when the base material 10 is located between a first user U1 and a second user U2, the transparent screen 11 may be disposed at a position on the base material 10 that does not prevent the first user U1 and the second user U2 from seeing each other's faces. In this case, the transparent screen 11 may be disposed below the center of the base material 10. The size of the transparent screen 11 may be set based on the amount of information to be projected onto the transparent screen 11.

[0019] 2, the transparent screen 11 includes a screen portion 12 and a light-shielding portion 13. The screen portion 12 is disposed on the surface 10A of the substrate 10. The light-shielding portion 13 is disposed on the screen portion 12.

[0020] The screen unit 12 is a projector screen. The screen unit 12 is made of a transparent material, such as a film, sheet, or plate, that can be attached to the base material 10. The screen unit 12 itself is sometimes called a "transparent screen." Projection light from the projector 20 is incident on the screen unit 12. The screen unit 12 diffuses a portion of the incident projection light on both the input and output sides of the projection light. The first user U1 and the second user U2 can recognize the image projected by the projector 20 when the projection light diffused by the screen unit 12 enters their field of vision.

[0021] The shape of the screen portion 12 is, for example, rectangular. However, the shape of the screen portion 12 is not limited to rectangular. The shape of the screen portion 12 may be any shape.

[0022] The light-shielding portion 13 at least partially blocks the transmission of the projection light emitted from the projector 20. In this embodiment, the light-shielding portion 13 blocks transmitted light of a predetermined wavelength from the projection light emitted from the projector 20. The light-shielding portion 13 is formed, for example, of a dichroic film that blocks light of a predetermined wavelength. For example, the light-shielding portion 13 is formed of a dichroic film that blocks red light.

[0023] The light-shielding portion 13 may overlap a part of the screen portion 12. For example, the light-shielding portion 13 is arranged overlapping the surface of the screen portion 12. As shown in FIG. 2 , the light-shielding portion 13 may be arranged below the center of the surface of the screen portion 12.

[0024] The shape of the light-shielding portion 13 is, for example, a rectangular shape. However, the shape of the light-shielding portion 13 is not limited to a rectangular shape. The shape of the light-shielding portion 13 may be any shape.

[0025] The screen unit 12 serves as a display unit in the display system 1. The area of ​​the screen unit 12 includes a first display area A1 and a second display area A2, as shown in FIG.

[0026] The first display area A1 is an area of ​​the screen unit 12 that does not overlap with the light-shielding unit 13. Projection light of characters, images, etc. is irradiated onto the first display area A1 by the projector 20. Because the first display area A1 is an area of ​​the screen unit 12 that does not overlap with the light-shielding unit 13, both the first user U1 and the second user U2 can view the characters, images, etc. projected onto the first display area A1. In this embodiment, the first display area A1 is used by the first user U1 to view the speech content, etc., of the second user U2.

[0027] The second display area A2 is an area where the screen unit 12 and the light-shielding unit 13 overlap. As will be described later, the projector 20 irradiates the second display area A2 with projection light of a predetermined wavelength that is blocked by the light-shielding unit 13. At this time, the first user U1 cannot see the characters and the like projected in the second display area A2. However, the second user U2 can see the characters and the like projected in the second display area A2. In this embodiment, the second display area A2 is used by the second user U2 to check the content of his or her own speech.

[0028] The second display area A2 may be located below the first display area A1, as shown in FIG. 3 (described later). The sizes of the first display area A1 and the second display area A2 may be set based on the amount of information to be displayed in each of the first display area A1 and the second display area A2. As an example, the first display area A1 may occupy 4 / 5 of the screen unit 12. The second display area A2 may occupy 1 / 5 of the screen unit 12.

[0029] The operation modes of the display system 1 include a first display mode and a second display mode.

[0030] The first display mode is a mode in which both text and images can be displayed in the first display area A1. In the first display mode, the first display area A1 includes a first area A11 and a second area A12, as shown in FIG. 3 (described later). Text is displayed in the first area A11. Images are displayed in the second area A12. The sizes of the first area A11 and the second area A12 in the first display area A1 may be set based on the amount of text and images displayed in the first display area A1. As an example, two-thirds of the first display area A1 may be the first area A11. One-third of the first display area A1 may be the second area A12.

[0031] The second display mode is a mode in which images are displayed in a different display manner from the first display mode. In this embodiment, the second display mode is a mode in which more or larger images can be displayed than in the first display mode. In the second display mode, the first display area A1 includes a third area A13, as shown in FIGS. 5 to 7 described below. An image is displayed in the third area A13. In FIGS. 5 to 7 described below, the size of the third area A13 is the same as the size of the first display area A1. However, the size of the third area A13 may be smaller than the size of the first display area A1.

[0032] 2, the projector 20 is disposed on the surface 10A side of the surface 10A, 10B of the base material 10. For example, the projector 20 is disposed closer to the second user U2 than the base material 10 as shown in FIG.

[0033] The projector 20 irradiates the screen unit 12 with projection light under the control of the electronic device 50. The projector 20 projects characters, images, etc. onto the screen unit 12 by irradiating the screen unit 12 with projection light.

[0034] As shown in Fig. 2, the microphone 30 is disposed on the surface 10A side of the surface 10A, 10B of the base material 10. For example, the microphone 30 is disposed closer to the second user U2 than the base material 10 as shown in Fig. 1. As an example, the microphone 30 may be disposed on a desk in front of the second user U2. When the second user U2 wears a headset, the microphone 30 may be attached to the headset.

[0035] The microphone 30 collects sound. The sound collected by the microphone 30 may include speech uttered by the second user U2. The microphone 30 transmits data of the collected sound to the electronic device 50.

[0036] As shown in Fig. 2, the input device 40 is disposed on the surface 10A side of the surface 10A, 10B of the base material 10. For example, the input device 40 is disposed closer to the second user U2 than the base material 10 as shown in Fig. 1. As an example, the input device 40 may be disposed on a desk in front of the second user U2 as shown in Fig. 1.

[0037] The input device 40 is configured with a keyboard, a numeric keypad, etc. The input device 40 accepts input from the second user U2. The input device 40 transmits data of the accepted input to the electronic device 50.

[0038] The electronic device 50 is, for example, a smartphone or a tablet terminal. The electronic device 50 is capable of communicating with the server 3 via a network 2. The network 2 may be any network including a mobile communication network, the Internet, etc. The server 3 is, for example, a cloud server. The server 3 is capable of performing voice recognition.

[0039] The server 3 is a server that can be accessed via the network 2. The server 3 according to this embodiment is a voice recognition server that provides a voice recognition service. The voice recognition service is a service that converts voice into text information. When the server 3 according to this embodiment receives voice data, it performs voice recognition processing on the received voice data. The voice recognition processing is a process that converts voice data into text information. The server 3 converts the received voice data into text information by performing the voice recognition processing. The server 3 transmits the converted text information to the sender of the voice data. The server 3 provides the voice recognition service as a paid or free service.

[0040] As shown in FIG. 2, the electronic device 50 includes a communication unit 51, a storage unit 52, and a control unit 53.

[0041] The communication unit 51 is configured to include at least one communication module connectable to the network 2. The communication module is a communication module compatible with mobile communication standards such as LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation).

[0042] The communication unit 51 includes at least one communication module capable of communicating with the projector 20 via a communication line. The communication module is a communication module that complies with the standard of the communication line between the electronic device 50 and the projector 20. The standard of the communication line is a short-range wireless communication standard such as Miracast.

[0043] The communication unit 51 includes at least one communication module capable of communicating with the microphone 30 via a communication line. The communication module is a communication module that complies with the standard of the communication line between the electronic device 50 and the microphone 30. The standard of the communication line is a wired communication standard such as the Cellular Telephone Industry Association (CTIA) standard or the Open Mobile Terminal Platform (OMTP) standard.

[0044] The communication unit 51 includes at least one communication module capable of communicating with the input device 40 via a communication line. The communication module is a communication module that complies with the standard of the communication line between the electronic device 50 and the input device 40. The standard of the communication line is, for example, a short-range wireless communication standard such as Bluetooth (registered trademark).

[0045] The communication unit 51 may be configured to include at least one communication module capable of communicating with an IC card. The communication module is a communication module that complies with a short-range wireless communication standard such as near field communication (NFC) or radio frequency identification (RFID). This communication module is placed on a desk in front of the first user U1 as shown in FIG. 1 .

[0046] The storage unit 52 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory may be, for example, a random access memory (RAM) or a read-only memory (ROM). The RAM may be, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The ROM may be, for example, an electrically erasable programmable read-only memory (EEPROM). The storage unit 52 may function as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 52 stores data used in the operation of the electronic device 50 and data obtained by the operation of the electronic device 50. For example, the storage unit 52 stores system programs, application programs, embedded software, and the like.

[0047] The storage unit 52 includes a first database 52D1 and a second database 52D2.

[0048] The first database 52D1 stores data of the first image. The first image may be a still image or a moving image. A first keyword is associated with the first image. Different first images may be associated with different first keywords. The vertical size of the first image is larger than the horizontal size of the first image. In other words, the first image is a so-called vertically long image. The aspect ratio of the first image may be set according to the size of the second area A12, etc. For example, the vertical size:horizontal size of the first image is 3:2. The first image is used in both the first display mode and the second display mode.

[0049] The second database 52D2 stores data of second images. The second images may be still images or moving images. A second keyword is associated with the second image. Different second keywords may be associated with different second images. Some or all of the multiple second keywords may be the same as or different from some or all of the multiple first keywords. The horizontal size of the second image is larger than the vertical size of the second image. In other words, the second image is a so-called horizontally long image. The aspect ratio of the second image may be set according to the size of the first display area A1, etc. For example, the vertical size:horizontal size of the second image is 2:3. The second image is used in the second display mode. The amount of information contained in the second image may be greater than the amount of information contained in the first image. The second image is, for example, a map, etc.

[0050] The control unit 53 is configured to include at least one processor, at least one dedicated circuit, or a combination of these. The processor is a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for specific processing. The dedicated circuit is, for example, an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit 53 controls each part of the electronic device 50 and executes processing related to the operation of the electronic device 50.

[0051] <Processing in First Display Mode> The control unit 53 operates in the first display mode in an initial state. For example, the electronic device 50 enters the initial state immediately after starting an application program for executing the display system 1. In the first display mode, the control unit 53 executes the process of acquiring character information, which will be described below.

[0052] <<Text Information Acquisition Process>> The control unit 53 receives voice data collected by the microphone 30 from the microphone 30 via the communication unit 51. The received voice data may include data of utterances made by the second user U2. The control unit 53 transmits the received voice data to the server 3 via the network 2 via the communication unit 51. Upon receiving the voice data from the electronic device 50, the server 3 performs voice recognition processing on the received voice data. The server 3 converts the voice data into text information and transmits the converted text information to the electronic device 50 via the network 2.

[0053] The control unit 53 receives the character information converted by voice recognition from the server 3 via the network 2 using the communication unit 51. In this embodiment, the control unit 53 receives the character information from the server 3, thereby acquiring the character information converted by voice recognition.

[0054] <<Process for Generating First Character Information and Second Character Information>> When the control unit 53 receives character information from the server 3 , the control unit 53 generates first character information and second character information based on the character information received from the server 3 .

[0055] The first character information is character information to be displayed in the first area A11 of the first display area A1. The control unit 53 generates the first character information so that the character strings included in the character information are displayed upright in the first area A11 as seen by the first user U1. In the present disclosure, "upright" refers to a state in which characters, etc. are displayed correctly from the user's perspective. "Upright" is used in contrast to a state in which characters, etc. are reversed left to right. Here, the direction in which the character strings of the first character information are arranged in the first display area A1 depends on the language and the display format of the text in the first area A11. As an example, the received character information is assumed to be Japanese. Furthermore, the text is displayed in the first area A11 in a horizontal display format, as shown in FIG. 3 (described later). Horizontally written Japanese text is read from left to right. Therefore, the control unit 53 generates the first character information so that the character strings included in the received character information are arranged from left to right as seen by the first user U1, as shown in first character information 60 (described later in FIG. 3). The control unit 53 may generate the first character information so that the character string included in the character information is readable by the first user U1.

[0056] The second character information is character information to be displayed in the second display area A2. In the same manner as or similar to the first character information, the control unit 53 generates the second character information so that the character string included in the character information is displayed upright in the second display area A2 as seen by the second user U2, as shown in second character information 61 in FIG. 4 (described later). In other words, the second character information displayed in the second display area A2 and the first character information displayed in the first display area A1 may be in a mirrored relationship as seen by the second user U2. The control unit 53 may generate the second character information so that the character string included in the character information is readable by the second user U2.

[0057] <<Display Process of First Character Information and Second Character Information>> After generating the first character information and the second character information, the control unit 53 executes display process of the first character information and the second character information. This display process is a process of displaying the first character information in the first area A11 and the second character information in the second display area A2.

[0058] To display the first character information, the control unit 53 causes the projector 20 to irradiate the first region A11 with projection light for the first character information by transmitting a control signal to the projector 20 via the communication unit 51. The wavelength of the projection light for the first character information may be set in consideration of the readability of characters and the like in the first region A11. The control unit 53 causes the projector 20 to irradiate the first region A11 with projection light for the first character information, thereby displaying the first character information in the first region A11.

[0059] To display the second character information, the control unit 53 causes the projector 20 to emit projection light for the second character information onto the second display area A2 by transmitting a control signal to the projector 20 via the communication unit 51. The projection light for the second character information is light of a predetermined wavelength that is blocked by the light blocking unit 13. For example, if the light blocking unit 13 is configured with a dichroic film that blocks red light, the projection light for the second character information will have a wavelength of red light. The control unit 53 causes the projector 20 to emit projection light for the second character information onto the second display area A2, thereby displaying the second character information in the second display area A2.

[0060] For example, FIG. 3 shows the first display area A1 and the second display area A2 as viewed from the first user U1. FIG. 4 shows the first display area A1 and the second display area A2 as viewed from the second user U2. In FIGS. 3 and 4, the control unit 53 receives text information such as "Good morning" from the server 3. In this case, the control unit 53 generates first text information 60 so that the text "Good morning" is arranged from left to right as viewed from the first user U1, as shown in FIG. 3. The control unit 53 also generates second text information 61 so that the text "Good morning" is arranged from left to right as viewed from the second user U2, as shown in FIG. 4. As described above, the projected light of the second text information 61 is light of a predetermined wavelength that is blocked by the light blocking unit 13. Therefore, as shown in FIG. 3, the first user U1 cannot see the text "Good morning" projected on the second display area A2.

[0061] <<Display Process of First Image>> When the control unit 53 receives the text information from the server 3, it executes a display process for displaying the first image in the first display area A1.

[0062] First, when control unit 53 receives character information from server 3, it refers to first database 52D1 and determines whether the received character information includes a first keyword. If control unit 53 determines that the received character information includes a first keyword, it obtains data of a first image associated with the first keyword from first database 52D1.

[0063] When the control unit 53 acquires data of the first image from the first database 52D1, the control unit 53 displays the acquired data of the first image in the second area A12. As an example of this process, the control unit 53 transmits a control signal to the projector 20 via the communication unit 51, thereby causing the projector 20 to irradiate the second area A12 with projection light of the first image. The wavelength of the projection light of the first image may be set taking into consideration the ease of viewing the image in the second area A12. The control unit 53 displays the first image in the second area A12 by causing the projector 20 to irradiate the second area A12 with projection light of the first image. For example, in the configuration shown in FIGS. 3 and 4 , the first image 62 is displayed in the second area A12.

[0064] <Process of Transition to Second Display Mode> When a first condition is satisfied while the display system 1 is in the first display mode, the control unit 53 transitions the operation mode of the display system 1 from the first display mode to the second display mode. The first condition is a condition for transitioning the operation mode of the display system 1 from the first display mode to the second display mode. The first condition may be set in consideration of user convenience.

[0065] As an example, the first condition may be a condition that a predetermined input is received. The predetermined input may be, for example, an input of an instruction to transition to the second display mode. For example, the second user U2 may want to display an image with a large amount of information, such as a map, in the first display area A1. In this case, the second user U2 may input an input of an instruction to transition to the second display mode to the input device 40. Upon receiving the input of the instruction to transition to the second display mode, the input device 40 may transmit data of the received input of the instruction to transition to the second display mode to the electronic device 50. The control unit 53 may receive the input of the instruction to transition to the second display mode by receiving the input data of the instruction to transition to the second display mode from the input device 40 via the communication unit 51. Upon receiving the input of the instruction to transition to the second display mode, the control unit 53 transitions the operating mode of the display system 1 from the first display mode to the second display mode. Here, the control unit 53 may receive the predetermined input via the microphone 30. In other words, the predetermined input may be input by voice.

[0066] As another example, the first condition may be that the status information of the first user U1 indicates a desire to use the second display mode. For example, the first user U1 may wish to receive an explanation from the second user U2 using only an image. In this case, the first user U1 may write in advance on an IC card he or she possesses that the first user U1 desires to use the second display mode. This IC card may be issued by a public institution that uses the display system 1 as a contact point. For example, the first user U1 may hold the IC card over the communication module of the communication unit 51 before starting a dialogue with the second user U2. When the IC card is held over the communication module of the communication unit 51, the control unit 53 performs short-range wireless communication with the first user U1's IC card via the communication unit 51. The control unit 53 performs short-range wireless communication with the first user U1's IC card via the communication unit 51, thereby acquiring the desire to use the second display mode written on the IC card as the first user U1's status information. When the control unit 53 acquires the information written in the IC card indicating that the second display mode is desired to be used, the control unit 53 shifts the operation mode of the display system 1 from the first display mode to the second display mode.

[0067] <Processing in Second Display Mode> When transitioning to the second display mode, the control unit 53 determines whether the first condition is satisfied while the first image is being displayed in the second area A12.

[0068] When transitioning to the second display mode, if the control unit 53 determines that the first condition is satisfied when the first image is not being displayed in the second area A12, the control unit 53 initializes the first display area A1. For example, as shown in Fig. 5, the control unit 53 initializes the first display area A1 by deleting the first character information 60 shown in Fig. 3 from the first area A11. The configuration shown in Fig. 5 is the configuration of the first display area A1 and the second display area A2 as seen by the first user U1.

[0069] When transitioning to the second display mode, if control unit 53 determines that the first condition is satisfied while the first image is being displayed in second area A12, control unit 53 determines whether a second image associated with the same second keyword as the first keyword associated with the first image being displayed is stored. Control unit 53 refers to second database 52D2 and determines whether a second image associated with the same second keyword as the first keyword associated with the first image being displayed is stored.

[0070] When the control unit 53 determines that a second image associated with the same second keyword as the first keyword associated with the first image displayed in the second area A12 is stored, the control unit 53 acquires data of the second image from the second database 52D2. Upon acquiring the data of the second image, the control unit 53 deletes the first image displayed in the second area A12 and displays the acquired second image in the third area A13. For example, the control unit 53 displays the second image 70 in the third area A13, as shown in FIG. 6 .

[0071] When the control unit 53 determines that a second image associated with the same second keyword as the first keyword associated with the first image currently displayed in the second area A12 is not stored, the control unit 53 displays the first image currently displayed in the second area A12 in the third area A13. For example, as shown in Fig. 7 , the control unit 53 displays the first image 71 in the third area A13. The control unit 53 displays the first image 71 in the center of the third area A13. However, the control unit 53 may display the first image 71 in any position other than the center of the third area A13.

[0072] The control unit 53 executes the character information acquisition process in the second display mode in the same or similar manner as in the first display mode. In the second display mode, when the control unit 53 receives new character information from the server 3, it references the second database 52D2 and determines whether the newly received character information includes a second keyword. If the control unit 53 determines that the newly received character information includes the second keyword, it acquires data of a new second image associated with the second keyword from the second database 52D2. The control unit 53 preferentially displays the new second image in the third area A13 of the first display area A1. In this embodiment, the control unit 53 prioritizes displaying the new second image in the third area A13, deletes the first image or second image currently displayed in the third area A13 of the first display area A1, and displays the new second image in the third area A13. However, preferentially displaying the new second image in the third area A13 is not limited to this. As another example, the control unit 53 may display a new second image by superimposing it on a part of the first image or second image that is currently being displayed.

[0073] <Another Example of Second Display Mode> As another example of the second display mode, when the character information newly received from the server 3 does not include the second keyword but does include the first keyword, the control unit 53 may obtain new data of a first image corresponding to the first keyword from the first database 52D1. The control unit 53 may display the new data of the first image in the third area A13 of the first display area A1.

[0074] Here, before displaying a new first image in the third area A13, the control unit 53 may determine whether or not there is free space in the third area A13. The free space is space in which the first image can be displayed. The control unit 53 may determine whether or not there is free space in the third area A13 by calculating the maximum number of first images that can be displayed in the third area A13. The control unit 53 may calculate the maximum number of first images that can be displayed in the third area A13 based on the aspect ratio of the first image and the horizontal and vertical sizes of the third area A13.

[0075] If the control unit 53 determines that there is free space in the third area A13 before displaying a new first image in the third area A13, the control unit 53 displays the new first image in the third area A13 together with the currently displayed first image. For example, in the configuration shown in FIG. 7 , the control unit 53 determines that there is free space in the third area A13. In this case, the control unit 53 displays a new first image 72 together with the currently displayed first image 71, as shown in FIG. 8 . The control unit 53 may display first images that were displayed going back in time toward the left side of the third area A13. Alternatively, the control unit 53 may display multiple first images centered around the center of the third area A1. However, the control unit 53 may display the currently displayed first image and the new first image, i.e., multiple first images, at any location in the third area A13.

[0076] If the control unit 53 determines that there is no free space in the third area A13 before displaying a new first image in the third area A13, it deletes one of the currently displayed first images and displays the new first image in the third area A13. The control unit 53 may delete the first image that was displayed most recently among the currently displayed first images. For example, in the configuration shown in FIG. 9 , the control unit 53 determines that there is no free space in the third area A13. Of the first images 71, 72, and 73 currently displayed in the third area A13, the first image 71 is the image that was displayed most recently. In the configuration shown in FIG. 9 , the control unit 53 deletes the first image 71 from the currently displayed first images 71 to 73 and displays the new first image in the third area A13.

[0077] <Image Deletion Process> In the first display mode or the second display mode, the second user U2 may input an image deletion instruction to the input device 40. The image deletion instruction is an input instructing to delete the first image or the second image being displayed in the first display area A1. The image deletion instruction may specify the image to be deleted from the first display area A1. When the input device 40 receives the input of the image deletion instruction, it may transmit data of the image deletion instruction input to the electronic device 50.

[0078] The control unit 53 may accept input of an instruction to delete an image from the second user U2 by receiving input data of the instruction to delete an image from the input device 40 via the communication unit 51. When the control unit 53 accepts input of the instruction to delete an image, it may delete the image from the first display area A1 in accordance with this input.

[0079] <Process of Transition to First Display Mode> When the second condition is satisfied while the display system 1 is in the second display mode, the control unit 53 transitions the operation mode of the display system 1 from the second display mode to the first display mode. The second condition is a condition for transitioning the operation mode of the display system 1 from the second display mode to the first display mode. The second condition may be set in consideration of user convenience.

[0080] As an example, the second condition may be a condition that a predetermined input is received. The predetermined input may be, for example, an input of an instruction to transition to the first display mode. For example, the second user U2 may want to return the operation mode of the display system 1 to the first display mode after explaining something to the first user U1 using the second display mode. In this case, the second user U2 may input an input of an instruction to transition to the first display mode to the input device 40. Upon receiving the input of the instruction to transition to the first display mode, the input device 40 may transmit data of the received input of the instruction to transition to the first display mode to the electronic device 50. The control unit 53 may receive the input of the instruction to transition to the first display mode by receiving the input data of the instruction to transition to the first display mode from the input device 40 via the communication unit 51. Upon receiving the input of the instruction to transition to the first display mode, the control unit 53 transitions the operation mode of the display system 1 from the second display mode to the first display mode. Here, the control unit 53 may receive the predetermined input via the microphone 30 in the same or similar manner as the first condition.

[0081] As another example, the second condition may be that the status information of the first user U1 does not indicate a desire to use the second display mode. The first user U1 may not particularly desire to use the second display mode. In this case, the first user U1 does not need to write a desire to use the second display mode, as described above, in the IC card he or she possesses. As described above, the first user U1 may insert the IC card into the communication module of the communication unit 51, for example, before starting a dialogue with the second user U2. The control unit 53 detects that a desire to use the second display mode is not written in the IC card by performing short-range wireless communication with the IC card of the first user U1 via the communication unit 51 as described above. When the control unit 53 detects that a desire to use the second display mode is not written in the IC card of the first user U1, the control unit 53 may determine that the condition that the status information of the first user U1 does not indicate a desire to use the second display mode is satisfied. In other words, when the control unit 53 detects that the first user U1's IC card does not indicate a desire to use the second display mode, the control unit 53 may transition the operation mode of the display system 1 from the second display mode to the second display mode. Here, the second user U2 may leave the operation mode of the display system 1 in the second display mode after explaining the second display mode to the visitor before the first user U1. Even if the second user U2 leaves the operation mode of the display system 1 in the second display mode, the operation mode of the display system 1 can be transitioned to the first display mode in accordance with the status information of the first user U1.

[0082] (Operation in First Display Mode) Fig. 10 is a flowchart showing the flow of control processing in the first display mode. The control processing shown in Fig. 10 corresponds to an example of a control method according to this embodiment. For example, when the control unit 53 receives, via the communication unit 51, an input indicating an instruction to display characters on the transparent screen 11 from the input device 40, the control unit 53 starts the processing of step S1 shown in Fig. 10. This input is entered into the input device 40 by the second user U2. At the start of the processing of step S1, the operation mode of the display system 1 is the first display mode.

[0083] The control unit 53 receives data of the voice collected by the microphone 30 from the microphone 30 via the communication unit 51 (step S1). The control unit 53 transmits the voice data received in the process of step S1 to the server 3 via the network 2 via the communication unit 51 (step S2). The control unit 53 receives text information converted by voice recognition from the server 3 via the network 2 via the communication unit 51 (step S3). In parallel with the process of step S4 and onwards, the control unit 53 repeatedly executes the processes of steps S1 to S3.

[0084] The control unit 53 generates first character information and second character information based on the character information received from the server 3 in the process of step S3 (step S4).

[0085] The control unit 53 refers to the first database 52D1 and determines whether the character information received in the process of step S3 includes the first keyword (step S5). If the control unit 53 determines that the received character information does not include the first keyword (step S5: NO), the control unit 53 proceeds to the process of step S6. On the other hand, if the control unit 53 determines that the received character information includes the first keyword (step S5: YES), the control unit 53 proceeds to the process of step S7.

[0086] In the processing of step S6, the control unit 53 displays the first character information generated in the processing of step S4 in the first area A11 of the first display area A1, and displays the second character information generated in the processing of step S4 in the second display area A2.

[0087] In the process of step S7, the control unit 53 acquires, from the first database 52D1, data of the first image associated with the first keyword included in the received character information.

[0088] In the process of step S8, the control unit 53 displays the first character information generated in the process of step S4 in the first area A11 of the first display area A1, and displays the second character information generated in the process of step S4 in the second display area A2. The control unit 53 displays the first image acquired in the process of step S7 in the second area A12 of the first display area A1.

[0089] After the process of step S7 or step S8, the control unit 53 returns to the process of step S4.

[0090] In the processing of steps S1 to S8, when the control unit 53 receives, for example, an input from the input device 40 via the communication unit 51 indicating the stopping of character display on the transparent screen 11, the control unit 53 ends the control processing shown in Fig. 10. This input is input to the input device 40 by the second user U2.

[0091] (Operation in Second Display Mode) Figures 11 and 12 are flowcharts showing the flow of control processing in the second display mode. The control processing shown in Figures 11 and 12 corresponds to an example of a control method according to this embodiment. For example, the control unit 53 executes the processing of step S11 shown in Figure 11 in parallel with the processing of steps S1 to S8 shown in Figure 10. The control unit 53 repeatedly executes the processing of steps S1 to S3 in parallel with the processing from step S11 onwards.

[0092] The control unit 53 determines whether the first condition is satisfied (step S11). If the control unit 53 determines that the first condition is satisfied (step S11: YES), the control unit 53 proceeds to the process of step S12. On the other hand, if the control unit 53 does not determine that the first condition is satisfied (step S11: NO), the control unit 53 executes the process of step S11 again.

[0093] In the process of step S12, the control unit 53 shifts the operation mode of the display system 1 from the first display mode to the second display mode.

[0094] In the process of step S13, the control unit 53 determines whether the first condition is satisfied while the first image is being displayed in the second area A12. For example, if the process of step S8 shown in FIG. 10 has been executed before the process of step S11, the first condition may be satisfied while the first image is being displayed.

[0095] If the control unit 53 determines that the first condition is satisfied when the first image is not being displayed in the second area A12 (step S13: NO), the control unit 53 initializes the first display area A1 (step S14). On the other hand, if the control unit 53 determines that the first condition is satisfied while the first image is being displayed in the second area A12 (step S13: YES), the control unit 53 proceeds to the processing of step S15.

[0096] In the process of step S15, the control unit 53 refers to the second database 52D2 and determines whether a second image associated with the same second keyword as the first keyword associated with the currently displayed first image is stored. If the control unit 53 determines that the second image is stored (step S15: YES), the control unit 53 proceeds to the process of step S17. On the other hand, if the control unit 53 determines that the second image is not stored (step S15: NO), the control unit 53 proceeds to the process of step S16.

[0097] In the process of step S16, the control unit 53 displays the first image currently being displayed in the second area A12 in the third area A13. For example, the control unit 53 displays the first image 71 in the third area A13 as shown in FIG.

[0098] In the process of step S17, the control unit 53 obtains, from the second database 52D2, data of a second image associated with the same second keyword as the first keyword associated with the first image displayed in the second area A12. The control unit 53 deletes the first image displayed in the second area A12 (step S18) and displays the second image obtained in the process of step S17 in the third area A13 (step S19). For example, the control unit 53 displays the second image 70 in the third area A13, as shown in FIG. 6 .

[0099] After executing the process of step S14, step S16, or step S19, the control unit 53 proceeds to the process of step S20 shown in FIG.

[0100] When the control unit 53 newly executes the process of step S3, i.e., when it receives new character information from the server 3, it executes the process of step S20. The control unit 53 references the second database 52D2 and determines whether the newly received character information from the server 3 includes the second keyword (step S20). If the control unit 53 determines that the newly received character information includes the second keyword (step S20: YES), it proceeds to the process of step S21. On the other hand, if the control unit 53 determines that the newly received character information does not include the second keyword (step S20: NO), it executes the process of step S20 again.

[0101] In the process of step S21, the control unit 53 acquires, from the second database 52D2, data of the second image associated with the second keyword included in the newly received character information.

[0102] In the process of step S22, the control unit 53 determines whether the first image or the second image is being displayed in the third area A13. If the process of step S16 or step S19 has been executed before the process of step S22, the first image or the second image is being displayed in the third area A13 of the first display area A1. If the process of step S14 has been executed before the process of step S22, neither the first image nor the second image is being displayed in the third area A13 of the first display area A1.

[0103] If the control unit 53 determines that the first image or the second image is being displayed in the third area A13 (step S22: YES), the control unit 53 proceeds to the process of step S23. On the other hand, if the control unit 53 determines that neither the first image nor the second image is being displayed in the third area A13 of the first display area A1 (step S22: NO), the control unit 53 proceeds to the process of step S24.

[0104] In the process of step S23, the control unit 53 deletes the first image or the second image being displayed from the third area A13. In the process of step S24, the control unit 53 displays the second image acquired in the process of step S21 in the third area A13.

[0105] In the processing of steps S11 to S24, when the control unit 53 receives, for example, an input from the input device 40 via the communication unit 51 indicating the stopping of character display on the transparent screen 11, the control unit 53 ends the control processing shown in Figures 11 and 12. This input is input to the input device 40 by the second user U2.

[0106] (Operation in Another Example of the Second Display Mode) Figures 13 and 14 are flowcharts showing the flow of control processing in another example of the second display mode. The control processing shown in Figures 13 and 14 corresponds to an example of a control method according to this embodiment. For example, after executing the processing of step S19 shown in Figure 11, the control unit 53 starts the processing of step S31 shown in Figure 13. The control unit 53 repeatedly executes the processing of steps S1 to S3 shown in Figure 10 in parallel with the processing of step S31 and subsequent steps.

[0107] When the control unit 53 newly executes the process of step S3, that is, when it newly receives character information from the server 3, it executes the process of step S31.

[0108] In the process of step S31, the control unit 53 refers to the second database 52D2 and determines whether or not the second keyword is included in the character information newly received from the server 3. If the control unit 53 determines that the newly received character information includes the second keyword (step S31: YES), the control unit 53 proceeds to the process of step S32. On the other hand, if the control unit 53 determines that the newly received character information does not include the second keyword (step S31: NO), the control unit 53 proceeds to the process of step S36.

[0109] The control unit 53 executes the processes of steps S32, S33, S34, and S35 in the same manner as or similar to the processes of steps S21, S22, S23, and S24 shown in Fig. 12. After executing the process of step S35, the control unit 53 returns to the process of step S31.

[0110] In the process of step S36, the control unit 53 refers to the first database 52D1 and determines whether or not the first keyword is included in the character information newly received from the server 3. The control unit 53 executes the process of step S36 on the same character information as the character information on which the process of step S31 was executed. If the control unit 53 determines that the newly received character information includes the first keyword (step S36: YES), the control unit 53 proceeds to the process of step S37. On the other hand, if the control unit 53 determines that the newly received character information does not include the first keyword (step S36: NO), the control unit 53 returns to the process of step S31.

[0111] In the process of step S37, the control unit 53 acquires, from the first database 52D1, data of the first image associated with the first keyword included in the newly received character information.

[0112] In the process of step S38, the control unit 53 determines whether or not the second image is currently being displayed in the third area A13. If the control unit 53 determines that the second image is currently being displayed in the third area A13 (step S38: YES), the control unit 53 deletes the second image from the third area A13 (step S39) and proceeds to the process of step S40. On the other hand, if the control unit 53 determines that the second image is not currently being displayed in the third area A13 (step S38: NO), the control unit 53 proceeds to the process of step S40.

[0113] In the process of step S40, the control unit 53 displays the first image acquired in the process of step S37 in the third area A13.

[0114] By processing steps S31 to S40, if the newly received text information from the server 3 does not include the second keyword but does include the first keyword, a new first image corresponding to the first keyword is displayed in the third area A13.

[0115] After executing the process of step S40, the control unit 53 proceeds to the process of step S41 shown in FIG.

[0116] When the control unit 53 newly executes the process of step S3, that is, when it newly receives character information from the server 3, it executes the process of step S41.

[0117] In the process of step S41, the control unit 53 refers to the second database 52D2 and determines whether or not the second keyword is included in the character information newly received from the server 3. If the control unit 53 determines that the newly received character information includes the second keyword (step S41: YES), the control unit 53 proceeds to the process of step S32 shown in Fig. 13. On the other hand, if the control unit 53 determines that the newly received character information does not include the second keyword (step S41: NO), the control unit 53 proceeds to the process of step S42.

[0118] In the process of step S42, the control unit 53 refers to the first database 52D1 and determines whether or not the first keyword is included in the character information newly received from the server 3. The control unit 53 executes the process of step S42 on the same character information as the character information on which the process of step S41 was executed. If the control unit 53 determines that the newly received character information includes the first keyword (step S42: YES), the control unit 53 proceeds to the process of step S43. On the other hand, if the control unit 53 determines that the newly received character information does not include the first keyword (step S42: NO), the control unit 53 returns to the process of step S31 shown in FIG.

[0119] In the process of step S43, the control unit 53 acquires, from the first database 52D1, data of the first image associated with the first keyword included in the newly received character information.

[0120] In the process of step S44, the control unit 53 determines whether or not there is any free space in the third area A13. If the control unit 53 determines that there is free space in the third area A13 (step S44: YES), the control unit 53 proceeds to the process of step S46. If the control unit 53 determines that there is no free space in the third area A13 (step S44: NO), the control unit 53 deletes one of the first images currently being displayed from the third area A13 (step S45), and proceeds to the process of step S46.

[0121] In the process of step S46, the control unit 53 displays the first image acquired in the process of step S43 in the third area A13. After executing the process of step S46, the control unit 53 returns to the process of step S41.

[0122] In this way, when the control unit 53 determines that there is free space in the third area A13 (step S44: YES), the control unit 53 displays a new first image together with the currently displayed first image in the third area A13 by the process of step S46. For example, as shown in FIG. 8 , the control unit 53 displays a first image 72 together with the currently displayed first image 71.

[0123] In this way, when the control unit 53 determines that there is no free space in the third area A13 (step S44: NO), it deletes one of the first images currently being displayed and displays a new first image in the third area A13 through the processes of steps S45 and S46. For example, in the configuration shown in Fig. 9, the control unit 53 deletes the first image 71 from the first images 71 to 73 currently being displayed and displays a new first image in the third area A13.

[0124] In the processing of steps S31 to S46, when the control unit 53 receives, for example, an input from the input device 40 via the communication unit 51 indicating the stopping of character display on the transparent screen 11, the control unit 53 ends the control processing shown in Figures 11 and 12. This input is input to the input device 40 by the second user U2.

[0125] (Operation in Image Deletion Processing) Fig. 15 is a flowchart showing the flow of image deletion processing. The image deletion processing shown in Fig. 15 corresponds to an example of a control method according to this embodiment. For example, the control unit 53 may execute the processing of step S51 shown in Fig. 15 in parallel with the processing of steps S1 to S8 shown in Fig. 10, the processing of steps S11 to S24 shown in Figs. 11 and 12, or the processing of steps S31 to S46 shown in Figs. 13 and 14.

[0126] The control unit 53 determines whether or not an input of an instruction to delete an image has been received from the second user U2 (step S51). If the control unit 53 determines that an input of an instruction to delete an image has been received from the second user U2 (step S51: NO), the control unit 53 executes the process of step S51 again. On the other hand, if the control unit 53 determines that an input of an instruction to delete an image has been received (step S51: YES), the control unit 53 deletes the image from the first display area A1 in accordance with this input (step S52). After executing the process of step S52, the control unit 53 returns to the process of step S51.

[0127] (Operation in Process of Transition to First Display Mode) Fig. 16 is a flowchart showing the flow of the process of transition to the first display mode. The process of transition to the first display mode shown in Fig. 16 corresponds to an example of a control method according to this embodiment. For example, the control unit 53 may execute the process of step S61 shown in Fig. 16 in parallel with the processes of steps S11 to S24 shown in Figs. 11 and 12 or the processes of steps S31 to S46 shown in Figs. 13 and 14.

[0128] The control unit 53 determines whether the second condition is satisfied (step S61). If the control unit 53 determines that the second condition is satisfied (step S61: YES), the control unit 53 proceeds to the process of step S62. On the other hand, if the control unit 53 does not determine that the second condition is satisfied (step S61: NO), the control unit 53 executes the process of step S61 again.

[0129] In the process of step S62, the control unit 53 transitions the operation mode of the display system 1 from the second display mode to the first display mode. After executing the process of step S62, the control unit 53 proceeds to the process of step S4 shown in Fig. 10. In the process of step S4, the control unit 53 generates first character information and second character information from the acquired character information. After executing the process of step S4, the control unit 53 determines whether the character information processed in step S4 includes the first keyword (step S5).

[0130] As described above, in the electronic device 50 according to this embodiment, when the first condition is satisfied while the operation mode of the display system 1 is the first display mode, the control unit 53 transitions the operation mode of the display system 1 from the first display mode to the second display mode. Furthermore, in the second display mode, the control unit 53 displays an image in the first display area A1 serving as the display unit of the display system 1 in a display format different from that in the first display mode. Because the image display format differs between the first display mode and the second display mode, the operation mode of the display system 1 can be transitioned to the first display mode or the second display mode depending on the status of the interaction between the first user U1 and the second user U2. Therefore, according to this embodiment, it is possible to improve the technology for displaying images on the display unit.

[0131] Furthermore, in this embodiment, the first condition may be a condition that a predetermined input has been received. In this case, the second user U2 may input an instruction to transition to the second display mode as the predetermined input into the input device 40, as described above. With this configuration, the operation mode of the display system 1 can be transitioned to the second display mode at a timing convenient for the second user U2. This improves convenience for the second user U2.

[0132] In the present embodiment, the first condition may be that the status information of the first user U1 indicates a desire to use the second display mode. This configuration can improve convenience for the first user U1.

[0133] In this embodiment, the first display mode may be a mode capable of displaying both text information and images. The first display mode may be a mode in which first text information is displayed in the first area A11 and a first image is displayed in the second area A12, as shown in FIG. 3 . Depending on the content of the dialogue between the first user U1 and the second user U2, it may be better to display both text information and images. Therefore, the first display mode displaying text information and images is highly convenient depending on the context of the dialogue between the first user U1 and the second user U2.

[0134] In the present embodiment, the control unit 53 may generate the first character information in the first display mode so that a character string included in the character information received from the server 3 is displayed upright when viewed from the first user U1. For example, the control unit 53 may generate first character information 60 as shown in FIG. 3. This configuration can improve convenience for the first user U1.

[0135] In this embodiment, when the first condition is satisfied while the first image is being displayed, the control unit 53 may determine whether a second image corresponding to the same second keyword as the first keyword corresponding to the first image being displayed is stored. If the control unit 53 determines that a second image is not stored, the control unit 53 may display the first image in the second display mode. By displaying the first image when a second image is not stored, the first display area A1 can be used efficiently.

[0136] In addition, in the present embodiment, in another example of the second display mode, when the newly acquired character information does not include the second keyword but does include the first keyword, the control unit 53 may display a new first image corresponding to the first keyword included in the newly acquired character information. By displaying a new first image in this way when the newly acquired character information does not include the second keyword but does include the first keyword, the first display area A1 can be used efficiently.

[0137] In this embodiment, in another example of the second display mode, the control unit 53 may determine whether or not there is free space in the third area A13 serving as the display unit before displaying a new first image. If the control unit 53 determines that there is free space in the third area A13, it may display the new first image in the third area A13 together with the currently displayed first image. This configuration allows the first display area A1 to be used efficiently.

[0138] In addition, in this embodiment, in another example of the second display mode, if the control unit 53 determines that there is no free space in the third area A13 serving as the display unit, it may delete one of the first images currently being displayed and display a new first image in the third area A13. By deleting one of the first images currently being displayed and displaying a new first image when there is no free space, a new first image corresponding to the latest interaction between the first user U1 and the second user U2 is displayed in the third area A13. This configuration can improve convenience for the first user U1 and the second user U2.

[0139] In addition, in the present embodiment, in another example of the second display mode, when the control unit 53 determines that there is no free space in the third area A13 and deletes one of the currently displayed first images, the control unit 53 may delete the first image that was displayed least recently among the currently displayed first images. Among the currently displayed first images, the first image that was displayed least recently may have decreased importance in the dialogue between the first user U1 and the second user U2. By deleting the first image that was displayed least recently, the possibility of impairing convenience for the first user U1 and the second user U2 is reduced.

[0140] In the present embodiment, in another example of the second display mode, the control unit 53 may determine whether or not there is free space in the third area A13 by calculating the maximum number of first images that can be displayed in the third area A13 as a display unit. With this configuration, the control unit 53 can more easily determine whether or not there is free space in the third area A13.

[0141] In the present embodiment, when the second condition is satisfied while the display system 1 is in the second display mode, the control unit 53 may transition the operation mode of the display system 1 from the second display mode to the first display mode. With this configuration, the operation mode of the display system 1 can be transitioned to the first display mode depending on the state of the dialogue between the first user U1 and the second user U2.

[0142] While the present disclosure has been described based on various drawings and examples, it should be noted that those skilled in the art would easily be able to make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are within the scope of the present disclosure. For example, the functions included in each functional unit can be rearranged so as not to cause logical inconsistencies. Multiple functional units may be combined into one or divided. The above-described embodiments of the present disclosure are not limited to faithful implementation of each of the described embodiments, but may be implemented by combining features or omitting some features as appropriate. In other words, those skilled in the art can make various modifications and alterations to the contents of the present disclosure based on the present disclosure. Therefore, these modifications and alterations are within the scope of the present disclosure. For example, in each embodiment, each functional unit, each means, or each step can be added to other embodiments so as not to cause logical inconsistencies, or can be replaced with each functional unit, each means, or each step of other embodiments. Furthermore, in each embodiment, multiple functional units, each means, or each step can be combined into one or divided. Furthermore, each of the above-described embodiments of the present disclosure is not limited to being implemented faithfully according to each of the described embodiments, but can also be implemented by combining each feature or omitting some of them as appropriate.

[0143] For example, in the above-described embodiment, the server 3 is described as executing the voice recognition process. However, the voice recognition process may be executed by any device other than the server 3. As an example, the electronic device 50 may execute the voice recognition process.

[0144] For example, an embodiment is also possible in which a general-purpose computer functions as the electronic device 50 according to the above-described embodiment. Specifically, a program describing the processing content for realizing each function of the electronic device 50 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by a processor. Therefore, the present disclosure can also be realized as a program executable by a processor or a non-transitory computer-readable medium storing the program.

[0145] For example, the components and functional blocks included in each embodiment of the present disclosure may be arranged in the same hardware or different hardware as appropriate. The microphone 30 according to each embodiment of the present disclosure may be included in the same hardware as the electronic device 50 or the projector 20. The input device 40 according to each embodiment of the present disclosure may be included in the same hardware as the electronic device 50 or the projector 20. Some or all of the communication unit 51, the storage unit 52, and the control unit 53 according to each embodiment of the present disclosure may be included in the projector 20.

[0146] For example, the display unit of the present disclosure is not limited to a configuration including a transparent screen, and may include, for example, a transparent organic light-emitting diode (OLED) display in which light-emitting elements are arranged within a transparent substrate.

[0147] For example, in the above-described embodiment, the first user U1 holds the IC card over the communication module of the communication unit 51. However, depending on the communication distance in short-range wireless communication between the IC card and the communication unit 51, the first user U1 does not need to hold the IC card over the communication module of the communication unit 51. In this case, when the distance between the IC card of the first user U1 and the communication unit 51 becomes a distance at which short-range wireless communication can be performed, the control unit 53 may receive, via the communication unit 15, a request to use the second display mode written in the IC card.

[0148] In one embodiment, (1) the program causes a display control device to perform processing including: acquiring character information converted by voice recognition; operating in a first display mode in which an image corresponding to a keyword included in the character information is displayed on a display unit located between a first user and a second user; transitioning from the first display mode to a second display mode when a first condition is satisfied while in the first display mode; and displaying the image on the display unit in a display manner different from that in the first display mode in the second display mode.

[0149] (2) In the program of (1) above, the first condition may be a condition that a predetermined input has been received.

[0150] (3) In the program according to (1) or (2), the first condition may be that status information of the first user indicates a desire to use the second display mode.

[0151] (4) In the program according to any one of (1) to (3) above, the first display mode may be a mode in which the character information and the image can be displayed.

[0152] (5) In the program according to any one of (1) to (4) above, the second display mode may be a mode capable of displaying more images or larger images than in the first display mode.

[0153] (6) In the program described in any one of (1) to (5) above, the processing may include, in the first display mode, displaying the image by displaying a first image corresponding to a first keyword included in the character information.

[0154] (7) In the program described in any one of (1) to (6) above, the processing may include displaying first character information as the display of the character information in the first display mode, and the first character information may be generated so that a character string included in the character information is displayed upright when viewed from the first user.

[0155] (8) In the program described in any one of (1) to (7) above, the processing may include, in the second display mode, displaying the image by displaying a second image corresponding to a second keyword included in the character information.

[0156] (9) In the program described in any one of (1) to (8) above, the processing may include: when the first condition is satisfied while the first image is being displayed, determining whether a second image corresponding to a second keyword that is the same as the first keyword is saved; and when it is determined that the second image is saved, displaying the second image in the second display mode.

[0157] (10) In the program described in any one of (1) to (9) above, the processing may include, when it is determined that the second image is not saved, displaying the first image in the second display mode as the image to be displayed.

[0158] (11) In the program described in any one of (1) to (10) above, the processing may include, when the character information is newly acquired in the second display mode, preferentially displaying a new second image corresponding to a second keyword included in the newly acquired character information.

[0159] (12) In the program described in any one of (1) to (11) above, the processing may include, in the second display mode, displaying a new first image corresponding to the first keyword included in the newly acquired character information when the newly acquired character information does not include a second keyword but includes a first keyword.

[0160] (13) In the program described in any one of (1) to (12) above, the processing may include: determining whether or not there is free space on the display unit before displaying the new first image; and, if it is determined that there is free space on the display unit, displaying the new first image on the display unit together with the first image currently being displayed.

[0161] (14) In the program described in any one of (1) to (13) above, the processing may include: determining whether or not there is free space on the display unit before displaying the new first image; and, if it is determined that there is no free space on the display unit, deleting any one of the first images currently being displayed and displaying the new first image on the display unit.

[0162] (15) In the program described in any one of (1) to (14) above, the processing may include deleting one of the first images currently being displayed, the first image being displayed most recently among the first images currently being displayed.

[0163] (16) In the program described in any one of (1) to (15) above, the processing may include: determining whether or not there is free space on the display unit by calculating the maximum number of the first images that can be displayed on the display unit; and calculating the maximum number of the first images that can be displayed on the display unit based on the aspect ratio of the first images and the horizontal and vertical sizes of the display unit.

[0164] (17) In the program described in any one of (1) to (16) above, the vertical size of the first image may be larger than the horizontal size of the first image, and the horizontal size of the second image may be larger than the vertical size of the second image.

[0165] (18) In the program described in any one of (1) to (17) above, the processing may include transitioning from the second display mode to the first display mode when a second condition is satisfied while in the second display mode.

[0166] In one embodiment, (19) a display control device operates in a first display mode that acquires character information converted by voice recognition and displays an image corresponding to a keyword contained in the character information on a display unit located between a first user and a second user, and includes a control unit that transitions from the first display mode to a second display mode when a first condition is satisfied while in the first display mode, and the control unit displays the image on the display unit in a display manner different from that in the first display mode in the second display mode.

[0167] In one embodiment, (20) a control method includes: acquiring character information after conversion by voice recognition; operating in a first display mode in which an image corresponding to a keyword included in the character information is displayed on a display unit located between a first user and a second user; transitioning from the first display mode to a second display mode when a first condition is satisfied while in the first display mode; and displaying the image on the display unit in a display manner different from that in the first display mode in the second display mode.

[0168] In this disclosure, descriptions such as "first" and "second" are identifiers for distinguishing the configuration. Configurations distinguished by descriptions such as "first" and "second" in this disclosure can exchange numbers in the configuration. For example, a first user can exchange the identifiers "first" and "second" with a second user. The exchange of identifiers is performed simultaneously. The configurations remain distinguished even after the identifier exchange. Identifiers may be deleted. Configurations from which identifiers have been deleted are distinguished by symbols. The descriptions of identifiers such as "first" and "second" in this disclosure should not be used solely to interpret the order of the configurations or to justify the existence of identifiers with smaller numbers.

[0169] REFERENCE SIGNS LIST 1 Display system 2 Network 3 Server 10 Base material 10A, 10B Surface 11 Transparent screen 12 Screen section 13 Light-shielding section 20 Projector 30 Microphone 40 Input device 50 Electronic device 51 Communication section 52 Storage section 52D1 First database 52D2 Second database 53 Control section 60 First character information 61 Second character information 70 Second image 62, 71, 72, 73 First image A1 First display area A11 First area A12 Second area A13 Third area A2 Second display area U1 First user U2 Second user

Claims

1. A display control device Obtaining text information converted by speech recognition; operating in a first display mode in which an image corresponding to a keyword included in the character information is displayed on a display unit located between a first user and a second user; transitioning from the first display mode to a second display mode when a first condition is satisfied while in the first display mode; and displaying the image on the display unit in a display manner different from that in the first display mode in the second display mode.

2. The program according to claim 1 , wherein the first condition is that a predetermined input has been received.

3. The program according to claim 1 , wherein the first condition is that status information of the first user indicates a desire to use the second display mode.

4. The program according to claim 1 , wherein the first display mode is a mode in which the character information and the image can be displayed.

5. The program according to claim 1 , wherein the second display mode is a mode capable of displaying more images or larger images than those in the first display mode.

6. The program according to claim 1 , wherein the process of displaying the image in the first display mode includes displaying a first image corresponding to a first keyword included in the character information.

7. the processing includes displaying first character information in the first display mode as the displaying of the character information; The program according to claim 4 , wherein the first character information is generated so that a character string included in the character information is displayed upright when viewed from the first user.

8. The program according to claim 1 , wherein the process of displaying the image in the second display mode includes displaying a second image corresponding to a second keyword included in the character information.

9. The process comprises: If the first condition is satisfied while the first image is being displayed, determining whether a second image corresponding to a second keyword that is the same as the first keyword is stored; The program according to claim 6 , further comprising: when it is determined that the second image is stored, displaying the image in the second display mode includes displaying the second image.

10. 10. The program according to claim 9, wherein the processing includes, when it is determined that the second image is not saved, displaying the first image in the second display mode as the display of the image.

11. The program according to claim 10, wherein the processing includes, when the character information is newly acquired in the second display mode, preferentially displaying a new second image corresponding to a second keyword included in the newly acquired character information.

12. The program according to claim 11, wherein the processing includes, in the second display mode, when the newly acquired character information does not include a second keyword but does include a first keyword, displaying a new first image corresponding to the first keyword included in the newly acquired character information.

13. The process comprises: determining whether there is free space on the display unit before displaying the new first image; The program according to claim 12 , further comprising: when it is determined that there is free space on the display unit, displaying the new first image on the display unit together with the first image currently being displayed.

14. The process comprises: determining whether there is free space on the display unit before displaying the new first image; The program according to claim 12, further comprising: when it is determined that there is no free space on the display unit, deleting any one of the first images currently being displayed and displaying the new first image on the display unit.

15. 15. The program according to claim 14, wherein the process of deleting one of the first images currently being displayed includes deleting a first image that was displayed most recently among the first images currently being displayed.

16. The process comprises: determining whether or not there is free space on the display unit by calculating a maximum number of the first images that can be displayed on the display unit; 14. The program according to claim 13, further comprising: calculating a maximum number of first images that can be displayed on the display unit based on an aspect ratio of the first images and horizontal and vertical sizes of the display unit.

17. a vertical size of the first image is larger than a horizontal size of the first image; The program according to claim 9 , wherein a horizontal size of the second image is larger than a vertical size of the second image.

18. The program according to claim 1 , wherein the processing includes transitioning from the second display mode to the first display mode when a second condition is satisfied in the second display mode.

19. a control unit that operates in a first display mode to acquire character information converted by voice recognition and display an image corresponding to a keyword included in the character information on a display unit located between a first user and a second user, and that transitions from the first display mode to a second display mode when a first condition is satisfied while in the first display mode; The control unit In the second display mode, the display control device displays the image on the display unit in a display manner different from that in the first display mode.

20. Obtaining text information converted by speech recognition; operating in a first display mode in which an image corresponding to a keyword included in the character information is displayed on a display unit located between a first user and a second user; transitioning from the first display mode to a second display mode when a first condition is satisfied while in the first display mode; In the second display mode, displaying the image on the display unit in a display manner different from that in the first display mode.