Program, display control device, and control method

Abstract

The program causes the display control device to execute a process. The processing includes: acquiring text information converted by speech recognition; an operation unit that operates in a first display mode in which an image corresponding to a keyword included in the text information is displayed on a display unit located between a first user and a second user; when a first condition is met in the first display mode, transferring from the first display mode to a second display mode; and in the second display mode, displaying the image on the display unit in a display mode different from the first display mode.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority from Japanese Patent Application No. 2023-027795 filed in Japan on February 24, 2023, and the entire disclosure of that prior application is incorporated herein by reference. Technical Field

[0003] The present disclosure relates to a program, a display control device, and a control method. Background Art

[0004] Conventionally, technologies for displaying images on a display unit are known (for example, Patent Document 1). The display device described in Patent Document 1 displays multiple images in separate display areas, detects user manipulation of the image display areas, and changes the image display areas and display states based on the detected user manipulation.

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1: International Publication No. 2018 / 025339 Summary of the Invention

[0008] A program according to an embodiment of the present disclosure causes a display control device to execute a process including:

[0009] Obtain text information converted by voice recognition;

[0010] operating in a first display mode for displaying an image corresponding to a keyword included in the text information on a display unit located between a first user and a second user;

[0011] If a first condition is satisfied in the first display mode, transition from the first display mode to the second display mode; and

[0012] In the second display mode, the image is displayed on the display unit in a display format different from that in the first display mode.

[0013] A display control device according to an embodiment of the present disclosure,

[0014] The device includes a control unit that receives text information converted by voice recognition and operates in a first display mode for displaying an image corresponding to a keyword included in the text information on a display unit located between a first user and a second user, wherein the control unit switches from the first display mode to a second display mode if a first condition is satisfied in the first display mode.

[0015] In the second display mode, the control unit displays the image on the display unit in a display method different from that in the first display mode.

[0016] A control method according to an embodiment of the present disclosure includes:

[0017] Obtain text information converted by voice recognition;

[0018] operating in a first display mode for displaying an image corresponding to a keyword included in the text information on a display unit located between a first user and a second user;

[0019] If a first condition is satisfied in the first display mode, transition from the first display mode to the second display mode; and

[0020] In the second display mode, the image is displayed on the display unit in a display format different from that in the first display mode. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 This is a diagram showing a schematic configuration of a display system according to one embodiment of the present disclosure.

[0022] Figure 2 yes Figure 1 The block diagram of the display system is shown.

[0023] Figure 3 This is a diagram showing the configuration of the first display area and the second display area as viewed from the perspective of a first user.

[0024] Figure 4 1 and 2 are diagrams showing the configuration of the first display area and the second display area as viewed from the perspective of a second user.

[0025] Figure 5 FIG. 1 is a diagram showing the first display area initialized in the second display mode.

[0026] Figure 6 1 is a diagram showing a display example of the first display area in the second display mode.

[0027] Figure 7 FIG. 1 is a diagram showing a display example of the first display area in the second display mode.

[0028] Figure 8 1 is a diagram showing a display example of the first display area in another example of the second display mode.

[0029] Figure 9 1 is a diagram showing a display example of the first display area in another example of the second display mode.

[0030] Figure 10This is a flowchart showing the flow of control processing in the first display mode.

[0031] Figure 11 This is a flowchart showing the flow of control processing in the second display mode.

[0032] Figure 12 This is a flowchart showing the flow of control processing in the second display mode.

[0033] Figure 13 This is a flowchart showing the flow of control processing in another example of the second display mode.

[0034] Figure 14 This is a flowchart showing the flow of control processing in another example of the second display mode.

[0035] Figure 15 This is a flowchart showing the flow of image deletion processing.

[0036] Figure 16 This is a flowchart showing the flow of the transition process to the first display mode. DETAILED DESCRIPTION

[0037] Conventional technology for displaying images on a display unit has room for improvement. According to one embodiment of the present disclosure, the technology for displaying images on a display unit can be improved.

[0038] In the present disclosure, the "vertical orientation" and "horizontal orientation" of an image can be set based on the image content. For example, the vertical orientation of an image can be the direction that a user identifies as the vertical direction within the image based on the image content. The horizontal orientation of an image can be the direction that a user identifies as the horizontal direction within the image based on the image content. Furthermore, the "aspect ratio" of an image is the ratio of the vertical dimension to the horizontal dimension of an image.

[0039] Hereinafter, embodiments according to the present disclosure will be described with reference to the accompanying drawings.

[0040] (Showing the system structure)

[0041] Figure 1 As shown, the display system 1 according to this embodiment is used at a counter. Examples of counters where the display system 1 is used include counters at public institutions such as government or local governments, counters at financial institutions, counters at medical institutions, and counters at public transportation facilities. However, the display system 1 can also be used in locations other than counters. For example, the display system 1 can be used in a business store or a conference room within an office of a self-employed business owner.

[0042] Display system 1 can facilitate a conversation between a first user U1 and a second user U2. First user U1 is a visitor to a counter. First user U1 is, for example, hearing-impaired. Second user U2 is a staff member in charge of the counter. At such a counter, first user U1 and second user U2 face each other.

[0043] like Figure 1 As shown, the display system 1 includes a substrate 10 and a projector 20. Figure 2 As shown, display system 1 includes microphone 30, input device 40, and electronic device 50. Electronic device 50 serves as the display control device in display system 1. Projector 20, microphone 30, input device 40, and electronic device 50 can communicate via a communication line. The communication line can be wired or wireless, for example. Projector 20, microphone 30, input device 40, and electronic device 50 can also be configured as a single device.

[0044] like Figure 1 As shown, substrate 10 is positioned between first user U1 and second user U2. Substrate 10 is, for example, made of a transparent member. The longitudinal length of substrate 10 can be greater than the length of an average person's upper body. The lateral length of substrate 10 can be several times the width of an average person's shoulders. In recent years, to prevent infection, plastic curtains or acrylic panels, etc., have sometimes been placed between visitors like first user U1 and counter staff like second user U2 to prevent the spread of droplets. Such plastic curtains or acrylic panels can be used as substrate 10.

[0045] like Figure 2 As shown, the substrate 10 includes surfaces 10A and 10B. When the substrate 10 is positioned between a first user U1 and a second user U2, the first user U1 is positioned on the surface 10B side. Furthermore, the second user U2 is positioned on the surface 10A side. The substrate 10 includes a transparent screen 11.

[0046] like Figure 2 As shown, the transparent screen 11 is disposed on the surface 10A side of the surfaces 10A and 10B of the substrate 10. As will be described later, the second user's speech and the like are projected onto the transparent screen 11 by the projector 20. By projecting the second user's speech and the like onto the transparent screen 11, the hearing-impaired first user U1 can read and understand the speech of the second user U2 projected onto the transparent screen 11.

[0047] The transparent screen 11 can be placed anywhere on the substrate 10. For example, if the substrate 10 is located between the first user U1 and the second user U2, the transparent screen 11 can be placed on the substrate 10 at a position that does not obstruct the first user U1 and the second user U2 from visually viewing each other's faces. In this case, the transparent screen 11 can be placed below the center of the substrate 10. The size of the transparent screen 11 can be set based on the amount of information projected onto the transparent screen 11.

[0048] like Figure 2 As shown, the transparent screen 11 includes a screen portion 12 and a light shielding portion 13. The screen portion 12 is disposed on the surface 10A of the substrate 10. The light shielding portion 13 is disposed on the screen portion 12.

[0049] The screen 12 is a projector screen. It is composed of a transparent member, such as a film, sheet, or plate, that can be attached to the substrate 10. The screen 12 itself is sometimes referred to as a "transparent screen." Projection light from the projector 20 is incident on the screen 12. The screen 12 diffuses a portion of the incident projection light on both the incident and exit sides. The projection light diffused by the screen 12 allows the first user U1 and the second user U2 to enter their fields of view and recognize the image projected by the projector 20.

[0050] The shape of the screen portion 12 is, for example, a rectangle. However, the shape of the screen portion 12 is not limited to a rectangle. The shape of the screen portion 12 may be any shape.

[0051] The light shielding portion 13 at least partially blocks the transmission of the projection light emitted from the projector 20. In this embodiment, the light shielding portion 13 blocks the transmission of light of a predetermined wavelength from the projection light emitted from the projector 20. The light shielding portion 13 is formed, for example, of a dichroic film that blocks light of a predetermined wavelength. For example, the light shielding portion 13 is formed of a dichroic film that blocks red light.

[0052] The light shielding portion 13 may overlap a portion of the screen portion 12. For example, the light shielding portion 13 may overlap the surface of the screen portion 12. Figure 2 As shown, the light shielding portion 13 may be arranged below the center of the surface of the screen portion 12 .

[0053] The shape of the light shielding portion 13 is, for example, a rectangle. However, the shape of the light shielding portion 13 is not limited to a rectangle. The shape of the light shielding portion 13 may be any shape.

[0054] The screen unit 12 becomes the display unit in the display system 1. Figure 2 As shown, the area of ​​the screen portion 12 includes a first display area A1 and a second display area A2.

[0055] The first display area A1 is the area of ​​the screen 12 that does not overlap with the light shielding portion 13. Projector 20 projects light onto the first display area A1, such as text or images. Because the first display area A1 is the area of ​​the screen 12 that does not overlap with the light shielding portion 13, both the first user U1 and the second user U2 can visually recognize the text or images projected onto the first display area A1. In this embodiment, the first display area A1 allows the first user U1 to view, for example, the speech of the second user U2.

[0056] The second display area A2 is the area where the screen portion 12 and the light shielding portion 13 overlap. As described later, projection light of a predetermined wavelength, blocked by the light shielding portion 13, is irradiated by the projector 20 onto the second display area A2. At this time, the first user U1 cannot visually recognize text, etc., projected onto the second display area A2. However, the second user U2 can visually recognize text, etc. projected onto the second display area A2. In this embodiment, the second display area A2 is used by the second user U2 to confirm their own speech.

[0057] As described later Figure 3 As shown, the second display area A2 can be located below the first display area A1. The size of the first display area A1 and the size of the second display area A2 can be set based on the amount of information displayed in the first display area A1 and the second display area A2, respectively. As an example, 4 / 5 of the screen portion 12 can be the first display area A1, and 1 / 5 of the screen portion 12 can be the second display area A2.

[0058] The operation modes of the display system 1 include a first display mode and a second display mode.

[0059] The first display mode is a mode in which both text and images can be displayed in the first display area A1. Figure 3 As shown, the first display area A1 includes a first area A11 and a second area A12. Text is displayed in the first area A11. Images are displayed in the second area A12. The size of the first area A11 and the size of the second area A12 in the first display area A1 can be set based on the amount of text and images displayed in the first display area A1. For example, two-thirds of the first display area A1 can be the first area A11, and one-third of the first display area A1 can be the second area A12.

[0060] The second display mode is a mode in which images are displayed in a different display mode from the first display mode. In this embodiment, the second display mode is a mode in which more images or larger images can be displayed than in the first display mode. In the second display mode, Figures 5 to 7As shown, the first display area A1 includes a third area A13. An image is displayed in the third area A13. Figures 5 to 7 In the embodiment, the size of the third area A13 is the same as the size of the first display area A1. However, the size of the third area A13 may be smaller than the size of the first display area A1.

[0061] like Figure 2 As shown in FIG. 1 , the projector 20 is disposed on the surface 10A side of the surfaces 10A and 10B of the substrate 10. The projector 20 is, for example, Figure 1 As shown, it is arranged at a position closer to the second user U2 than the substrate 10 .

[0062] The projector 20 irradiates projection light onto the screen portion 12 based on the control of the electronic device 50. The projector 20 projects text, images, and the like onto the screen portion 12 by irradiating the screen portion 12 with projection light.

[0063] like Figure 2 As shown, the microphone 30 is arranged on the surface 10A side of the surfaces 10A and 10B of the substrate 10. For example, the microphone 30 is arranged on the surface 10A side of the substrate 10. Figure 1 The substrate 10 shown is closer to the second user U2. As an example, the microphone 30 can be placed on a table in front of the second user U2. If the second user U2 wears a headset, the microphone 30 can also be installed on the headset.

[0064] The microphone 30 collects voice. The voice collected by the microphone 30 may include the speech of the second user U2. The microphone 30 transmits the collected voice data to the electronic device 50.

[0065] like Figure 2 As shown in FIG. 1 , the input device 40 is disposed on the surface 10A side of the surface 10A and the surface 10B of the substrate 10. The input device 40 is disposed, for example, Figure 1 As shown, the substrate 10 is closer to the position of the second user U2. As an example, the input device 40 can be configured at Figure 1 As shown, the table in front of the second user U2 is shown.

[0066] The input device 40 is composed of a keyboard, a numeric keypad, etc. The input device 40 receives input from the second user U2 and transmits the received input data to the electronic device 50 .

[0067] Electronic device 50 is, for example, a smartphone or tablet terminal. Electronic device 50 can communicate with server 3 via network 2. Network 2 can be any network including a mobile communication network and the Internet. Server 3 is, for example, a cloud server. Server 3 can perform speech recognition.

[0068] Server 3 is a server that can be accessed via network 2. Server 3 involved in this embodiment is a speech recognition server that provides speech recognition service. Speech recognition service is a service that converts speech into text information. When receiving speech data, server 3 involved in this embodiment performs speech recognition processing on the received speech data. Speech recognition processing is a process of converting speech data into text information. Server 3 converts the received speech data into text information by performing speech recognition processing. Server 3 sends the converted text information to the source of the speech data. Server 3 provides speech recognition service as a paid or free service.

[0069] like Figure 2 As shown, the electronic device 50 includes a communication unit 51 , a storage unit 52 , and a control unit 53 .

[0070] The communication unit 51 includes at least one communication module that can connect to the network 2. The communication module is, for example, a communication module that supports a mobile communication standard such as LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation).

[0071] The communication unit 51 includes at least one communication module capable of communicating with the projector 20 via a communication line. The communication module is a communication module compatible with the standard of the communication line between the electronic device 50 and the projector 20. The communication line standard is a short-range wireless communication standard such as Miracast.

[0072] Communication unit 51 includes at least one communication module capable of communicating with microphone 30 via a communication line. The communication module corresponds to a standard for the communication line between electronic device 50 and microphone 30. The communication line standard is a wired communication standard such as the CTIA (Cellular Telephone Association) standard or the OMTP (Open Mobile Terminal Platform) standard.

[0073] The communication unit 51 includes at least one communication module capable of communicating with the input device 40 via a communication line. The communication module corresponds to a standard for the communication line between the electronic device 50 and the input device 40. For example, the communication line standard is a short-range wireless communication standard such as Bluetooth (registered trademark).

[0074] The communication unit 51 may also be configured to include at least one communication module capable of communicating with an IC card. The communication module is a communication module corresponding to a short-range wireless communication standard such as NFC (near field communication) or RFID (Radio Frequency Identifier). The communication module is configured in a manner such as Figure 1 As shown, the table in front of the first user U1.

[0075] The storage unit 52 is configured to include at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. Examples of semiconductor memory include RAM (Random Access Memory) and ROM (Read Only Memory). Examples of RAM include SRAM (Static Random Access Memory) and DRAM (Dynamic Random Access Memory). Examples of ROM include EEPROM (Electrically Erasable Programmable Read Only Memory). The storage unit 52 can function as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 52 stores data used for the operation of the electronic device 50 and data obtained by the operation of the electronic device 50. For example, the storage unit 52 stores system programs, application programs, and embedded software.

[0076] The storage unit 52 includes a first database 52D and a second database 52D.

[0077] The data of the first image is stored in the first database 52D. The first image can be either a still image or a dynamic image. A first keyword is associated with the first image. Different first images can correspond to different first keywords. The vertical dimension of the first image is greater than the horizontal dimension of the first image. In other words, the first image is a so-called vertically long image. The aspect ratio of the first image can be set according to the size of the second area A12, etc. For example, the vertical dimension:horizontal dimension of the first image is 3:2. The first image is used in both the first display mode and the second display mode.

[0078] The data of the second image is stored in the second database 52D2. The second image can be either a still image or a dynamic image. A second keyword is associated with the second image. Different second images can correspond to different second keywords. Some or all of the multiple second keywords can be the same as or different from some or all of the multiple first keywords. The horizontal dimension of the second image is larger than the vertical dimension of the second image. In other words, the second image is a so-called horizontally long image. The aspect ratio of the second image can be set according to the size of the first display area A1, etc. For example, the vertical dimension: horizontal dimension of the second image is 2:3. The second image is used in the second display mode. The amount of information contained in the second image can be more than the amount of information contained in the first image. The second image is, for example, a map.

[0079] The control unit 53 is configured to include at least one processor, at least one dedicated circuit, or a combination thereof. A processor can be a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor for specific processing. Dedicated circuits include, for example, FPGAs (Field-Programmable Gate Arrays) or ASICs (Application-Specific Integrated Circuits). The control unit 53 controls the various components of the electronic device 50 and executes processing related to the operation of the electronic device 50.

[0080] <Processing in the First Display Mode>

[0081] In the initial state, the control unit 53 operates in the first display mode. For example, the electronic device 50 enters the initial state immediately after starting an application for executing the display system 1. In the first display mode, the control unit 53 executes the text information acquisition process described below.

[0082] <<Acquisition and processing of text information>>

[0083] The control unit 53 receives voice data collected by the microphone 30 from the microphone 30 via the communication unit 51. The received voice data may include speech data uttered by the second user U2. The control unit 53 transmits the received voice data to the server 3 via the network 2 via the communication unit 51. After receiving the voice data from the electronic device 50, the server 3 performs voice recognition processing on the received voice data. After converting the voice data into text information, the server 3 transmits the converted text information to the electronic device 50 via the network 2.

[0084] The control unit 53 receives the text information converted by the voice recognition from the server 3 via the network 2 via the communication unit 51. In the present embodiment, the control unit 53 receives the text information from the server 3 to obtain the text information converted by the voice recognition.

[0085] <<Generation Process of First Text Information and Second Text Information>>

[0086] When receiving text information from the server 3 , the control unit 53 generates first text information and second text information based on the text information received from the server 3 .

[0087] The first text information is text information displayed in the first area A11 of the first display area A1. The control unit 53 generates the first text information so that the character string contained in the text information is displayed upright when observed from the first user U1 in the first area A11. In the present disclosure, "upright" refers to a state in which text, etc. are displayed upright from the user's perspective. "Upright" is used in contrast to a state in which text, etc. are flipped left and right. Here, the direction in which the character string of the first text information is arranged in the first display area A1 depends on the language and the display method of the article in the first area A11. As an example, it is assumed that the received text information is based on Japanese text information. In addition, as described later Figure 3 As shown in FIG. 1 , the article is displayed in a horizontal display mode in the first area A11. The horizontal Japanese article is read from the left side to the right side of the article. Therefore, the control unit 53 is as described later. Figure 3 The control unit 53 may generate the first text information so that the character strings contained in the received text information are arranged from left to right when viewed from the first user U1, as shown in the first text information 60. The control unit 53 may also generate the first text information so that the character strings contained in the text information are readable when viewed from the first user U1.

[0088] The second text information is text information that is displayed in the second display area A2. The control unit 53 generates the second text information in the same or similar manner as the first text information so that the second text information is displayed in the second display area A2. Figure 4 As shown in FIG. 6A , the character string contained in the text information is displayed upright in the second display area A2 when viewed from the second user U2, as in the second text information 61 shown. In other words, the second text information displayed in the second display area A2 and the first text information displayed in the first display area A1 may be flipped left-right when viewed from the second user U2. The control unit 53 may also generate the second text information so that the character string contained in the text information is readable when viewed from the second user U2.

[0089] <<Display Processing of First and Second Text Information>>

[0090] When generating the first and second character information, the control unit 53 executes a display process for the first and second character information, displaying the first character information in the first area A11 and the second character information in the second display area A2.

[0091] To display the first text information, the control unit 53 sends a control signal to the projector 20 via the communication unit 51, causing the projector 20 to project light for the first text information toward the first area A11. The wavelength of the projection light for the first text information can be set based on the visibility of text, etc., in the first area A11. The control unit 53 causes the projector 20 to project light for the first text information toward the first area A11, thereby displaying the first text information in the first area A11.

[0092] To display the second text information, the control unit 53 sends a control signal to the projector 20 via the communication unit 51, causing the projector 20 to project light for the second text information onto the second display area A2. The projection light for the second text information is light of a predetermined wavelength blocked by the light shielding unit 13. For example, if the light shielding unit 13 is formed of a dichroic film that blocks red light, the projection light for the second text information will have a red wavelength. The control unit 53 causes the projector 20 to project light for the second text information onto the second display area A2, thereby displaying the second text information in the second display area A2.

[0093] For example, in Figure 3 FIG shows a structure in which the first user U1 observes the first display area A1 and the second display area A2. Figure 4 , the structure of the first display area A1 and the second display area A2 viewed from the perspective of the second user U2 is shown. Figure 3 as well as Figure 4 In the example, the control unit 53 receives the text information "おはようございます." from the server 3. In this case, the control unit 53 Figure 3 The first text information 60 is generated as shown in FIG. 5 so that the character string "おはようございます." is arranged from the left to the right when viewed from the first user U1. Figure 4 The second text information 61 is generated as shown in FIG. 1 so that the character string "おはようございます." is arranged from the left to the right when viewed from the second user U2. As described above, the projection light of the second text information 61 is the light of a given wavelength blocked by the light shielding portion 13. Therefore, as shown in FIG. Figure 3 As shown, the first user U1 cannot visually recognize the characters “おはようござます.” projected on the second display area A2 .

[0094] <<Display Processing of the First Image>>

[0095] Upon receiving the text information from the server 3 , the control unit 53 executes a display process for displaying the first image in the first display area A1 .

[0096] First, upon receiving text information from server 3, control unit 53 refers to first database 52D1 to determine whether the received text information contains the first keyword. If control unit 53 determines that the received text information contains the first keyword, it retrieves data for the first image associated with the first keyword from first database 52D1.

[0097] When the control unit 53 obtains the data of the first image from the first database 52D1, it displays the obtained data of the first image in the second area A12. As an example of this process, the control unit 53 sends a control signal to the projector 20 through the communication unit 51, so that the projector 20 irradiates the projection light of the first image to the second area A12. The wavelength of the projection light of the first image can be set in consideration of the visibility of the image in the second area A12. The control unit 53 displays the first image in the second area A12 by causing the projector 20 to irradiate the projection light of the first image to the second area A12. For example, Figure 3 as well as Figure 4 In the illustrated configuration, the first image 62 is displayed in the second area A12.

[0098] <Transition Process to Second Display Mode>

[0099] When the display system 1 is in the first display mode, the control unit 53 switches the operating mode of the display system 1 from the first display mode to the second display mode if a first condition is satisfied. The first condition is a condition for switching the operating mode of the display system 1 from the first display mode to the second display mode. The first condition can be set based on user convenience.

[0100] As an example, the first condition may be a condition in which a given input is received. The given input may be, for example, an input indicating a transition to the second display mode. For example, the second user U2 may sometimes want the first display area A1 to display an image such as a map containing a large amount of information. In this case, the second user U2 may input an input indicating a transition to the second display mode into the input device 40. Upon receiving the input indicating a transition to the second display mode, the input device 40 may transmit data indicating the input indicating the transition to the second display mode to the electronic device 50. The control unit 53 may receive the input data indicating the transition to the second display mode from the input device 40 via the communication unit 51, thereby receiving the input indicating the transition to the second display mode. Upon receiving the input indicating the transition to the second display mode, the control unit 53 causes the operating mode of the display system 1 to transition from the first display mode to the second display mode. Here, the control unit 53 may also receive the given input via the microphone 30. In other words, the given input may also be a voice-based input.

[0101] As another example, the first condition may be that the first user U1's status information indicates a desire to use the second display mode. For example, the first user U1 may wish to receive instructions from the second user U2 solely through images. In this case, the first user U1 may also pre-write the desire to use the second display mode onto an IC card they hold. This IC card may be issued by a public institution that uses the display system 1 at a counter. For example, before beginning a conversation with the second user U2, the first user U1 places the IC card on the communication module of the communication unit 51. When the IC card is placed on the communication module of the communication unit 51, the control unit 53 performs near-field wireless communication with the first user U1's IC card. The control unit 53 performs near-field wireless communication with the communication unit 51 and the first user U1's IC card, thereby obtaining the first user U1's status information indicating a desire to use the second display mode as written on the IC card. Upon obtaining the desire to use the second display mode written on the IC card, the control unit 53 switches the operating mode of the display system 1 from the first display mode to the second display mode.

[0102] <Processing in the Second Display Mode>

[0103] When shifting to the second display mode, the control unit 53 determines whether the first condition is satisfied during the display of the first image in the second area A12 .

[0104] When the control unit 53 shifts to the second display mode, if it determines that the first condition is satisfied when the first image is not being displayed in the second area A12, it initializes the first display area A1. Figure 5 As shown, the control unit 53 deletes Figure 3The first text message 60 is used to initialize the first display area A1. Figure 5 The illustrated structure is a structure in which the first display area A1 and the second display area A2 are viewed from the perspective of the first user U1 .

[0105] When the control unit 53 shifts to the second display mode, if it determines that the first condition is satisfied while the first image is displayed in the second area A12, the control unit 53 determines whether a second image associated with a second keyword is stored, and the second keyword is the same as the first keyword associated with the displayed first image. The control unit 53 refers to the second database 52D2 and determines whether a second image associated with the second keyword is stored, and the second keyword is the same as the first keyword associated with the displayed first image.

[0106] When the control unit 53 determines that a second image corresponding to a second keyword is stored, and the second keyword is the same as the first keyword corresponding to the first image currently displayed in the second area A12, the control unit 53 obtains the data of the second image from the second database 52D2. When obtaining the data of the second image, the control unit 53 deletes the first image currently displayed in the second area A12 and displays the obtained second image in the third area A13. For example, Figure 6 As shown, the control unit 53 displays the second image 70 in the third area A13.

[0107] If the control unit 53 determines that there is no second image associated with the second keyword stored, and the second keyword is the same as the first keyword associated with the first image currently displayed in the second area A12, the control unit 53 displays the first image currently displayed in the second area A12 in the third area A13. Figure 7 As shown, the control unit 53 displays the first image 71 in the third area A13. The control unit 53 displays the first image 71 in the center of the third area A13. However, the control unit 53 may display the first image 71 in any position other than the center of the third area A13.

[0108] The control unit 53 also performs the same or similar text information acquisition process in the second display mode as in the first display mode. In the second display mode, when the control unit 53 receives text information again from the server 3, it refers to the second database 52D2 to determine whether the newly received text information contains the second keyword. When the control unit 53 determines that the newly received text information contains the second keyword, it obtains data of a new second image corresponding to the second keyword from the second database 52D2. The control unit 53 preferentially displays the new second image in the third area A13 of the first display area A1. In this embodiment, the control unit 53 preferentially displays the new second image in the third area A13, deletes the first image or the second image displayed in the third area A13 of the first display area A1, and displays the new second image in the third area A13. However, preferentially displaying the new second image in the third area A13 is not limited to this. As another example, the control unit 53 may also superimpose the new second image on a portion of the first image or the second image being displayed.

[0109] <Other Examples of the Second Display Mode>

[0110] As another example of the second display mode, when newly received text information from the server 3 does not contain the second keyword but contains the first keyword, the control unit 53 may retrieve data for a new first image corresponding to the first keyword from the first database 52D1. The control unit 53 may also display the data for the new first image in the third area A13 of the first display area A1.

[0111] Here, the control unit 53 may determine whether there is free space in the third area A13 before displaying a new first image in the third area A13. Free space is space that can display a first image. The control unit 53 may also determine whether there is free space in the third area A13 by calculating the maximum number of first images that can be displayed in the third area A13. The control unit 53 may calculate the maximum number of first images that can be displayed in the third area A13 based on the aspect ratio of the first image and the horizontal and vertical dimensions of the third area A13.

[0112] Before displaying the new first image in the third area A13, if the control unit 53 determines that there is free space in the third area A13, the control unit 53 displays the new first image together with the first image currently being displayed in the third area A13. Figure 7 In the structure shown in FIG. 1 , the control unit 53 determines that there is a free space in the third area A13. In this case, Figure 8As shown, the control unit 53 displays the new first image 72 together with the currently displayed first image 71. The control unit 53 may display the first image displayed in reverse chronological order to the left of the third area A13. Furthermore, the control unit 53 may display multiple first images centered around the center of the third area A1. However, the control unit 53 may display the currently displayed first image and the new first image, i.e., multiple first images, at any location in the third area A13.

[0113] Before displaying the new first image in the third area A13, the control unit 53 deletes any of the first images currently being displayed if it determines that there is no free space in the third area A13, and displays the new first image in the third area A13. The control unit 53 may also delete the first image that was displayed the earliest among the first images currently being displayed. For example, Figure 9 In the structure shown, the control unit 53 determines that there is no free space in the third area A13. Among the first image 71, the first image 72, and the first image 73 displayed in the third area A13, the first image 71 is the first image to be displayed. Figure 9 In the illustrated configuration, the control unit 53 deletes the first image 71 from among the first images 71 to 73 being displayed, and displays a new first image in the third area A13 .

[0114] Image Deletion Processing

[0115] The second user U2 can input an image deletion instruction into the input device 40 in the first display mode or the second display mode. The image deletion instruction is an input instructing to delete the first image or the second image currently displayed in the first display area A1. The image deletion instruction can specify an image to be deleted from the first display area A1. Upon receiving the image deletion instruction input, the input device 40 can transmit the image deletion instruction input data to the electronic device 50.

[0116] The control unit 53 may receive input data of an image deletion instruction from the input device 40 via the communication unit 51, thereby accepting input of an image deletion instruction from the second user U2. Upon receiving the input of the image deletion instruction, the control unit 53 may delete the image from the first display area A1 in accordance with the input.

[0117] <Transition Process to First Display Mode>

[0118] When the second display mode is in the second display mode, if the second condition is satisfied, the control unit 53 switches the operating mode of the display system 1 from the second display mode to the first display mode. The second condition is a condition for switching the operating mode of the display system 1 from the second display mode to the first display mode. The second condition can be set based on user convenience.

[0119] As an example, the second condition may be a condition in which a given input is received. The given input may be, for example, an input indicating a transition to the first display mode. For example, after explaining the second display mode to the first user U1, the second user U2 may want to return the operating mode of the display system 1 to the first display mode. In this case, the second user U2 may input an input indicating a transition to the first display mode into the input device 40. Upon receiving the input indicating a transition to the first display mode, the input device 40 may transmit data indicating the input indicating the transition to the first display mode to the electronic device 50. The control unit 53 may receive the input indicating the transition to the first display mode from the input device 40 via the communication unit 51, thereby receiving the input indicating the transition to the first display mode. Upon receiving the input indicating the transition to the first display mode, the control unit 53 causes the operating mode of the display system 1 to transition from the second display mode to the first display mode. Here, the control unit 53 may also receive a given input that is the same as or similar to the first condition through the microphone 30.

[0120] As another example, the second condition may be that the first user U1's status information does not indicate a desire to use the second display mode. Sometimes, the first user U1 does not specifically desire to use the second display mode. In this case, the first user U1 may not write a desire to use the second display mode described above on their IC card. As described above, the first user U1, for example, does not place an IC card on the communication module of the communication unit 51 before initiating a conversation with the second user U2. As described above, the control unit 53 performs near-field wireless communication with the first user U1's IC card via the communication unit 51, thereby detecting that no desire to use the second display mode is written on the IC card. If the control unit 53 detects that no desire to use the second display mode is written on the first user U1's IC card, it can determine that the condition that the first user U1's status information does not indicate a desire to use the second display mode is satisfied. In other words, if the control unit 53 detects that no desire to use the second display mode is written on the first user U1's IC card, it can cause the display system 1's operating mode to shift from the second display mode to the second display mode. Here, the second user U2 may maintain the operation mode of the display system 1 in the second display mode after explaining the second display mode to the previous visitor of the first user U1. In this way, even if the second user U2 maintains the operation mode of the display system 1 in the second display mode, the operation mode of the display system 1 can be shifted to the first display mode based on the status information of the first user U1.

[0121] (Actions in the first display mode)

[0122] Figure 10This is a flowchart showing the flow of control processing in the first display mode. Figure 10 The control process shown is an example of the control method according to the present embodiment. For example, when the control unit 53 receives an input indicating an execution instruction of displaying text on the transparent screen 11 from the input device 40 via the communication unit 51, the control unit 53 starts Figure 10 The input is input by the second user U2 to the input device 40. When the process of step S1 is started, the operation mode of the display system 1 is the first display mode.

[0123] The control unit 53 receives voice data collected by the microphone 30 from the microphone 30 via the communication unit 51 (step S1). The control unit 53 transmits the voice data received in step S1 to the server 3 via the communication unit 51 via the network 2 (step S2). The control unit 53 receives text information converted by voice recognition from the server 3 via the communication unit 51 via the network 2 (step S3). The control unit 53 repeatedly executes steps S1 through S3 in parallel with the processing from step S4 onwards.

[0124] The control unit 53 generates first and second text information based on the text information received from the server 3 in the process of step S3 (step S4 ).

[0125] The control unit 53 refers to the first database 52D1 and determines whether the text information received in step S3 contains the first keyword (step S5). If the control unit 53 determines that the received text information does not contain the first keyword (step S5: No), the process proceeds to step S6. On the other hand, if the control unit 53 determines that the received text information contains the first keyword (step S5: Yes), the process proceeds to step S7.

[0126] In the process of step S6 , the control unit 53 displays the first character information generated in the process of step S4 in the first area A11 of the first display area A1 , and displays the second character information generated in the process of step S4 in the second display area A2 .

[0127] In the process of step S7 , the control unit 53 obtains the data of the first image associated with the first keyword included in the received text information from the first database 52D1 .

[0128] In step S8, the control unit 53 displays the first text information generated in step S4 in first area A11 of the first display area A1 and the second text information generated in step S4 in second display area A2. The control unit 53 displays the first image obtained in step S7 in second area A12 of the first display area A1.

[0129] After the process of step S7 or step S8 , the control unit 53 returns to the process of step S4 .

[0130] In the process of steps S1 to S8, the control unit 53 ends the process when receiving an input indicating the stop of the text display on the transparent screen 11 from the input device 40 through the communication unit 51. Figure 10 The input is input to the input device 40 by the second user U2.

[0131] (Actions in the secondary display mode)

[0132] Figure 11 as well as Figure 12 This is a flowchart showing the flow of control processing in the second display mode. Figure 11 as well as Figure 12 The control process shown is an example of the control method involved in this embodiment. Figure 10 The control unit 53 executes the processing of steps S1 to S8 shown in FIG. Figure 11 The control unit 53 repeatedly executes the processing of steps S1 to S3 in parallel with the processing after step S11.

[0133] The control unit 53 determines whether the first condition is satisfied (step S11). If the control unit 53 determines that the first condition is satisfied (step S11: Yes), the process proceeds to step S12. On the other hand, if the control unit 53 does not determine that the first condition is satisfied (step S11: No), the process of step S11 is repeated.

[0134] In the process of step S12 , the control unit 53 shifts the operation mode of the display system 1 from the first display mode to the second display mode.

[0135] In the process of step S13, the control unit 53 determines whether the first condition is satisfied in the display of the first image in the second area A12. For example, the process of step S11 has been executed. Figure 10 In the case of the processing of step S8 shown, the first condition can be satisfied in displaying the first image.

[0136] If the control unit 53 determines that the first condition is satisfied when the first image is not being displayed in the second area A12 (step S13: No), it initializes the first display area A1 (step S14). On the other hand, if the control unit 53 determines that the first condition is satisfied when the first image is being displayed in the second area A12 (step S13: Yes), the process proceeds to step S15.

[0137] In step S15, the control unit 53 refers to the second database 52D2 to determine whether a second image associated with a second keyword, the second keyword being the same as the first keyword associated with the first image currently being displayed, is stored. If the control unit 53 determines that the second image is stored (step S15: Yes), the process proceeds to step S17. On the other hand, if the control unit 53 determines that the second image is not stored (step S15: No), the process proceeds to step S16.

[0138] In the process of step S16, the control unit 53 displays the first image displayed in the second area A12 in the third area A13. Figure 7 As shown, the control unit 53 displays the first image 71 in the third area A13.

[0139] In the process of step S17, the control unit 53 obtains data of a second image associated with a second keyword from the second database 52D2. The second keyword is the same as the first keyword associated with the first image currently displayed in the second area A12. The control unit 53 deletes the first image currently displayed in the second area A12 (step S18) and displays the second image obtained in the process of step S17 in the third area A13 (step S19). For example, Figure 6 As shown, the control unit 53 displays the second image 70 in the third area A13.

[0140] After executing the processing of step S14, step S16 or step S19, the control unit 53 enters Figure 12 The process of step S20 is shown.

[0141] If the control unit 53 executes step S3 again, that is, if it receives new text information from the server 3, it executes step S20. The control unit 53 references the second database 52D2 and determines whether the newly received text information from the server 3 contains the second keyword (step S20). If the control unit 53 determines that the newly received text information contains the second keyword (step S20: Yes), the process proceeds to step S21. On the other hand, if the control unit 53 determines that the newly received text information does not contain the second keyword (step S20: No), the process of step S20 is executed again.

[0142] In the process of step S21 , the control unit 53 obtains the data of the second image associated with the second keyword included in the newly received text information from the second database 52D2 .

[0143] In step S22, the control unit 53 determines whether the first image or the second image is currently displayed in the third area A13. If step S16 or step S19 was executed before step S22, the first image or the second image is currently displayed in the third area A13 of the first display area A1. If step S14 was executed before step S22, neither the first image nor the second image is currently displayed in the third area A13 of the first display area A1.

[0144] If the control unit 53 determines that the first image or the second image is being displayed in the third area A13 (step S22: Yes), the process proceeds to step S23. On the other hand, if the control unit 53 determines that neither the first image nor the second image is being displayed in the third area A13 of the first display area A1 (step S22: No), the process proceeds to step S24.

[0145] In the process of step S23, the control unit 53 deletes the first image or the second image currently displayed from the third area A13. In the process of step S24, the control unit 53 displays the second image acquired in the process of step S21 in the third area A13.

[0146] In the process of steps S11 to S24, the control unit 53 ends the process when receiving an input indicating that the display of characters on the transparent screen 11 is stopped from the input device 40 via the communication unit 51. Figure 11 and the control process shown in FIG12. The input is input to the input device 40 by the second user U2.

[0147] (Operation in another example of the second display mode)

[0148] Figure 13 as well as Figure 14 This is a flowchart showing the flow of control processing in another example of the second display mode. Figure 13 as well as Figure 14 The control process shown is an example of the control method involved in this embodiment. Figure 11 After the processing of step S19 shown, the Figure 13 The control unit 53 repeatedly executes the processing of step S31 and subsequent steps in parallel. Figure 10 The processing of steps S1 to S3 is shown.

[0149] When the control unit 53 executes the process of step S3 again, that is, when the text information is received again from the server 3, the control unit 53 executes the process of step S31.

[0150] In step S31, the control unit 53 refers to the second database 52D2 to determine whether the text information newly received from the server 3 contains the second keyword. If the control unit 53 determines that the newly received text information contains the second keyword (step S31: Yes), the process proceeds to step S32. On the other hand, if the control unit 53 determines that the newly received text information does not contain the second keyword (step S31: No), the process proceeds to step S36.

[0151] The control unit 53 executes Figure 12 The processes of steps S21, S22, S23, and S24 are the same as or similar to the processes of steps S32, S33, S34, and S35. After executing the process of step S35, the control unit 53 returns to the process of step S31.

[0152] In step S36, the control unit 53 refers to the first database 52D1 and determines whether the text message newly received from the server 3 contains the first keyword. The control unit 53 performs step S36 on the same text message as the text message processed in step S31. If the control unit 53 determines that the newly received text message contains the first keyword (step S36: Yes), the process proceeds to step S37. On the other hand, if the control unit 53 determines that the newly received text message does not contain the first keyword (step S36: No), the process returns to step S31.

[0153] In the process of step S37 , the control unit 53 obtains the data of the first image associated with the first keyword included in the newly received text information from the first database 52D1 .

[0154] In step S38, the control unit 53 determines whether the second image is being displayed in the third area A13. If the control unit 53 determines that the second image is being displayed in the third area A13 (step S38: Yes), it deletes the second image from the third area A13 (step S39) and proceeds to step S40. On the other hand, if the control unit 53 determines that the second image is not being displayed in the third area A13 (step S38: No), it proceeds to step S40.

[0155] In the process of step S40 , the control unit 53 displays the first image acquired in the process of step S37 in the third area A13 .

[0156] By the processing of steps S31 to S40 , when the text information newly received from the server 3 does not include the second keyword but includes the first keyword, a new first image corresponding to the first keyword is displayed in the third area A13 .

[0157] After executing step S40, the control unit 53 enters Figure 14 The process of step S41 is shown.

[0158] When the control unit 53 executes the process of step S3 again, that is, when the text information is received again from the server 3, the control unit 53 executes the process of step S41.

[0159] In the process of step S41, the control unit 53 refers to the second database 52D2 and determines whether the text information newly received from the server 3 contains the second keyword. If the control unit 53 determines that the newly received text information contains the second keyword (step S41: Yes), it enters Figure 13 On the other hand, when the control unit 53 determines that the newly received text information does not include the second keyword (step S41: No), the process proceeds to step S42.

[0160] In the process of step S42, the control unit 53 refers to the first database 52D1 and determines whether the text information newly received from the server 3 contains the first keyword. The control unit 53 performs the process of step S42 on the same text information as the text information processed in step S41. If the control unit 53 determines that the newly received text information contains the first keyword (step S42: Yes), the control unit 53 proceeds to the process of step S43. On the other hand, if the control unit 53 determines that the newly received text information does not contain the first keyword (step S42: No), the control unit 53 returns to step S43. Figure 13 The process of step S31 is shown.

[0161] In the process of step S43 , the control unit 53 obtains the data of the first image associated with the first keyword included in the newly received text information from the first database 52D1 .

[0162] In step S44, the control unit 53 determines whether there is free space in the third area A13. If the control unit 53 determines that there is free space in the third area A13 (step S44: Yes), the process proceeds to step S46. If the control unit 53 determines that there is no free space in the third area A13 (step S44: No), the control unit 53 deletes any of the first images currently displayed in the third area A13 (step S45) and proceeds to step S46.

[0163] In the process of step S46, the control unit 53 displays the first image acquired in the process of step S43 in the third area A13. After executing the process of step S46, the control unit 53 returns to the process of step S41.

[0164] Thus, when the control unit 53 determines that there is a free space in the third area A13 (step S44: Yes), the control unit 53 displays the new first image together with the first image currently being displayed in the third area A13 through the process of step S46. Figure 8 As shown, the control unit 53 displays the first image 72 together with the first image 71 currently being displayed.

[0165] Thus, when the control unit 53 determines that there is no free space in the third area A13 (step S44: No), it deletes any of the first images currently being displayed and displays a new first image in the third area A13 through the processing of steps S45 and S46. Figure 9 In the illustrated configuration, the control unit 53 deletes the first image 71 from among the first images 71 to 73 being displayed, and displays a new first image in the third area A13 .

[0166] In the process of steps S31 to S46, the control unit 53 ends the process when, for example, the control unit 53 receives an input indicating the stop of the text display on the transparent screen 11 from the input device 40 via the communication unit 51. Figure 11 and the control process shown in FIG12. The input is input to the input device 40 by the second user U2.

[0167] (Image deletion process)

[0168] Figure 15 This is a flowchart showing the flow of image deletion processing. Figure 15 The image deletion process shown in FIG. 5 corresponds to an example of the control method involved in this embodiment. For example, the control unit 53 may Figure 10 The processing of steps S1 to S8 shown in FIG. Figure 11 as well as Figure 12 The processing of steps S11 to S24 shown or Figure 13 as well as Figure 14 The processing of steps S31 to S46 shown is executed in parallel Figure 15 The process of step S51 is shown.

[0169] The control unit 53 determines whether an instruction to delete an image has been received from the second user U2 (step S51). If the control unit 53 does not determine that an instruction to delete an image has been received from the second user U2 (step S51: No), the control unit 53 executes the process of step S51 again. On the other hand, if the control unit 53 determines that an instruction to delete an image has been received (step S51: Yes), the control unit 53 deletes the image from the first display area A1 in accordance with the input (step S52). After executing the process of step S52, the control unit 53 returns to the process of step S51.

[0170] (Operations in the Transition Process to the First Display Mode)

[0171] Figure 16 This is a flowchart showing the flow of the transition process to the first display mode. Figure 16 The transition process to the first display mode shown in FIG. 1 corresponds to an example of the control method involved in this embodiment. For example, the control unit 53 may Figure 11 as well as Figure 12 The processing of steps S11 to S24 shown or Figure 13 as well as Figure 14 The processing of steps S31 to S46 shown is executed in parallel Figure 16 The process of step S61 is shown.

[0172] The control unit 53 determines whether the second condition is satisfied (step S61). If the control unit 53 determines that the second condition is satisfied (step S61: Yes), the process proceeds to step S62. On the other hand, if the control unit 53 does not determine that the second condition is satisfied (step S61: No), the process of step S61 is repeated.

[0173] In the process of step S62, the control unit 53 switches the operation mode of the display system 1 from the second display mode to the first display mode. After executing the process of step S62, the control unit 53 enters Figure 10 The process of step S4 shown in FIG. In the process of step S4, the control unit 53 generates first and second text information based on the acquired text information. After executing the process of step S4, the control unit 53 determines whether the text information processed in step S4 contains the first keyword (step S5).

[0174] Thus, in the electronic device 50 according to this embodiment, when the first condition is satisfied while the display system 1 is in the first display mode, the control unit 53 causes the display system 1 to transition from the first display mode to the second display mode. Furthermore, in the second display mode, the control unit 53 displays an image in the first display area A1, serving as the display unit of the display system 1, using a display method different from that in the first display mode. Thus, by displaying images differently in the first and second display modes, the display system 1 can transition to either the first or second display mode depending on the context of the conversation between the first user U1 and the second user U2. Therefore, according to this embodiment, the technology for displaying images on a display unit can be improved.

[0175] Furthermore, in this embodiment, the first condition may also be a condition of receiving a given input. In this case, as described above, the second user U2 can input an instruction to transition to the second display mode as the given input into the input device 40. This configuration allows the operating mode of the display system 1 to transition to the second display mode at a timing convenient for the second user U2. This improves the convenience for the second user U2.

[0176] In addition, in this embodiment, the first condition may also be that the status information of the first user U1 indicates that the first user U1 desires to use the second display mode. With such a configuration, the convenience of the first user U1 can be improved.

[0177] In addition, in this embodiment, the first display mode can also be a mode that can display text information and images. The first display mode can be Figure 3 As shown, the first text message is displayed in the first area A11, and the first image is displayed in the second area A12. Depending on the content of the conversation between the first user U1 and the second user U2, it may be preferable to display both the text message and the image. Therefore, the first display mode, which displays both the text message and the image, is highly convenient depending on the context of the conversation between the first user U1 and the second user U2.

[0178] In addition, in this embodiment, the control unit 53 may also generate the first text information in the first display mode so that the character string included in the text information received from the server 3 is displayed upright when viewed from the first user U1. For example, the control unit 53 may generate Figure 3 The first text information 60 is shown as shown. With such a structure, the convenience of the first user U1 can be improved.

[0179] Furthermore, in this embodiment, when the first condition is satisfied during the display of the first image, the control unit 53 can determine whether a second image corresponding to a second keyword is stored, where the second keyword is the same as the first keyword corresponding to the displayed first image. If the control unit 53 determines that the second image is not stored, the control unit 53 can display the first image in the second display mode. By displaying the first image without storing the second image, the first display area A1 can be utilized without waste.

[0180] Furthermore, in this embodiment, in another example of the second display mode, the control unit 53 may display a new first image corresponding to the first keyword contained in the newly acquired text information, even if the newly acquired text information does not contain the second keyword but does contain the first keyword. By displaying the new first image even if the newly acquired text information does not contain the second keyword but does contain the first keyword, the first display area A1 can be used without waste.

[0181] Furthermore, in this embodiment, in other examples of the second display mode, the control unit 53 may determine whether there is free space in the third area A13 serving as the display unit before displaying a new first image. If the control unit 53 determines that there is free space in the third area A13, it may display the new first image in the third area A13 along with the currently displayed first image. This configuration allows for efficient use of the first display area A1.

[0182] Furthermore, in this embodiment, in another example of the second display mode, the control unit 53 may delete any of the currently displayed first images and display a new first image in the third area A13 if it determines that there is no free space in the third area A13 serving as the display unit. By deleting any of the currently displayed first images and displaying a new first image when there is no free space, a new first image corresponding to the most recent conversation between the first user U1 and the second user U2 is displayed in the third area A13. This configuration improves the convenience of the first user U1 and the second user U2.

[0183] Furthermore, in this embodiment, in another example of the second display mode, the control unit 53 may also delete the oldest displayed first image among the displayed first images when it determines that there is no free space in the third area A13. The oldest displayed first image among the displayed first images may have a lower importance in the conversation between the first user U1 and the second user U2. By deleting the oldest displayed first image, the possibility of impairing the convenience of the first user U1 and the second user U2 is reduced.

[0184] Furthermore, in this embodiment, in another example of the second display mode, the control unit 53 may determine whether there is free space in the third area A13 by calculating the maximum number of first images that can be displayed in the third area A13 as the display unit. With this configuration, the control unit 53 can more easily determine whether there is free space in the third area A13.

[0185] Furthermore, in this embodiment, the control unit 53 may also switch the operating mode of the display system 1 from the second display mode to the first display mode if the second condition is satisfied while the display system 1 is in the second display mode. With this configuration, the operating mode of the display system 1 can be switched to the first display mode based on the status of the conversation between the first user U1 and the second user U2.

[0186] Although the present disclosure has been described based on the drawings and embodiments, it should be noted that those skilled in the art can easily perform various deformations or modifications based on the present disclosure. Therefore, it should be noted that these deformations or modifications are included in the scope of the present disclosure. For example, the functions included in each functional unit can be reconfigured so as not to be logically contradictory. Multiple functional units can be combined into one or divided. The above-mentioned embodiments of the present disclosure are not limited to faithfully implementing the respective embodiments described, and can be implemented by appropriately combining the features or omitting a part. In other words, the contents of the present disclosure can be variously deformed and modified based on the present disclosure by those skilled in the art. Therefore, these deformations and modifications are included in the scope of the present disclosure. For example, in each embodiment, each functional unit, each unit or each step can be added to other embodiments, or can be replaced with each functional unit, each unit or each step of other embodiments so as not to be logically contradictory. In addition, in each embodiment, each functional unit, each unit or each step can be combined into one or divided. In addition, the above-mentioned embodiments of the present disclosure are not limited to faithfully implementing the respective embodiments described, and can be implemented by appropriately combining the features or omitting a part.

[0187] For example, in the above embodiment, the server 3 performs the speech recognition process. However, any device other than the server 3 may perform the speech recognition process. For example, the electronic device 50 may also perform the speech recognition process.

[0188] For example, a general-purpose computer can also be used as an embodiment to function as the electronic device 50 involved in the above-mentioned embodiment. Specifically, a program describing the processing content that implements the various functions of the electronic device 50 involved in the above-mentioned embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by the processor. Therefore, the present disclosure can also be implemented as a program executable by a processor, or a non-transitory computer-readable medium that stores the program.

[0189] For example, the structural elements and functional blocks included in each embodiment of the present disclosure can be appropriately configured in the same hardware or different hardware. The microphone 30 involved in the embodiment of the present disclosure can be included in the same hardware as the electronic device 50 or the projector 20. The input device 40 involved in each embodiment of the present disclosure can be included in the same hardware as the electronic device 50 or the projector 20. Part or all of the communication unit 51, storage unit 52, and control unit 53 involved in each embodiment of the present disclosure can also be included in the projector 20.

[0190] For example, the display unit of the present disclosure is not limited to a structure including a transparent screen. The display unit may include, for example, a transparent organic EL display (OLED) in which light-emitting elements are arranged on a transparent substrate.

[0191] For example, in the above embodiment, the first user U1 places an IC card on the communication module of the communication unit 51. However, depending on the communication distance in NFC between the IC card and the communication unit 51, the first user U1 may not cover the communication module of the communication unit 51. In this case, when the distance between the first user U1's IC card and the communication unit 51 reaches a distance that allows NFC, the control unit 53 can receive, through the communication unit 15, an indication that the first user U1 wishes to use the second display mode written to the IC card.

[0192] In one embodiment, (1) a program is provided for causing a display control device to execute a process including:

[0193] Obtain text information converted by voice recognition;

[0194] operating in a first display mode for displaying an image corresponding to a keyword included in the text information on a display unit located between a first user and a second user;

[0195] If a first condition is satisfied in the first display mode, transition from the first display mode to the second display mode; and

[0196] In the second display mode, the image is displayed on the display unit in a display format different from that in the first display mode.

[0197] (2) In the procedure of (1) above,

[0198] The first condition may also be a condition that a given input is accepted.

[0199] (3) In the procedure of (1) or (2) above,

[0200] The first condition may also be a condition that the first user's status information indicates a desire to use the second display mode.

[0201] (4) In any one of the procedures described in (1) to (3) above,

[0202] The first display mode may also be a mode capable of displaying the text information and the image.

[0203] (5) In any one of the procedures described in (1) to (4) above,

[0204] The second display mode may be a mode capable of displaying more images than the first display mode or a larger image than the first display mode.

[0205] (6) In the procedure described in any one of (1) to (5) above,

[0206] The processing may also include: displaying, as the image in the first display mode, a first image corresponding to a first keyword included in the text information.

[0207] (7) In any one of the procedures described in (1) to (6) above,

[0208] The processing may also include: in the first display mode, displaying first text information as the text information;

[0209] The first text information is generated so that a character string included in the text information is displayed upright when viewed from the first user.

[0210] (8) In any one of the procedures described in (1) to (7) above,

[0211] The processing may include displaying, in the second display mode, a second image corresponding to a second keyword included in the text information as the image.

[0212] (9) In any one of the procedures described in (1) to (8) above,

[0213] The processing may also include:

[0214] When the first condition is satisfied during display of the first image, determining whether a second image corresponding to a second keyword is stored, the second keyword being the same as the first keyword; and

[0215] If it is determined that the second image is stored, the second image is displayed as the image in the second display mode.

[0216] (10) In the procedure described in any one of (1) to (9) above,

[0217] The processing may also include:

[0218] If it is determined that the second image is not stored, the first image is displayed as the image in the second display mode.

[0219] (11) In any one of the procedures described in (1) to (10) above,

[0220] The processing may also include:

[0221] In the second display mode, when the text information is newly acquired, a new second image corresponding to the second keyword included in the newly acquired text information is preferentially displayed.

[0222] (12) In any one of the procedures described in (1) to (11) above,

[0223] The processing may also include:

[0224] In the second display mode, when the newly acquired text information does not include the second keyword but includes the first keyword, a new first image corresponding to the first keyword included in the newly acquired text information is displayed.

[0225] (13) In any one of the procedures described in (1) to (12) above,

[0226] The processing may also include:

[0227] Before displaying the new first image, determining whether there is an empty space in the display portion; and

[0228] When it is determined that there is free space on the display unit, the new first image is displayed on the display unit together with the first image currently being displayed.

[0229] (14) In any one of the procedures described in (1) to (13) above,

[0230] The processing may also include:

[0231] Before displaying the new first image, determining whether there is an empty space in the display portion; and

[0232] If it is determined that there is no free space on the display unit, any one of the first images currently being displayed is deleted, and the new first image is displayed on the display unit.

[0233] (15) In any one of the procedures described in (1) to (14) above,

[0234] The processing may also include:

[0235] As any one of the first images being displayed being deleted, the first image displayed earliest among the first images being displayed is deleted.

[0236] (16) In any one of the procedures described in (1) to (15) above,

[0237] The processing may also include:

[0238] determining whether there is a free space in the display unit by calculating a maximum number of the first images that can be displayed on the display unit; and

[0239] The maximum number of first images that can be displayed on the display unit is calculated based on the aspect ratio of the first image and the horizontal and vertical dimensions of the display unit.

[0240] (17) In any one of the procedures described in (1) to (16) above,

[0241] The vertical size of the first image may also be larger than the horizontal size of the first image.

[0242] The horizontal size of the second image may also be larger than the vertical size of the second image.

[0243] (18) In any one of the procedures described in (1) to (17) above,

[0244] The processing may also include:

[0245] If the second condition is satisfied in the second display mode, the second display mode is shifted to the first display mode.

[0246] In one embodiment, (19) a display control device,

[0247] A control unit is provided, the control unit receiving text information converted by voice recognition and operating in a first display mode for displaying an image corresponding to a keyword included in the text information on a display unit located between a first user and a second user, and switching from the first display mode to a second display mode if a first condition is satisfied in the first display mode.

[0248] The control unit displays the image on the display unit in the second display mode in a display format different from that in the first display mode.

[0249] In one embodiment, (20) a control method comprises:

[0250] Obtain text information converted by voice recognition;

[0251] operating in a first display mode for displaying an image corresponding to a keyword included in the text information on a display unit located between a first user and a second user;

[0252] If a first condition is satisfied in the first display mode, transition from the first display mode to the second display mode; and

[0253] In the second display mode, the image is displayed on the display unit in a display format different from that in the first display mode.

[0254] In the present disclosure, the descriptions of "first" and "second" are identifiers used to distinguish the structures. The structures distinguished by the descriptions of "first" and "second" in the present disclosure can exchange the numbers in the structures. For example, a first user can exchange "first" and "second" as identifiers with a second user. The identifiers can be exchanged simultaneously. The structures can also be distinguished after the identifiers are exchanged. The identifiers can be deleted. The structures with deleted identifiers are distinguished by symbols. The descriptions of identifiers such as "first" and "second" in the present disclosure alone cannot be used to interpret the order of the structures or to justify the existence of identifiers with smaller numbers.

[0255] -Description of Reference Numerals-

[0256] 1 Display system

[0257] 2 Network

[0258] 3 Servers

[0259] 10. Substrate

[0260] 10A, 10B

[0261] 11. Transparent Screen

[0262] 12 Screen

[0263] 13 shading part

[0264] 20 Projector

[0265] 30 microphones

[0266] 40 Input Device

[0267] 50 electronic devices

[0268] 51 Ministry of Communications

[0269] 52 Storage

[0270] 52D1 First Database

[0271] 52D2 Second Database

[0272] 53 Control Department

[0273] 60 First text message

[0274] 61 Second text message

[0275] 70 Second Image

[0276] 62, 71, 72, 73 First Image

[0277] A1 first display area

[0278] A11 First Area

[0279] A12 Second Area

[0280] A13 Third Area

[0281] A2 Second display area

[0282] U1 First User

[0283] U2 Second user.

Claims

1. A program causing a display control device to execute a process comprising: Obtain text information converted by voice recognition; operating in a first display mode for displaying an image corresponding to a keyword included in the text information on a display unit located between a first user and a second user; If a first condition is satisfied in the first display mode, transition from the first display mode to the second display mode; as well as In the second display mode, the image is displayed on the display unit in a display format different from that in the first display mode.

2. The program according to claim 1, wherein The first condition is a condition that a given input is accepted.

3. The program according to claim 1, wherein The first condition is a condition that the first user's status information indicates a desire to use the second display mode.

4. The program according to any one of claims 1 to 3, wherein The first display mode is a mode capable of displaying the text information and the image.

5. The program according to any one of claims 1 to 4, wherein The second display mode is a mode capable of displaying more images than the first display mode or a larger image than the first display mode.

6. The program according to any one of claims 1 to 5, wherein The processing includes: In the first display mode, as the displayed image, a first image corresponding to a first keyword included in the text information is displayed.

7. The program according to any one of claims 1 to 6, wherein The processing includes: In the first display mode, first text information is displayed as the text information. The first text information is generated so that a character string included in the text information is displayed upright when viewed from the first user.

8. The program according to any one of claims 1 to 7, wherein The processing includes: In the second display mode, as the displayed image, a second image corresponding to the second keyword included in the text information is displayed.

9. The program according to claim 6, wherein The processing includes: When the first condition is satisfied during display of the first image, determining whether a second image corresponding to a second keyword is stored, the second keyword being the same as the first keyword; and If it is determined that the second image is stored, the second image is displayed as the image in the second display mode.

10. The program according to claim 9, wherein The processing includes: If it is determined that the second image is not stored, the first image is displayed as the image in the second display mode.

11. The program according to claim 10, wherein The processing includes: In the second display mode, when the text information is newly acquired, a new second image corresponding to the second keyword included in the newly acquired text information is preferentially displayed.

12. The program according to claim 11, wherein The processing includes: In the second display mode, when the newly acquired text information does not include the second keyword but includes the first keyword, a new first image corresponding to the first keyword included in the newly acquired text information is displayed.

13. The program according to claim 12, wherein The processing includes: Before displaying the new first image, determining whether there is an empty space in the display portion; and When it is determined that there is free space on the display unit, the new first image is displayed on the display unit together with the first image currently being displayed.

14. The program according to claim 12, wherein The processing includes: Before displaying the new first image, determining whether there is an empty space in the display portion; and If it is determined that there is no free space on the display unit, any one of the first images currently being displayed is deleted, and the new first image is displayed on the display unit.

15. The program according to claim 14, wherein The processing includes: As any one of the first images being displayed being deleted, the first image displayed earliest among the first images being displayed is deleted.

16. The program according to any one of claims 13 to 15, wherein The processing includes: determining whether there is a free space in the display unit by calculating a maximum number of the first images that can be displayed on the display unit; and The maximum number of first images that can be displayed on the display unit is calculated based on the aspect ratio of the first image and the horizontal and vertical dimensions of the display unit.

17. The program according to any one of claims 9 to 15, wherein The longitudinal size of the first image is greater than the transverse size of the first image, A horizontal size of the second image is larger than a vertical size of the second image.

18. The program according to any one of claims 1 to 17, wherein The processing includes: If the second condition is satisfied in the second display mode, the second display mode is shifted to the first display mode.

19. A display control device, A control unit is provided for obtaining text information converted by voice recognition and operating in a first display mode for displaying an image corresponding to a keyword included in the text information on a display unit located between a first user and a second user, and for switching from the first display mode to a second display mode if a first condition is satisfied in the first display mode. The control unit displays the image on the display unit in the second display mode in a display format different from that in the first display mode.

20. A control method comprising: Obtain text information converted by voice recognition; operating in a first display mode for displaying an image corresponding to a keyword included in the text information on a display unit located between a first user and a second user; If a first condition is satisfied in the first display mode, transition from the first display mode to the second display mode; as well as In the second display mode, the image is displayed on the display unit in a display format different from that in the first display mode.

Images