Image display system, information processing device, image display device, image display method, and program
By capturing, storing and sending image data on the information processing device side, and receiving display completion notifications to overlap display, the content inconsistency caused by image display delay is solved, and the synchronous display between the information processing device and the image display device is realized.
Patent Information
- Application Number
- CN201980097299.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-06-13
- Publication Date
- 2025-01-17
- Estimated Expiration
- 2039-06-13
AI Technical Summary
During the image transmission process between the information processing device and the image display device, the image display device displays the image late, resulting in the speaker being unable to know the image content seen by the audience in time, which may be inconsistent with the content described by the speaker.
On the information processing device side, the image data to be sent is captured and stored, and sent to the image display device through the sending unit. After receiving the display completion notification, the images are displayed and received overlaid to ensure that the information processing device side and image display are displayed on the information processing device side. The image content on the device side is consistent.
It is realized that the image content displayed in the image display device is grasped in real time on the information processing device side, so as to ensure that the speaker can synchronize the description based on the images seen by the audience.
Smart Images

Figure CN113939798B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an image display system, an information processing device, an image display device, and an image display method and program. Background Art
[0002] There is a technology that connects an information processing device and an image display device via a network such as a wireless LAN, and transmits an image to the image display device and displays it through an application of the information processing device (e.g., Patent Document 1). The information processing device captures the image currently being output as one image, scales it to an optimal resolution for display on the image display device, performs encoding processing optimized to an amount of information suitable for image transmission, and then transmits the image data to the image display device via network communication. The image display device that receives the image data decodes and restores the image data, and displays the image through image display processing.
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2010-147905 Summary of the invention
[0006] Problems to be solved by the invention
[0007] Since a series of processes from image capture by the information display device to image display by the image display device require processing time, the image displayed on the image display device by image transmission is displayed later than the image output by the information processing device. Therefore, when a speaker gives a presentation while viewing the image output from the information processing device, the speaker does not know the image viewed by the audience, that is, the image displayed by the image display device, and the content of the speaker's explanation may differ from the content displayed by the image display device.
[0008] In view of the above-mentioned problems, the object of the present invention is to provide an information processing device, an image display device, an image display system, a display method and a program, which can grasp the content of the image displayed in the image display device on the information processing device side when forwarding image data from the information processing device to the image display device and displaying it.
[0009] Technical solutions to solve problems
[0010] An information processing device according to one embodiment of the present invention comprises: an acquisition unit for acquiring an image to be displayed from image data to be sent to an image display device; a storage unit for storing the acquired image; a sending unit for sending the image data to the image display device; a receiving unit for receiving a display completion notification sent from the image display device in response to the display of the image; and a display unit for reading from the storage unit and displaying an image corresponding to the display completion notification received by the receiving unit.
[0011] An image display device according to one embodiment of the present invention comprises: a receiving unit for receiving image data from an information processing device; a display unit for displaying an image based on the image data received from the information processing device; and a sending unit for sending a display completion notification to the information processing device in response to the display of the image.
[0012] An image display system according to one embodiment of the present invention comprises an information processing device and an image display device for displaying an image from the information processing device, wherein the information processing device comprises: an acquisition unit for acquiring an image to be displayed from image data to be sent to the image display device; a storage unit for storing the acquired image; a first sending unit for sending the image data to the image display device; a first receiving unit for receiving a display completion notification sent from the image display device in correspondence with a situation in which the image is displayed; and a first display unit for reading from the storage unit and displaying an image corresponding to the received display completion notification, wherein the image display device comprises: a second receiving unit for receiving image data from the information processing device; a second display unit for displaying an image based on the image data received from the information processing device; and a second sending unit for sending a display completion notification to the information processing device in correspondence with a situation in which the image is displayed.
[0013] An image display method according to one embodiment of the present invention performs the image display method on the information processing device side when image data is forwarded from an information processing device and displayed on an image display device, wherein the image display method includes the following steps: obtaining an image to be displayed from image data to be sent to the image display device; storing the obtained image in a storage unit; sending the image data to the image display device; and upon receiving a display completion notification sent from the image display device corresponding to the situation in which the image is displayed, reading from the storage unit and displaying an image corresponding to the received display completion notification.
[0014] An image display method according to one embodiment of the present invention performs the image display method on the image display device side when image data is forwarded from an information processing device and displayed on the image display device, wherein the image display method includes the following steps: receiving image data from the information processing device; displaying the image received from the information processing device; and sending a display completion notification to the information processing device corresponding to the situation where the image is displayed.
[0015] An image display method according to one embodiment of the present invention forwards image data from an information processing device and displays the image data on an image display device, wherein the image display method includes the following steps: the information processing device obtains an image to be displayed from the image data to be sent to the image display device; the information processing device stores the obtained image in a storage unit; the information processing device sends the image data to the image display device; the image display device receives the image data from the information processing device; the image display device displays an image based on the image data received from the information processing device; the image display device sends a display completion notification to the information processing device corresponding to the situation in which the image is displayed; and when the information processing device receives the display completion notification, it reads and displays the image corresponding to the received display completion notification from the storage unit.
[0016] A program in one embodiment of the present invention is executed in an information processing device when image data is forwarded from an information processing device and displayed in an image display device, wherein the program includes the following steps: obtaining an image to be displayed from the image data to be sent to the image display device; storing the obtained image; sending the image data to the image display device; and upon receiving a display completion notification sent from the image display device corresponding to the situation in which the image is displayed, reading from the storage unit and displaying the image corresponding to the received display completion notification.
[0017] Effects of the Invention
[0018] According to the present invention, an image corresponding to an image displayed on the image display device is superimposed and displayed on a part of the display unit of the information processing device, thereby enabling the information processing device to understand the content of the image displayed on the image display device. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 It is a schematic structural diagram of an image display system according to an embodiment of the present invention.
[0020] Figure 2 It is an explanatory diagram of a display unit of an information processing device according to an embodiment of the present invention.
[0021] Figure 3 This is a block diagram showing the configuration of an information processing device and a video display device in a video display system according to an embodiment of the present invention.
[0022] Figure 4 This is a flowchart showing the processing performed by the information processing device according to the embodiment of the present invention.
[0023] Figure 5 This is a flowchart showing the processing performed by the image display device according to the embodiment of the present invention.
[0024] Fig. 6A This is an explanatory diagram of an example of image display processing performed by the video display system according to the embodiment of the present invention.
[0025] Figure 6B This is an explanatory diagram of an example of image display processing performed by the video display system according to the embodiment of the present invention.
[0026] Figure 6C This is an explanatory diagram of an example of image display processing performed by the video display system according to the embodiment of the present invention.
[0027] Fig.6D This is an explanatory diagram of an example of image display processing performed by the video display system according to the embodiment of the present invention.
[0028] Fig. 7A This is a diagram for explaining another example of the image display process performed by the video display system according to the embodiment of the present invention.
[0029] Figure 7B This is a diagram for explaining another example of the image display process performed by the video display system according to the embodiment of the present invention.
[0030] Figure 7C This is a diagram for explaining another example of the image display process performed by the video display system according to the embodiment of the present invention.
[0031] Fig.7D This is a diagram for explaining another example of the image display process performed by the video display system according to the embodiment of the present invention.
[0032] Figure 8 It is an explanatory diagram of a process in which images displayed in the image display system according to the embodiment of the present invention are continuously switched.
[0033] Fig. 9 This is a schematic block diagram showing the basic structure of the information processing device of the present invention. DETAILED DESCRIPTION
[0034] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. Figure 1It is a schematic configuration diagram of a video display system 1 according to an embodiment of the present invention.
[0035] like Figure 1 As shown, the image display system 1 of the embodiment of the present invention is composed of an information processing device 10 and an image display device 20. The information processing device 10 and the image display device 20 are connected via, for example, a wireless LAN (Local Area Network) 30. A PC (Personal Computer) is used as the information processing device 10. The information processing device 10 includes a display unit 11. The image display device 20 is, for example, a projector, and displays an image on a screen 21.
[0036] Figure 2 1 is an explanatory diagram of the display unit 11 of the information processing device 10 according to the embodiment of the present invention. Figure 2 As shown in FIG. 1 , a main image region P1 and a sub image region P2 are provided in the display unit 11. The sub image region P2 is a region that is displayed overlapping a portion of the main image region P1.
[0037] Figure 1 The image display system 1 of the embodiment of the present invention shown is used, for example, for demonstration. When performing a demonstration, an application of the information processing device 10 is started. Then, the image data is forwarded from the information processing device 10 to the image display device 20 via the wireless LAN 30. At this time, the information processing device 10 captures the image to be forwarded to the image display device 20, scales it to the optimal resolution for display in the image display device 20, and after performing encoding processing optimized to an amount of information suitable for image transmission, sends it to the image display device 20 via the wireless LAN network 30. The image display device 20 that has received the image data decodes the image data and restores it, and displays the image on the screen 21 through image display processing. In addition, in the main image area P1 of the display unit 11 of the information processing device 10, an image based on the image data forwarded to the image display device 20 is displayed.
[0038] Here, it is assumed that the speaker switches the image used for the presentation. At this time, the image in the main image area P1 of the display unit 11 of the information processing device 10 is immediately updated to the new image. In contrast, the image projected on the screen 21 of the image display device 20 is updated after a series of process processing time. Therefore, the content of the image displayed in the main image area P1 of the display unit 11 of the information processing device 10 and the content of the image displayed on the screen 21 of the image display device 20 may not be consistent.
[0039] Therefore, in the present embodiment, the image display device 20 further transmits a display completion notification to the information processing device 10 when the display of the image is completed. When the information processing device 10 receives the display completion notification, it reduces the captured image and displays it in an overlapping manner on the sub-image area P2 of the display unit 11. As a result, an image corresponding to the image displayed on the screen 21 of the image display device 20 is displayed in the sub-image area P2 of the display unit 11 of the information processing device 10. The speaker who is giving a presentation knows the content of the image displayed on the screen 21 of the image display device 20 by confirming the image displayed in the sub-image area P2 of the display unit 11. As a result, the speaker can explain according to the image that the audience sees.
[0040] In this example, a PC is used as the information processing device 10, but the information processing device 10 is not limited to a PC. In this example, a projector is used as the image display device 20, but the image display device 20 is not limited to a projector. In this example, the information processing device 10 and the image display device 20 are connected by a wireless LAN 30, but the connection between the information processing device 10 and the image display device 20 is not limited to a wireless LAN.
[0041] Figure 3 1 is a block diagram showing the configuration of the information processing device 10 and the image display device 20 in the image display system 1 according to the embodiment of the present invention. Figure 3 As shown, the information processing device 10 includes a central processing unit 101 , a storage unit 102 , a communication unit 103 , a display unit 11 , and a user interface unit 105 .
[0042] The central processing unit 101 is composed of a CPU (Central Processing Unit) and the like, and performs processing based on a program stored in the storage unit 102. In the present embodiment, the central processing unit 101 executes an application for presentation, and performs processing for displaying a desired image in the main image area P1 of the display unit 11. In addition, the central processing unit 101 performs the following processing: capturing the image displayed on the display unit 11, and scaling and encoding the image data of the image displayed on the display unit 11 in accordance with the resolution of the image display device 20, and sending it to the image display device 20. In addition, capturing means acquiring one image and saving it. In addition, when the central processing unit 101 receives a display completion notification from the image display device 20, it performs processing for reducing the captured image and displaying it in the sub-image area P2 of the display unit 11. The central processing unit 101 functions as an acquisition unit that acquires (captures) an image from the image data to be sent to the image display device 20. In addition, the central processing unit 101 functions as an image processing unit that reduces the display size of the acquired image.
[0043] The storage unit 102 is composed of various memories such as ROM, RAM, HDD, SSD, etc. The storage unit 102 is composed of storage media such as HDD (Hard Disk Drive), flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), RAM (Random Access read / write Memory), ROM (Read Only Memory), or any combination of these storage media. In this embodiment, the storage unit 102 stores an operating system and an application for demonstration. In addition, the storage unit 102 captures and saves the displayed image. In addition, the storage unit 102 is used as a temporary storage area when scaling and encoding image data.
[0044] The communication unit 103 transmits and receives data using the wireless LAN with the communication unit 203 of the image display device 20. In the present embodiment, the communication unit 103 transmits the image data to the image display device 20. In addition, the communication unit 103 receives a display completion notification transmitted from the image display device 20 in response to completion of display of the image signal.
[0045] The display unit 11 includes a liquid crystal drive circuit and a liquid crystal display panel. The liquid crystal drive circuit generates a drive signal for driving the liquid crystal display panel in accordance with the image signal output from the central processing unit 101, and outputs the drive signal to the liquid crystal display panel. The liquid crystal display panel drives the elements of each pixel in accordance with the drive signal output from the liquid crystal drive circuit, thereby displaying an image corresponding to the image data.
[0046] The user interface unit 105 is composed of a keyboard, a mouse, etc. The user interface unit 105 receives input operations from the user, and outputs the results to the central processing unit 101. The central processing unit 101 performs various processes in accordance with the inputs from the user interface unit 105.
[0047] The image display device 20 includes a central processing unit 201 , a storage unit 202 , a communication unit 203 , and a display unit 204 .
[0048] The central processing unit 201 is composed of a CPU and the like, and performs processing based on a program stored in the storage unit 202. In the present embodiment, the central processing unit 201 performs processing to decode the image data received from the information processing device 10 and display the image data on the screen 21 by the display unit 204. In addition, when the display processing of the image data received from the information processing device 10 is completed, the central processing unit 201 performs processing to send a display completion notification to the information processing device 10.
[0049] The storage unit 202 is composed of various memories such as ROM, RAM, HDD, SSD, etc. The storage unit 202 is composed of a storage medium such as HDD, flash memory, EEPROM, RAM, ROM, or any combination of these storage media. In this embodiment, the storage unit 202 is used as a temporary storage area when converting the resolution of image data and decoding image data.
[0050] The communication unit 203 transmits and receives data using the wireless LAN with the communication unit 103 of the information processing device 10. In the present embodiment, the communication unit 203 receives image data from the information processing device 10. In addition, the communication unit 203 transmits a display completion notification to the information processing device 10.
[0051] The display unit 204 includes a liquid crystal drive circuit, a liquid crystal panel, a projection lamp, and a projection lens, and constitutes a liquid crystal projector. The liquid crystal drive circuit generates a drive signal for driving the liquid crystal panel in response to the image signal output from the central processing unit 201, and outputs the drive signal to the liquid crystal panel. The liquid crystal panel drives the elements of each pixel in response to the drive signal output from the liquid crystal drive circuit. The projection lamp irradiates projection light to the liquid crystal panel. The projection lens converges the projection light irradiated from the projection lamp and transmitted through the liquid crystal panel onto the screen 21.
[0052] Furthermore, the display unit 204 is not limited to a liquid crystal projector, but may be a projector of other structures such as a DLP (Digital Light Processing) projector. Furthermore, the display unit 204 is not limited to a projector, but may be a display unit of other forms such as a liquid crystal display.
[0053] Figure 4 1 is a flowchart showing the processing performed by the information processing device 10 according to the embodiment of the present invention. Figure 5 This is a flowchart showing the processing performed by the video display device 20 according to the embodiment of the present invention.
[0054] (Step S101) Figure 4 In step S102, the central processing unit 101 of the information processing device 10 starts the forwarding process of the image displayed on the display unit 11, and advances the process to step S102.
[0055] (Step S102) The central processing unit 101 captures the image displayed on the display unit 11, stores it in the storage unit 102, and advances the process to step S103.
[0056] (Step S103) The central processing unit 101 performs scaling and encoding processing on the image data of the video captured in the storage unit 102, and advances the processing to step S104.
[0057] (Step S104) The central processing unit 101 transmits the image data subjected to the scaling and encoding processes to the image display device 20, and advances the process to step S105.
[0058] (Step S105) The central processing unit 101 determines whether the communication unit 103 has received a display completion notification from the image display device 20. If the central processing unit 101 has not received a display completion notification (step S105: No), the processing returns to step S105 and waits until a display completion notification is received. If a display completion notification is received (step S105: Yes), the processing proceeds to step S106.
[0059] If the information processing device 10 has not received the display completion notification (step S105: No), it enters a waiting state until the display completion notification is received.
[0060] The image display device 20 receives the image data from the information processing device 10. In step S104, when the information processing device 10 sends the image data to the image display device 20, the process proceeds to Figure 5 Step S201 in .
[0061] (Step S201) Figure 5 In the process, when the central processing unit 201 of the image display device 20 receives the image data from the information processing device 10 through the communication unit 203, the central processing unit 201 advances the process to step S202.
[0062] (Step S202) The central processing unit 201 decodes the image data transferred from the information processing device 10, and advances the process to step S203.
[0063] (Step S203) The central processing unit 201 executes processing for displaying the image data transferred from the information processing device 10 on the display unit 204, and the process proceeds to step S204.
[0064] (Step S204) The central processing unit 201 determines whether the display processing is completed. If the display processing is not completed (step S204: "No"), the processing returns to step S203 and repeats the processing for displaying the image data on the display unit 204. If the display processing is completed (step S204: "Yes"), the processing proceeds to step S205.
[0065] (Step S205) If the display process is completed, the central processing unit 201 performs a process of transmitting a display completion notification to the information processing device 10.
[0066] like Figure 4As shown, on the information processing device 10 side, when the image data is sent to the image display device 20 in step S104, the display completion notification from the image display device 20 is waited in step S105. In step S105, when the forwarding completion notification is sent from the image display device 20 to the information processing device 10, the central processing unit 101 of the information processing device 10 determines that the display completion notification has been received in step S105.
[0067] (Step S106) When receiving the display completion notification from the image display device 20, the central processing unit 101 reads the image captured in step S102 from the storage unit 102, reduces the display size, and displays it in an overlapping manner on the sub-image area P2 of the display unit 11, thereby terminating the process.
[0068] Figure 6A to Figure 6D 1 is an explanatory diagram of an example of image display processing performed by the image display system according to the embodiment of the present invention. Here, it is assumed that the display unit 11 of the information processing device 10 and the screen 21 of the image display device 20 display an image of the text "A". When an instruction is given to display the text "A" in the information processing device 10 by operating the user interface unit 105 of the information processing device 10, as shown in FIG. Fig. 6A As shown, the image of the character "A" is immediately displayed in the main image area P1 of the display unit 11. At this time, no image is displayed on the screen 21 of the image display device 20.
[0069] like Figure 4 As shown in step S102 in the above, the information processing device 10 captures the image of the character "A" displayed on the display unit 11, and as shown in step S103, performs scaling and encoding processing on the forwarded image. Then, as shown in step S104, the image data is sent from the information processing device 10 to the image display device 20. Figure 6B As shown, the image data of the image of the character “A” is encoded and transmitted from the information processing device 10 to the image display device 20 .
[0070] like Figure 5 As shown in step S201 in FIG. 1 , the image display device 20 receives image data from the information processing device 10. Figure 5 As shown in steps S202 to S204 in FIG. 2 , when the image display device 20 receives image data from the information processing device 10, it performs processing for decoding the image data and displaying the image on the screen 21. Figure 6B As shown, an image of the text "A" is displayed on the screen 21.
[0071] like Figure 5As shown in step S204 and step S205 in FIG. 1 , when the image display device 20 completes displaying the image on the screen 21, Figure 6C As shown, a display completion notification is sent to the information processing device 10.
[0072] like Figure 4 As shown in step S105 in FIG. 1 , the information processing device 10 waits for a display completion notification from the image display device 20. Then, as shown in FIG. Figure 4 As shown in step S105 and step S106 in FIG. 1 , upon receiving the display completion notification, the information processing device 10 displays the captured image in the sub-image area P2 of the display unit 11. Fig.6D As shown, the image of the text "A" is displayed in the sub-image area P2 of the display unit 11. The speaker operating the information processing device 10 can recognize that the image of the text "A" is displayed on the image display device 20 by viewing the image of the text "A" in the sub-image area P2.
[0073] FIG. 7A to FIG. 7D 1 is an explanatory diagram of another example of image display processing performed by the image display system according to the embodiment of the present invention. Here, it is assumed that until last time, the image of the text "A" was displayed on the display unit 11 of the information processing device 10 and the screen 21 of the image display device 20. Then, it is assumed that an instruction to switch from the text "A" to the text "B" is given to the information processing device 10 through the operation of the user interface unit 105 of the information processing device 10.
[0074] like Fig. 7A As shown, the display of the main image area P1 of the display unit 11 is immediately switched from the image of the text "A" to the image of the text "B". At this time, the image of the screen 21 of the image display device 20 remains the image of the text "A". In addition, the display of the sub-image area P2 of the display unit 11 remains the image of the text "A".
[0075] like Figure 4 As shown in step S102 in the above, the information processing device 10 captures the image of the character "B" displayed on the display unit 11, and as shown in step S103, performs scaling and encoding processing on the forwarded image. Then, as shown in step S104, the image data is sent from the information processing device 10 to the image display device 20. Figure 7B As shown, the image data of the image of the character “B” is encoded and transmitted from the information processing device 10 to the image display device 20 .
[0076] like Figure 5 As shown in step S201 in FIG. 1 , the image display device 20 receives image data from the information processing device 10. Figure 5As shown in steps S202 to S204 in FIG. 2 , when the image display device 20 receives image data from the information processing device 10, it performs processing for decoding the image data and displaying the image on the screen 21. Figure 7B As shown, an image of the text "B" is displayed on the screen 21.
[0077] like Figure 5 As shown in step S204 and step S205 in FIG. 1 , when the image display device 20 completes displaying the image on the screen 21, Figure 7C As shown, a display completion notification is sent to the information processing device 10.
[0078] like Figure 4 As shown in step S105 in FIG. 1 , the information processing device 10 waits for a display completion notification from the image display device 20. Then, as shown in FIG. Figure 4 As shown in step S105 and step S106 in FIG. 1 , upon receiving the display completion notification, the information processing device 10 displays the captured image in the sub-image area P2 of the display unit 11. Fig.7D As shown, the image of the sub-image area P2 of the display unit 11 is switched from the image of the text "A" to the image of the text "B". The speaker operating the information processing device 10 can recognize that the image of the text "B" is displayed on the image display device 20 by looking at the image of the text "B" in the sub-image area P2.
[0079] As described above, through the processing of the above steps S101 to S106 and the processing of steps S201 to S205, the speaker watching the display unit 11 of the information processing device 10 can know the image displayed on the screen 21 of the image display device 20 at this time through the display image of the sub-image area P2.
[0080] In addition, the image superimposed on the sub-image area P2 of the information processing device 10 in step S106 can also be set to an image other than the object acquired in step S102. In this case, the image acquired as a still picture of the image displayed on the display unit 11 is used to implement subsequent processing.
[0081] In addition, since the image overlapping with the sub-image area P2 in step S106 is acquired at the time of step S102, the information processing device 10 can also perform processing to prepare the image for overlapping with the sub-image area P2 in parallel with the period when the image display device 20 performs each processing in steps S202 to S204.
[0082] Figure 8FIG. 2 is an explanatory diagram of a process in which images displayed in the image display system according to the embodiment of the present invention are continuously switched. Figure 8 As shown, in the image of the initial frame F1, the information processing device 10 captures the image in period T11, performs scaling and encoding in period T12, and forwards the image data corresponding to the image from the information processing device 10 to the image display device 20 in period T13. On the image display device 20 side, the image data is decoded and displayed in period T14, and a display completion notification is forwarded from the image display device 20 to the information processing device 10 in period T15. Then, upon receiving the display completion notification, the information processing device 10 displays the captured image in the sub-image area P2 in period T16.
[0083] In the images of the frames F2, F3, ... that follow, images are captured at a predetermined timing in parallel with the processing of the previous frames. That is, with respect to frame F2, when the image capture period T11 of frame F1 ends, the image is captured immediately in period T21, scaling and encoding are performed in period T22, and the image data is forwarded from the information processing device 10 to the image display device 20 in period T23. Furthermore, with respect to the next frame F3, when the image capture period T21 of frame F2 ends, the image is captured immediately in period T31, scaling and encoding are performed in period T32, and the image data is forwarded from the information processing device 10 to the image display device 20 in period T33.
[0084] The image display device 20 performs decoding processing of each frame F1, F2, F3, ... in the periods T14, T24, T34, ..., and sends a display completion notification to the information processing device 10 in the periods T15, T25, T35, .... The display completion notification includes identification information for specifying the image, so that the information processing device 10 can determine which frame of the image display has been completed. The information processing device 10 displays the image of each frame F1, F2, F3, ... in the sub-image area P2 of the display unit 11 in the periods T16, T26, T36, ....
[0085] Furthermore, in the above-mentioned embodiment, the case of image transmission between the information processing device 10 and the image display device 20 is described as an example, but it can also be used in the case of using other information processing devices instead of the image display device 20 to make video calls between information processing devices, and in the case of using a video conferencing system to hold a meeting, in order to know how the image sent by oneself is displayed on the display device viewed by the other party.
[0086] In addition, the transmitted image does not necessarily need to be an acquired image of the image displayed by the information processing device 10. For example, the following usage method is also considered: in addition to the image displayed in the information processing device 10, only an image of the report material is acquired and transmitted to the image display device 207 for display.
[0087] Fig. 9 1 is a schematic block diagram showing a basic structure of the information processing device of the present invention. The information processing device 510 of the present invention has an acquisition unit 511, a storage unit 512, a transmission unit 513, a reception unit 514, and a display unit 515 as a basic structure.
[0088] The acquisition unit 511 acquires an image to be displayed from the image data to be transmitted to the image display device 520. The storage unit 512 stores the acquired image. The transmission unit 513 transmits the image data to the image display device 520. The receiving unit 514 receives a display completion notification transmitted from the image display device 520 in response to the display of the image. The display unit 515 reads the image corresponding to the display completion notification received by the receiving unit 514 from the storage unit 512 and displays it.
[0089] The whole or part of the image display system 1 in the above-mentioned embodiment can also be implemented by a computer. In this case, it can also be implemented by recording the program for implementing the function in a computer-readable recording medium, so that the computer system reads and executes the program recorded in the recording medium. In addition, the "computer system" mentioned here is set to include hardware such as OS and peripheral devices. In addition, "computer-readable recording medium" refers to mobile media such as floppy disks, optical magnetic disks, ROMs, CD-ROMs, and storage devices such as hard disks built into the computer system. Further, "computer-readable recording medium" can also include recording media that dynamically maintain programs in a short period of time, such as communication lines in the case of sending programs via networks such as the Internet, telephone lines, etc., and recording media that maintain programs for a certain period of time, such as volatile memories inside computer systems as servers and clients in this case. In addition, the above-mentioned program can be used to implement part of the above-mentioned function, and further, it can also be possible to implement the above-mentioned function by combining it with a program already recorded in the computer system, or it can be implemented using programmable logic devices such as FPGAs.
[0090] As mentioned above, although the embodiment of the present invention has been described in detail with reference to the drawings, the specific structure is not limited to this embodiment, and also includes designs etc. within the scope that does not depart from the gist of the present invention.
[0091] Description of symbols
[0092] 10 Information processing device
[0093] 11 Display
[0094] 20 Image display device
[0095] 21 Screen
[0096] 101, 201 Central Processing Unit
[0097] 102, 202 Storage
[0098] 103, 203 Ministry of Communications
[0099] 204 Display
[0100] 510 Information processing device
[0101] 511 Acquisition Department
[0102] 512 Storage
[0103] 513 Sending Department
[0104] 514 Receiving Department
[0105] 515 Display
Claims
1. An information processing device is an information processing device used by a speaker who makes a presentation, wherein: have: an acquisition unit that acquires an image to be displayed from image data to be sent to an image display device; A storage unit for storing the acquired image; A sending unit, sending the image data to the image display device; A receiving unit, receiving a display completion notification sent by the sending unit after the display processing of the image data by the image display device is completed; as well as The display unit displays the image in the main image area, and after the receiving unit receives the display completion notification, reads the image corresponding to the display completion notification received by the receiving unit from the storage unit and displays it overlappingly in the sub-image area which is a part of the main image area.
2. The information processing device according to claim 1, wherein: The acquisition unit acquires the image from image data before scaling according to a resolution displayed by the image display device.
3. The information processing device according to claim 1, wherein: The information processing device includes an image processing unit that reduces the display size of the acquired image. The display unit displays the reduced image in response to receiving the display completion notification.
4. The information processing device according to claim 1, wherein: The acquisition unit acquires the image at each predetermined timing. The receiving unit receives the display completion notification including identification information for identifying an image of an image signal displayed on the image display device, The display unit reads the image corresponding to the identification information from the storage unit and displays the image.
5. The information processing device according to claim 1, wherein: The image display device comprises: a receiving unit that receives the image data transmitted from the transmitting unit of the information processing device; A display unit that displays an image based on the image data received from the information processing device; and a sending unit that sends the display completion notification to the information processing device in response to the display of the image, The receiving unit of the information processing device receives the display completion notification transmitted from the transmitting unit of the image display device.
6. An information processing device used by a speaker giving a presentation, wherein: have: an acquisition unit that acquires an image to be displayed from image data to be sent to an image display device; A storage unit for storing the acquired image; A sending unit, sending the image data to the image display device; A receiving unit, receiving a display completion notification sent by the sending unit after the display processing of the image data by the image display device is completed; as well as a display unit that displays the image in a main image area, and reads the image corresponding to the display completion notification received by the receiving unit from the storage unit and displays the image in a superimposed manner in a sub-image area that is a part of the main image area, The image is the image currently being displayed in the main image area of the display unit or the image displayed in the past in the main image area of the display unit.
7. An information processing device used by a speaker giving a presentation, wherein: have: an acquisition unit that acquires an image to be displayed from image data to be sent to an image display device; A storage unit for storing the acquired image; A sending unit, sending the image data to the image display device; a receiving unit that receives a display completion notification sent from the image display device in response to display of the image; as well as The display unit reads out from the storage unit and displays an image corresponding to the display completion notification received by the receiving unit.
8. An image display system comprising an information processing device used by a speaker giving a presentation and an image display device for displaying an image from the information processing device, wherein: The information processing device comprises: an acquisition unit that acquires an image to be displayed from image data to be sent to the image display device; A storage unit for storing the acquired image; A first sending unit, sending the image data to the image display device; A first receiving unit receives a display completion notification sent from the sending unit after the display processing of the image data by the image display device is completed; as well as The first display unit displays the image in the main image area, and after the receiving unit receives the display completion notification, reads the image corresponding to the received display completion notification from the storage unit and displays it in a superimposed manner in the sub-image area which is a part of the main image area. The image display device comprises: a second receiving unit for receiving the image data from the information processing device; a second display unit that displays an image based on the image data received from the information processing device; and The second sending unit sends the display completion notification to the information processing device in response to the display of the image.
9. An image display method, wherein when image data is forwarded from an information processing device used by a speaker giving a presentation and displayed on an image display device, the image display method is performed by the information processing device, wherein: The image display method comprises the following steps: obtaining an image to be displayed from image data to be sent to the image display device; storing the acquired image in a storage unit; sending the image data to the image display device; and The image is displayed in the main image area, and when a display completion notification is received which is sent after the display processing of the image data sent from the sending unit is completed by the image display device, the image corresponding to the received display completion notification is read from the storage unit and displayed overlappingly in the sub-image area which is a part of the main image area.
10. An image display method, wherein image data is forwarded from an information processing device used by a speaker giving a presentation and displayed on an image display device, wherein: The image display method comprises the following steps: The information processing device obtains an image to be displayed from the image data to be sent to the image display device; The information processing device stores the acquired image in a storage unit; The information processing device sends the image data to the image display device; The image display device receives the image data from the information processing device; The image display device displays an image based on the image data received from the information processing device; The image display device sends a display completion notification to the information processing device after the display processing of the image is completed; and The image is displayed in the main image area, and when the display completion notification is received, the information processing device reads the image corresponding to the received display completion notification from the storage unit and displays the image in an overlapping manner in the sub-image area which is a part of the main image area.
11. A recording medium having a program recorded thereon, the program being executed in an information processing device when image data is forwarded from an information processing device used by a speaker giving a presentation and displayed on an image display device, wherein: The procedure comprises the following steps: obtaining an image to be displayed from image data to be sent to the image display device; storing the acquired image in a storage unit; sending the image data to the image display device; and The image is displayed in the main image area, and when a display completion notification is received which is sent after the display processing of the image data by the image display device is completed, the image corresponding to the received display completion notification is read from the storage unit and displayed overlappingly in the sub-image area which is part of the main image area.
Citation Information
Patent Citations
Display control device and image processor
JP2010147905A
Video processing device, display device and video processing method
CN102404563A
Image processing device, image display device, and method of controlling image processing device
CN104253964A
Image processing apparatus, method of controlling the same, and program
JP2011004155A
Display system, information device, display device, image selection program and display method
JP2012174013A