Touch display device and image display method thereof

By setting up an image capture unit in front of a large touch display device and using mother-child picture technology, the problem of information obstruction caused by speaker occlusion is solved, the viewing experience of meetings and teaching is improved, and efficient information transmission is achieved.

CN118915985APending Publication Date: 2024-11-08AMTRAN TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310605224.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-08
Filing Date
2023-05-26
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

When using a large touch display device, the physical occlusion of the speaker itself will cause some listeners to be unable to see the content on the display device, affecting the viewing experience. Existing solutions such as waiting for the speaker to move or adding the display device to increase costs and occupancy Space, lack of effective solutions.

Method used

By setting an image capture unit in front of the touch display device, the speaker's position is captured and the obstructed area is judged, and the content of the obstructed area is displayed in the unobstructed area by using mother-child screen technology to ensure that the listener can see important information.

Benefits of technology

It effectively improves the viewing experience of conferences and teaching, avoids information obstruction, avoids the disadvantages of increasing costs and occupying space, and provides flexible and efficient solutions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118915985A_ABST
    Figure CN118915985A_ABST
Patent Text Reader

Abstract

The invention discloses an image display method, which is used for a touch display device and comprises the following steps of: capturing an image of a previous area of the touch display device; determining a position of a speaker according to the image, and determining an occluded area and an unoccluded area according to the position; and displaying the picture content related to the sheltered area in the unsheltered area through the child-mother picture.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a touch display device and an image display method thereof, and more particularly to a touch display device and an image display method thereof that can enhance viewing experience. Background Art

[0002] The touch display device allows users to click, access, and draw directly on the touch display device with their fingers or stylus, thus providing more flexible operation and better human-computer interaction. Large touch displays have replaced traditional tools such as projectors, monitors, and whiteboards, and are becoming increasingly popular in conference rooms, classrooms, and other places. The flexible operation characteristics of large touch displays can help listeners better understand the content of the speaker's explanation.

[0003] However, similar to the use of traditional devices, when using a large touch display device, the large touch display device will be affected by the physical obstruction of the speaker himself, causing some listeners to be unable to see the content on the large touch display device or the content written by the speaker on it, thereby affecting the received information or viewing experience. In the past, to solve this problem, it was usually necessary to passively wait for the speaker to move, but this also caused other listeners to be blocked from receiving information. On the other hand, it is also possible to provide a display of the obstructed image by adding a display device, but this method not only increases the cost, but also takes up extra space. Therefore, there is a need for improvement. Summary of the invention

[0004] Therefore, the purpose of the present invention is to provide a touch display device and method, which utilizes the flexible display characteristics of the touch device and uses a camera to detect the position of the speaker so that the content blocked by the speaker can be seen by the listeners, thereby improving the quality of meetings and teaching.

[0005] An embodiment of the present invention provides an image display method for a touch display device, comprising capturing an image of an area in front of the touch display device; determining a position of a speaker based on the image, and determining an obstructed area and an unobstructed area based on the position; and displaying image content related to the obstructed area in the unobstructed area through a picture-in-picture display.

[0006] The present invention also provides a touch display device, comprising a power supply unit for supplying power to all components; an image capture unit for capturing images; a storage unit for temporarily storing screen contents; an image display unit for displaying screen contents; and a processing unit coupled to the power supply unit, the image capture unit, the storage unit, and the image display unit. The processing unit is used to execute an image display method, which includes controlling the image capture unit to capture an image of a front area of ​​the touch display device; determining a position of a speaker according to the image, and determining an obstructed area and an unobstructed area according to the position; and displaying the screen contents related to the obstructed area in the unobstructed area through a picture-in-picture screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 Schematic diagram of a usage scenario of an embodiment of the present invention.

[0008] Figure 2 FIG. 1 is a schematic diagram of a touch display device according to an embodiment of the present invention.

[0009] Figure 3 FIG. 4 is a schematic diagram of an image display process according to an embodiment of the present invention.

[0010] Figure 4 FIG. 4 is a schematic diagram of a screen partition according to an embodiment of the present invention.

[0011] Figure 5A , Figure 5B and Figure 5C It is a schematic diagram of determining the blocked area according to the speaker position according to an embodiment of the present invention.

[0012] Figure 6 FIG. 4 is a schematic diagram of a picture processing flow according to an embodiment of the present invention.

[0013] Figure 7 The present invention is an embodiment of executing the picture processing flow when the blocked area is the left area.

[0014] Figure 8 This is an embodiment of executing the picture processing flow when the blocked area is the right area.

[0015] Fig. 9 FIG. 4 is a schematic diagram of a picture processing flow according to an embodiment of the present invention.

[0016] Fig.10 FIG. 4 is a schematic diagram of a picture processing flow according to an embodiment of the present invention.

[0017] Fig.11A , Fig. 11B and Fig. 11C This is an embodiment of executing the picture processing flow when the blocked area is the middle area.

[0018] Fig.12 FIG. 4 is a schematic diagram of a picture processing flow according to an embodiment of the present invention.

[0019] Explanation of reference numerals: 1-use scenario; 2, 10-touch display device; 12-speaker; 14-listener; 100-power supply unit; 102-image capture unit; 104-image display unit; 106-processing unit; 108-storage unit; 3, 6, 9, 10, 12-process; 300-308, 600-610, 900-908, 1000-1014, 1200-1208-steps; W-screen width; L-left area; M-middle area; R-right area; w-screen width in the horizontal direction of the image; x L - The position coordinate of the left edge of the picture on the horizontal x-axis of the image; R - the position coordinate of the right edge of the image on the horizontal x-axis; M+R, L+M-unblocked area; L+M+R-whole image; B-redundant area; L', R'-sub-image area; (L+M)', (M+L)'-scaling range of the image content in the unblocked area; M L -Left screen content; M R - Contents on the right side of the screen; M L '-Left sub-screen area; M R '-Right sub-picture area. DETAILED DESCRIPTION

[0020] Certain words are used in the specification and claims to refer to specific components. It should be understood by those skilled in the art that hardware manufacturers may use different terms to refer to the same component. This specification and claims do not distinguish components by differences in name, but by differences in the functions of the components. The term "including" mentioned throughout the specification and claims is an open-ended term and should be interpreted as "including but not limited to". In addition, the term "coupled" includes any direct and indirect electrical connection means. Therefore, if the text describes a first device coupled to a second device, it means that the first device can be directly electrically connected to the second device, or indirectly electrically connected to the second device through other devices or connection means.

[0021] Please refer to Figure 1 , Figure 1Schematic diagram of usage scenario 1 of an embodiment of the present invention. Usage scenario 1 may be teaching, meeting or speech, but is not limited thereto; in usage scenario 1, a speaker 12 uses a touch display device 2 to give a speech to a plurality of listeners 14. The touch display device 2 may be a large touch display, and the speaker 12 may play images of relevant speech content through the touch display device 2, or directly perform relevant operations such as writing, drawing, and screen control on the touch display panel of the touch display device 2. When the speaker 12 operates the touch display device 2, the body of the speaker 12 will inevitably block a part of the screen of the touch display device 2, causing some listeners 14 to be unable to see the screen content on the blocked area, especially the content that the speaker 12 is operating, resulting in some listeners 14 being unable to fully receive the information conveyed by the speaker 12, affecting the viewing experience.

[0022] In order to enhance the viewing experience, the present invention obtains the position of the speaker 12 through an image capture unit, determines the range of the screen blocked by the touch display device 2 according to the position of the speaker 12, and displays the blocked screen in the unblocked area through the picture-in-picture (PIP) technology to prevent the listener 14 from missing important information. The image capture unit can be a camera, video camera, image sensor, etc. built-in or external to the touch display device 2, but is not limited to this. The setting position of the built-in image capture unit is preferably the upper frame of the touch display device, and the setting position of the external image capture unit is preferably in front of or above the touch display device, but is not limited to this. As long as the lens can completely capture the horizontal width range of the touch display device in the front area of ​​the touch display device, it can be used to implement the present invention.

[0023] For details, please refer to Figure 2 , Figure 2 FIG. 1 is a schematic diagram of a touch display device 10 according to an embodiment of the present invention. The touch display device 10 may replace Figure 1The touch display device 2 is applied to scenario 1. The touch display device 10 includes a power supply unit 100, an image capture unit 102, an image display unit 104, a processing unit 106 and a storage unit 108. The processing unit 106 is coupled to the image capture unit 102, the image display unit 104 and the storage unit 108. The power supply unit 100 is coupled to all the operation units of the touch display device 10 and supplies power to them. The image capture unit 102 can be built-in or externally connected to the body of the touch display device 10, and is used to capture the image of the area in front of the touch display device 10 to obtain the position of the speaker 12. When the image capture unit 102 is externally connected to the body of the touch display device 10, it can be an external camera, which can be set at any position in the meeting or teaching space, and is coupled to the touch display device 10 in a wired or wireless manner. The image display unit 104 can be a touch display panel for presenting screen content. The processing unit 106 may be a general purpose processor, a microprocessor, an application specific integrated circuit (ASIC), etc., or a combination thereof, for analyzing the image content captured by the image capture unit 102, further performing image processing, and controlling the image display unit 104 to present the processed image. The storage unit 108 may be any data storage device for storing program codes, data, and related images for running the method of the embodiment of the present invention. For example, the storage unit 108 may be a flash memory, a random access memory (RAM), a hard disk, an optical data storage device, and a non-volatile storage unit, etc., but is not limited thereto.

[0024] For the operation of the touch display device 10, please refer to Figure 3 , Figure 3 FIG. 3 is a schematic diagram of an image display process 3 according to an embodiment of the present invention. The image display process 3 can be compiled into program codes and stored in the storage unit 108 to control the operation of the touch display device 10. The image display process 3 includes the following steps:

[0025] Step 300: Start.

[0026] Step 302 : The image capturing unit 102 captures an image of a front area of ​​the touch display device 10 .

[0027] Step 304 : The processing unit 106 determines a position of the speaker 12 according to the image, and determines a blocked area and an unblocked area of ​​the touch display device 10 according to the position.

[0028] Step 306: Displaying the image content related to the blocked area in the unblocked area.

[0029] Step 308: End.

[0030] According to step 302, the touch display device 10 first captures an image of the previous area of ​​the touch display device 10 through the image capture unit 102. Next, in step 304, the processing unit 106 determines the position of the speaker 12 according to the image obtained in step 302, and determines the blocked area and the unblocked area of ​​the touch display device 10 according to the position of the speaker 12. Finally, in step 306, the processing unit 106 combines the screen contents of the blocked area and the unblocked area with the picture-in-picture technology and displays them on the image display unit 104. Accordingly, the screen contents blocked by the speaker 12 can be flexibly presented in the unblocked area of ​​the touch display device 10 to ensure that the listener 14 can obtain important information on the screen.

[0031] Specifically, in step 302, the touch display device 10 captures an image of the area in front of it through the image capture unit 102 to obtain the position of the speaker 12. The viewing angle of the image capture unit 102 is not limited to a specific direction, and it is only necessary to ensure that the area range of the image captured by the image capture unit 102 can at least include the left and right edges of the touch display device 10 in the horizontal direction.

[0032] In step 304, the touch display device 10 can determine the position of the speaker 12 according to the image captured in step 302, and determine the blocked area and the unblocked area of ​​the screen according to the position of the speaker 12. For example, please refer to Figure 4 , Figure 4 FIG. 1 is a schematic diagram of a screen partition of the touch display device 10 according to an embodiment of the present invention. Figure 4 As shown, the screen of the touch display device 10 can be divided into three areas in the horizontal direction according to the screen width W: the left area L, the middle area M and the right area R. In this embodiment, the width of the left area L and the right area R is one quarter of the screen width W (i.e., W / 4), and the width of the middle area M is one half of the screen width W (i.e., W / 2) for example, but it is not limited thereto. The processing unit 106 determines one of the left area L, the middle area M and the right area R as an obstructed area according to the position of the speaker 12 in the image captured in step 302, and determines the remaining areas as unobstructed areas.

[0033] Please continue to refer to Figure 5A to Figure 5C , Figure 5A to Figure 5C FIG. 1 is a schematic diagram of the processing unit 106 determining the occlusion area according to the position of the speaker 12. Assume that the position coordinates of the left and right edges of the screen of the touch display device 10 on the horizontal x-axis of the image are x and L 、x R, then the horizontal width w of the image is x R -x L According to the width of the left area L, the middle area M and the right area R, the x-axis can be divided into three intervals, which are the left interval corresponding to the left area L The middle section corresponding to the middle area M And the right interval corresponding to the right area R In step 304, the processing unit 106 may first perform human detection based on the image captured in step 302. If no human is detected, it can be determined as a no-blocking state and no processing of the image is required; if a human is detected, the area ratio of the human in the three intervals can be further calculated based on the coordinates and area of ​​the human to determine the blocked area. Figure 5A As shown, when the figure of the speaker 12 is detected in the captured image and the area thereof is mostly located in the left interval, the processing unit 106 determines that the blocked area is the left area L, and the unblocked areas are the middle area M and the right area R; when the figure of the speaker 12 is mostly located in the middle interval, the processing unit 106 determines that the blocked area is the middle area M, and the unblocked areas are the left area L and the right area R; when the figure of the speaker 12 is mostly located in the right interval, the processing unit 106 determines that the blocked area is the right area R, and the unblocked areas are the left area L and the middle area M. It should be noted that the image capture unit 102 is mainly used to capture the image of the speaker 12, and the captured image may not include the body or screen of the touch display device 10, and the position coordinates x of the left and right edges of the screen of the touch display device 10 in the horizontal x-axis direction of the image are x. L 、x R It can be obtained through setting, but is not limited to this.

[0034] Next, in step 306, the processing unit 106 may further process the image content according to the blocked area and the unblocked area determined in step 304, and preferably display the image content on the image display unit 104 in the form of a picture-in-picture screen. In one embodiment, according to different blocked areas, the embodiment of the present invention may perform different image processing. In addition, the image processing method may be further divided into two modes, namely a proportional scaling mode and a non-proportional scaling mode. Among them, the proportional scaling mode is a uniform scaling that maintains the original image aspect ratio, which can avoid image content distortion; the non-proportional scaling mode can fill the blocked area to achieve full utilization of the display area.

[0035] For example, see Figure 6 , Figure 6FIG. 6 is a schematic diagram of a picture processing process 6 according to an embodiment of the present invention. The picture processing process 6 is used in the touch display device 10 to further process the situation when the blocked area is the left area L or the right area R. The picture processing process 6 can be compiled into a program code and stored in the storage unit 108 and executed by the processing unit 106, which includes the following steps:

[0036] Step 600: Start.

[0037] Step 602 : Copy the full screen content of the touch display device 10 .

[0038] Step 604: Adjust the full screen content to the size of the unblocked area.

[0039] Step 606: Remove the image content in the unblocked area.

[0040] Step 608: Display the resized full-screen content in the unblocked area.

[0041] Step 610: End.

[0042] According to the screen processing flow 6, the processing unit 106 first copies the full screen content displayed by the touch display device 10 to the storage unit 108 (step 602), and resizes the copied full screen content to a desired size (step 604). Next, the processing unit 106 removes the screen content in the original unobstructed area (step 606), and finally displays the resized full screen content in the unobstructed area through the picture-in-picture display (step 608).

[0043] For more information, see Figure 7 , Figure 7 This is an embodiment of the processing unit 106 executing the picture processing flow 6 when the blocked area is the left area L. Figure 7 As shown, when the blocked area is the left area L, the unblocked area is the middle area M and the right area R. Figure 7Indicated by M+R. In step 602, when the image processing method is the proportional scaling mode, the processing unit 106 maintains the aspect ratio of the copied full-screen content and uniformly scales it according to the size of the unobstructed area M+R, and leaves the excess area black (in this example, the black area is located at the bottom of the image, and can also be at the top or distributed at the top or bottom, and is not limited to this). When the image processing method is the non-proportional scaling mode, the processing unit 106 scales the copied full-screen content to a size that matches the unobstructed area M+R to fill the unobstructed area M+R. Accordingly, through the picture-in-picture screen, the embodiment of the present invention can retain the screen content of the obstructed area L that the speaker 12 is operating to avoid affecting the operation. At the same time, the screen of the obstructed area L and the screen content of the unobstructed area M+R can be displayed in the unobstructed area M+R, ensuring that the listener 14 can fully see the screen content projected by the speaker 12 through the touch display device 10.

[0044] Please refer to Figure 8 , Figure 8 This is an embodiment of the processing unit 106 executing the picture processing flow 6 when the blocked area is the right area R. Figure 8 As shown, when the blocked area is the right area R, the unblocked area is the left area L and the middle area M. Figure 8 Indicated by L+M. In step 602, when the image processing method is the proportional scaling mode, the processing unit 106 maintains the aspect ratio of the copied full-screen content and uniformly scales it according to the size of the unobstructed area L+M, and leaves the excess area black (in this example, the black area is located at the bottom of the image, and can also be at the top or distributed at the top or bottom, and is not limited to this). When the image processing method is the non-proportional scaling mode, the processing unit 106 scales the copied full-screen content to a size that matches the unobstructed area L+M to fill the unobstructed area L+M. Accordingly, through the picture-in-picture screen, the screen content of the obstructed area R that the speaker 12 is operating can be retained to avoid affecting the operation. At the same time, the screen content of the obstructed area R and the screen content of the unobstructed area L+M can be displayed in the unobstructed area L+M, ensuring that the listener 14 can fully see the screen content projected by the speaker 12 through the touch display device 10.

[0045] Please refer to Fig. 9 , Fig. 9FIG. 9 is a schematic diagram of a screen processing flow 9 according to another embodiment of the present invention. The screen processing flow 9 is used in the touch display device 10 to further process the situation when the blocked area is the left area L or the right area R. Compared with the method of copying the full screen content of the touch display device 10 for processing in step 602, the screen content of the blocked area and the unblocked area are processed separately in this embodiment. The screen processing flow 9 can be compiled into a program code and stored in the storage unit 108, and executed by the processing unit 106, which includes the following steps:

[0046] Step 900: Start.

[0047] Step 902: Adjust the size of the screen content in the unblocked area to free up a sub-screen area.

[0048] Step 904: Adjust the screen content of the blocked area to the size of the sub-screen area.

[0049] Step 906: Display the resized screen content of the blocked area in the sub-picture area through the picture-in-picture screen.

[0050] Step 908: End.

[0051] According to the image processing flow 9, the processing unit 106 first adjusts (reduces) the size of the image content in the unobstructed area to create a sub-image area in the unobstructed area (step 902). Next, the processing unit 106 adjusts the size of the image content in the obstructed area to match the size of the sub-image area (step 904). Finally, the resized image content in the obstructed area is displayed in the sub-image area through the picture-in-picture technology (step 906).

[0052] For more details, please refer to Figure 7 , Figure 7 This is an embodiment of the processing unit 106 executing the picture processing flow 9 when the blocked area is the left area L. Figure 7 As shown, the blocked area is the left area L, and the unblocked area is the middle area M and the right area R. Figure 7Indicated by M+R. When the image processing method is the proportional scaling mode, in step 902, the processing unit 106 maintains the original aspect ratio of the image content of the unobstructed area M+R and uniformly scales it to (M+R)' according to its proportion in the entire image (labeled as L+M+R), so as to leave a sub-image area L' and a redundant area B in the unobstructed area M+R. In step 904, the processing unit 106 maintains the original aspect ratio of the image content of the obstructed area L, and uniformly scales it to a size that matches the sub-image area L' according to its proportion in the entire image L+M+R. Finally, in step 906, the adjusted image content of the obstructed area L is displayed in the sub-image area L' through the picture-in-picture technology, while the redundant area B does not display the image. When the image processing method is the non-proportional scaling mode, in step 902, the processing unit 106 scales the image content of the unobstructed area M+R to (M+R)' in a non-proportional manner to leave a sub-image area L' in the unobstructed area. In this example, the height of the original image can be maintained, and the image can be scaled to (M+R)' according to the proportion of the width of the unobstructed area M+R in the entire image L+M+R, but is not limited to this. In step 904, the processing unit 106 scales the image content of the obstructed area L in a non-proportional manner to match the size of the sub-image area L'. Finally, in step 906, the adjusted image of the obstructed area L is displayed in the sub-image area L' through the picture-in-picture technology. Accordingly, through the picture-in-picture screen, the embodiment of the present invention can retain the screen content of the blocked area L where the speaker 12 is operating to avoid affecting the operation. At the same time, the screen content of the blocked area L and the screen content of the unblocked area M+R can be displayed in the unblocked area M+R, ensuring that the listener 14 can fully see the screen content projected by the speaker 12 through the touch display device 10.

[0053] Please continue to refer to Figure 8 , Figure 8 This is an embodiment of the processing unit 106 executing the picture processing flow 9 when the blocked area is the right area R. Figure 8 As shown, when the blocked area is the right area R, the unblocked area is the left area L and the middle area M. Figure 8Indicated by L+M. When the image processing method is the proportional scaling mode, in step 902, the processing unit 106 maintains the original aspect ratio of the image content of the unobstructed area L+M and uniformly scales it to (L+M)' according to its proportion in the entire image L+M+R, so as to leave a sub-image area R' and a redundant area B in the unobstructed area L+M. In step 904, the processing unit 106 maintains the original aspect ratio of the image content of the obstructed area R and uniformly scales it to a size that matches the sub-image area R' according to its proportion in the entire image L+M+R. Finally, in step 906, the adjusted image content of the obstructed area R is displayed in the sub-image area R' through the picture-in-picture technology, while the redundant area B does not display the image. When the image processing method is the non-proportional scaling mode, in step 902, the processing unit 106 scales the image content of the unobstructed area L+M to (L+M)' in a non-proportional manner to leave a sub-image area R' in the unobstructed area L+M. In this example, the original image height can be maintained, and the image is scaled to (L+M)' according to the proportion of the width of the unobstructed area L+M in the entire image L+M+R, but is not limited to this. In step 904, the processing unit 106 scales the image content of the obstructed area R in a non-proportional manner to match the size of the sub-image area R'. Finally, in step 906, the adjusted image content of the obstructed area R is displayed in the sub-image area R' through the picture-in-picture technology. Accordingly, through the picture-in-picture screen, the embodiment of the present invention can retain the screen content of the blocked area R where the speaker 12 is operating to avoid affecting the operation. At the same time, the screen content of the blocked area R and the screen content of the unblocked area L+M can be displayed in the unblocked area L+M, ensuring that the listener 14 can fully see the screen content projected by the speaker 12 through the touch display device 10.

[0054] On the other hand, please refer to Fig.10 , Fig.10 FIG. 1 is a schematic diagram of a picture processing process 10 according to an embodiment of the present invention. The process 10 is used in the touch display device 10 to further process the situation when the blocked area is the middle area M. The picture processing process 10 can be compiled into program codes and stored in the storage unit 108 and executed by the processing unit 106, which includes the following steps:

[0055] Step 1000: Start.

[0056] Step 1002: Determine the image processing mode. If it is a proportional scaling mode, execute step 1004; if it is a non-proportional scaling mode, execute step 1006.

[0057] Step 1004: Divide the screen content of the blocked area into left screen content and right screen content.

[0058] Step 1006 : Split the full screen content of the touch display device 10 into left screen content and right screen content.

[0059] Step 1008: Copy the left screen content and the right screen content.

[0060] Step 1010: Remove the image content in the unblocked area.

[0061] Step 1012: Display the left image content in the left area of ​​the unblocked area, and display the right image content in the right area of ​​the unblocked area.

[0062] Step 1014: End.

[0063] According to process 10, when the blocked area is the middle area M, the processing unit 106 first determines the processing method of the screen (step 1002), divides the screen content into left screen content and right screen content according to different modes (steps 1004 and 1006), and copies the left screen content and the right screen content to the storage unit 108 (step 1008). After removing the screen content of the unblocked area (step 1010), the left screen content is displayed in the left area of ​​the unblocked area through the picture-in-picture screen, and the right screen content is displayed in the right area of ​​the unblocked area (step 1012). It should be noted that the touch display device 10 can be preset to use the proportional zoom mode or preset to use the proportional zoom mode. In this case, it is not necessary to perform the judgment of step 1002, and step 1004 or step 1006 is directly executed according to the preset mode.

[0064] Specifically, please refer to Fig.11A , Fig. 11B , Fig.11A , Fig. 11B This is an embodiment of the processing unit 106 executing the picture processing flow 10 when the blocked area is the middle area M. In this case, the unblocked area is divided into a left area L and a right area R, and the picture content of the blocked area M should be displayed together. Fig.11A The embodiment when the image processing mode is the proportional scaling mode is shown, that is, the processing unit 106 divides the blocked area M into the left image content M according to step 1004. L (i.e. the left half of the screen is blocked) and the right half of the screen content M R (i.e. the right half of the screen content is blocked), and according to step 1012, the left screen content M is displayed in the unblocked left area L through the PIP. L And the right screen content M is displayed in the right area R R . Fig. 11BThe embodiment when the image processing mode is the non-uniform scaling mode is shown, that is, the processing unit 106 divides the full screen content displayed by the touch display device 10 into the left screen content M and the right screen content M according to step 1006. L And the content on the right side of the screen M R , and according to step 1012, the left image content M is displayed in the unobstructed left area L through the PIP. L And the right screen content M is displayed in the right area R R It should be noted that in the non-uniform scaling mode, the left image content M must be L And the content on the right side of the screen M R The screen is scaled to the size that matches the left area L and the right area R, respectively, to fill the left area L and the right area R. The screen content can be scaled to different degrees in the horizontal direction by non-linear unequal-proportional scaling, so that the screen content of the blocked area has less proportional distortion when displayed compared to the content of the unblocked area. Accordingly, through the picture-in-picture screen, the screen content of the blocked area M that the speaker 12 is operating can be retained to avoid affecting the operation. At the same time, the screen content of the blocked area M can be displayed in the unblocked areas L and R, ensuring that the listener 14 can see the screen content projected by the speaker 12 through the touch display device 10.

[0065] Please refer to Fig.12 , Fig.12 Schematic diagram of a screen processing flow 12 of another embodiment of the present invention. The screen processing flow 12 is used in the touch display device 10 to further process the situation of the unequal scaling mode when the blocked area is the middle area M. Compared with the simultaneous processing of the screen contents of the blocked area and the unblocked area in steps 1006 to 1008, the present embodiment processes the screen contents of the blocked area and the unblocked area separately. The screen processing flow 12 can be compiled into a program code and stored in the storage unit 108, and executed by the processing unit 106, which includes the following steps:

[0066] Step 1200: Start.

[0067] Step 1202: Divide the image content of the blocked area into a left half blocked image content and a right half blocked image content.

[0068] Step 1204: Reduce the image contents of the left unobstructed area and the right unobstructed area in different proportions to free up a left sub-image area and a right sub-image area.

[0069] Step 1206: Respectively scale down the left half obstructed screen content and the right half obstructed screen content in different proportions, and display the left half obstructed screen content in the left sub-screen area and the right half obstructed screen content in the right sub-screen area through picture-in-picture.

[0070] Step 1208: End.

[0071] Please also refer to Fig. 11C , Fig. 11C This is an embodiment of the processing unit 106 executing the picture processing flow 12 when the blocked area is the middle area M. In this case, the unblocked area is divided into the left area L and the right area R, which together display the picture content of the blocked area M. According to the picture processing flow 12, Fig. 11C Another implementation method when the image processing method is the non-uniform scaling mode is shown. The processing unit 106 first divides the image content of the blocked area into a left half blocked image content M according to step 1202. L And the right half of the screen content M R Next, according to step 1204, the processing unit 106 scales down the image contents of the left unobstructed area L and the right unobstructed area R to the left unobstructed area L' and the right unobstructed area R' in different proportions, so as to leave a left sub-image area M in the left unobstructed area L and the right unobstructed area R respectively. L ' and a right sub-picture area M R Finally, in step 1206, the processing unit 106 respectively converts the left half of the blocked image content M L And the right half of the screen content M R The left sub-picture area M is respectively reduced in different proportions by using the picture-in-picture technique. L 'Show the resized left half of the blocked image and the right sub-image area M R 'Display the resized right half of the blocked screen. It should be noted that in this mode, in steps 1204 and 1026, when the screen content is scaled unequally, the height of the original screen can be maintained without adjustment, but it is not limited to this. In this embodiment, the screen content can be scaled to different degrees in the horizontal direction by unequally proportional nonlinear scaling, so that the screen content of the blocked area has less proportional distortion when displayed compared to the screen content of the unblocked area. Accordingly, through the picture-in-picture screen, the screen content of the blocked area M that the speaker 12 is operating can be retained to avoid affecting the operation. At the same time, the screen content of the blocked area M can be displayed in the unblocked areas L and R, ensuring that the listener 14 can see the screen content projected by the speaker 12 through the touch display device 10.

[0072] In summary, the touch display device and image display method of the present invention can dynamically display the image content of the area blocked by the speaker on the unblocked area, overcoming the shortcomings of traditional whiteboards, projectors, displays, etc., ensuring that the audience can see the complete display content, thereby improving the quality of meetings, teaching, and lectures.

[0073] The above description is only a preferred embodiment of the present invention. All equivalent changes and modifications made according to the claims of the present invention should fall within the scope of the present invention.

Claims

1. An image display method, used in a touch display device, characterized in that: Include: capturing an image of an area in front of the touch display device; Determining a position of a speaker according to the image, and determining a blocked area and an unblocked area according to the position; and The image content related to the blocked area is displayed in the unblocked area.

2. The image display method according to claim 1, wherein: When the blocked area is located at the center of the touch display device, the step of displaying the screen content related to the blocked area in the unblocked area includes: Splitting the screen content of the blocked area into a left half blocked screen content and a right half blocked screen content; and Reducing the image contents of the unblocked area on the left and right sides in different proportions to create a left sub-image area and a right sub-image area; and The left and right half of the blocked screen content are respectively reduced in different proportions, and the left half of the blocked screen content is displayed in the left sub-screen area through a picture-in-picture method, and the right half of the blocked screen content is displayed in the right sub-screen area.

3. The image display method according to claim 1, wherein: When the blocked area is located at the center of the touch display device, the step of displaying the screen content related to the blocked area in the unblocked area includes: Splitting the screen content of the blocked area into a left half of the blocked screen content and a right half of the blocked screen content; and The left half of the blocked image content is displayed in the left unblocked area, and the right half of the blocked image content is displayed in the right unblocked area.

4. The image display method according to claim 1, wherein: When the blocked area is located on the left or right side of the touch display device, the step of displaying the screen content related to the blocked area in the unblocked area includes: The image content of the unblocked area is reduced in different proportions to leave a sub-image area; The screen content of the blocked area is reduced in different proportions to the size of the sub-screen area; as well as The reduced screen content of the blocked area is displayed in the sub-picture area through the picture-in-picture technique.

5. The image display method according to claim 1, wherein: When the blocked area is located on the left or right side of the touch display device, the step of displaying the screen content related to the blocked area in the unblocked area includes: The screen content of the unblocked area is reduced in proportion to its proportion to the entire screen, so as to leave a sub-screen area and a redundant area; The screen content of the blocked area is reduced in proportion to its proportion to the entire screen to match the size of the sub-screen area; as well as The reduced screen content of the blocked area is displayed in the sub-picture area through the picture-in-picture method, while the redundant area does not display the screen.

6. A touch display device, characterized in that: Include: A power supply unit for supplying power to all components; An image capturing unit, used for capturing images; A storage unit for temporarily storing screen content; An image display unit, used to display the image content; A processing unit is coupled to the power supply unit, the image capture unit, the storage unit and the image display unit, and is used to execute an image display method. The image display method includes: Controlling the image capture unit to capture an image of a region in front of the touch display device; Determining a position of a speaker according to the image, and determining a blocked area and an unblocked area according to the position; and The image content related to the blocked area is displayed in the unblocked area.

7. The touch display device according to claim 6, wherein: When the blocked area is located at the center of the touch display device, the step of displaying the screen content related to the blocked area in the unblocked area includes: Splitting the screen content of the blocked area into a left half blocked screen content and a right half blocked screen content; and Reducing the image contents of the unblocked area on the left and right sides in different proportions to create a left sub-image area and a right sub-image area; and The left and right half of the blocked screen content are respectively reduced in different proportions, and the left half of the blocked screen content is displayed in the left sub-screen area through a picture-in-picture method, and the right half of the blocked screen content is displayed in the right sub-screen area.

8. The touch display device according to claim 6, wherein: When the blocked area is located at the center of the touch display device, the step of displaying the screen content related to the blocked area in the unblocked area includes: Splitting the screen content of the blocked area into a left half of the blocked screen content and a right half of the blocked screen content; and The left half of the blocked image content is displayed in the left unblocked area, and the right half of the blocked image content is displayed in the right unblocked area.

9. The touch display device according to claim 6, wherein: When the blocked area is located on the left or right side of the touch display device, the step of displaying the screen content related to the blocked area in the unblocked area includes: The image content of the unblocked area is reduced in different proportions to leave a sub-image area; The screen content of the blocked area is reduced in different proportions to the size of the sub-screen area; as well as The reduced screen content of the blocked area is displayed in the sub-picture area through the picture-in-picture technique.

10. The touch display device according to claim 6, wherein: When the blocked area is located on the left or right side of the touch display device, the step of displaying the screen content related to the blocked area in the unblocked area includes: The screen content of the unblocked area is reduced in proportion to its proportion to the entire screen, so as to leave a sub-screen area and a redundant area; The screen content of the blocked area is reduced in proportion to its proportion to the entire screen to match the size of the sub-screen area; as well as The reduced screen content of the blocked area is displayed in the sub-picture area through the picture-in-picture method, while the redundant area does not display the screen.