Display System

Abstract

To provide a "display system" in which a touch panel display can be used more comfortably.SOLUTION: When a screen to be displayed on a touch panel display 1 includes no visual content for appreciation, such as a movie, the screen 500 is displayed at a position, close to a user, at which the user can naturally manipulate the screen (a, b). When the screen includes a handwritten input acceptance box 501 (b), the screen 500 is placed at an upper position so that a handwriting input operation by the user is eased. When the screen includes visual content for appreciation, the screen 500 is displayed at a position slightly distant from the user so as to be suitable for viewing the visual content for appreciation (c, d). The position suitable for appreciation is set according to the display size and resolution of the visual content, included in the screen, for appreciation.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to a display system equipped with a touch panel display. [Background technology]

[0002] Known technology relating to a display system equipped with a touch panel display includes technology that detects the posture of a user seated in a car seat and moves the touch panel display to a position within reach of the user based on the detected posture (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-184024 A Summary of the Invention [Problem to be solved by the invention]

[0004] Touch panel displays mounted on automobiles are often used not only for accepting user operations but also for displaying visual content for viewing, such as movies. When such ornamental visual content is displayed, if the touch panel display is positioned within reach of the user, the distance may be too close and the ornamental visual content may not be viewed comfortably.

[0005] Therefore, an object of the present invention is to provide a display system that allows a touch panel display to be used more comfortably. [Means for solving the problem]

[0006] In order to achieve the above object, the present invention provides a display system for displaying a screen to a user, the display system comprising a touch panel display capable of changing the position at which the screen is displayed and which displays the screen and accepts operations on the screen, and a display control means for controlling the display of the screen on the touch panel display, wherein the display control means determines whether the screen to be displayed is a screen containing visual content for viewing according to a predetermined criterion, and when the screen to be displayed is not a screen containing visual content for viewing, displays the screen at an operation-compatible position that is relatively close to the user, and when the screen to be displayed is a screen containing visual content for viewing, displays the screen at an viewing-compatible position that is relatively far from the user.

[0007] Here, such a display system may be configured in such a way that the display control means calculates, as the suitable viewing position, a distance suitable for viewing the visual content for viewing contained on the screen, determined from the resolution and display size of the visual content for viewing, and a position away from the user.

[0008] In addition, the above display system may be provided with a gesture detection means for detecting a user's gesture attempting to perform an operation on the screen when the screen is displayed at the suitable viewing position, and in the display control means, if the gesture detection means detects the gesture when the screen is displayed at the suitable viewing position, the position of the displayed screen may be moved to the suitable operation position.

[0009] Furthermore, the above display system may be provided with a gaze detection means for detecting the gaze of a user gazing at a display object for accepting user operations on the displayed screen when the screen is displayed at the suitable viewing position, and in the display control means, if the gaze detection means detects the gaze when the screen is displayed at the suitable viewing position, the position of the displayed screen may be moved to the suitable operation position.

[0010] In addition, the above display system may be provided with a measurement means for performing geometric measurements of the user's body, and the display control means may calculate, from the geometric measurement results of the measurement means, a position at which the user can easily perform hand operations, as the operation-compatible position.

[0011] In addition, the above display system may be configured so that, when the screen to be displayed accepts handwritten input, the display control means calculates, as the operation suitable position, a position that is closer to the user's face than when the screen to be displayed does not accept handwritten input.

[0012] Furthermore, the above display system may be configured such that, when the display control means displays a screen at the operation-compatible position, the screen is displayed at a larger size the farther the position at which the screen is displayed is from the user.

[0013] In the above display system, the screen containing the visual content for viewing may be a screen containing video content. Furthermore, the above-mentioned display system may be a display system mounted on an automobile, and the touch panel display may be a touch panel display in which the position at which the screen is displayed is variable in the fore-and-aft direction of the automobile.

[0014] According to the above-described display system, a screen that does not include visual content for appreciation is displayed relatively close to the user, making it easy for the user to operate on the screen, whereas a screen that includes visual content for appreciation is displayed relatively far from the user, allowing the user to comfortably appreciate the visual content for appreciation without feeling stressed due to the screen being too close. Effect of the Invention

[0015] As described above, according to the present invention, it is possible to provide a display system that allows a touch panel display to be used more comfortably. [Brief description of the drawings]

[0016] [Figure 1] 1 is a block diagram showing a configuration of an in-vehicle system according to an embodiment of the present invention; [Diagram 2] 1 is a diagram showing the layout of an in-vehicle system according to an embodiment of the present invention; [Diagram 3] FIG. 4 is a diagram showing measurement positions in an embodiment of the present invention. [Figure 4] 5 is a flowchart showing a screen layout setting process according to the embodiment of the present invention. [Diagram 5] 11 is a flowchart showing an operation-suitable layout calculation process according to an embodiment of the present invention. [Figure 6] 11A to 11C are diagrams illustrating a processing example of a screen layout setting process according to the embodiment of the present invention. [Figure 7] FIG. 11 is a diagram showing another configuration example of the in-vehicle system according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, an embodiment of the present invention will be described taking as an example an application to an in-vehicle system mounted on an automobile. Figure 1 shows the configuration of the in-vehicle system. As shown in the figure, the in-vehicle system includes a touch panel display 1, a speaker 2, an in-vehicle camera 3, an input / output control unit 4, a screen layout setting unit 5, an in-vehicle monitoring system 6, and a plurality of source devices 7.

[0018] The source device 7 may be an AV player, a broadcast receiving device, a car navigation system, or some other device, and each source device 7 operates using the touch panel display 1 via the input / output control unit 4 for display output and reception of user operations.

[0019] Furthermore, the touch panel display 1 includes a display 11 and a touch panel 12 that detects a touch on the display screen of the display 11 by a user. Here, in this embodiment, the touch panel display 1 is described as being long in the horizontal direction of the display area (the front-to-rear direction of the vehicle) and is arranged on the side of the vehicle interior on the right side of the right rear seat, as shown in Figures 2a and 2b.

[0020] The in-vehicle camera 3 is disposed on the ceiling of the vehicle cabin as shown in Figures 2a and 2b, for example, and captures the user seated in the right rear seat. The in-vehicle camera 3 may be an infrared camera, and is preferably a stereo camera capable of measuring three-dimensional positions.

[0021] Returning to Fig. 1, the in-vehicle monitoring system 6 monitors various conditions inside the vehicle from the video captured by the in-vehicle camera 3. The in-vehicle monitoring system 6 also performs geometric measurement of the body of the user seated in the right rear seat. In this geometric measurement, as shown in Fig. 3, the position of the user's eyes P1, the position of the user's shoulders P2, the position of the user's waist P3, the position of the user's elbows P4, and the position of the user's hands P5 are measured. However, since the position of the waist is approximately the same in relation to the seat surface regardless of the user's physique, this same position may be set in advance as the position of the waist P3 and used.

[0022] Furthermore, from each measured position, the in-vehicle monitoring system 6 calculates the length from the shoulder to the elbow, the length from the elbow to the hand, and the direction from the shoulder to the waist. 1, when screen layout setting unit 5 receives a screen layout setting request from input / output control unit 4, it sets the position at which the screen is to be displayed on touch panel display 1 and the size of the display screen as the screen layout to input / output control unit 4. The operation of setting this screen layout will be described in detail later.

[0023] The input / output control unit 4 controls the display of the output screen of each source device 7 on the touch panel display 1, the output of the output audio of each source device 7 to the speaker 2, and the acceptance of user operations using the touch panel display 1 of each source device 7.

[0024] When switching the screen displayed on touch panel display 1 in response to a user operation or the like, input / output control unit 4 issues a screen layout setting request and receives the setting of the screen layout from screen layout setting unit 5. Then, the switched screen is displayed at a position on touch panel display 1 according to the screen layout set by screen layout setting unit 5, with a size according to the screen layout.

[0025] The operation of setting the screen layout in the input / output control unit 4, which is performed by the screen layout setting unit 5, will be described below. FIG. 4 shows the procedure of the screen layout setting process performed by the screen layout setting unit 5. As shown in the figure, in the screen layout setting process, when the screen layout setting unit 5 receives a screen layout setting request from the input / output control unit 4 (step 402), it obtains screen information by issuing a screen information request to the input / output control unit 4 (step 404).

[0026] Here, the input / output control unit 4 issues a screen information request when switching a screen displayed on the touch panel display 1, and upon receiving the screen information request from the screen layout setting unit 5, provides the input / output control unit 4 with information on the screen to be switched to as screen information. The screen information includes the size of the screen and information on the contents included in the screen, and the information on the contents includes the type and various attributes of each content. The types of content include video, still images, slide shows, virtual controls, text, and handwritten input acceptance boxes. In addition, when the content is a video, still image, or slide show, the display size and resolution of the content are included in the attributes of the content. The input / output control unit 4 learns the screen information of the screen to be switched to from a source device that outputs the screen to be switched to. However, the screen information may be learned by analyzing the structure of the screen to be switched to, or the screen information may be set in advance for each type of screen output by each source device.

[0027] Next, once the screen information has been acquired (step 404), it is determined from the content information included in the image information whether the destination screen contains ornamental visual content (step 406). Ornamental visual content is visual content intended for viewing, and in step 406, it is determined that the screen contains ornamental visual content if the content information indicates that the screen contains a moving image. However, it may be determined that the screen contains ornamental visual content only if the screen contains a moving image whose display size or screen occupancy ratio is greater than a predetermined value.

[0028] Also, if the display system also displays slide shows, the screen may be determined to contain ornamental visual content when it contains a slide show in addition to when it contains a moving image, but even in this case, the screen may be determined to contain ornamental visual content only when it contains a slide show whose display size or screen occupancy ratio is greater than a predetermined value.

[0029] In addition, if the display system also displays still images for viewing, such as photographs, it may be determined that the screen contains visual content for viewing if the display size of the still images is larger than a predetermined size and has a resolution higher than a predetermined value.

[0030] Alternatively, a correspondence may be registered between the type of screen output by each source device and whether the screen is a screen for presenting aesthetic visual content, and when the correspondence indicates that the type of screen to be switched to is a screen for presenting aesthetic visual content, it may be determined that the screen contains aesthetic visual content.

[0031] If the destination screen does not include any ornamental visual content (step 406), an operation-compatible layout calculation process is performed (step 408). FIG. 5 shows the procedure for this operation-compatible layout calculation process. As shown in the figure, in the operation-compatible arrangement calculation process, first, a position that is moved in a direction from the shoulder position measured by the in-vehicle monitoring system 6 toward the waist by the length from the shoulder to the elbow is calculated as the standard elbow position (step 502). This standard elbow position corresponds to the position of the elbow when the user is in a standard posture with the upper arms along the body. However, the elbow position measured by the in-vehicle monitoring system 6 may be calculated as the standard elbow position as it is. Also, when the right rear seat is a seat with an armrest and the user is in a posture with the elbow resting on the armrest or in a standard posture, the elbow position on the armrest measured by the in-vehicle monitoring system 6 is calculated as the standard elbow position as it is.

[0032] Then, a vertical position 10 cm above the vertical position of the standard elbow position is set as the reference vertical position (step 504). This reference vertical position is approximately the vertical position of the elbow when the user raises the elbow slightly upward from the standard posture in which the upper arm is along the body.

[0033] Also, a position 10 cm backward from the standard elbow position, which is the length from the elbow to the hand, is set as the reference elbow position (step 506). This reference elbow position is approximately the position of the hand when the user raises the elbow slightly upward from the standard posture with the upper arm along the body and naturally extends the hand diagonally forward.

[0034] Next, based on the acquired screen information, it is determined whether the screen to be switched to includes a handwritten input acceptance box (step 508). Here, the handwritten input acceptance box is an area on the screen that accepts handwritten input from the user.

[0035] If the handwritten input acceptance box is not included (step 508), the screen position is set to a position in the display area of ​​the touch panel display 1 that corresponds to the front-rear and up-down position with the reference front-rear position as the front-rear position and the reference up-down position as the up-down position (step 510).Then, the process proceeds to step 512.

[0036] On the other hand, if a handwritten input acceptance box is included (step 508), it is checked whether the vertical position of the eye measured by the in-vehicle monitoring system 6 is above the vertical center position of the touch panel display 1 (step 516).If it is not above, the screen position is set to the position in the display area of ​​the touch panel display 1 that corresponds to the front-rear, up-down position with the reference front-rear position as the front-rear position and the reference up-down position as the up-down position (step 510), and the process proceeds to step 512.

[0037] On the other hand, if the vertical position of the eyes is not above the vertical center of the touch panel display 1 (step 516), the position in the display area of ​​the touch panel display 1 corresponding to the vertical position in the front-rear direction, with the reference front-rear position as the front-rear position and the position 10 cm above the reference vertical position as the vertical position, is set as the screen position (step 518). However, if the position 10 cm above the reference vertical position is a position above the vertical position of the eyes, the position in the display area of ​​the touch panel display 1 corresponding to the vertical position in the front-rear direction, with the reference front-rear position as the front-rear position and the vertical position of the eyes as the vertical position, is set as the screen position. Then proceed to step 512.

[0038] Here, when the handwriting input reception box is included on the screen, the screen position is set 10 cm higher than when it is not included, in order to bring the handwriting position closer to the face and make it easier for the user to handwrite.

[0039] Now, after setting the screen position in this manner (steps 510, 518) and proceeding to step 512, the screen size is set according to the distance between the eye position measured by the in-vehicle monitoring system 6 and the set screen position, so that the screen size becomes larger as the distance increases, within the range that fits within the display area of ​​the touch panel display 1.

[0040] Then, the set screen position and screen size are set as the operation-compatible layout (step 514), and the process returns to the screen layout setting process. Returning to FIG. 4, once the operation-suitable layout calculation process has been performed (step 408), the operation-suitable layout is set as the screen layout in the input / output control unit 4 (step 410), and the process returns to step 402 and subsequent steps.

[0041] On the other hand, if the switched-to screen contains ornamental visual content (step 406), a position in the display area of ​​touch panel display 1 suitable for viewing the ornamental visual content is set as the screen position according to the eye position measured by in-vehicle monitoring system 6 and the display size and resolution attributes of the ornamental visual content contained in the screen (step 412). An example of a position suitable for viewing ornamental visual content is a position where the distance between the eyes and the screen is n times the vertical size of the ornamental visual content. n is set according to the resolution, increasing as the resolution of the ornamental visual content decreases.

[0042] Then, the set screen position and original screen size are set as the screen layout in the input / output control unit 4 (step 414). The original screen size is the original size of the screen, and is a size in which the resolution and display size of the ornamental visual content to be displayed do not change.

[0043] Then, once the screen layout has been set (step 414), the reception of a screen layout setting request from the input / output control unit 4 (step 416) and the occurrence of an operation gesture (step 418) are monitored.

[0044] Here, an operation gesture is a gesture made by the user in the right rear seat to operate the screen displayed on the touch panel display 1, and in step 418, it is determined that an operation gesture has occurred, for example, when the hand position measured by the in-vehicle monitoring system 6 moves a predetermined distance or more in the direction of the displayed screen.

[0045] Then, when a screen layout setting request is received (step 416), the process returns to step 404. On the other hand, if an operation gesture occurs (step 418), the operation-suitable layout calculation process shown in FIG. 5 is performed to calculate an operation-suitable layout (step 420), the set operation-suitable layout is set as the screen layout in the input / output control unit 4 (step 422), and the process returns to step 402.

[0046] Here, when the operation-suitable layout is set as the screen layout in step 422, the input / output control unit 4 changes the position and size of the displayed screen in accordance with the set screen layout. As a result, in response to the user's operation on the screen, the displayed screen moves to a position closer to the user where the user can easily perform the operation.

[0047] The screen layout setting process performed by the screen layout setting unit 5 has been described above. Here, in the in-vehicle monitoring system 6, the line of sight of a user seated in the right rear seat may be detected from the image captured by the in-vehicle camera 3, and step 418 of the screen layout setting process may be a process of monitoring the occurrence of a user's line of sight gazing at a display object for accepting user operations on the displayed screen, instead of or in addition to an operation gesture.

[0048] The display object for accepting user operations is a display object that accepts user operations, such as virtual operators such as buttons and keys, and handwritten input acceptance boxes, among the display objects that are elements constituting the screen.

[0049] In addition, in the case where the occurrence of the gaze of the user gazing at the display object for accepting a user operation is monitored in place of the operation gesture in step 418, the process proceeds to step 420 if the occurrence of the gaze is detected in step 418, and returns to step 416 if the occurrence of the gaze is not detected. In addition, in the case where the occurrence of the gaze of the user gazing at the display object for accepting a user operation is monitored in step 418 together with the operation gesture, the process proceeds to step 420 if either the operation gesture or the occurrence of the gaze is detected in step 418, and returns to step 416 if neither is detected.

[0050] The operation of setting the screen layout in the input / output control unit 4 by the screen layout setting unit 5 has been described above. According to such operation of the screen layout setting unit 5, when the screen does not contain visual content for viewing, the screen 500 is displayed in a position close to the user so that the user can operate it with natural movements, as shown in Figures 6a and 6b.

[0051] Here, Fig. 6a shows the layout of the screen when the screen does not include a handwritten input acceptance box, and Fig. 6b shows the layout of the screen when the screen includes a handwritten input acceptance box 501. As shown, when the screen includes the handwritten input acceptance box 501, the screen is positioned a little closer to the face, facilitating the user's handwritten input.

[0052] Then, when the screen contains visual content for viewing, as shown in Figures 6c, d, the screen 500 is displayed at a distance from the user in a position suitable for viewing the visual content for the user to view.

[0053] Here, Figures 6c and 6d show a case where the screen contains appreciation visual contents of the same display size at the same position on the screen, with Figure 6c showing the screen arrangement when the appreciation visual contents have a high resolution, and Figure 6d showing the screen arrangement when the appreciation visual contents have a low resolution. As shown in the figures, depending on the resolution of the appreciation visual contents contained in the screen, the screen is arranged at a different position according to the resolution so that the distance from the user to the screen is a distance suitable for viewing the appreciation visual contents of that resolution. As mentioned above, the arrangement of the screen containing the appreciation visual contents is set depending on the display size as well as the resolution of the appreciation visual contents.

[0054] The embodiment of the present invention has been described above. Thus, according to the present embodiment, the screen that does not include the appreciation visual content is displayed relatively close to the user, making it easier for the user to operate on the screen, whereas the screen that includes the appreciation visual content is displayed relatively far from the user, allowing the user to comfortably appreciate the appreciation visual content without the stress of having the screen too close.

[0055] Incidentally, in the above embodiment, one touch panel display 1 is provided only on the side surface of the vehicle interior on the right side of the right rear seat of the automobile, but the number and arrangement of the touch panel displays 1 can be variously modified.

[0056] For example, the touch panel display 1 may be provided on the passenger compartment side surface on the left side of the left rear seat, or the touch panel display 1 may be provided on the passenger compartment side surface on the right side of the right rear seat and on the left side of the left rear seat.

[0057] Alternatively, for example, as shown in Figs. 7a1 and a2, a touch panel display 1 that is long in the vertical direction of the display area (the front-rear direction of the car) may be provided between the right and left rear seats of the car.

[0058] In this case as well, when the screen does not include visual content for viewing, screen 500 is displayed on touch panel display 1 so as to be positioned close to the user where the user can operate it naturally, as shown in Figures 7b1 and 7b2. Also, when the screen includes handwritten input acceptance box 501, as shown in Figure 7b2, it is displayed slightly closer in the left-right direction to the user using touch panel display 1 than when the screen shown in Figure 7b1 does not include handwritten input acceptance box 501, making it easier for the user to input handwritten input.

[0059] Additionally, when the screen contains appreciation visual content, as shown in Figures 7b3 and b4, screen 500 is displayed at a location farther away from the user than when the screen does not contain appreciation visual content as shown in Figures 7b1 and b2, and is more suitable for the user's appreciation of the appreciation visual content. Additionally, depending on the resolution and display size of the appreciation visual content contained in the screen, the screen is displayed at different locations such that the distance from the user to the screen is more suitable for appreciation of the appreciation visual content of that resolution and display size.

[0060] In addition, in the above embodiments, the screen layout is changed by varying the display position of the screen within the display area of ​​touch panel display 1, but the screen layout may also be changed by moving touch panel display 1 itself. [Explanation of symbols]

[0061] 1...touch panel display, 2...speaker, 3...in-vehicle camera, 4...input / output control unit, 5...screen layout setting unit, 6...in-vehicle monitoring system, 7...source device, 11...display, 12...touch panel.

Claims

1. A display system that displays a screen to a target user, the target user being a user seated in a single specific seat, comprising: a touch panel display that displays a screen to the target user and accepts operations on the screen by the target user, the touch panel display being capable of changing a position at which the screen is displayed; A display control means for controlling display of a screen on the touch panel display, The display control means determines whether the screen to be displayed is a screen containing visual content for viewing according to predetermined criteria, and when the screen to be displayed is not a screen containing visual content for viewing, displays the screen at an operation-compatible position that is relatively close to the target user, and when the screen to be displayed is a screen containing visual content for viewing, displays the screen at a viewing-compatible position that is relatively far from the target user.

2. 2. The display system of claim 1, A display system characterized in that the display control means calculates the suitable viewing position as a distance suitable for viewing the visual content for viewing contained on the screen, determined from the resolution and display size of the visual content for viewing, and a position away from the target user.

3. 3. A display system according to claim 1, further comprising: a gesture detection means for detecting a gesture of a target user who is about to perform an operation on the screen while the screen is displayed at the suitable viewing position; A display system characterized in that, when the gesture detection means detects the gesture while the screen is displayed at the viewing-compatible position, the display control means moves the position of the displayed screen to the operation-compatible position.

4. A display system according to claim 1, 2 or 3, a gaze detection means for detecting a gaze of the target user gazing at the display object for receiving a target user operation on the displayed screen when the screen is displayed at the suitable viewing position; A display system characterized in that, when the display control means detects the gaze while the screen is displayed at the viewing-compatible position, the display control means moves the position of the displayed screen to the operation-compatible position.

5. A display system according to claim 1, 2, 3 or 4, A measuring means for performing a geometric measurement of the body of the target user, A display system characterized in that the display control means calculates, as the operation-compatible position, a position at which the target user can easily perform operation with their hands, obtained from the geometric measurement results of the measurement means.

6. A display system according to claim 1, 2, 3, 4 or 5, The display system is characterized in that, when the screen to be displayed accepts handwritten input, the display control means calculates, as the operation suitable position, a position that is closer to the face of the target user than when the screen to be displayed does not accept handwritten input.

7. A display system according to claim 5 or 6, A display system characterized in that, when displaying a screen at the operation-compatible position, the display control means displays the screen at a size that increases as the position at which the screen is displayed becomes farther from the target user.

8. A display system according to claim 1, 2, 3, 4, 5, 6 or 7, A display system, characterized in that the screen containing the visual content for viewing is a screen containing video content.

9. A display system according to claim 1, 2, 3, 4, 5, 6, 7 or 8, The display system is a display system mounted on a vehicle, A display system, characterized in that the touch panel display is capable of changing the position at which the screen is displayed in the fore-and-aft direction of the automobile.

Images