Using capacitive sensing to identify users in multi-view display systems

Abstract

In one embodiment, a method includes generating, on a multi-view display, first content viewed at a first angle and second content viewed at a second angle. The first content and the second content are displayed simultaneously. The method also includes receiving a first plurality of capacitive signals at a touch screen panel coupled to the multi-view display. The method then generates a first touch screen panel heat map based on the received first plurality of capacitive signals by the touch screen panel. The method then determines, based on the first touch screen panel heat map, whether a first user input regarding the first content or the second content is received. The method then assigns the first user input to the first content or the second content based on determining that the first user input corresponds to the first content or the second content.

Description

Technical Field

[0001] The present disclosure relates generally to touch screen panels in multi-view display systems. Background Art

[0002] Existing displays are often designed as one-to-many experiences, where a single image is broadcast to anyone viewing the display. In scenarios where multiple people are viewing and interacting with a single display, the communication efficiency of one-to-many displays decreases. For example, if multiple people gather around a traditional display, the display will present the same content to all users, limiting the relevance and value of the content. User interaction can also be an issue if the display points to an interface that can be used by multiple users. Multi-user interfaces can be confusing or complex due to having all the elements that each user uses on a single display. Summary of the invention

[0003]

Technical Solution

[0004] In one embodiment, a method includes generating, on a multi-view display, first content viewed at a first angle and second content viewed at a second angle. The first content and the second content are displayed simultaneously. The method also includes receiving a first plurality of capacitive signals at a touch screen panel coupled to the multi-view display. The method then generates a first touch screen panel heat map based on the received first plurality of capacitive signals by the touch screen panel. The method then determines whether a first user input regarding the first content or the second content is received based on the first touch screen panel heat map. The method then assigns the first user input to the first content or the second content based on determining that the first user input corresponds to the first content or the second content. BRIEF DESCRIPTION OF THE DRAWINGS

[0005] Figures 1A-1D An example multi-view display system with different content displayed at different viewing angles is shown.

[0006] Figure 2 An example of capacitive sensing using a touch screen panel is shown.

[0007] Figure 3 An example process for receiving input from a touch screen panel connected to a multi-view display is shown.

[0008] Figure 4A-4B Example user identification using capacitive sensing is shown.

[0009] Figure 5 An example flow chart for user identification using capacitive sensing is shown.

[0010] Figure 6 Example user identification using motion tracking is shown.

[0011] Figure 7 An example flow diagram for user identification using motion tracking is shown.

[0012] Figure 8 An example method of mapping user input to content is shown.

[0013] Fig. 9 An example computer system is shown. DETAILED DESCRIPTION

[0014] In one embodiment, a method includes generating, on a multi-view display, first content viewed at a first angle and second content viewed at a second angle, wherein the first content and the second content are displayed simultaneously, receiving a first plurality of capacitive signals on a touch screen panel coupled to the multi-view display, generating, by the touch screen panel, a first touch screen panel heat map based on the received first plurality of capacitive signals, determining, based on the first touch screen panel heat map, whether a first user input corresponds to the first content or the second content, and assigning the first user input to the first content or the second content based on determining whether the first user input corresponds to the first content or the second content.

[0015] In one embodiment, the method further includes detecting that one of the one or more capacitance signals exceeds a threshold capacitance value, wherein in response to detecting that one of the one or more capacitance signals exceeds the threshold capacitance value, generating a touch screen panel heat map.

[0016] In one embodiment, the first touch screen panel heat map indicates capacitance values ​​corresponding to a plurality of locations on the touch screen panel.

[0017] In one embodiment, the first user input is a touch input received via a touch screen panel.

[0018] In one embodiment, the method further includes generating a capacitive shadow representing a first plurality of capacitive signals corresponding to a plurality of locations of the touch screen panel based on the first touch screen panel heat map, identifying a direction associated with the capacitive shadow, and determining whether the direction corresponds to the first content or the second content. In one embodiment, the method further includes determining that the direction corresponds to the first content, and in response to determining that the direction corresponds to the first content, assigning the first user input to the first content. In one embodiment, the method further includes determining that the direction corresponds to the second content, and in response to determining that the direction corresponds to the second content, assigning the first user input to the second content.

[0019] In one embodiment, a first plurality of capacitive signals are received within a time interval. In one embodiment, the method further comprises: in response to receiving the first plurality of capacitive signals within the time interval, generating a vector corresponding to a motion detected from a sequence in which each of the first plurality of capacitive signals is received within the time interval; identifying a direction associated with the vector; and determining whether the direction corresponds to a first content or a second content. In one embodiment, the method further comprises determining that the direction corresponds to the first content, and in response to determining that the direction corresponds to the first content, assigning a first user input to the first content. In one embodiment, the method further comprises determining that the direction corresponds to the second content, and in response to determining that the direction corresponds to the second content, assigning the first user input to the second content.

[0020] In one embodiment, assigning a first user input to a first content or a second content includes identifying a position of a touch screen panel corresponding to an activatable element corresponding to the first content or the second content; and in response to assigning the first user input to the first content or the second content, triggering the activatable element corresponding to the first content or the second content.

[0021] In one embodiment, the method also includes determining one or more characteristics of a user associated with the first plurality of capacitive signals based on a plurality of locations at which the first plurality of capacitive signals are received relative to the touch screen panel, and modifying display of one or more of the first content or the second content based on the determined one or more characteristics.

[0022] In one embodiment, the method also includes generating a first interactive element at the location of the touch screen panel, wherein the first interactive element corresponds to first content, wherein the first user input is associated with the location of the touch screen panel, and generating a second interactive element at the location of the touch screen panel, wherein the second interactive element corresponds to second content, wherein the first user input triggers the first interactive element or the second interactive element based on the assignment of the first user input.

[0023] In one embodiment, the method further includes receiving a second plurality of capacitive signals, generating a second touch screen panel heat map based on the received second plurality of capacitive signals, and determining whether the second user input corresponds to the first content or the second content based on the second touch screen panel heat map. In one embodiment, the method further includes identifying a first direction corresponding to the first user input, wherein the first direction is associated with the first content, and identifying a second direction corresponding to the second user input, wherein the second direction is associated with the second content.

[0024] In one embodiment, the method further comprises generating a content package including the first content and the second content. In one embodiment, the method further comprises changing the first content or the second content based on the allocation of the first content or the second content by the first user input, and regenerating the content package in response to changing the first content or the second content, wherein the regenerated content package is displayed on the multi-view display.

[0025] In one embodiment, a device includes a multi-view display, a touch screen panel coupled to the multi-view display, one or more storage media embedded with instructions, and one or more processors, wherein the processors are operable to execute instructions to: generate a first content to be viewed at a first angle and a second content to be viewed at a second angle on the multi-view display, wherein the first content and the second content are displayed simultaneously, and receive a first plurality of capacitive signals at the touch screen panel; generate a first touch screen panel heat map by the touch screen panel based on the received first plurality of capacitive signals, determine whether a first user input corresponds to the first content or the second content based on the first touch screen panel heat map, and assign the first user input to the first content or the second content based on the determination whether the first user input corresponds to the first content or the second content.

[0026] In one embodiment, one or more computer-readable storage media are embedded with instructions that, when executed by one or more processors, cause the one or more processors to generate a first content to be viewed at a first angle and a second content to be viewed at a second angle on a multi-view display, wherein the first content and the second content are displayed simultaneously, receive a first plurality of capacitive signals on a touch screen panel coupled to the multi-view display, generate a first touch screen panel heat map by the touch screen panel based on the received first plurality of capacitive signals, determine whether a first user input corresponds to the first content or the second content based on the first touch screen panel heat map, and assign the first user input to the first content or the second content based on determining whether the first user input corresponds to the first content or the second content.

[0027] The electronic device of the present disclosure provides the ability to accurately map user input to specific content displayed on a multi-view display. For example, the electronic device can be a multi-view display system including a multi-view display coupled to a touch screen panel. Using a touch screen panel, the device may be able to implement capacitive sensing to detect user input by measuring the capacitance value through the touch screen panel. As described herein, the device determines the direction associated with the measured capacitance value, and maps the user input to, for example, a first content or a second content displayed on the multi-view display based on the determined direction. Although certain embodiments of the present disclosure describe a multi-view display that displays a first content and a second content, as described more fully herein, the present disclosure contemplates a multi-view display that can provide any suitable separate or unique view of the content, such as three views, four views, etc.

[0028] A multi-view display can display various contents to multiple users at the same time. This can help increase the relevance of the content to each user by increasing the available content. The multi-view display can present each available content and combine them using a presentation engine to generate a content package showing different contents at different angles. The implementation of user identification can enable users to browse their respective content (i.e., the content presented to each user view) without interfering with the content displayed by other views of the multi-view display. For example, if a multi-view display is used in a vehicle, a global positioning system (GPS) can be used to present directions for navigation to the driver, and music applications can be presented to passengers for entertainment. By identifying users and their respective interactions with the multi-view display, users may be able to effectively navigate their respective content (e.g., the driver performs navigation settings and the passenger performs music applications).

[0029] In order to accurately identify the user interacting with the multi-view display, the touch screen panel can be used for capacitive sensing, wherein when the user approaches the touch screen panel, the touch screen panel can receive the capacitance value corresponding to the user (e.g., the user's hand, arm, etc.). These capacitance values ​​can be used to generate a heat map, which indicates the capacitance value corresponding to the touch screen panel position. As used herein, "heat map" refers to any suitable characterization of the capacitance value at the point on the capacitive sensor of the touch screen panel, and is not limited to, for example, a graphical representation of these values. The heat map can associate a specific capacitance value with each position of the touch screen panel. These heat maps are used to determine the direction in which the user input is received. For example, when receiving the user input, the touch screen panel can generate a heat map, and the identification heat map is approaching the multi-view display from the left. By identifying that the heat map is from the left, it can be determined that the user input associated with the heat map is from the user on the left side of the multi-view display (e.g., the driver in the vehicle). Therefore, the user interaction can be specifically associated with the content of the left view on the multi-view display, and the interaction is ignored by other views of the right view on the multi-view display, for example.

[0030] When discussing multi-view displays, any kind of multi-view display can be used, and the multi-view display can include different components. For example, a lenticular lens sheet, a parallax barrier, or a diffraction backlight can be used. The multi-view display can include different panel structures. For example, the multi-view display can have a stackup including a display, a lens array followed, and a touch screen panel. The multi-view display can have different stackups, including a display, followed by a touch screen panel, and then a lens array.

[0031] Unlike conventional multi-view displays, the multi-view displays described herein are not limited to areas of the display that are divided for specific users. For example, a user viewing the multi-view display from the left side can interact with the entire display, such as by touching an interactive element on the right side of the screen. The user input interfaces of each view can overlap each other, i.e., can share the same physical space on the display, for example, to maximize the user input interface space for each user. This can reduce clutter of content displayed on the multi-view display by appropriately spacing out the interactive elements of the user interface.

[0032] Figures 1A-1D An example multi-view display system with different contents displayed at different viewing angles is shown. Figure 1A , a vehicle 102 is shown. The vehicle may include a multi-view display 104 that projects a navigation application 106 through a viewing angle 108, a music application 110 through a viewing angle 112, and a media player application 114 through a viewing angle 116. Each of the viewing angles 108, 112, 114 may be determined to provide each user with an optimal amount of operability to move around to interface with the multi-view display 104. Each of the applications 106, 110, 114 may have their own respective user interface, providing a personalized interface experience for each user. In certain embodiments, based on the viewing angle, one or more of the applications 106, 110, 114 may have reduced or no user interface elements to interact with. For example, a passenger in the rear of the vehicle may not have access to the multi-view display 104 and therefore does not need any user interface elements, thereby maximizing the media content 114 presented within the viewing angle 116. As described above, each of the applications 106, 110, 114 may be presented by user interfaces that overlap each other in the physical space of the multi-view display 104.

[0033] refer to Figure 1B, a user interface of a navigation application 106 is shown on the multi-view display 104. The multi-view display 104 may include or be coupled to a touch screen panel 118, which may receive capacitive signals in response to a user's interaction with the multi-view display 104. In certain embodiments, only users within the viewing angle 108 may view and interact with the navigation application 106. The navigation application 106 may include an icon 120 representing the user's location, a route 122, and an interactive element 124 that ends the route 122 to a destination (not shown). Other elements of the navigation application may also be displayed. The interactive element 124 may only be presented to a user viewing the multi-view display 104 from the viewing angle 108. As described more fully herein, the interactive element 124 may only be activated or selected by a user viewing the multi-view display 104 from the viewing angle 108. As described above, from the perspective of a user within the viewing angle 108, the navigation application 106 appears to occupy the entire physical display space of the multi-view display 104.

[0034] refer to Figure 1C , a user interface of a music application 110 is shown on a multi-view display 104. The multi-view display 104 may include or be coupled to a touch screen panel 118, which may receive capacitive signals in response to a user's interaction with the multi-view display 104. In certain embodiments, only users within the viewing angle 112 may view and interact with the music application 110. The music application 110 may include a progress bar 126, an interactive element 128 to go to the previous song, an interactive element 130 to pause or play a song, and an interactive element 132 to go to the next song. Other elements of the music application may also be displayed. The interactive elements 126, 128, 130, 132 may only be presented to a user viewing the multi-view display 104 from the viewing angle 112. The interactive elements 126, 128, 130, 132 may only be activated or selected by a user viewing the multi-view display 104 from the viewing angle 112.

[0035] refer to Figure 1D, a user interface of a media player application 114 is shown on the multi-view display 104. The multi-view display 104 may include or be coupled to a touch screen panel 118, which may receive capacitive signals in response to user interaction with the multi-view display 104. In certain embodiments, only users within the viewing angle 114 may interact with the media player application 114. The media player application 114 may include a progress bar 134, an interactive element 136 to go to the previous video, an interactive element 138 to pause or play the video, and an interactive element 140 to go to the next video. Other elements of the media player application may also be displayed. The interactive elements 134, 136, 138, 140 may only be presented to users viewing the multi-view display 104 from the viewing angle 116. The interactive elements 134, 136, 138, 140 may only be activated or selected by users viewing the multi-view display 104 from the viewing angle 116. Although the media player application 114 is presented with the interactive elements 134, 136, 138, 140, the media player application 114 may be presented without any interactive elements.

[0036] In certain embodiments, each application 106, 110, 114 may include an interactive element to switch content to a different application 106, 110, 114. For example, a passenger may switch to the navigation application 106 to enter new directions for the driver or change the content in the media player application 114. Figure 1A The example of FIG. 1 shows three views associated with three perspectives 108, 112, and 116, but the present disclosure contemplates that more or fewer views may be associated with such perspectives. For example, perspective 116 itself may be associated with three separate views: one for Figure 1A A view associated with the left rear seat in Figure 1A A view associated with the center rear seat in Figure 1A Each of these views may be different from the views associated with viewing angles 108 and 112, for a total of 5 different views.

[0037] Figure 2An example of capacitive sensing 200 is shown in which a user 202 uses a touch screen panel 204 to detect capacitance values ​​206a, 206b, 206c, 206d. When the user 202 contacts the touch screen panel 204, the touch screen panel 204 detects capacitance signals of different capacitance values ​​206. As shown, the further the user 202 is from the touch screen panel 204, the greater the interval between the user 202 and the touch screen panel 204, which affects the capacitance values ​​206 corresponding to various positions of the touch screen panel 204. The further the user 202 is from the touch screen panel 204, the less likely the touch screen panel 204 is to record any capacitance value. Capacitive sensing 200 is used to detect from which direction the user 202 is docking with the touch screen panel 204. For example, capacitive sensing 200 can detect that the user 202 is approaching the touch screen panel from the right side.

[0038] Figure 3 An example process 300 of receiving input 302 from a touch screen panel connected to a multi-view display is shown. The process 300 can begin with the touch screen panel receiving a touch screen input 302 from a user. For example, the user can approach the touch screen panel and touch the touch screen panel at a location on the touch screen panel to generate the touch screen panel input 302. The touch screen panel input 302 can be one or more capacitive signals. The touch screen panel can receive the touch screen panel input 302 and generate a heat map 304 representing the location of the touch screen panel, which corresponds to the received capacitive signals. The heat map 304 is sent to a user detection system 306 to detect which user the touch screen panel input 302 corresponds to, as described herein.

[0039] The user detection system 306 can send a determination 308 of which view the touch screen panel input 302 is associated with and a touch position 310 indicating the position of the touch screen panel where the touch screen panel input 302 is received to the multi-view application 314. The multi-view application 314 can record information 312 of the view identifier, which indicates which content corresponds to which perspective and the interactive elements of the corresponding content. The multi-view application 314 can send the recorded information 312 to the user detection system 306 to ensure that the user detection system 306 is using the latest information 312 to accurately determine which user is watching which content. The multi-view application 314 can generate a first user interface 316 including the first content and a second user interface 318 including the second content. The received touch screen panel input 302 can change the previously generated first user interface 316 or the previously generated second user interface 318. The change can cause the multi-view application 314 to send updated information 312 to the user detection system 306. The multi-view application 314 can send data 320 associated with both the user interfaces 316 and 318 to the rendering engine 322. The rendering engine 322 generates a content package 324 to be displayed on the multi-view display. After generating the content package 324, the rendering engine sends an output 326 to the multi-view display, which presents the second user interface 318 to a user viewing the multi-view display at a first angle 328 and presents the first user interface 316 to a user viewing the multi-view display at a second angle 330.

[0040] Figure 4A-4B An example user identification process 400 using capacitive sensing is shown. Figure 4A In certain embodiments, user 402 may approach touch screen panel 404 from one side (e.g., the left side). Touch screen panel 404 may generate a heat map indicating the capacitance value of the received capacitive signal. In certain embodiments, touch screen panel 404 may take a snapshot of the capacitive signal at any given moment. In certain embodiments, touch screen panel 404 may take a snapshot of the capacitive signal in response to detecting touch input 406. Touch input 406 may be a capacitive signal exceeding a threshold capacitance value. In certain embodiments, touch screen panel 404 may use a heat map to generate a capacitive shadow that represents the capacitive signal captured in the snapshot. The capacitive shadow may include touch input 406, second level input 408, and third level input 410.

[0041] The touch screen panel 404 can determine an angle 412 of the capacitive shadow relative to the touch screen panel 404. The touch screen panel 404 can use the capacitive shadow and the angle 412 to accurately determine from which direction the user inputs the touch input 406. By analyzing the capacitive shadow, the touch screen panel 404 can determine that the capacitance value gradually decreases from the touch input 406 (dark=high capacitance value) to the second level input 408 (bright=medium capacitance value) to the third level input 410 (bright=low capacitance value). The pattern of the capacitive shadow can be used to indicate that the user's arm (e.g., the user's finger) is touching the location associated with the touch input 406, and the arm is slightly approaching the touch screen panel 404 at an angle 412 to the direction indicated by the second level input 408 and the third level input 410. The touch screen panel 404 can determine that the user 402 is approaching the touch screen panel 404 from the left. The touch screen panel 404 can map the touch input 406 to the content displayed on the left multi-view display.

[0042] refer to Figure 4B In certain embodiments, user 403 may approach touch screen panel 404 from one side (e.g., the right side). Touch screen panel 404 may generate a heat map indicating the capacitance value of the received capacitance signal. In certain embodiments, touch screen panel 404 may take a snapshot of the capacitance signal at any given moment. In certain embodiments, touch screen panel 404 may take a snapshot of the capacitance signal in response to detecting touch input 414. Touch input 414 may be a capacitance signal exceeding a threshold capacitance value. In certain embodiments, touch screen panel 404 may use a heat map to generate a capacitance shadow that represents the capacitance signal captured in the snapshot. The capacitance shadow may include touch input 414, second level input 416, and third level input 418. Touch screen panel 404 may determine the angle (not shown) of the capacitance shadow relative to touch screen panel 404.

[0043] The touch screen panel 404 can use the capacitive shading and angle to accurately determine from which direction the user inputs the touch input 414. By analyzing the capacitive shading, the touch screen panel 404 can determine that the capacitance value gradually decreases from the touch input 414 (dark = high capacitance value) to the second level input 416 (bright = medium capacitance value) to the third level input 418 (bright = low capacitance value). The pattern of the capacitive shading can be used to indicate that the user's arm (e.g., the user's finger) is touching the location associated with the touch input 414, and the arm is approaching the touch screen panel 404 slightly at an angle to the direction indicated by the second level input 416 and the third level input 418. The touch screen panel 404 can determine that the user 403 is approaching the touch screen panel 404 from the right. The touch screen panel 404 can map the touch input 414 to the content displayed on the right multi-view display.

[0044] Figure 5 An example flow chart for user identification using capacitive sensing is shown. Process 500 can begin by receiving a touch screen panel heat map 502 from a touch screen panel. The touch screen panel heat map 502 is passed to a shadow detection process 504, which initially performs noise filtering on the touch screen panel heat map 502 at step 506. After performing the noise filtering, at step 508, touch detection is performed to determine that a touch has been received. In a particular embodiment, the touch detection determines whether the capacitance value exceeds a threshold capacitance value.

[0045] At step 510, a touch position corresponding to a touch input is identified. The touch screen panel heat map is used to identify the maximum capacitance value corresponding to the touch input. The touch screen panel heat map is then used to determine the touch position of the touch input. At step 512, a shadow angle is detected, which corresponds to the angle between the user who is inputting the touch input and the touch screen panel. After the shadow angle is detected, at step 514, process 504 continues to determine which view the user input (e.g., touch input) corresponds to. The user input is mapped to content or views displayed at a given viewing angle. Each content displayed on the multi-view display 530 can be given a view identifier to distinguish the content from each other.

[0046] To determine which view identifier the user input is associated with, the view identifier and the position relative to the display information 516 are used in the determination process of step 514. After determining the view identifier associated with the user input, the process 504 outputs an identifier and a position 518 of the user input (e.g., a touch input), which is sent to a user interface 520 corresponding to the driver content 526 or the passenger content 528 displayed on the multi-view display 530. Based on whether the view identifier is identifier #1 522 or identifier #2 524, the user input is sent to the corresponding user interface 520. Once the corresponding user interface 520 is determined, the user input can be entered into the user interface 520. The received user input can activate or select an interactive element in the corresponding content 526, 528.

[0047] Figure 6An example process 600 of user identification using motion tracking is shown. User 602 can approach touch screen panel 604 from one side (e.g., the left side). Touch screen panel 604 can generate a heat map indicating the capacitance value of the received capacitive signal. In a particular embodiment, touch screen panel 604 can take a snapshot of the capacitive signal at any given moment. In a particular embodiment, during process 600, touch screen panel 604 can wait to receive any capacitive signal from user 602. Once a capacitive signal from the user is detected at a first position 602a, touch screen panel 604 can record the capacitive signal and the corresponding timestamp until a user input (e.g., a touch input on the touch screen panel) is received. Touch screen panel 604 can track the motion of user 602 by recording the capacitive signal within a time interval.

[0048] like Figure 6 As shown, the user 602 may be reaching the touch screen panel 604 to input a user input at a specific location on the touch screen panel 604. The user 602 follows a path where the user 602 starts at a first location 602a, moves to a second location 602b, moves to a third location 602c, and finally ends at a fourth location 602d. As the user 602 crosses the touch screen panel 604, when the user 602 is at the first location 602a, the touch screen panel 604 detects a third level input 606 of the capacitive shadow. When the user 602 reaches the second location 602b, the touch screen panel 604 detects a third level input 608 that is slightly larger than the third level input 606. When the user 602 reaches the third location 602c, the touch screen panel 604 detects a third level input 610 that is slightly larger than the third level input 608, and detects a second level input 612. When the user 602 reaches the fourth position 602d, the touch screen panel 604 detects the same third level input 610 and second level input 612 as the third position 602c, and detects a touch input 614. The touch screen panel can analyze the capacitive signal record, and in certain embodiments, the associated timestamp, to determine the motion followed by the user 602 to reach the touch input 614. The motion can be used to determine the direction from which the user 602 came, which indicates the viewing angle of the user 602 and the content that the user 602 is viewing. The touch screen panel 604 can map the touch input 614 to the corresponding content (e.g., content viewed from the left) accordingly.

[0049] Figure 7An example flow chart for user identification using motion tracking is shown. Process 700 can begin by receiving a touch screen panel heat map 702 from a touch screen panel. The touch screen panel heat map 702 is passed to a motion tracking process 704, which initially performs noise filtering on the touch screen panel heat map 702 at step 706. After performing noise filtering, motion tracking is initiated at step 708 when a capacitance signal is received, and the motion tracking process 704 can record the capacitance value with a timestamp. At step 710, touch detection is performed to determine that a touch has been received. In a particular embodiment, the touch detection determines whether the capacitance value exceeds a threshold capacitance value. At step 712, a touch position corresponding to a touch input is identified. The touch screen panel heat map is used to identify the maximum capacitance value corresponding to the touch input. The touch screen panel heat map is then used to determine the touch position of the touch input.

[0050] After the touch location is identified, process 704 continues to determine which view the user input corresponds to at step 714. The user input (e.g., touch input) is mapped to content or views displayed at a given viewing angle. Each content displayed on the multi-view display can be given a view identifier to distinguish the content from each other. In order to determine which view identifier the user input is associated with, the view identifier and the position relative to the display information 718 are used in the determination process of step 714. After determining the view identifier associated with the user input, process 704 outputs an identifier and position 716 of the user input (e.g., touch input). The identifier and position 716 can be sent to the user interface corresponding to the view identifier content.

[0051] like Figure 7As shown, the user 720 may be reaching the touch screen panel 722 to input the user input at a specific position on the touch screen panel 722. The user 720 follows a path where the user 720 starts at a first position 720a, moves to a second position 720b, moves to a third position 720c, and finally ends at a fourth position 720d. As the user 720 crosses the touch screen panel 722, when the user 720 is at the first position 720a, the touch screen panel 722 detects a third level input 724 of the capacitive shadow. The touch screen panel 722 may generate a first vector 726 representing the motion of the user 720 relative to the capacitive signal recorded in the first position 720a. When the user 720 reaches the second position 720b, the touch screen panel 722 detects a third level input 728 slightly larger than the third level input 724. The touch screen panel 722 may generate a second vector 730 representing the motion of the user 720 relative to the capacitive signal recorded in the second position 720b. When the user 720 reaches the third position 720c, the touch screen panel 722 detects a second level input 732. The touch screen panel 722 may generate a third vector 734 representing the movement of the user 720 relative to the capacitive signal recorded in the third position 720c. When the user 720 reaches the fourth position 720d, the touch screen panel 722 detects the touch input 736 and detects the second level input 738. The touch screen panel 722 may generate a fourth vector 740 representing the movement of the user 720 relative to the capacitive signal recorded in the fourth position 720d. The touch screen panel 722 may use the generated vectors 726, 730, 734, 740 to determine the movement followed by the user 720. The movement may be used to determine the direction from which the user 720 is coming, which indicates the viewing angle of the user 720 and the content that the user 720 is viewing. The touch screen panel 722 may map the touch input 736 to the corresponding content (e.g., content viewed from the left) accordingly.

[0052] Figure 8 An example method for mapping user input to content is shown. In step 802, the method includes generating, on a multi-view display, first content viewed at a first angle and second content viewed at a second angle. As shown in step 802, the first content and the second content may be displayed simultaneously. In step 804, the method includes receiving a first plurality of capacitive signals at a touch screen panel coupled to the multi-view display. In step 806, the method includes generating, by the touch screen panel, a first touch screen panel heat map based on the received first plurality of capacitive signals. In step 808, the method includes determining, based on the first touch screen panel heat map, whether a first user input regarding the first content or the second content is received. In step 810, the method includes mapping the first user input to the first content or the second content based on determining that the first user input corresponds to the first content or the second content.

[0053] Where appropriate, specific examples may be repeated Figure 8 Although the present disclosure will Figure 8 The specific steps of the method are described and shown as occurring in a specific order, but the present disclosure contemplates Figure 8 Any suitable steps of the method may occur in any suitable order. Furthermore, although this disclosure describes and illustrates example methods for mapping user input to content, this disclosure contemplates any suitable method for mapping user input to content, which may include, where appropriate, Figure 8 In addition, although the present disclosure describes and illustrates the implementation of Figure 8 specific components, devices or systems for specific steps of the method, but the present disclosure contemplates performing Figure 8 Any suitable combination of any suitable components, devices, or systems of any suitable steps of the method.

[0054] In certain embodiments, the multi-view display system may include a multi-view display coupled to a touch screen panel and a processor.Although the steps described herein have been described as being performed by a portion of the multi-view display system, the steps may be performed by any portion of the multi-view display system.

[0055] In a particular embodiment, once the multi-view display system receives the user input, the multi-view display system can identify which content the user input corresponds to. After the multi-view display system determines which content the user input corresponds to, the multi-view display system can map the user input to the content. Mapping the user input to the content can trigger any activatable element of the content located at the location of the received user input. Multiple activatable elements from different content can be located at the same location on the multi-view display system. One user can see an end button for a navigation application, and another user can see a play button for a music application.

[0056] In certain embodiments, the multi-view display system may determine one or more characteristics of a user interfacing with the multi-view display system. For example, the user may be interacting with a large touch screen panel that may receive capacitive signals from the user's entire body. In certain embodiments, the multi-view display system may use the received capacitive signals to determine the characteristics of the user. For example, the multi-view display system may determine whether the user is a child or an adult based on height detection using capacitive signals received from the user's body. The multi-view display system may determine whether the user is right-handed or left-handed, for example, by determining the user's body position and the touch angle associated with the user's touch. For example, if the user's touch produces Figure 4AIf the heat map shown in the multi-view display is determined to be to the left of the capacitive signal associated with the user's body, the system can determine that the touch occurred with the user's left hand. The multi-view display system can modify any displayed content based on the determined characteristics. For example, if the multi-view display system detects that a child is viewing the multi-view display, the multi-view display system can customize content suitable for children.

[0057] The present disclosure contemplates that a multi-view display system can take any suitable form in which the techniques disclosed herein for associating a particular user touch or user interaction (e.g., proximity) with a particular view can be applied. For example, a multi-view display can be part of or placed on a horizontal surface (e.g., a table). For example, a multi-view display can display a board game, and four different views can be displayed, one for each side of a typical board used in a board game. Using the techniques described herein, each player's touch or hover interaction can be associated with the player's content. For example, a particular user's touch can perform a function associated with the particular user's turn, or additionally or alternatively, the content of a view associated only with the user can be displayed. As another example, a multi-view display can be a large surface, such as a display the size of a whiteboard mounted on a wall. A multi-view display can provide multiple views to different users. The number of views can scale with the size of the display, and as described herein, the granularity required to determine a particular touch with a particular view can depend on the number of views.

[0058] Fig. 9 An example computer system 900 is shown. In certain embodiments, one or more computer systems 900 perform one or more steps of one or more methods described or shown herein. In certain embodiments, one or more computer systems 900 provide functionality described or shown herein. In certain embodiments, software running on one or more computer systems 900 performs one or more steps of one or more methods described or shown herein, or provides functionality described or shown herein. Certain embodiments include one or more portions of one or more computer systems 900. Here, references to computer systems may include computing devices, and vice versa, where appropriate. Furthermore, references to computer systems may include one or more computer systems, where appropriate.

[0059] The present disclosure contemplates any suitable number of computer systems 900. The present disclosure contemplates that the computer system 900 takes any suitable physical form. By way of example and not limitation, the computer system 900 may be an embedded computer system, a system on a chip (SOC), a single board computer system (SBC) (e.g., a computer on a module (COM) or a system on a module (SOM)), a desktop computer system, a laptop or notebook computer system, an interactive information kiosk, a mainframe, a computer system grid, a mobile phone, a personal digital assistant (PDA), a server, a tablet computer system, an augmented / virtual reality device, or a combination of two or more of these. Where appropriate, the computer system 900 may include one or more computer systems 900; unified or distributed; across multiple locations; across multiple machines; across multiple data centers; or reside in a cloud, which may include one or more cloud components in one or more networks. Where appropriate, one or more computer systems 900 may perform one or more steps of one or more methods described or illustrated herein without substantial spatial or temporal limitations. By way of example and not limitation, one or more computer systems 900 may perform one or more steps of one or more methods described or illustrated herein in real time or in batch mode. One or more computer systems 900 may perform, at different times or different locations, one or more steps of one or more methods described or illustrated herein, where appropriate.

[0060] In a particular embodiment, computer system 900 includes processor 902, memory 904, storage 906, input / output (I / O) interface 908, communication interface 910, and bus 912. Although this disclosure describes and illustrates a particular computer system having particular numbers of particular components in a particular arrangement, this disclosure contemplates any suitable computer system having any suitable numbers of any suitable components in any suitable arrangement.

[0061] In a particular embodiment, the processor 902 includes hardware for executing instructions, such as instructions that constitute a computer program. By way of example and not limitation, to execute instructions, the processor 902 may retrieve (or fetch) instructions from an internal register, an internal cache, memory 904, or storage 906; decode and execute them; and then write one or more results to an internal register, an internal cache, memory 904, or storage 906. In a particular embodiment, the processor 902 may include one or more internal caches for data, instructions, or addresses. The present disclosure contemplates that the processor 902 includes any suitable number of any suitable internal caches, where appropriate. By way of example and not limitation, the processor 902 may include one or more instruction caches, one or more data caches, and one or more translation lookaside buffers (TLBs). The instructions in the instruction cache may be copies of instructions in the memory 904 or storage 906, and the instruction cache may speed up the retrieval of those instructions by the processor 902. The data in the data cache may be a copy of the data in the memory 904 or storage 906 for operation by instructions executed on the processor 902; the result of a previous instruction executed at the processor 902 for access or writing to the memory 904 or storage 906 by subsequent instructions executed at the processor 902; or other suitable data. The data cache may speed up the read or write operation of the processor 902. The TLB may speed up the virtual address translation of the processor 902. In a particular embodiment, the processor 902 may include one or more internal registers for data, instructions, or addresses. The present disclosure contemplates that the processor 902 may include any suitable number of any suitable internal registers, where appropriate. Where appropriate, the processor 902 may include one or more arithmetic logic units; be a multi-core processor; or include one or more processors 902 (ALUs). Although the present disclosure describes and illustrates a particular processor, the present disclosure contemplates any suitable processor.

[0062] In certain embodiments, the memory 904 includes main memory for storing instructions for execution by the processor 902 or data for operation by the processor 902. By way of example and not limitation, the computer system 900 may load instructions from the memory 906 or another source (e.g., another computer system 900) to the memory 904. The processor 902 may then load the instructions from the memory 904 to an internal register or an internal cache. To execute the instructions, the processor 902 may retrieve the instructions from the internal register or the internal cache and decode them. During or after the execution of the instructions, the processor 902 may write one or more results (which may be intermediate or final results) to the internal register or the internal cache. The processor 902 may then write one or more of these results to the memory 904. In certain embodiments, the processor 902 executes only instructions in one or more internal registers or internal caches or memory 904 (as opposed to memory 906 or elsewhere), and operates only on data in one or more internal registers or internal caches or memory 904 (as opposed to memory 906 or elsewhere). One or more memory buses (each of which may include an address bus and a data bus) may couple the processor 902 to the memory 904. The bus 912 may include one or more memory buses, as described below. In a particular embodiment, one or more memory management units (MMUs) reside between the processor 902 and the memory 904 and facilitate access to the memory 904 requested by the processor 902. In a particular embodiment, the memory 904 includes a random access memory (RAM). Where appropriate, the RAM may be a volatile memory. Where appropriate, the RAM may be a dynamic RAM (DRAM) or a static RAM (SRAM). In addition, where appropriate, the RAM may be a single-port or multi-port RAM. The present disclosure contemplates any suitable RAM. Where appropriate, the memory 904 may include one or more memories 904. Although the present disclosure describes and illustrates specific memories, the present disclosure contemplates any suitable memory.

[0063] In a particular embodiment, the memory 906 includes a large capacity storage for data or instructions. As an example and not limitation, the memory 906 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a tape, or a universal serial bus (USB) drive, or a combination of two or more of these drives. Where appropriate, the storage 906 may include a removable or non-removable (or fixed) medium. Where appropriate, the memory 906 may be inside or outside the computer system 900. In a particular embodiment, the memory 906 is a non-volatile solid-state memory. In a particular embodiment, the memory 906 includes a read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically alterable ROM (EAROM) or a flash memory or a combination of two or more of these. The present disclosure contemplates that the large capacity storage 906 takes any suitable physical form. Where appropriate, the memory 906 may include one or more storage control units that facilitate communication between the processor 902 and the memory 906. Where appropriate, the memory 906 may include one or more memories 906. Although this disclosure describes and illustrates particular storage, this disclosure contemplates any suitable storage.

[0064] In a particular embodiment, the I / O interface 908 includes hardware, software, or both, providing one or more interfaces for communication between the computer system 900 and one or more I / O devices. Where appropriate, the computer system 900 may include one or more of these I / O devices. One or more of these I / O devices can enable communication between a person and the computer system 900. As an example and not limitation, the I / O device may include a keyboard, a keypad, a microphone, a monitor, a mouse, a printer, a scanner, a speaker, a still camera, a stylus, a tablet computer, a touch screen, a trackball, a camera, another suitable I / O device, or a combination of two or more of these devices. The I / O device may include one or more sensors. The present disclosure contemplates any suitable I / O device and any suitable I / O interface 908 for them. Where appropriate, the I / O interface 908 may include one or more device or software drivers so that the processor 902 can drive one or more of these I / O devices. Where appropriate, the I / O interface 908 may include one or more I / O interfaces 908. Although the present disclosure describes and illustrates a specific I / O interface, the present disclosure contemplates any suitable I / O interface.

[0065] In a particular embodiment, the communication interface 910 includes hardware, software, or both, providing one or more interfaces for communication (e.g., packet-based communication) between the computer system 900 and one or more other computer systems 900 or one or more networks. By way of example and not limitation, the communication interface 910 may include a network interface controller (NIC) or network adapter for communicating with an Ethernet or other wired network, or a wireless NIC (WNIC) or wireless adapter for communicating with a wireless network (e.g., a WI-FI network). The present disclosure contemplates any suitable network and any suitable communication interface 910 thereof. By way of example and not limitation, the computer system 900 may communicate with one or more parts of a self-organizing network, a personal area network (PAN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), or the Internet, or a combination of two or more of these. One or more parts of one or more of these networks may be wired or wireless. By way of example, the computer system 900 may communicate with a wireless PAN (WPAN) (e.g., a Bluetooth WPAN), a WI-FI network, a WI-MAX network, a cellular phone network (e.g., a global system for mobile communications (GSM) network), or other suitable wireless network, or a combination of two or more of these networks. Computer system 900 may include any suitable communication interface 910 for any of these networks, where appropriate. Communication interface 910 may include one or more communication interfaces 910, where appropriate. Although this disclosure describes and illustrates particular communication interfaces, this disclosure contemplates any suitable communication interfaces.

[0066] In certain embodiments, bus 912 includes hardware, software, or both that couples components of computer system 900 to each other. By way of example and not limitation, bus 912 may include an accelerated graphics port (AGP) or other graphics bus, an enhanced industry standard architecture (EISA) bus, a front side bus (FSB), a hypertransport (HT) interconnect, an industry standard architecture (ISA) bus, an INFINIBAND interconnect, a low pin count (LPC) bus, a memory bus, a micro channel architecture (MCA) bus, a peripheral component interconnect (PCI) bus, a PCI-Express (PCIe) bus, a serial advanced technology attachment (SATA) bus, a video electronics standard association local (VLB) bus, or another suitable bus, or a combination of two or more thereof. Where appropriate, bus 912 may include one or more buses 912. Although the present disclosure describes and illustrates a particular bus, the present disclosure contemplates any suitable bus or interconnect.

[0067] Here, the computer-readable non-transitory storage medium or media may include one or more semiconductor-based or other integrated circuits (ICs) (e.g., field programmable gate arrays (FPGAs) or application-specific ICs (ASICs)), hard disk drives (HDDs), hybrid hard disk drives (HHDs), optical disks, optical disk drives (ODDs), magneto-optical disks, magneto-optical disk drives, floppy disks, floppy disk drives (FDDs), magnetic tapes, solid-state drives (SSDs), RAM drives, secure digital cards or drives, any other suitable computer-readable non-transitory storage mediums, or any suitable combination of two or more of these. Where appropriate, the computer-readable non-transitory storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile.

[0068] Here, "or" is inclusive and not exclusive, unless expressly stated otherwise or the context indicates otherwise. Thus, herein, "A or B" means "A, B, or both," unless expressly stated otherwise or the context indicates otherwise. Furthermore, "and" is both conjunctive and plural, unless expressly stated otherwise or the context indicates otherwise. Thus, herein, "A and B" means "A and B, jointly or severally," unless expressly stated otherwise or the context indicates otherwise.

[0069] As used herein, “automatically” and its derivatives mean “without human intervention” unless expressly stated otherwise or the context indicates otherwise.

[0070] The scope of the present disclosure includes all changes, substitutions, variations, alterations and modifications to the exemplary embodiments described or shown herein that will be understood by those of ordinary skill in the art. The scope of the present disclosure is not limited to the exemplary embodiments described or shown herein. In addition, although the present disclosure describes and illustrates various embodiments including specific components, elements, features, functions, operations or steps, any of these embodiments may include any combination or arrangement of any components, elements, features, functions, operations or steps described or shown anywhere herein, which is understandable to those of ordinary skill in the art. In addition, in the appended claims, references to devices or systems or components of devices or systems that are suitable for, arranged to, capable of, configured to, enabled to, operable to or operable to perform specific functions include the device, system, component, whether or not it or the specific function is activated, turned on or unlocked, as long as the device, system or component is so suitable for, arranged to, capable of, configured to, enabled to, operable or operable. In addition, although the present disclosure describes or illustrates specific embodiments as providing specific advantages, specific embodiments may not provide, provide some or all of these advantages.

Claims

1. A method for user identification, comprising: generating, on a multi-view display, first content to be viewed at a first angle and second content to be viewed at a second angle, wherein the first content and the second content are displayed simultaneously; receiving a first plurality of capacitive signals at a touch screen panel coupled to a multi-view display; generating, by the touch screen panel, a first touch screen panel heat map based on the received first plurality of capacitive signals; determining, based on the first touch screen panel heat map, whether the first user input corresponds to the first content or the second content; and assigning the first user input to the first content or the second content based on determining that the first user input corresponds to the first content or the second content; wherein the first plurality of capacitance signals are received within a time interval, and wherein, in response to receiving the first plurality of capacitive signals within the time interval, generating a vector corresponding to motion detected from a sequence when each of the first plurality of capacitive signals is received within the time interval; identifying the direction associated with the vector; and It is determined whether the direction corresponds to the first content or the second content.

2. The method according to claim 1, further comprising: One of the one or more capacitive signals is detected to exceed a threshold capacitive value, wherein a touch screen panel heat map is generated in response to detecting that one of the one or more capacitive signals exceeds the threshold capacitive value. 3 . The method of claim 1 , wherein the first touch screen panel heat map indicates capacitance values ​​corresponding to a plurality of locations on the touch screen panel.

4. The method according to claim 1, further comprising: generating capacitive shadows representing a first plurality of capacitive signals corresponding to a plurality of locations of the touch screen panel based on the first touch screen panel heat map; Identify the direction associated with the capacitive shadow; and It is determined whether the direction corresponds to the first content or the second content.

5. The method according to claim 4, further comprising: determining that the direction corresponds to the first content; and In response to determining that the direction corresponds to the first content, the first user input is assigned to the first content.

6. The method according to claim 1, further comprising: determining that the direction corresponds to the first content; and In response to determining that the direction corresponds to the first content, the first user input is assigned to the first content.

7. The method of claim 1 , wherein assigning the first user input to the first content or the second content comprises: identifying a location of the touch screen panel corresponding to an activatable element corresponding to the first content or the second content; and In response to assigning the first user input to the first content or the second content, an activatable element corresponding to the first content or the second content is triggered.

8. The method according to claim 1, further comprising: determining one or more characteristics of a user associated with the first plurality of capacitive signals based on a plurality of locations relative to the touch screen panel at which the first plurality of capacitive signals are received; and Display of one or more of the first content or the second content is modified based on the determined one or more characteristics.

9. The method according to claim 1, further comprising: generating a first interactive element at a location of the touch screen panel, wherein the first interactive element corresponds to first content, wherein the first user input is associated with the location of the touch screen panel; and A second interactive element is generated at the location of the touch screen panel, wherein the second interactive element corresponds to second content, wherein the first user input triggers the first interactive element or the second interactive element based on an assignment of the first user input.

10. The method according to claim 1, further comprising: receiving a second plurality of capacitive signals; generating a second touch screen panel heat map based on the received second plurality of capacitive signals; and Based on the second touch screen panel heat map, it is determined whether the second user input corresponds to the first content or the second content.

11. The method according to claim 1, further comprising: A content package including the first content and the second content is generated.

12. A device for user identification, comprising: Multi-view display; a touch screen panel coupled to the multi-view display; and One or more storage media embodying instructions, and one or more processors operable to execute the instructions to: generating, on a multi-view display, first content to be viewed at a first angle and second content to be viewed at a second angle, wherein the first content and the second content are displayed simultaneously; receiving a first plurality of capacitive signals at the touch screen panel; generating, by the touch screen panel, a first touch screen panel heat map based on the received first plurality of capacitive signals; determining, based on the first touch screen panel heat map, whether the first user input corresponds to the first content or the second content; and assigning the first user input to the first content or the second content based on determining that the first user input corresponds to the first content or the second content; wherein the first plurality of capacitance signals are received within a time interval, and wherein, in response to receiving the first plurality of capacitive signals within the time interval, generating a vector corresponding to motion detected from a sequence when each of the first plurality of capacitive signals is received within the time interval; identifying the direction associated with the vector; and It is determined whether the direction corresponds to the first content or the second content.

13. One or more computer-readable storage media embedded with instructions, which, when executed by one or more processors, cause the one or more processors to perform the method of one of claims 1 to 11.

Images