Touchscreen monitor alignment
By integrating the digitizer control module and processor in the computing device, the relative position of the touch display is automatically calculated and transmitted, and the problem of difficulty in coordination between multiple touch displays is solved, improving operational efficiency and accuracy.
Patent Information
- Application Number
- CN201980065890.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-10-03
- Filing Date
- 2019-09-17
- Publication Date
- 2025-02-18
- Estimated Expiration
- 2039-09-17
AI Technical Summary
In scenarios where multiple touch monitors are used simultaneously, it is difficult to coordinate and automatically configure the relative position of the monitor, resulting in users needing to manually adjust the operating system settings, which is time-consuming and error-prone.
By integrating the digitizer control module and processor in the computing device, monitoring the signals received by the receiving electrodes, detecting and calculating the relative position of the second touch display, the multiple touch displays are automatically regarded as a combined display.
Automatically calculate and transmit the relative position of the touch monitor, simplifying user operations, reducing the error rate and time-consuming of manual configuration, and improving the efficiency of multi-display coordination.
Smart Images

Figure CN112840291B_ABST
Abstract
Description
[0001] background
[0002] Touch displays are increasingly being used in scenarios where there is more than one touch display being used simultaneously for a shared task. In such scenarios, it may be difficult to coordinate the multiple touch displays. Typically, manual configuration of a touch display is accomplished, such as by having a user or operator configure settings in an operating system of a host computing device that controls the touch display. However, it is typically difficult, time-consuming, and error-prone for an end user to manually adjust operating system settings, especially when the end user is a novice who is not familiar with operating system settings.
[0003] The embodiments described below are not limited to implementations that solve any or all of the shortcomings of known touch displays.
[0004] Overview
[0005] A brief summary of the disclosure is presented below to provide the reader with a basic understanding. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Its sole purpose is to present a selection of the concepts disclosed herein in a simplified form as a prelude to a more detailed description that is presented later.
[0006] In various examples, there is a computing device with a first touch display having a digitizer panel including at least a plurality of receiving electrodes. The computing device has a digitizer control module configured to monitor signals received by the receiving electrodes and detect signals from a second touch display of a second computing device physically close to the computing device in the monitored signals. The digitizer control module is configured to determine one or more locations on the first touch display at which the signal from the second touch display is received. A processor in the computing device is configured to calculate a relative position of the second touch display relative to the first touch display based on the determined positions, and use the calculated relative position to treat the first touch display and the second touch display as a combined display.
[0007] Many of the accompanying features will become more readily appreciated as the same become better understood by reference to the following detailed description considered in conjunction with the accompanying drawings.
[0008] Description of the drawings
[0009] The present specification will be better understood from the following detailed description when read in conjunction with the accompanying drawings, in which:
[0010] Figure 1 is a schematic diagram of a pair of wall-mounted touch display video conferencing devices used in a conference room;
[0011] Figure 2 is a schematic diagram of three wall-mounted touch display video conferencing devices;
[0012] Figure 3 is a schematic diagram of a rectangular touch display video conferencing device rotatably mounted on a stand and being transformed from a portrait orientation to a landscape orientation;
[0013] Figure 4 is a schematic diagram of a touch display computing device;
[0014] Figure 5 is a schematic diagram of a digitizer of a touch display computing device;
[0015] Fig. 6A is a schematic diagram of four touch display computing devices arranged in a grid;
[0016] Figure 6B is a schematic diagram of three touch display computing devices arranged in a row;
[0017] Fig. 7A is a schematic diagram of two touch display computing devices that are end-to-end but slightly misaligned;
[0018] Figure 7B is a schematic diagram of a first touch display computing device in a portrait orientation and a second touch display computing device adjacent to the first touch display computing device;
[0019] Figure 8 is a flow chart of a method performed at a touch display computing device;
[0020] Fig. 9 Yes Figure 8 an optionally added flow chart of the method; and
[0021] Fig.10 is a schematic diagram of two operating modes of a touch display computing device and illustrates transitions between these modes.
[0022] The same reference numbers are used throughout the various drawings to refer to the same parts.
[0023] Detailed Description
[0024] The detailed description provided below in conjunction with the accompanying drawings is intended to be a description of an example of the present invention, and is not intended to represent the only form of constructing or using an example of the present invention. This description sets forth the functions of the example of the present invention, and the sequence of operations for constructing and operating the example of the present invention. However, the same or equivalent functions and sequences can be accomplished by different examples.
[0025] Figure 11 is a schematic diagram of two touch display computing devices 100, 102 mounted on a wall 112 of a conference room. Each computing device 100, 102 has a camera 104, but this is not required. The computing devices are in a landscape orientation and are placed end to end to form a single rectangle in the landscape orientation.
[0026] exist Figure 1 In the illustrated example, the content displayed on the two touch display computing devices 100, 102 is different. The first of the touch display computing devices 100 is displaying images of four people who are remote parties to a video conference held using the touch display computing devices 100, 102 acting as video conferencing equipment. The second of the touch display computing devices 102 is displaying images of a building designed by the people participating in the video conference. A laptop computer 106 and a tablet computer 108 used by one or more people 110 in the room are able to join the video conference. The first touch display computing device 100 and the second touch display computing device 102 are able to communicate with each other through a wired or wireless connection.
[0027] Suppose one of the people 10 in the room wants to view the content displayed on the touch display computing device 102 in more detail by extending the content from the touch display computing device 102 to two wall-mounted touch display computing devices 100, 102. It is not straightforward to achieve the expansion of content. In addition, suppose the user wants to move the mouse cursor across the displays and make the cursor continue its movement as expected when the displays are regarded as a single combined display. It is not straightforward to do so. The user needs to manually change the settings in the operating system of one or both of the wall-mounted touch display computing devices 100, 102. In order for the operating system of the touch display computing device 102 to expand its content as needed and / or operate the cursor as needed, it needs to know the position of the other touch display computing device relative to itself, so as to send the correctly rendered content to the other touch display computing device 100 for display. The user will need to manually provide relative position information, which is time-consuming, error-prone and difficult for the user. If a video conference is in progress, the user will need to interrupt the video conference in order to manually change the operating system settings and provide relative position information. Each time the user wants to expand the content or stop expanding the content, there will be an interruption to the video conference to manually adjust the settings.Techniques described herein provide functionality for automatically calculating relative position information and appropriately expanding content on two or more touch display computing devices.
[0028] Figure 2200, 202, 204, each in a portrait orientation and mounted side by side on a wall. One of the touch display computing devices has a camera 206 for video conferencing. Assume that a user 208 wants to operate the three touch display computing devices 200, 202, 204 as a single combined interactive whiteboard shared with a remote party of a video conference. The user 208 must manually configure the settings of the operating system of one of the touch display computing devices 200, 202, 204 to make it a host. The host controls the content rendered on the display of the combination formed by the three touch display computing devices. The host device has manual input information about the relative position of the touch display computing device so that the content is correctly rendered by the host and sent to the appropriate one of the touch display computing devices. The technology described herein provides functionality for automatically calculating relative position information so that the host touch display computing device can treat multiple touch displays as a combined touch display.
[0029] In the case where multiple touch display computing devices are mounted on a wall adjacent to each other, there are usually significant problems in accurately mounting the devices so that they are correctly aligned. Typically, the walls of a building are not truly vertical, and therefore there are difficulties in correctly aligning the touch display. If the computing device is not accurately aligned on a wall or other supporting surface, there are difficulties for the end user when they are used as a combined display. The displayed content does not look correct, and if the touch screen display is used as a combined whiteboard, there may be a difference between what the user expects and what is actually caused, such as the movement of the mouse between the displays. This is improved by the correct alignment of the display, because it allows the mouse cursor to move accurately between the displays and continue its movement as expected. Typically, during the installation of the touch display computing device, the inaccuracy of the alignment is not easily visible to the human eye, and due to the limitations of manual dexterity, it may be difficult to use a level and other equipment.
[0030] Figure 3 It is shown how in some cases a touch display computing device can be rotatably mounted, such as on a stand or wall. The rotatable mounting gives versatility because a portrait orientation or a landscape orientation of a rectangular touch display computing device can be moved between and orientations between portrait and landscape are possible. In the case where multiple touch display computing devices are used together, the problem of how to detect the relative position of the touch display computing devices is complicated if one or more of the touch display computing devices are rotatably mounted.
[0031] Figure 44 is a schematic diagram of a master device 400 that hosts a digitizer 418 and a digitizer control module 404. The master device 400 is a touch display computing device with an optional camera 402. The digitizer 418 and the digitizer control module 404 together form a digitizer device. The master device 420 may be a smart phone, a tablet computer, a wall-mountable video conferencing device, or any other type of master device having a digitizer 418, wherein multiple master devices are adapted to be used adjacent to each other to create a combined display from the displays of the individual master devices.
[0032] The main device has at least one processor 406, memory 408, communication interface 416 (such as a radio communication transceiver), a network card, or any other communication interface for realizing wired or wireless communication with other computing entities. The main device has an input / output interface 412, for controlling the output from the main device and for controlling the input received at the main device 420. The main device 420 has a display 460, which includes a display panel 414, which is located in front of or behind a digitizer 418, such as in a conventional smart phone or tablet computer. Bus 410 connects various components of the main device 420, such as a digitizer control module 404, a processor 406, a memory 408, an input / output interface 412, a display 460, and a communication interface 416.
[0033] The digitizer 418 includes a first array of electrodes arranged substantially parallel to each other and a second array of electrodes arranged substantially parallel to each other. In some implementations, the electrodes in the first array are row electrodes positioned substantially perpendicular to the electrodes (column electrodes) in the second array to form a grid or matrix, such as Figure 5 Although row electrodes may be referred to as transmitting electrodes and column electrodes may be referred to as receiving electrodes, these designations may be reversed and the meaning remains unchanged. However, it is not necessary to arrange the electrodes in a grid. In some cases, the row electrodes intersect each column electrode at a non-perpendicular angle, thereby forming a sensor having a parallelogram form. In some cases, the electrodes form a more complex pattern in which no two rows or columns need be parallel or arranged along a straight line. In some cases, the electrodes are formed as pads rather than elongated electrodes.
[0034] In the case where the sensor panel is used in front of or inside a display (such as a liquid crystal display), the digitizer 418 is substantially transparent to visible wavelengths of light. Specifically, the electrodes in the digitizer are made of a transparent conductive material (e.g., indium tin oxide), or alternatively, made of an opaque material, but its trace is so small that it is difficult to detect. The digitizer 418 is used to measure the capacitance from each row electrode to each column electrode in order to measure the position of an input medium (such as a finger or stylus 422).
[0035] Figure 5 The digitizer 514 is shown in more detail in the case where the electrodes of the digitizer are arranged in a grid to form a grid-based capacitive sensor. The stylus 422 transmits electromagnetic signals that are detected by the capacitive sensor. The touch of one or more fingers 510 or other conductive objects can also be detected by the capacitive sensor. The stylus 422 transmits one or more signal bursts and / or pulses transmitted at a defined repetition rate. In some examples, the control module 404 of the digitizer manages a synchronization signal that is used to synchronize the signal bursts emitted by the stylus 422 with a sampling window for sampling the output from the digitizer 514. Optionally, one or more signal bursts and / or pulses are transmitted by the stylus 422, and the one or more signal bursts and / or pulses include information about the operation of the stylus 422 and / or the pressure applied to the stylus's tip 502. The signal bursts transmitted by the stylus 422 are picked up by one or more electrodes in the digitizer 514 on both the horizontal and vertical axes of the grid. In some examples, the information is decoded by the digitizer circuit system in the control module 404. The position of the stylus tip is calculated by the control module 404 and sent to the host device 400 .
[0036] Optionally, mutual capacitance detection methods and / or self-capacitance detection methods are applied on the digitizer 514 for sensing interactions with the fingertips 510. The digitizer control module 404 sends a trigger pulse and / or interrogation signal to one or more transmitting electrodes 504 of the digitizer, and samples the output from the receiving electrodes 512 in response to the trigger and / or interrogation. In some embodiments, some or all of the electrodes 504 along one axis of the grid are interrogated simultaneously or in a sequential manner, and in response to each interrogation, the output from the electrodes 512 on the other axes is sampled. This scanning procedure can be used to obtain an output associated with each junction point 506 of the grid. The output from each junction point of the grid can be used to simultaneously (multi-touch) detect one or more conductive objects (such as fingertips) touching the digitizer and / or hovering over the digitizer. In some examples, the digitizer control module 404 alternates between scanning the digitizer 514 to detect one or more fingertips and sampling the output on both the horizontal and vertical electrodes to locate the signal transmitted by the stylus 422.
[0037] Stylus 422 has a tip transmitter located in its tip 502, and the digitizer is able to detect the position of the stylus tip relative to the digitizer grid by detecting signals transmitted by the tip transmitter.
[0038] In various examples described herein, the digitizer control module 404 is configured to drive one or more transmit electrodes to transmit an alignment signal for use in aligning the touch display computing device with one or more other touch display computing devices. In some examples, the alignment signal includes an identifier of the touch display computing device.
[0039] The digitizer control module 404 alternates between transmitting the alignment signal and at least:
[0040] scanning digitizer 514 to detect one or more fingertips;
[0041] sampling the output on both horizontal and vertical electrodes to locate the signal transmitted by stylus 422; and
[0042] The output is sampled on both horizontal and vertical electrodes to locate alignment signals received from other touch display computing devices.
[0043] Fig. 6A is a schematic diagram of four touch display computing devices 600, 602, 604, 606 supported on a flat surface and placed in a grid arrangement. The touch display computing devices are the same size and shape as each other and are rectangular. The touch display computing devices are adjacent to each other so as to form a rectangle that is larger than each individual touch display computing device. The touch display computing devices are arranged in a grid arrangement. Fig. 6A The touch display computing devices 600 communicate with each other via wired or wireless links that are not visible in the display because, in the case of a wired connection, these are located on the back of the touch display computing device. One of the touch display computing devices 600 is a host that controls a combined display formed by the collection of four touch displays of the four touch display computing devices 600, 602, 604, 606. In order to establish one of the touch display computing devices 600 as a host, an operator configures the settings when installing the touch display computing device. Alternatively, the touch display computing devices communicate among themselves and randomly assign one of the touch display computing devices as a host. A touch display computing device that is not a host is referred to as a worker in this article.
[0044] Each of the touch display computing devices has a digitizer as part of its touch display. Figure 8Described in more detail, the host touch display computing device monitors the receiving electrodes of its digitizer to detect signals transmitted by the transmitting electrodes of other touch display computing devices. Each machine uses one or more transmitting electrodes of its digitizer to transmit an identifier signal that identifies the specific machine transmitting the signal. In some examples, all transmitting electrodes of a given machine are used to transmit the identifier signal. In other examples, the transmitting electrodes used to transmit the identifier signal are selected to be at the end of the specific machine involved. That is, in some cases, electrodes at the edge of the touch display of a specific machine are used to transmit the identifier signal.
[0045] The host touch display computing device detects the transmitted identifier signal of the machine device and calculates the position on the host touch display computing device where the specific identifier signal is detected. Using the calculated position associated with the identifier, the host computing device calculates the relative position of the machine touch display computing device.
[0046] exist Fig. 6A In the example of FIG. 6 , the host touch display computing device 600 receives the identifier signal 610 from the worker touch display computing device 602 and is able to infer that the worker touch display computing device 602 is on its left hand side.
[0047] The host touch display computing device receives the identifier signal 614 from the worker touch display computing device 604 and is able to infer that the worker touch display computing device 604 is beneath it.
[0048] The host touch display computing device receives the identifier signal 612 from the touch display computing device 606 and is able to infer that the worker touch display computing device 606 is diagonally opposite in the grid because it already knows the positions of the worker touch display computing devices 602 and 604 .
[0049] The host touch display computing device 600 may optionally not transmit the identifier signal, as it is not necessary and power may be saved by not transmitting it.
[0050] Once the host touch display computing device 600 has calculated the relative position of the worker touch display computing device, it can treat its own display and the worker's display as a combined display. It does this by rendering content appropriate for each display and sending the rendered content to the worker touch display computing device for display at those devices.
[0051] In some examples, the host touch display computing device 600 has optional additional information for calculating the relative position of the industrial machine display computing device. The optional additional information includes one or more of the following: the size and shape of the host touch display computing device, the size and shape of the industrial machine touch display computing device, the signal strength of the received identifier signal, and the knowledge that the transmitting electrode for transmitting the identifier signal is located at the edge of the industrial machine touch display computing device. As more types of optional additional information are used, the accuracy of the calculated relative position increases. Since the resolution of the transmitting electrode and the receiving electrode of the digitizer of the touch display computing device is on the order of a few millimeters in many cases, it is possible to calculate the relative position information to a fine scale. The identifier signal transmitted by the industrial machine touch display computing device is configured to reduce interference, such as by using frequency multiplexing or time multiplexing.
[0052] exist Figure 6B In the example of , initially there is no host. Here, there are three touch display computing devices 620, 622, 624 arranged in a row and connected using wired or wireless means. Device 620 transmits its identifier signal 628 to device 622 and receives identifier signal 626 from device 622. Device 622 transmits its identifier signal 626 to device 624 and receives identifier signal 630 from device 624. Device 620 is able to calculate the relative position of device 622 relative to itself. Device 622 is able to calculate the relative position of device 620 and device 624 relative to itself. Device 624 is able to calculate the relative position of device 622 relative to itself.
[0053] As a result, device 622 is able to become the host and view the displays of devices 620 and 624 together with its own display as a single combined display. Another option is for device 620 to become the host and view its own display and the display of device 622 as a single combined display. Another option is for device 624 to become the host and view its own display and the display of device 622 as a single combined display.
[0054] Fig. 7A is an example of two rectangular touch display computing devices mounted on a planar support surface and offset. As indicated by the arrows, the transmitted identifier signal is in accordance with the above for Fig. 6AAs a result of being transmitted and received in the same manner as described, each device is aware of the other device. The size and shape of the computing devices are available, and if it is known that only the transmitting electrodes at the edge of the digitizer are being used, the misalignment is inferred by one or both of the computing devices. Feedback about the misalignment is given to the user, such as auditory feedback or visual feedback displayed on a touch display. The feedback encourages the user to move the device into alignment during the installation process, and because the feedback is given iteratively, the user is able to find the correct alignment by trial and error without the need for levels and other manual measuring equipment.
[0055] Figure 7B There is a scenario where there are two touch display computing devices 704, 706, one of which is fixed in a portrait orientation and one of which is rotatably mounted and initially in a landscape orientation, as indicated at 710. The rotatable touch display computing device 706 is rotated into a portrait orientation, as indicated by dashed line 708. The fixed touch display computing device 704 is able to detect the orientation of the rotatably mounted computing device 706 using an identifier signal transmitted by a transmitting electrode at the edge of the digitizer of the rotatably mounted computing device and by knowing the size and shape of the rotatably mounted computing device. The fixed touch display computing device 704 acts as a host and is able to treat its own display and the display of the rotatably mounted computing device as a single combined display, such as a single interactive whiteboard, or by extending the content displayed on its own display to the display of the touch display computing device 706 as well as its own display according to the detected orientation and relative position.
[0056] Figure 8 In such Figures 4 to 7B 800 . The digitizer control module of the touch display computing device monitors 800 for signals received at the receiving electrodes of the digitizer of the touch display. If the digitizer control module detects 802 an alignment signal from another touch display computing device, it proceeds to determination operation 804. If no alignment signal is detected, the digitizer control module continues to monitor 800 .
[0057] Determining operation 804 includes determining a location on the touch display where an alignment signal is received from one or more other touch display computing devices.
[0058] A processor in the touch display computing device calculates the relative position of each of the other touch display computing devices relative to the touch display computing device. To calculate the relative position, the processor uses at least the determined position of the received alignment signal from each of the respective other touch display computing devices. Optional additional types of information used to calculate the relative position are one or more of the following: the size and shape of one or more touch display computing devices, the signal strength of the received alignment signal, and knowledge of the position of the transmitting electrode used to transmit the alignment signal in the other touch display computing device.
[0059] The processor checks 812 whether it is the host of the multiple touch display computing device by checking a setting in the operating system or by checking user input. If the processor is the host, it instructs the renderer at the touch display computing device to expand 810 the content displayed at the touch display computing device so that it is expanded on one or more other touch display computing devices other than the touch display computing device itself. Alternatively or additionally, the processor uses its knowledge of the relative positions of the other touch display computing devices to treat the multiple touch displays as a combined touch display.
[0060] If the processor is not the host at check 812, the processor sends 814 the relative position information to the one of the other touch display computing devices that is the host. The host receives the relative position information and uses it to treat the multiple touch displays as a combined display.
[0061] In the case where the processor is not the host, it instructs the digitizer control module to drive the transmit electrode to transmit 816 the alignment signal.
[0062] In some but not all embodiments, Figure 8 The method is suitable for combining Fig. 9 Immediately after operation 806 (which is the operation of calculating the relative position), Fig. 9 Operation Insert Figure 8 in the method.
[0063] The processor of the touch display computing device calculates 900 the target relative position using one or more of: rules for specifying target positions applicable in the context of a range of values for the relative position, user input, operating system settings, knowledge of the sizes and shapes of multiple touch display computing devices. The target relative position is a desired relative position of the touch display computing device, such as in Figure 6B In the case of vertical alignment in a row, Fig. 6A In the case of Figure 2 In the case of being arranged in a row, etc. The processor compares 902 the relative position of the target with the Figure 8If there is no difference, or the difference is below a threshold, the process returns to Figure 8 Operation 810. If the difference is above the threshold, feedback (such as auditory feedback and / or visual feedback) is output 904 to the user. The feedback indicates to the user the presence and / or magnitude of the difference. In some cases, the feedback indicates to the user in which direction to move one or more touch display computing devices. Repeat Fig. 9 The process enables the user to adjust the physical position of the touch display computing device and reach the desired target relative position through trial and error.
[0064] In another embodiment, when entering alignment mode, the first touch display computing device in the touch display computing device displays alignment points at multiple specified points on its touch display. The multiple specified points are located at two or more corners of the touch display or spaced apart along the same edge of the touch display. The user uses an object such as a pen or finger to swipe from the displayed alignment point to the second touch display computing device adjacent to the first touch display computing device. The displayed alignment point (which is the starting point) is known. The second touch display computing device detects the entry point of the swipe into the second touch display. The starting point and the entry point are considered as adjacent points. Repeat the process for the second displayed alignment point. Together with the knowledge of the size and shape of the first touch display and the second touch display, the relative position of the first touch display and the second touch display can then be calculated.
[0065] In some but not all examples, the touch display computing device processor and digitizer control module are operable in two modes: standard touch mode 1000 and alignment mode 1002. The processor and digitizer control module operate only in the same mode at any time, and only in a single mode at any time. When the processor and digitizer control module are in standard touch mode 1000, the touch display operates as a standard touch display by detecting multi-touch and hover inputs from a user and / or a stylus. In standard touch mode 1000, the touch display computing device does not send alignment signals. In alignment mode 1002, the processor and digitizer control module are operable to drive the transmitting electrode to transmit alignment signals at appropriate times outside of the standard touch mode operation of the digitizer.
[0066] The processor and digitizer control module transition between modes 1000, 1002 based on one or more of the following criteria: user input, power on of the computing device, a change in detection of one or more other computing devices that are physically proximate to the computing device. Physical proximity refers to where computing devices are able to detect each other using one or more of the following: near field communication, capacitive detection, wireless detection, or other methods (such as where the computing devices are located in the same room).
[0067] Alternatively or additionally, reference Figures 8 to 10 The described functionality is performed at least in part by one or more hardware logic components. As an example and not limitation, illustrative types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), complex programmable logic devices (CPLDs), and graphics processing units (GPUs).
[0068] As an alternative or in addition to other examples described herein, some examples include any combination of the following:
[0069] Clause 1. A computing device comprising:
[0070] a first touch display having a digitizer panel including at least a plurality of receiving electrodes;
[0071] a digitizer control module configured to monitor signals received by the receiving electrodes and detect in the monitored signals a signal from a second touch display of a second computing device physically proximate to the computing device;
[0072] The digitizer control module is configured to determine one or more locations on the first touch display at which the signal from the second touch display is received;
[0073] A processor is configured to calculate a relative position of the second touch display with respect to the first touch display based on the determined position, and to use the calculated relative position to treat the first touch display and the second touch display as a combined display.
[0074] In the present technology, the digitizer control module 404 and processor 406 of the present disclosure operate in an "unconventional way" to achieve the ability to calculate the relative position of the second touch display with respect to the first touch display in an accurate and practical manner.
[0075] The digitizer control module 404 and processor 406 improve the operation of the underlying computing device by calculating the relative position of the second touch display with respect to the first touch display based on both the determined position and signal strength and using the calculated relative position to treat the first touch display and the second touch display as a combined display.
[0076] Clause 2. The computing device of clause 1, wherein the digitizer control module is configured to measure a strength of a signal from the second touch display, and the processor is configured to calculate a relative position of the second touch display with respect to the first touch display based on both the determined position and the signal strength.
[0077] Clause 3. The computing device of clause 1 or 2, wherein the processor is configured to calculate an orientation of the second touch display relative to the first touch display using specified information about a size and shape of the first touch display and a size and shape of the second touch display.
[0078] Clause 4. The computing device of any preceding clause, wherein the processor is configured to obtain the specified information about the size and shape of the second touch display by obtaining an identifier of the second touch display from the monitored signal and looking up the size and shape of the second touch display in a storage that maintains an association between the identifier and the size and shape of the touch display.
[0079] Clause 5. The computing device of any preceding clause, wherein the digitizer panel of the first touch display has a plurality of transmit electrodes, and wherein the digitizer control module is configured to drive the transmit electrodes to transmit signals including an identifier of the first touch display.
[0080] Clause 6. The computing device of any preceding clause, wherein the digitizer control module is configured to detect, among the monitored signals, a signal from a third touch display of a third computing device that is physically proximate to the computing device;
[0081] the digitizer control module being configured to identify, from the monitored signals, a signal from the third touch display and determine one or more locations on the first touch display at which the signal from the third touch display was received;
[0082] And wherein the processor is configured to calculate a relative position of the third touch display with respect to the first touch display and the second touch display based on the determined position.
[0083] Clause 7. The computing device of any preceding clause, wherein the digitizer control module operates in a standard touch mode or an alignment mode; and wherein the processor is configured to instruct the digitizer control module to move from the standard touch mode to the alignment mode based on one or more of: user input, powering on of the computing device, a change in detection of one or more other computing devices that are physically proximate to the computing device.
[0084] Clause 8. The computing device of any preceding clause, wherein the processor is configured to compare the calculated relative position to the specified relative position and to provide feedback to a user of the computing device based on the comparison.
[0085] Clause 9. The computing device of any preceding clause, the computing device being a wall mounted video conferencing device, and wherein the second computing device is a second wall mounted video conferencing device.
[0086] Clause 10. The computing device of any preceding clause, the computing device being a rectangular planar computing device including a rotatable mounting structure that enables the computing device to be rotated from a portrait orientation to a landscape orientation.
[0087] Clause 11. A method performed by a computing device, comprising:
[0088] monitoring signals received by receive electrodes in a digitizer panel of a touch display of a computing device;
[0089] detecting in the monitored signals a signal from a second touch display of a second computing device physically proximate to the computing device;
[0090] determining one or more locations on the first touch display at which the signal from the second touch display is received;
[0091] calculating a relative position of the second touch display with respect to the first touch display based on the determined position;
[0092] The calculated relative positions are used to treat the first touch display and the second touch display as a combined touch display.
[0093] Clause 12. The method of clause 11, comprising: measuring a strength of a signal from the second touch display, and calculating a relative position of the second touch display with respect to the first touch display based on both the determined position and the signal strength.
[0094] Clause 13. The method of clause 11 or clause 12, comprising: using specified information about the size and shape of the first touch display and the size and shape of the second touch display to calculate an orientation of the second touch display relative to the first touch display.
[0095] Clause 14. The method of any preceding clause 11 to 13, comprising obtaining specified information about the size and shape of the second touch display by obtaining an identifier of the second touch display from the monitored signal and looking up the size and shape of the second touch display in a storage maintaining an association between the identifier and the size and shape of the touch display.
[0096] Clause 15. The method of any preceding clause 11 to 14, comprising: driving a transmitting electrode of the digitizer panel to transmit a signal comprising an identifier of the first touch display.
[0097] Clause 16. The method of any preceding clause 11 to 15, comprising: instructing the digitizer control module to move from the standard touch mode to the alignment mode based on one or more of: user input, powering on the computing device, a change in detection of alignment signals from one or more other computing devices physically proximate to the computing device.
[0098] Clause 17. The method of any preceding clause 11 to 16, comprising: instructing the digitizer control module to move from the alignment mode to the standard touch mode based on one or more of: user input, lack of detection of alignment signals from other computing devices physically proximate to the computing device.
[0099] Clause 18. The method of any preceding clause 11 to 17, comprising: comparing the calculated relative position with the specified relative position, and providing feedback to a user of the computing device based on the comparison result.
[0100] Clause 19. The method of clause 17, wherein the feedback is auditory.
[0101] Clause 20. A computing device comprising:
[0102] a first touch display having a digitizer including at least a plurality of receiving electrodes;
[0103] a digitizer control module configured to monitor signals received by the receive electrodes and detect signals from a second touch display of a second computing device;
[0104] The digitizer control module is configured to determine one or more locations on the first touch display at which the signal from the second touch display is received;
[0105] A processor is configured to calculate a relative position of the second touch display with respect to the first touch display based on the determined position, and to use the calculated relative position to expand content displayed on the first touch display to both the first touch display and the second touch display.
[0106] In one example, there is a method performed by a computing device, including:
[0107] means for monitoring signals received by receive electrodes in a digitizer panel of a touch display of a computing device;
[0108] means for detecting in the monitored signals a signal from a second touch display of a second computing device physically proximate to the computing device;
[0109] means for determining one or more locations on the first touch display at which a signal from the second touch display is received and measuring the strength of the signal from the second touch display;
[0110] means for calculating a relative position of the second touch display with respect to the first touch display based on both the determined position and the signal strength;
[0111] The calculated relative positions are used to treat the first touch display and the second touch display as a combined touch display.
[0112] In one example, the means for monitoring the signal is a processor of a computing device with appropriate instructions for monitoring the signal. In one example, the means for detecting the signal from the second touch display is a processor, and the means for determining the one or more positions is also a processor. The means for calculating the relative position is a processor in the computing device.
[0113] As used herein, the term "computer" or "computing-based device" refers to any device with processing capabilities so that it can execute instructions. Those skilled in the art will recognize that such processing capabilities are incorporated into many different devices, and thus the terms "computer" and "computing-based device" each include personal computers (PCs), servers, mobile phones (including smartphones), tablet computers, set-top boxes, media players, game consoles, personal digital assistants, wearable computers, and many other devices.
[0114] In some examples, the methods described herein are performed by software in a machine-readable form on a tangible storage medium, such as in the form of a computer program including computer program code means adapted to perform all operations of one or more of the methods described herein when the program is run on a computer, and wherein the computer program may be embodied on a computer-readable medium. The software is suitable for execution on a parallel processor or a serial processor so that the method operations may be performed in any suitable order or simultaneously.
[0115] This recognizes that software is a valuable, individually exchangeable commodity. It is intended to cover software that runs on or controls "dumb" or standard hardware to perform desired functions. It is also intended to cover software that "describes" or defines the configuration of hardware to perform desired functions, such as HDL (Hardware Description Language) software used to design silicon chips, or to configure general-purpose programmable chips.
[0116] Those skilled in the art will recognize that the storage device used to store program instructions can be optionally distributed across a network. For example, a remote computer can store an example of a process described as software. A local or terminal computer can access a remote computer and download a part or all of the software to run the program. Alternatively, a local computer can download fragments of the software as needed, or execute some software instructions at a local terminal and execute other software instructions at a remote computer (or computer network). Those skilled in the art will also recognize that, by utilizing conventional techniques known to those skilled in the art, all or part of the software instructions can be executed by dedicated circuits such as digital signal processors (DSPs), programmable logic arrays, etc.
[0117] As will be apparent to one skilled in the art, any range or device value given herein may be expanded or altered without losing the effect sought.
[0118] Although the subject matter of the present invention is described in language specific to structural features and / or method actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are disclosed as example forms of implementing the claims.
[0119] It will be understood that the benefits and advantages described above may relate to one embodiment or may relate to several embodiments. The embodiments are not limited to those embodiments that solve any or all of the problems set forth or those embodiments that have any or all of the benefits and advantages set forth. It will be further understood that reference to "an" item refers to one or more of those items.
[0120] The steps of the methods described herein may be performed in any suitable order, or may be performed simultaneously where appropriate. Additionally, individual frames may be deleted from any method without departing from the scope of the subject matter described herein. Aspects of any one of the examples described above may be combined with aspects of any one of the other examples described to form further examples without losing the effects sought.
[0121] The term "comprising" is used herein to mean including the blocks or elements of the identified method, but such blocks or elements are not exclusive and the method or apparatus may contain additional blocks or elements.
[0122] It should be understood that the above description is given as an example only, and various modifications may be made by those skilled in the art. The above description, examples and data provide a comprehensive description of the structure and use of exemplary embodiments. Although various embodiments have been described above with a certain degree of particularity or with reference to one or more individual embodiments, many changes may be made to the disclosed embodiments by those skilled in the art without departing from the scope of this specification.
Claims
1. A computing device, comprising: a first touch display having a digitizer panel including at least a plurality of receiving electrodes; a digitizer control module configured to monitor signals received by the receiving electrodes and detect, in the monitored signals, a signal from a second touch display of a second computing device that is physically proximate to the computing device; the digitizer control module being configured to determine one or more locations on the first touch display at which the signal from the second touch display is received and to measure the strength of the signal from the second touch display; a processor configured to calculate a relative position of the second touch display with respect to the first touch display based on both the determined position and the strength of the signal, and to use the calculated relative position to treat the first touch display and the second touch display as a combined display; The processor is configured to compare the calculated relative position with the specified relative position and provide feedback to a user of the computing device based on the result of the comparison, the feedback indicating the existence and / or magnitude of a difference between the calculated relative position and the specified relative position.
2. The computing device of claim 1, wherein: The processor is configured to calculate an orientation of the second touch display relative to the first touch display using specified information about a size and shape of the first touch display and a size and shape of the second touch display.
3. The computing device of claim 2, wherein: The processor is configured to obtain the specified information about the size and shape of the second touch display by obtaining an identifier of the second touch display from the monitored signal and looking up the size and shape of the second touch display in a storage that maintains an association between the identifier and the size and shape of the touch display.
4. The computing device of claim 1, wherein: The digitizer panel of the first touch display has a plurality of transmit electrodes, and wherein the digitizer control module is configured to drive the transmit electrodes to transmit signals including an identifier of the first touch display.
5. The computing device of claim 1, wherein: The digitizer control module is configured to detect, among the monitored signals, a signal from a third touch display of a third computing device that is physically proximate to the computing device; The digitizer control module is configured to identify a signal from the third touch display from the monitored signals and determine one or more locations on the first touch display at which the signal from the third touch display is received; And wherein the processor is configured to calculate a relative position of the third touch display with respect to the first touch display and the second touch display based on the determined position.
6. The computing device of claim 1, wherein: The digitizer control module operates in a standard touch mode or an alignment mode; and wherein the processor is configured to instruct the digitizer control module to move from the standard touch mode to the alignment mode based on one or more of: user input, powering on the computing device, a change in detection of one or more other computing devices that are physically proximate to the computing device.
7. The computing device of claim 1, the computing device being a wall mounted video conferencing device, and wherein the second computing device is a second wall mounted video conferencing device.
8. The computing device of claim 1, the computing device being a rectangular planar computing device including a rotatable mounting structure that enables the computing device to be rotated from a portrait orientation to a landscape orientation.
9. The computing device of claim 1, wherein: The processor is configured to display a plurality of alignment marks on the first touch display and prompt a user to swipe the combined display starting at one of the alignment marks and ending on the second touch display.
10. The computing device of claim 9, wherein: The processor is configured to detect an entry point of the swipe on the second touch display and calculate a relative alignment of the first touch display and the second touch display by considering the alignment mark and the entry point to be adjacent to each other.
11. A method performed by a computing device, comprising: monitoring signals received by receive electrodes in a digitizer panel of a first touch display of the computing device; detecting in the monitored signals a signal from a second touch display of a second computing device physically proximate to the computing device; determining one or more locations on the first touch display at which the signal from the second touch display is received and measuring the strength of the signal from the second touch display; calculating a relative position of the second touch display with respect to the first touch display based on both the determined position and the strength of the signal; using the calculated relative position to treat the first touch display and the second touch display as a combined touch display; as well as The calculated relative position is compared to the specified relative position, and feedback is provided to a user of the computing device based on a result of the comparison, the feedback indicating the presence and / or magnitude of a difference between the calculated relative position and the specified relative position.
12. The method of claim 11, comprising: An orientation of the second touch display relative to the first touch display is calculated using specified information about the size and shape of the first touch display and the size and shape of the second touch display.
13. The method of claim 12, comprising: The specified information about the size and shape of the second touch display is obtained by obtaining an identifier of the second touch display from the monitored signal and looking up the size and shape of the second touch display in a storage maintaining an association between the identifier and the size and shape of the touch display.
14. The method of claim 11, comprising: A transmitting electrode of the digitizer panel is driven to transmit a signal including an identifier of the first touch display.
15. The method of claim 11, comprising: Instructing a digitizer control module of the computing device to move from a standard touch mode to an alignment mode based on one or more of: user input, powering on of the computing device, a change in detection of alignment signals from one or more other computing devices physically proximate to the computing device.
16. The method of claim 11, comprising: A digitizer control module of the computing device is instructed to move from an alignment mode to a standard touch mode based on one or more of: user input, lack of detection of alignment signals from other computing devices physically proximate to the computing device.
17. The method of claim 11, wherein: The feedback is auditory.
18. A computing device comprising: a first touch display, the first touch display having a digitizer, the digitizer comprising at least a plurality of receiving electrodes; a digitizer control module configured to monitor signals received by the receive electrodes and detect signals from a second touch display of a second computing device; the digitizer control module being configured to determine one or more locations on the first touch display at which the signal from the second touch display is received and to measure the strength of the signal; a processor configured to calculate a relative position of the second touch display with respect to the first touch display based on both the determined position and the strength of the signal, and to use the calculated relative position to extend content displayed on the first touch display to both the first touch display and the second touch display; The processor is configured to compare the calculated relative position with the specified relative position and provide feedback to a user of the computing device based on the result of the comparison, the feedback indicating the existence and / or magnitude of a difference between the calculated relative position and the specified relative position.
19. A computer-readable storage medium having instructions which, when executed, cause a computing device to perform the method of any one of claims 11-17.
Citation Information
Patent Citations
Inter-display communication
US20150338943A1
Display device unit, control device, and image display panel
US20170061930A1