Setting up multiple displays via user input
Through simplified user input methods and sensor technology, the problems of complexity and waste of resources in the existing technology of display equipment are solved, and the rapid and accurate multi-display equipment layout and configuration efficiency is improved.
Patent Information
- Application Number
- CN201980026111.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-05-25
- Filing Date
- 2019-04-02
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2039-04-02
AI Technical Summary
In the prior art, when configuring multiple display devices, users need to manually enter the physical arrangement and sequence of the display devices through a complex menu interface, resulting in cumbersome configuration process and waste of resources, and the relative position changes of the display devices cannot be detected automatically, resulting in display information. May appear on the wrong monitor.
Simplify using the Space Configurator Wizard by providing improved user input methods such as touch gestures, voice input or other user input forms, in combination with available sensors (such as touch-sensitive screens, cameras, microphones) to determine the physical arrangement and sequence of display devices, using the Space Configurator Wizard to simplify The configuration process reduces user interaction complexity and resource consumption.
The physical arrangement and sequence of multiple display devices is realized quickly and efficiently configured, reducing configuration time and resource usage, avoiding repeated configuration attempts, and improving configuration accuracy and efficiency.
Smart Images

Figure CN111989640B_ABST
Abstract
Description
Background Art
[0001] Display monitor is used in various applications, such as personal computing, advertisement, entertainment and providing public information.Many computers have display controllers, and use two or more displays, and display controller is configurable.For example, when a computer uses two displays, two video cables (for example, VGA, DisplayPort or HDMI) can be used to directly connect these two displays to the computer.Computer can use user interface, which of two displays can be placed on the left and which of two displays can be placed on the right, so that image can be correctly displayed on two displays.When using three displays, computer can use user interface, which of three displays can be placed on the left, which of three displays can be placed on the center and which of three displays can be placed on the right, so that image can be correctly displayed on three displays.
[0002] Various types of display devices, such as televisions, computer monitors, wearable displays, projectors, or any other display device, can be connected to a computer and configuration information can be set. However, configuration of multiple display devices is typically performed through a menu interface that is often complex and can be difficult for inexperienced users. In some cases, such as when the display is wall-mounted, or mounted in a manner that makes it difficult to physically access the display port, it can also be difficult to connect the display device to the computer.
[0003] The computer can automatically detect when it has been connected to a new display device. However, the computer does not know where the display device is physically located relative to any other display devices, and the user needs to use a menu interface to enter this information. This can be inconvenient and may also be difficult for some users. The computer device will also not detect any subsequent changes in the relative positions of the display devices, which need to be entered manually.
[0004] When the spatial layout of the grouping of displays is unknown to the computer, the drawn information may appear on any one of the displays and may not appear on the display the user desires or in the order the user desires, or the content may otherwise be displayed incorrectly. It then needs to be moved, or in the case of some applications, the application and display devices need to be configured through other menu interfaces to ensure that a particular application image appears on the correct display device.
[0005] In addition, even if the user is able to enter the desired configuration information, the user may need to evaluate whether the resulting configuration meets expectations. Otherwise, the configuration may revert to the previous configuration and the user will need to repeat the configuration process. This process may be time-consuming and waste resources such as power, network bandwidth, and processing capacity.
[0006] It is with these and other considerations that the disclosure made herein is proposed. Summary of the invention
[0007] The disclosed embodiments describe techniques for efficiently and easily configuring a computing environment, which includes the use of multiple display devices. Methods and systems that provide improvements and efficiency when obtaining user input are described to determine the physical arrangement of a display and determine how to draw (render) portions of display data within the determined arrangement. In various embodiments, the user input may include a touch gesture, a voice input, an action gesture, or other forms of user input suitable for indicating the arrangement of a display device. Such user input forms can be used to configure one or more displays in a manner that can overcome the above-mentioned problems. For example, this form of user input can easily provide configuration information and allow users to quickly view the results of configuration decisions. As described below, the technology disclosed herein allows a computer to efficiently determine a desired display configuration with reduced processing and other computing resources. For example, the presentation of selectable configuration options and the efficient use of sensor input for easy selection can allow a reduction in processing load and a reduction in configuration data that needs to be generated, maintained, and stored. In addition, the efficient presentation and easy selection of configuration options enable users to experience a reduction in configuration time and resource usage, and avoid repeated attempts to configure and verify display configurations.
[0008] In one example, a visual, audio, or other prompt may be generated to prompt the user to identify each display in a set of displays in a specified order so that the expected display arrangement and order may be determined and stored. The user may provide the requested input by touch, voice, action / gesture, or other means. The user input may be provided in a manner that reduces the number and complexity of user interactions with the display. For example, if the display has a touch-sensitive surface, the user may touch each display. If a camera system is available on the display, the user may also use gestures, or if voice / sound recognition is available on the display, the user may provide voice prompts. Other means of providing user input may be employed.
[0009] Simplifications and assumptions may be made to minimize the amount of user input data required. For example, if the display has a means for determining its orientation through the use of on-device sensors, this information may be used to reduce the amount of information presented to the user for confirmation. Additionally, if the displays have sensors capable of detecting their proximity and alignment relative to each other, the alignment between the displays may be determined and presented to the user for confirmation. Once the user input is saved, the configuration information may be maintained and used by the system until the user changes the configuration.
[0010] In the examples presented herein, the disclosed techniques are described with reference to display monitors for simplicity. However, the techniques may be applied to determine the spatial orientation of other devices such as Internet of Things (IoT) devices (e.g., clocks, lights, voice-activated controllers, and speakers). In addition, the disclosed techniques may be used in conjunction with any type of display including virtual reality glasses and heads-up displays. For example, a heads-up display that covers only a portion of the field of view may be incorporated to provide an integrated display experience along with a large screen display.
[0011] Many display controllers are designed to accommodate a variety of heterogeneous displays, and are therefore complex in their menus and possible configurations. However, when the situation is relatively simple, such as in the case of four homogeneous displays with limited orientation possibilities, the display configuration interface may be too complex and cumbersome for what should be set up quickly and easily. Moreover, when the setup environment lacks the ability to connect a precision pointing device such as a mouse, but the display configuration interface presented to the user assumes access to a precision pointing device, the user may have difficulty using the interface and providing the requested information. Additionally, if the display is wall-mounted, it may be cumbersome to require that a mouse and another computer be attached to the display to complete the setup.
[0012] In one embodiment, instead of a setup screen that requires precise placement of objects on a screen to represent a display arrangement, a wizard is provided that utilizes available input sensors on individual devices (such as a touch screen) to receive user input and determine the order or arrangement of displays. As described herein, the wizard may be referred to as a spatial configurator. Because the spatial configurator is not limited to one interface on a single screen, the spatial configurator may provide a more intuitive input environment that is tailored to a particular display device and device layout.
[0013] In some embodiments, the spatial configurator may perform a best fit of user inputs to determine the arrangement of display devices. For example, the range of possible configurations may be limited to those that are possible based on the available information. For example, the set of possible form factors for display devices may be limited, allowing a set of intelligent alignment and orientation options that the user can select. This may reduce the number of ways a user can set the wrong configuration.
[0014] The spatial configurator can combine the capabilities of available sensors to provide input for determining the spatial arrangement. For example, if one or more displays have a microphone, or a microphone is coupled to the spatial configurator, the spatial configurator can request voice input to confirm the information used to determine the arrangement.
[0015] If one or more displays have a camera or other ability to detect a user's movement or gestures, the spatial configurator can prompt the user for a gesture to confirm the information used to determine the arrangement. The camera can use eye tracking, identification of where the user is standing relative to the camera or display, the direction in which the user is speaking, or a wave or other gesture from the user. For example, the spatial configurator can draw text on one or more displays, such as: "Is this display 1 or 2?" or "When the display indicates the desired display position (1, 2, 3, or 4), answer yes." Individual displays can draw identifiers for the user to identify each display, such as numbers, shapes, colors, or other visual means of identification. Alternatively, the user can sequentially touch the monitors in a sequence, perform user gestures (e.g., pointing) in a desired sequence, or perform actions to indicate a sequence (e.g., an arm motion that moves from left to right to indicate the desired sequence). Motion detectors can also be used to determine the proximity of a user to a particular display. The spatial configurator can determine the available sensors and find an efficient way to determine data indicating directionality and identification of individual displays.
[0016] In another example, alignment of the display can be confirmed by drawing alignment marks on the display and asking the user to indicate when the alignment marks are aligned. As the marks move relative to each other, the user can respond to the prompt to indicate "yes" or "no," or on a touch-enabled display, the user can touch the screen to indicate where the marks are aligned.
[0017] In some embodiments, the spatial configurator may allow sub-groupings of displays to be created. For example, a group of four displays may be grouped into two sub-groups of two displays each. Thus, the spatial configurator may allow the user to identify the number of groups, and then identify the spatial arrangement of each of the groups. This may be accomplished by prompting the user to identify the number of groups. Then, using the techniques disclosed herein, the user may be prompted to enter the arrangement of the displays in each grouping. Alternatively, the user may be allowed to define an order and provide an indication that the current display is the last display in the grouping. For example, the user may tap twice or enter some other indication indicating that the current display is the last display in the grouping. If the spatial configurator knows that there are other displays that have been identified but have not yet been placed in a known arrangement, the spatial configurator may prompt the user at that time as to whether the additional display will be part of the second sub-grouping. Other methods may also be conceived, such as prompting the user as to whether there are additional displays to be added to the grouping after each display is identified.
[0018] In some embodiments, a subgroup may have only one display, such as a projector, which may be considered to have its own display properties.
[0019] Some display devices may not have a direct means of input, such as a projector. In this case, the user can be prompted to identify the order of the projectors on another display device that can receive user input.
[0020] In the case of a set of arranged displays, once the spatial arrangement is known, the boundaries of the integrated display can be determined, and the graphics generation function can determine the display canvas for the graphics to be generated for the integrated display. For example, based on the number of available displays, the entire display canvas can be divided into multiple display portions.
[0021] This Summary is provided to introduce some concepts in a simplified form that are further described in the Detailed Description below. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The specific embodiments are described with reference to the accompanying drawings. In the description detailed herein, reference is made to the accompanying drawings which constitute a part of this document and which show specific embodiments or examples by way of illustration. The drawings herein are not drawn to scale. In all several figures, like numbers represent like elements.
[0023] Figure 1A is a diagram illustrating a computing environment for configuring a display according to the present disclosure;
[0024] Figure 1B is a diagram illustrating a computing environment for configuring a display according to the present disclosure;
[0025] Figure 2 is a diagram illustrating a configuration of a display according to the present disclosure;
[0026] Figure 3 is a diagram illustrating a configuration of a display according to the present disclosure;
[0027] Figure 4 is a diagram illustrating a configuration of a display according to the present disclosure;
[0028] Figure 5 is a diagram illustrating a configuration of a display according to the present disclosure;
[0029] Figure 6 is a diagram illustrating a configuration of a display according to the present disclosure;
[0030] Figure 7 is a diagram illustrating a configuration of a display according to the present disclosure;
[0031] Figure 8 is a diagram illustrating a configuration of a display according to the present disclosure;
[0032] Fig. 9 is a diagram illustrating a configuration of a display according to the present disclosure;
[0033] Fig.10 is a diagram illustrating a configuration of a display according to the present disclosure;
[0034] Fig.11 is a diagram illustrating a configuration of a display according to the present disclosure;
[0035] Fig.12 is a diagram illustrating a configuration of a display according to the present disclosure;
[0036] Fig.13 is a diagram illustrating a configuration of a display according to the present disclosure;
[0037] Fig.14 is a diagram illustrating a configuration of a display according to the present disclosure;
[0038] Fig.15 is a diagram illustrating a configuration of a display according to the present disclosure;
[0039] Fig.16 is a diagram illustrating a configuration of a display according to the present disclosure;
[0040] Fig.17is a diagram illustrating a configuration of a display according to the present disclosure;
[0041] Fig.18 is a diagram illustrating a configuration of a display according to the present disclosure;
[0042] Fig.19 is a flow chart depicting an example process for configuring a display according to the present disclosure;
[0043] Fig. 20 is a flow chart depicting an example process for configuring a display according to the present disclosure;
[0044] Fig.21 is a flow chart depicting an example process for configuring a display according to the present disclosure;
[0045] Fig. 22 is an example computing device according to the present disclosure. DETAILED DESCRIPTION
[0046] The following detailed description describes techniques for efficiently and easily configuring a computing environment that includes multiple displays or other devices that can be arranged in a variety of configurations. The disclosed techniques provide improvements and efficiencies when obtaining user input to determine the physical arrangement of displays and other devices, and determining the order of displays and other devices within the physical arrangement. Users can easily provide configuration information, and quickly view and confirm configurations, thereby allowing more accurate configurations, more efficient use of computing resources, and reducing configuration time and resource usage.
[0047] refer to Figure 1A , illustrated is an example computing environment 100 including displays 101A, 101B, 101C, 101D, and 101E. As discussed, the disclosed examples are described with reference to the displays. However, the disclosed technology can be applied to other types of devices that can be spatially arranged. Figure 1A A user 110 is illustrated interacting with displays 101A, 101B, 101C, 101D, and 101E to configure the displays to operate in computing environment 100 . Figure 1A Displays 101A, 101B, 101C, and 101D are depicted positioned side by side in a horizontal configuration. Display 101E is physically separate from displays 101A, 101B, 101C, and 101D. Figure 1AIt can be seen that it would be efficient to allow user 110 to configure displays 101A, 101B, 101C, and 101D by quickly touching these displays in the desired order, rather than through a multi-step process with multiple windows. It would also be efficient to allow user 110 to configure display 101E by using voice prompts, or gesture prompts, rather than interacting with multiple menu items through display windows.
[0048] In various embodiments, visual, audio, or other prompts may be generated to prompt the user to identify each display in a set of displays in a specified order so that the desired display arrangement and order may be determined and stored. The user may provide the requested input by touch, voice, motion, gesture, or other means. User input may be input using a variety of input sensors, such as a touch screen display, a camera system, a voice or sound activated sensor, a motion detector, and the like.
[0049] In one embodiment, instead of a setup screen that requires precise placement of objects on a screen to represent a display arrangement, a wizard is provided that utilizes available input sensors on the device (such as a touch screen) to receive user input and determine the order or arrangement of displays. As described herein, the wizard may be referred to as a spatial configurator. Because the spatial configurator is not limited to one interface on a single screen, the spatial configurator may provide a more intuitive input environment that is tailored to a particular device and device layout.
[0050] Figure 1B An example computing environment 100B is shown in which embodiments described herein may be implemented. Figure 1B 1 is a diagram schematically illustrating one example of a device 100 that can provide the described computing functionality. The device 100 can be part of a display or can be another device configured to provide the described functionality. Figure 1B Illustrated in FIG. 1 are one or more users 110 (which may be referred to herein as “user 110” in the singular or as “users 110” in the plural). Also illustrated are displays 120A and 120B (which may be referred to herein as “display 120” in the singular or as “displays 120” in the plural) via a network 130. The computing functionality provided by device 100 may include various types of functionality, such as a spatial configurator 150 and a graphics subsystem 160.
[0051] The network 130 may be a publicly accessible network, such as a linked network, and may be operated by various different parties (such as the Internet). In other embodiments, the network 130 may be a private network, such as, for example, a corporate network that is completely or partially inaccessible to non-privileged users. In other embodiments, the network 130 may include one or more private networks with access to and / or from the Internet. If implemented locally, the network 130 may be a local area network of connected devices (such as a group of displays connected to a single computing device) via direct video and data connections (such as HDMI and USB).
[0052] Display 120 may be any type of display accessible to user 110. For example, display 120 may be a wall-mounted monitor, a desktop monitor, a television, a tablet computer, or any other device capable of providing a user interface to user 110 and communicating with device 100. Although only two displays 120 are shown, it should be understood that multiple user displays may be present.
[0053] Figure 1B Sensors 140 are illustrated (which may be referred to herein as "sensor 140" in the singular or "sensors 140" in the plural) and may include sensors such as a touch-sensitive display, a voice or text recognition system, a camera system, a gesture or motion detector, and the like. The spatial configurator 150 may be configured to configure various aspects of the display 120 and how they are utilized by the graphics subsystem 160 for drawing graphics. In this regard, the spatial configurator 150 may provide a graphical interface via the display 120 to prompt the user 110 to provide input that identifies an order for the display 120. The prompt may be provided directly on the display 120. Additionally or alternatively, in order to prompt on the display 120, an audio prompt may be provided on an audio speaker ( Figure 1B ), or on a separate audio speaker.
[0054] It should be understood that although the embodiments disclosed herein illustrate the space configurator 150 as a function executed on one device, the space configurator 150 can be installed and executed on one or more of the separate computing or device displays 120. The space configurator 150 can also be executed remotely via the network 130. It should be understood that for simplicity, various aspects of the computing system and other devices are shown in this example without showing certain conventional details. Additional computing systems and other devices can be interconnected in other embodiments, and can be interconnected in different ways. Figure 1BThe network topology shown has been greatly simplified, and many more networks and devices can be utilized to interconnect the various computing systems disclosed herein. These network topologies and devices should be clear to those skilled in the art.
[0055] It should also be understood that Figure 1B The configurations depicted in are merely illustrative, and other implementations may be utilized. In addition, it should be understood that the functionality disclosed herein may be implemented in software, hardware, or a combination of software and hardware. Other implementations should be clear to those skilled in the art. In addition, in some embodiments, the functionality provided by the illustrated modules may be combined in fewer modules or distributed in more modules. Similarly, in some embodiments, some of the functions of the illustrated modules may not be provided, and / or other additional functions may be available.
[0056] refer to Figure 2 , illustrated is an example computing environment 200 that includes an example arrangement of four displays 120, 121, 122, and 123 that are arranged in horizontal alignment. In one embodiment, the displays 120, 121, 122, and 123 may have touch-sensitive screens. The spatial configurator 150 may be configured to provide a graphical interface via the displays 120, 121, 122, and 123 to prompt the user 110 to provide input that identifies the order of the displays 120, 121, 122, and 123. The prompt may be provided directly on the displays 120, 121, 122, and 123. In this example, the displays 120, 121, 122, and 123 may have a marker 210 that indicates to the user 110 that the displays 120, 121, 122, and 123 may be touched in the order that the user wishes to assign to the individual displays. Additionally or alternatively, in order to provide prompts on displays 120, 121, 122 and 123, audio prompts may be provided on audio speakers ( Figure 2 The audio prompt may be provided on a display 120 (not shown), the audio speaker may be physically integrated into the display 120, or the audio prompt may be provided on a separate audio speaker.
[0057] refer to Figure 3 , after the user 110 touches the first of the displays 120, a "1" 310 is drawn on the screen of the first display to indicate that this is the first display of the set of displays. The user 110 may then move to the second display.
[0058] refer to Figure 4, after the user 110 touches the second display 121 in the display, a "2" 410 is drawn on the screen of the second display to indicate that this is the second display in the set of displays. The user 110 may then move to the third display.
[0059] refer to Figure 5 , after the user 110 touches the third display 122 in the display, a "3" 510 is drawn on the screen of the third display to indicate that this is the third display in the set of displays. The user 110 may then move to the fourth display.
[0060] refer to Figure 6 , after the user 110 touches the fourth display 123 in the display, a "4" 610 is drawn on the screen of the fourth display to indicate that this is the fourth display in the group of displays. Now, the configuration of the four displays 120 for this stage has been completed.
[0061] In some embodiments, the spatial configurator 150 can perform a best fit of user input to determine the arrangement of the display device. For example, the range of possible configurations can be limited to those that are possible based on the available information. For example, a set of possible form factors for a display device may be limited, allowing a set of intelligent alignment and orientation options that a user can select. This can reduce the number of ways a user can set an incorrect configuration. In one example, if an identification of a specific display device is available, the identification of the specific display device includes a brand and model, then the characteristics of the specific brand and model including the physical size of the display and the display size of the display can be obtained. This information can be used to limit the specific arrangement of displays available for user selection. This information can also be used to notify the graphics subsystem 160 of the possible size of the drawn output. The spatial configurator 150 can combine the capabilities of available sensors to provide input for determining the spatial arrangement.
[0062] refer to Figure 7, shown is an example arrangement of four displays 710, 711, 712, and 713, which are arranged in horizontal alignment. In one embodiment, the spatial configurator 150 may be configured to provide a graphical interface via the displays 710, 711, 712, and 713 to prompt the user 110 to provide an input that identifies the order of the displays 710, 711, 712, and 713. The prompt may be provided directly on the displays 710, 711, 712, and 713. In this example, the display 710 may display a prompt 720 that indicates to the user 740 that the user 740 should respond to the following inquiry: an inquiry about whether the first display in the displays 710 is the first display in the order of the displays. For example, the spatial configurator 150 may draw text on one of the displays 710, which indicates: "When the display indicates the desired display position (1, 2, 3, or 4), answer yes". In addition to the prompts on displays 710, 711, 712, and 713, audio prompts can be heard through the audio speakers ( Figure 7 The audio prompts may be provided on displays 710, 711, 712, and 713 (not shown), the audio speakers may be physically integrated with displays 710, 711, 712, and 713, or the audio prompts may be provided on separate audio speakers. A microphone 730 is also illustrated, which may be coupled to the space configurator 150 via a network or other communication medium.
[0063] User 740 may say "yes" to prompt 720 to indicate that first of the displays 710 is the first of the grouped displays. Figure 8 , after the user 740 responds to the prompt 720, a "1" is drawn on the screen of the first display 710 to indicate that this is the first display in the group of displays. Then, the spatial configurator 150 may configure the second display 711. The spatial configurator 150 may cause the second display 711 in the displays to display a prompt 750 indicating to the user 740 that the user 740 should respond to an inquiry as to whether the second display 711 in the displays is the second display in the order of the displays.
[0064] The user 740 may say "yes" to indicate that the second one of the displays 711 is the second one of the displays of the group.
[0065] refer to Fig. 9, after the user 740 responds to the prompt 750, "2" is drawn on the screen of the second display 711 to indicate that this is the second display in the group of displays. The spatial configurator 150 may then configure the third display. The spatial configurator 150 may cause the third display 712 in the displays to display a prompt 760 indicating to the user 740 that the user 740 should respond to an inquiry as to whether the third display 712 in the displays is the third display in the order of the displays.
[0066] The user 740 may say "yes" to indicate that the third display 712 in the display is the third display in the group of displays. Fig.10 , after the user 740 responds to the prompt 760, "3" is drawn on the screen of the third display 712 to indicate that this is the third display 712 in the group of displays. Then, the spatial configurator 150 may configure the fourth display 713. The spatial configurator 150 may cause the fourth display 713 in the displays to display a prompt 770 indicating to the user 740 that the user 740 should respond to an inquiry as to whether the fourth display 714 in the displays is the fourth display in the order of the displays.
[0067] The user 740 may say "yes" to indicate that the fourth display 713 in the display is the fourth display in the group of displays. Fig.11 After the user 740 responds to the prompt 770, a "4" is drawn on the screen of the fourth display 713 to indicate that this is the fourth display in the group of displays. The configuration for this stage of the display settings may then be considered complete.
[0068] Back to reference Figure 1B If one or more of displays 120 has a camera or other capability to detect movement or gestures of user 110, or if a camera is coupled to device 100 via network 130, spatial configurator 150 may prompt the user for gestures to confirm information used to determine the arrangement of displays 120. The camera may use eye tracking, identification of where the user is standing relative to the camera or display, the direction from which the user is speaking, or a wave or other gesture from the user.
[0069] refer to Fig.12, illustrated is an example arrangement of four displays 1210, 1220, 1230, and 1240 arranged in a horizontal alignment. In one embodiment, the spatial configurator 150 may be configured to provide a graphical interface via the displays 1210, 1220, 1230, and 1240 to prompt a user to provide input that identifies the order of the displays 710. Also illustrated is a camera 1200 that may be coupled to the spatial configurator 150 via a network or other communication medium.
[0070] refer to Fig.13 , the user 110 may make a gesture 1300, which may point to the display, or the user 110 may provide some other gesture, to indicate that the first of the displays 1210 is the first of the grouped displays. After the user 1300 performs the gesture 1300, which has been captured and processed by the camera, a "1" 1310 is drawn on the screen of the first display 1210 to indicate that this is the first of the grouped displays.
[0071] refer to Fig.14 , the user 110 may make a gesture 1300 that may perform a directional gesture of the hand from left to right to indicate a second display 1220, a third display 1230, and a fourth display 1240 of the displays. After the user performs the gesture, "2" 1410 is drawn on the screen of the second display 1220 to indicate that this is the second display of the set of displays, "3" 1420 is drawn on the screen of the third display 1230 to indicate that this is the third display of the set of displays, and "4" 1430 is drawn on the screen of the fourth display 1240 to indicate that this is the fourth display of the set of displays.
[0072] Fig.15 Another example of using gestures to configure displays is illustrated. The figure shows another configuration of displays 1510, which is in a top two display, bottom two display arrangement. User 110 performs a clockwise gesture 1520, the row of clockwise gestures 1520 starting from the top left display to indicate the first display, the second display, the third display, and the fourth display in displays 1510. After the user performs gesture 1520, indicators 1530 are drawn on the screen of each display to indicate their order.
[0073] Fig.16Another example of configuring displays using gesture 1620 is shown. The figure shows a configuration of display 1610 in a top two display, bottom two display arrangement. User 1620 can perform a Z-shaped gesture 1620 starting from the top left display to indicate a first display, a second display, a third display, and a fourth display in display 1610. After the user performs gesture 1620, an indicator 1630 is drawn on the screen of each display to indicate their order.
[0074] Typically, the displays may be painted with identifiers so that a user can identify each display, such as a number, shape, color, or other visual means of identification.
[0075] refer to Fig.17 , illustrated is an example of display alignment. Illustrated are three displays 1710, 1720, and 1730, each with an alignment mark 1740. The alignment mark for 1730 is shown as not aligned with the alignment marks of 1710 and 1720. The user can respond by making a touch gesture 1750 that touches the alignment mark of display 1730 and moves the mark so that it is aligned with the alignment marks of 1710 and 1720. Reference Fig.18 , alignment mark 1740 for display 1730 is now shown aligned with the alignment marks of displays 1710 and 1720 .
[0076] In some embodiments, the spatial configurator may allow sub-groupings of displays to be created. For example, a group of four displays may be grouped into two sub-groups of two displays each. Thus, the spatial configurator may allow the user to identify the number of groups, and then identify the spatial arrangement of each of the groups. This may be accomplished by prompting the user to identify multiple groups. Then, using the techniques disclosed herein, the user may be prompted to enter the arrangement of the displays in each group. Alternatively, the user may be allowed to define an order and provide an indication that the current display is the last display in the group. For example, the user may tap twice, or enter some other indication, to indicate that the current display is the last display in the group. If the spatial configurator knows that there are other displays that have been identified but not yet placed in a known device, the spatial configurator may prompt the user at that time as to whether the additional display will be part of the second sub-group. Other methods may also be conceivable, such as prompting the user as to whether there are additional displays to be added to the group after each display is identified.
[0077] In some embodiments, a subgroup may have only one display, such as a projector, which may be considered to have its own display properties.
[0078] Some display devices may not have a direct means of input, such as a projector. In this case, the user can be prompted to identify the order of the projectors on another display device that is capable of receiving user input.
[0079] Simplifications and assumptions may be made to minimize the amount of user input data required. For example, if the display has a means for determining its orientation using sensors on the device, this information may be utilized to reduce the amount of information presented to the user for confirmation. Additionally, if the displays have sensors that are capable of detecting their proximity and alignment relative to each other, the alignment between the displays may be determined and presented to the user for confirmation. Once the user input is saved, the configuration information may be maintained and used by the system until the user changes the configuration.
[0080] In the case of a set of arranged displays, once the spatial arrangement is known, the boundaries of the integrated display can be determined, and the graphics generation function can determine the display canvas for the graphics that will be generated for the integrated display. For example, based on the number of available displays, the entire display canvas can be divided into multiple display portions. For example, the display canvas can be a workspace, a desktop, or any display that includes the entirety of the content to be drawn. The display portion can be a subdivision of the display canvas, which can be, for example, a window, a proportional portion of the display canvas based on the ratio of the individual display to the integrated display.
[0081] Now turn to Fig.19 , which shows an example operation process for configuring multiple display devices according to the present disclosure. In one embodiment, the example operation process can implement a method performed on one or more computing devices. Such an operation process can be performed by, for example, Figure 1B The operation process can be implemented in a system including one or more computing devices. Fig.19 , operation 1901 illustrates identifying a grouping of display devices that are to be combined to form an integrated display.
[0082] Operation 1901 may be followed by operation 1903. Operation 1903 illustrates generating a prompt for a user input indicating a spatial arrangement of a display device. Operation 1903 may be followed by operation 1905. Operation 1905 illustrates receiving a series of user inputs from one or more input sensors in response to the prompt.
[0083] Operation 1905 may be followed by operation 1907. Operation 1907 illustrates estimating a spatial arrangement of display devices based on a series of user inputs. Operation 1907 may be followed by operation 1909. Operation 1909 illustrates mapping portions of display data to display devices based on the estimated spatial arrangement of display devices. The operations end at operation 1911, which illustrates drawing the mapped portions of display data on the display devices to form an integrated display.
[0084] refer to Fig. 20 , illustrated is another example operation process for configuring a display according to the present disclosure. In one embodiment, the example operation process may implement a system. Such an operation process may be performed by, for example, Figure 1B The operation process may be implemented in a system including one or more computing devices. Fig. 20 , operation 2001 illustrates identifying a group of display devices.
[0085] Operation 2001 may be followed by operation 2003. Operation 2003 illustrates drawing a user interface configured to prompt a user for input indicating an order in which to display the devices.
[0086] Operation 2003 may be followed by operation 2005. Operation 2005 illustrates receiving user input data via a user interface, the user input data indicating an order for displaying the devices.
[0087] Operation 2005 may be followed by operation 2007. Operation 2007 illustrates converting the user input data into a spatial arrangement of the display device.
[0088] Operation 2007 may be followed by operation 2009. Operation 2009 illustrates generating display data based on the spatial arrangement of the display device and the size data of the display device. Operation 2009 may be followed by operation 2011. Operation 2011 illustrates drawing an integrated display on the display device using the display data, wherein Fig. 20 Finish.
[0089] refer to Fig.21 , illustrated is an example operation process for configuring a device according to the present disclosure. In one embodiment, the example operation process may be implemented as a computer-readable storage medium having computer-executable instructions stored thereon, which, when executed by one or more processors of a computing device, causes the computing device to perform operations performed on one or more computing devices. Such an operation process may be implemented by, for example, Figure 1B Reference Fig.21, operation 2101 illustrates identifying a grouping of devices that will be combined to form a spatially integrated function.
[0090] Operation 2101 may be followed by operation 2103. Operation 2103 illustrates receiving data indicative of a desired arrangement of the device from one or more sensors operable to receive input data from a user.
[0091] Operation 2103 may be followed by operation 2105. Operation 2105 illustrates estimating a spatial arrangement of devices based on the input data.
[0092] Operation 2105 may be followed by operation 2107. Operation 2107 illustrates dispatching output data to devices based on the estimated spatial arrangement of the devices. Operation 2107 may be followed by operation 2109. Operation 2109 illustrates rendering the dispatched output data on the devices to form an integrated output, wherein Fig.21 Finish.
[0093] Sample Clauses
[0094] The present disclosure presented herein may be similarly considered in light of the following terms.
[0095] Example clause A, a method for configuring a plurality of display devices, the method comprising:
[0096] identifying groups of display devices that are to be combined to form an integrated display;
[0097] generating a prompt for a user input indicating a spatial arrangement of the display device;
[0098] In response to the prompt, receiving a series of user inputs from one or more input sensors;
[0099] estimating the spatial arrangement of the display device based on the series of user inputs;
[0100] mapping portions of display data to the display devices based on the estimated spatial arrangement of the display devices; and
[0101] The mapped portion of the display data is rendered on the display device to form an integrated display.
[0102] Example clause B, a computer-implemented method according to example clause A, wherein the prompting includes: drawing an indication of the unique identifier on each of the display devices.
[0103] Example clause C, a computer-implemented method according to any of example clauses A to B, wherein the one or more input sensors include a touch-sensitive display.
[0104] Example clause D. A computer-implemented method according to any of example clauses A to C, wherein the series of user inputs includes a series of user touches of the touch-sensitive display.
[0105] Example clause E. A computer-implemented method according to any of example clauses A to D, wherein the one or more input sensors include at least one camera.
[0106] Example clause F, a computer-implemented method according to any of example clauses A to E, wherein the series of user inputs includes a series of gestures, the series of gestures indicating at least one direction.
[0107] Example clause G, a computer-implemented method according to any of example clauses A to F, wherein the spatial arrangement includes an order of each of the display devices in the grouping.
[0108] Example clause H, a computer-implemented method according to any of example clauses A to G, wherein the one or more input sensors include at least one audio input device.
[0109] Example Clause I, a computer-implemented method according to any one of Example Clauses A to H, wherein the series of user inputs includes a series of voice commands.
[0110] Example clause J, a computer-implemented method according to any of example clauses A to I, wherein the spatial arrangement includes an alignment of each display device in the display devices in the grouping.
[0111] Example Clause K. The computer-implemented method of any one of Example Clauses A to J, further comprising: drawing, on the display devices of the group, an indication of the order of each of the display devices.
[0112] Example Clause L, A computing device comprising:
[0113] one or more processors; and
[0114] A memory in communication with the one or more processors, the memory having computer-readable instructions stored thereon, the computer-readable instructions, when executed by the one or more processors, causing the computing device to perform operations, the operations comprising:
[0115] Identify a group of display devices;
[0116] drawing a user interface, the user interface being configured to prompt a user for input, the input indicating an order of the display devices;
[0117] receiving user input data via the user interface, the user input data indicating the order of the display devices;
[0118] converting the user input data into a spatial arrangement of the display device;
[0119] generating display data based on the spatial arrangement of the display device and the size data of the display device; and
[0120] An integrated display is drawn on the display device using the display data.
[0121] Example clause M, a computer-implemented method according to any of example clauses L, wherein the user interface includes a touch screen input and the user input data includes a series of touch inputs on successive ones of the display devices.
[0122] Example clause N, a computer-implemented method according to any one of example clauses L to M, wherein the user interface includes an optical input device and the user input data includes one or more gestures, wherein the one or more gestures indicate an order of the display devices.
[0123] Example clause O, a computer-implemented method according to any one of example clauses L to N, wherein generating the display data includes: generating a display area, the display area includes individual display areas of the arranged display devices.
[0124] Example clause P, a computer-implemented method according to any one of example clauses L to O, wherein the user interface includes an audio input device and the user input data includes one or more voice commands.
[0125] Example clause Q, a computer-implemented method according to any of example clauses L to P, wherein the one or more gestures include a directional gesture indicating the sequence of the display device.
[0126] Example Clause R, A computer-readable storage medium having stored thereon computer-executable instructions, the computer-executable instructions, when executed by one or more processors of a computing device, causing the computing device to:
[0127] identifying groupings of devices that are to be combined to form spatially integrated functions;
[0128] receiving data indicative of a desired arrangement of the device from one or more sensors, the one or more sensors being operable to receive input data from a user;
[0129] estimating a spatial arrangement of the devices based on the input data;
[0130] dispatching output data to the devices based on the estimated spatial arrangement of the devices; and
[0131] The dispatched output data is rendered on the device to form an integrated output.
[0132] Example clause S, a computer-implemented method according to example clause R, wherein the device is a display device, and the display device is spatially arranged to form an integrated display.
[0133] Example clause T, a computer-implemented method according to any one of example clauses R to S, further comprising computer executable instructions stored thereon, which, when executed by one or more processors of a computing device, cause the computing device to: identify a second group of devices, which are to be combined to form a second spatially integrated output.
[0134] Various aspects of the present disclosure are described herein with respect to certain examples and embodiments, which are intended to illustrate rather than limit the present disclosure. It should be understood that the subject matter presented herein can be implemented as a computer process, a computer-controlled device, or a computing system or product, such as a computer-readable storage medium. Although the subject matter described herein is presented in the general context of a program module executed on one or more computing devices, those skilled in the art will recognize that other implementations can be performed in conjunction with other types of program modules. Typically, program modules include routines, programs, components, data structures, and other types of structures that perform specific tasks or implement specific abstract data types.
[0135] Those skilled in the art will also appreciate that the subject matter described herein can be practiced on or with other computer system configurations (including multiprocessor systems) other than the computer system configuration described herein. The embodiments described herein can also be practiced in a distributed computing environment, in which tasks are performed by remote processing devices that are linked via a communication network. In a distributed computing environment, program modules can be located in local and remote storage devices.
[0136] Fig. 22 Additional details of an example computer architecture capable of implementing various aspects of the above-described embodiments are shown. Fig. 22The computer architecture shown illustrates aspects of a system such as a conventional server computer, workstation, desktop computer, laptop computer, tablet computer, computing or processing system embedded in a device (such as a wearable device, automobile, home automation, etc.), or other computing device, and can be used to execute any software components presented herein. For example, Fig. 22 The computer architecture shown may be used to execute any of the software components described above.
[0137] The computer architecture includes a baseboard 2202 or "motherboard," which is a printed circuit board to which multiple components or devices may be connected via a system bus or other electrical communication paths. In an exemplary embodiment, one or more central processing units ("CPUs") 2204 operate in conjunction with a chipset 2206. The CPU 2204 may be a standard programmable processor that performs the arithmetic and logic operations required for the operation of the computer architecture.
[0138] The CPU 2204 performs operations by manipulating switching elements to switch from one discrete physical state to the next, and the switching elements distinguish between and change these states. Switching elements can generally include: electronic circuits that maintain one of two binary states, such as flip-flops; and electronic circuits that provide output states based on logical combinations of the states of one or more other switching elements, such as logic gates. These basic switching elements can be combined to create more complex logic circuits, including registers, adders, subtractors, arithmetic logic units, floating point units, etc.
[0139] Chipset 2206 provides an interface between CPU 2204 and the rest of the components and devices on baseboard 2202. Chipset 2206 may provide an interface to RAM 2208, which is used as main memory in the computer architecture. Chipset 2206 may also provide an interface to a computer-readable storage medium, such as a read-only memory ("ROM") 2210 or non-volatile RAM ("NVRAM"), which is used to store basic routines that help boot the computing device and transfer information between various components and devices. ROM 2210 or NVRAM may also store other software components required for the operation of the computer architecture according to the embodiments described herein.
[0140] The computer architecture can operate in a networked environment using a logical connection to a remote computing device and a computer system through a network 2214 such as a local area network. Chipset 2206 may include a function for providing a network connection through a network interface controller (NIC) 2212 such as a Gigabit Ethernet adapter. NIC 2212 can connect the computer architecture to other computing devices through a network 2214. It should be understood that multiple NICs 2212 may exist in the computer architecture to connect the computer to other types of networks and remote computer systems. The network allows the computer architecture to communicate with remote services and servers (such as remote computers 2201). It is understood that remote computers 2201 can host many services, such as the XBOX LIVE gaming service provided by MICROSOFT CORPORATION in Redmond, Washington. In addition, as described above, remote computers 2201 can mirror and reflect the data stored on the computer architecture, and host services that can provide data or processing for the technology described herein.
[0141] The computer architecture can be connected to a mass storage device 2226 that provides non-volatile storage for the computing device. The mass storage device 2226 can store system programs, applications, other program modules and data, which have been described in more detail herein. The mass storage device 2226 can be connected to the computer architecture via a storage controller 2215 connected to the chipset 2206. The mass storage device 2226 can be composed of one or more physical storage units. The storage controller 2215 can be connected to the physical storage unit interface through any of the following items: a serial attached SCSI ("SAS") interface, a serial advanced technology attachment ("SATA") interface, a fiber channel ("FC") interface, or other types of interfaces for physically connecting and transmitting data between a computer and a physical storage unit. It should also be understood that the mass storage device 2226, other storage media and the storage controller 2215 can include a multimedia card (MMC) component, an eMMC component, a secure digital (SD) component, a PCI Express component, etc.
[0142] By transforming the physical state of the physical storage unit to reflect the information being stored, the computer architecture can store data on the mass storage device 2226. In different implementations of the specification, the specific transformation of the physical state can depend on various factors. Examples of such factors can include, but are not limited to, the technology used to implement the physical storage unit, whether the mass storage device 2226 is characterized as primary storage or secondary storage, etc.
[0143] For example, the computer architecture can store information to the mass storage device 2226 by issuing instructions through the storage controller 2215 to change: the magnetic properties of a specific location within a disk drive unit, the reflective or refractive properties of a specific location in an optical storage unit, or the electrical properties of a specific capacitor, transistor or other discrete component in a solid-state storage unit. Other transformations of the physical media are possible without departing from the scope and spirit of the present specification, wherein the foregoing examples are provided only to facilitate the present description. The computer architecture can further read information from the mass storage device 2226 by detecting the physical state or properties of one or more specific locations within the physical storage unit.
[0144] In addition to the mass storage device 2226 described above, the computer architecture may also access other computer-readable media to store and retrieve information, such as program modules, data structures, or other data. Since the operating system 2227, applications 2229, other data, and other modules are depicted as data and software stored in the mass storage device 2226, it should be understood that these components and / or other modules may be at least partially stored in other computer-readable storage media of the computer architecture. Although the description of computer-readable media contained herein refers to mass storage devices, such as solid-state drives, hard disks, or CD-ROM drives, it should be understood by those skilled in the art that computer-readable media may be any available computer storage media or communication media that can be accessed by the computer architecture.
[0145] Communication media includes computer readable instructions, data structures, program modules, or other data in a modulated data signal (such as a carrier wave or other transmission mechanism), and communication media includes any delivery media. The term "modulated data signal" means a signal in which one or more of the characteristics of the signal are changed or set in a manner that can encode information in the signal. As an example and not limitation, communication media include wired media such as a wired network or a direct wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of any of the above should also be included within the scope of computer readable media.
[0146] By way of example and not limitation, computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. For example, computer media include, but are not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid-state storage technology, CD-ROM, digital versatile disk ("DVD"), HD-DVD, BLU-RAY or other optical storage devices, cassettes, magnetic tape, magnetic disk storage devices or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer architecture. For the purposes of the claims, the phrases "computer storage medium", "computer readable storage medium" and variations thereof do not include waves or signals themselves and / or communication media.
[0147] The mass storage device 2226 can store an operating system 2227, which is used to control the operation of the computer architecture. According to one embodiment, the operating system includes a game operating system. According to another embodiment, the operating system includes an operating system from Microsoft Corporation. According to another embodiment, the operating system may include a UNIX, ANDROID, WINDOWS PHONE or iOS operating system available from its respective manufacturer. It should be understood that other operating systems may also be used. The mass storage device 2226 can store other systems or applications and data used by the computer architecture, such as any other software components and data described above. The mass storage device 2226 can also store other programs and data not specifically identified herein.
[0148] In one embodiment, the mass storage device 2226 or other computer-readable storage medium is encoded with computer-executable instructions that, when loaded into the computer architecture, convert the computer from a general-purpose computing system to a special-purpose computer capable of implementing the embodiments described herein. As described above, these computer-executable instructions transform the computer architecture by specifying how the CPU 2204 transitions between states. According to one embodiment, the computer architecture has access to a computer-readable storage medium storing computer-executable instructions that, when executed by the computer architecture, perform the above-described Fig. 22 The computing device may also include a computer-readable storage medium for performing any other computer-implemented operations described herein.
[0149] The computer architecture may also include one or more input / output controllers 2216 for receiving and processing input from a plurality of input devices such as a keyboard, a mouse, a microphone, a headset, a touch pad, a touch screen, an electronic stylus, an image processing and gesture recognition device, or any other type of input device. The input / output controller 2216 communicates with the input / output device 2225. The input / output controller 2216 may provide output to a display such as a computer monitor, a flat panel display, a digital projector, a printer, a plotter, or other type of output device. The input / output controller 2216 may provide input communications with other devices such as microphones, speakers, game controllers, and / or audio devices.
[0150] For example, the input / output controller 2216 may be an encoder, and the input / output device 2225 may include a full speaker system with multiple speakers. The encoder may use a spatialization technique, and the encoder may process the audio output audio or output signal received from the application 2222. The encoder may utilize the selected spatialization technique to generate a spatially coded stream to the input / output device 2225 that is appropriately rendered.
[0151] Although various configurations have been described using language specific to structural features and / or methodological acts, it should be understood that the subject matter defined in the appended representations is not necessarily limited to the specific features or acts described. Rather, specific features and acts are disclosed as example forms of implementing the claimed subject matter.
[0152] Unless expressly stated otherwise or otherwise understood in the context of use, conditional language such as "may," "could," "might," "such as," "for example," and the like as used herein is generally intended to convey that certain embodiments include certain features, elements, and / or steps, while certain embodiments do not. Thus, such conditional language is generally not intended to imply that one or more embodiments require features, elements, and / or steps in any way, or to imply that one or more embodiments necessarily include logic for determining, with or without author input or prompting, whether such features, elements, and / or steps are included or will be performed in any particular embodiment. The terms "include," "comprises," "has," and the like are synonymous and are used inclusively in an open-ended manner and do not exclude other elements, features, actions, operations, and the like. Similarly, the term "or" is used in its inclusive sense (and not in its exclusive sense), so that, for example, when used to connect a list of elements, the term "or" means one, some, or all of the elements in the high list.
[0153] Although certain example embodiments have been described, these embodiments are given by way of example only and are not intended to limit the scope of the invention disclosed herein. Therefore, nothing in the above description is intended to imply that any particular feature, characteristic, step, module, or block is necessary or indispensable. In fact, the novel methods and systems described herein can be embodied in a variety of other forms. In addition, various omissions, substitutions, and changes may be made to the form of the methods and systems described herein without departing from the spirit of the present invention disclosed herein. The attached claims and their equivalents are intended to cover forms or modifications that will fall within the scope and spirit of certain inventions disclosed herein.
[0154] It should be understood that any references to items and / or abstract concepts such as "first", "second", etc. in the specification are not intended to and should not be interpreted as necessarily corresponding to any references to elements such as "first", "second", etc. of the claims. In particular, in the "Summary of the Invention" and / or the "Specific Implementation Methods" that follow, items and / or abstract concepts (such as, for example, the operating states of individual computing devices and / or computing clusters) may be distinguished by numerical labels, and such labels do not necessarily correspond to the claims or even other paragraphs of the "Summary of the Invention" and / or "Specific Implementation Methods". For example, any designation of a "first operating state" and a "second operating state" of a computing cluster within a paragraph of the present disclosure is only used to distinguish between two different operating states of the computing cluster within that particular paragraph - not two different operating states of the computing cluster in any other paragraph, particularly not within the claims.
[0155] Finally, although various techniques have been described using language specific to structural features and / or methodological acts, it should be understood that the subject matter defined in the accompanying representations is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claimed subject matter.
Claims
1. A method for configuring a plurality of display devices, the method comprising: identifying a plurality of display devices that are to be combined to form an integrated rendering of the plurality of portions of the display data; receiving user input from one or more input sensors, the user input indicating a sequence of individual display devices among the plurality of display devices, the user input being received from the one or more sensors without the use of a precision pointing device and a display configuration interface; determining a spatial arrangement of the display devices based on the user input indicating the sequence; receiving, using the one or more input sensors, subsequent user input confirming the spatial arrangement, wherein the user input comprises at least a motion gesture; in response to the subsequent user input confirming the spatial arrangement, mapping a portion of the display data to the display device based on the spatial arrangement of the display device; as well as The mapped portion of the display data is rendered on the display device to form an integrated display.
2. The method according to claim 1, further comprising: On each of the display devices, a prompt is generated that includes a unique identifier, wherein the user input is provided in response to the prompt. The method of claim 1 , wherein the one or more input sensors comprises a touch-sensitive display. The method of claim 3 , wherein the user input comprises a series of user touches of the touch-sensitive display. The method of claim 1 , wherein the one or more input sensors include at least one camera. The method of claim 5 , wherein the input comprises a series of gestures indicating at least one direction. 7 . The method of claim 1 , wherein the spatial arrangement comprises an order of each of the display devices in a group.
8. The method of claim 1, wherein the one or more input sensors include at least one audio input device and the user input includes a series of voice commands.
9. A method according to claim 1, wherein the spatial arrangement includes alignment of each of the display devices, and wherein confirmation of the alignment of each of the display devices in the spatial arrangement is requested using determined capabilities of each of the display devices.
10. The method according to claim 7, further comprising: On the display devices of the group, an indication of the order of each of the display devices is drawn.
11. The method according to claim 1, further comprising: The user is prompted for the subsequent user input confirming the spatial arrangement, wherein the subsequent user input comprises user gestures in a desired sequence.
12. A computing device comprising: one or more processors; as well as a memory in communication with the one or more processors, the memory having computer-readable instructions stored thereon, the computer-readable instructions, when executed by the one or more processors, causing the computing device to perform operations, the operations comprising: Identify a group of display devices; drawing a user interface, the user interface being configured to prompt a user for input, the input indicating an order of the display devices; receiving user input data via the user interface, the user input data indicating the sequence of the display devices, the user input data being received from the one or more sensors without the use of a precision pointing device and a display configuration interface; converting the user input data into a spatial arrangement of the display devices, wherein the determined capabilities of the display devices are used to request confirmation of the display devices in the spatial arrangement; generating display data based on the spatial arrangement of the display device and the dimension data for the display device; and An integrated display is drawn on the display device using the display data.
13. The computing device of claim 12, wherein the user interface comprises a touch screen input and the user input data comprises a series of touch inputs on successive ones of the display devices.
14. The computing device of claim 12, wherein the user interface comprises an optical input device and the user input data comprises one or more gestures that indicate a sequence of the display devices.
15. The computing device of claim 12, wherein generating the display data comprises: A display area is generated, the display area comprising individual display areas of the arranged display devices.
16. The computing device of claim 12, wherein the user interface comprises an audio input device and the user input data comprises one or more voice commands.
17. The computing device of claim 14, wherein the one or more gestures include a directional gesture that indicates the sequence of the display device.
18. A computer-readable storage medium having stored thereon computer-executable instructions, which, when executed by one or more processors of a computing device, cause the computing device to: identifying groupings of devices that are to be combined to form spatially integrated functions; receiving data indicative of a desired arrangement of the device from one or more sensors, the one or more sensors being operable to receive input data from a user, the input data being received from the one or more sensors without the use of a precision pointing device and a display configuration interface; estimating a spatial arrangement of the devices based on the input data, wherein the determined capabilities of the display devices are used to request confirmation of the display devices in the spatial arrangement; dispatching output data to the devices based on the estimated spatial arrangement of the devices; as well as The dispatched output data is rendered on the device to form an integrated output.
19. The computer-readable storage medium of claim 18, wherein the devices are display devices spatially arranged to form an integrated display.
20. The computer-readable storage medium of claim 18, further comprising computer-executable instructions stored thereon, which, when executed by one or more processors of a computing device, cause the computing device to: identify a second grouping of devices, which will be combined to form a second spatially integrated output.
Citation Information
Patent Citations
Method and system for displaying to a user a transition between a first rendered projection and a second rendered projection
CN104969265A
Multiuser / multi pointing device graphical user interface system
CN1200189A
Virtual desktop manager
US20030189597A1
Method and apparatus for implementing multi-vision system by using multiple portable terminals
US20130176255A1
