System and method for simultaneously managing multiple designated peripheral devices
By designing a data recombinator, the data of multiple designated peripheral devices is converted into a single structure, the conflict problem of multiple devices in the computer system is solved when using them simultaneously, the virtual combination and collaborative work of devices is realized, and the equipment is enhanced. Universality and collaborative work capability.
Patent Information
- Application Number
- CN201880066872.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2017-10-19
- Filing Date
- 2018-10-19
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2038-10-19
AI Technical Summary
The prior art is difficult to effectively manage multiple designated peripheral devices with active surfaces in a computer system at the same time, resulting in the prone to device conflicts and functional inconsistencies in the environment of coordinated operations, limiting the universality and collaborative working ability of the device.
A recombinator is designed to ensure that the central unit can correctly process and identify multiple devices by organizing the data of multiple designated peripheral devices into a single data structure and converting them into data sent by a single designated peripheral device, so as to ensure that the central unit can correctly process and identify them, realizing virtual combination and collaboration of multiple devices. Work.
The simultaneous use of multiple designated peripheral devices is realized, which avoids device conflicts, enhances the universality and collaborative working ability of the device, and enables operators to use multiple touch screens, stylus and other devices on the same computer system at the same time without conflict.
Smart Images

Figure CN111263928B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of computer systems, in particular to the field of human-computer interaction.
[0002] More particularly, the present invention relates to a system and method for managing a plurality of designated peripheral devices by which an operator can interact with a computer system when the designated peripheral devices are simultaneously connected to the same computer system. Background Art
[0003] In the field of peripheral devices that allow a user of a computer system to operate said computer system, devices are known that are driven by the user interacting with graphical elements on a screen.
[0004] Among these devices are in particular keyboards, mice, styluses, touchpads or touch screens.
[0005] To ensure that these devices can be used with multiple computer systems, these devices communicate with the computer systems by sending data frames formatted according to a standard protocol called HID ("Human Interface Device").
[0006] Typically, the actions performed by the operator through these devices are visualized on one or more display surfaces of the computer system. This allows the operator to take actions according to his interaction needs (such as selection, confirmation, drawing, etc.).
[0007] Several of these devices (e.g., several keyboards or several mice) can be connected to the same computer system, but in these cases only one of the alternate devices can be used at a given moment. Thus, one mouse controls the position of the pointer acting on the display surface, but if more than one mouse is activated at the same time, there is little control over the pointer position.
[0008] For example, on a single-user computer station, even if two mice are connected, it is not necessary to use both mice at the same time, which does not affect the normal use of the computer. On the other hand, this also prohibits two people from using one mouse each on the same computer in the case of collaborative work.
[0009] In the case of a given system of the touch screen or tablet type, it may be necessary to act on the sensitive surfaces of these systems simultaneously.
[0010] Therefore, touch screens suitable for detecting and managing multiple simultaneous contact points are now widely used, which use the contact point information to obtain specific effects through software. However, this multiple contact possibility can currently only be used for a single touch surface and it is not possible to act on different touch surfaces simultaneously without special computer processing.
[0011] This limitation is due to the difficulty in combining a single and standardized link between a given peripheral device and the central unit of a computer system.
[0012] When a computer system includes several designated peripheral devices (A, B, C), these various peripheral devices are connected to the central unit separately via dedicated links, currently usually USB ("Universal Serial Bus"), such as Figure 1 shown.
[0013] Therefore, in this hardware and logic configuration, it is necessary to stop using a specified peripheral device so that another peripheral device can be used in a satisfactory manner at least from a functional point of view.
[0014] In order to make a given peripheral device as independent as possible from the connected computer system, a specific HID standard superimposed on the USB standard defines the content and structure of the data exchanged between the terminal and the central unit.
[0015] The disadvantage of this architecture comes from the fact that, in the context of coordinated actions of one or more operators, it is not possible to take into account simultaneous actions on several designated peripherals without conflicts.
[0016] To overcome this problem, software solutions have been developed, but these solutions are specific to the specific operating system and application implemented.
[0017] Thus, users of computer systems lose the versatility that they desire with designated peripheral devices, particularly touch screen devices and graphics tablets. Summary of the invention
[0018] The present invention proposes a solution for realizing multiple designated peripheral devices with active surfaces simultaneously by a computer system. The solution is that the data sent by multiple designated peripheral devices with active surfaces are reorganized into a group of data by a reorganizer, and the group of data includes all data representing the operations performed by the operator on the active surfaces of each designated peripheral device, and the group of data has the structure of the data sent by a single designated peripheral device.
[0019] To this end, the invention relates to a reorganizer for connecting a plurality of designated peripheral devices to the same central unit of a computer system.
[0020] The recombiner includes:
[0021] - an exchange input for exchanging data with each designated peripheral device when said designated peripheral device is connected to the recombiner, the data being the data normally exchanged with the central unit when said designated peripheral device is directly connected to the central unit;
[0022] - an exchange output, an output for exchanging data with the central unit when the recombiner is connected to the central unit;
[0023] - digital processing means configured to transform data received at an input of the reorganizer into data transmitted from an output of the reorganizer; the data transmitted from the output corresponding in content and structure to data emitted by a designated peripheral device comprising a single active surface;
[0024] The data sent as output represent at each instant in time, respectively on a single active surface, the actions performed with the specified peripheral device, which actions are represented with the data received as input.
[0025] By exchanging data with the reassembler, the central unit no longer faces the inconsistencies and conflicts encountered when multiple designated peripherals are directly connected to the central unit. The reassembler has converted the data received from the various designated peripherals so that they obtain values and structures corresponding to the data generated by a single designated peripheral combining the functional characteristics of the various connected designated peripherals. The designated peripheral combining said functional characteristics can be compared to a virtual designated peripheral that is a digital assembly of the actual designated peripherals connected to the reassembler.
[0026] The recombinator of the present invention includes all or part of the following technically combinable features.
[0027] In one embodiment, the digital processing device comprises:
[0028] - at least one analyzer configured to extract from data received as input for each designated peripheral device connected to said recombiner a variable data table and a descriptor of said designated peripheral device;
[0029] - at least one configurator configured to define, in a coordinate system of a single active surface, the size and position of an active surface associated with each designated peripheral device connected to said recombiner;
[0030] - at least one controller for converting variable data of data received as input into variable data of output data;
[0031] - at least one regulator configured to structure the data to be output according to a communication protocol comprised by the central unit to which the reorganizer must be connected.
[0032] These various functions can be performed by one or more microcontrollers integrated in the housing of the recombiner or in a set of interconnected housings. The configuration can be a stand-alone recombiner, so that it can be quickly connected to the central unit without hardware intervention on the central unit, or it can be mounted on an electronic board to be permanently installed in the central unit.
[0033] In one embodiment, for each active surface associated with a given peripheral device connected to the recombiner, the configurator defines the size and location of the area in the single active surface corresponding to the active surface associated with the given peripheral device by:
[0034] - a scaling ratio of each of the abscissa and ordinate axes of the active surface known in the coordinate system of the active surface relative to the coordinate system of the single active surface;
[0035] - The position of the reference point of the active surface in the coordinate system of the single active surface.
[0036] Thus, each work surface associated with a pointing peripheral is defined as a specific area of a single work surface in which actions of an operator performed with the pointing peripheral are characterized.
[0037] In one embodiment, the coordinates of a point specified on the active surface in the coordinate system of the peripheral device, which coordinates are transmitted in the variable data received at the input of the recombiner or generated by the recombiner from these received variable data, are converted into the coordinates of said point specified on the active surface in the coordinate system of the single active surface and incorporated into the variable data of the data emitted at the output.
[0038] In one embodiment, the reassembler is configured to receive data on at least one input that complies with the requirements of an open standard, such as the USB standard and a HID that overlays the USB standard.
[0039] In one embodiment, the reassembler is configured to receive on at least one input data defined by a protocol known as a "proprietary" protocol.
[0040] In one embodiment, the output data complies with requirements of an open standard, such as the USB standard and HID that covers the USB standard.
[0041] In one embodiment, at least one input corresponds to a wireless link to which the wireless designated peripheral device can be connected, for example via a radio link or via an optical link.
[0042] The invention also relates to an assembly comprising a reorganizer according to the invention and comprising at least two specified peripherals.
[0043] Thus, a complex designated peripheral device may be created by assembling a plurality of existing designated peripheral devices, and thus a designated surface of larger size may be created by assembling designated surfaces associated with different designated peripheral devices and / or associating generally incompatible functions.
[0044] In one embodiment, at least one designated peripheral of the component includes an active surface associated with a touch screen.
[0045] In one embodiment, at least one peripheral device of the assembly is a stylus associated with the designated surface.
[0046] In one embodiment, at least one designated peripheral of the assembly is a scrolling designated peripheral such as a mouse or trackball, the signals of which are processed to define a position on the designated surface.
[0047] The invention also relates to a computer system comprising such an assembly, which comprises the reorganizer of the invention, wherein the output of the reorganizer is connected to a central unit of the computer system.
[0048] The invention also relates to a method for connecting a plurality of designated peripheral devices to the same central unit in a computer system to allow said designated peripheral devices to interoperate simultaneously, comprising the steps of connecting said designated peripheral devices to the inputs of a recombiner of the invention and connecting the outputs of this recombiner to the central unit, so that the designated peripheral devices connected to the recombiner are seen by the central unit as a single designated peripheral device.
[0049] In one embodiment of the method, the method comprises the step of parameterizing the reorganizer, the step of parameterizing comprising defining an arrangement of active surfaces associated with each connected designated peripheral device in a single active surface.
[0050] Thus, consistency of the physical arrangement of the active surfaces with the physical arrangement virtually assigned thereto in a single active surface can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS
[0051] The present invention is described with reference to a diagram given by way of non-limiting example of an embodiment of the invention, the schematic diagram of which is as follows:
[0052] Figure 1 : the already mentioned principle of "alternative" operation of the various designated peripheral devices in a computer system, whose central unit receives signals from these various peripheral devices according to the principles of the prior art;
[0053] Figure 2 : The principle of simultaneous operation of various designated peripheral devices in a computer system, the central unit of which receives signals from these various peripheral devices through the data reassembler according to the present invention;
[0054] Figure 3 : A schematic diagram of the internal architecture of an embodiment of a recombinator according to the present invention;
[0055] Figure 4 : Schematic diagram of data processing in the reassembler;
[0056] Figure 5 : Schematic diagram of the main steps of the data processing method of the reorganizer specified peripheral device.
[0057] In the figures, the drawings of the various parts of the system and their components are represented symbolically. DETAILED DESCRIPTION
[0058] Figure 2 To give the general principle of the invention, the figure shows a computer system 100 comprising a central unit 90, a display surface 91 connected to the central unit 90, and three designated peripherals A, B, C intended to be used simultaneously or not simultaneously by one or more operators. It should be noted here that the designated peripherals considered below are the peripherals that restore the position of the indicator on the display surface.
[0059] Such a designated peripheral, such as a designated surface, can restore the position of a physical pointer such as a finger or stylus on, near, and above the active surface.
[0060] Such a designated peripheral device enables, for example, the measurement of the displacement of a cursor in the manner of a mouse or a trackball, from which the position of the pointer is defined on the display surface, in particular by integrating the displacement.
[0061] It is understood here that the invention is integrated into a conventional computer system in which peripheral devices communicate with a central unit via a standardized digital communication bus, for example the bus with the USB ("Universal Serial Bus") standard widely used today.
[0062] Although other existing or future "central unit-peripheral device" communication standards can be implemented in the present invention, the description will refer to a communication bus that meets the USB standard and the specific case of HID ("Human Interface Device") covering the USB standard.
[0063] Appropriate standards known to the person skilled in the art are available from, inter alia, the “USB Implementers Forum, Inc.”
[0064] It should be noted here that multiple considered designated peripheral devices can be associated with the same display surface, for example in the case of a touch screen, whose screen surface is larger than the effective surface of the designated peripheral device, or can be associated with several screens, for example juxtaposed touch screens.
[0065] therefore, Figure 2The display surface 91 is a symbolic representation of a display device comprising one or more screens, this aspect of the display system having no particular bearing on the present invention.
[0066] In the following description, only those data transmitted by the given peripheral devices A, B, C to the central unit 90 of the computer system 100 will be considered which are necessary for understanding the invention and its operation.
[0067] In particular, not all communication protocols available in various versions and to which reference can be made and the detailed structure of the data transmitted according to the requirements of the applicable standard, such as the USB standard: "Universal Serial Bus Specification", can be developed.
[0068] exist Figure 2 In the example shown, two first type designated peripheral devices A and B each include an active surface arranged on the surface of the screen 91 to constitute one or more touch screens.
[0069] Each designated peripheral device A, B generates data for transmission via the digital USB bus according to the requirements of the HID standard. However, data can be transmitted via another bus and according to another transmission standard without questioning the principle of the invention.
[0070] Thus, the designated peripheral device is a standard device, satisfying the HID communication standard in this example, and does not implement any technology specificity of the present invention.
[0071] In the following description, the expressions "specified peripheral device" and "HID peripheral device" will be used interchangeably to designate a specified peripheral device that includes an active surface and is configured to, among other things, transmit the absolute position of an operator's finger or a suitable tool, such as a stylus, at a specified point on the active surface relative to a reference frame.
[0072] It should be noted that the HID standard mentioned here is a special case of a standard, which is used as an example since it is currently frequently used in the field of specified peripheral devices, but this choice does not limit the invention since the invention can easily be adapted to another communication standard.
[0073] Computer system 100 also implements reassembler 10 .
[0074] The reassembler 10 receives data according to a standardized format, in the HID format according to an example, from respective designated peripherals A, B at inputs 11A, 11B of said reassembler.
[0075] The recombiner 10 processes data in a standardized format received on the various inputs 11A, 11B to reconstruct composite data according to the standardized format for transmission on a single output 17 of said recombiner.
[0076] It is to be understood here that the data outputted synthetically meets the requirements of the standard and therefore corresponds, for the central unit 90 , to the data transmitted here by the individual peripheral devices according to the HID standard.
[0077] This particular structure is different from the structure of USB hubs or switches well known in the field of communication networks between computers, which ensure that incoming data is transmitted continuously in a serial manner or without conversion in the background of this data.
[0078] In the reassembler 10 of the invention, the data received as input from at least two HID peripheral devices are received on different inputs and the data transmitted on a single output 17 in HID format combines the information contained in the data received at a given moment, so that the assembly comprising the reassembler 10 and the HID peripheral devices connected thereto is seen by the central unit 90 as if it were a single peripheral device satisfying the HID communication standard and therefore communicates with it without the need to install specific software or driver units on said central unit.
[0079] It is obvious to a person skilled in the art that the reassembler 10 must be designed to take into account the synchronization and processing problems of the signals transmitted or received by the different peripheral devices and to overcome the different constraints of the communication standards used, whether for reception or transmission. Therefore, the reassembler will notably include a buffer memory for storing digital data as input or to be output and, if necessary, a microcontroller.
[0080] The data emitted by the reassembler 10 are therefore constituted by the data received on the different inputs available to said reassembler at a given moment.
[0081] The reassembler is advantageously designed around a microcontroller, comprising conventional elements such as a processor, memory, peripheral units, input-output interfaces, which in its main embodiment is programmed to perform conversions applied to data received on input and to construct output data, said output data function being described below.
[0082] Figure 3 An example of the internal architecture of the recombiner 10 according to the present invention is shown, and in the case of using the HID standard to specify a peripheral device with an active surface, the following will be described. Figure 5 The operation of the recombiner 10 is schematically shown in FIG.
[0083] exist Figure 3 From left to right they are:
[0084] - inputs 11A, 11B, for example inputs associated with a quick connector of the USB standard, to which the data transmission bus generated by each HID peripheral device is connected;
[0085] - a conventional USB hub 14, which is implemented to send the received data to the analyzer 13;
[0086] -Analyzer 13;
[0087] - a controller 12;
[0088] - regulator 15;
[0089] An output 17 to which a data transmission bus is connected, which in this exemplary embodiment is a serial bus of the USB standard.
[0090] Figure 3 The hub also includes a configurator 16 that links to the analyzers, controllers and regulators.
[0091] Figure 3 Also shown is a radio receiver 11 c which transmits received signals to an accessory controller 14 ′ and then to an accessory analyzer 13 ′ which is connected to the controller 12 and the configurator 16 .
[0092] The functions and benefits of this radio receiver, accessory controller, and accessory analyzer will be described later.
[0093] Consider the case where two HID peripherals A and B are connected to inputs 11A and 11B, or vice versa, each of them transmitting a set of data relating to its capabilities and current status.
[0094] The data are transmitted via a USB hub 14 to an analyzer 13 which interprets the data received according to the HID standard in order to extract the information necessary for the reassembler to reconstruct the data to be sent by the reassembler.
[0095] There are two types of data:
[0096] -HID peripheral descriptor;
[0097] -HID peripheral variable data.
[0098] Descriptors are "fixed" data, parameterizable if necessary, to describe the characteristics of a HID peripheral, independently of the specification made, and which may differ from one HID peripheral to another. They generally allow the central unit 90 to know the characteristics of the HID peripheral from which variable data are received, so that the applications implemented on the central unit can correctly interpret the variable data received from this same HID peripheral. In the case of the present invention, they are processed by the analyzer.
[0099] Variable data are related to the use of HID peripherals. On a touch surface, these data indicate the contact of a finger with the active surface and give the position of the finger in the form of coordinates consistent with the descriptor. These data will be interpreted by the application implemented on the central unit, provided that they comply with the HID standard.
[0100] As mentioned earlier, peripherals that conform to the USB / HID standard can be supported on all applications and any operating system and have the standard integrated in their communication protocol, eliminating the need for specific drivers in systems that use so-called "proprietary" communication protocols.
[0101] according to Figure 5 In the input data conversion method 50 shown, in the first analysis step 51, the analyzer 13 will reconstruct a data table according to the descriptors and variable data of each HID peripheral device involved in the controller processing.
[0102] In the case of a cursor HID peripheral such as a mouse, data relating to the displacement of the cursor are interpreted by a controller to calculate the position of a pointer controlled by the cursor on a designated surface assigned to the peripheral.
[0103] In a second description step 54, the configurator 16 processes the descriptors of each HID peripheral A, B to develop virtual components of the designated surfaces 16A, 16B of the HID peripherals A, B to define a single virtual active surface 16U representing the physical arrangement of the designated surfaces of said peripherals.
[0104] The physical arrangement of such a given surface of the reconfigurator is known in simple cases, for example when the configurator is used for a predetermined assembly of given surfaces, the example of an active surface of a pre-set touch screen may be mentioned.
[0105] In another embodiment, the physical arrangement is communicated in the form of parameters transmitted to the recombiner during an initialization or parameter setting step, for example by a user of the computer system 100 via the central unit 90 .
[0106] Figure 4 In particular, a simple example of components defining such a single active surface 16U is shown.
[0107] In this example, the HID peripheral device under consideration includes a touch surface that is sensitive to touch and is able to identify the location of a finger touching the surface.
[0108] In this example, two display screens, each covered with a touch surface, are placed substantially side by side to form a composite screen 91 having the appearance of a single screen. In this configuration, the simulated active surface 16U physically corresponds to the components of the touch surface covering the screen.
[0109] However, since the designated peripherals including these touch screens are a priori "off-the-shelf" devices, the two touch surfaces do not have to have the same functionality, and they can specifically have different physical sizes, different logical sizes (resolutions), different detection technologies. Therefore, the descriptors of each corresponding HID peripheral are not only distinct, but can be distinct.
[0110] The single active surface 16U also corresponds to an arbitrarily selected or shaped descriptor, which must be transformed from the descriptor of the HID peripheral connected to the reassembler 10. The transformation performed in the configurator 16 mainly determines the transformation of the points of the specified surface of the specified periphery represented by the coordinates in the reference system of the specified surface corresponding to the points of the single active surface 16U, the points of the single active surface being represented by the coordinate system of the single active surface.
[0111] By way of example, Figure 4 The configurator shows the case where two rectangular specified surfaces are connected by edges each having the same length and height, but the points of the specified surfaces are determined at different scales in the coordinate systems of the two specified surfaces.
[0112] In the coordinate system of the first designated surface 16A, here associated with the display surface of the first HID peripheral device A, the scale of the touch surface is determined (by construction) by the coordinates of the upper right point of the first designated surface: [X = 2353; Y = 1322], which is relative to the origin at the lower left corner: [X = 0; Y = 0], where X is the horizontal coordinate along the width of the first designated surface and Y is the vertical coordinate along the height of the designated surface.
[0113] In the coordinate system of a second designated surface 16B associated with the display surface of a second HID peripheral device B, the scale of the designated surface is determined (by construction) by the coordinates of the upper right point of the second designated surface: [X = 19353; Y = 10886], which is relative to the origin at the lower left corner: [X = 0; Y = 0].
[0114] A single active surface 16U representing the combination of two specified surfaces is associated with a coordinate system having coordinates of the upper right corner point: [X = 32768; Y = 32768] relative to the origin: [X = 0; Y = 0] of the lower left corner point of the single active surface, which coordinates are arbitrarily selected values.
[0115] Then, the single active surface 16U includes two areas, a first area 16A' isomorphic to the first designated surface 16A, and a second area 16B' isomorphic to the second designated surface 16B. The relative position between the first area and the second area is also the relative position between the first actual designated surface 16A and the second designated surface 16B.
[0116] Thus, in the coordinate system of the single touch surface 16U, the first area 16A′ associated with the display surface of the first HID peripheral device A is here determined by the coordinates of the point at the upper right: [X=16384; Y=32768] and the origin at the lower left: [X=0; Y=0].
[0117] The second area 16B′ associated with the display surface of the second HID peripheral device B is again determined by the coordinates of the point at the upper right: [X=32768; Y=32768] and the origin of the second designated surface at the lower left: [X=16385; Y=32768]. The offset in X of the origin of the second area corresponds to the juxtaposed arrangement of the two designated surfaces 16A, 16B.
[0118] In this simple example, the two touch surfaces 16A and 16B have the same physical dimensions, which results in two areas that are the same width along X and height along Y.
[0119] However, this condition is not required.
[0120] In practice, the given surfaces can have different sizes, different shapes, different orientations relative to each other. They can also be fully or partially superimposed.
[0121] The area of a single active surface 16U associated with a given surface may be a linear transformation of the physical touch surface, or may be transformed by a non-linear law to produce a particular effect, such as a proportional modification of a given surface or a curvature effect depending on the location of a given point thereon.
[0122] It is not necessary to arrange the areas corresponding to the different designated surfaces in a manner similar to the physical arrangement of the designated surfaces, and it is possible to bring them close to or apart from each other, more or less overlapping, in a single active surface 16U of the areas of the different designated surfaces. The areas can also declare the position of the designated surface as invalid. The latter configuration allows, for example, to ensure the continuity of the sliding action of the operator's finger when there is an inactive area between two juxtaposed designated surfaces related to sliding.
[0123] For example, in the case of a simple depiction of two designated surfaces, the two designated surfaces 16A and 16B may have the same physical height as shown, but different widths, which is not shown, in which case the dimensions along the Y direction of the two areas 16A' and 16B' will be the same, and the dimensions along the X will be different, and the ratio of the physical widths along the designated surfaces will be different. They may also have different orientations: for example 90 degrees or 45 degrees to form a touching mosaic. They may also be discontinuous to correspond to the physical arrangement of the designated surfaces.
[0124] The two designated surfaces 16A and 16B may also have different physical heights, which is not shown. In this case, the single rectangular active surface 16U will not be fully active.
[0125] In a third conversion step 52 , the data characterizing the zones 16A′, 16B′ associated with the HID peripherals A, B established by the configurator 16 during the description step 54 are sent to the controller 12 .
[0126] In this conversion step, for each HID peripheral device connected to the recombiner 10, the controller 12 converts the variable data related to the operation of the HID peripheral device, so that the variable data corresponding to the descriptor of the HID peripheral device sent by the HID peripheral device is expressed after the transformation of the single active surface 16U corresponding to the descriptor.
[0127] Typically, a specified position on a specified surface of a HID peripheral device, such as a detected position of a finger, is sent by the HID peripheral device in data as a pair of values (Xf, Yf) corresponding to the specified position in the coordinate system of the specified surface under consideration, transformed in the coordinate system of the single active surface 16U by a scaling factor on each axis and an offset from the coordinate origin, the scaling factor and the origin offset depending on the area of the single active surface 16U corresponding to the specified surface under consideration.
[0128] Thus, in the illustrated example shown previously, the coordinate point (Xfa, Yfa) of the first HID peripheral device A will be transformed, by a simple uniform transformation, without origin offset, since the origins are coincident, into the coordinate point (Xga, Yga) of the coordinate system of the single active surface 16U:
[0129] Xga = Xfa x 16384 / 2353
[0130] Yga = Yfa x 32768 / 1322
[0131] The coordinate point (Xfb, Yfb) of the second HID peripheral device B will be transformed by homogenization and origin offset to a coordinate point (Xgb, Ygb) in the coordinate system of the single active surface 16U:
[0132] Xgb = (Xfb x 16384 / 19353) + 16385
[0133] Ygb = Yfb x 32768 / 10886
[0134] In a fourth formatting step 53, the HID regulator 15 receives:
[0135] - from the configurator 16, data for reconstructing the descriptor of a single active surface 16U according to the specifications of the HID standard, and
[0136] - variable data resulting from the transformation during the step of converting the variable data sent by each HID peripheral connected to the recombiner 10, carrying said variable data of the HID peripheral and in the form of variable data relating to the operation of a single active surface 16U, then;
[0137] - Reconstructing the data table, combining the descriptors and variable data of a single active surface 16U, to transmit said data according to standard conditions associated with HID peripherals, that is to say corresponding to those data transmitted by a single designated peripheral of a designated surface, ie a single active surface 16U.
[0138] When the reorganizer 10 is in operation, the different steps of the method 50 for converting input data are repeatedly performed when new variable data have to be converted.
[0139] However, the second analysis step only needs to be performed when the recombiner is put into use in a computer system and the configuration of a specified peripheral device connected to the recombiner is modified, for example by adding a specified peripheral device.
[0140] Therefore, it follows from the present invention that multiple HID peripheral devices A, B connected to the recombiner 10 are "seen" by the central unit 90 as a single HID peripheral device, which includes the combined specified capabilities of the HID peripheral device including multiple HIDs that can be realized simultaneously by simple connection (plug and play).
[0141] Thus, the reassembler 10 associated with all the designated peripherals connected thereto appears as a single designated peripheral with respect to the central unit 90, without the known operating problems arising when several designated peripherals are respectively directly connected to the central unit.
[0142] As already pointed out in the introduction to the description of this exemplary embodiment, details related to the protocols disclosed in the USB and HID standards associated with the operation of the HID peripheral device are not given in the description, which details are known to those skilled in the art and do not provide useful information for understanding the present invention.
[0143] Furthermore, although the HID standard is widely used today, the present invention can also be applied to a specified device using a data transmission standard other than the HID standard.
[0144] In one embodiment, the recombiner 10 comprises at least one input for a peripheral device of a second type comprising an active surface and designed to communicate with the central unit through a specific protocol not satisfying a common standard, generally specified by the expression “proprietary system”, or not satisfying a standard different from that used by the peripheral devices of the first type connected to said recombiner.
[0145] In this embodiment, the data sent by the designated peripheral device of the second type are transformed by the reorganizer according to their structure to reconstruct a data table having the same form as other designated peripheral devices connected to the reorganizer.
[0146] The data received from the designated peripheral device of the second type is then processed like a designated peripheral device of the second type and taken into account in a formatting step 53 to be merged into the data table of the single active surface 16U.
[0147] It should be noted that at least a portion of the second type of designated peripherals does not necessarily include the descriptors necessary to assign a specific area of the single active surface 16U to the active surface. In this case, an arbitrary area will be assigned to the designated peripheral, such as the entire single active surface 16U, or an area 16A, 16B of another designated peripheral A, B, or an area selected by the operator from a connected computer station.
[0148] Figure 2 and Figure 3 An example of this embodiment is shown.
[0149] In this example, the peripheral device C of the second type is a stylus C1 associated with an active surface C2. In the case shown, the peripheral device C sends data essentially for practical reasons via a radio link (Wi-Fi, Bluetooth®, etc.).
[0150] This second type designated peripheral does not use the HID standardized communication standards (otherwise it would be considered a first type designated peripheral) and generally requires driver software to be installed on the central unit to implement it.
[0151] Such driver software is specific to the operating system installed on the central unit 90 and is sometimes not available for certain operating systems, which limits the use of these peripheral devices to operating systems for which the driver software is available.
[0152] In the illustrated embodiment of the recombiner 10 of the present invention, Figure 3 As shown, the reassembler includes the above-mentioned functions of supporting two HID peripheral devices and also includes:
[0153] - Receiver 11C;
[0154] - Accessory controller 14C;
[0155] -Attachment Analyzer 13C.
[0156] The receiver 11C, here a radio receiver, receives the data transmitted by the stylus.
[0157] These data include at least one identification of the peripheral device so that the recombiner can assign a corresponding interaction to it on the surface C2 .
[0158] Under conditions of typical use, these operating data are usually extracted and interpreted by driver software specifically adapted to the peripheral device in question.
[0159] In the case of reassembler 10, data received by radio controller 14C is processed by accessory analyzer 13C to obtain variable data related to the use of the graphics tablet.
[0160] To this end, the attachment analyzer 13C comprises, for example, firmware which can be installed during the manufacture of the reassembler or downloaded, for example, from the central unit 90 into a flash memory.
[0161] Advantageously, the stylus descriptor will be incorporated into the attachment analyzer 13C.
[0162] The variable data and descriptors determined for the second type-specified peripheral device C are then sent to the controller 12 .
[0163] The controller 12 then reconstructs a data table consistent with the data table generated by the HID peripheral device for the second type-specified peripheral device, such as the stylus under consideration, and then processes the second type-specified peripheral device as a first type-specified peripheral device, i.e., for example, in the case of the stylus C1, the effective surface C2 associated with the stylus is associated with the designated surface in which the designated peripheral device is active.
[0164] The active surfaces of the second type of peripheral device are then associated with the region 16 ′C of the single active surface 16U.
[0165] Said area 16C′ is, for example, equal to a single active surface 16U, so that the stylus C1 allows designating any point of the display surface 91 corresponding to, for example, the single active surface 16U.
[0166] In practice, all or part of the area 16C' on which the stylus C1 acts may be juxtaposed with other areas 16A', 16B' of the designated peripherals 16A, 16B, or may cover all or part of said other areas.
[0167] After being reconstructed by the controller 12, the data linked to the second type designated peripheral device C has the same structure as the data of the other designated peripheral devices A, B, so that it, like the data of the other designated peripheral devices A, B, is received and processed by the controller 12 to convert these data according to the data received from the configurator 16.
[0168] As in the embodiment implementing two HID peripherals, the data is then sent to the reconstructor 15 which reconstructs the data table and merges together the transformed variable data from all designated peripherals A, B and C of either the first or second class connected to the reconstructor 10.
[0169] These data are then transmitted via the communication bus connected to the output peripheral 17 in the form and conditions of the standard associated with the designated peripheral, in this example the HID standard, to be considered by the central unit 90 as representative data of the operation of a single active surface 16U.
[0170] It should be noted here that the simultaneous use of a graphics tablet and a touch screen is generally not contemplated.
[0171] However, this situation has a lot to do with the limitations of existing systems, which do not allow this use to be carried out effectively at the same time and are seen as a hindrance.
[0172] In contrast, the recombiner 10 of the present invention allows an operator to use a graphics tablet on a touch screen, such as a large touch screen in a vertical position, which may be composed of several display panels and several touch surfaces, while one or more other operators work through direct interaction on the touch screen as part of a collaborative effort.
[0173] Furthermore, the reassembler 10 also has the function of enabling the peripheral devices of the second type to communicate according to different open or proprietary protocols in a manner compatible with standards such as the HID standard. In fact, thanks to the reassembler of the present invention, the peripheral devices of the second type can be used on any computer system compatible with the output standard of the data managed by the reassembler, without the need to use a specific driver on the computer system, provided that a driver is available for the computer system.
[0174] It should also be noted here that a HID peripheral with a cursor, such as a mouse, can be used simultaneously with other designated peripherals through the recombiner 10, and these other peripherals can be of all types, such as touch surfaces, styluses associated with active surfaces, and other cursor peripherals.
[0175] In certain configurations, in particular in order to increase the number of HID peripheral devices to be connected to a single input of the central unit beyond the number of inputs of the recombiner 10, the recombiner 10 may receive one or more other recombiners, each connected to the input of the first recombiner 10, such as a cascade installation, allowing, at least in theory, to increase indefinitely the number of a given peripheral device that can be connected simultaneously to the central unit.
[0176] Clearly, at least in theory, there is no limit to the number of inputs used to connect a given peripheral to the reassembler, as long as the corresponding variable data can be placed on a single output while maintaining compatibility with the standard under consideration.
[0177] Advantageously, the reassembler comprises at least two inputs so as to enable at least two designated peripheral devices to be used simultaneously.
[0178] The standard used at the output of the central unit for transmitting data to the computer system is not necessarily the same as the standard used for receiving data at the input of the reassembler.
[0179] As an example, consider the case already described of two designated peripheral devices, each peripheral device including a touch surface.
[0180] Arrange two touch surfaces to form a touch screen, for example, each touch surface covers a screen whose size is half greater than the size of the touch surface, or each touch surface covers a screen, and the two screens are arranged to form a touch screen. Over the entire display surface, the two touch surfaces do not have to have the same technology, for example, a touch surface of capacitive technology and a touch surface of optical technology.
[0181] Due to the presence of the recombiner, operations can be performed on currently conventional display systems on a simple touch screen, but cannot be implemented in a simple and intuitive manner on the considered complex arrangements of touch surfaces.
[0182] Example 1: Simple drag: The operator places a finger on one of the touch surfaces and makes a movement, for example drawing a line or moving a "grabbed" object. If the path of his finger passes from one touch surface to the other, the central unit will perceive the movement as a continuous and uninterrupted displacement of the finger on a single touch surface. In particular, if there is a separation between the two touch surfaces for technical reasons, the definition of corresponding "dead" areas in the single active surface 16U will ensure the alignment of the path traversed by the finger on the two touch surfaces. In this example, a temporary absence of the signal can be interpreted as a temporary lift-off of the finger.
[0183] Example 2: Multiple contacts at the same time: The operator places two fingers on one touch surface and another finger on another touch surface. This double touch does not create a conflict because it is received by the central unit as a double touch on the same touch surface. Therefore, the coordinated action of sliding fingers on the touch surfaces that the central unit considers as a single touch surface can produce the effect of image zooming in or out, image rotation.
[0184] Example 3: Collaborative work: An operator performs actions with a stylus and an active tablet, which are performed on a (simple or composite) touch screen. Another operator simultaneously interacts without conflict by making finger contact on shapes or other elements generated by the stylus and the active tablet.
[0185] The invention thus allows the assembly of a plurality of existing designated peripherals in situations where different technologies are required, thus overcoming the drawbacks of existing solutions by ensuring the possibility of using them simultaneously in a transparent manner for the central unit to recognize only one designated computer system and that this peripheral transmits all the specific information about the actions performed on each of the designated peripherals.
[0186] It should be understood that, in certain cases, the architecture of the recombiner is described as an example, and if necessary, those skilled in the art may choose to implement the various functions to be performed by the recombiner of the present invention by implementing one or more analyzers, and / or one or more controllers, and / or one or more configurators, and / or one or more regulators. He may also choose to combine some elements together, or conversely distribute the functions to be performed in different ways without departing from the present invention.
[0187] In one embodiment, the reassembler includes multiple outputs so that it can transmit the reassembled data to multiple computers.
[0188] The invention described in this specification is the result of work partially supported by the European Commission under Magellan Grant Agreement No. 611526 within the scope of the Seventh Framework Programme.
Claims
1. A reassembler (10) for connecting a plurality of designated peripheral devices (A, B, C) to a same central unit (90) of a computer system (100), characterized in that include: - inputs (11A, 11B, 11C) for exchanging data with each of the designated peripheral devices when the designated peripheral devices are connected to the reorganizer, wherein the data are the data normally exchanged between the designated peripheral devices and the central unit (90) when the designated peripheral devices are directly connected to the central unit; - an output (17) for exchanging data with the central unit (90) when the recombiner is connected to the central unit; - digital processing means (12, 13, 15, 13C, 14C, 16) configured to convert data received at the input (11A, 11B, 11C) of the recombiner into data transmitted from the output (17) of the recombiner; said data transmitted by said output conforms in content and structure to data transmitted by said designated peripheral device comprising a single active surface (16U); said data transmitted by said output (17) characterize, at each instant, on said single active surface (16U), respectively, an action performed with said designated peripheral device (A, B, C), said action being characterized by receiving as said input data (11A, 11B, 11C); as well as Wherein, the digital processing device comprises: - at least one analyzer (13, 13C) configured to extract from the data received as said input (11A, 11B, 11C) by each of said designated peripheral devices connected to said recombiner a variable data table and a descriptor of said designated peripheral device; - at least one configurator (16) configured to define, in the coordinate system of said single active surface (16U), the size and position of a designated surface (16A, 16B, 16C) associated with each of said designated peripheral devices connected to said recombiner; - at least one controller (12) for converting variable data of data received as said input (11A, 11B, 11C) into variable data of data sent by said output (17); - at least one regulator (15) configured to structure the data to be sent by the output (17) according to a communication protocol comprised by the central unit (90) to which the recombiner (10) must be connected; wherein, for each of the designated surfaces (16A, 16B, 16C) associated with the designated peripheral device connected to the recombiner, the configurator (16) defines a size and a position in the single active surface (16U) corresponding to an area (16A', 16B', 16C') of the active surface associated with the designated peripheral device, wherein the above definition utilizes: - a scaling factor of the abscissa axis and the ordinate axis of the designated surface, known in the coordinate system of the designated surface, each relative to the coordinate system of the single active surface (16U); - the position of the reference point of the specified surface in the coordinate system of the single active surface (16U).
2. The recombinator according to claim 1, wherein: The coordinates of a point specified on the specified surface (16A, 16B, 16C) in the coordinate system of the specified peripheral device (A, B, C) sent in the variable data are converted into the coordinate system of the single active surface (16U) by converting a value received at the input (11A, 11B, 11C) of the recombiner or a value generated by the recombiner from the received variable data into the coordinates of the point specified on the specified surface and incorporating them into the variable data of the data sent at the output (17).
3. The reassembler according to claim 1, configured to receive data on at least one of the inputs (11A, 11B) in compliance with the requirements of an open standard, the open standard being a USB standard and a HID standard covering the USB.
4. Reassembler according to claim 1, configured to receive on at least one input (11C) data defined by a closed protocol called "proprietary" protocol.
5. The recombinator according to claim 1, wherein: The data sent by the output (17) meets the requirements of the open standard, and the open standard is the USB standard and the HID standard covering the USB standard.
6. The recombinator according to claim 1, wherein: At least one of said inputs (11C) corresponds to a wireless link to which a designated peripheral device (C) can be connected either via a wireless link or via an optical link.
7. An apparatus comprising a recombiner (10) according to one of claims 1 to 6 and comprising at least two of said designated peripheral devices (A, B, C).
8. The device according to claim 7, wherein: At least one of the designated peripheral devices (A, B) comprises the active surface (16A, 16B) associated with a touch screen.
9. The device according to claim 7, wherein: At least one designated peripheral device (C) is a stylus associated with the designated surface.
10. The device according to claim 7, wherein: At least one of the designated peripheral devices is a scrolling device, signals of which are processed to define a position on the designated surface.
11. A computer system comprising the apparatus according to claim 7, wherein: The output (17) of the reorganizer (10) is connected to the central unit (90) of the computer system.
12. A method for connecting a plurality of said designated peripheral devices (A, B, C) to the same said central unit (90) in said computer system to allow said designated peripheral devices to interoperate simultaneously, comprising the steps of connecting said designated peripheral devices to a recombiner (10) according to one of claims 1 to 6, and connecting the output of said recombiner to said central unit (90) so that said designated peripheral devices connected to said recombiner are seen by said central unit as said single active surface designated peripheral device.
13. The method according to claim 12, comprising the step of parameterizing the recombiner (10), the step of parameterizing comprising defining, in the single active surface (16U), an arrangement of the designated surfaces (16A, 16B, 16C) associated with each connected designated peripheral device (A, B).
