Using multi-user interactive displays to change the active users of the stylus

By detecting events transmitted through the stylus, multi-user displays adjust the user experience and interface mode, solving the problem of inflexible user collaboration and interaction in existing technologies. This enables multi-user collaboration and content sharing, improving user experience and efficiency.

CN123114355APending Publication Date: 2026-11-17MICROSOFT TECHNOLOGY LICENSING LLC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611318841.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2017-03-06
Filing Date
2018-02-23
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Existing multi-user interactive displays do not integrate stylus transfer functionality for collaborative interaction between users, resulting in inflexible user experience and interface adjustments, making it difficult to achieve natural interaction and collaboration among multiple users.

Method used

By detecting stylus input events, the user experience of multi-user displays can be adjusted, including changing user interface patterns, establishing communication channels between user devices, automatically establishing social media relationships, and using AI agents to adjust user roles, thereby enabling collaborative functions in multi-user mode.

Benefits of technology

It enables flexible user experience adjustments when multiple users are using stylus input, improves collaboration efficiency and interface adaptability among users, and supports content sharing and social network connections among multiple users.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123114355A_ABST
    Figure CN123114355A_ABST
Patent Text Reader

Abstract

In a multi-user collaborative environment, a change in operating system state can occur when a stylus is passed from one user to another. Upon detecting a change in the active user, state machine transitions can lead to changes in the user experience. In one example, the change in user experience includes alterations to user interface (UI) functionality. Some examples include changing the color of the displayed digital ink, changing the handwriting mode, and automatically switching the view displayed on the user interface. The switched view can transition from single-user mode to multi-user mode. In another example, state machine transitions can lead to the establishment of a connection between the device (e.g., a phone or laptop computer) associated with the user using the pen.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the invention patent application "Changing the active user of the stylus using a multi-user interactive display" filed on February 23, 2018, with application number 201880016120.7. Background Technology

[0002] Styluses, or pen styluses, are often used as input devices for digitizers associated with computer screens, mobile devices, graphics tablets, and other devices. For touchscreen devices, users place the stylus on the surface of the screen to write, draw, or select by tapping the screen. Thus, in addition to mice, trackpads, or fingers, styluses are also used as pointing devices.

[0003] Styluses can be used in collaborative environments, such as on multi-user displays also known as interactive whiteboards. An interactive whiteboard is a large digital display capable of receiving input from multiple users simultaneously. For example, users can interact more naturally with data using styluses, touch, or a combination of pen and touch on the digital display, which is not possible on a conventional whiteboard. Furthermore, in conventional whiteboards, markers are typically passed from one user to another as each person takes turns demonstrating and writing on the whiteboard. Such user-to-user interaction has not yet been integrated into the collaborative environment of interactive whiteboards. Summary of the Invention

[0004] This summary is provided to introduce some concepts in a simplified form, which will be further described in the detailed embodiments below. This summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter.

[0005] In one embodiment, a method for interacting with a multi-user display is disclosed. It is possible to detect that a first user has passed a stylus to a second user. In response to the pen transfer, the user experience is adjusted by modifying the functionality associated with the multi-user display. For example, the user interface (UI) behavior can be modified based on the transfer. In one example, the UI can switch from a single-user mode to a shared mode (i.e., multi-user mode). In multi-user mode, a new application window can be opened, displaying shared content between the users. Another example is the ability to modify the UI interaction model, such as how to launch an application, how to execute windows, etc. One example is that, upon pen transfer, any subsequent keyboard entries are directed to the shared application window instead of the previous user interface context.

[0006] In other embodiments, relationships between users can be automatically established due to pen transfer. For example, communication channels can be automatically established between users' personal devices, such as between users' laptops or telephones. Relationships can also be automatically established on social media by connecting users involved in pen transfer.

[0007] In other embodiments, the pen delivery can influence how digital agents are utilized during a meeting. For example, an artificial intelligence (AI) agent can treat the active user of the stylus differently from other users in the meeting environment. A simple example is that the active user can be interpreted as the leader of the conversation and can be given higher priority for agenda items, calendar events, etc., than other participants in the meeting.

[0008] The foregoing and other objects, features and advantages of the present invention will become more apparent from the following detailed description with reference to the accompanying drawings. Attached Figure Description

[0009] Figure 1 This is a diagram of a collaborative environment where users are interacting with multiple user displays.

[0010] Figure 2 It is a diagram showing multiple users interacting with multiple user monitors, where pen input causes a new application window to open.

[0011] Figure 3 This is an example of a digital converter circuit used in conjunction with a multi-user display to receive touch and stylus signals.

[0012] Figure 4 This is an example of hardware circuitry used in a stylus.

[0013] Figure 5 This is another example showing further details of the hardware circuitry used in a stylus with multiple hardware components to assist in identifying active users.

[0014] Figure 6 This is an exemplary environment that illustrates the combination of components of a multi-user display with other services coupled to the multi-user display.

[0015] Figure 7 This is an example of opening an application window with shared content in response to passing the stylus to different users.

[0016] Figure 8 This is an example demonstrating how third-party social media websites can be integrated with pen delivery.

[0017] Figure 9 This is an example demonstrating how the user interface interaction model can be modified in response to pen input.

[0018] Figure 10 This is a flowchart of a function for adjusting a multi-user display in response to pen input, according to one embodiment.

[0019] Figure 11 This is a flowchart of a function for adjusting a multi-user display in response to pen input, according to another embodiment.

[0020] Figure 12 It is an exemplary computing system that can be used to implement any of the embodiments described herein. Detailed Implementation

[0021] Overview In a multi-user collaborative environment, operating system state changes can be easily achieved by passing a stylus from one user to another. State machine transitions can lead to changes in user experience upon detecting a change in the active user. In one example, changes in user experience include alterations to user interface (UI) functionality. Some examples include: changing the color of the displayed digital ink, changing the writing mode to make the user's handwriting clearer (e.g., consistent or with a crisp font), automatically switching the view displayed on the UI, etc. The switched view can switch from single-user mode to multi-user mode. In another example, state machine transitions can lead to connections being established between devices (e.g., phones or laptops) associated with the user using the pen. For example, when a pen transfer occurs, it can affect which devices share the main operating system with the multi-user display. Additionally, pen transfers can lead to social networking connections between users. In yet another example, the person holding the stylus is considered the leader of the session, and a digital agent (artificial intelligence (AI) agent) can provide the leader with elevated state levels. For example, the leader can direct actions to be taken in meeting minutes, while others in the meeting have different state levels. Alternatively, AI can create distinct roles for the person holding the stylus, past owners of the stylus, and other participants who have not yet used the stylus. These and other examples are further illustrated below with reference to the accompanying figures.

[0022] Figure 1An exemplary interactive display environment 100 is illustrated. In this case, the environment includes an interactive multi-user digital display 110. The interactive multi-user display is a display in which multiple input devices can be used simultaneously by different users. For example, in such a display, two or more application windows (accepting user input) can be focused simultaneously. Additionally, the multi-user display can accommodate different logins for different users working simultaneously on the multi-user display. One or more users (shown as user A and user B) can participate in an interactive experience using the multi-user display 110. The multi-user display may include a multi-user interactive display screen 116, digitizer hardware (not shown, but...) Figure 3 (described in the text) and processing hardware (not shown, but in...) Figure 4 and Figure 5 (As described in the text) and multiple sensors (such as sensor 120). The display screen can be any of a variety of screens, including but not limited to: light-emitting diode (LED) screens, liquid crystal screens, electroluminescent screens, plasma screens, and / or other display and screen types under development or yet to be developed.

[0023] Sensor 120 may include one or more cameras for capturing an area in front of the multi-user display. The cameras may be configured for visible light, infrared, and / or other frequencies. The cameras may operate in conjunction with an infrared-mode projector to assist the cameras in distinguishing objects. Other camera configurations may use time-of-flight or other technologies to enhance the information captured by the cameras about one or more users and / or the environment. In one implementation, the sensor set may be Kinect® branded sensing technology provided by Microsoft RTM® Corp. Additionally, sensor 120 may include audio hardware for capturing voice interaction with display 110. Other types of sensors may be used, such as pressure sensors integrated into screen 116. Any number of desired sensors may be used to detect user engagement with the multi-user display, including assisting in detecting when pen transfer occurs and assisting in identifying which user is active. Different levels of detection may be used to identify users. For example, camera and voice recognition may be considered low-level identification, while stylus fingerprint recognition may be high-level user identification. Once a user has been detected, the set of sensors 120 can track the user's position relative to the screen 116 and can track movement to detect stylus input or determine if the user is attempting user commands, such as writing on the screen or making control gestures.

[0024] Environment 100 represents a meeting environment. In such an environment, each user can bring personal devices 130, 132 to the meeting. In this example, personal devices 130, 132 are laptops, but other mobile devices, such as mobile phones 134, are also typically brought to the meeting. These personal devices 130, 132, 134 can be used to input commands or content into display 110 or to assist in user identification. Identification of a specific user can be accomplished by identification signals sent from the user's personal device (such as via Bluetooth or other communication protocols). Such signals can be received by sensor 120, display 110 itself, or other devices in the meeting room (such as AI front-end 150). The AI ​​front-end can be used in conjunction with a back-end server computer (not shown) to perform cloud-based functions, such as taking meeting minutes, adding calendar events, etc. The AI ​​front-end will be discussed below. Figure 6 Further details are provided below.

[0025] Users can interact with the multi-user display simultaneously and using multiple input devices. For example, user A is shown using stylus 160, while user B inputs data using touch commands, as shown at 162. As further described below, stylus 160 and sensors 120, 150 can include a number of hardware devices for capturing biometric attributes associated with the user, including but not limited to: fingerprints (using a fingerprint sensor in the stylus), facial imaging (using a camera, such as the one included in sensor 120), voice recognition (using a microphone, such as the one included in AI voice recognition 150), and so on. Thus, two or more different sensors can cooperate to provide user identification information. Metric (i.e., measurable) attributes can also be used to identify the user, including grip (finger positioning sensor in the stylus), pressure (pressure sensor in the stylus), stylus angle during use (gyroscope in the stylus), writing speed (timer in the stylus), and changes in writing speed (accelerometer in the stylus). Typically, the stylus 160 communicates with a digitizer below the screen 116 to transmit identification information to the operating system running on the multi-user display. Other information, such as camera data, can also be communicated to the operating system. The camera data can be used to assist in identifying the stylus angle during use, as well as the other measurements mentioned above.

[0026] When a touch command is detected as shown at point 162, fingerprint (and / or other biometric) analysis can be used to identify the user executing the command. Fingerprint analysis can also identify which individual finger of the user is touching the screen and the orientation of the finger. This information can be used to analyze whether two users are simultaneously touching areas of the pad, and finger orientation can indicate which finger belongs to which user. Detecting a user means determining the presence of the user and has the ability to identify the user to any degree. Therefore, detection can include knowing only the relative position of the person without knowing their actual identity, or knowing both the person's position and identity, thereby enabling the retrieval of personal information from a database.

[0027] When the stylus 160 is passed between user A and user B, it indicates the relationship between the users: whether they are work colleagues or friends. This recognition of the relationship can be utilized by using any of the aforementioned sensors in the environment 100, including sensor 120 and stylus 160. For example, the operating system can detect the presence of user A's fingerprint during a first time period and user B's fingerprint during a second time period. Therefore, when different users are detected holding the stylus 160, it indicates that a pen transfer has occurred. At this point, the operating system can change the state to adjust the user experience for one or both of the users who received and delivered the pen. The adjusted user experience can include establishing a communication channel between personal devices 130, 132, or 130, 134. Such a communication channel can be established via Bluetooth or other wireless communication channels or via network communication channels. Adjusting the user experience can also include changing the UI in some way, such as how to launch a new application, open a new application window, or the location of the application window. Additionally, the AI ​​voice recognition 150 can adjust its behavior by prioritizing the active user of the stylus. Therefore, information from a meeting can be interpreted as the active user being the leader of the meeting. Leaders can be prioritized for tasks such as setting agenda items, scheduling meetings, and inviting other team members. Other behavioral adjustments can include distributing notes to users, changing the language model based on who is speaking, and so on.

[0028] Figure 2A multi-user display 210 is shown, in which user A has an open application window 220 and is using a stylus 230 to input data into the application. As indicated at 240, user A passes the stylus 230 to user B. The multi-user display 210 detects that user B is now the active user of the stylus 230. As a result, a new application window 250 is automatically opened, and user content associated with user B is automatically displayed. Therefore, as a result of changing the active user of the stylus 230, the multi-user display 210 adjusts the functions associated with the user interface of the multi-user display 210. Other functions associated with user B can include automatically changing the digital ink color displayed when user B writes data into the application window 250. Other digital ink attributes can also be changed, including but not limited to: the width of the ink strokes, brush style (e.g., calligraphy, pressure ink absorption, pencil mode and fountain pen mode, thick marker and ballpoint pen, etc.). Other exemplary changes to functions can be controlled via button action mapping. Such adjustments to functions can be stored in a user profile as customization options that occur during pen transfer. Recognizing user B also allows the multi-user display to obtain profile data associated with user B, such as handwriting patterns, and whether user B is left-handed or right-handed. Knowing the user's handwriting pattern allows the system to display the user's handwriting in a more consistent manner. Therefore, if the user makes the letters more messy than usual, the multi-user display 210 can alter the letters so that they appear to be the same letters stored in the user's profile. Knowing whether the user is left-handed or right-handed allows the system to better interpret handwritten data input into the application window. For example, detecting the user's palm is useful to ignore the location where the palm touches the multi-user display screen.

[0029] Exemplary digital converter Figure 3A digital-to-digital converter (DDC) circuit capable of detecting stylus signals associated with the multi-user display is illustrated. Typically, the DDC circuit is positioned directly behind the display screen, which includes an outer glass panel. The DDC converts analog signals into digital signals. For example, user interface actions such as pressing or swiping on a touchscreen are converted into digital signals to allow the user to write, erase, or move content displayed on the touchscreen. The stylus typically includes a first end, referred to as the stylus tip, for writing content and a second end for performing digital erasure of the content. As further described below, the stylus tip and / or eraser end are capable of transmitting signals to the multi-user display for operation as a user input device. When the stylus is detected, it can switch to one of several candidate protocols without user interaction to communicate with the DDC. The stylus can then dynamically set the protocol for communicating with the DDC, matching the protocol desired by the DDC. Setting the protocol can affect the waveform generated by the stylus. For example, transmit and receive time slots can conform to the selected protocol and transmit modulation. Finally, the stylus can enable components supported by the selected protocol or a specific digital converter.

[0030] Figure 3 A digitizer circuit 300 is shown. The digitizer circuit 300 includes multiple electrodes, including column electrodes 310 and row electrodes 312. Columns are positioned above rows with gaps between them to form capacitance between each column and row. When a finger or stylus comes into contact with the surface of the digitizer, the capacitance between the columns and rows of electrodes changes. Multiple receiver circuits 320 can be used to sense the changing capacitance, indicating the position of the user's finger or stylus on the digitizer. The digitizer 300 also includes multiple transmitters 330, one transmitter per row electrode 312, for transmitting touch signals across the electrodes in a scanning mode. The transmitted touch signals are received at the column receivers 320 to detect any changes in capacitance. When a stylus comes into contact with the surface of the digitizer, the column electrodes 310 are also capable of receiving stylus signals. The position of the stylus can be determined based on which column electrode 310 is receiving the strongest stylus signal.

[0031] Exemplary stylus circuit Figure 4 A first embodiment of a stylus circuit capable of being used to analyze touch signals from a digital converter is shown. The stylus circuit 400 includes a receiver circuit 410 configured to receive signals from a digital converter positioned near the stylus. Figure 3The receiver receives wireless touch signals in analog form. An analog-to-digital converter (ADC) 420 is coupled to the output of the receiver to convert the analog touch signals into digital signals for processing by the stylus circuitry 400. The output of the ADC is coupled to a signal processing circuitry 430, which includes a processor 440 (which can be a general-purpose processor, ASIC, or microcontroller) and any necessary supplementary signal processing circuitry 450. The processor 440 is coupled to the supplementary signal processing circuitry 450 so that the processor 440 can receive various different data related to the characteristics of the touch signals received from the ADC. The supplementary signal processing circuitry 450 can also be directly coupled to the receiver 410 so that the supplementary signal processing circuitry 450 can directly process the amplified signal without the ADC. As further described below, the characteristics received from the ADC 420 or the receiver 410 can relate to time-based or frequency-based characteristics of the touch signals, including the rise time of the touch signals, the pulse characteristics of the touch signals, the frequency characteristics of the touch signals, and so on. The processor 440 can communicate with the ADC via a wireless transmitter 470 using a selected protocol. Typically, processor 440 uses the aforementioned protocol to send data (such as stylus-related data) to the digitizer. For example, stylus-related data can include the stylus's serial number, pressure data, the status of any buttons on the stylus, battery level data, and inertial measurement unit (IMU) data. The IMU can be used to retrieve data about forces, angular velocities, and magnetic fields around the stylus. Additionally, the accelerometer, gyroscope, and magnetometer within the IMU can be used independently. Additional information can include information associated with user identification, such as the information described below. Figure 5 Further description of the measurement or biometric data.

[0032] Figure 5 Showing from Figure 4 Further details of the signal processing circuit 430. For clarity, the following is repeated (from...). Figure 4The system consists of a receiver 410 and an ADC 420. The receiver 410 receives touch signals from a digitizer as previously described. These touch signals are converted into digital signals by the ADC 420. The output of the ADC can be provided to multiple different hardware and / or software components for performing signal processing on the touch signals. For example, the processor 440 itself can perform some or all of the signal processing shown to be performed by other components. These other components can be directly coupled to the receiver 410 without going through the ADC. A correlation engine 510 is coupled to the output of the ADC 420. The correlation engine 510 correlates data between detected touch signals with signatures stored in the stylus's memory 460. The correlation engine 510 can perform various correlation types of functions, such as comparing points in a received waveform with points in a stored waveform to detect similarities between waveforms. If the similarity exceeds a threshold level 511, the correlation engine determines that a match has been found. The threshold level 511 can be based on a constant or can be programmed by the user. The correlation function performs point-to-point multiplication and adds the results to generate a correlation output C. The higher the output of the correlation function, the greater the likelihood that the two functions are correlated. If the output of the correlation function exceeds a threshold level of 511, then the touch signal is determined to match the signature in memory.

[0033] In addition to or as an alternative to the correlation engine 510, a Fast Fourier Transform (FFT) engine 512 can be used. The FFT engine 512 receives the touch signal from the ADC 420 and performs frequency analysis on the touch signal. Specifically, as further described below, different manufacturers can have different spectra associated with their touch signals. For example, some suppliers may use different frequencies, meaning their respective FFTs will have dominant peaks at different locations. In some cases, the FFT engine can also be used to distinguish digital converters operating at the same fundamental frequency if their harmonics have different amplitudes (e.g., due to drivers with different slew rates). The FFT output can be passed to a processor 440, which can compare the output from the FFT engine 512 with signature frequency data stored in memory 460. Based on this comparison, identification of the digital converter is possible.

[0034] Envelope detector 516 can be coupled to the output of receiver 410 to perform envelope analysis on the input touch signal. Envelope detector 516 can track peaks in the input touch signal and, depending on the time constant, can track individual peaks or the general shape of a series of pulses. The output of envelope detector 516 can be passed to processor 440 for analysis. Specifically, the processor can compare the various pulse characteristics determined by envelope detector 516 with pulse characteristics stored in memory 460. If the pulse characteristics match, the processor can use memory 460 to retrieve the brand and model of the digitizer. Specifically, the data record in memory 460 can store the brand and model of the digitizer and signature data associated with the digitizer, so that the brand and model can be retrieved when the signature matches. Additionally, the same data record can store protocol-related information for use with the digitizer. This information can be individual parameters or configuration settings.

[0035] The pulse train characterizer 520 can be coupled in parallel to the receiver 410 with the correlation engine 510, the fast Fourier transform engine 512, and the envelope detector 516. The pulse train characterizer 520 can include a timer and a comparator for measuring the pulse width, pulse train length, and pulse train duration. Such characteristics of the pulses or combinations of pulses constituting the touch signal can be used as a signature to detect the type of digital converter generating the touch signal. Other pulse-related characteristics, such as the number of pulses, the amplitude of the pulses, and the length of the gaps between pulses, can be used.

[0036] The signal processing circuit may also include a rise time start comparator 530, a rise time end comparator 532, and a timer 534. The rise time start comparator 530 and the rise time end comparator 532 are coupled in parallel to the receiver 410 for receiving touch signals. Upon receiving the first pulse of the touch signal, the rise time start comparator starts the timer 534, such as at the rising edge of the pulse. When the pulse reaches its maximum amplitude, the rise time end comparator 532 stops the timer 534, such that the timer accurately reflects the rise time of the pulse associated with the touch signal. The timer output can be coupled to a processor 440, which can then compare the rise time with a rise time stored in memory 460. As a result, the rise time represents a signature of the touch signal that can be compared with a known signature stored in memory, used to identify the manufacturer, model, or configuration of the digitizer. Additionally, such timing can be associated with typical user patterns to aid in user identification.

[0037] Using one, more, or all of these various signal processing components, the processor is able to identify which digitizer generated the touch signal received on receiver 410. The processor is then able to select a suitable protocol for communication with the detected digitizer and is also able to enable electronics 550 on the stylus. These electronics can be various different components and / or features, which may be supported only by a specific protocol or manufacturer, such as Bluetooth or other sensors on the stylus. Coupled to or incorporated into the electronics 550 are different hardware functions that can be used to identify the active user of the stylus. For example, a fingerprint sensor 560 can be included as a pad (not shown) on the outer body of the stylus. The fingerprint sensor 560 is used to identify the user of the stylus with a high degree of determinism. The fingerprint sensor includes electronics for capturing digital images of fingerprint patterns. The captured images (referred to as live scans) can be digitally processed to generate biometric templates for pattern matching. Various patterns of known users can be stored in memory 460.

[0038] An accelerometer 570 can be used to detect user characteristics at the start or stop of writing with the stylus. Different users typically start and stop at different speeds, allowing the accelerometer to assist in user identification. One or more pressure sensors 572 detect the amount of force applied by the user when holding the stylus. Similarly, such pressure sensing can assist in user identification. A finger position sensor 574 can be used to detect how the user holds the stylus, such as the distance between the index finger and thumb. This characteristic can be used as an identification factor. Finally, a gyroscope 576 can be used to determine the angle at which the user holds the pen, which is also an identification characteristic. Using one or more such identification circuits, the stylus can determine when the pen movement occurs. Other sensors can be used individually or integrated into the sensors described above, such as capacitive sensors, transducers, and ultrasound. For example, using ultrasound, both continuous wave and pulsed ultrasound signals can be used to determine the distance or position of the stylus. Using a capacitive sensor, the user's finger position can be determined. Furthermore, specific user identification can be determined. The identification information or collected data can be transmitted wirelessly to the multi-user display, which can access additional processing power, such as via a network, to enable identification. If a user is identified, profile information can be obtained from the network and used to interpret the user's handwriting or otherwise perform user-related actions, such as retrieving data used to launch the user's applications or other personal data.

[0039] Exemplary display system Figure 6An exemplary display system 600 including a display screen 610 is illustrated. The display screen can be any of a variety of screens, including but not limited to: light-emitting diode (LED) screens, liquid crystal screens, electroluminescent screens, plasma screens, and / or other display and screen types under development or yet to be developed. Typically, the display screen 610 is an external glass plate touched by a user with a finger or a stylus. The capacitive effects of user interaction with the display screen 610 can be captured by a digitizer 620. As described above, the digitizer includes multiple rows and columns of electrodes that can be used to detect the capacitive effects of the stylus. The digitizer 620 can be used to convert analog signals into digital signals to capture the position of the stylus.

[0040] Processor 630 can be coupled to digitizer 620 and execute an operating system for controlling the display system. The processor can be a general-purpose central processing unit (CPU), an application-specific integrated circuit (ASIC), or any other type of processor. As shown at 632, when the number of active users of display screen 610 changes, the operating system partially alters the state of the state machine shown at 632. This change in the state of the operating system causes adjustments to the functionality of the multi-user display. As previously mentioned... Figure 1 and Figure 5 As described, the identification signal can be sent from any of various electronic components (fingerprint sensor, accelerometer, gyroscope, etc.) to identify that the active user of the stylus has changed. In the example shown at 632, the operating system can change its state from single-user mode to multi-user mode due to pen input. Other changes of functionality are further described herein with reference to other figures. However, in all cases, the adjustment function means that the operating system state transitions from one state to another in response to pen input. Thus, two states are shown as a minimal example of a larger state machine. The operating system, then executing on processor 630, can then transmit display data to rendering engine 640, which displays the display data on display screen 610.

[0041] The operating system running on processor 630 is also capable of communicating with third-party service 660 via network 650. Network 650 can be any type and / or form of network and can include any of the following: point-to-point network, broadcast, local area network or wide area network, telecommunications or data communication network, computer network, ATM (Asynchronous Transfer Mode) network, SDH (Synchronous Digital Hierarchy) network, SONET (Synchronous Fiber Network), wireless network, and wired network. The network can also include wireless links, such as satellite bands or infrared channels.

[0042] The third-party service 660 can be, for example, a social network, such as a social networking website. If the operating system detects a change in active users, it can send a request to establish a relationship between the active user of the stylus and the previously active user of the stylus. For example, because two users are communicating using the same display 610 and they are sharing a stylus, the operating system assumes the users are colleagues or friends. In some embodiments, the stylus can provide identifiers for new and previously active users. These identifiers can be associated with user-specific data storage 634 for access tokens to third-party services (e.g., OAuth2 tokens for LinkedIn®, Facebook®, etc.). Tokens can be populated in the database to access third-party services based on explicit user authorization. The token is associated with the user identifier. By knowing the two identities involved in the transmission interaction, the detection of the stylus transmission causes an API request (e.g., an HTTP request to a REST API) on behalf of one of the two users to "connect" the user using the associated access token. Connecting users includes the ability to share content associated with each user's account with other users. The third-party service can then track interactions between people for purposes such as sales, networking, relationship management, etc.

[0043] It is possible to replace third-party services with enterprise-based services or local (on-system) services. An example local service could be a shared device pre-caching another user's content (based on their interaction history) when the current user is active. For enterprise services, enterprises can intelligently understand how their employees interact with each other and infer performance metrics given some interaction history.

[0044] The operating system can also be coupled via a network to, for example, an AI speech recognition engine 670. Engine 670 can communicate with a backend AI server 680 to assist in recognizing speech patterns and commands, enabling it to identify which user is speaking in a meeting and make informed decisions about possible actions. The operating system can pass user identifiers to engine 670 associated with the system's most recently active users. The backend AI server 680 can then use these identifiers to determine which user is active. When it comes to actions and setting up scheduled meetings, the identified active users can be given higher status.

[0045] Switching from single-user mode to multi-user mode Figure 7A multi-user display 700 is illustrated, in which two users (User A and User B) previously interacted simultaneously in application windows 710 and 720 on the multi-user display. At a time point indicated at 726, a stylus 728 is transferred from User A to User B. As a result, the operating system detects the pen transfer to switch the active user from User A to User B. This detection occurs because the operating system receives an identification signal from the stylus 728 indicating that User A used the pen during a first time period, and then the operating system receives an identification signal indicating that User B now controls the stylus 728. In response, the operating system is able to automatically launch a shared application 730 at a location within the multi-user display 700, which includes shared content such as content associated with User A and content associated with User B. For example, some content from application window 710 and some content from application window 720 are moved into the shared application window 730. Thus, the operating system adjusts the functionality of the multi-user display by automatically switching the user interface view in response to the change in the active user. Changing the user interface view means being able to open and move the application window to accommodate a change from single-user mode to multi-user mode. For example, when a new application window 730 is opened, application window 710 can move to the right to accommodate the new window 730. Similarly, application window 720 can move to the left to create a gap between application windows 720 and 710, large enough to display application window 730. Typically, application window 730 will open somewhere between where user A and user B previously interfaced with the multi-user display.

[0046] Application window 730 includes shared content. In the illustrated embodiment, the shared content includes content associated with user A and content associated with user B. Such content can be derived from open applications associated with each user or stored content associated with each user. Specifically, user A and user B are each logged into a multi-user monitor, and each user has different access permissions to stored information. Such stored information can be retrieved by the operating system of the multi-user monitor and presented in the shared application window 730. In some aspects, the multi-user monitor can be considered as the same display screen running different virtual computers to which both user A and user B are logged. However, when a pen transfer occurs, the system automatically switches to shared mode, where both users are logged into the same virtual computer running the shared application window 730. Furthermore, prior to pen transfer 726, multiple application windows 710, 720 are in focus, but the pen transfer switches the view, causing application windows 710 and 720 to be removed from focus, and application window 730 to be placed in focus. Keyboard entries from either User A or User B (from a personal device) can then be directly accessed in the shared content window 730. Therefore, when User A and User B share an application canvas where multiple applications are running simultaneously and are in focus, the stylus 728 triggers a change, taking into account the content displayed on the multi-user monitor 700. This change in view can lead to changes in the rules governing user input (to the input of both users in the shared application window), changes in login status (both users are logged into the virtual computer executing the shared application 730), and changes in the appearance and feel of the user's monitor, such as the automatically opening of a new application window. An example of this change in appearance and feel is that the new application 730 can be opened as a full-screen window to accommodate the sharing aspect. Thus, in single-user mode, a smaller application window can be opened, but in shared multi-user mode, a larger application window can be opened, and the switch from single-user mode to multi-user mode can be automatic by simply handing the stylus to different users.

[0047] Relationships are established between users through the passing of pens. Figure 8 The illustration depicts the establishment of a third-party relationship in response to a pen transfer. Establishing a relationship means that users can share content at least electronically, such as through a communication channel or by using a third-party website. In some contexts, a pen transfer between user A and user B can result in the establishment of a relationship between these users outside the context of the multi-user display 800. Previously, this has been discussed in relation to... Figure 1As described, pen transfer can lead to the establishment of communication channels between users' personal devices. For example, a communication channel can be established between users' laptops or smartphones. However, it is also possible to establish relationships between users on third-party websites. For example, a processor 810 associated with a multi-user display 800 can detect changes in the active users of the stylus and retrieve access tokens accordingly from a database 820 associated with a third-party service. The processor 810 can then generate an API for a third-party website 830, including tokens for users A and B. The API can request the establishment of a connection between users A and B, allowing users to share content through a third-party social media website.

[0048] In a particular embodiment, the stylus 840 provides identifiers for new active users and previously active users. These identifiers can be associated with user-specific data storage 820 for access tokens to third-party services (e.g., OAuth2 tokens for LinkedIn®, Facebook®, etc.). Tokens can be populated in the database to access the third-party service based on explicit user authorization. By knowing the two identities involved in the interaction, the stylus transfer is detected to cause an API request (e.g., an HTTP request to a REST API) on behalf of one of the two users to "connect" the user using the associated access token. The third-party service can then track interactions between people for purposes such as sales, networking, relationship management, etc.

[0049] It's possible to replace third-party services with enterprise-based or local (on-system) services. An example local service could be: a shared device pre-caching another user's content (based on their interaction history) while the current user is active. For enterprise services, businesses can intelligently understand how their employees interact with each other and infer performance metrics given some interaction history. Therefore, it's possible to track collaboration between employees and use it for performance measurements to determine how collaboration impacts productivity. Collaboration, such as that indicated by pen passing, can be a more efficient way to track two or more people working together. Other technologies, such as tracking meeting attendance (or other available metrics), may not be as effective as tracking pen passing. For example, pen passing indicates proactive collaboration between users, while being with multiple people in a meeting is a location-based metric and doesn't necessarily mean people are working together.

[0050] The selection of which third-party websites to use can be based on the location transmitted by the pen. For example, the processor 810 can determine the working location of the multi-user monitor 800 based on GPS coordinates. In this case, the third-party website could be a commercial website. On the other hand, if the multi-user monitor is located in a social location, such as a restaurant, bar, or resort, then the third-party website could be a social networking site. Therefore, the processor 810 can select one of several third-party websites based on the location of the multi-user monitor.

[0051] Change the user interface view based on pen input Figure 9 The illustration shows how the user interface can be modified based on pen input. Figure 9 A top view of the multi-user display 900 illustrates the user interface 906 prior to the pen transfer from user A to user B. User A is shown working in application window 910, which is the application in focus before the pen 912 is transferred. When user A transfers the pen 912 to user B, the view of the user interface changes. This change in user interface 906 can be seen in a bottom view of the multi-user display 900. Specifically, application window 910 moves to the right on user interface 906 to make room for user B on the multi-user display. In some embodiments, application window 910 can remain in focus, allowing user A to continue inputting data into the application. Additionally, a new application window 920 is opened for user B, which can also be in focus simultaneously with application window 910. Thus, as a result of the pen transfer (transferring the user's input stylus from one person to another), the user interface view can be modified. For example, the application window can be moved to the right or left, and a new application window can be opened to accommodate a new active user. Therefore, switching the user interface view can mean any of the following: opening a new application window, moving an application window, or changing the application in focus.

[0052] Other UI changes may also occur. For example, user identification data can be passed to the application, and the application can use the identification information to obtain stored preferences for the user. Exemplary preferences may include layout settings, display settings, language preferences, browser settings, desktop settings, etc.

[0053] A pen-based method for interacting with multi-user displays Figure 10 This is a flowchart of a method for interacting with a multi-user display. In processing block 1010, the first user of the stylus is detected. Detection implies performing some level of identification to eliminate ambiguity between one user and another. Such detection can be accomplished using any electronic component described herein, such as a fingerprint sensor 560 (…). Figure 5The stylus includes an accelerometer 570, a pressure sensor 572, a finger position sensor 574, and / or a gyroscope 576. Additional cameras and voice sensors can also be used for identification. Different levels of identification can be used to detect the first user. For example, knowing the angle at which the user writes or the past history of the pressure applied by the user while writing can be used for low-fidelity identification. Higher-fidelity identification, such as through fingerprint analysis, can also be used, leading to a high degree of certainty in identifying the user. Once a user's identification is detected, it can be periodically checked and transmitted to a processor in a multi-user display. In this way, the multi-user display can track the user of the stylus. An exemplary detection method can include the operating system reading all the sensors identified above from the stylus and determining which sensors include identification information. The operating system can then apply weights to different inputs to identify users with varying levels of intensity. For example, the highest weight can be given to valid fingerprints, while lower weights can be given to camera data.

[0054] In processing block 1020, it is possible to detect when a stylus is passed to a second user. Once the second user begins using the stylus, the identification information captured by the stylus changes according to the second user. The stylus can then transmit the new identification information to the processor within the multi-user display. The operating system associated with the multi-user display can then switch states based on this detection of the change in the active user of the stylus. The change in the operating system's state causes the functions associated with the multi-user display to adjust in response to the change in the active user. The operating system can maintain a list of stylus users, including which user is the active user, and the active user is the user currently using the stylus to input data into the multi-user display. The user list can be stored in operating system-accessible memory, such as memory within the processor running the operating system or external memory.

[0055] In processing box 1030, the functionality of the multi-user display is adjusted in response to changes in the active user of the stylus. Adjusting the functionality means that the user experience associated with the multi-user display changes. Adjusting the functionality includes any of a variety of different functions that can be changed in the multi-user display. Several examples have been described herein, including automatically switching the user interface view of the multi-user display in response to changes in the active user. Changing the view of the user interface can include moving an application window or opening a new application window. Adjusting the functionality can also include opening a user interface window containing shared content between a first user and a second user. The new user interface window can have associated permissions different from other open windows on the user interface. For example, it is possible to assume that multiple users are logged into the new interface window, while other windows only allow a single user. Other adjustments to the functionality include automatically establishing a relationship between the first user and the second user. Establishing the relationship can include connecting the first user and the second user on a third-party social networking site or establishing a network connection between the personal devices of the first user and the second user. Establishing the relationship can also include establishing a trust relationship between the users, which affects functionality such as allowing content to be transferred between users. Adjusting the functionality can also include changing the functionality of the AI ​​system based on the active user. Such adjustments to the AI ​​system include performing speech recognition and treating commands from active users as having a different priority (e.g., higher priority) than commands from other users. Other adjustments to the multi-user interface are also possible.

[0056] Figure 11 This is a flowchart of a method for interacting with a multi-user display according to another embodiment. In processing block 1110, input data is received from a stylus that identifies a first user. In this example, the stylus is capable of wirelessly transmitting identification information about an active user. As previously discussed, various hardware components available on the stylus can be used to obtain the identification information. In processing block 1120, input data identifying a second user, different from the first user, can be received from the stylus. The identification of the second user is close in time (e.g., less than 1 minute) to the receipt of the first user's identification information, indicating that a pen transfer has occurred. In processing block 1130, in response to a change in the active user, the functionality of the multi-user display can be modified. Modifying the functionality includes changing the user experience associated with the multi-user display. Such modified functionality includes switching from single-user mode to multi-user mode. Other modified functionality can include modifying the UI view displayed on the multi-user display. Other adjustments to the functionality have been described herein.

[0057] Computing System Figure 12A generalized example of a suitable computing system 1200 in which the described invention can be implemented is depicted. The computing system 1200 is not intended to impose any limitation on the scope of its use or functionality, as the invention can be implemented in various general-purpose or special-purpose computing systems. The computing system 1200 is capable of being used as a multi-user display.

[0058] refer to Figure 12 The computing system 1200 includes one or more processing units 1210, 1215 and memories 1220, 1225. Figure 12 In the diagram, the basic configuration 1230 is enclosed within the dashed lines. Processing units 1210 and 1215 execute computer-executable instructions. The processing units can be general-purpose central processing units (CPUs), processors in application-specific integrated circuits (ASICs), or any other type of processor. In a multiprocessor system, multiple processing units execute computer-executable instructions to increase processing power. For example, Figure 12 A central processing unit 1210 and a graphics processing unit or coprocessor 1215 are shown. Physical memories 1220 and 1225 may be volatile memories (e.g., registers, caches, RAM), non-volatile memories (e.g., ROM, EEPROM, flash memory, etc.), or some combination of both, accessible by one or more processing units. Memories 1220 and 1225 store one or more innovative software 1280 implemented herein in the form of computer-executable instructions suitable for execution by one or more processing units.

[0059] The computing system may have additional features. For example, computing system 1200 includes storage device 1240, one or more input devices 1250, one or more output devices 1260, and one or more communication connections 1270. Interconnect mechanisms (not shown) (such as buses, controllers, or networks) interconnect the components of computing system 1200. Typically, operating system software (not shown) provides an operating environment for other software executing in computing system 1200 and coordinates the activities of the components of computing system 1200.

[0060] The physical storage device 1240 may be removable or non-removable and includes a disk, magnetic tape or cartridge, CD-ROM, DVD, or any other medium capable of storing information and accessible within the computing system 1200. The storage device 1240 stores instructions for implementing one or more innovative software 1280 described herein.

[0061] One or more input devices 1250 may be touch input devices such as a keyboard, mouse, pen, or trackball, voice input devices, scanning devices, or other devices that provide input to the computing system 1200. In the specific embodiments described herein, a stylus can be used as an input device. For video encoding, one or more input devices 1250 may be a camera, video card, TV tuner card, or similar devices that accept video input in analog or digital form, or read video samples into a CD-ROM or CD-RW in the computing system 1200. One or more output devices 1260 may be a display, printer, speaker, CD burner, or other devices that provide output from the computing system 1200.

[0062] One or more communication connections 1270 enable communication with another computing entity via a communication medium. The communication medium conveys information or other data, such as computer-executable instructions, audio or video input or output, in a modulated data signal. The modulated data signal is a signal whose one or more characteristics are set or altered in a manner that encodes information in the signal. By way of example, and not limitation, the communication medium can be electrical, optical, RF, or other carriers.

[0063] This invention can be described within the general context of computer-executable instructions, such as those included in program modules, which execute on a computing system on a target real or virtual processor. Typically, program modules include routines, programs, libraries, objects, classes, components, data structures, etc., that perform specific tasks or implement specific abstract data types. In various embodiments, the functionality of program modules can be combined or divided among program modules as needed. The computer-executable instructions for program modules can execute within a local or distributed computing system.

[0064] The terms “system” and “device” are used interchangeably herein. Unless the context clearly indicates otherwise, neither term implies any limitation on the type of computing system or computing device. Generally, a computing system or computing device can be local or distributed and can include any combination of dedicated hardware and / or general-purpose hardware with software that implements the functions described herein.

[0065] For introductory purposes, terms such as "determine" and "use" are used in detail to describe computer operations in a computing system. These terms are high-level abstractions of operations performed by a computer and should not be confused with actions performed by humans. The actual computer operations corresponding to these terms vary depending on the implementation.

[0066] Although some operations of the disclosed methods are described in a specific order for ease of presentation, it should be understood that this descriptive approach includes rearrangement unless the specific language used below requires a particular order. For example, in some cases, the sequentially described operations may be rearranged or performed concurrently. Furthermore, for simplicity, the accompanying drawings may not show the various ways in which the disclosed methods can be combined with other methods.

[0067] Any of the disclosed methods can be implemented as computer-executable instructions stored on one or more computer-readable storage media (e.g., one or more optical media disks, volatile memory components such as DRAM or SRAM, or non-volatile memory components such as flash memory or hard disk drives) and executed on a computer (e.g., any commercial computer, including smartphones or other mobile devices that include computing hardware). The term "computer-readable storage media" excludes communication connections such as signals and carrier waves. Any computer-executable instructions used to implement the disclosed techniques, and any data created and used during the implementation of the disclosed embodiments, can be stored on one or more computer-readable storage media. The computer-executable instructions can be, for example, part of a dedicated software application or a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software can be executed, for example, on a single local computer (e.g., any suitable commercial computer) or using one or more networked computers in a networked environment (e.g., via the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such networks).

[0068] For clarity, only certain selected aspects of the software-based implementation have been described. Other details well-known in the art have been omitted. For example, it should be understood that the disclosed techniques are not limited to any particular computer language or program. For instance, the disclosed techniques can be implemented using software written in C++, Java, Perl, or any other suitable programming language. Similarly, the disclosed techniques are not limited to any particular computer or hardware type. Certain details of suitable computers and hardware are well-known and do not need to be elaborated in this disclosure.

[0069] It should also be well understood that any functionality described herein can be performed, at least in part, by one or more hardware logic components rather than software. For example, but not as a limitation, illustrative types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-chips (SoCs), complex programmable logic devices (CPLDs), etc.

[0070] Furthermore, any software-based implementation (including, for example, computer-executable instructions for causing a computer to perform any of the disclosed methods) can be uploaded, downloaded, or remotely accessed via a suitable communication unit. Such suitable communication units include, for example, the Internet, the World Wide Web, an intranet, software applications, cables (including fiber optic cables), magnetic communication, electromagnetic communication (including RF, microwave, and infrared communication), electronic communication, or other such communication methods.

[0071] Alternative embodiments Other embodiments can be derived from the following numbered paragraphs.

[0072] 1. A method for interacting with a multi-user display, comprising: The multi-user display is used to detect the first user of the stylus; The system detects that the stylus has been passed to a second user to change the active user of the stylus; and The functions associated with the multi-user display are adjusted in response to changes in the active user of the stylus.

[0073] 2. According to the method described in paragraph 1, adjusting the function includes: automatically switching the user interface view of the multi-user display in response to the change of the active user.

[0074] 3. The method according to paragraph 1 or 2, wherein the user interface window has a shared context involving the first user and the second user.

[0075] 4. According to the method described in paragraph 3, the user interface window shares content between the first user and the second user.

[0076] 5. According to the method described in paragraphs 1-3, adjusting the function includes: establishing a relationship between the first user and the second user.

[0077] 6. According to the method described in paragraph 5, establishing the relationship includes: automatically connecting the first user and the second user on a third-party social networking website.

[0078] 7. According to the method described in paragraph 5, establishing the relationship includes: establishing a network connection or trust relationship between the personal device of the first user and the personal device of the second user.

[0079] 8. According to the method described in paragraphs 1-5, adjusting the function includes: changing the function of the artificial intelligence system based on the active users.

[0080] 9. According to the method described in paragraph 8, adjusting the function includes: performing speech recognition and processing commands from the active user differently from commands from other users.

[0081] 10. According to the method described in paragraph 8, adjusting the function includes: changing the operating system state in response to the change of the active user of the stylus.

[0082] 11. A display system, comprising: Multi-user interactive display screen; A processor for receiving input data associated with the currently active user of the stylus from the multi-user interactive display and from the stylus; Memory coupled to or within the processor; The processor is configured to execute a method, the method comprising: The first user of the stylus is detected at the first point in time. Detecting a second user of the stylus at a second time point indicates that the active user of the stylus has changed from the first user to the second user; The functions of the display system are modified in response to a change in the active user of the stylus.

[0083] 12. The display system according to paragraph 11, wherein detecting the first user includes detecting identification information associated with the first user, and detecting the second user includes detecting identification information associated with the second user.

[0084] 13. The display system according to paragraphs 11-12, wherein modifying the function includes: modifying the digital ink color associated with the active user.

[0085] 14. The display system according to paragraphs 11-13, wherein modifying the function includes: using profile information associated with the active user to modify the handwriting pattern associated with the active user's handwriting to make the handwriting appear more consistent.

[0086] 15. The display system according to paragraphs 11-14, wherein modifying the function includes: switching the user interface to display a shared application window, the shared application window including content from the first user and content from the second user.

[0087] Given the many possible embodiments to which the principles of the disclosed invention can be applied, it should be understood that the illustrated embodiments are merely preferred examples of the invention and should not be considered as limiting the scope of the invention. Rather, the scope of the invention is defined by the following claims. Therefore, we claim that our invention is fully compliant with the scope of these claims.

Claims

1. A method for interacting with a multi-user display, the multi-user display being configured to simultaneously receive input from a first user and input from a second user, the method comprising: The multi-user display is used to detect the first user of the stylus; It was detected that the stylus was passed to a second user to change the active user of the stylus; as well as In response to a change in the active user of the stylus, the operating system associated with the multi-user display is adjusted, wherein adjusting the function includes at least: switching the multi-user display from a single-user display mode to a multi-user display mode, wherein in the single-user display mode, the first user is designated as the active user and independent application windows associated with the first user and the second user are both in focus, wherein in the multi-user display mode, the second user is designated as the active user and a shared application window including content from the first user and the second user is in focus.

2. The method according to claim 1, wherein, Adjusting the functionality includes automatically switching the user interface view of the multi-user display in response to the change in the active user.

3. The method according to claim 1 or 2, wherein, The user interface window has a shared context involving the first user and the second user.

4. The method according to claim 3, wherein, The user interface window shares content between the first user and the second user.

5. The method according to claim 1 or 2, wherein, Adjusting the function includes: establishing a relationship between the first user and the second user.

6. The method according to claim 5, wherein, Establishing the relationship includes automatically connecting the first user and the second user on a third-party social networking website.

7. The method according to claim 5, wherein, Establishing the relationship includes: establishing a network connection or trust relationship between the personal device of the first user and the personal device of the second user.

8. The method according to claim 1 or 2, wherein, Adjusting the functionality includes changing the functions of the artificial intelligence system based on the active users.

9. The method according to claim 8, wherein, The adjustment to the function includes: performing speech recognition, and processing commands from the active user differently from commands from other users.

10. A display system, comprising: Multi-user interactive display screen; A processor for receiving input data associated with the currently active user of the stylus from the multi-user interactive display and from the stylus; Memory coupled to or within the processor; The processor is configured to execute a method, the method comprising: The first user of the stylus is detected at the first point in time. Detecting a second user of the stylus at a second time point indicates that the active user of the stylus has changed from the first user to the second user; The functionality of the display system on which the stylus is being used is modified in response to a change in the active user of the stylus, wherein the modified functionality includes at least: The display system is switched from a single-user display mode to a multi-user display mode, wherein in the single-user display mode, the first user is designated as the active user and the independent application windows associated with the first user and the second user are both in focus, and wherein in the multi-user display mode, the second user is designated as the active user and a shared application window including content from the first user and the second user is in focus, and When the first user is the active user of the stylus, a touch-based signal received at the display system according to a first set of parameters is processed, and when the second user is the active user of the stylus, a touch-based signal received at the display system according to a second set of parameters is processed, wherein the touch-based signal according to the first set of parameters and the touch-based signal according to the second set of parameters are processed differently by the display system based on the active user of the stylus.

11. The display system according to claim 10, wherein, Detecting the first user includes detecting identification information associated with the first user, and detecting the second user includes detecting identification information associated with the second user.

12. The display system according to claim 10 or 11, wherein, Modifying the function includes: modifying the digital ink color associated with the active user.

13. The display system according to claim 10 or 11, wherein, Modifying the functionality includes using profile information associated with the active user to modify the handwriting pattern associated with the active user's handwriting, so that the handwriting appears more consistent.

14. The display system according to claim 10 or 11, wherein, The modification to the function includes: switching the user interface to display a shared application window, the shared application window including content from the first user and content from the second user.