Visual status notifications on the edge of the display

Abstract

SOLUTION: To provide an edge lighting of a computing device (200), in which the computing device (200) comprises a display (265) containing a first part (280) and a second part (270), the first part (280) contains an actual part of a circumference of the display, and excludes the second part (270) of the display, and one or more processor (210) of the computing device (200) determines the change of a state of the computing device (200), determines a visual notification on the basis of the change of the state, and may perform an interface connection with the first part (280) of the display so as to output a light pattern on the basis of the visual notification.EFFECT: By an integration edge lighting, a user can quickly specify a change of a state of a computing device.SELECTED DRAWING: Figure 2

Description

[Background technology]

[0001] background Computing devices often enable various notifications that indicate changes in the state of the computing device. For example, mobile phones (including so-called "smartphones") may issue notifications that indicate that a cellular interface or other wireless interface has received an incoming call using vibration, a ringtone or other audible alert, a visual message or other graphical element, etc. Cellular phones may issue similar notifications that indicate that a cellular interface and / or other wireless interface has received a text message. Summary of the Invention [Problem to be solved by the invention]

[0002] However, cellular devices may issue conflicting notifications for other features of the cellular phone. For example, a cellular phone may include a near-field communication (NFC) interface, a personal area network (PAN) interface (e.g., a Bluetooth interface), etc. Although the cellular phone can interact with other computing devices through these interfaces, these interfaces may provide limited or no notifications when detecting other compatible devices, such as wireless speakers (including smart speakers or smart personal assistant speakers), displays (e.g., televisions, smart TVs, smart displays, personal assistant display devices), smart watches, smart glasses, home automation devices (including smart lights, smart thermostats, automatic blinds, smart plugs, etc.), cameras, etc. Thus, conflicting notifications between different features of the cellular phone may prevent users of the cellular phone and other electronic devices from using the cellular phone to interface with other devices or from fully understanding how to use the cellular phone.

[0003] overview In general, the present disclosure provides an integrated notification system that utilizes edge lighting elements of a computing device to output light patterns indicating the current state of the computing device based on visual notifications determined in response to changes in the state of the computing device (e.g., in response to user input, changes in position, changes in other devices proximate to the computing device, changes in sensors on the computing device). The visual notifications can represent different patterns of light (e.g., including different colors, different animations), and the edge lighting elements can be configured to output light patterns using pixels at different positions along the edge lighting elements. For example, when a camera of a computing device is turned on, the edge lighting elements can output a particular color, pattern, or animation near or adjacent to the camera. As another example, when a user provides input to change the volume level of a speaker on a computing device, the edge lighting elements can output a change in size of a particular color indicating the current volume level relative to the maximum volume level of the speaker (which may generally refer to the speaker of the computing device, a speaker connected to the computing device wirelessly, e.g., wireless speakers and / or wireless headphones, or a speaker connected to the computing device via a wired connection, e.g., wired speakers and / or wired headphones).

[0004] Thus, the techniques of this disclosure provide an intuitive and integrated way of representing changes in the state of a computing device (using edge lighting to represent changes in the state of the computing device). Integrated edge lighting can provide additional information that indicates the state of a computing device. Integrated edge lighting allows a user of a computing device to more quickly identify state changes in the computing device (compared to computing devices featuring heterogeneous state notification systems) without potentially having to resort to examining various system-level configuration parameters. Thus, various aspects of edge lighting techniques can reduce the number of user inputs required to perform a task or determine the current state of a computing device, thereby reducing consumption of computing resources (e.g., processor cycles, memory space, memory bus bandwidth), which can potentially improve the power efficiency of the computing device itself. [Means for solving the problem]

[0005] In one example, various aspects of the present technique relate to a method that includes: one or more processors of a computing device determining a change in a state of the computing device; the one or more processors of the computing device determining a visual notification based on the change in state; and the one or more processors of the computing device interfacing with a first portion of a display of the computing device to output a light pattern based on the visual notification, the display including the first portion and a second portion, the first portion including a substantial portion of a periphery of the display and excluding the second portion of the display.

[0006] In another example, various aspects of the present technique relate to a computing device comprising a display including a first portion and a second portion, the first portion including a substantial portion of the periphery of the display and excluding the second portion of the display. The computing device comprises one or more processors configured to interface with the first portion of the display of the computing device to determine a change in a state of the computing device, determine a visual notification based on the change in state, and output a light pattern based on the visual notification.

[0007] In another example, various aspects of the present technique relate to a non-transitory computer-readable storage medium storing instructions that, when executed, cause one or more processors of a computing device to perform the following operations: determining a change in a state of the computing device, determining a visual notification based on the change in state, and interfacing with a first portion of a display of the computing device to output a light pattern based on the visual notification, the display including a first portion and a second portion, the first portion including a substantial portion of a periphery of the display and excluding the second portion of the display. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a conceptual diagram illustrating an example communication system configured to provide a light pattern in the vicinity of a device in accordance with one or more techniques of this disclosure. [Figure 2] FIG. 1 is a block diagram illustrating an example computing device configured to provide visual communication via edge lighting in accordance with one or more aspects of the present disclosure. [Figure 3] 1 is a flow diagram illustrating an example operation of a computing device for providing visual communication via edge lighting in accordance with one or more aspects of the present disclosure. [Figure 4A]FIG. 1 is a conceptual diagram illustrating an example computing device for visual communication via edge lighting in accordance with various techniques of this disclosure. [Figure 4B] FIG. 1 is a conceptual diagram illustrating an example computing device for visual communication via edge lighting in accordance with various techniques of this disclosure. [Figure 4C] FIG. 1 is a conceptual diagram illustrating an example computing device for visual communication via edge lighting in accordance with various techniques of this disclosure. [Figure 4D] FIG. 1 is a conceptual diagram illustrating an example computing device for visual communication via edge lighting in accordance with various techniques of this disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0009] Detailed Description Generally, this disclosure describes a computing device configured to provide a user with visual communication regarding a state change of the computing device using edge lighting. The computing device may include a display along a periphery of the computing device, e.g., around a central display. The computing device may change state, for example, in response to receiving an input (e.g., touch input, voice input, button input, motion input, touchless gesture input, remote device input). To indicate the state change, the computing device may determine a visual notification. Based on the visual notification, the computing device may display a light pattern on the display along the periphery of the computing device. In some examples, based on the visual notification, the computing device may configure the display to indicate a state change that occurred in response to the input by outputting distinct light segments along a direction in which the computing device receives the input.

[0010] A computing device can output edge lighting to provide visual communication to a user by activating a portion of pixels on the periphery of a display. The pixels of a portion of the display (a first portion of the display) can substantially include the periphery of the display and exclude pixels of a second portion of the display (a second portion of the display) that does not include the periphery of the display. The periphery of the display refers to a continuous or discontinuous band of pixels that substantially surrounds the outer edge of the display (e.g., a continuous band of pixels that surrounds more than 50% or a slightly higher percentage of the periphery of the display. This band may have a pixel width that is less than a certain percentage of the total pixels of the display, e.g., 1%, 5%, 10%, 20%, or 30%, or may be higher but less than 50% of all available pixels of the display). Edge lighting may include one or more groups of activated pixels that are distinguishable from one or more other groups of pixels by different brightness or color. The computing device can vary the activation of the pixel groups over time to cause animation, such as blinking the pixel groups.

[0011] The techniques disclosed herein can improve the efficiency of computing devices and reduce user confusion regarding interaction with the computing device. As computing devices become more complex, they need ways to facilitate user understanding of the functionality provided by the computing device. Rather than interfacing with the user using a variety of different methods (e.g., visual notifications such as warning messages or status alerts, audible notifications such as chimes or alerts, tactile notifications such as vibrations), the computing device can provide a consistent notification system. Instead of different applications and features on the device notifying the user of functionality in a random manner or not notifying them at all, the computing device outputs light patterns as a unified notification system.

[0012] Additionally, rather than causing a computing device to unnecessarily consume resources (e.g., bandwidth, memory, processing power) by performing state changes that the user does not want, the computing device may be configured to perform state changes more efficiently (in terms of computing resources). In some cases, the computing device may use optical signals to communicate to the user how the computing device is using resources (e.g., processor cycles, memory, memory bus bandwidth) based on visual notifications. For example, without what is called a "visual language," a computing device may drain battery power by scanning the device through a personal area network (PAN) without the user's knowledge. In contrast, with the use of a so-called visual language, a computing device may interface with a display and output a light pattern to notify the user that the computing device is scanning, allowing the user to configure the computing device to turn off the PAN. In other words, the computing device allows the user to configure the computing device to better accommodate the user's preferences. Thus, a visual language can easily eliminate wasteful consumption of computing resources.

[0013] 1 is a conceptual diagram illustrating an example communication system configured to provide a light pattern in the vicinity of a device in accordance with one or more techniques of this disclosure. As shown in FIG. 1, system 100 includes a computing device 110, a remote device 130, and remote systems 120A-120N (hereinafter referred to as "remote systems 120"). Computing device 110 can communicate with remote device 130 and remote systems 120 over a network 140 or directly to provide a light pattern on a peripheral display 118 in the vicinity of computing device 110.

[0014] Examples of computing device 110 include, but are not limited to, portable, mobile, or other devices, such as mobile phones (including smartphones), laptop computers, desktop computers, tablet computers, smart television platforms, server computers, mainframes, etc. For example, in the example of Figure 1, computing device 110 may be a wearable computing device, such as a smart watch.

[0015] As shown in the example of FIG. 1 , computing device 110 includes user interface devices 112. The user interface devices 112 of computing device 110 may be configured to function as input and / or output devices for computing device 110. The user interface devices 112 may be implemented using various technologies. For example, the user interface devices 112 may be configured to receive tactile input, auditory input, visual input, touchless gesture input, motion input, and / or remote device input. Examples of input devices include a presence-aware display, a presence-aware or touch-sensitive input device, a mouse, a keyboard, a voice response system, a camera, a microphone, a button, a switch, radar, or any other type of device for detecting signals from the environment of computing device 110 by a user or remote device 130. In some examples, the presence-aware display includes a touch-sensitive or presence-aware input screen, such as a resistive touchscreen, a surface acoustic wave touchscreen, a capacitive touchscreen, a projected-capacitive touchscreen, or other presence-aware technology. That is, user interface devices 112 may include presence sensing devices capable of receiving tactile input from a user of computing device 110 .

[0016] The user interface device 112 can receive an indication of tactile input by detecting one or more touch gestures (e.g., tap, swipe, hold, button press) from a user. Examples of input devices may further include sensors for detecting motion (e.g., accelerometer, gyroscope), sensors for detecting position (e.g., GPS, barometer, magnetometer), sensors for detecting touchless gestures (e.g., radio transceiver), or other devices (e.g., infrared transceiver).

[0017] Additionally or alternatively, the user interface device 112 may provide tactile, auditory, or other or may be configured to function as an output device for providing output to a user using visual stimuli. Examples of output devices include a sound card, a video graphics adapter card, or one or more display devices, such as a liquid crystal display (LCD), a dot matrix display, a light emitting diode (LED) display, a micro light emitting diode (microLED) display, a quantum light emitting diode (QLED) display, an organic light emitting diode (OLED) display, electronic ink, or a monochrome or color display capable of outputting visual information to a user of computing device 110. Further examples of output devices include speakers, liquid crystal displays (LCDs), or other devices capable of generating understandable output for presentation to a user.

[0018] For example, user interface device 112 may present output to a user of computing device 110 as a graphical user interface that may be associated with functionality provided by computing device 110. In this manner, user interface device 112 may present various user interfaces of applications (e.g., electronic messaging application, internet browser application) running on or accessible by computing device 110. A user of computing device 110 may cause computing device 110 to perform operations associated with the functionality by interacting with each user interface of the application.

[0019] In some examples, the user interface device 112 of the computing device 110 can detect two-dimensional and / or three-dimensional gestures as input from a user of the computing device 110. For example, a sensor of the user interface device 112 can detect a user movement (e.g., a movement of a hand, arm, pen, or stylus) within a threshold distance of the sensor of the user interface device 112. The user interface device 112 can determine a two-dimensional or three-dimensional vector representation of the movement and correlate the vector representation to a gesture input having multiple dimensions (e.g., a hand wave, pinch, clap, pen stroke). In other words, in some examples, the user interface device 112 can detect a multi-dimensional gesture without requiring the user to gesture at or near a screen or surface for which the user interface device 112 outputs display information. Instead, the user interface device 112 can detect a multi-dimensional gesture made at or near a sensor, which may be positioned near a screen or surface for which the user interface device 112 outputs display information.

[0020] 1, computing device 110 includes a user interface module 114. User interface module 114 may perform one or more operations described herein using hardware, software, firmware, or a combination thereof resident and / or operating on computing device 110. Computing device 110 may execute user interface module 114 using one processor or multiple processors. In some examples, computing device 110 may execute user interface module 114 as a virtual machine running on underlying hardware. User interface module 114 may run as one or more services of an operating system or computing platform, or may run in the application layer of a computing platform as one or more executable programs.

[0021] As shown in the example of FIG. 1, the user interface module 114 may include one or more functions. The user interface module 114 may be operable by the computing device 110 to perform, for example, receive input and transmit instructions of the input to other components associated with the computing device 110. The user interface module 114 may also receive data from components associated with the computing device 110. Using the received data, the user interface module 114 may cause other components associated with the computing device 110, such as the user interface device 112, to provide output based on the received data. For example, the user interface module 114 may receive data to display a GUI.

[0022] Remote system 120 represents any remote computing system, such as one or more desktop computers, laptop computers, mainframes, servers, cloud computing systems, etc., configured to store and / or manage data used by computing device 110. For example, remote system 120 may include a web server, database management system, etc. accessible via network 140.

[0023] Remote device 130 may be any additional computing device capable of communicating with computing device 110 via network 140 or directly. Examples of remote device 130 include, but are not limited to, portable devices, mobile devices, or other devices, such as mobile phones (including smartphones), laptop computers, desktop computers, tablet computers, smart television platforms, server computers, mainframes, etc. For example, in the example of FIG. 1, remote device 130 may be a wearable computing device, such as a smart watch.

[0024] The computing device 110 can display notifications in a variety of ways, including non-obvious ways. The computing device 110 can notify the user via a banner or a text message. The computing device 110 can notify the user that a photo has been taken with the camera via a shutter sound. The computing device 110 can provide an indication of a state change in a nested menu with a list of configuration parameters. The computing device 110 can notify the user of unsuccessful face recognition with a vibration.

[0025] The computing device 110 may not provide, even when indicated, a particular state change. For example, the computing device 110 typically does not indicate a radio scanning frequency. As another example, the computing device 110 may not indicate receipt of a touchless gesture signal (e.g., detected via radar or other forms of wireless gesture detection). The computing device 110 may not indicate a state change due to motion (e.g., turning the computing device 110 face down). In these instances where the computing device 110 does not provide, even when indicated, a particular state change, the computing device 110 unnecessarily consumes computing resources (e.g., power, processor cycles, memory, memory bandwidth) by consuming resources to perform various activities that the user does not desire (e.g., facial recognition, keyword detection, proximity detection, companion device detection, and other activities that are transparent or otherwise not actively communicated to the user).

[0026] Computing device 110 may detect companion devices, such as remote device 130, by scanning a network, such as network 140, periodically or periodically (possibly constantly, or in various circumstances, e.g., when connected to a particular wireless network), thereby enabling communication with remote device 130. A signal from the remote device 130 may represent an input to the computing device 110. The computing device 110 may be configured to not alert the user to scans or other transparent activity other than settings or other configuration parameters that may be difficult to discover in nested menus and that may be presented in current operating systems.

[0027] According to one or more techniques of the present disclosure, the computing device 110 may be configured to provide a user with unified and consistent visual notification regarding state changes of the computing device 110 via edge lighting output. The user interface device 112 may include a peripheral display 118 surrounding the central display 116. The peripheral display 118 may notify the user of state changes of the computing device 110 in a consistent manner by presenting different patterns of light. The state changes of the computing device 110 may be triggered by inputs such as touch input, voice input, button input, motion input, touchless gesture input, remote device input, etc. To indicate the state change, the computing device 110 may first determine a visual notification. The computing device 110 may then interface with the peripheral display 118 to output a light pattern based on the visual notification.

[0028] When outputting a light pattern, the computing device 110 may interface with a peripheral display to output the light pattern by activating pixels in the peripheral display 118 based on a visual indication representing the light pattern. The peripheral display 118 may include one or more groups of activated pixels that are distinguishable from one or more other groups of pixels by different brightness and / or color. The computing device 110 may vary the activation of the pixel groups over time to cause animations such as the pixel groups flashing, illuminating, waving, blinking, changing intensity or brightness, changing color, changing patterns over time, etc.

[0029] In operation, the user interface device 112 may include a central display 116 and a peripheral display 118. The peripheral display 118 (which may represent a first portion of the display 116 / 118) may substantially surround the central display 116 (which may represent a second portion of the display 116 / 118) and thus may exclude the central display 116. The peripheral display 118 may substantially surround the central display 116 in that the peripheral display 118 may include a band of contiguous or discontinuous pixels that substantially surrounds the outer edge of the display 116 / 118. Peripheral display 118 refers to a continuous or discontinuous band of pixels that substantially surrounds the outer edge of display 116 / 118 (e.g., a continuous band of pixels that surrounds more than 50% or a slightly higher percentage of the periphery of display 116 / 118. This band may have a pixel width that is less than a certain percentage of the total pixels of the display, e.g., 1%, 5%, 10%, 20%, or 30%, or may be higher but less than 50% of all available pixels of display 116 / 118). Edge lighting may include one or more groups of activated pixels that are distinguishable from one or more other groups of pixels by a different brightness or color.

[0030] In some examples, the central display 116 and the peripheral display 118 may be different portions of a single display. In other examples, the central display 116 and the peripheral display 118 may be separate displays. The peripheral display 118 may have a variety of widths (e.g., 3 pixels, 4 pixels). In some examples, the central display 116 and the peripheral display 118 may be coplanar (i.e., the central display 116 and the peripheral display 118 are coplanar). The central display 116 may be on the front of the computing device 110. In other examples, the central display 116 and the peripheral display 118 may be on different planes. For example, the central display 116 may be on the front of the computing device 110, and the peripheral display 118 may be on an edge of the computing device 110 (e.g., the central display 116 may be positioned at a right angle, an acute angle, an obtuse angle, or any non-zero angle relative to the peripheral display 118). The user interface device 112 can provide various user interfaces of applications via the central display 116. The user interface device 112 can output light patterns as edge lighting via the peripheral display 118.

[0031] Computing device 110 may output light patterns via peripheral display 118 in response to a state change of computing device 110. In some cases, the state change may result from activation of one or more of various sensors of user interface device 112. User interface device 112 may receive input indications from sensors including microphones, cameras, radar, buttons, etc. Thus, input may include tactile input, auditory input, visual input, motion input, radio-transmitted input, or any other input received by computing device 110 (which in this example is assumed to be a cellular handset such as a smartphone or other mobile computing device).

[0032] The user interface device 112 can detect input from a user or from another device, such as the remote system 120 or the remote device 130. The user interface device 112 can detect local input, such as a button press, or environmental input, such as an ultra-wideband (UWB) signal. The user interface module 114 can process the input to determine a user command or an indication of a future user command and, in response to detecting the input, perform a corresponding process (e.g., initiating a pairing process with the remote device 130, activating the central display 116 when a user is detected to be within visual distance of the computing device 110, activating a microphone, camera, or other sensor). In other cases, a state change may not be due to the activation of a sensor. A state change may be due to an internal process or the execution of a predetermined task. The computing device 110 can perform one or more of the aforementioned actions in response to the execution of an internal process or a predetermined task.

[0033] Execution of an action may change the state of the computing device 110. The user interface module 114 may, for example, initiate execution of a command to take a picture or a command to increase the volume. The user interface module 114 may determine that the computing device 110 should enter a new operating mode, such as a recording mode or a discovery mode. For example, in the recording mode, the computing device 110 may activate a microphone to receive, store, and / or analyze audible input. As another example, in the discovery mode, the computing device 110 may display the capabilities of the computing device 110, such as available buttons to press, available microphones to capture audio (e.g., speech), and activation of pairing with a remote device 130.

[0034] The computing device 110 can indicate a state change by first determining a visual notification representative of the state change. The user interface module 114 can determine that the state change is relevant to the user. The user interface module 114 can output a light pattern based on the visual notification to alert the user of the state change by interfacing with the peripheral display 118. Additionally, the user interface module 114 can indicate control sensitivity on the computing device 110. The user interface module 114 can provide functionality discoverability and feedback to the user by outputting light patterns specified by visual notifications. By outputting light patterns based on the visual notifications, the user interface module 114 can proactively assist the user in discovering potentially unknown or misconfigured features.

[0035] The user interface module 114 can determine visual notifications and interface with the peripheral display 118 to activate pixels on the peripheral display 118 consistently across applications on the computing device 110. In other words, the user interface module 114 can enable clear indications of various state changes (e.g., different features that the user previously configured but may have forgotten, default configurations that the user does not want to touch or enable, default configurations that the user misconfigured and does not want to enable). The user interface module 114 can use various aspects of the edge lighting techniques described in this disclosure to alert the user to application-level state changes, but can provide indications of such state changes at a system level rather than an application level.

[0036] In some cases, the user interface module 114 may indicate a state change by outputting a light pattern based on a visual notification, rather than using words or icons. Instead of words or icons, the user interface device 112 may output a light pattern based on a visual notification by interfacing with the peripheral display 118. The user interface module 114 may configure the peripheral display 118 to exhibit various light patterns that notify the user of various functions or other capabilities of the computing device 110 by activating various pixels of the peripheral display 118. In some cases, the user interface module 114 may activate all pixels on the peripheral display 118. In other cases, the user interface module 114 may activate a portion of the pixels on the peripheral display 118. The user interface module 114 may activate groups of pixels by changing brightness and / or color.

[0037] The user interface module 114 may determine the location of one or more groups of activated pixels to match a position on the computing device 110 or to indicate a direction from which the computing device 110 received an input. In some cases, the user interface module 114 may determine dynamic variation of pixel activation over time, such that the peripheral display 118 outputs animated light patterns. In other cases, the user interface module 114 may determine static activation of pixels.

[0038] The light patterns can provide the user with feedback regarding their interaction with the computing device 110. For example, when a user increases the volume of the audio output of the computing device 110 by pressing a volume button (which can be a physical or virtual button), the peripheral display 118 can output light segments near the volume button that increase in length proportional to the volume relative to the maximum volume level. As another example, when a user takes a picture using a camera app, the peripheral display 118 can output light along the entire peripheral display 118 or in proximity to the camera sensor.

[0039] Additionally, the light patterns may provide a user with feedback regarding the interaction of computing device 110 with another device, such as remote device 130, via peripheral intelligence. For example, computing device 110 may discover nearby remote device 130, e.g., via PAN or UWB, and peripheral display 118 may output a light segment along a portion of the periphery corresponding to the direction of remote device 130. As another example, computing device 110 may be a smart TV that discovers two remote controls, and peripheral display 118 of the smart TV may output two light segments along two portions of peripheral display 118 indicating the direction of each of the two remote controls.

[0040] In some cases, the user interface module 114 may determine that a pixel activation pattern should include pixels that vary in output brightness, pixels that vary in output color, or groups of pixels that vary in activation and deactivation. For example, the user interface module 114 may determine the location of various groups of patterns (or visual indications representing various groups of patterns) that match an input device or indicate the orientation or remote gesture of the remote device 130. As another example, the user interface module 114 may determine changes in pixel activation over time and generate animations, such as flashes or changes in the size of activated pixel groups. In other cases, the user interface module 114 may not distinguish between groups of pixels that have inherent variations. In this case, the user interface module 114 may determine a uniform pixel activation pattern having a single intensity and color.

[0041] The user interface module 114 can output a light pattern on the peripheral display 118. The peripheral display 118 can include multiple pixels for generating the light pattern. The peripheral display 118 can have different pixels activated at different times to output light segments of various lengths, intensities, colors, etc. The peripheral display 118 can also have inactive pixels in the absence of visual communication or for dark segments in the light pattern.

[0042] The techniques disclosed herein can promote efficient user interaction with the computing device 110. A common design implementation of edge lighting can reduce user confusion and frustration regarding the increasing complexity of the device. Edge lighting allows symbiotic hardware and software designs to generate intuitive interaction patterns. By providing feedback via such edge lighting, the computing device 110 can enable users to use touchless gestures more efficiently or avoid using undesirable touchless gestures. By providing discoverability guidance via edge lighting, the computing device 110 can enable users to interact more efficiently with less common features, thereby promoting the adoption of such features. In some examples, the computing device 110 can provide users with 360° situational awareness through the peripheral display 118 that completely surrounds the central display 116. In this way, edge lighting can enhance the user experience of the computing device 110 by providing a consistent mode of visual communication.

[0043] Additionally, the computing device 110 may use edge lighting visual communication to enable the user to discover operating modes of the computing device 110 that the user does not want, thereby enabling the user to disable various actions that would be performed during those operating modes. By clearly communicating with the user, the computing device 110 may avoid unnecessarily draining energy, memory, or computational resources. This allows the computing device 110 itself to operate more efficiently.

[0044] 2 is a block diagram illustrating an example computing device configured to provide visual communication regarding state changes of the example computing device via edge lighting, in accordance with one or more aspects of the present disclosure. Computing device 200 of FIG. 2 is described below as an example of computing device 110 of FIG. 1. FIG. 2 illustrates only one particular example of computing device 200; many other examples of computing device 200 may be used in other cases, may include some of the components included in computing device 200, or may include additional components not shown in FIG. 2.

[0045] 2, computing device 200 includes one or more processors 210, one or more communication units 220, one or more sensors 250, one or more storage elements 240, a central display 270, and a peripheral display 280. The storage element 240 of computing device 200 includes a user interface module 262 and a visual notification (VN) 260. User interface module 262 may be the same as or substantially similar to user interface module 114 of FIG. 1. User interface module 262 includes an input detection unit 242, a state change monitoring unit 244, a notification determination unit 246, and a display interface unit 248.

[0046] Communication channel 230 interconnects each of elements 210, 220, 240, 250, 270, and 280 for inter-element communication (physically, communicatively, and / or operationally). In some examples, communication channel 230 may include a system bus, a network connection, an inter-process communication data structure, or any other method for communicating data.

[0047] The one or more communication units 220 communicate with external devices via one or more wired and / or wireless networks by transmitting and / or receiving network signals over the one or more networks. Examples of communication units 220 include network interface cards (e.g., Ethernet cards), optical transceivers, radio frequency transceivers, GPS receivers, or any other type of device capable of transmitting and / or receiving information. Other examples of communication units 220 may include shortwave radios, cellular data radios, wireless network radios, and universal serial bus (USB) controllers.

[0048] One or more sensors 250 can receive input. Examples of sensors 250 include, but are not limited to, a capacitive touchscreen, a projected capacitive touchscreen, a resistive touchscreen, a surface acoustic wave touchscreen, a camera, a microphone, a button, a switch, an accelerometer, a gyroscope, a barometer, a magnetometer, radar, etc. The sensors 250 can cooperate with the communication unit 220 (e.g., a UWB interface, a personal area network (PAN) interface, a global positioning system (GPS) receiver, a radar detector) to receive input, such as radio wave input.

[0049] One or more storage elements 240 store information that is processed during operation of computing device 200. In some examples, storage element 240 is temporary memory, meaning that the primary purpose of storage element 240 is not long-term storage. Storage element 240 on computing device 200 may be configured as volatile memory for short-term storage of information. Thus, when powered off, storage element 240 does not retain its stored content. Examples of volatile memory include random access memory (RAM), dynamic This includes dynamic random access memory (DRAM), static random access memory (SRAM), and other types of volatile memory known in the art.

[0050] In some examples, the storage element 240 includes one or more computer-readable storage media. In some examples, the storage element 240 includes one or more non-transitory computer-readable storage media. The storage element 240 may be configured to store a larger amount of information than is typically stored by volatile memory. The storage element 240 may further be configured for long-term storage of information as non-volatile memory space, capable of retaining information after power-on / off cycles. Examples of non-volatile memory include magnetic hard disks, optical disks, floppy disks, flash memory, or electrically programmable memory (EPROM) or electrically erasable programmable memory (EEPROM). The storage element 240 may store program instructions and / or information (e.g., data) associated with the input detection unit 242, the state change monitoring unit 244, the notification determination unit 246, the display interface unit 248, and the VN 260.

[0051] One or more processors 210 may implement functions and / or execute instructions associated with computing device 200. Examples of processor 210 include an application processor, a display controller, an auxiliary processor, one or more sensor hubs, and any other hardware configured to function as a processor, processing unit, or processing device. The input detection unit 242, the state change monitoring unit 244, the notification determination unit 246, and the display interface unit 248 may include instructions executable by processor 210 to perform various operations, operations, or functions of computing device 200. For example, processor 210 may read and execute instructions stored by storage element 240 that cause processor 210 to perform operations described herein that are attributed to input detection unit 242, state change monitoring unit 244, notification determination unit 246, and display interface unit 248. Execution of these instructions by processor 210 may cause computing device 200 to store information in storage element 240, for example, in VN 260.

[0052] 2 as part of a single device, in some examples they may be located within and / or as part of different devices. For example, in some examples some or all of the functionality of input detection unit 242, state change monitoring unit 244, notification determination unit 246, and display interface unit 248 may be provided in the same or different computing systems. That is, in some examples, the techniques of this disclosure may be performed and utilized by a single computing device, but in other examples they may be performed and / or utilized across multiple computing systems, e.g., distributed or "cloud" computing systems.

[0053] Computing device 200 may include a display having a first portion and a second portion. Peripheral display 280 may represent the first portion, which may include a substantial portion of the periphery of display 265 (e.g., a contiguous band of pixels surrounding more than 50% or a slightly higher percentage of the periphery of the display. This band may have a pixel width of less than a certain percentage of the total pixels of the display, e.g., 1%, 5%, 10%, 20%, or 30%, or may be higher but less than 50% of all available pixels of the display), while central display 270 may represent the second portion of display 265. Central display 270 may not include peripheral display 280. Peripheral display 280 may represent an example of peripheral display 118 of FIG. 1, and central display 270 may represent an example of central display 116 of FIG. 1. Computing device 200 may include peripheral display 280 and central display 270. The interface connection can output a light pattern that indicates one or more of the VNs 260 that indicate a change in state of the computing device 200.

[0054] During operation, the state change monitoring unit 244 can first determine a change in the state of the computing device 200. The state change can occur in response to many different conditions. For example, the computing device 200 may be configured to activate various sensors or interfaces to identify the remote device 130, the user, or other activity within the environment, network, or other medium by periodically or contextually scanning the environment, network (e.g., PAN, any wireless network including a cellular network), or other medium (e.g., to detect a user via radar or other proximity sensor) (e.g., when connected to a particular wireless network, when in a particular location indicated by a GPS sensor), or other medium. Rather than silently activating sensors or other interfaces to perform scans without alerting the user, the state change monitoring unit 244 can detect a change in the state of the computing device 200 (which may include a change in the state of one of the sensors 250, the communication unit 220, the processor 210, etc.) and provide an indication representing the change in state by interfacing with the notification determination unit 246.

[0055] Additionally, computing device 200 can change state in response to input from a user or another device, e.g., a companion device such as a smartwatch, smart glasses, smart speaker, or home hub. Remote device 130 may represent one example of such a companion device. In any event, input detection unit 242 can detect input provided by a user via central display 270 (if central display 270 represents a presence-sensitive display capable of receiving touch input), buttons, or other sensors 250, including motion input detected by a gyroscope and / or accelerometer, weather input (e.g., humidity, air pressure, temperature, wind speed) sensed by weather sensors of sensors 250, and GPS input representing the location of computing device 200.

[0056] In other words, the input detection unit 242 can receive an indication of an input from the communication unit 220 and / or the sensor 250. The input detection unit 242 can receive an indication of a tactile input, an auditory input, a visual input, a touchless gesture input, a motion input, or a secondary device input. The sensor 250 can receive a button press, a single-touch gesture, or a multi-touch gesture. The sensor 250 can identify a voice command or a keyword (e.g., "computer") to a voice assistant. The sensor 250 can receive a QR code or an image key (e.g., facial recognition). The communication unit 220 and / or the sensor 250 can detect a hand reaching out toward or waving at the computing device 200. The communication unit 220 and / or the sensor 250 can detect a physical movement of the computing device 200, such as lifting or rotating the computing device 200 (e.g., via a gyroscope). The communication unit 220 and / or the sensor 250 may receive an input from the secondary device, such as a wired connection signal, a UWB signal, a Bluetooth® signal, or a WiFi® signal. In response to the communication unit 220 and / or the sensor 250 detecting an input via the communication channel 230, the input detection unit 242 may receive an indication of the input.

[0057] Such user and sensor inputs can result in a change in the state of the computing device 200, so that the computing device 200 can independently perform some action in response to the change in state. Rather than performing the operation silently, an input indication can be provided by interfacing with the state change monitoring unit 244, which can determine a change in state based on the input indication. The state change monitoring unit 244 can then provide an indication representing the change in state to the notification determination unit 246.

[0058] In some examples, software installed on computing device 200 can respond to input and initiate actions on computing device 200 according to the software's respective instructions. For example, a camera app can activate the sensor's 250 camera to take a picture in response to a button tap on a touchscreen. As another example, an alarm app can snooze an alarm in response to a hand gesture. As yet another example, a volume controller can increase or decrease the volume of computing device 200 in response to a button press on sensor 250. As yet another example, a remote device pairing controller can discover a second computing device (e.g., remote device 130) in response to a UWB signal received by communication unit 220.

[0059] The state change monitoring unit 244 can determine a state change caused by software on the computing device 200 changing the operating mode of the computing device 200. For example, a radio wave transmitted from a remote device (e.g., remote device 130) can cause the computing device 200 to enter pairing mode. In this case, the state change includes the computing device 200 pairing with the remote device via a personal area network or UWB connection. As another example, a button tap on a touchscreen can cause the computing device 200 to enter recording mode. In this case, the computing device 200 receives, stores, and / or analyzes microphone input. As yet another example, a user picking up the computing device 200 can cause the computing device 200 to enter discovery mode. In this case, the computing device 200 indicates the capabilities of the computing device 200, such as available buttons to press or available microphones to speak into.

[0060] In other cases, the state change monitoring unit 244 can analyze operations on the computing device 200 to determine significant state changes. The state change monitoring unit 244 can determine the significance of the state change based on salient characteristics of the operations. The state change monitoring unit 244 can analyze activation of notable hardware of the computing device 200 (e.g., a camera or microphone in the sensor 250, a radio receiver and / or transmitter in the communication unit 220). The state change monitoring unit 244 can analyze changes in values ​​within a range (e.g., volume, screen brightness). In this case, the state change monitoring unit 244 can provide an indication of the state change to the notification determination unit 246.

[0061] The notification determination unit 246 may receive an indication representing a state change. Based on the state change, the notification determination unit 246 may select one of the VNs 260 that represents a pattern of pixel activation indicative of the state change. The notification determination unit 246 may interface with a display interface unit 248 that provides an indication of the selected one of the VNs 260. Based on the indication of the selected one of the VNs 260, the display interface unit 248 may interface with a peripheral display 280 and configure the peripheral display 280 to activate pixels represented by the VN of the VN 260 selected by the notification determination unit 246 to output a light pattern.

[0062] Based on the state change, the notification determination unit 246 may determine a visual notification to communicate the state change to the user. The notification determination unit 246 may determine the significance of the state change of the computing device 200. The notification determination unit 246 may determine the significance by predicting whether the user's knowledge of the state change will cause a change in behavior by the user. For example, the notification determination unit 246 may calculate a utility score for the state change, and determine whether the utility score is greater than or equal to a threshold user value. The notification determination unit 246 may determine that a state change is significant if it satisfies a utility score. In some cases, the notification determination unit 246 may determine that the state change causes the user to participate in a new behavior (e.g., start streaming music to a newly paired remote device, discover a new function of a control on the computing device 200, etc.), resulting in a higher utility score. In other cases, the notification determination unit 246 may determine that the state change causes the user to stop participating in a behavior (e.g., stop increasing the volume or release a button on a camera app), resulting in a higher utility score.

[0063] In some cases, the notification determination unit 246 may receive a data object from the software application indicating the significance of a state change caused by the software application. In other words, the software application may be configured to provide an instruction specifying one of the VNs 260. For example, a camera app may identify taking an image as a significant state change and provide an instruction to the state change monitoring unit 244 specifying one of the VNs 260 associated with activating the camera to take an image (and / or video). As another example, a motion sensor controller may predict that a user will pick up the computing device 200 and speak into a microphone and may identify future use of the microphone as a significant state change and provide an instruction specifying one of the VNs 260 associated with activating the microphone.

[0064] The notification determination unit 246 may determine that the significance of the state change (as measured by the utility score) merits presentation of one of the VNs 260. After determining that the significant state change results in selection of one of the VNs 260, the notification determination unit 246 may select one of the VNs 260.

[0065] Also, in some examples, the notification determination unit 246 can select one of the VNs 260 by determining characteristics of the state change. The characteristics may include a direction corresponding to the state change. The state change may include a feature corresponding to hardware on the computing device 200, such as a sensor or a button. The state change may include a feature corresponding to a remote device having a known position relative to the computing device 200 or a touchless gesture. The characteristics may include an intensity corresponding to the state change. In some examples, the state change may include a feature corresponding to a volume range or a distance between the remote device and the computing device 200. Alternatively, the notification determination unit 246 can determine that the state change does not have significant characteristics, such as directionality or intensity.

[0066] In examples where the notification determination unit 246 determines the directionality of the state change, the notification determination unit 246 may select one of the VNs 260 that represents a pattern of pixel activations that includes variations that indicate the directionality of the state change. For example, the selected one of the VNs 260 may include activation of a first group of pixels (of the peripheral display 280), deactivation of a second group of pixels (of the peripheral display 280), and a group of pixels (of the peripheral display 280) that has a higher intensity output than another group of pixels (of the peripheral display 280). The activation of an active pixel group may be specified, or the activation of an active pixel group may have a different color output than another pixel group (on the peripheral display 280). The placement of distinct pixel groups may indicate the location of a sensor or another input mechanism corresponding to a state change. For example, if the input detection unit 242 receives an indication of a button press that initiates a volume increase or decrease, the notification determination unit 246 may select one of the VNs 260 that specifies the location of a pixel group corresponding to the button. As another example, if the computing device 200 is recording microphone input, the notification determination unit 246 may select one of the VNs 260 located on the peripheral display 280 that activates a pixel group corresponding to the microphone.

[0067] In an example in which the computing device 200 notifies the user of a feature provided by the computing device 200, the notification determination unit 246 may select one of the VNs 260 to activate a distinct group of pixels that matches a feature associated with the feature of the computing device 200. In such a case, the notification determination unit 246 may select one of the VNs 260 to activate an arrangement of pixels such that the pattern of pixels indicates the computing device 200's ability to receive additional input. For example, the notification determination unit 246 may select one of the VNs 260 to activate a pattern of pixels including a group of pixels that matches a power button to indicate that the power button opens an associated application (e.g., a camera application). In some cases, the notification determination unit 246 may select one of the VNs 260 to activate a group of pixels such that the group of pixels outputs two pulses. When two pulses are presented, it indicates that two presses of the power button can open an associated application (e.g., a camera application).

[0068] The notification determination unit 246 may select one of the VNs 260 to activate an array of pixels of the peripheral display 280 to indicate a direction of a remote input, such as from the remote device 130 or a touchless gesture, relative to the computing device 200. When the computing device 200 pairs with a remote device, the position of the distinct group of pixels is aligned with the orientation of the remote device relative to the computing device 200 to indicate the orientation of the remote device relative to the computing device 200. When the computing device 200 silences a notification signal in response to a gesture, the notification determination unit 246 may select one of the VNs 260 to activate a distinct group of pixels that matches the direction of the gesture relative to the computing device 200. Additionally or alternatively, the notification determination unit 246 may determine other changes in pixel groups that indicate other state changes and modify or alter existing ones of the VNs 260 (which serve as templates that the notification determination unit 246 can modify to create new VNs).

[0069] In another example, the notification determination unit 246 may select one of the VNs 260 that activates a pattern of pixels that includes one distinct group without variation. For example, the pattern may include one level of brightness and one color. In such an example, the notification determination unit 246 may determine that the state change does not correspond to an associated direction or position.

[0070] The notification determination unit 246 may select one of the VNs 260 that indicates that a group of pixels should capture the entire peripheral display 280. The notification determination unit 246 may select one of the VNs 260 that indicates that the camera of the computing device 200 is activated to take a photo or video, that the computing device 200 is taking a screenshot, and / or that the computing device 200 is unlocking. In response to a state change, one of the VNs 260 that represents such a pattern can be selected.

[0071] The notification determination unit 246 can select one of the VNs 260 that represents a pattern of pixels that animates the peripheral display 280. The notification determination unit 246 can select one of the VNs 260 that represents a dynamic time series of activations (e.g., activation followed by deactivation, a change in color or intensity of an activated pixel, a change after a delay compared to other pixel changes) as the animation. The notification determination unit 246 can select one of the VNs 260 that represents a change in activation of an entire group of pixels, such as by activating, deactivating, and reactivating the group of pixels.

[0072] In practice, the change in activation may be displayed as a flash or pulse of pixels when output on the peripheral display 280. The notification determination unit 246 may select one of the VNs 260 that represents a change in the number of pixels in a group of pixels over time, such that the group of pixels in the peripheral display 280 includes more activated pixels over time, or such that the group of pixels in the peripheral display 280 includes fewer activated pixels over time.

[0073] In practice, a change in the number of pixels within a group of pixels on the peripheral display 280 may be displayed as an increase or decrease in the group of pixels when activated by the peripheral display 280. Animation may correspond to a state change. For example, a group of pixels may blink to attract the user's attention when the computing device 200 suggests a function of the computing device 200. As another example, a pattern of pixel activation may blink to help the user discover a function. For example, activating, deactivating, and reactivating a group of pixels adjacent to a power button may indicate that a double-click will launch a camera application.

[0074] In some cases, the notification determination unit 246 may select one of the VNs 260 that represents a size of the group of activated pixels proportional to the height corresponding to the state change. The notification determination unit 246 may modify the selected VN of the VNs 260 to change its size proportional to the changing height. The notification determination unit 246 may change the size of the group of pixels by activating or deactivating some pixels after a delay compared to other pixels in the group of pixels.

[0075] In some examples, the animation may include groups of pixels that change output intensity or color. For example, a discrete group of pixels corresponding to a volume change (e.g., distinguished by activation compared to inactive pixels, or distinguished by brightness or color compared to other activated pixels) may increase in size as the volume increases and decrease in size as the volume decreases. Such pixels correspond to discrete pixels represented by peripheral display 280.

[0076] As another example, a separate group of pixels representing a remote device, such as remote device 130 shown in the example of FIG. 1, changes size in proportion to the proximity of computing device 110 to remote device 130. That is, as remote device 130 gets closer to computing device 110, it increases in size (e.g., adds activated pixels). , shrinking (e.g., deactivating some pixels) as the remote device 130 moves away from the computing device 110. Additionally or alternatively, the notification determination unit 246 can determine other animations of the pixel patterns to indicate other state changes.

[0077] In some cases, the notification determination unit 246 can construct a pattern that represents a state change. In other cases, the notification determination unit 246 can use a pattern indicated by a software application associated with the state change, such as a software application that provides a data object to the notification determination unit 246. In still other cases, the notification determination unit 246 can use a pattern stored in the computing device 200 as the VN 260. The pattern indicated by the software application or the pattern from the VN 260 can specify one or more intensities, one or more colors, one or more directions, and / or one or more animations. The pattern in the VN 260 can indicate a state change or a characteristic of the state change. Thus, when the notification determination unit 246 detects a state change, it can reference the corresponding pattern in the VN 260.

[0078] A user of the computing device 200 can customize the pattern via a user interface. The notification determination unit 246 can store the customized pattern as a VN 260. The customization may include intensity, color, and / or animation. The notification determination unit 246 can provide default values ​​that the user can change. The user can further customize the type of state change for which the notification determination unit 246 determines the pattern. For example, the notification determination unit 246 can select and modify one of the VNs 260 representing a feedback or discoverability mode only when the computing device 200 is configured to provide feedback or discoverability, such as when indicated by the user in a settings configuration or as a default configuration.

[0079] After the notification determination unit 246 selects one of the VNs 260, the display interface unit 248 may interface with the peripheral display 280 to output a visual notification as a light pattern based on the selected one of the VNs 260. The display interface unit 248 may perform pixel activation specified by the one of the VNs 260 determined by the notification determination unit 246. The notification determination unit 246 may determine one of the VNs 260 that represents the light pattern and provide an indication of the determined one of the VNs 260 to the display interface unit 248.

[0080] Display interface unit 248 may represent a unit configured to interface with peripheral display 280 and / or central display 270. In response to receiving the determined one of VNs 260, display interface unit 248 may configure peripheral display 280 (rather than central display 270) to output the light pattern represented by the determined one of VNs 260. In other words, display interface unit 248 may configure a display buffer, which may be separate from (or may be integrated with) the display buffer of central display 270, to store various values ​​that result in activation of pixels to output the light pattern represented by the determined one of VNs 260.

[0081] Thus, the peripheral display 280 may include a separate display buffer from the central display, or both the peripheral display 280 and the central display 270 may include a separate display buffer. The central display 270 and peripheral display 280 may share a common display buffer. When the display buffer is shared, the display interface unit 248 can store data in the shared buffer using a common interface, but the display processor only changes the output light patterns for the peripheral display 280 (in some examples) by copying the contents of the display buffer that activates the pixels of the central display 270 and replacing the data that activates the pixels of the peripheral display 280 with the data provided by the display interface unit 248. Separate display buffers for each of the central display 270 and peripheral display 280 can potentially improve performance by avoiding copying data stored for the central display 270, but increase the costs associated with separate buffers.

[0082] In some cases, computing device 200 may include two display processors for processing instructions for peripheral display 280 and central display 270, respectively. In other cases, computing device 200 may include a single display processor with two separate frame buffers, one corresponding to peripheral display 280 and one corresponding to central display 270. In some cases, computing device 200 may include a single frame buffer logically divided into two portions.

[0083] 3 is a flow diagram illustrating an example operation of a computing device for providing visual communication via edge lighting in accordance with one or more aspects of the present disclosure. The example operation of FIG. 3 is described below, for illustrative purposes only, within the context of FIG. 2.

[0084] 3, computing device 200 includes a display 265 having a first portion (i.e., peripheral display 280 shown in the example of FIG. 2) and a second portion (i.e., central display 270 shown in the example of FIG. 2). The first portion includes only the periphery of display 265, and the second portion excludes the periphery of display 265. That is, the first portion substantially surrounds the second portion (e.g., a continuous band of pixels surrounding more than 50% or a slightly higher percentage of the periphery of the display. This band may have a pixel width that is less than a certain percentage of the total pixels of the display, e.g., 1%, 5%, 10%, 20%, or 30%, or may be higher but less than 50% of all available pixels of the display).

[0085] In some cases, the first portion and the second portion are two portions of a single display. In other cases, the first portion and the second portion are separate displays. The first portion may have a variety of widths (e.g., 1, 2, ..., 20 pixels). In some examples, the first portion and the second portion may be coplanar (e.g., the first portion and the second portion may be on the front surface of the computing device). In other examples, the first portion and the second portion may be positioned at different non-zero angles relative to each other. The second portion may be on the front surface of the computing device, and the first portion may be on an edge of the computing device (e.g., the first portion may be positioned at a non-zero angle relative to the second portion).

[0086] Computing device 200 can detect input. Computing device 200 can detect input using any of a variety of sensors and / or communication devices (e.g., a presence-aware touchscreen, a microphone, a camera, an accelerometer, radar), for example, via communication unit 220, sensors 250, and / or display 265. In some examples, the input may be tactile input, such as a single or multiple touches on a touchscreen of computing device 200 (which may be represented when display 265 is configured to perform presence-aware detection), or a button press on the computing device. In other examples, the input may be an audio frame. In yet another example, the input may be an audio input, such as a command. In yet another example, the input may be a visual input, such as a QR code. In yet another example, the input may be a motion of the computing device, such as lifting or flipping the computing device. In yet another example, the input may be a touchless gesture (e.g., radio waves) or a radio wave transmission, such as a signal (e.g., a UWB signal) from another computing device.

[0087] As described above, computing device 200 may determine a change in the state of the computing device in response to the input (304). The change in state may be, for example, the performance of an action or a change in operational mode. For example, computing device 200 may unlock a second portion of the display in response to a visual password presented via a camera (e.g., using facial recognition). As another example, computing device 200 may enter a pairing mode with remote device 130 (shown in the example of FIG. 1) in response to receiving a PAN signal.

[0088] The computing device 200 may determine 306 a visual notification 260 representing the light pattern based on the change in state. The visual notification 260 may indicate activation of pixels of the peripheral display 280 that output a light pattern. The visual notification 260 may represent data indicating activation of one or more groups of pixels of various sizes or pixels having various brightness or color outputs. In some cases, a selected one of the visual notifications 260 may include data indicating activation of a single group of pixels without variation. In other cases, a selected one of the visual notifications 260 may include data indicating activation of two or more groups distinguishable by different brightness or different colors. A selected one of the visual notifications 260 may include data indicating activation of pixels that output an animated light pattern by blinking or changing the size of a group of pixels over time.

[0089] The computing device 200 can emphasize characteristics of a change in state of the pattern. The change in state can include, for example, the direction of the remote device 130 or the direction of a hardware element (e.g., a microphone, a button) of the computing device 200. In such an example, the selected one of the visual notifications 260 can include data indicating activation of two or more separate groups of pixels, each group aligned with a direction. The selected one of the visual notifications 260 can include data indicating an intensity, such as a volume, or a proximity to the remote device. The selected one of the visual notifications 260 can include data indicating activation of two or more separate groups of pixels, each group having a size corresponding to an intensity. Furthermore, the selected one of the visual notifications 260 can include data indicating activation of pixels that results in an animation. Thus, some groups of activated pixels grow or shrink in response to an increase or decrease in the intensity or proximity of the computing device 200 to the remote device 130.

[0090] In this regard, the pattern can provide visual communication to the user. The pattern can assure the user that the computing device is processing the input. For example, the pattern can indicate the direction of a remote gesture, such as a hand wave, by the user, and assure the user that the computing device 200 detected the gesture. The pattern can suggest an action to the user. For example, the pattern can indicate that the user can take a picture by pressing the power button twice (e.g., via the activation, deactivation, and reactivation of a group of pixels aligned with the computing device's power button).

[0091] The computing device 200 may invoke the display interface unit 248 to interface with the peripheral display 280 to output a light pattern based on the selected one of the visual notifications 260 (308). The peripheral display 280 may perform pixel activation according to the selected one of the visual notifications 260 to generate a corresponding light pattern. This may cause the peripheral display 280 to output the light pattern. By displaying the light pattern via the peripheral display 280, the computing device 200 may provide the user with 360-degree situational awareness of the environment. The duration of the light pattern may be any of a variety of durations (e.g., half a second, one second, two seconds).

[0092] 4A-4D are conceptual diagrams illustrating example computing devices for providing visual communication via edge lighting in accordance with various techniques of this disclosure.

[0093] 4A illustrates an exemplary scenario 400 having a smartphone 404 including a central display and a peripheral display 402. The smartphone 404 may represent an example of the computing device 200 shown in the example of FIG. 2. In the example of FIG. 4A, the smartphone 404 has detected a remote speaker 408, such as via a PAN or UWB signal, which represents an example of a remote device 130. The smartphone 404 communicates the presence of the remote speaker 408 to a user by generating a light pattern on the peripheral display 402.

[0094] That is, the smartphone 404 can determine that it has changed state in terms of having the ability to communicate with a remote device (in this example, the remote speaker 408) in response to detecting the remote speaker 408. Accordingly, the smartphone 404 can select one of the VNs 260 based on the change in state. The smartphone 404 can interface with the peripheral display 402 to present, via the actuated portion 406, a light pattern based on the selected one of the VNs 260.

[0095] The light pattern indicates the direction of the remote speaker 408 relative to the smartphone 404 by outputting light segments at locations corresponding to the direction of the remote speaker 408 via a portion 406 of the peripheral display 402 that is distinct from the remainder of the peripheral display 402. The portion 406 may differ from the remainder of the peripheral display 402 as a result of outputting a different brightness or color. In some cases, the smartphone 404 may interface with the peripheral display 402 to indicate a change in proximity to the remote speaker 408 by animating the light segments output by the portion 406. For example, the portion 406 may increase in size (the number of currently activated pixels in the portion 406 relative to the number of previously activated pixels in the portion 406) as the smartphone 404 moves closer to the remote speaker 408 and decrease in size (the number of currently activated pixels in the portion 406 relative to the number of previously activated pixels in the portion 406) as the smartphone 404 moves farther away from the remote speaker 408.

[0096] FIG. 4B illustrates an exemplary scenario 410 having a smart TV 415 including a central display 418 and peripheral displays 416. The smart TV 418 represents another example of the computing device 200 shown in the example of FIG. 2. The smart TV 415 detects a remote control 412A and a remote control 412B (collectively referred to as "remote controls 412"), such as via a PAN or UWB signal. Each of the remote controls 412 represents an example of the remote device 130 shown in the example of Figure 1. Thus, by detecting the remote control 412, the smart TV 418 can detect a change in the state of the smart TV 415, and the smart TV 415 can select one of the VNs 260.

[0097] The smart TV 415 communicates the presence of the remote control 412 to the user by generating a light pattern via the peripheral display 416. Thus, the smart TV 415 can invoke the display interface unit 248 to interface with the peripheral display 416 to output a light pattern represented by a selected one of the VNs 260 based on the selected one of the VNs 260. The light pattern indicates the orientation of each of the remote controls 412 relative to the smart TV 415 by activating portions 414A and 414B of the peripheral display 416 to present light segments at positions corresponding to the orientation of the remote control 412.

[0098] Portion 414A and portion 414B (“portion 414”) differ from the rest of the peripheral display 416 because portion 414 produces a different brightness or color. In some cases, portion 414 may output animated light segments to indicate changing proximity to the remote control 412. For example, portion 414A may output a light segment that increases in size as the remote control 412A moves closer to the smart TV 415. As another example, portion 414B may output a light segment that decreases in size as the remote control 412B moves further away from the smart TV 415.

[0099] 4C illustrates an exemplary smartphone 420 that includes a central display 424 and a peripheral display 422. The smartphone 420 may represent an example of the computing device 200 shown in the example of FIG. 2. The smartphone 420 detects input from a user, such as a touch on the touchscreen of the central display 424 or facial recognition using the camera of the smartphone 420. The smartphone 420 may determine that a state change in response to the touch or facial recognition does not correspond to a particular direction but still merits visual communication to the user.

[0100] Based on the detected state change (detection of user input), the smartphone 420 can determine one of the VNs 260 that corresponds to the detected state change. Based on the determined VN among the VNs 260, the smartphone 420 can configure the peripheral display 422 to generate a light pattern having a single light segment without variation (i.e., a light segment of uniform brightness and color). In this way, the smartphone 420 can communicate to the user that the smartphone 420 is receiving and processing input.

[0101] The smartphone 420 can configure the peripheral displays 422 to generate light patterns regardless of additional content displayed on the central display 424. In some cases, the peripheral displays 422 may be configured to generate light patterns if there is a delay in generating content on the central display 424. In other cases, the peripheral displays 422 may be configured to generate light patterns to standardize visual communication to the user across all apps installed on the smartphone 420.

[0102] 4D illustrates an exemplary smartphone 430 including a central display and a peripheral display 432. The smartphone 430 represents another example of the computing device 200 shown in the example of FIG. 2. The smartphone 430 includes a user interface for volume control buttons 434. In response to the button press, the smartphone 430 can determine a state change as a change in the volume of audio output by the smartphone 430. The smartphone 430 can then select one of the VNs 260 based on the detected state change.

[0103] Smartphone 430 communicates the volume change to the user by interfacing with peripheral display 432 and outputting a light pattern via portion 436 based on a selected one of VNs 260 of peripheral display 432. The light pattern indicates the location of volume control button 434 on smartphone 430 by aligning the light pattern with volume control button 434. As an example, the output light segment differs from the rest of the light output by peripheral display 432 by a different brightness or color. Smartphone 430 can configure peripheral display 432 to animate the light segment output by portion 436 to indicate the volume change. For example, portion 436 may indicate changes in the volume of smartphone 430 to the user by increasing in size (the number of currently activated pixels in portion 436 relative to the number of previously activated pixels in portion 436) as the volume increases and decreasing in size (the number of currently activated pixels in portion 436 relative to the number of previously activated pixels in portion 436) as the volume decreases.

[0104] In this manner, various aspects of the present technique can enable the following: Item 1 1. A method comprising: determining, by one or more processors of the computing device, a change in state of the computing device; determining, by one or more processors of the computing device, a visual notification based on the change in state; one or more processors of the computing device interfacing with a first portion of a display of the computing device to output a light pattern based on the visual notification; The display includes a first portion and a second portion, the first portion including a substantial portion of the periphery of the display and excluding the second portion of the display.

[0105] Section 2 further comprising detecting a user input; Item 10. The method of item 1, wherein determining a change in state of the computing device includes determining a change in state of the computing device based on user input.

[0106] Section 3 detecting that a wireless connection to a different device is available; 3. The method of any combination of clauses 1 and 2, wherein determining a change in state includes determining that a wireless connection to a different device is available.

[0107] Section 4 determining an orientation of the different devices relative to the computing device; Determining the visual indication includes determining a directional visual indication indicating an orientation of the different device relative to the computing device; Interfacing with the first portion of the display is configured to output light patterns indicating the direction of different devices relative to the computing device based on the directional visual notification. 4. The method of claim 3, comprising interfacing with a first portion of the display such that

[0108] Section 5 Item 3. The method of item 3, wherein the directional visual indication includes a proximity visual indication indicating relative distances between different devices and the computing device.

[0109] Section 6 The visual notification indicates a change in the state of a sensor of the computing device; The method of any combination of clauses 1 to 5, wherein interfacing with the first portion of the display includes interfacing with the first portion of the display to output a light pattern indicating a position of the sensor in the computing device based on the visual notification.

[0110] Section 7 Item 7. The method of item 6, wherein the sensor includes one or more of a camera and a microphone.

[0111] Section 8 the first portion of the display is a first display; 8. The method of any combination of paragraphs 1 to 7, wherein the second portion of the display is a second display that is different from the first display.

[0112] Section 9 9. The method of any combination of clauses 1-8, wherein the visual notification indicates that the computing device is configured to accept user input.

[0113] Item 10 10. The method of any combination of clauses 1-9, wherein the first portion of the display is positioned at a non-zero angle relative to the second portion of the display.

[0114] Section 11 1. A computing device comprising: a display including a first portion and a second portion, the first portion including a substantial portion of the periphery of the display and excluding the second portion of the display; The computing device further comprises one or more processors; One or more processors determining a change in the state of the computing device; Determine visual notifications based on state changes; The display is configured to interface with a first portion of a display of the computing device to output a light pattern based on the visual notification.

[0115] Section 12 the one or more processors are further configured to detect user input; Item 12. The computing device of item 11, wherein the one or more processors are configured to determine a change in state of the computing device based on user input.

[0116] Item 13 13. The method of any combination of clauses 11 and 12, wherein the one or more processors are further configured to detect that a wireless connection to a different device is available, and the one or more processors are configured to determine that a wireless connection to a different device is available. Computing equipment.

[0117] Section 14 the one or more processors are further configured to determine an orientation of the different devices relative to the computing device; One or more processors determining directional visual indications indicating the orientation of different devices relative to the computing device; Item 14. The computing device of item 13, configured to interface with a first portion of the display to output a light pattern indicating the direction of a different device relative to the computing device based on a directional visual notification.

[0118] Section 15 Item 14. The computing device of item 13, wherein the directional visual indication includes a proximity visual indication indicating a relative distance between different devices and the computing device.

[0119] Section 16 The visual notification indicates a change in state of a sensor of the computing device; 16. The computing device of any combination of clauses 11-15, wherein the one or more processors are configured to interface with the first portion of the display to output a light pattern indicating the location of a sensor of the computing device based on the visual notification.

[0120] Item 17 Item 17. The computing device of item 16, wherein the sensor includes one or more of a camera and a microphone.

[0121] Section 18 the first portion of the display is a first display; 18. The computing device of any combination of clauses 11-17, wherein the second portion of the display is a second display different from the first display.

[0122] Section 19 19. The computing device of any combination of clauses 11-18, wherein the visual notification indicates that the computing device is configured to accept user input.

[0123] Item 20 20. The computing device of any combination of clauses 11-19, wherein the first portion of the display is positioned at a non-zero angle relative to the second portion of the display.

[0124] Section 21 A non-transitory computer-readable storage medium storing instructions that, when executed, cause one or more processors of a computing device to perform the following operations: Determining a change in state of a computing device; determining a visual notification based on the change in state; interfacing with a first portion of a display of the computing device to output a light pattern based on the visual notification; the display includes a first portion and a second portion; The first portion includes a substantial portion of the periphery of the display and excludes a second portion of the display.

[0125] In one or more examples, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted via a computer-readable medium as one or more instructions or code and executed by a hardware-based processing unit. A computer-readable medium may include a computer-readable storage medium, which corresponds to a tangible medium, such as a data storage medium or a communication medium, and includes any medium capable of transferring a computer program from one place to another according to a communication protocol. In this case, a computer-readable medium may generally correspond to (1) a non-transitory tangible computer-readable storage medium or (2) a communication medium such as a signal or carrier wave. A data storage medium may be any available medium that can be accessed by one or more computers or one or more processors to read instructions, code, and / or data structures for implementing the techniques described in this disclosure. A computer program product may include a computer-readable storage medium.

[0126] By way of example, and not limitation, such computer-readable storage media can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage, flash memory, or any other medium that can be used to store desired program code in the form of instructions or data structures and that can be accessed by a computer. Also, any connection is properly referred to as a computer-readable medium. For example, if instructions are transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included within the definition of medium. However, computer-readable storage media and data storage media do not include connections, carrier waves, signals, or other transitory media, but instead include non-transitory tangible storage media. Disk and disc, as used herein, include compact discs (CDs), laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs. Disks typically reproduce data magnetically, and discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0127] The instructions may be executed by one or more processors, such as one or more digital signal processors (DSPs), general-purpose microprocessors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other equivalent integrated circuits or discrete logic circuitry. Thus, the term "processor," as used herein, may refer to any of the aforementioned structures or any other structure suitable for implementing the techniques described herein. Furthermore, in some aspects, the functionality described herein may be implemented within dedicated hardware and / or software modules. The techniques described herein may also be implemented entirely within one or more circuits or logic elements.

[0128] The techniques of this disclosure may be implemented in a wide variety of devices or equipment, including wireless handsets, integrated circuits (ICs), or IC sets (e.g., chip sets). Although various elements, modules, or units have been described in this disclosure to highlight functional features of devices configured to perform the disclosed techniques, the implementation of these elements, modules, or units does not necessarily require distinct hardware units. Rather, as noted above, the various units may be combined into a hardware unit, along with appropriate software and / or firmware, or may be provided by a collection of interoperating hardware units, including one or more processors as described above. Good too.

[0129] Various examples have been described. These and other examples are within the scope of the following claims.

Claims

1. detecting, by one or more processors of the computing device, a user input; determining, by the one or more processors of the computing device, a change in state of the computing device in response to detecting the user input; the one or more processors of the computing device determining a visual notification based on the change in the state; and the one or more processors of the computing device interfacing with a first portion of a display of the computing device to output a light pattern based on the visual notification; the display includes the first portion and a second portion; The method of claim 1, wherein the first portion is a contiguous band of pixels surrounding more than 50% of the perimeter of the second portion and excluding the second portion of the display.

2. A method comprising: detecting, by one or more processors of the computing device, a user input; determining, by the one or more processors of the computing device, a change in state of the computing device in response to detecting the user input; the one or more processors of the computing device determining a visual notification based on the change in the state; and the one or more processors of the computing device interfacing with a first portion of a display of the computing device to output a light pattern based on the visual notification; the display includes the first portion and a second portion; The first portion includes a substantial portion of a periphery of the display and excludes the second portion of the display, and the method includes: detecting that a wireless connection to a different device is available; Determining the change in state includes determining that the wireless connection to the different device is available, the method comprising: determining an orientation of the different device relative to the computing device; determining the visual indication includes determining a directional visual indication indicating the direction of the different device relative to the computing device; the interfacing with the first portion of the display includes interfacing with the first portion of the display to output the light pattern indicating the direction of the different device relative to the computing device based on the directional visual notification.

3. One or more processors of a computing device detecting user input; determining, by the one or more processors of the computing device, a change in state of the computing device in response to detecting the user input; the one or more processors of the computing device determining a visual notification based on the change in the state; and the one or more processors of the computing device interfacing with a first portion of a display of the computing device to output a light pattern based on the visual notification; the display includes the first portion and a second portion; the first portion includes a substantial portion of the periphery of the display and excludes the second portion of the display; the visual notification indicates a change in the state of a sensor of the computing device; and interfacing with the first portion of the display includes interfacing with the first portion of the display to output the light pattern indicative of a position of the sensor on the computing device based on the visual indication.

4. The method of any one of claims 1 to 3, wherein detecting the user input comprises detecting a voice command.

5. The method of any one of claims 1 to 4, wherein detecting the user input comprises detecting one or more button presses of one or more buttons of the computing device.

6. The method of any one of claims 1 to 5, wherein determining the visual notification comprises determining an animation corresponding to the change in state of the computing device.

7. detecting the user input includes detecting one or more voice commands; The method of claim 6 , wherein determining the visual notification comprises determining the animation corresponding to the one or more voice commands.

8. detecting that a wireless connection to a different device is available; The method of claim 1 or 3, wherein determining the change in state comprises determining that the wireless connection to the different device is available.

9. The method of claim 2 , wherein the directional visual indication comprises a proximity visual indication indicating a relative distance between the different device and the computing device.

10. The method of claim 3 , wherein the sensor includes one or more of a camera and a microphone.

11. A computer program product which, when executed, causes one or more processors of a computing device to carry out the method of any one of claims 1 to 10.

12. a memory configured to store the computer program of claim 11; and one or more processors configured to execute the computer program.

Images