Visual condition notification to be displayed onto edge of display

Abstract

SOLUTION: To provide an edge lighting of a computing device (200), in which the computing device (200) comprises a display (265) containing a first part (280) and a second part (270), the first part (280) contains an actual part of a circumference of the display, and excludes the second part (270) of the display, and one or more processor (210) of the computing device (200) determines the change of a state of the computing device (200), determines a visual notification on the basis of the change of the state, and may perform an interface connection with the first part (280) of the display so as to output a light pattern on the basis of the visual notification.EFFECT: By an integration edge lighting, a user can quickly specify a change of a state of a computing device.SELECTED DRAWING: Figure 2

Description

[Background technology]

[0001] background Computing devices often enable a variety of notifications that indicate changes in the state of the computing device. For example, mobile phones (including so-called "smartphones") may issue notifications that a cellular interface or other wireless interface has received an incoming call using vibration, a ringtone or other audible alert, a visual message or other graphical element, etc. Cellular phones may issue similar notifications that a cellular interface and / or other wireless interface has received a text message. Summary of the Invention [Problem to be solved by the invention]

[0002] However, a cellular device may issue conflicting notifications for other features of the cellular phone. For example, a cellular phone may include a Near Field Communication (NFC) interface, a Personal Area Network (PAN) interface (e.g., a Bluetooth interface), and the like. Although the cellular phone can interact with other computing devices through these interfaces, the cellular phone may provide limited or no notifications when these interfaces detect other compatible devices, such as wireless speakers (including smart speakers or smart personal assistant speakers), displays (e.g., televisions, smart televisions, smart displays, personal assistant display devices), smart watches, smart glasses, home automation devices (including smart lights, smart thermostats, automatic blinds, smart plugs, and the like), cameras, and the like. Thus, conflicting notifications between different features of the cellular phone may prevent users of the cellular phone and other electronic devices from interfacing with other devices using the cellular phone or from fully understanding the use of the cellular phone.

[0003] overview In general, the present disclosure provides an integrated notification system that utilizes edge lighting elements of a computing device to output light patterns indicative of a current state of the computing device based on visual notifications determined in response to changes in the state of the computing device (e.g., in response to user input, changes in position, changes in other devices proximate to the computing device, changes in sensors of the computing device). The visual notifications can represent different patterns of light (e.g., including different colors, different animations), and the edge lighting elements can be configured to output light patterns with pixels at different positions along the edge lighting elements. For example, when a camera of a computing device is turned on, the edge lighting elements can output a particular color, particular pattern, or particular animation at a position near or adjacent to the camera. As another example, when a user provides an input to change the volume level of a speaker of a computing device, the edge lighting elements can output a size change of a particular color indicative of a current volume level relative to a maximum volume level of a speaker (which may generally refer to a speaker of a computing device, a speaker connected to a computing device wirelessly, e.g., wireless speakers and / or wireless headphones, or a speaker connected to a computing device via a wired connection, e.g., wired speakers and / or wired headphones).

[0004] Thus, the techniques of this disclosure provide an intuitive and integrated way of representing changes in the state of a computing device (by using edge lighting to represent changes in the state of the computing device). Integrated edge lighting can provide additional information that identifies changes in the state of a computing device. Integrated edge lighting allows a user of a computing device to more quickly identify state changes in the computing device (compared to computing devices featuring heterogeneous state notification systems) without potentially having to resort to inspecting various system-level configuration parameters. Thus, various aspects of edge lighting techniques can reduce the number of user inputs required to perform a task or to determine the current state of a computing device, thereby reducing consumption of computing resources (e.g., processor cycles, memory space, memory bus bandwidth), which can potentially improve the power efficiency of the computing device itself. [Means for solving the problem]

[0005] In one example, various aspects of the technique relate to a method that includes one or more processors of a computing device determining a change in a state of the computing device, the one or more processors of the computing device determining a visual notification based on the change in state, and the one or more processors of the computing device interfacing with a first portion of a display of the computing device to output a light pattern based on the visual notification, the display including a first portion and a second portion, the first portion including a substantial portion of a periphery of the display and excluding the second portion of the display.

[0006] In another example, various aspects of the present technique relate to a computing device comprising a display including a first portion and a second portion, the first portion including a substantial portion of a periphery of the display and excluding the second portion of the display. The computing device comprises one or more processors configured to interface with the first portion of the display of the computing device to determine a change in a state of the computing device, determine a visual notification based on the change in state, and output a light pattern based on the visual notification.

[0007] In another example, various aspects of the present technique relate to a non-transitory computer-readable storage medium storing instructions that, when executed, cause one or more processors of a computing device to perform the following operations: determining a change in a state of the computing device, determining a visual notification based on the change in state, and interfacing with a first portion of a display of the computing device to output a light pattern based on the visual notification, the display including a first portion and a second portion, the first portion including a substantial portion of a periphery of the display and excluding the second portion of the display. [Brief description of the drawings]

[0008] [Figure 1] 1 is a conceptual diagram illustrating an example communication system configured to provide a light pattern in the vicinity of a device in accordance with one or more techniques of this disclosure. [Diagram 2] FIG. 1 is a block diagram illustrating an example computing device configured to provide visual communication via edge lighting in accordance with one or more aspects of the present disclosure. [Diagram 3] 1 is a flow diagram illustrating an example operation of a computing device for providing visual communication via edge lighting in accordance with one or more aspects of the present disclosure. [Figure 4A]FIG. 1 is a conceptual diagram illustrating an example computing device for visual communication via edge lighting in accordance with various techniques of this disclosure. [Figure 4B] FIG. 1 is a conceptual diagram illustrating an example computing device for visual communication via edge lighting in accordance with various techniques of this disclosure. [Figure 4C] FIG. 1 is a conceptual diagram illustrating an example computing device for visual communication via edge lighting in accordance with various techniques of this disclosure. [Figure 4D] FIG. 1 is a conceptual diagram illustrating an example computing device for visual communication via edge lighting in accordance with various techniques of this disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Detailed Description Generally, this disclosure describes a computing device configured to provide a user with visual communication regarding a state change of the computing device using edge lighting. The computing device may include a display along a periphery of the computing device, e.g., around a central display. The computing device may change state, e.g., in response to receiving an input (e.g., touch input, voice input, button input, motion input, touchless gesture input, remote device input). To indicate the state change, the computing device may determine a visual notification. Based on the visual notification, the computing device may display a light pattern on the display along the periphery of the computing device. In some examples, based on the visual notification, the computing device may configure the display to indicate a state change that occurred in response to the input by outputting a separate light segment along a direction in which the computing device receives the input.

[0010] The computing device can output edge lighting to provide visual communication to a user by activating a portion of pixels at the periphery of the display. The pixels of a portion of the display (a first portion of the display) can substantially include the periphery of the display and exclude pixels of a second portion of the display (a second portion of the display) that does not include the periphery of the display. The periphery of the display refers to a continuous or discontinuous band of pixels that substantially surrounds the outer edge of the display (e.g., a continuous band of pixels that surrounds more than 50% or a slightly higher percentage of the periphery of the display. The band may have a pixel width that is less than a certain percentage of the total pixels of the display, e.g., 1%, 5%, 10%, 20% or 30%, or may be higher but less than 50% of all available pixels of the display). The edge lighting may include one or more groups of activated pixels that are distinguishable from one or more other groups of pixels by different brightness or color. The computing device can vary the activation of the pixel groups over time to cause animations, such as blinking the pixel groups.

[0011] The techniques disclosed herein can improve the efficiency of a computing device and reduce user confusion regarding interaction with the computing device. As computing devices become more complex, they need ways to facilitate a user's understanding of the functionality provided by the computing device. Instead of interfacing with the user using a variety of different methods (e.g., visual notifications such as warning messages or status alerts, audible notifications such as chimes or alerts, tactile notifications such as vibrations), the computing device can provide a consistent notification system. Instead of different applications and features on the device informing the user of their functionality in a random manner or not at all, the computing device outputs light patterns as a unified notification system.

[0012] Additionally, rather than causing a computing device to unnecessarily consume resources (e.g., bandwidth, memory, processing power) by performing state changes that the user does not want, the computing device may be configured to perform state changes more efficiently (in terms of computing resources). In some cases, the computing device may use optical signals to communicate to the user how the computing device is using resources (e.g., processor cycles, memory, memory bus bandwidth) based on visual notifications. For example, in the absence of what is called a "visual language," a computing device may drain battery power by scanning the device through a personal area network (PAN) without the user's knowledge. In contrast, when utilizing a so-called visual language, the computing device may interface with a display to notify the user that the computing device is performing a scan by outputting a light pattern, allowing the user to configure the computing device to turn off the PAN. In other words, the computing device allows the user to configure the computing device to better adapt to the user's preferences. Thus, the visual language can easily eliminate wasteful consumption of computing resources.

[0013] 1 is a conceptual diagram illustrating an example communication system configured to provide a light pattern in a vicinity of a device in accordance with one or more techniques of the present disclosure. As shown in FIG. 1, system 100 includes a computing device 110, a remote device 130, and remote systems 120A-120N (hereinafter referred to as "remote systems 120"). Computing device 110 can communicate with remote device 130 and remote systems 120 over a network 140 or directly to provide a light pattern on a peripheral display 118 in a vicinity of computing device 110.

[0014] Examples of computing devices 110 include, but are not limited to, portable devices, mobile devices, or other devices, such as mobile phones (including smartphones), laptop computers, desktop computers, tablet computers, smart television platforms, server computers, mainframes, etc. For example, in the example of Figure 1, computing device 110 may be a wearable computing device, such as a smart watch.

[0015] As shown in the example of FIG. 1, the computing device 110 includes a user interface device 112. The user interface device 112 of the computing device 110 may be configured to function as an input device and / or an output device of the computing device 110. The user interface device 112 may be implemented using a variety of technologies. For example, the user interface device 112 may be configured to receive tactile input, auditory input, visual input, touchless gesture input, motion input, and / or remote device input. Examples of input devices include a presence aware display, a presence aware or touch sensitive input device, a mouse, a keyboard, a voice response system, a camera, a microphone, a button, a switch, a radar, or any other type of device for detecting signals from the environment of the computing device 110 by a user or a remote device 130. In some examples, the presence aware display includes a touch sensitive or presence aware input screen, such as a resistive touch screen, a surface acoustic wave touch screen, a capacitive touch screen, a projected capacitive touch screen, or other presence aware technology. That is, user interface devices 112 may include presence sensing devices capable of receiving tactile input from a user of computing device 110 .

[0016] The user interface device 112 can receive an indication of tactile input by detecting one or more touch gestures (e.g., tap, swipe, hold, button press) from a user. Examples of input devices may further include sensors for detecting motion (e.g., accelerometer, gyroscope), sensors for detecting position (e.g., GPS, barometer, magnetometer), sensors for detecting touchless gestures (e.g., radio transceivers), or other devices (e.g., infrared transceivers).

[0017] Additionally or alternatively, the user interface device 112 may provide tactile, auditory, or other or may be configured to function as an output device to provide output to a user using visual stimuli. Examples of output devices include a sound card, a video graphics adapter card, or any of one or more display devices, such as a liquid crystal display (LCD), a dot matrix display, a light emitting diode (LED) display, a micro light emitting diode (microLED) display, a quantum light emitting diode (QLED) display, an organic light emitting diode (OLED) display, electronic ink, or a monochrome or color display capable of outputting visual information to a user of the computing device 110. Further examples of output devices include speakers, liquid crystal displays (LCD), or other devices capable of generating understandable output to be provided to a user.

[0018] For example, user interface devices 112 may present output to a user of computing device 110 as graphical user interfaces that may be associated with functionality provided by computing device 110. In this manner, user interface devices 112 may present various user interfaces of applications (e.g., electronic messaging applications, internet browser applications) running on or accessible by computing device 110. A user of computing device 110 may cause computing device 110 to perform operations associated with the functionality by interacting with each user interface of the application.

[0019] In some examples, the user interface device 112 of the computing device 110 can detect two-dimensional and / or three-dimensional gestures as input from a user of the computing device 110. For example, a sensor of the user interface device 112 can detect a user's motion (e.g., a motion of moving a hand, arm, pen, stylus) within a threshold distance of the sensor of the user interface device 112. The user interface device 112 can determine a two-dimensional or three-dimensional vector representation of the motion and correlate the vector representation to a gesture input having multiple dimensions (e.g., a hand wave, a pinch, a clap, a pen stroke). In other words, in some examples, the user interface device 112 can detect a multi-dimensional gesture without requiring the user to gesture at or near a screen or surface for which the user interface device 112 outputs display information. Instead, the user interface device 112 can detect a multi-dimensional gesture made at or near a sensor that may be positioned near a screen or surface for which the user interface device 112 outputs display information.

[0020] In the example of FIG. 1, computing device 110 includes a user interface module 114. User interface module 114 may perform one or more operations described herein using hardware, software, firmware, or a combination thereof resident and / or operating on computing device 110. Computing device 110 may execute user interface module 114 using one processor or multiple processors. In some examples, computing device 110 may execute user interface module 114 as a virtual machine running on underlying hardware. User interface module 114 may execute as one or more services of an operating system or computing platform, or may execute in an application layer of a computing platform as one or more executable programs.

[0021] As shown in the example of FIG. 1, the user interface module 114 may include one or more functions. The user interface module 114 may be operable by the computing device 110 to, for example, receive input and send an indication of the input to other components associated with the computing device 110 to execute a command to control the user interface module 114. The user interface module 114 may also receive data from components associated with the computing device 110. Using the received data, the user interface module 114 may cause other components associated with the computing device 110, such as the user interface unit 112, to provide output based on the received data. For example, the user interface module 114 may receive data to display a GUI.

[0022] Remote system 120 represents any remote computing system, such as one or more desktop computers, laptop computers, mainframes, servers, cloud computing systems, etc., configured to store and / or manage data used by computing device 110. For example, remote system 120 may include a web server, database management system, etc. accessible via network 140.

[0023] Remote device 130 may be any additional computing device capable of communicating with computing device 110 over network 140 or directly. Examples of remote device 130 include, but are not limited to, portable devices, mobile devices, or other devices, such as mobile phones (including smartphones), laptop computers, desktop computers, tablet computers, smart television platforms, server computers, mainframes, etc. For example, in the example of FIG. 1, remote device 130 may be a wearable computing device, such as a smart watch.

[0024] The computing device 110 may display notifications in a variety of or obscure ways: The computing device 110 may notify the user with a text message via a banner; The computing device 110 may notify the user that a picture has been taken with the camera via a shutter sound; The computing device 110 may provide an indication of a state change within a nested menu with a list of configuration parameters; The computing device 110 may notify the user of unsuccessful face recognition with a vibration.

[0025] The computing device 110 may not provide, even when there is an indication of a particular state change. For example, the computing device 110 typically does not indicate a frequency of wireless scanning. As another example, the computing device 110 may not indicate receipt of a touchless gesture signal (e.g., detected via radar or other forms of wireless gesture detection). The computing device 110 may not indicate a state change due to motion (e.g., turning the computing device 110 face down). In these cases where the computing device 110 does not provide, even when there is an indication of a particular state change, the computing device 110 unnecessarily consumes computing resources (e.g., power, processor cycles, memory, memory bandwidth) as it consumes resources to perform various activities that the user does not desire (e.g., facial recognition, keyword detection, proximity detection, companion device detection, and other activities that are transparent or otherwise not actively communicated to the user).

[0026] Computing device 110 may detect companion devices, such as remote device 130, by scanning a network, such as network 140, periodically or periodically (possibly constantly or in various circumstances, e.g., when connected to a particular wireless network), thereby enabling communication with remote device 130. A signal from a remote device 130 may represent an input to the computing device 110. The computing device 110 may be configured to not alert the user to scanning or other transparent activity other than settings or other configuration parameters that may be difficult to discover in nested menus and that may be presented in current operating systems.

[0027] According to one or more techniques of the present disclosure, the computing device 110 may be configured to provide a unified and consistent visual notification to a user regarding a state change of the computing device 110 through the output of edge lighting. The user interface device 112 may include a peripheral display 118 surrounding the central display 116. The peripheral display 118 may notify a user of a state change of the computing device 110 in a consistent manner by presenting different patterns of light. The state change of the computing device 110 may be triggered by an input, such as, for example, a touch input, a voice input, a button input, a motion input, a touchless gesture input, a remote device input, etc. To indicate the state change, the computing device 110 may first determine a visual notification. The computing device 110 may then interface with the peripheral display 118 to output a light pattern based on the visual notification.

[0028] When outputting a light pattern, the computing device 110 may interface with a peripheral display to output the light pattern by activating pixels in the peripheral display 118 based on a visual indication representing the light pattern. The peripheral display 118 may include one or more groups of activated pixels that are distinguishable from one or more other groups of pixels by different brightness and / or color. The computing device 110 may vary the activation of the pixel groups over time to cause animation of the pixel groups, such as flashing, emitting light, waving, blinking, changing intensity or brightness, changing color, changing patterns over time, etc.

[0029] In operation, the user interface device 112 may include a central display 116 and a peripheral display 118. The peripheral display 118 (which may represent a first portion of the display 116 / 118) may substantially surround the central display 116 (which may represent a second portion of the display 116 / 118) and thus may exclude the central display 116. The peripheral display 118 may substantially surround the central display 116 in that the peripheral display 118 may include a band of contiguous or discontinuous pixels that substantially surrounds an outer edge of the display 116 / 118. Peripheral display 118 refers to a continuous or discontinuous band of pixels that substantially surrounds the outer edge of display 116 / 118 (e.g., a continuous band of pixels that surrounds more than 50% or a slightly higher percentage of the periphery of display 116 / 118. This band may have a pixel width that is less than a certain percentage of the total pixels of the display, e.g., 1%, 5%, 10%, 20% or 30%, or may be higher but less than 50% of all available pixels of display 116 / 118). Edge lighting may include a group of one or more activated pixels that are distinguishable from one or more other groups of pixels by a different brightness or color.

[0030] In some examples, the central display 116 and the peripheral display 118 may be different portions of a single display. In other examples, the central display 116 and the peripheral display 118 may be separate displays. The peripheral display 118 may have a variety of widths (e.g., 3 pixels, 4 pixels). In some examples, the central display 116 and the peripheral display 118 may be coplanar (i.e., the central display 116 and the peripheral display 118 are coplanar). In another example, the central display 116 and the peripheral display 118 may be on different planes. For example, the central display 116 may be on the front of the computing device 110, and the peripheral display 118 may be on an edge of the computing device 110 (e.g., the central display 116 may be disposed at a right angle, an acute angle, an obtuse angle, or any non-zero angle with respect to the peripheral display 118). The user interface device 112 may provide various user interfaces of applications via the central display 116. The user interface device 112 may output light patterns as edge lighting via the peripheral display 118.

[0031] Computing device 110 can output light patterns via peripheral display 118 in response to a state change of computing device 110. In some cases, the state change may result from activation of one or more of various sensors of user interface device 112. User interface device 112 can receive an indication of input from sensors including microphones, cameras, radar, buttons, etc. Thus, input may include tactile input, auditory input, visual input, motion input, radio transmission input, or any other input received by computing device 110 (which in this example is assumed to be a cellular handset such as a smartphone or other mobile computing device).

[0032] The user interface device 112 can detect input from a user or from another device, such as the remote system 120 or the remote device 130. The user interface device 112 can detect local input, such as a button press, or environmental input, such as an ultra-wideband (UWB) signal. The user interface module 114 can process the input to determine a user command or an indication of a future user command, and can execute a corresponding process in response to detecting the input (e.g., initiating a pairing process with the remote device 130, activating the central display 116 when a user is detected to be within visual distance of the computing device 110, activating a microphone, camera, or other sensor). In other cases, the state change may not be due to the activation of a sensor. The state change may be due to an internal process or due to the execution of a predetermined task. The computing device 110 can execute one or more of the above-mentioned operations in response to the execution of an internal process or a predetermined task.

[0033] Execution of an action may change the state of the computing device 110. The user interface module 114 may, for example, initiate execution of a command to take a picture or to increase the volume. The user interface module 114 may determine that the computing device 110 should enter a new mode of operation, such as a record mode or a discovery mode. For example, in the record mode, the computing device 110 may activate a microphone to receive, store, and / or analyze audible input. As another example, in the discovery mode, the computing device 110 may display the capabilities of the computing device 110, such as buttons available to press, microphones available to capture audio (e.g., speech), and activation of pairing with a remote device 130.

[0034] The computing device 110 may indicate a state change by first determining a visual notification representative of the state change. The user interface module 114 may determine that the state change is relevant to a user. The user interface module 114 may output a light pattern based on the visual notification to alert the user of the state change by interfacing with the peripheral display 118. Additionally, the user interface module 114 can indicate control sensitivity on the computing device 110. The user interface module 114 can provide functionality discoverability and feedback to the user by outputting light patterns specified by the visual notification. The user interface module 114 can proactively assist the user in discovering potentially unknown or misconfigured functionality by outputting light patterns based on the visual notification.

[0035] The user interface module 114 can determine visual notifications and interface with the peripheral display 118 to activate pixels on the peripheral display 118 consistently across applications on the computing device 110. In other words, the user interface module 114 can enable clear indications of various state changes (e.g., different features that the user previously configured but may have forgotten, default configurations that the user does not want to touch or enable, default configurations that the user misconfigured and does not want to enable). The user interface module 114 can employ various aspects of the edge lighting techniques described in this disclosure to alert the user to application-level state changes, but can provide indications of such state changes at a system level rather than an application level.

[0036] In some cases, the user interface module 114 may indicate a state change by outputting a light pattern based on a visual notification without using a word or icon. Instead of a word or icon, the user interface device 112 may output a light pattern based on a visual notification by interfacing with the peripheral display 118. The user interface module 114 may configure the peripheral display 118 to exhibit different light patterns that notify the user of various functions or other capabilities of the computing device 110 by activating different pixels of the peripheral display 118. In some cases, the user interface module 114 may activate all pixels on the peripheral display 118. In other cases, the user interface module 114 may activate a portion of the pixels on the peripheral display 118. The user interface module 114 may activate groups of pixels by changing brightness and / or color.

[0037] The user interface module 114 may determine the location of one or more groups of activation pixels to match a location on the computing device 110 or to indicate a direction from which the computing device 110 received an input. In some cases, the user interface module 114 may determine dynamic variation of activation of pixels over time, such that the peripheral display 118 outputs animations of light patterns. In other cases, the user interface module 114 may determine static activation of pixels.

[0038] The light patterns can provide the user with feedback regarding their interaction with the computing device 110. For example, when a user increases the volume of the audio output of the computing device 110 by pressing a volume button (which can be a physical button or a virtual button), the peripheral display 118 can output light segments near the volume button that increase in length proportional to the volume relative to the maximum volume level. As another example, when a user takes a picture using a camera app, the peripheral display 118 can output light along the entire peripheral display 118 or in close proximity to the camera sensor.

[0039] Additionally, the light patterns may provide a user, via peripheral intelligence, feedback regarding the interaction of computing device 110 with another device, such as remote device 130. For example, computing device 110 may discover a nearby remote device 130, e.g., via PAN or UWB, and the peripheral display 118 may output a light segment along a portion of the periphery that corresponds to the direction of the remote device 130. As another example, computing device 110 may be a smart TV that discovers two remote controls, and the peripheral display 118 of the smart TV may output two light segments along two portions of the peripheral display 118 indicating the direction of each of the two remote controls.

[0040] In some cases, the user interface module 114 may determine that the pixel activation pattern should include pixels whose output brightness varies, whose output color varies, or groups of pixels whose activation and deactivation vary. For example, the user interface module 114 may determine the location of different groups of patterns (visual notifications representing different groups of patterns) that match the input device or indicate the orientation or remote gesture of the remote device 130. As another example, the user interface module 114 may determine the change in pixel activation over time and generate an animation, such as a flash or a change in size of the activated pixel group. In other cases, the user interface module 114 may not distinguish between groups of pixels that have inherent variations. In this case, the user interface module 114 may determine a uniform pixel activation pattern with a single intensity and color.

[0041] The user interface module 114 can output light patterns on the peripheral display 118. The peripheral display 118 can include multiple pixels for generating the light patterns. The peripheral display 118 may have different pixels that are activated at different times to output light segments of various lengths, brightness, colors, etc. The peripheral display 118 may have inactive pixels in the absence of visual communication or for dark segments in the light pattern.

[0042] The techniques disclosed herein can promote efficient interaction between a user and the computing device 110. A common design implementation of edge lighting can reduce user confusion and frustration regarding the increasing complexity of the device. With edge lighting, symbiotic hardware and software designs can generate intuitive interaction patterns. By providing feedback via such edge lighting, the computing device 110 can enable a user to use touchless gestures more efficiently or avoid using undesirable touchless gestures. By providing discoverability guidance via edge lighting, the computing device 110 can enable a user to interact more efficiently with less common features, thereby encouraging adoption of such features. In some examples, the computing device 110 can provide a user with 360° situational awareness via the peripheral display 118 that entirely surrounds the central display 116. In this manner, edge lighting can enhance the user experience of the computing device 110 by providing a consistent mode of visual communication.

[0043] Additionally, the computing device 110 may use edge lighting visual communication to enable the user to discover operating modes of the computing device 110 that the user does not want, thereby allowing the user to disable various actions that would be performed during those operating modes. By clearly communicating with the user, the computing device 110 may avoid unnecessarily draining energy, memory, or computational resources. This allows the computing device 110 itself to operate more efficiently.

[0044] 2 is a block diagram illustrating an example computing device configured to provide visual communication regarding state changes of the example computing device via edge lighting, in accordance with one or more aspects of the present disclosure. The computing device 200 of FIG. 2 is described below as an example of the computing device 110 of FIG. 1. FIG. 2 illustrates only one particular example of computing device 200, and many other examples of computing device 200 may be used in other cases and may include some of the components included in computing device 200 or may include additional components not illustrated in FIG. 2.

[0045] As shown in the example of Fig. 2, the computing device 200 includes one or more processors 210, one or more communication units 220, one or more sensors 250, one or more storage elements 240, a central display 270, and a peripheral display 280. The storage element 240 of the computing device 200 includes a user interface module 262 and a visual notification (VN) 260. The user interface module 262 may be the same as or substantially similar to the user interface module 114 of Fig. 1. The user interface module 262 includes an input detection unit 242, a state change monitoring unit 244, a notification determination unit 246, and a display interface unit 248.

[0046] Communication channel 230 interconnects (physically, communicatively, and / or operationally) each of elements 210, 220, 240, 250, 270, and 280 for inter-element communication. In some examples, communication channel 230 may include a system bus, a network connection, an inter-process communication data structure, or any other method for communicating data.

[0047] The one or more communication units 220 communicate with external devices via one or more wired and / or wireless networks by transmitting and / or receiving network signals on the one or more networks. Examples of communication units 220 include network interface cards (e.g., Ethernet cards), optical transceivers, radio frequency transceivers, GPS receivers, or any other type of device capable of transmitting and / or receiving information. Other examples of communication units 220 may include shortwave radios, cellular data radios, wireless network radios, and universal serial bus (USB) controllers.

[0048] One or more sensors 250 can receive input. Examples of sensors 250 include, but are not limited to, capacitive touchscreens, projected capacitive touchscreens, resistive touchscreens, surface acoustic wave touchscreens, cameras, microphones, buttons, switches, accelerometers, gyroscopes, barometers, magnetometers, radar, etc. Sensors 250 can cooperate with communication unit 220 (e.g., UWB interface, personal area network (PAN) interface, global positioning system (GPS) receiver, radar detector) to receive input, such as radio wave input.

[0049] The one or more storage elements 240 store information that is processed during operation of the computing device 200. In some examples, the storage elements 240 are temporary memories. This means that the primary purpose of the storage elements 240 is not long-term storage. The storage elements 240 on the computing device 200 may be configured as volatile memories to store information short-term. Thus, when powered off, the storage elements 240 do not retain the stored content. Examples of volatile memories include random access memory (RAM), dynamic random access memory (DRAM), and dynamic random access memory (DRAM). This includes dynamic random access memory (DRAM), static random access memory (SRAM), and other types of volatile memory known in the art.

[0050] In some examples, the storage element 240 includes one or more computer-readable storage media. In some examples, the storage element 240 includes one or more non-transitory computer-readable storage media. The storage element 240 may be configured to store a larger amount of information than is typically stored by a volatile memory. The storage element 240 may be further configured to store information long-term as a non-volatile memory space and may retain information after a power on / off cycle. Examples of non-volatile memory include a magnetic hard disk, an optical disk, a floppy disk, a flash memory, or an electrically programmable memory (EPROM) or an electrically erasable programmable (EEPROM) memory. The storage element 240 may store program instructions and / or information (e.g., data) associated with the input detection unit 242, the state change monitoring unit 244, the notification determination unit 246, the display interface unit 248, and the VN 260.

[0051] The one or more processors 210 may implement functions and / or execute instructions associated with the computing device 200. Examples of the processor 210 include an application processor, a display controller, an auxiliary processor, one or more sensor hubs, and any other hardware configured to function as a processor, processing unit, or processing device. The input detection unit 242, the state change monitoring unit 244, the notification determination unit 246, and the display interface unit 248 may include instructions executable by the processor 210 to perform various operations, operations, or functions of the computing device 200. For example, the processor 210 may read and execute instructions stored by the storage element 240 and causing the processor 210 to perform operations described herein that are attributed to the input detection unit 242, the state change monitoring unit 244, the notification determination unit 246, and the display interface unit 248. When these instructions are executed by the processor 210, the computing device 200 may store information in the storage element 240, for example, in the VN 260.

[0052] 2 as part of a single device, in some examples, the components of computing device 200 may be located within and / or as part of different devices. For example, in some examples, some or all of the functionality of input detection unit 242, state change monitoring unit 244, notification determination unit 246, and display interface unit 248 may be provided in the same or different computing systems. That is, in some examples, the techniques of this disclosure may be performed and utilized by a single computing device, but in other examples, may be performed and / or utilized across multiple computing systems, e.g., distributed or "cloud" computing systems.

[0053] Computing device 200 may include a display having a first portion and a second portion. Peripheral display 280 may represent a first portion that may include a substantial portion of the periphery of display 265 (e.g., a contiguous band of pixels surrounding more than 50% or a slightly higher percentage of the periphery of the display, which may have a pixel width less than a certain percentage of the total pixels of the display, e.g., 1%, 5%, 10%, 20% or 30%, or higher but less than 50% of all available pixels of the display), while central display 270 may represent a second portion of display 265. Central display 270 may not include peripheral display 280. Peripheral display 280 may represent an example of peripheral display 118 of FIG. 1, and central display 270 may represent an example of central display 116 of FIG. 1. Computing device 200 may include peripheral display 280 and central display 270. By connecting to the interface, the VN 260 may output a light pattern indicative of one or more of the state changes of the computing device 200.

[0054] During operation, the state change monitoring unit 244 may first determine a change in the state of the computing device 200. The state change may occur in response to many different conditions. For example, the computing device 200 may be configured to activate various sensors or interfaces to identify the remote device 130, the user, or other activities in the environment, network, or other medium by periodically or contextually scanning the environment, network (e.g., PAN, any wireless network including cellular network), or other medium (e.g., to detect a user via radar or other proximity sensor) (e.g., when connected to a particular wireless network, when in a particular location indicated by a GPS sensor), etc. Rather than silently activating sensors or other interfaces to perform scans without alerting the user, the state change monitoring unit 244 may detect a change in the state of the computing device 200 (which may include a change in the state of one of the sensors 250, the communication unit 220, and the processor 210, etc.) and provide an indication representing the change in state by interfacing with the notification determination unit 246.

[0055] Additionally, the computing device 200 may change state in response to input from a user or another device, e.g., a companion device such as a smartwatch, smart glasses, smart speaker, home hub, etc. The remote device 130 may represent one example of these companion devices. In any case, the input detection unit 242 may detect inputs provided by a user via the central display 270 (if the central display 270 represents a presence-aware display capable of receiving touch input), buttons, or other sensors 250, including motion inputs detected by a gyroscope and / or accelerometer, weather inputs (e.g., humidity, air pressure, temperature, wind speed) sensed by weather sensors of the sensors 250, and GPS inputs representing the location of the computing device 200.

[0056] In other words, the input detection unit 242 can receive an indication of an input from the communication unit 220 and / or the sensor 250. The input detection unit 242 can receive an indication of a tactile input, an auditory input, a visual input, a touchless gesture input, a motion input, or a secondary device input. The sensor 250 can receive a button press, a single-touch gesture, or a multi-touch gesture. The sensor 250 can identify a voice command or a keyword (e.g., "computer") to a voice assistant. The sensor 250 can receive a QR code or an image key (e.g., face recognition). The communication unit 220 and / or the sensor 250 can detect a hand reaching out to the computing device 200 or a hand gesture to the computing device 200. The communication unit 220 and / or the sensor 250 can detect a physical movement of the computing device 200 (e.g., via a gyroscope), such as lifting or rotating the computing device 200. The communications unit 220 and / or the sensor 250 may receive an input, such as a wired connection signal, a UWB signal, a Bluetooth signal, or a WiFi signal, from a secondary device. In response to the communications unit 220 and / or the sensor 250 detecting an input via the communications channel 230, the input detection unit 242 may receive an indication of the input.

[0057] Such user and sensor inputs can result in a change in the state of the computing device 200, so that the computing device 200 can independently perform some action in response to the change in state. Instead of performing the operation silently, an indication of an input may be provided by interfacing with the state change monitoring unit 244, which may determine a change in state based on the indication of the input. The state change monitoring unit 244 may then provide an indication representing the change in state to the notification determination unit 246.

[0058] In some examples, software installed on the computing device 200 can respond to an input and initiate actions on the computing device 200 according to the software's respective instructions. For example, a camera app can activate the sensor 250's camera to take a picture in response to a button tap on a touch screen. As another example, an alarm app can snooze an alarm in response to a hand gesture. As yet another example, a volume controller can increase or decrease the volume of the computing device 200 in response to a button press on the sensor 250. As yet another example, a remote device pairing controller can discover a second computing device (e.g., remote device 130) in response to a UWB signal received by the communication unit 220.

[0059] The state change monitoring unit 244 can determine a state change due to software on the computing device 200 changing the operating mode of the computing device 200. For example, a radio wave transmitted from a remote device (e.g., the remote device 130) can cause the computing device 200 to enter a pairing mode. In this case, the state change includes the computing device 200 pairing with the remote device via a personal area network or UWB connection. As another example, a button tap on a touch screen can cause the computing device 200 to enter a recording mode. In this case, the computing device 200 receives, stores, and / or analyzes input to a microphone. As yet another example, a user can lift the computing device 200 and the computing device 200 can enter a discovery mode. In this case, the computing device 200 indicates the capabilities of the computing device 200, such as buttons available to press or microphones available to speak into.

[0060] In other cases, the state change monitoring unit 244 can analyze operations on the computing device 200 to determine significant state changes. The state change monitoring unit 244 can determine the significance of the state change based on salient characteristics of the operations. The state change monitoring unit 244 can analyze the activation of notable hardware of the computing device 200 (e.g., a camera or microphone in the sensor 250, a radio receiver and / or transmitter in the communication unit 220). The state change monitoring unit 244 can analyze changes in values ​​(e.g., sound volume, screen brightness) within a range. In this case, the state change monitoring unit 244 can provide an indication of the state change to the notification determination unit 246.

[0061] The notification determination unit 246 may receive an indication representative of a state change. Based on the state change, the notification determination unit 246 may select one of the VNs 260 that represents a pattern of pixel activation indicative of the state change. The notification determination unit 246 may interface with a display interface unit 248 that provides an indication of the selected one of the VNs 260. Based on the indication of the selected one of the VNs 260, the display interface unit 248 may interface with a peripheral display 280 and configure the peripheral display 280 to activate pixels indicated by the VN selected by the notification determination unit 246 among the VNs 260 to output a light pattern.

[0062] Based on the state change, the notification determination unit 246 may determine a visual notification to communicate the state change to the user. The notification determination unit 246 may determine the significance of the state change of the computing device 200. The notification determination unit 246 may determine the significance by predicting whether the user's knowledge of the state change will cause a change in behavior by the user. For example, the notification determination unit 246 may calculate a utility score for the state change, and determine whether the utility score is greater than or equal to a threshold user's utility score. A state change may be determined to be meaningful if it satisfies a utility score of 100. In some cases, the notification determination unit 246 may determine that the state change causes the user to participate in a new behavior (e.g., start streaming music to a newly paired remote device, discover a new function of a control on the computing device 200, etc.), resulting in a higher utility score. In other cases, the notification determination unit 246 may determine that the state change causes the user to stop participating in a behavior (e.g., stop increasing the volume or release a button on a camera app), resulting in a higher utility score.

[0063] In some cases, the notification determination unit 246 may receive a data object from the software application indicating the significance of a state change caused by the software application. In other words, the software application may be configured to provide an instruction to designate one of the VNs 260. For example, a camera app may identify taking an image as a significant state change and provide an instruction to the state change monitoring unit 244 to designate one of the VNs 260 associated with activating the camera to take an image (and / or video). As another example, a motion sensor controller may predict that a user will lift the computing device 200 and speak into a microphone and may identify future use of the microphone as a significant state change and provide an instruction to designate one of the VNs 260 associated with activating the microphone.

[0064] The notification determination unit 246 may determine that the significance of the state change (as measured by the utility score) merits presentation of one of the VNs 260. After determining that the significant state change results in selection of one of the VNs 260, the notification determination unit 246 may select one of the VNs 260.

[0065] Also, in some examples, the notification determination unit 246 may select one of the VNs 260 by determining characteristics of the state change. The characteristics may include a direction corresponding to the state change. The state change may include a characteristic corresponding to hardware on the computing device 200, such as a sensor or a button. The state change may include a characteristic corresponding to a remote device having a known position relative to the computing device 200 or a touchless gesture. The characteristics may include an intensity corresponding to the state change. In some examples, the state change may include a characteristic corresponding to a volume range or a distance between the remote device and the computing device 200. Alternatively, the notification determination unit 246 may determine that the state change does not have a significant characteristic, such as a direction or intensity.

[0066] In examples where the notification determination unit 246 determines the directionality of the state change, the notification determination unit 246 may select one of the VNs 260 that represents a pattern of pixel activation that includes a variation that indicates the directionality of the state change. For example, the selected one of the VNs 260 may represent a pattern of pixel activation that includes an activation of a first group of pixels (of the peripheral display 280), a deactivation of a second group of pixels (of the peripheral display 280), and a deactivation of a group of pixels (of the peripheral display 280) that has a higher intensity output than another group of pixels (of the peripheral display 280). The activation of an active pixel group may be specified to have a different color output than another pixel group (of the peripheral display 280). The placement of the distinct pixel groups may indicate the location of a sensor or another input mechanism that corresponds to a state change. For example, if the input detection unit 242 receives an indication of a button press that initiates a volume increase or decrease, the notification determination unit 246 may select one of the VNs 260 that specifies the location of the pixel group that corresponds to the button. As another example, if the computing device 200 is recording a microphone input, the notification determination unit 246 may select one of the VNs 260 located on the peripheral display 280 that activates a pixel group that corresponds to the microphone.

[0067] In an example where the computing device 200 notifies the user of a feature provided by the computing device 200, the notification determination unit 246 may select one of the VNs 260 that activates a separate group of pixels that matches a feature associated with the functionality of the computing device 200. In such a case, the notification determination unit 246 may select one of the VNs 260 that activates an array of pixels such that the pattern of pixels indicates the computing device 200's ability to receive additional input. For example, the notification determination unit 246 may select one of the VNs 260 that activates a pattern of pixels that includes a group of pixels that matches a power button such that the power button indicates that the associated application (e.g., a camera application) is opened. In some cases, the notification determination unit 246 may select one of the VNs 260 that activates a pixel group such that the pixel group outputs two pulses. When two pulses are presented, it indicates that two presses of the power button can open an associated application (e.g., a camera application).

[0068] The notification determination unit 246 may select one of the VNs 260 that activates an array of pixels of the peripheral display 280 to indicate a direction of a remote input, such as from the remote device 130 or a touchless gesture, relative to the computing device 200. When the computing device 200 pairs with a remote device, the position of the distinct group of pixels is aligned with the orientation of the remote device relative to the computing device 200 to indicate the orientation of the remote device relative to the computing device 200. When the computing device 200 silences the notification signal in response to a gesture gesture, the notification determination unit 246 may select one of the VNs 260 that activates a distinct group of pixels that matches the direction of the gesture relative to the computing device 200. Additionally or alternatively, the notification determination unit 246 may determine other changes in pixel groups that indicate other state changes and modify or alter existing ones of the VNs 260 (which serve as templates that the notification determination unit 246 can modify to create new VNs).

[0069] In another example, the notification determination unit 246 may select one of the VNs 260 that activates a pattern of pixels that includes one distinct group without variation. For example, the pattern may include one level of brightness and one color. In such an example, the notification determination unit 246 may determine that the state change does not correspond to an associated direction or position.

[0070] The notification determination unit 246 may select one of the VNs 260 that indicates that a group of pixels should capture the entirety of the peripheral display 280. The notification determination unit 246 may select one of the VNs 260 that indicates that the camera of the computing device 200 is activated to take a picture or video, that the computing device 200 is taking a screenshot, and / or that the computing device 200 is unlocking. In response to a state change, one of the VNs 260 that represents such a pattern can be selected.

[0071] The notification determination unit 246 can select one of the VNs 260 that represents a pattern of pixels that represents the peripheral display 280 in an animation. The notification determination unit 246 can select one of the VNs 260 that represents a dynamic time series of activations (e.g., activation followed by deactivation, a change in color or intensity of an activated pixel, a change after a delay compared to other pixel changes) as an animation. The notification determination unit 246 can select one of the VNs 260 that represents a change in activation across a group of pixels, such as by activating, deactivating, and reactivating the group of pixels.

[0072] In practice, the change in activation may be displayed as a flash or pulse of pixels when output on the peripheral display 280. The notification determination unit 246 may select one of the VNs 260 that represents a change in the number of pixels in a group of pixels over time, such that the group of pixels of the peripheral display 280 includes more activated pixels over time, or such that the group of pixels of the peripheral display 280 includes fewer activated pixels over time.

[0073] In practice, a change in the number of pixels within a group of pixels of the peripheral display 280 may be displayed as an increase or decrease in the group of pixels when activated by the peripheral display 280. An animation may correspond to a state change. For example, a group of pixels may blink to attract the user's attention when the computing device 200 is suggesting a feature of the computing device 200. As another example, a pattern of pixel activation may blink to help the user discover a feature. For example, a group of pixels adjacent to a power button may be activated, deactivated, and reactivated to indicate that a double click will launch a camera application.

[0074] In some cases, the notification determination unit 246 can select one of the VNs 260 that represents a size of the group of activated pixels proportional to the height corresponding to the state change. The notification determination unit 246 can modify the selected VN of the VNs 260 to change the size proportional to the changing height. The notification determination unit 246 can change the size of the group of pixels by activating or deactivating some pixels after a delay compared to other pixels of the group of pixels.

[0075] In some examples, the animation may include groups of pixels that change output intensity or color. For example, a separate group of pixels that corresponds to a volume change (e.g., differentiated by activation compared to inactive pixels, or by brightness or color compared to other activated pixels) may increase in size as the volume increases and decrease in size as the volume decreases. Such pixels correspond to discrete pixels represented by the peripheral display 280.

[0076] As another example, a separate group of pixels representing a remote device, such as remote device 130 shown in the example of FIG. 1, changes size in proportion to the proximity of computing device 110 to remote device 130. That is, as remote device 130 gets closer to computing device 110, it increases in size (e.g., adds activated pixels) and , shrinking (e.g., deactivating some pixels) as the remote device 130 moves away from the computing device 110. Additionally or alternatively, the notification determination unit 246 can determine other animations of the patterns of pixels to indicate other state changes.

[0077] In some cases, the notification determination unit 246 may construct a pattern that represents a state change. In other cases, the notification determination unit 246 may use a pattern indicated by a software application associated with the state change, such as a software application that provides a data object to the notification determination unit 246. In still other cases, the notification determination unit 246 may use a pattern stored in the computing device 200 as the VN 260. The pattern indicated by the software application or from the VN 260 may specify one or more intensities, one or more colors, one or more directions, and / or one or more animations. The pattern of the VN 260 may indicate a state change or a characteristic of a state change. Thus, the notification determination unit 246 may refer to a corresponding pattern in the VN 260 when it detects a state change.

[0078] A user of the computing device 200 can customize the pattern through a user interface. The notification determination unit 246 can store the customized pattern as a VN 260. The customization may include intensity, color, and / or animation. The notification determination unit 246 can provide default values ​​that the user can change. The user can further customize the type of state change for which the notification determination unit 246 determines the pattern. For example, the notification determination unit 246 can select and modify one of the VNs 260 representing a feedback or discoverability mode only when the computing device 200 is configured to provide feedback or discoverability, such as when indicated by the user in a setting configuration or as a default configuration.

[0079] After the notification determination unit 246 selects one of the VNs 260, the display interface unit 248 can interface with the peripheral display 280 to output a visual notification as a light pattern based on the selected one of the VNs 260. The display interface unit 248 can perform pixel activations specified by the one of the VNs 260 determined by the notification determination unit 246. The notification determination unit 246 can determine one of the VNs 260 that represents the light pattern and provide an indication of the determined one of the VNs 260 to the display interface unit 248.

[0080] The display interface unit 248 may represent a unit configured to interface with the peripheral display 280 and / or the central display 270. In response to receiving the determined one of the VNs 260, the display interface unit 248 may configure the peripheral display 280 (rather than the central display 270) to output the light pattern represented by the determined one of the VNs 260. In other words, the display interface unit 248 may configure a display buffer, which may be separate from (or may be integrated with) the display buffer of the central display 270, to store various values ​​that result in activation of pixels to output the light pattern represented by the determined one of the VNs 260.

[0081] Thus, the peripheral display 280 may include a separate display buffer from the central display, or both the peripheral display 280 and the central display 270 may include a separate display buffer. may share a common display buffer. If the display buffer is shared, the display interface unit 248 may store data in the shared buffer using a common interface, but the display processor only modifies the output of the light patterns for the peripheral display 280 (in some examples) by copying the contents of the display buffer that activates the pixels of the central display 270 and replacing the data that activates the pixels of the peripheral display 280 with the data provided by the display interface unit 248. Separate display buffers for each of the central display 270 and peripheral display 280 can potentially improve performance by avoiding copying of data stored for the central display 270, but increases the costs associated with separate buffers.

[0082] In some cases, computing device 200 may include two display processors for processing instructions for peripheral display 280 and central display 270, respectively. In other cases, computing device 200 may include a single display processor with two separate frame buffers, one for each of peripheral display 280 and central display 270. In some cases, computing device 200 may include a single frame buffer that is logically split into two portions.

[0083] 3 is a flow diagram illustrating an example operation of a computing device for providing visual communication via edge lighting in accordance with one or more aspects of the present disclosure. The example operation of FIG. 3 is described below, for illustrative purposes only, within the context of FIG. 2.

[0084] In the example of FIG. 3, computing device 200 includes a display 265 having a first portion (i.e., peripheral display 280 shown in the example of FIG. 2) and a second portion (i.e., central display 270 shown in the example of FIG. 2). The first portion includes only the periphery of display 265, and the second portion excludes the periphery of display 265. That is, the first portion substantially surrounds the second portion (e.g., a contiguous band of pixels that surrounds a percentage of the periphery of the display that is greater than or slightly higher than 50%. This band may have a pixel width that is less than a certain percentage of the total pixels of the display, e.g., 1%, 5%, 10%, 20%, or 30%, or may be higher but less than 50% of all available pixels of the display).

[0085] In some cases, the first portion and the second portion are two portions of a single display. In other cases, the first portion and the second portion are separate displays. The first portion may have a variety of widths (e.g., 1, 2, ..., 20 pixels). In some examples, the first portion and the second portion may be coplanar (e.g., the first portion and the second portion may be on the front surface of the computing device). In other examples, the first portion and the second portion may be disposed at different non-zero angles relative to each other. The second portion may be on the front surface of the computing device and the first portion may be on an edge of the computing device (e.g., the first portion may be disposed at a non-zero angle relative to the second portion).

[0086] Computing device 200 can detect input. Computing device 200 can detect input using any of a variety of sensors and / or communication devices (e.g., a presence-aware touchscreen, microphone, camera, accelerometer, radar), for example, via communication unit 220, sensor 250, and / or display 265. In some examples, the input may be tactile input, such as a single or multiple touch on a touchscreen of computing device 200 (which may be represented when display 265 is configured to perform presence-aware detection), or a button press on the computing device. In other examples, the input may be an audio frame, a voice message, or a text message. In yet another example, the input may be an audio input, such as a message. In yet another example, the input may be a visual input, such as a QR code. In yet another example, the input may be a motion of the computing device, such as lifting or flipping the computing device. In yet another example, the input may be a touchless gesture (e.g., radio waves) or a radio transmission, such as a signal (e.g., a UWB signal) from another computing device.

[0087] As described above, computing device 200 may determine a change in the state of the computing device in response to the input (304). The change in state may be, for example, the performance of an action or a change in an operational mode. For example, computing device 200 may unlock a second portion of the display in response to a visual password presented via the camera (e.g., using facial recognition). As another example, computing device 200 may enter a pairing mode with remote device 130 (shown in the example of FIG. 1) in response to receiving a PAN signal.

[0088] The computing device 200 may determine 306 a visual notification 260 representing the light pattern based on the change in state. The visual notification 260 may indicate activation of pixels of the peripheral display 280 that output a light pattern. The visual notification 260 may represent data indicating activation of one or more groups of pixels of various sizes or pixels having various brightness or color outputs. In some cases, a selected one of the visual notifications 260 may include data indicating activation of a single group of pixels without variation. In other cases, a selected one of the visual notifications 260 may include data indicating activation of two or more groups that are distinguishable by different brightness or different colors. A selected one of the visual notifications 260 may include data indicating activation of pixels that output an animated light pattern by blinking or changing the size of the pixel group over time.

[0089] The computing device 200 can highlight characteristics of a change in state of the pattern. The change in state can include, for example, a direction of the remote device 130 or a direction of a hardware element (e.g., microphone, button) of the computing device 200. In such an example, the selected one of the visual notifications 260 can include data indicating activation of two or more separate groups of pixels, each group aligned with a direction. The selected one of the visual notifications 260 can include data indicating an intensity, such as a volume, or a proximity to the remote device. The selected one of the visual notifications 260 can include data indicating activation of two or more separate groups of pixels, each group's size corresponding to an intensity. Additionally, the selected one of the visual notifications 260 can include data indicating activation of pixels that results in an animation. Thus, some groups of activated pixels grow or shrink in response to an increase or decrease in intensity or proximity of the computing device 200 to the remote device 130.

[0090] In this regard, the pattern can provide visual communication to the user. The pattern can assure the user that the computing device is processing the input. For example, the pattern can indicate the direction of a remote gesture, such as a hand wave, by the user, and assure the user that the computing device 200 detected the gesture. The pattern can suggest an action to the user. For example, the pattern can indicate that the user can take a picture by pressing the power button twice (e.g., via the activation, deactivation, and reactivation of a group of pixels aligned with the computing device's power button).

[0091] The computing device 200 may output (308) a light pattern based on the selected one of the visual notifications 260 by invoking the display interface unit 248 to interface with the peripheral display 280. The peripheral display 280 may perform pixel activation according to the selected one of the visual notifications 260 to generate a corresponding light pattern. This may cause the peripheral display 280 to output the light pattern. By displaying the light pattern via the peripheral display 280, the computing device 200 may indicate a 360-degree situational awareness of the environment to the user. The duration of the light pattern may be any of a variety of durations (e.g., half a second, one second, two seconds).

[0092] 4A-4D are conceptual diagrams illustrating example computing devices for providing visual communication via edge lighting in accordance with various techniques of this disclosure.

[0093] Fig. 4A illustrates an example scenario 400 having a smartphone 404 that includes a central display and a peripheral display 402. The smartphone 404 may represent an example of the computing device 200 shown in the example of Fig. 2. In the example of Fig. 4A, the smartphone 404 has detected a remote speaker 408, such as via a PAN or UWB signal, which represents an example of a remote device 130. The smartphone 404 communicates the presence of the remote speaker 408 to a user by generating a light pattern on the peripheral display 402.

[0094] That is, the smartphone 404 can determine that it has changed state in that it has the ability to communicate with a remote device (in this example, the remote speaker 408) in response to detecting the remote speaker 408. Thus, the smartphone 404 can select one of the VNs 260 based on the change in state. The smartphone 404 can interface with the peripheral display 402 to present, via the actuated portion 406, a light pattern based on the selected one of the VNs 260.

[0095] The light pattern indicates the direction of the remote speaker 408 relative to the smartphone 404 by outputting light segments at locations corresponding to the direction of the remote speaker 408 via a portion 406 of the peripheral display 402 that is different from the remainder of the peripheral display 402. The portion 406 may differ from the remainder of the peripheral display 402 as a result of outputting a different brightness or color. In some cases, the smartphone 404 may interface with the peripheral display 402 to indicate a change in proximity to the remote speaker 408 by animating the light segments output by the portion 406. For example, the portion 406 may increase in size (the number of pixels currently activated in the portion 406 relative to the number of pixels previously activated in the portion 406) as the smartphone 404 moves closer to the remote speaker 408 and decrease in size (the number of pixels currently activated in the portion 406 relative to the number of pixels previously activated in the portion 406) as the smartphone 404 moves away from the remote speaker 408.

[0096] 4B illustrates an example scenario 410 having a smart TV 415 including a central display 418 and peripheral displays 416. The smart TV 418 represents another example of the computing device 200 shown in the example of FIG. 2. The smart TV 415 detects a remote control 412A and a remote control 412B (collectively referred to as "remote controls 412"), such as via a PAN or UWB signal. Each of the remote controls 412 represents an example of a remote device 130 shown in the example of Figure 1. Thus, by detecting the remote control 412, the smart TV 418 can detect a change in state of the smart TV 415, and the smart TV 415 can select one of the VNs 260.

[0097] The smart TV 415 communicates the presence of the remote control 412 to the user by generating a light pattern via the peripheral display 416. Thus, the smart TV 415 can invoke the display interface unit 248 to interface with the peripheral display 416 to output a light pattern represented by a selected one of the VNs 260 based on the selected one of the VNs 260. The light pattern indicates the direction of each of the remote controls 412 relative to the smart TV 415 by activating portions 414A and 414B of the peripheral display 416 to present light segments at positions corresponding to the direction of the remote control 412.

[0098] Portion 414A and portion 414B ("portion 414") differ from the rest of the peripheral display 416 because portion 414 produces different brightness or color. In some cases, portion 414 may output animated light segments to indicate changing proximity to the remote control 412. For example, portion 414A may output a light segment that increases in size as the remote control 412A moves closer to the smart TV 415. As another example, portion 414B may output a light segment that decreases in size as the remote control 412B moves away from the smart TV 418.

[0099] 4C illustrates an exemplary smartphone 420 that includes a central display 424 and a peripheral display 422. The smartphone 420 may represent an example of the computing device 200 shown in the example of FIG. 2. The smartphone 420 detects input from a user, such as a touch on a touchscreen of the central display 424 or facial recognition using a camera of the smartphone 420. The smartphone 420 may determine that a state change in response to the touch or facial recognition does not correspond to a particular direction but still merits a visual communication to the user.

[0100] The smartphone 420 can determine one of the VNs 260 that corresponds to the detected state change based on the detected state change (detection of a user input). The smartphone 420 can configure the peripheral display 422 to generate a light pattern having a single light segment without variation (i.e., a light segment of uniform brightness and color) based on the determined VN of the VNs 260. In this manner, the smartphone 420 can communicate to the user that the smartphone 420 is receiving and processing the input.

[0101] The smartphone 420 can configure the peripheral displays 422 to generate the light patterns regardless of additional content displayed on the central display 424. In some cases, the peripheral displays 422 may be configured to generate the light patterns if there is a delay in generating content on the central display 424. In other cases, the peripheral displays 422 may be configured to generate the light patterns to standardize visual communication to the user across all apps installed on the smartphone 420.

[0102] 4D illustrates an exemplary smartphone 430 that includes a central display and a peripheral display 432. The smartphone 430 represents another example of the computing device 200 shown in the example of FIG. In response to the button press, the smartphone 430 can determine a state change as a change in the volume of an audio output by the smartphone 430. The smartphone 430 can then select one of the VNs 260 based on the detected state change.

[0103] The smartphone 430 communicates the volume change to the user by interfacing with the peripheral display 432 and outputting a light pattern via portion 436 based on a selected one of the VNs 260 of the peripheral display 432. The light pattern indicates the location of the volume control button 434 on the smartphone 430 by aligning the light pattern with the volume control button 434. As an example, the output light segment differs from the rest of the light output by the peripheral display 432 by a different brightness or color. The smartphone 430 can configure the peripheral display 432 to animate the light segment output by portion 436 to indicate the volume change. For example, portion 436 may indicate changes in volume of smartphone 430 to a user by increasing in size (the number of currently activated pixels among pixels included in portion 436 relative to the number of previously activated pixels among pixels included in portion 436) as volume increases and decreasing in size (the number of currently activated pixels among pixels included in portion 436 relative to the number of previously activated pixels among pixels included in portion 436) as volume decreases.

[0104] In this manner, various aspects of the present technique can enable the following: Item 1 1. A method comprising: determining, by one or more processors of the computing device, a change in state of the computing device; determining, by one or more processors of the computing device, a visual notification based on the change in state; and interfacing one or more processors of the computing device with a first portion of a display of the computing device to output a light pattern based on the visual notification; The display includes a first portion and a second portion, the first portion including a substantial portion of the periphery of the display and excluding the second portion of the display.

[0105] Section 2 detecting a user input; Item 11. The method of item 1, wherein determining a change in a state of the computing device includes determining a change in a state of the computing device based on user input.

[0106] Section 3 detecting that a wireless connection to a different device is available; 3. The method of any combination of clauses 1 and 2, wherein determining a change in state includes determining that a wireless connection to a different device is available.

[0107] Section 4 determining an orientation of the different devices relative to the computing device; Determining the visual indication includes determining a directional visual indication indicating an orientation of the different devices relative to the computing device; Interfacing with the first portion of the display includes outputting a light pattern indicating a direction of the different devices relative to the computing device based on the directional visual notification. 4. The method of claim 3, further comprising interfacing with a first portion of the display such that

[0108] Section 5 4. The method of claim 3, wherein the directional visual indication includes a proximity visual indication indicating a relative distance between the different devices and the computing device.

[0109] Section 6 The visual notification indicates a change in state of a sensor of the computing device; The method of any combination of clauses 1-5, wherein interfacing with the first portion of the display includes interfacing with the first portion of the display to output a light pattern indicative of a position of the sensor in the computing device based on the visual notification.

[0110] Section 7 7. The method of claim 6, wherein the sensor includes one or more of a camera and a microphone.

[0111] Section 8 the first portion of the display is a first display; 8. The method of any combination of paragraphs 1 to 7, wherein the second portion of the display is a second display different from the first display.

[0112] Section 9 The method of any combination of clauses 1-8, wherein the visual notification indicates that the computing device is configured to accept user input.

[0113] Item 10 10. The method of any combination of clauses 1-9, wherein the first portion of the display is positioned at a non-zero angle relative to the second portion of the display.

[0114] Section 11 1. A computing device comprising: a display including a first portion and a second portion, the first portion including a substantial portion of the periphery of the display and excluding the second portion of the display; The computing device further comprises one or more processors; One or more processors may: Determining a change in state of the computing device; Determine visual notifications based on state changes; The display is configured to interface with a first portion of a display of the computing device to output a light pattern based on the visual notification.

[0115] Item 12 The one or more processors are further configured to detect user input; Item 12. The computing device of item 11, wherein the one or more processors are configured to determine a change in a state of the computing device based on user input.

[0116] Item 13 13. The method of claim 12, wherein the one or more processors are further configured to detect that a wireless connection to a different device is available, and the one or more processors are configured to determine that a wireless connection to a different device is available. Computing device.

[0117] Section 14 The one or more processors are further configured to determine an orientation of the different devices relative to the computing device; One or more processors may: determining a directional visual indication indicating an orientation of the different devices relative to the computing device; Item 14. The computing device of item 13, configured to interface with a first portion of the display to output a light pattern indicating a direction of a different device relative to the computing device based on a directional visual notification.

[0118] Item 15 Item 14. The computing device of item 13, wherein the directional visual indication includes a proximity visual indication indicating a relative distance between the different devices and the computing device.

[0119] Item 16 The visual notification indicates a change in state of a sensor of the computing device; 16. The computing device of any combination of clauses 11-15, wherein the one or more processors are configured to interface with a first portion of the display to output a light pattern indicating a position of a sensor of the computing device based on the visual notification.

[0120] Item 17 Item 17. The computing device of item 16, wherein the sensor includes one or more of a camera and a microphone.

[0121] Section 18 the first portion of the display is a first display; 18. The computing device of any combination of clauses 11-17, wherein the second portion of the display is a second display different from the first display.

[0122] Item 19 19. The computing device of any combination of clauses 11-18, wherein the visual notification indicates that the computing device is configured to accept user input.

[0123] Item 20 20. The computing device of any combination of clauses 11-19, wherein the first portion of the display is positioned at a non-zero angle relative to the second portion of the display.

[0124] Section 21 A non-transitory computer-readable storage medium storing instructions that, when executed, cause one or more processors of a computing device to perform the following operations: Determining a change in state of a computing device; determining a visual notification based on the change in state; and interfacing with a first portion of a display of the computing device to output a light pattern based on the visual notification; The display includes a first portion and a second portion; The first portion includes a substantial portion of the periphery of the display and excludes a second portion of the display.

[0125] In one or more examples, the described functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted via a computer-readable medium as one or more instructions or codes and executed by a hardware-based processing unit. The computer-readable medium may include a computer-readable storage medium, which corresponds to a tangible medium, such as a data storage medium or a communication medium, and includes any medium capable of transferring a computer program from one place to another according to a communication protocol. In this case, the computer-readable medium may generally correspond to (1) a non-transitory tangible computer-readable storage medium, or (2) a communication medium, such as a signal or carrier wave. The data storage medium may be any available medium that can be accessed by one or more computers or one or more processors to read instructions, codes, and / or data structures for implementing the techniques described in this disclosure. The computer program product may include a computer-readable storage medium.

[0126] By way of example and not limitation, such computer-readable storage media can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage, flash memory, or any other medium that can be used to store desired program code in the form of instructions or data structures and accessed by a computer. Also, any connection is properly referred to as a computer-readable medium. For example, if instructions are transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of media. However, computer-readable storage media and data storage media do not include connections, carrier waves, signals, or other transitory media, but instead include non-transitory tangible storage media. Disk and disc, as used herein, include compact discs (CDs), laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs. Disks typically reproduce data magnetically and discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0127] The instructions may be executed by one or more processors, such as one or more digital signal processors (DSPs), general-purpose microprocessors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other equivalent integrated circuits or discrete logic circuitry. Thus, the term "processor" as used herein may refer to any of the aforementioned structures, or any other structure suitable for implementing the techniques described herein. Furthermore, in some aspects, the functionality described herein may be implemented in dedicated hardware and / or software modules. Also, the techniques described herein may be implemented entirely in one or more circuits or logic elements.

[0128] The techniques of the present disclosure may be implemented in a wide variety of devices or equipment, including wireless handsets, integrated circuits (ICs), or IC sets (e.g., chip sets). Although various elements, modules, or units have been described in this disclosure to highlight functional features of devices configured to perform the disclosed techniques, the realization of these elements, modules, or units does not necessarily require distinct hardware units. Rather, as described above, the various units may be combined into a hardware unit, along with appropriate software and / or firmware, or may be provided by a collection of interoperating hardware units, including one or more processors as described above. Good too.

[0129] Various examples have been described. These and other examples are within the scope of the following claims.

Claims

1. determining, by one or more processors of a computing device, a change in state of said computing device; determining, by the one or more processors of the computing device, a visual notification based on the change in state; and and interfacing the one or more processors of the computing device with a first portion of a display of the computing device to output a light pattern based on the visual notification; the display includes the first portion and a second portion; The method of claim 1, wherein the first portion includes a substantial portion of a periphery of the display and excludes the second portion of the display.

2. detecting a user input; The method of claim 1 , wherein determining the change in the state of the computing device comprises determining the change in the state of the computing device based on the user input.

3. detecting that a wireless connection to a different device is available; The method of claim 1 , wherein determining the change in state includes determining that the wireless connection to the different device is available.

4. determining an orientation of the different device relative to the computing device; determining the visual indication includes determining a directional visual indication indicating the direction of the different device relative to the computing device; 4. The method of claim 3, wherein interfacing with the first portion of the display comprises interfacing with the first portion of the display to output the light pattern indicating the direction of the different device relative to the computing device based on the directional visual notification.

5. The method of claim 4 , wherein the directional visual indication comprises a proximity visual indication indicating a relative distance between the different device and the computing device.

6. the visual notification indicates a change in the state of a sensor of the computing device; 2. The method of claim 1, wherein interfacing with the first portion of the display comprises interfacing with the first portion of the display to output the light pattern indicative of a position of the sensor on the computing device based on the visual indication.

7. The method of claim 6 , wherein the sensor includes one or more of a camera and a microphone.

8. the first portion of the display is a first display; The method of claim 1 , wherein the second portion of the display is a second display different from the first display.

9. The method of claim 1 , wherein the visual notification indicates that the computing device is configured to accept user input.

10. The method of claim 1 , wherein the first portion of the display is disposed at a non-zero angle relative to the second portion of the display.

11. 1. A computing device comprising: a display including a first portion and a second portion, the first portion including a substantial portion of a periphery of the display and excluding the second portion of the display; the computing device further comprises one or more processors; The one or more processors: determining a change in state of the computing device; determining a visual notification based on the change in state; A computing device configured to interface with the first portion of the display to output a light pattern based on the visual indication.

12. the one or more processors are further configured to detect user input; The computing device of claim 11 , wherein the one or more processors are configured to determine the change in the state of the computing device based on the user input.

13. The computing device of claim 11 , wherein the one or more processors are further configured to detect that a wireless connection to a different device is available.

14. the one or more processors are further configured to determine an orientation of the different device relative to the computing device; The one or more processors: determining a directional visual indication indicating the direction of the different device relative to the computing device; 14. The computing device of claim 13, configured to interface with the first portion of the display to output the light pattern indicating the direction of the different device relative to the computing device based on the directional visual notification.

15. The computing device of claim 14 , wherein the directional visual indication comprises a proximity visual indication indicating a relative distance between the different device and the computing device.

16. the visual notification indicates a change in the state of a sensor of the computing device; The sensor includes one or more of a camera and a microphone; 12. The computing device of claim 11, wherein the one or more processors are configured to interface with the first portion of the display to output the light pattern indicative of a position of the sensor of the computing device based on the visual indication.

17. the first portion of the display is a first display; The computing device of claim 11 , wherein the second portion of the display is a second display different from the first display.

18. The computing device of claim 11 , wherein the visual notification indicates that the computing device is configured to accept user input.

19. The first portion of the display is non-linear with respect to the second portion of the display. The computing device of claim 11 , wherein the computing device is positioned at a zero angle.

20. A non-transitory computer-readable storage medium storing instructions that, when executed, cause one or more processors of a computing device to perform the following operations: determining a change in state of the computing device; determining a visual notification based on the change in state; and and interfacing with a first portion of a display of the computing device to output a light pattern based on the visual indication; the display includes the first portion and a second portion; The first portion includes a substantial portion of a periphery of the display and excludes the second portion of the display.

Images