Controlling the orientation of a device screen display based on the usage context
By incorporating user face and grip position into the alignment system, the patent addresses unexpected screen orientation changes, improving user experience by aligning with user intent and reducing unwanted adjustments.
Patent Information
- Application Number
- DE102016104532
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2015-03-18
- Filing Date
- 2016-03-11
- Publication Date
- 2025-01-30
- Estimated Expiration
- 2036-03-11
AI Technical Summary
Existing alignment systems in handheld devices, which rely on Earth as a reference, often cause unexpected and inconvenient changes in screen orientation due to user posture or grip changes, disrupting the user experience.
Integration of usage context parameters, such as user face and grip position, into the auto-turn process to suppress or modify alignment changes based on these factors, ensuring alignment adjustments align with user intent.
Reduces the frequency of undesirable screen orientation changes, enhancing user experience by adapting the auto-turn system to user preferences and reducing the need for repeated device repositioning.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
BACKGROUND OF THE INVENTION 1. FIELD OF THE INVENTION
[0001] The invention generally relates to computer systems. More specifically, the invention relates to controlling the orientation of a device screen display based on usage context. 2. DESCRIPTION OF THE STATE OF THE ART
[0002] Handheld computers such as mobile phones and tablets typically control the orientation of the data displayed on a device screen depending on how the user holds the device. An orientation sensor measures the position of the device relative to the Earth and changes the screen display in response to the user's rotation of the device. In general, the orientation sensor can be implemented using a virtual sensor that receives information from a physical sensor and uses this information to determine the device's position. The orientation sensor can determine the position in a plane substantially perpendicular to the Earth's surface (i.e., vertical plane) or in a plane substantially parallel to the Earth's surface (i.e., horizontal plane). Consider a mobile device that has a general rectangular shape with long and short axes.When the user holds the device so that the long axis is generally perpendicular to the Earth, the screen orientation is set to portrait mode. When the device is rotated so that the long axis is generally parallel to the Earth (i.e., when the user holds the device sideways), the orientation sensor detects the changed position and automatically changes the screen orientation to display the data in landscape mode. This process is commonly referred to as auto-rotate mode.
[0003] Because the Earth is used as a reference, when the auto-rotate feature is enabled, the device may unexpectedly and inconveniently change the orientation of the data under certain circumstances. For example, if a user is leaning back on a couch and looking at a screen that is set to portrait orientation, the device will be oriented in portrait mode relative to the user's face, but the angle at which the device is held relative to the Earth is recorded as 45°. Because the orientation sensor and auto-rotate logic determine the device's angular position relative to the Earth, the device may automatically change the screen orientation to landscape, which effectively does not align with the user's face. In response, the user rotates the device to force the device back to portrait mode.The user may need to repeatedly rotate the device to achieve the desired orientation and find a position where they can hold the device without triggering auto-rotation. This situation is annoying and potentially detrimental to the quality of the user experience.
[0004] From EP 2 701 046 A1 a method and a device are known in which the orientation of the data on a display screen is controlled depending on an angular position of the device relative to the earth and on an angular position of the device relative to an angular position of the face of a user.
[0005] From US 2015 / 0022558 A1 a method and a device are known in which the orientation of the data on a display screen is controlled depending on an angular position of the device relative to the earth and depending on a multiple recorded scrolling by the user relative to a preferred orientation of data in a displayed content.
[0006] From US 2015 / 0042554 A1 a method and a device are known in which the orientation of the data on a display screen is controlled depending on an angular position of the device relative to the earth and depending on a handle position.
[0007] The present invention is directed to a method and an apparatus with which the problems described above can be solved better than before or at least some of them can be reduced better than before.
[0008] For this purpose, a method according to claim 1 and a device according to claim 4 are proposed. Advantageous embodiments of the invention are the subject of the dependent claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] Embodiments of the invention are described below with reference to the accompanying drawings. Like features and elements are identified by like reference numerals throughout. Fig. 1 is a simplified block diagram of a device including a computer system configured to control the orientation of a device screen display based on usage context, according to some embodiments; Fig. 2 is a flowchart of a method for controlling the orientation of a device screen display based on usage context, according to some embodiments; Fig. 3 to Fig. 5 are diagrams of the device of Fig. 1 to illustrate angular position thresholds for making changes to the orientation of the screen display according to some embodiments; and Fig. 6 is a flowchart of an alternative method for controlling the orientation of a device screen display based on usage context, according to some embodiments.
[0010] Specific embodiments will be described in more detail below by way of example and with reference to the drawings. Various modifications and alternative forms are possible, and the specific embodiments described are not to be construed as limiting the invention. Rather, all modifications, equivalents, and alternatives are intended to fall within the scope of the invention as defined by the appended claims. DETAILED DESCRIPTION
[0011] The following is a description of various embodiments of the invention. For the sake of clarity, not all features of an actual implementation are explained in this description. It should be understood that in developing such actual implementations, numerous implementation-specific decisions must be made to achieve the developer's particular goals, such as conforming to system-related or business constraints that vary from one implementation to the next.
[0012] Furthermore, such development efforts may be complex and time-consuming, but are a routine undertaking for one of ordinary skill in the art having the benefit of the present disclosure.
[0013] The subject matter of the invention will now be described with reference to the accompanying drawings. In the drawings, various structures, systems, and devices are shown only schematically in order not to unnecessarily obscure the present disclosure with details that are well known to those skilled in the art. Nevertheless, the drawings serve to explain exemplary embodiments. The terminology used in the description corresponds to the terminology in the relevant technical field. If a specific definition is chosen for a term or expression in this description, i.e. a definition that deviates from the common meaning known to those skilled in the art, this definition shall not be deemed to be an implied definition due to the consistent use of the term or expression in this description.If a term or expression has a special meaning that differs from its common technical meaning, this will be stated in the description in a definitional manner so that this special definition of the term or expression is clear and unambiguous.
[0014] The Fig. Figures 1 to 6 show example methods for controlling the orientation of a device's screen display based on one or more usage context parameters. Usage context parameters such as the position of a user's face, the user's grip position, or user reactions are incorporated into an auto-rotation decision-making process to improve device operation and optimize the user experience. The incorporation of usage context parameters reduces the likelihood and / or frequency of unexpected or unwanted orientation changes.
[0015] The device can detect the event of a change in the orientation of the screen display and can decide whether to perform or suppress a change in the orientation of the screen display based on whether the orientation change is consistent with the usage context information. If the orientation change is inconsistent with other information such as the position of the user's face or the grip of the hand, the orientation change can be suppressed. If the user responds to an orientation change by changing the position of the device in such a way that a return to the previous orientation is forced, the angle threshold for performing future orientation changes can be changed, or the auto-rotation feature can be disabled, for example, after requesting an orientation lock from the user.
[0016] Fig. 1 is a block diagram of a device 100 with a computer system 105. The computer system 105 includes a processor 110, a memory 115, a display screen 117, and a battery 120 that provides power to the computer system 105. The memory may be volatile memory (e.g., DRAM, SRAM) or non-volatile memory (e.g., ROM, flash memory, etc.). In some embodiments, the device 100 may be a communications device, for example, a cellular phone, and the computer system may include a transceiver 125 for transmitting and receiving signals via an antenna 130. The transceiver 125 may include multiple radio devices for communication according to various radio access technologies, such as Wi-Fi or cellular. An orientation sensor 135 (e.g.,An orientation sensor (e.g., an accelerometer, magnetometer, mercury switch, gyroscope, compass, or some combination thereof) is provided for measuring the position of the device 100 relative to a physical reference point or surface. The orientation sensor 135 may be a physical sensor or a virtual sensor that receives data from a physical sensor and processes the data to determine the position of the device 100. Usage context sensors, such as a camera 140 or one or more grip sensors 145, may be provided to collect information about how a feature or object positioned external to the device 100, such as a user of the device 100, is oriented relative to the position measured by the orientation sensor 135.The device 100 has an outer casing 150 that supports the display screen 117 and encloses active components of the computer system 105, providing external surfaces along which a user connects to the device 100. Grip sensors 145 can connect to the casing 150 to determine the position of a user's hand. In some embodiments, the antenna 130 can serve as a grip sensor by changing the gain characteristics of the antenna 130 depending on the position of the user's hand.
[0017] The processor 110 may execute instructions stored in the memory 115 and may store information such as the results of the executed instructions in the memory 115. The processor 110 controls the display screen 117 and, in embodiments where the display screen 117 is a touch screen, may receive user input via the display screen 117. Some embodiments of the processor 110, the memory 115, and the sensors 140, 145 may be configured to perform portions of the method 200 described in Fig. 2. For example, the processor 110 may execute an application, which may be part of the operating system for the computer system 105, to control the orientation of the data on the display screen 117 based on information from the orientation sensor 135 and usage context parameters, such as from the camera 140, the grip sensors 145, or user actions (rotation reversal or user input). Although a single processor 110 is illustrated, in some embodiments the processor 110 may include multiple distributed processors. For example, the processor 110 may have a first processing unit that interfaces with or implements the orientation sensor 135 and a second processing unit for controlling the orientation of the data on the display screen 117 based on the input from the first processing unit.
[0018] In various embodiments, device 100 may be embodied as a handheld device or a portable device, such as a laptop computer, handheld computer, tablet computer, mobile device, telephone, electronic organizer ("PDA"), music player, gaming device, a device worn by a user (e.g., a smartwatch or smart glasses), and the like. While particular example aspects of device 100 are not described herein, they may or may not be present in various embodiments without limiting the spirit and scope of the present invention as understood by those skilled in the art.
[0019] Fig. 2 shows a flowchart of an example method 200 for controlling the orientation of data on the display 117 according to some embodiments. In the example shown in Fig. 2, the device 100 is initially in portrait orientation at block 205. Of course, the method 200 can be modified so that the device starts in landscape mode. At block 210, the device 100 (e.g., the processor 110, which executes instructions and receives data from the orientation sensor 135 - see Fig. 1) a rotation event such as in the case of rotation of the device 100 beyond a predetermined angular value.
[0020] Fig. 3 shows a front view of the device 100, in which a reference position 300 of the device is indicated, which corresponds to a portrait format. For illustration purposes, it is assumed that the user holds the device 100 in the reference position 300. If the device 100 is subsequently rotated from the reference position 300 to an angular position 310 of the device measured by the orientation sensor 135, which exceeds an orientation angle threshold ±α1 (e.g., α1 = ±80 degrees), in block 210 of Fig. 2 a rotation event is detected.
[0021] In block 215, an angle of the user's face orientation is determined. Camera 140 may capture an image of the user, and the angular position of the user's face orientation may be determined. Fig. Figure 4 shows how the position of the user's face can be compared with the device position. The angular position 400 of the face's orientation can be determined by processing the captured image to detect the position of the user's eyes or ears, or some other reference points of the face. In the example shown in Fig. 4, the position of the user's face is represented as a vertical line between the user's eyes. Of course, other references may be used in some embodiments. The angular position 400 of the face orientation may be compared to the angular position 310 of the device. If the difference between the angular position 400 of the face orientation and the angular position 310 of the device is less than the threshold β of the face orientation, the device 100 may be judged to be oriented in portrait mode toward the user's face in block 220, and the orientation change that would normally have been the result of the rotation event detected in block 210 is suppressed in block 225.
[0022] If the user's face is not aligned in block 220, the user's grip is determined in block 230 based on information from the grip sensors 145 in Fig. 1. The processor 110 monitors the position of the hand so that the positions of the hand before and after detecting the rotation event in block 210 are known. Typically, a user changes hand positions when changing the orientation of the device 100. For example, if the device 100 is held in portrait orientation, the user typically holds the device 100 in one hand, whereas the user uses both hands to hold the device in landscape mode. If the hand grip has not changed, this may indicate that the user does not actually want to change the position in which they intend to use the device 100. If the hand grip has not changed in block 235, the orientation change that would normally have been the result of the rotation event detected in block 210 is suppressed in block 225.
[0023] If the hand grip is changed in block 235, the rotation event is processed and the orientation of the data on the display screen 117 is rotated to the landscape orientation in block 240.
[0024] In block 245, a reversion event is detected and implemented. For example, the user may not have wanted the orientation of the data on the display screen 117 to change. Therefore, the user rotates the device 100 in the opposite direction to force a change in orientation back to portrait. This reversion is a usage context parameter that allows the user's desired orientation to be inferred from the user's actions. If the reversion event occurred within a predetermined number of seconds (e.g., 2 seconds) from the orientation change performed in block 240, the orientation angle threshold for subsequent rotation events is modified (increased) as specified in block 225, e.g., ±α2 (e.g., α2 = ±85 degrees). This process is described in Fig. 5, where line 500 corresponds to the modified (enlarged) orientation angle threshold (±α2). Modifying the orientation angle threshold for future rotation events reduces the future likelihood of unwanted orientation changes being made. The modified orientation angle threshold may remain in effect as long as the display screen 117 is active, may be used as the default orientation angle threshold for any future use of the device, and / or may be reset following a power-on cycle of the device 100.
[0025] In the case of procedure 200, which Fig. 2, three types of user context parameters are considered. However, the user context parameters are not limited to the examples given here, and not all types of user context parameters need to be used. For example, if face orientation is not used, blocks 210 and 220 may be omitted, and a transition occurs from block 210 directly to block 230. If grip position is not used, blocks 230 and 235 may be omitted, and branch "N" leads from block 220 directly to block 240. If only rotation reversal detection is used, a direct transition may occur from block 210 to block 240, and blocks 215-235 may be omitted.
[0026] In an alternative embodiment of a Fig. In the method 600 for controlling the orientation of the device screen display shown in FIG. 6, the usage context parameters can be used to prompt the user for the preferred orientation if the usage context parameter is inconsistent with the rotation event detected in block 215. Instead of suppressing an orientation change based on the face orientation in block 220 or based on the grip position in block 235, or instead of modifying the orientation angle threshold in response to a rotation reversal event in block 250 (see FIG. 2), the user can be prompted in block 265 as to whether the orientation of the data on the display screen 117 should be locked in the previous orientation. If the user desires the orientation of the data to be locked in block 265, the locking is enabled in block 270 until the next timeout or power-up cycle of the device 100.If the user does not wish to lock the orientation in block 265, the orientation change is performed in block 275. Here, too, additional usage context parameters may be used, or certain usage context parameters may be omitted, as explained above in connection with . Fig. 2 was executed.
[0027] In an alternative embodiment, the detection of the rotation reversal event in block 245 of Fig. 6 can be performed by prompting the user after the initial rotation event that occurred in block 240 by displaying a subtle pop-up window stating: "Screen display rotated: To return to (and lock in) the previous orientation, tap the screen." The rotation reversal event is detected in this context by registering a user tap on the screen in block 265 (i.e., the usage context parameter is a user data input). The time interval of block 250 can specify the time interval during which the pop-up window remains visible before disappearing.
[0028] The use of usage context parameters in controlling the orientation of data provided on the display screen 117 improves the user experience by reducing the likelihood of unwanted orientation changes. The user does not have to struggle to find a position in which to hold the device 100 to maintain the desired orientation of the displayed data. Rather, the auto-rotation system can be adapted based on the usage context parameter(s) to avoid such unwanted orientation changes.
[0029] In some embodiments, certain aspects of the methods described above may be implemented by one or more processors of a processing system executing the software. The methods 200, 600 described herein may be implemented by executing the software on a computing device, such as the processor 110 of Fig. 1. However, such methods are not irrelevant insofar as they improve the operation of the device 100 and the user experience when operating the device 100. Before execution, the software instructions can be transferred from the non-transitory computer-readable storage medium to a memory, for example, to the memory 115 of Fig. 1.
[0030] The software may include one or more sets of executable instructions stored on or otherwise tangibly present on a non-transitory computer-readable storage medium. The software may include the instructions and certain data that, when executed by one or more processors, cause the one or more processors to perform one or more aspects of the methods described above. The non-transitory computer-readable storage medium may be, for example, a magnetic or optical disk, solid-state storage such as flash memory, cache memory, random access memory (RAM) or other non-volatile storage device, and the like.The executable instructions stored on the non-transitory computer-readable storage medium may be in source code, assembly code, object code, or other data format that can be interpreted or otherwise executed by one or more processors.
[0031] A computer-readable storage medium may include any storage medium or combination of storage media that can be accessed during use by a computer system to provide commands or instructions and / or data to the computer system. Such storage media may include, but are not limited to, optical media (e.g., a compact disc (CD), digital versatile disc (DVD), Blue Ray disc), magnetic media (e.g., a floppy disc, magnetic tape, or a magnetic hard disk), volatile memory (e.g., random access memory (RAM) or cache), non-volatile memory (e.g., read-only memory (ROM) or flash memory), or microelectromechanical system (MEMS)-based storage media. The computer-readable storage medium may be integrated into the computer system (e.g., system RAM or ROM), permanently attached to the computer system (e.g.,a magnetic hard disk), be removably attached to the computer system (e.g., an optical disk or a Universal Serial Bus (USB)-based flash memory), or be connected to the computer system via a wired or wireless network (e.g., a network-accessible storage (NAS)).
[0032] A method for controlling an orientation of data on a display screen of a device includes determining a device angular position for the device, determining a usage context parameter for the device, and controlling the orientation of the data on the display screen based on the device angular position and the usage context parameter.
[0033] A device includes a display screen, an orientation sensor for determining a device angular position for the device, and a processor coupled to the orientation sensor. The processor determines a usage context parameter for the device and controls the orientation of the data on the display screen based on the device angular position and the usage context parameter.
[0034] A method for controlling the orientation of data on a display screen of a device includes determining an angular position of the device for the device, detecting a first display orientation change event in response to an angular position of the device exceeding a first orientation angle threshold associated with a first orientation, changing the orientation of the data on the display screen from a first orientation to a second orientation, detecting a display orientation change event in response to an angular position of the device exceeding an orientation angle threshold associated with a second orientation, changing the orientation of the data on the display screen from the second orientation to the first orientation, and modifying the first orientation threshold.
[0035] The specific embodiments described above are for illustrative purposes only. Those skilled in the art will recognize that the invention may be modified and practiced in various but equivalent ways. For example, the above-mentioned method steps may be performed in reverse order. Furthermore, except as set forth in the appended claims, there are no limitations on construction details and configurations. It is therefore obvious that the specific embodiments described above may be changed and modified without departing from the scope of the present invention.Where terms such as "first," "second," "third," or "fourth" are used to refer to the various steps or structures in this specification and the appended claims, these terms serve merely as a shorthand reference to such steps / structures and do not necessarily imply that these steps / structures must be performed in the recited order. Of course, depending on the precise wording of the claims, an ordered sequence of such processes may or may not be necessary. The scope of protection is thus recited in the appended claims.
Claims
[1] A method for controlling an orientation of data on a device screen, comprising: Determining an angular position of the device for the device; Determining a usage context parameter for the device; Control the orientation of data on the display screen; detecting a display orientation change event in response to an angular position of the device exceeding an orientation angle threshold associated with a first orientation for displaying the data; querying a user of the device for the preferred orientation in response to detecting the display orientation change event and in response to determining that the particular usage context parameter is inconsistent with the detected display orientation change event; and Locking the orientation of the data on the display screen in the first orientation in response to the user requesting the orientation of the data on the display screen in the first orientation. [2] The method of claim 1, wherein determining the usage context parameter comprises detecting an angular position of the orientation of a user's face, and determining that the determined usage context parameter is inconsistent with the detected display orientation change event comprises determining that the angular position of the orientation of the user's face matches the first orientation. [3] The method of claim 1 or 2, wherein determining the usage context parameter comprises monitoring a grip position of the user on the device, and determining that the determined usage context parameter is inconsistent with the detected display orientation change event comprises determining that the grip position of the user on the device prior to detecting the display orientation change event does not change after detecting the display orientation change event. [4] Device comprising: a display screen; an orientation sensor for determining an angular position of the device for the device; and a processor coupled to the orientation sensor, the processor determining a usage context parameter for the device, detecting a display orientation change event in response to an angular position of the device exceeding an orientation angle threshold associated with a first orientation for displaying the data, informing a user of the device in response to detecting the display orientation change event and in response to determining that the determined Usage context parameter is inconsistent with the detected display orientation change event, prompts for the preferred orientation, and locks the orientation of the data on the display screen in the first orientation in response to the user requesting the orientation of the data on the display screen in the first orientation. [5] The device of claim 4, further comprising a camera coupled to the processor for capturing an image of the user of the device, wherein the processor determines an angular position of the orientation of a user's face to determine the usage context parameter, and wherein the processor determines that the angular position of the orientation of the user's face matches the first orientation to determine that the user context parameter does not match the detected display orientation change event. [6] The device of claim 4 or claim 5, further comprising a grip sensor coupled to the processor for determining a grip position of a user on the device, wherein the processor monitors changes in the grip position to determine the usage context parameter, and wherein the processor determines that the grip position of the user on the device before detecting the display orientation change event does not change after detecting the display orientation change event to determine that the user context parameter does not match the detected display orientation change event.
Citation Information
Patent Citations
Information display device, control method, and program
EP2701046A1
Orientation Control For a Mobile Computing Device Based On User Behavior
US20150022558A1
Method for adjusting screen displaying mode and electronic device
US20150042554A1