Electronic devices and their screen control methods
By working together with the flexible display and the processor, the content display reference point of the display area is adjusted, which solves the problems of content defocusing and vibration when the display area size of the flexible electronic device is adjusted, and achieves a continuous user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-12
- Publication Date
- 2026-03-13
AI Technical Summary
When flexible electronic devices adjust the size of the display area, the content configuration may change or become out of focus, resulting in a discontinuous user experience and screen vibration.
By combining a flexible display and a processor, the content display reference point is adjusted based on changes in the size of the display area to ensure continuous display of content on the screen and to compensate for screen vibration.
Maintaining content continuity and user focus before and after adjusting the display area size provides a stable screen switching experience.
Smart Images

Figure CN116391224B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to electronic devices and methods for controlling their screens. For example, this disclosure relates to electronic devices including flexible displays and methods for controlling their screens. Background Technology
[0002] Recently, the use of flexible electronic devices that can change the physical shape of the display area is becoming increasingly popular. For example, foldable, rollable, or sliding electronic devices employ structures to enlarge or shrink the display area, thus maintaining portability and providing a wide screen by increasing the size of the display area as needed.
[0003] If the size of the display area is adjusted (e.g., enlarged or reduced) in a flexible electronic device, a layout that is fully configured to adjust the size of the display area may be required. Summary of the Invention
[0004] Technical issues
[0005] If the size of the display area of a flexible electronic device is adjusted (e.g., enlarged or reduced), problems may occur before / after the adjustment of the display area size, such as changes in content configuration or screen content becoming out of focus on the screen.
[0006] If the size of the display area of a flexible electronic device is adjusted, the content display state provided before / after the adjustment may be interrupted, causing inconvenience to the user.
[0007] Embodiments of this disclosure provide an electronic device and a screen control method thereof for maintaining content continuity and user-centric content focus on the screen before / after adjusting the size of the display area.
[0008] Embodiments of this disclosure provide an electronic device and a screen control method thereof for providing a continuous content viewing experience to a user before / after adjusting the size of the display area.
[0009] Embodiments of this disclosure provide an electronic device and a screen control method thereof for providing stable screen switching by compensating for screen vibration or jitter caused by adjusting the size of the display area.
[0010] Solution to the problem
[0011] An electronic device according to various example embodiments may include: a flexible display configured to change the size of an area exposed to the outside of the electronic device; and at least one processor connected to the flexible display. The at least one processor may be configured to: receive input for changing the area to a second size based on the area being a first size and a first screen being displayed in the area; and, based on the area being changed to the second size according to the input, display a second screen in the area that has been changed to the second size, corresponding to the second size. Among a plurality of elements in the content, the second screen may include a first element and a second element of the content corresponding to elements in the first screen.
[0012] An electronic device according to various example embodiments may include a flexible display configured to change the size of an area exposed to the outside of the electronic device, and at least one processor connected to the flexible display. The at least one processor may be configured to: display a first screen in the area having a first size and including a portion of an object; receive input for enlarging the size of the area to a second size; and, based on the area being enlarged to the second size according to the input, display a second screen in the area enlarged to the second size, thus enlarging the first screen to correspond to the second size. The second screen may include at least a portion of a first element corresponding to the object and a second object.
[0013] Beneficial effects of the invention
[0014] According to various example embodiments, content continuity and user-centric content focus can be maintained on the screen before / after adjusting the size of the display area.
[0015] According to various example embodiments, a continuous content viewing experience can be provided to the user before / after adjusting the size of the display area.
[0016] According to various example embodiments, stable screen switching can be provided by compensating for screen vibrations or jitters caused by adjusting the size of the display area.
[0017] In addition, various effects can be obtained directly or indirectly from this disclosure. Attached Figure Description
[0018] The above and other aspects, features, and advantages of certain embodiments of this disclosure will become clearer from the following detailed description taken in conjunction with the accompanying drawings, in which:
[0019] Figure 1A This is a block diagram illustrating an example configuration of an electronic device according to various embodiments;
[0020] Figure 1B This is a diagram illustrating example variations of the display reference point in an electronic device according to various embodiments;
[0021] Figure 2A and Figure 2B This is a diagram illustrating examples of changes in the sliding state in an electronic device according to various embodiments;
[0022] Figure 2C This is a diagram illustrating examples of changes in the sliding state in an electronic device according to various embodiments;
[0023] Figure 2D This is a diagram illustrating examples of changes in the sliding state in an electronic device according to various embodiments;
[0024] Figure 3A This is a diagram showing the changes based on the comparison example, enlarged according to the screen size;
[0025] Figure 3B and Figure 3C This is a diagram illustrating example screens for screen control according to various embodiments;
[0026] Figure 4A This is a flowchart illustrating example screen control methods according to various embodiments;
[0027] Figure 4B This is a flowchart illustrating example screen control methods according to various embodiments;
[0028] Figure 5A and Figure 5B This is a diagram illustrating examples of screen control according to various embodiments;
[0029] Figure 6A This is a flowchart illustrating example screen control methods according to various embodiments;
[0030] Figure 6B This is a diagram illustrating example screen controls according to various embodiments;
[0031] Figure 7A and Figure 7B This is a diagram illustrating an example of screen control according to an embodiment.
[0032] Figure 8A and Figure 8B This is a flowchart illustrating example screen control methods according to various embodiments;
[0033] Figure 9 This is a diagram illustrating example screen controls according to various embodiments; and
[0034] Figure 10 This is a block diagram illustrating example electronic devices in a network environment according to various embodiments; Detailed Implementation
[0035] Various exemplary embodiments are disclosed below with reference to the accompanying drawings.
[0036] refer to Figure 1A , Figure 1B , Figure 2A , Figure 2B , Figure 2C and Figure 2D Example configurations of electronic devices according to various embodiments are described. The illustrated example configurations are provided merely to aid in understanding and describing the various embodiments, and the scope of the embodiments is not limited to any particular structure. Various embodiments that modify, alter, apply, and enlarge the illustrated structures are possible within the scope of flexible displays.
[0037] Electronic devices according to various embodiments may include flexible displays (e.g., slidable or rollable displays). A flexible display may be a display in which the size of an area exposed to the outside of the electronic device (or seen from the front surface of the electronic device) changes (e.g., enlarges or shrinks).
[0038] In the following description, the area of the display exposed to the outside of the electronic device may be referred to as the display area. The display area may refer to a physical area. A screen can be displayed through the display area. If the size of the display area is adjusted, the size of the screen displayed in that area may change in response to the adjustment of the display area's size.
[0039] Figure 1A This is a block diagram illustrating an example configuration of an electronic device according to various embodiments.
[0040] refer to Figure 1A The electronic device 100 according to an embodiment may include a display 110 and at least one processor 120 (e.g., including processing circuitry). The display 110 and at least one processor 120 included in the electronic device 100 may be electrically connected and / or operatively connected to each other to exchange signals (e.g., commands or data).
[0041] Electronic device 100 may include Figure 10 At least a portion of the electronic device 1001 shown. For example, the display 110 may be... Figure 10 The display module 1060. The processor 120 may be... Figure 10 The processor (one of 1020, 1021 or 1023).
[0042] Electronic device 100 may include display 110, the size of which is variable for the display area exposed outside electronic device 100.
[0043] Display 110 may be a flexible display (e.g., a sliding display or a rollable display). Display 110 may be a display capable of adjusting (e.g., enlarging or shrinking) the size of the display area. Display 110 may be a display for changing its shape. Display 110 may have a flexible form factor. The size of the display area may change (e.g., enlarge or shrink) according to the deformation state of display 110 (e.g., sliding state, rolling state, enlarged state, reduced state, maximum enlarged state, maximum reduced state, intermediate state).
[0044] The display 110 may be a display that zooms in or out based on user input (e.g., slide-in / slide-out input based on a swipe operation, or roll-in / roll-out input based on a scroll operation).
[0045] The display 110 can be slid or rolled in at least one direction (e.g., widthwise or lengthwise). The size of the display area exposed to the outside of the electronic device 100 can be changed by sliding or rolling the display 110.
[0046] The electronic device 100 may include a sliding structure or a scrolling structure for adjusting the size of the display area.
[0047] The display 110 according to an embodiment may, for example, include a slidable or rollable single-axis flexible display. For example, the display 110 may slide out along a single axis in a first direction (e.g., to the right laterally or downwards vertically) and slide in in a second direction (e.g., to the left laterally or upwards vertically), the second direction being the opposite of the first direction. The size of the display area can be enlarged by the slide-out operation, and the size of the display area can be reduced by the slide-in operation. The display 110 according to an embodiment may also be a slidable or rollable multi-axis flexible display. For example, the display 110 may slide out along multiple axes in an enlargement direction (e.g., outwards, laterally (left and right) or vertically (up and down)) and slide in in the opposite direction (e.g., inwards, laterally (right and left) or vertically (down and up)). The size of the display area can be enlarged by a bidirectional slide-out operation, and the size of the display area can be reduced by a bidirectional slide-in operation.
[0048] The display area exposed to the outside of the electronic device 100 can be resized (e.g., zoomed in or zoomed out) depending on user input.
[0049] When the display area of the display 110 exposed to the outside of the electronic device 100 is of a first size and the first screen is displayed in the display area, the processor 120 can receive input for changing the display area to a second size. For example, the input can be any one of an opening input for enlarging the size of the display area, a closing input for shrinking the size of the display area, a sliding input for enlarging the size of the display area, and a sliding input for shrinking the size of the display area.
[0050] When the display area changes to a second size based on input, the processor 120 can display a second screen in the display area that has changed to the second size, which corresponds to the first screen.
[0051] For example, if the display area is magnified according to user input, the processor 120 can identify the size of the magnified display area based on the magnification distance. If the display area is shrunk according to user input, the processor 120 can identify the size of the shrunk display area based on the shrunk distance. The electronic device 100 may include sensor structures (not shown, e.g., one or more Hall sensors / magnets, multiple switches, gyroscope sensors, accelerometers, grip sensors, proximity sensors, posture sensors, infrared (IR) sensors, etc.) for detecting the magnification or shrunk distance of the display area. If the size of the display area changes from a first size (e.g., magnified or shrunk) to a second size, the processor 120 can change the first screen that would be displayed in the first-sized display area (e.g., scaled according to the changed size or a ratio corresponding to the changed size) to a second screen corresponding to the second size using the changed second-sized display area.
[0052] For example, the first screen may include content elements before scaling. The second screen may include content elements after scaling.
[0053] Content may include multiple elements (content elements, such as objects or at least a portion of objects, such as text, images, and videos). For example, one of multiple content pages (e.g., web pages, wired / wireless internet pages, application pages) that include content may be set to the first display portion to be included in the first screen and displayed through a display area of a first size.
[0054] If the display area changes from a first size (e.g., enlarges or shrinks) to a second size, the content can be scaled. For example, if the content is scaled, text within the content can be rearranged according to the scaled text area size, or images or videos, or portions thereof, within the content can be resized according to a scaling ratio (e.g., the ratio of the first size to the second size). One of a plurality of content pages including the scaled content can be set to the second display portion to be included in the first screen and displayed by changing the display area to the second size.
[0055] Among multiple elements in the content (e.g., objects or at least a portion of objects such as text, images, and videos), the second screen may include a first element and a second element in the content that correspond to elements in the first screen.
[0056] In an embodiment, the element in the first screen corresponding to the first element of the second screen (hereinafter referred to as the reference element) can be a display reference. For example, the reference element can be an element displayed in response to a reference position (e.g., any one of zero point, starting point, top row, and top sector) of an area of the first size. For example, the reference element can be any one of a reference point (e.g., the starting point at the top of the first screen), a reference word (the first word at the top of the first screen), a reference line (the first line at the top of the first screen), a reference object (an object at the top of the first screen), and at least a portion of the reference object displayed at the reference position of the area of the first size.
[0057] A reference position can indicate the physical reference position of the display area (e.g., the zero point, starting point, specific coordinates used as a reference, vertical axis reference point, and vertical axis zero point of the display area). The reference position of the display area can remain fixed even if the screen displayed in the display area or the content on the screen changes.
[0058] Reference elements used as a reference for content display can be displayed in response to a reference position (e.g., a starting point) of the display area. Reference elements in the first screen can be displayed in response to a reference position within the display area. Reference elements in the second screen can be displayed in response to a reference position within an area that has changed to a second size.
[0059] The displayed portion of the content can be set based on the reference element.
[0060] If the display area changes from a first size to a second size, the second display portion of the content to be included in the second screen can be set based on a reference element in the first screen. For example, the second display portion can be set to include a first element in the scaled content that corresponds to the reference element in the first screen, and a second element that is different from the element in the first screen and is not included in the first screen. The second display portion can be included in the second screen and displayed in the display area that has changed to the second size.
[0061] In an embodiment, the second display portion of the content to be included in the second screen can be set based on any of the type of reference element in the first screen, the position of the reference element in the first screen, and user settings related to screen display (e.g., text-priority mode, scalable object-priority mode, or display reference hold mode).
[0062] The second display portion of the content to be included in the second screen can be configured to include both the first and second elements. For example, the first element, which corresponds to a reference element in the first screen, can be a reference element in the second screen. The second element differs from the element in the first screen, and may not be displayed in that area if the area is of the first size.
[0063] The reference element corresponding to the first element in the first screen can be displayed at the top of the area of the first size. The first element can be displayed at the top of the area that has been changed to the second size. The second element can be displayed at the bottom of the area that has been changed to the second size.
[0064] If the reference element in the first screen is text, the text corresponding to that reference element can be rearranged and included in the second screen. If the reference element in the first screen is an image or video, at least a portion of the image or video corresponding to that reference element can be resized and included in the second screen.
[0065] Reference elements in the content that serve as a reference for setting the display portion can be any one of reference points, reference words, reference lines, reference objects, and at least a portion of reference objects included in the content.
[0066] For example, a reference element can be a reference point within the content. A reference point can be any of the following: a point related to the display of the content, a spot, a zero point (e.g., (0, 0), a starting point, a plane coordinate (e.g., (x, y)), any of the plane coordinates (e.g., (0, y), (x, 0)), a pixel, the basic unit of display, and a point (e.g., the starting point) of a reference row (e.g., the topmost pixel row, the first pixel row).
[0067] As another example, within elements of content, a reference point can be a reference word (e.g., the first word at the top of the first screen), a reference line (e.g., a sentence at the top of the first screen), a reference object (e.g., an image or video type object at the top of the first screen), the first paragraph (e.g., the first text paragraph at the top of the first screen), and at least a portion of an image or video type object (e.g., an object portion at the top of the first screen).
[0068] Unlike a fixed shape factor that physically fixes the size of the display area, a display 110 that is a flexible shape factor (e.g., a sliding display, a rollable display) can frequently change the size of the display area based on user input.
[0069] By adaptively or in real-time adjusting the content display portion based on the screen resizing, various embodiments can continuously maintain the continuity of content display under a flexible shape factor and user-centric content focus.
[0070] In various embodiments, a display reference can be adjusted (or moved) to set the content display portion to be displayed in a sized display area. Content can be moved and displayed according to the adjusted display reference. By moving the content based on the adjusted display reference, a content display portion corresponding to the sized display area can be set. Adjusting (or moving) the display reference can indicate adjusting (or moving) the position used to display reference elements (e.g., reference points, reference words, reference lines, reference objects, or at least a portion of reference objects) that serve as display references. By adjusting (or moving) the display reference and setting the content display portion corresponding to the sized display area based on the adjusted display reference, continuity of content display and content focus can be maintained.
[0071] The adjustment scheme for the display reference will be explained in more detail below with reference to the accompanying drawings. For convenience, the following description mainly focuses on the display reference point (hereinafter, the display reference point (e.g., the vertical axis reference point)) that is displayed in response to the reference position (e.g., zero point, starting point) of the display area, which is an embodiment of the display reference.
[0072] Figure 1B This is a diagram illustrating example variations of the display reference point in an electronic device according to various embodiments.
[0073] The display 110 of the aforementioned electronic device 100 may be a sliding display or a rollable display. Figure 1B An example of a horizontally magnified display is shown.
[0074] Reference numeral 150 indicates the display area in a first state (e.g., slide-in state, collapsed state, shrunk state, or maximum shrunk state). Reference numerals 152 and 154 indicate the display area in a second state (e.g., slide-out state, open state, zoomed-in state, maximum zoomed-in state, or intermediate state).
[0075] Reference numeral 160 in the attached figure indicates the reference position (e.g., start point, zero point) for display areas 150, 152, and 154. As shown, the reference position can be fixed regardless of the size of the display area.
[0076] Reference numerals 170, 172, and 174 indicate changes in the position of the display reference point within the content. Reference numeral 170 indicates the display reference point before the magnified display area. Reference numeral 172 indicates the display reference point after the magnified display area has not been adjusted (or moved). Reference numeral 174 indicates the display reference point after the magnified display area has been adjusted.
[0077] In the display area 150 before magnification, the display reference point 170 of the content can be displayed at the reference position 160 of the display area (e.g., the start point, zero point, Y-axis zero point, vertical axis reference point).
[0078] The display area 150 can be enlarged according to the user's input (e.g., slide in input, collapse input, slide out input, expand input).
[0079] When the display area 150 is magnified, a portion of the content included in the first screen displayed in the unmagnified display area 150 may move off-screen. Therefore, the display reference point 170 may disappear from the second screen displayed in the magnified display areas 152 and 154. Reference numeral 172 indicates that the display reference point is not displayed in the magnified display area 152.
[0080] The display reference point 172, which extends beyond the second screen displayed in the enlarged display areas 152 and 154, can be moved vertically and returned to the reference point 160 in the display area 154.
[0081] In one embodiment, the display reference point 174 of the content can be moved vertically (e.g., downwards) and included in a second screen displayed within the enlarged display area 154. The display portion of the content can be set based on the vertically moved display reference point 174.
[0082] When display reference points 172 and 174 are moved vertically, the position of display reference point 174 after the enlarged display area can be adjusted (or moved) to correspond to the position of display reference point 170 before the enlarged display area. The portion of content to be included in the second screen can be set based on the adjusted display reference point 174. For example, a portion of the content corresponding to the size of the enlarged display area 154 can be specified starting from display reference point 174, and this portion can be included in the second screen and displayed through the enlarged display area.
[0083] The display area size of the display 110 can be changed (e.g., zoomed in or zoomed out) depending on a sliding or scrolling operation.
[0084] For example, the main area, which is part of the display 110, can always be visible to the outside. The alpha area, which is another part of the display 110, can be located inside the housing and not visible to the outside in a first state (e.g., a sliding state or a retracted state when the housing is pushed in), and can be visible to the outside in a second state (e.g., a sliding state or an open state when the housing is pulled out).
[0085] The size of the display area can be enlarged when the alpha area is pushed into or pulled out of the housing via a sliding or opening operation. Conversely, the size of the display area can be reduced when the alpha area, pulled out of the housing, is pushed into the housing via a sliding or retracting operation.
[0086] The electronic device 100 according to an embodiment may include Figure 2A , Figure 2B , Figure 2C and Figure 2D Any of the displays 200, 202, and 204 shown.
[0087] Figure 2A and Figure 2B This is a diagram illustrating examples of changes in the sliding state in an electronic device according to various embodiments.
[0088] The electronic device 100 according to an embodiment may include, for example, Figure 2A The sliding display 200 shown.
[0089] like Figure 2A and Figure 2B As shown, the slidable display 200 can be enlarged or reduced in one direction (e.g., horizontally (e.g., the X-axis direction)). The slidable display 200 can have a structure that slides out and enlarges in a first direction 250 (e.g., the right side of the horizontal direction), or a structure that slides in and shrinks in a second direction opposite to the first direction (e.g., the left side of the horizontal direction).
[0090] like Figure 2A and Figure 2B As shown, the slidable display 200 can be rolled up. Shape or Shape. If the user performs an operation to unfold the display 200 (slide out operation), the rolled-up display 200 can be pushed out in a first direction 250 (e.g., to the right) to enlarge the first display area 210 of the display 200 to the second display area 220.
[0091] Figure 2A and Figure 2B Reference numeral 210 indicates the display area of the display 200 in a first state (e.g., slide-in state, pre-magnification state). The display area 210 in the first state may include a main area 230. The size of the display area 210 can be enlarged by sliding out in a first direction 250 (e.g., to the right).
[0092] Before magnification, display area 210 can display a first screen. After magnification, display area 220 can display a second screen. The first screen and the second screen can have different screen sizes (or aspect ratios). The screen size of the first screen can correspond to the size (or ratio) of display area 210 before magnification. The screen size of the second screen can correspond to the size (or ratio) of display area 220 after magnification.
[0093] For example, if the display area 210 of the display 200 is enlarged along a first direction 250 (e.g., to the right), the second screen displayed in the enlarged display area 220 (e.g., aspect ratio 20:9) can have a wider aspect ratio horizontally than the first screen displayed in the unenlarged display area 210 (e.g., aspect ratio 4:3).
[0094] Figure 2A and Figure 2B Reference numeral 220 indicates the display area of the display 200 in a second state (e.g., a slide-out state, a magnified state). The display area 220 in the slide-out state may include a main area 230 and an alpha area 235. The alpha area 235 may be an area that is collapsed in the slide-in state and added (pushed out) when the display 200 is magnified by the slide-out operation.
[0095] Figure 2C This is a diagram illustrating examples of changes in the sliding state in an electronic device according to various embodiments.
[0096] The electronic device 100 according to an embodiment may include, for example, Figure 2C The slideable display 202 is shown. (As shown in the image) Figure 2CAs shown, the slidable display 202 may have a structure that slides out and enlarges in a second direction 252 (e.g., the left side of the lateral direction), or slides in and shrinks in a first direction opposite to the second direction (e.g., the right side of the lateral direction).
[0097] exist Figure 2C In the accompanying drawing, reference numeral 212 indicates the display area of the display 202 in a first state (e.g., slide-in state, pre-magnification state). The display area 212 in the first state may include a main area 232. The size of the display area 212 can be enlarged by sliding out in a second direction 252 (e.g., to the left).
[0098] Reference numeral 222 indicates the display area of the display 202 in a second state (e.g., a slide-out state, a magnified state). The display area 210 in the slide-out state may include a main area 232 and an alpha area 237. The alpha area 237 may be an area that is collapsed in the slide-in state and added (pushed out) when the display 202 is magnified by the slide-out operation.
[0099] Figure 2D This is a diagram illustrating examples of changes in the sliding state in an electronic device according to various embodiments.
[0100] The electronic device 100 according to an embodiment may include, for example, Figure 2D The illustrated bidirectional slidable display 204 can be a slidable multi-axis flexible display. In this case, the display 204 can have a deformable shape in two directions based on multiple axes. The electronic device 100 can have a structure that slides out and enlarges based on multiple axes in two magnification directions 254 and 256 (e.g., outward, left, and right), or slides in and shrinks based on multiple axes in two shrinkage directions (e.g., inward, right, and left).
[0101] exist Figure 2D In the figure, reference numeral 214 indicates the display area in a first state (e.g., slide-in state, before zooming in state). Reference numeral 224 indicates the display area in a second state (e.g., slide-out state, after zooming in state).
[0102] The display area 210 in the first state may include a main area 234. The size of the display area 210 can be enlarged by sliding out in two magnification directions (e.g., left and right) 254 and 256.
[0103] The display area 220 in the second state may include a main area 230 and an alpha area 239. The alpha area 239 may be an area that collapses in the slide-in state and is added (pushed out) from both directions when the screen is enlarged by a slide-out operation.
[0104] like Figure 2A , Figure 2B , Figure 2C and Figure 2D As shown, the electronic device 100 may have a flexible shape factor that allows for adjustment (e.g., scaling up / down) of the size of an area (or screen) exposed to the outside of the electronic device 100.
[0105] In shape factors that change the size of the display area, the screen size (or aspect ratio) can change before or after adjusting the size of the display area due to mechanical properties. The content display state can change with the change in screen size (or aspect ratio). Due to the change in content display state, the content being displayed may change, or may lose focus on the content provided to the user.
[0106] According to various embodiments, by adjusting the display reference of the content based on the resizing of the display area, a continuous and natural content viewing experience can be provided to the user by compensating for sudden changes in content display that may occur due to the shape factor characteristics of changing the size of the display area.
[0107] The following will refer to Figure 3A , Figure 3B , Figure 3C , Figure 4A , Figure 4B , Figure 5A , Figure 5B , Figure 6A , Figure 6B , Figure 7A , Figure 7B , Figure 8A , Figure 8B and Figure 9 The screen control of the electronic device according to various embodiments is described in more detail. For convenience, screen control of the electronic device 100, which includes a structure that zooms in / out in one direction (e.g., horizontal), is explained primarily. However, this structure is merely an example, and the scope of the embodiments is not limited to the specific structure.
[0108] Figure 3A This is a diagram showing the changes of the comparison example based on a larger screen size.
[0109] Reference numeral 310 indicates the content. Reference numeral 315 indicates the scaled content.
[0110] Reference numeral 320 indicates a first screen before magnification. The first screen 320 can be displayed in the display area before magnification. The size of the first screen 320 can correspond to the size of the display area before magnification. The first screen may include a first display portion (first content page) as part of content 310.
[0111] Reference numeral 325 illustrates a magnified second screen. The second screen 325 can be displayed within the magnified display area. The size of the second screen 325 can correspond to the size of the magnified display area. The second screen may include a second display portion (second content page) as part of the scaled content 315. The second display portion may be the portion of the scaled content 315 corresponding to the first display portion.
[0112] Before zooming in, the first screen 320 may include a first display portion (first content page) of content 310. The first display portion included in the first screen 320 may include a first object 330 (e.g., a first image) and a second object 340 (e.g., a second image).
[0113] When the screen of display 110 is enlarged, content 310 can be scaled (enlarged). Reference numeral 315 indicates scaled (enlarged) content. As the size of the display area is enlarged, the first screen 320 can be enlarged to a second screen 325, and scaled content 315 can be obtained. A second display portion (second content page) corresponding to the first display portion (first content page) can be set in the scaled content 315.
[0114] The second display portion (second content page) can be included in the second screen. The scaled content 315 can include a magnified first object 335 and a magnified second object 345. As shown, the magnified second object 345 can be included in the second screen 345 and displayed in the magnified display area. The magnified first object 335 may extend beyond the second screen 325 and may not be displayed in the magnified display area.
[0115] Therefore, if the display reference for the content is not adjusted when the size of the display area is adjusted, it may result in the loss of displayed content or unnatural changes to the content.
[0116] For example, some or all of the content elements (e.g., text, images, or videos) displayed in the original display area may disappear from the screen after zooming in. The position or content of the content elements displayed in the original display area may change, resulting in a loss of user-centric content focus.
[0117] Figure 3B and Figure 3C This is a diagram illustrating examples of screen controls according to various embodiments.
[0118] exist Figure 3BIn the diagram, reference numeral 317 indicates the content. Reference numeral 319 indicates the scaled content. Reference numeral 327 indicates the first screen before magnification. Reference numeral 329 indicates the second screen after magnification. The first screen 327 can be displayed in the display area before magnification. The second screen 329 can be displayed in the display area after magnification.
[0119] The first display portion (first content page) that is part of content 317 can be included in the first screen 327 before zooming. The second display portion (second content page) that is part of the zoomed content 319 can be included in the second screen 329 after zooming.
[0120] For example, content 317 may include one or more content pages. Each content page may be any of a webpage, a wired / wireless internet page, and an application page. A portion of content 317 may be set to a first display portion (first content page). The first display portion may be included in a first screen before zooming in (e.g., application screen, home screen, current screen, etc.) and displayed through a display area.
[0121] When the size of the display area is adjusted, the content 317 can be scaled (enlarged), and the first screen 327 is enlarged to a second screen 329. Reference numeral 319 refers to the scaled (enlarged) content. Scaled content 319 can be obtained when the size of the display area is enlarged. A second display portion (second content page) of the scaled content 319 can be set to be included in the second screen 329.
[0122] A portion of the scaled content 319 can be set to a second display portion (second content page). The second display portion can indicate the portion of the scaled content 319 that corresponds to the first display portion of the unscaled content 317.
[0123] Contents 317 and 319 can include various types of content elements. A content element can be a component of the content. For example, a content element can be at least one of text, image, video, banner, icon, JavaScript, functional object, symbol, whitespace, item, content, or widget. A content element can be a graphical element (or a user interface (UI) / user experience (UX) element or visual element). Any type of element included on the screen and that can be displayed on the display area can be a content element.
[0124] One or more content pages, including content 317 and 319, can scroll based on user input (e.g., scrolling, touching, tapping).
[0125] When the display area is enlarged, the first screen 327 can be changed and displayed as the second screen 329. The scaled content 319 can be obtained based on the enlarged size (or ratio) of the display area. For example, the entire content 317 including the first display portion of the first screen 327 can be scaled according to the enlarged size (or ratio) of the display area to obtain the scaled content 319. For example, the second display portion (second content page) included in the second screen 329 can include objects (e.g., text, images, or videos) in the first display portion (first content page) included in the first screen 327 by scaling (e.g., rearranging or resizing) according to the size (or ratio) of the changed display area.
[0126] If the size of the display area changes, and the screen size changes accordingly (e.g., enlarged or reduced), the content 317 can be scaled up or down proportionally in response to the changed display area size (or ratio). For example, if the display area is enlarged horizontally, the screen size can be enlarged horizontally, and the horizontal and vertical lengths of the scalable objects 332 and 342 in the content 317 can be adjusted in response to the enlarged size (or ratio) of the display area. Based on the enlarged size (or ratio) of the display area, the horizontal and vertical lengths of the text area can be adjusted, and the text can be sequentially filled and rearranged in the corresponding areas. When rearranging the text, the text attributes (e.g., size, color, font) can be maintained.
[0127] The portion of the scaled content 319 corresponding to the enlarged display area size can be designated as the second display portion to be included in the second screen 329 and displayed through the enlarged display area. The second display portion can be the portion of the scaled content 319 corresponding to the first display portion of the content 317 before scaling.
[0128] To specify the second display portion to be included in the second screen 329, the content display reference can be adjusted (or moved). If the content display reference is not adjusted, some content being displayed before the screen is zoomed in may extend beyond the screen or be out of focus, such as... Figure 3A As shown.
[0129] Figure 3B The content display (or movement) based on reference object 332 is shown.
[0130] Reference numeral 332 indicates a reference object for the first display portion of content 317 included in the first screen 327 before magnification. Reference object 332 can be used as a reference element for content display.
[0131] Based on the reference object 332 of the first screen 327, the second display portion of the scaled content 319 to be included in the second screen 329 can be determined.
[0132] As described above, if the display area is enlarged and the screen is enlarged accordingly, the content 317 can be scaled. For example, image or video type objects 332 and 342 in the content elements of content 317 can be scaled (proportional enlargement) according to the enlargement size (or ratio) of the display area. In text type objects, the text area can be scaled (proportional enlargement) and enlarged, and characters (e.g., letters, numbers, symbols, spaces, words, sentences) can be displayed by sequentially rearranging and filling the enlarged text area in the same format (e.g., size, style, spacing, paragraph arrangement) as in the display area before enlargement.
[0133] If the display area is enlarged, the extent of the second display portion (second content page) to be included in the second screen 329 within the content 319 can be determined based on reference object 332. The extent of the second display portion can be set based on reference object 332 in the first screen 327. Reference object 332 can be displayed at a reference position (physical reference position, e.g., the top of the display area) of the display area before enlargement. For example, the second display portion can be configured to include a first object 337 corresponding to reference object 332 and a second object 347 corresponding to object 342 in the scaled content 319. The second display portion can be included in the second screen 329 and displayed through the scaled display area.
[0134] Figure 3C This is a diagram illustrating example content displayed (or moved) based on references 370 and 375 according to various embodiments.
[0135] Reference numeral 360 shows a first screen including a first display portion (first content page) containing content 350. Reference numerals 362 and 364 show a second screen including a second display portion (second content page) containing scaled content 352 and 354.
[0136] Reference numeral 360 shows a first screen before magnification. The first screen 360 can be displayed in the display area before magnification. Reference numerals 362 and 364 show a second screen after magnification. The second screens 362 and 364 can be displayed in the display area after magnification. Reference numeral 370 shows a reference word for the first display portion of the content 350 displayed in the first screen 360 before magnification. The reference word 370 can be used as a reference element for content display.
[0137] The first screen 360, which includes the first display portion (first content page) of content 350, can be displayed through the enlarged display area.
[0138] If the display area is enlarged and the screen size changes, content 350 can be scaled to obtain scaled content 352 and 354.
[0139] If the first screen 360 before zooming is changed to the second screens 362 and 364 after zooming, the second display portion (second content page) in the scaled content 352 and 354 can be set based on the reference word 370. The reference word 370 can be included in the first screen 360 before zooming. The reference word 370 in the first screen 360 can be displayed at a reference position (e.g., zero point, starting point) in the display area. The display reference of content 352 and 354 can be adjusted based on the reference word 370. If the display reference is not adjusted, the position of the reference word 370 (sapien) in the scaled content 352 may not match the reference position of the scaled display area.
[0140] In this configuration, as shown, contents 352 and 354 can be moved to position the statement including reference word 370 at a reference position corresponding to the enlarged display area (e.g., the top row of the second screen 364). Reference elements can be reset based on the movement of contents 352 and 354. For example, contents 352 and 354 can be moved to position the statement including reference word 370 in the first screen 360 at a reference position corresponding to the enlarged display area (e.g., the top row of the second screen 364), and the statement including reference word 370 can be set as a reference row. The portion of content 354 to be included in the second screen 364 can be set based on the reference row. As another example, the first word 375 of the statement including reference word 370 can be set as a new reference word. The portion of content 354 to be included in the second screen 364 can be set based on the new reference word 375.
[0141] According to various embodiments, content display continuity and focus can be maintained by adjusting the content display reference based on resizing the display area. A continuous content viewing experience can be provided to the user before and after resizing the display area.
[0142] In various embodiments, if the display area changes (e.g., zooms in / out) to a second size when a first portion of the content is displayed in a first-size display area, the content can be moved and displayed in a second-size display area where a second portion of the content is changed to a second-size display area.
[0143] For example, content can be moved based on at least one of the following: a reference position within the content (e.g., the starting point displayed at the top of the display area before resizing), a reference object (e.g., an image or video type object displayed at the top of the display area before resizing), the first paragraph of a text type object (e.g., the first text paragraph displayed at the top of the display area before resizing), at least a portion of an image or video type object (e.g., a portion of an object displayed at the top of the display area before resizing), a reference word (e.g., the first word displayed at the top of the display area before resizing), a reference line (e.g., a sentence displayed at the top of the display area before resizing), or a combination thereof.
[0144] The processor 120 can control the display to display the first element corresponding to the reference element of the first screen as the reference position corresponding to the area that has been changed to the second size by moving the content.
[0145] The processor 120 can be configured to move content in a second direction (e.g., the other of the horizontal and vertical directions) that is perpendicular to the size of the region along a first direction (e.g., one of the horizontal and vertical directions) in which the region is enlarged or reduced.
[0146] The processor 120 can determine the offset as the degree of content movement based on any of the type of elements (e.g., reference elements) in the first screen, the position of the elements, and user settings related to the screen display.
[0147] If the elements in the first screen are rearranged or their size is adjusted, and the first element is not included in the second screen, the processor 120 can determine an offset for including the first element in the second screen. The processor 120 can then move and display content based on this offset.
[0148] The processor 120 can also move and display content along the size of the region in a first direction (e.g., the horizontal direction) in which it is magnified or reduced. The content can be moved based on at least one of the region's margins, the region's magnification direction, the region's magnification speed, the region's reduction direction, and the region's reduction speed.
[0149] Figure 4A and Figure 4B This is a flowchart illustrating example screen control methods according to various embodiments.
[0150] refer to Figure 4A The screen control method according to various embodiments may include operations 410 and 420. For convenience, it is assumed that each operation is performed by the processor 120 of FIG1.
[0151] In operation 410, when the display area exposed to the outside of the electronic device 100 is of a first size and the first screen is displayed in the display area, the processor 120 may receive input for changing the display area to a second size.
[0152] In operation 420, when the display area is changed to a second size according to the input, the processor 120 can display a second screen in the area that has been changed to the second size, which corresponds to the second size of the first screen.
[0153] Among the multiple elements in the content, the second screen may include a first element corresponding to an element in the first screen and a second element in the content.
[0154] The second element can be different from the element in the first screen, and may not be displayed in the area when the area is the first size.
[0155] If an element in the first screen is text, the text corresponding to that element can be rearranged and included in the second screen.
[0156] If an element in the first screen is an image or video, at least a portion of the image or video corresponding to that element can be resized and included in the second screen.
[0157] Elements in the first screen can be displayed at the top of the area with the first size. The first element in the second screen can be displayed at the top of the area that has been resized to the second size. The second element in the second screen can be displayed at the bottom of the area that has been resized to the second size.
[0158] The display portion of the content, including the first and second elements, can be determined based on any of the element type in the first screen, the element's position, and user settings related to screen display.
[0159] Elements on the first screen can be displayed as reference positions corresponding to areas. The first element on the second screen can be displayed as a reference position corresponding to an area that has been resized to the second size.
[0160] The processor 120 can display the first element by moving the content in response to a change in the reference position of the area to the second size.
[0161] The processor 120 can move and display content in a second direction (e.g., vertical direction) perpendicular to the size of the area, along a first direction (e.g., the horizontal direction) in which the area is enlarged or reduced.
[0162] The processor 120 can determine the offset as the degree of content movement based on any of the type of elements in the first screen, the position of the elements, and user settings related to the screen display. If the first element in the first screen is rearranged or its size is adjusted and is not included in the second screen, the processor 120 can determine the offset for including the first element in the second screen and move the content based on that offset.
[0163] If a portion of the content that is part of the first content page is displayed in the area, the processor 120 can obtain a second content page corresponding to the first content page. The processor 120 can move and display content based on a comparison between the area of the top hidden portion of the first content page and the area of the top hidden portion of the second content page.
[0164] The processor 120 can move and display content to keep the area of the top hidden portion of the first content page and the area of the top hidden portion of the second content page substantially the same.
[0165] Processor 120 may include a first display portion as part of a first content page in a first screen and display it in that area. Processor 120 may identify elements in the first screen that are displayed in response to a reference position of the area in the first display portion. When the area changes from a first size to a second size, processor 120 may obtain a second content page corresponding to the second size based on the first content page. Processor 120 may identify a first element in the second content page corresponding to an element in the first screen and determine a second display portion in the second content page based on the first element and the second size. Processor 120 may include the second display portion in the second screen and display it in the area that has changed to the second size.
[0166] The processor 120 can also move and display content in the first direction. The processor 120 can move and display content based on at least one of the region's margin, the region's zoom direction, the region's zoom speed, the region's zoom direction, and the region's zoom speed.
[0167] refer to Figure 4B Example screen control methods according to various embodiments may include operations 450, 455, 460, 465, 470, and 475. For convenience, it is assumed that each operation is performed by the electronic device 101 of FIG1.
[0168] In operation 450, the electronic device 100 may include a first display portion as part of a first content page in the first screen and display it in the display area. The first content page can be understood as a page that includes a portion of content (e.g., a webpage, a wired / wireless internet page, an application page).
[0169] In operation 455, the electronic device 100 can identify an element in the first screen corresponding to a reference position of the first display portion of the display area. For example, this element could be a reference element used to set the content display portion.
[0170] In operation 460, when the display area changes from a first size to a second size, the electronic device 100 can obtain a second content page corresponding to the second size based on the first content page. The second content page can scale the first content page to correspond to the second size.
[0171] In operation 465, electronic device 100 can identify from the second content page a first element corresponding to an element in the first screen.
[0172] In operation 470, electronic device 100 can determine a second display portion in a second content page based on a first element and a second size.
[0173] In operation 475, electronic device 100 may include a second display portion in the second screen and display it in an area that has been changed to a second size.
[0174] Figure 5A and Figure 5B This is a diagram illustrating example screen controls according to various embodiments, and an example scheme for adjusting the content display reference before / after zooming in.
[0175] exist Figure 5A The image shows a first content page 510 containing content. Reference numerals 512 and 514 indicate a second content page containing scaled content. Content pages 510, 512, and 514 may include multiple objects (e.g., text, images, videos).
[0176] Second content pages 512 and 514 may correspond to first content page 510. Second content pages 512 and 514 may process (e.g., scale) the first content page 510 according to the changed size (or ratio) of the display area. Objects in the first content page 510 may be scaled (e.g., rearranged or resized) and included in the second pages 512 and 514.
[0177] Some display portions 530, 532, and 534 of each content page 510, 512, and 514 can be included in each page 520, 522, and 524 and displayed through display areas.
[0178] If the display area changes from a first size (e.g., enlarged or reduced) to a second size, the content page 510 can be scaled. For example, if the content is scaled, the text in the content page 510 can be rearranged according to the size of the scaled text area, or the images or videos in the content page 510 can be resized according to the scaling rate.
[0179] Reference numeral 520 indicates the first screen before magnification. The first screen 520 can be displayed in the display area before magnification. Reference numeral 522 indicates the screen during magnification. The second screen 524 can be displayed in the display area after magnification. The content display reference can be adjusted and displayed in the magnified second screen 524.
[0180] The first content page 510 may include a first display portion 530, a top hidden portion 540, and a bottom hidden portion 550. The first screen 520 before zooming may display the first display portion 530, which is part of the first content page 510 (e.g., the middle portion). For example, if a user scrolls the first content page 510, the content of a certain display portion 530 of the first content page 510 may be displayed in the first screen 520 before zooming, depending on the scroll position. The top hidden portion 540 may be located above the display portion 530, while the bottom hidden portion 550 may be located below the display portion 530.
[0181] If the screen is unfolded before the first screen 520 is enlarged on the display monitor 110, the scroll position may change. In this case, it may be inconvenient to reposition the scroll position viewed by the user.
[0182] The embodiment can maintain the scroll position by adjusting the size of the display area by adjusting the content display reference, regardless of screen switching.
[0183] A second screen 524, including a second display portion 534 which is part of a second content page 514, can be displayed in the enlarged display area.
[0184] As shown in the first screen 520 before magnification, the screen 522 during magnification, and the second screen 524 after magnification, if the screen of the display 110 is magnified horizontally, the content element at the top of the display portion 530 in the first screen 520 before magnification can move upward (e.g., in the Y-axis direction) as the horizontal length of the screen changes, and the content can fall from the display portion 530 or separate from the top hidden portion 540 above the display portion 530.
[0185] The top hidden portion 540 may be a portion that includes the topmost point of the first content page 510 (e.g., zero point, Y-axis zero point, point specifying the topmost pixel row). The displayed portion 530 may be a portion that includes the midpoint of the first page 510. The display reference (e.g., Y-axis reference point) specifying the displayed portion 530 may correspond to the midpoint of the first content page 510.
[0186] Referring to the first screen 520 before zooming in, if the first screen 520 before zooming in includes the first display portion 530 of the first content page 510, then the first screen 520 before zooming in may not include (not display) the topmost point of the first content page 510, and may include (display) the middle point of the first content page 510. In this case, if the first screen 520 before zooming in is zoomed in or zoomed out, a change in the width of the content (e.g., text, images, etc.) can occur and be displayed on the first screen 520 before zooming in. Therefore, the extent of the content included in the top hidden portion 540 can change.
[0187] Referring to the enlarged screen 512, if the display area is enlarged horizontally, the horizontal length of the screen changes (the screen is enlarged from 520 to 522), and at least a portion of the displayed content can be scrolled up to the top hidden portion 540 and displayed.
[0188] The electronic device 100 can continuously maintain the area of the top hidden portions 540, 542, and 544 above the display portions 530, 532, and 534, and thus maintain the range of the content displayed on the screens 530, 532, and 534 by appropriately adjusting the display reference (e.g., the vertical axis reference point) used to set the display portion in the content.
[0189] In this way, by continuously maintaining the area of the top hidden portions 540, 542, and 544, the range of content included in the display portions 530, 532, and 534 can be stably maintained, regardless of the adjustment size of the display area or the adjustment size of the screen. The area of the top hidden portion 540 before magnification can be continuously maintained in both the magnification-in-progress and magnification-complete states.
[0190] For example, if the top hidden portion 540 consists only of text, the position of the content display reference (e.g., the starting point of the content) can be maintained by making the areas of the top hidden portions 540, 542, and 544 the same.
[0191] In text, even if the screen is enlarged, the amount of text included in the same area can remain constant.
[0192] Therefore, if the display reference remains at the same height before / after the screen is zoomed in, and the display reference is not adjusted, the content seen by the user may be different before / after the screen is zoomed in, or the content may lose focus.
[0193] Figure 522 shows an enlarged middle screen without adjusting the display reference.
[0194] According to the embodiments, by adjusting the content display reference before / after zooming in, the continuity of the content and user-centric content focus can be maintained.
[0195] Figure 524 shows the second screen after magnification, with the display reference adjusted.
[0196] like Figure 5A As shown, if the first display portion 530 displayed in the first screen 520 before magnification is the middle portion of the first content page 510, then the display portion 532 included in the magnified screen 522 and the second display portion 534 included in the magnified second screen 524 can be the middle portion of the second content pages 512 and 514 magnified from the first content page 510.
[0197] The electronic device according to the embodiment (e.g., the electronic device 100 of FIG1) can adjust the display reference based on a comparison between the area of the top hidden portion 540 of the first content page 510 and the area of the top hidden portions 542 and 544 of the first content pages 512 and 514 after being resized (e.g., enlarged or reduced) to improve the problem of content display without adjusting the display reference.
[0198] refer to Figure 5A The adjustment scheme for the content display reference using the area of the top hidden portion is explained in further detail below.
[0199] According to the embodiment, the electronic device can adjust the display reference to keep the area of the top hidden portion 540 of the first content page 510 the same as the area of the top hidden portion 544 of the second content page 514 obtained after resizing the first content page 510.
[0200] For example, in the screen magnification of an electronic device, the electronic device can adjust the content display reference to keep the area of the top hidden portion 540 before magnification substantially the same as the area of the magnified top hidden portion 544.
[0201] If the areas of the two top hidden portions 540 and 544 remain the same, the range of the content included in the top hidden portion 540 before magnification and the range of the content included in the top hidden portion 544 after magnification can remain unchanged.
[0202] For example, if the content included in the top hidden portion 540 before zooming is text, the display reference can be adjusted before / after screen zooming to maintain the same area of the two top hidden portions 540 and 544, thereby continuously maintaining the range of content included in the two top hidden portions 540 and 544.
[0203] The electronic device 100 can adjust the display reference (e.g., vertical axis reference point) of the magnified display portion 534 to maintain the areas of the two top hidden portions 540 and 544 being substantially the same. By adjusting the content display reference, the display reference (e.g., starting point) of the display portion 534 after the magnified top hidden portion 544 can be controlled to be positioned at the reference position (e.g., vertical axis reference point) of the display area.
[0204] Without adjusting the content display reference, the display positions or states of the first object 570 in the first screen 520 before zooming and the first object 572 in the first screen 522 during zooming may not correspond to each other as shown in the figure. By adjusting the content display reference, the display positions or states of the first object 570 in the first screen 520 before zooming and the first object 574 in the first screen 524 after zooming can correspond to each other as shown in the figure.
[0205] For example, if the top of the first display portion 530 before zooming includes the first object 570 in the content (e.g., an image as a scalable object), then the first object 574 after zooming can be displayed on top of the second display portion 534 after zooming.
[0206] Therefore, the continuity of the content included in the two display portions 530 and 534 before / after screen magnification can be maintained, as well as user-centric content focus.
[0207] In various embodiments, the content display reference can be a reference point (e.g., a vertical axis reference point). For example, the vertical axis reference point can be referred to as any of the following: the Y-axis zero point, the Y-axis reference point, the longitudinal reference point, the scroll reference point, and the Y-axis coordinate value.
[0208] In various embodiments, the content display reference can be any one of a reference word, reference line, reference object, or a portion of a reference object displayed at a reference location in the display area (e.g., at the top of the display area).
[0209] As described above, if the size of the display area is adjusted, the content display reference before / after zooming in can be adjusted based on the area of the top hidden portion before the displayed portion during the display of the midpoint of the content.
[0210] If the horizontal length of the display portion 530 displayed on the screen 520 before magnification is X, and the vertical length is Y, then the horizontal length of the real-time magnified display portion 532 can be defined as X1, X2, X3, ..., Xn, and the vertical length can be defined as Y1, Y2, Y3, ..., Yn. The horizontal length of the display portion 534 after magnification can be defined as X′, and the vertical length can be defined as Y′.
[0211] The area of the top hidden part 540 before magnification can be represented as X*Y, the area of the top hidden part 542 during magnification can be represented as X1*Y1, X2*Y2, X3*Y3, ..., Xn*Yn, and the area of the top hidden part 544 after magnification can be represented as X′*Y′.
[0212] The electronic device can maintain the area of the enlarged top hidden portions 542 and 544 being the same as the area of the original top hidden portion 540 by adjusting the content display reference based on X and Y (e.g., a vertical axis reference point).
[0213] When the screen is zoomed in, the following equation 1 can be established for the changes in the area of the top hidden portions 540, 542, and 544.
[0214] Equation 1
[0215] X*Y=X1*Y1=X2*Y2=X3*Y3=……=Xn*Yn=X′*Y′
[0216] For example, if the value of the vertical axis reference point (e.g., height) is 0 before zooming in, the electronic device can control the value of the vertical axis reference point to be no lower than 0 during screen zooming. The electronic device can change the value of the vertical axis reference point in response to the degree of screen zoom (or zoom distance), so that the user does not miss the content context before / after screen zooming.
[0217] Furthermore, even when the screen is scaled down, an adjustment scheme that takes into account the area of the hidden top portion can be used to adjust the display reference in real time.
[0218] If the screen shrinks from its enlarged state back to its original state, the content context can be maintained by applying the values of the vertical axis reference points in reverse, based on the same scheme. For example, during the shrinking of the display area, the screen can be displayed in the order of 524, 522, and 520. In this case, the area of the top hidden portion 544 before shrinking can be represented as X′*Y′, the area of the shrinking top hidden portion 542 can be represented as Xn*Yn, ..., X3*Y3, X2*Y2, X1*Y1, and the area of the top hidden portion 540 after shrinking can be represented as X*Y.
[0219] The electronic device can maintain the area of the reduced top hidden portion 540 the same as the area of the original top hidden portion 544 by adjusting the vertical axis reference point based on X′ and Y′.
[0220] In screen scaling, the following equation 2 can be established for the changes in the area of the top hidden portions 544, 542, and 540.
[0221] Equation 2
[0222] X′*Y′=Xn*Yn=……=X3*Y3=X2*Y2=X1*Y1=X*Y
[0223] Figure 5B This is a diagram illustrating example screen controls according to various embodiments, used to explain adjustments to the content display reference before / after zooming in relation to content including scalable objects.
[0224] Reference numeral 526 shows the first screen before magnification. Reference numeral 528 shows the screen during magnification without adjusting the reference. Reference numeral 529 shows the second screen after magnification with the display reference adjusted.
[0225] Before zooming in, the first screen 526 can display a display portion 536, which is part of the first content page 516. The first content page 516 may include the display portion 536, a top hidden portion 546, and a bottom hidden portion 556.
[0226] In screen magnification (or display area magnification), the first content page 516 can scale according to the magnified screen size (or ratio). The magnified content page 518 may include a top hidden portion 548, a display portion 538, and a bottom hidden portion 558. The magnified screen 528 may display the display portion 538, which is part of the magnified content page 518.
[0227] The top hidden portion 546, located above the display portion 536 on the first screen 526 before magnification, may include scalable objects (e.g., images, videos, symbols, etc.). Figure 5B Image 576 is shown as a scalable object. The display portion 536 located below image 576 can display text.
[0228] As shown in the figure, if the screen zooms out horizontally in response to an increase in the display area, the text can be rearranged and displayed according to the size of the zoomed-out screen. For example, during screen zooming, only the amount of text included in the corresponding area can be increased, without changing the text size.
[0229] Unlike text, in landscape zooming, scalable objects such as images or videos need to be enlarged according to the zoomed-in screen ratio. Scalable objects can scale based on screen resizing. For example, if the screen is zoomed in, scalable objects such as images can be scaled proportionally to the changed screen ratio.
[0230] If the first screen 526 before magnification is horizontally magnified, its horizontal length can be increased, and scalable objects can be scaled proportionally according to the magnification ratio, thereby changing the object's size. In this case, content that is scaled proportionally to the screen size in some areas can be separated into other areas. For example, as shown in the magnified screen 528, the image 578 can be scaled proportionally based on the magnification ratio, and when the display portion 538 is magnified, a portion of the text included in the display portion 536 before magnification can be separated and pushed upwards to the top hidden portion 548.
[0231] According to an embodiment, the content display reference (e.g., vertical axis reference point) in the screen resizing can be adjusted to prevent and / or reduce the separation of some content in the display portion into the hidden portion.
[0232] refer to Figure 5B The following is a more detailed description of the content display adjustment scheme used to prevent and / or reduce content separation.
[0233] For example, in screen magnification, if the top hidden portion 546 before magnification includes image 576, the electronic device 100 can calculate the vertical axis increment of the magnified image 578, vertically adjust (or move) the reference point used as a display reference, thereby excluding the calculated vertical axis increment from the top hidden portion 548. In this way, the vertical axis increment of image 578 scaled at the same ratio as the screen magnification ratio can be adjusted.
[0234] If the horizontal length of the region corresponding to the image 576 included in the top hidden portion 546 is defined as Px and the vertical length is defined as Py, the vertical axis reference point, which serves as a display reference, can be adjusted to exclude the vertical magnified portion Py*(Xn / X-1) of the image 576 from the screen, which is the top hidden portion 546.
[0235] In this case, Equation 3 can be true.
[0236] Equation 3
[0237] Before magnification, the Y-axis reference point = Y
[0238] The reference point for the Y-axis during magnification is calculated as: Yn - Py*(Xn / X-1).
[0239] The magnified Y-axis reference point = Y' - Py*(X'n / X-1)
[0240] Reference numeral 529 illustrates an enlarged second screen with an adjusted display reference in the content. The enlarged second content page 519 may include a top hidden portion 549, a display portion 539, and a bottom hidden portion 559. The vertical axis increment of the first image 579 in the top hidden portion 549 can be excluded from the top hidden portion 549. When the vertical axis increment of the image 579 in the top hidden portion 549, located above the display portion 539 in the enlarged state of the second content page 519, is compensated, the vertical axis reference point used as a display reference can be adjusted vertically. Therefore, the display portion 539, corresponding to the display portion 536 before enlargement, can be displayed on the enlarged second screen 529.
[0241] Some electronic devices (e.g., smartphones) may have a fixed area, such as a status bar or indicator, that is always visible regardless of content movement or screen magnification, depending on the device's characteristics. In such cases, if the area of the top hidden portion or the vertical axis increment is calculated, a scheme for stabilizing the exclusion of the corresponding area can be used to adjust the vertical axis reference point used as a display reference.
[0242] Figure 6A This is a flowchart illustrating example screen control methods according to various embodiments. Figure 6B This is a diagram illustrating example screens for explaining screen controls according to various embodiments.
[0243] refer to Figure 6A The screen control method according to the embodiment may include operation 610 and operation 620. For convenience, it is assumed that each operation is performed by the electronic device 101 of FIG1.
[0244] In operation 610, when the display area is of a first size and the first screen is displayed in the display area, the processor 120 can receive input for changing the display area to a second size.
[0245] In operation 620, when the area is changed to a second size according to the input, the processor 120 can display a second screen in the area that has been changed to the second size, which is a second screen corresponding to the second size.
[0246] Among the multiple elements in the content, the second screen may include a first element corresponding to an element in the first screen and a second element in the content.
[0247] The second element can be different from the element in the first screen, and if the area is the first size, it can be left out of the display area.
[0248] If an element in the first screen is text, the corresponding text can be rearranged and included in the second screen. If an element in the first screen is an image or video, at least a portion of the corresponding image or video can be resized and included in the second screen.
[0249] Elements in the first screen can be displayed at the top of the area with the first size. The first element in the second screen can be displayed at the top of the area that has been resized to the second size. The second element in the second screen can be displayed at the bottom of the area that has been resized to the second size.
[0250] The display portion of the content, including the first and second elements, can be determined based on any of the element type in the first screen, the element's position, and user settings related to screen display.
[0251] Elements on the first screen can be displayed at reference positions corresponding to a region. The first element on the second screen can be displayed in response to a change in reference position to a region of a second size.
[0252] In one embodiment, the processor 120 can display the first element by moving the content in response to a change in the reference position of the area to the second size.
[0253] The processor 120 can move and display content in a second direction perpendicular to the size of the area along the first direction in which it is magnified or reduced.
[0254] The offset as the degree of content movement can be determined based on any of the type of element in the first screen, the position of the element, and user settings related to screen display.
[0255] If the first element, which has been rearranged or resized in the first screen, is not included in the second screen, the processor 120 can determine an offset for including the first element in the second screen and move the content based on that offset.
[0256] If a portion of the content that is part of the first content page is displayed in the area, the processor 120 can obtain a second content page corresponding to the first content page. The processor 120 can move and display content based on a comparison between the area of the top hidden portion of the first content page and the area of the top hidden portion of the second content page.
[0257] The processor 120 can move and display content to keep the area of the top hidden portion of the first content page and the area of the top hidden portion of the second content page substantially the same.
[0258] The processor 120 can also move and display content in the first direction. The processor 120 can move and display content based on at least one of the region's margin, the region's zoom direction, the region's zoom speed, the region's zoom direction, and the region's zoom speed.
[0259] Figure 6B This is a diagram illustrating example adjustments to the content display reference according to various embodiments.
[0260] The first screen 630 can be displayed in the display area before the first size is enlarged. The second screen (one of 632, 634, and 636) can be displayed in the display area enlarged to the second size.
[0261] When the display area (e.g., the display area before zooming in) is a first size, a first screen 630, including a portion of the reference object 640, can be displayed in that display area. For example, the first screen 630 may include a portion of the first reference object 640 and a second reference object 650. Figure 6B In the image, the first reference object is shown as an image that is scalable, while the second reference object 650 is shown as text.
[0262] When a first screen 630, which includes a portion of a first reference object 640, is displayed in the display area, the processor 120 can receive input for scaling the size of the display area to a second size.
[0263] If the area is enlarged to a second size based on the input, the processor 120 can display a second screen (one of 632, 634, and 636) enlarged to correspond to the second size in the display area enlarged to the second size. The second screen (one of 632, 634, and 636) may include at least a portion of a first object 644 (e.g., one of 644a, 644b, and 646) corresponding to a first reference object 640 of the first screen 630 and / or a second object (one of 672 and 676).
[0264] The second object (e.g., 672 or 676) of the second screen (e.g., 632 or 636) is different from the reference object (e.g., 640 or 650) of the first screen 630, and may not be displayed in the display area when the display area is the first size.
[0265] For example, a second screen, such as reference numeral 632, can be displayed in a display area enlarged to a second size. The first reference object 640 may not be included in the second screen 632, and a second reference object 650 below the first reference object may be enlarged and included in the second screen 632. An object 652 that rearranges the text in the second reference object 650 may be displayed at the top of the display area enlarged to a second size. A second object 672 not included in the first screen 630 may be included at the bottom of the second screen 632.
[0266] For example, a second screen, such as reference numeral 634, can be displayed in a display area enlarged to a second size. The substantial entirety of the first reference object can be enlarged according to the second size and displayed at the top of the display area enlarged to the second size. A first object 644, enlarged to the second size, can be included at the top of the second screen 634 and displayed at the top of the display area enlarged to the second size. The first object 644 can include a first portion 644a and a second portion 644b. The first portion 644a can correspond to other portions of the first reference object not included in the first screen 630.
[0267] The object 654, which corresponds to the second reference object 650 in the first screen 630, can be located below the first object 644 in the second screen 634.
[0268] For example, a second screen, such as reference numeral 636, can be displayed in a display area magnified to a second size. A portion of the first reference object 640 can be enlarged according to the second size and displayed at the top of the area magnified to the second size, and a second reference object 650 below the first reference object can be enlarged and included in the second screen 636. An object 656 that rearranges the text in the second reference object 650 can be displayed at the top of the display area magnified to the second size. A second object 676 not included in the first screen 630 can be included at the bottom of the second screen 636.
[0269] The processor 120 may determine, based on the type of the reference object (e.g., 640) in the first screen 630, the position of the reference object (e.g., 640, 650) in the first screen 630, and any of the user settings related to the screen display, that at least a portion of the first object (e.g., one of 652, 644, and 646) and the second object (e.g., one of 672 and 676) will be included in the second screen (one of 632, 634, and 636).
[0270] The processor 120 can adjust the content display reference based on a reference object (e.g., 640) displayed on top of the first screen 630 in the content.
[0271] Without adjusting the content display reference, the first screen 630 before zooming in and the second screen (one of 632, 634, and 636) after zooming in may lose the continuity of content display and user-centric content focus.
[0272] Content display references can be moved based on the type or location of a reference object (e.g., 640) within the content. For example, a reference object can be text or a scalable object (e.g., an image, video, banner ad, icon, symbol, etc.).
[0273] For example, processor 120 can move the content display reference upward by a first offset and display the content display reference so that the first reference object 640 is not actually displayed in the magnified second screen 632, and the second reference object 650 located below the first reference object 640 is displayed at the top of the magnified second screen 632. If the content display reference is adjusted to display the text serving as the second reference object 650 (which is arranged below the image serving as the first reference object 640 in the first screen 630) at the top of the second screen 632, the first offset can be adjusted to maintain the degree of movement of the text serving as the second reference object 650 in the first screen 630 and the second screen 632 before / after magnification within a certain range, thereby maintaining content continuity or content focus.
[0274] For example, the processor 120 can move down and display a content display reference to enlarge and display substantially the entirety of the image serving as the first reference object 640 in a magnified second screen 634, depending on the screen size.
[0275] For example, in order to enlarge and display a portion of the image serving as the first reference object 640 in the enlarged second screen 636 according to the screen size, the processor 120 can move the content display reference upward by a second offset and display the content display reference. The second offset can have a smaller value than the first offset.
[0276] Although the first reference object 640 is scaled according to the magnified screen size (or ratio), if the content display reference is not adjusted (e.g., if the second offset is not moved up, or if the scaled first object is displayed as is without adjusting the display reference), the position or display state of the object displayed at the top of the two screens before / after magnification may not correspond to each other.
[0277] The processor 120 can display the first object 646 arranged on top of the enlarged second screen 636 as a first reference object 640 arranged on top of the first screen 630 before enlargement by moving the second offset and displaying the content display reference.
[0278] Content display references can be moved based on user settings related to screen display. For example, a user can set a screen magnification mode. The screen magnification mode can be any of the following: text-priority mode, scalable object (e.g., image)-priority mode, and display reference hold mode.
[0279] For example, if a text-first mode is set, the content display reference can be adjusted to display text first during screen magnification (e.g., displaying a text-type object 652 in a magnified second screen 632).
[0280] If a scalable object (e.g., image) priority mode is set, the content display reference can be adjusted to display scalable objects first during screen magnification (e.g., displaying image-type object 644 in a magnified second screen 634).
[0281] If the display reference hold mode is set, the content display reference can be adjusted in response to the object at the top (e.g., the top row) of the first screen 630 before the screen is zoomed in, displaying the scaled object (e.g., displaying an image as the first object 646 in the zoomed-in second screen 632).
[0282] Figure 7A and Figure 7B This is a diagram illustrating example screen controls according to various embodiments, showing a reference for adjusting the content display in landscape mode before / after zooming in.
[0283] Figure 7A This shows the screen before / after zooming in if the content display reference (e.g., zero point) is not updated. Figure 7B This is a diagram showing the screen before / after zooming in if the content display reference (e.g., zero point) is updated.
[0284] like Figure 7A As shown, when screen 710 zooms in to the right, the shape factor of the new area that is pushed out from the left may need to update the display reference points 720, 722, and 721 (e.g., zero point) of the content displayed on screens 712 and 714 that are being zoomed in by the expanded and zoomed-in areas.
[0285] Figure 7BThis illustrates how display reference points 740, 742, and 744 are updated based on the magnification of screens 730, 732, and 734 as the screen is gradually magnified. The screen magnification (or magnification distance) can be measured when updating display reference points 740, 742, and 744, thereby moving the display reference points by the corresponding area.
[0286] In such cases, it may be difficult to accurately measure the screen magnification in real time. Measurements may contain errors, and delays may occur when processing screen updates based on those measurements. Due to measurement errors or processing delays, the moved display reference point may not precisely match the screen magnification, resulting in gaps. Users may perceive screen vibration or jitter as the physical display reference point changes during screen magnification. In non-electrically driven solutions (e.g., manual solutions implemented with springs, or semi-automatic magnification drivers), the perceived screen vibration or jitter may be even more pronounced.
[0287] According to various embodiments, screen vibration / jitter caused by adjusting the size of the display area or its corresponding screen size can be compensated by horizontally adjusting the content display reference point, thereby achieving a stable screen.
[0288] Figure 8A and Figure 8B This is a flowchart illustrating example screen control methods according to various embodiments. Figure 9 This is a diagram illustrating example screen controls according to various embodiments.
[0289] Figure 8A , Figure 8B and Figure 9 The embodiments involve schemes for adjusting the horizontal axis reference point.
[0290] The embodiment can reduce vibration / jitter by providing a graphic effect in the same direction as the magnification direction during screen magnification, or make the vibration / jitter undetectable to the user.
[0291] For example, a graphic effect could be a scheme that moves the horizontal axis reference point and the entire content displayed on the screen in the same direction as the zoom-in direction at a speed faster than the zoom-in speed, and restores the horizontal axis reference point immediately after (or before) the zoom-in is complete. The horizontal axis reference point can be referred to as any of the following: the X-axis zero point, the X-axis reference point, or the lateral reference point.
[0292] Immediately before / after magnification completion can indicate a specific time (e.g., 1 second) from the magnification completion time. Vibration / jitter before / after magnification can be adjusted via graphic effects.
[0293] Corrections to the horizontal axis reference point (e.g., horizontal axis zero) and the vertical axis reference point (e.g., vertical axis zero) can be applied together. For example, screen vibration or jitter caused by the adjustment of the display reference point can be compensated by adjusting the content display reference point (e.g., vertical axis zero) according to the screen magnification orientation and providing graphic effects in the same direction as the magnification direction of the display 110.
[0294] First refer to Figure 9 Assume that the length of the X-axis region (alpha region) rolled up on the back of the electronic device 100 and not exposed in the sliding display 200 is Hidden, the length of the basic X-axis margin before magnification is B, and the time-based magnification (magnification length) is Expanded. In this case, the reference point before magnification (e.g., zero point, X-axis zero point, horizontal axis reference point) can be defined as "Hidden + B".
[0295] At the start of screen magnification or during screen magnification 910, 912 and 914, the electronic device 100 can change the X-axis zero points 920, 922 and 924 in real time in the following manner.
[0296] First, at the start of screen zoom or during screen zooms 910 and 912, the X-axis zeros 920 and 922 can be moved sequentially by N pixels (or dpi) from 0 along the zoom direction (horizontally). This movement can be performed faster than the screen zoom speed.
[0297] Second, the maximum extra margin can be set to "B + Expanded + N pixels (or dpi)", and the starting reference X-axis zero point can be set to "Hidden + B - Expanded + N (0 ~ N)".
[0298] Third, reference point 924 can be moved and restored to the base margin B to remove the extra margin immediately after the screen zoom-in is complete (within a specific time period from the zoom-in completion time). "Hidden-Expanded = 0 + B" can be established relative to the starting reference X-axis zero.
[0299] At the start of magnification or during magnification, it can be done through Figure 8A The scheme shown changes the display reference point in real time.
[0300] refer to Figure 8A In operation 810, the electronic device 100 can set the X-axis zero point, which serves as the display reference point before magnification, to "Hidden+B".
[0301] In operation 812, the electronic device 100 can detect the occurrence of a display magnification event based on user input (e.g., slide-out input, open input).
[0302] In operation 814, screen magnification of display 110 can be started or continued. The X-axis zero point can be set to "Hidden+B-Expanded+N".
[0303] In operation 816, electronic device 100 can set the N value to "B * display magnification". When the screen is magnified, the display magnification can increase, and the N value can also increase.
[0304] In operation 820, electronic device 100 can determine whether the magnification of display 110 is complete. For example, if the magnification distance of display 110 reaches a pre-specified maximum magnification distance, or if no input for magnifying display 110 is received within a specific time, electronic device 100 can determine that the magnification of display 110 is complete.
[0305] If the magnification of the display 110 is not completed, the electronic device 100 can update the X-axis zero point by repeating operation 814 and operation 816 based on the screen magnification.
[0306] If the magnification of the display 110 is complete, then in operation 822, the electronic device 100 can sequentially and rapidly reduce the N value to 0. Therefore, the X-axis zero point can return to the basic margin B immediately after the screen magnification is complete.
[0307] At the start of zooming out or during zooming out, the reference point may be displayed as... Figure 8B The method shown changes in real time. (And) Figure 8A A similar approach can be applied in reverse when the screen is scaled down. In this case, the value of N can be controlled to not exceed the maximum basic margin B.
[0308] refer to Figure 8B In operation 850, the electronic device 100 can set the X-axis zero point, which serves as the display reference point before magnification, to "Hidden+B".
[0309] In operation 852, electronic device 100 can detect the occurrence of a display zoom-out event based on user input (e.g., slide-in input, zoom-out input).
[0310] In operation 854, the screen shrinking of display 110 can be started or continued. The X-axis zero point can be set to "Hidden+B-Expanded-N".
[0311] In operation 856, electronic device 100 can set the N value to "B * display scaling factor". When the screen is scaled down, the display scaling factor can increase, and the N value can decrease.
[0312] In operation 860, the electronic device 100 can determine whether the reduction of the display 110 is complete. For example, if the reduction distance of the display 110 reaches a pre-specified maximum reduction distance, or if no input for reducing the display 110 is received within a certain time, the electronic device 100 can determine that the reduction of the display 110 is complete.
[0313] If the reduction of the display 110 is not completed, the electronic device 100 can update the X-axis zero point by repeating operation 854 and operation 856 according to the screen reduction.
[0314] If the reduction of the display 110 is complete, in operation 862, the electronic device 100 can sequentially and rapidly increase the N value to 0. Therefore, the X-axis zero point can return to the basic margin B immediately after the screen reduction is complete.
[0315] The screen control methods according to various embodiments can be performed by an electronic device (e.g., electronic device 100 or processor 120). For illustrative purposes, it is assumed that each operation is performed by processor 120 or electronic device 100 of FIG. 1. Electronic device 100 or processor 120 can be configured to perform at least a portion of the operations of the screen control methods according to the embodiments. At least one of the operations according to the various embodiments may be omitted, the order of some operations may be changed, or other operations may be added.
[0316] Figure 10 This is a block diagram illustrating an electronic device 1001 in a network environment 1000 according to various embodiments. Reference Figure 10In network environment 1000, electronic device 1001 can communicate with electronic device 1002 via a first network 1098 (e.g., a short-range wireless communication network), or with at least one of electronic device 1004 or server 1008 via a second network 1099 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 1001 can communicate with electronic device 1004 via server 1008. According to an embodiment, electronic device 1001 may include a processor 1020, a memory 1030, an input module 1050, a sound output module 1055, a display module 1060, an audio module 1070, a sensor module 1076, an interface 1077, a connection terminal 1078, a haptic module 1079, a camera module 1080, a power management module 1088, a battery 1089, a communication module 1090, a Subscriber Identity Module (SIM) 1096, or an antenna module 1097. In some embodiments, at least one of the aforementioned components (e.g., connection terminal 1078) may be omitted from electronic device 1001, or one or more other components may be added to electronic device 1001. In some embodiments, some of the aforementioned components (e.g., sensor module 1076, camera module 1080, or antenna module 1097) may be implemented as a single integrated component (e.g., display module 1060).
[0317] Processor 1020 may run software (e.g., program 1040) to control at least one other component (e.g., hardware or software component) of electronic device 1001 connected to processor 1020, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, processor 1020 may store commands or data received from another component (e.g., sensor module 1076 or communication module 1090) in volatile memory 1032, process the commands or data stored in volatile memory 1032, and store the result data in non-volatile memory 1034. According to embodiments, processor 1020 may include a main processor 1021 (e.g., central processing unit (CPU) or application processor (AP)) or an auxiliary processor 1023 (e.g., graphics processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), sensor central processor, or communication processor (CP)) that is operationally independent of or combined with the main processor 1021. For example, when electronic device 1001 includes a main processor 1021 and an auxiliary processor 1023, the auxiliary processor 1023 can be adapted to consume less power than the main processor 1021 or to be dedicated to a specific function. The auxiliary processor 1023 can be implemented separately from the main processor 1021 or as part of the main processor 1021.
[0318] When the main processor 1021 is inactive (e.g., in sleep) state, the auxiliary processor 1023 (rather than the main processor 1021) can control at least some of the functions or states associated with at least one component of the electronic device 1001 (e.g., display module 1060, sensor module 1076, or communication module 1090). Alternatively, when the main processor 1021 is active (e.g., running an application), the auxiliary processor 1023 can work with the main processor 1021 to control at least some of the functions or states associated with at least one component of the electronic device 1001 (e.g., display module 1060, sensor module 1076, or communication module 1090). According to embodiments, the auxiliary processor 1023 (e.g., an image signal processor or a communication processor) can be implemented as part of another component (e.g., camera module 1080 or communication module 1090) functionally associated with the auxiliary processor 1023. According to embodiments, the auxiliary processor 1023 (e.g., a neural processing unit) can include hardware structures dedicated to artificial intelligence model processing. Artificial intelligence models can be generated through machine learning. For example, such learning can be performed via electronic device 1001 where the artificial intelligence is executed, or via a separate server (e.g., server 1008). The learning algorithm can include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model can include multiple layers of artificial neural networks. The artificial neural networks can be, but are not limited to, deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted Boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), or deep Q-networks, or combinations of two or more of these. Additionally or optionally, the artificial intelligence model can include software structures in addition to hardware structures.
[0319] The memory 1030 may store various data used by at least one component of the electronic device 1001 (e.g., processor 1020 or sensor module 1076). The various data may include, for example, software (e.g., program 1040) and input or output data for commands associated with it. The memory 1030 may include volatile memory 1032 or non-volatile memory 1034.
[0320] The program 1040 can be stored as software in the memory 1030, and the program 1040 may include, for example, an operating system (OS) 1042, middleware 1044, or application 1046.
[0321] The input module 1050 can receive commands or data from outside the electronic device 1001 (e.g., from a user) that will be used by other components of the electronic device 1001 (e.g., the processor 1020). The input module 1050 may include, for example, a microphone, a mouse, a keyboard, keys (e.g., buttons), or a digital pen (e.g., a stylus).
[0322] The sound output module 1055 can output sound signals to the outside of the electronic device 1001. The sound output module 1055 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. According to embodiments, the receiver can be implemented separately from the speaker or as part of the speaker.
[0323] Display module 1060 can visually provide information to the outside of electronic device 1001 (e.g., to a user). Display device 1060 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling a respective one of the display, holographic device, and projector. According to an embodiment, display module 1060 may include a touch sensor adapted to detect touch or a pressure sensor adapted to measure the intensity of the force caused by touch.
[0324] The audio module 1070 can convert sound into electrical signals and vice versa. According to an embodiment, the audio module 1070 can obtain sound via the input module 1050, or output sound via the sound output module 1055 or headphones of an external electronic device (e.g., electronic device 1002) that is directly (e.g., wired) or wirelessly connected to the electronic device 1001.
[0325] Sensor module 1076 can detect the operating state of electronic device 1001 (e.g., power or temperature) or the environmental state outside electronic device 1001 (e.g., user state), and then generate an electrical signal or data value corresponding to the detected state. According to embodiments, sensor module 1076 may include, for example, a posture sensor, gyroscope sensor, atmospheric pressure sensor, magnetic sensor, accelerometer, grip sensor, proximity sensor, color sensor, infrared (IR) sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.
[0326] Interface 1077 may support one or more specific protocols used to enable electronic device 1001 to connect directly (e.g., wired) or wirelessly to external electronic device (e.g., electronic device 1002). According to embodiments, interface 1077 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital Card (SD) interface, or an audio interface.
[0327] Connection 1078 may include a connector, via which electronic device 1001 may be physically connected to an external electronic device (e.g., electronic device 1002). According to embodiments, connection 1078 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0328] The haptic module 1079 can convert electrical signals into mechanical stimuli (e.g., vibration or motion) or electrical stimuli that can be recognized by a user through their touch or kinesthesia. According to embodiments, the haptic module 1079 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.
[0329] Camera module 1080 can capture still or moving images. According to an embodiment, camera module 1080 may include one or more lenses, an image sensor, an image signal processor, or a flash.
[0330] The power management module 1088 manages the power supply to the electronic device 1001. According to an embodiment, the power management module 1088 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).
[0331] Battery 1089 can power at least one component of electronic device 1001. According to an embodiment, battery 1089 may include, for example, a non-rechargeable primary battery, a rechargeable rechargeable battery, or a fuel cell.
[0332] The communication module 1090 can support the establishment of a direct (e.g., wired) or wireless communication channel between the electronic device 1001 and an external electronic device (e.g., electronic device 1002, electronic device 1004, or server 1008), and perform communication via the established communication channel. The communication module 1090 may include one or more communication processors capable of operating independently of the processor 1020 (e.g., application processor (AP)) and support direct (e.g., wired) or wireless communication. According to embodiments, the communication module 1090 may include a wireless communication module 1092 (e.g., a cellular communication module, a short-range wireless communication module, or a Global Navigation Satellite System (GNSS) communication module) or a wired communication module 1094 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). One of these communication modules can communicate with an external electronic device via a first network 1098 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 1099 (e.g., a long-range communication network such as a traditional cellular network, 5G network, next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components (e.g., multiple chips) that are separate from each other. The wireless communication module 1092 can identify and verify the electronic device 1001 in the communication network (such as the first network 1098 or the second network 1099) using user information (e.g., the International Mobile Subscriber Identity (IMSI)) stored in the user identification module 1096.
[0333] Wireless communication module 1092 can support 5G networks following 4G networks and next-generation communication technologies (such as new radio (NR) access technologies). NR access technologies can support enhanced type mobile broadband (eMBB), massive machine-type communication (mMTC), or ultra-reliable low-latency communication (URLLC). Wireless communication module 1092 can support high-frequency bands (e.g., millimeter-wave bands) to achieve, for example, high data transmission rates. Wireless communication module 1092 can support various technologies for ensuring performance in high-frequency bands, such as, for example, beamforming, massive MIMO, full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. Wireless communication module 1092 can support various requirements specified in electronic device 1001, external electronic device (e.g., electronic device 1004), or network system (e.g., second network 1099). According to an embodiment, the wireless communication module 1092 may support peak data rates (e.g., 20 Gbps or greater) for implementing eMBB, lost coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less, or 1 ms or less round trip for each of the downlink (DL) and uplink (UL)) for implementing URLLC.
[0334] Antenna module 1097 can transmit or receive signals or power to or from the exterior of electronic device 1001 (e.g., external electronic device). According to an embodiment, antenna module 1097 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, antenna module 1097 may include multiple antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as a first network 1098 or a second network 1099) can be selected from the multiple antennas by, for example, communication module 1090 (e.g., wireless communication module 1092). Signals or power can then be transmitted or received between communication module 1090 and the external electronic device via the selected at least one antenna. According to an embodiment, additional components besides the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally incorporated into antenna module 1097.
[0335] According to various embodiments, antenna module 1097 can form a millimeter-wave antenna module. According to embodiments, the millimeter-wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and multiple antennas (e.g., an array antenna), wherein the RFIC is disposed on or adjacent to a first surface (e.g., a bottom surface) of the printed circuit board and is capable of supporting a specified high-frequency band (e.g., a millimeter-wave band), and the multiple antennas are disposed on or adjacent to a second surface (e.g., a top or side surface) of the printed circuit board and are capable of transmitting or receiving signals in the specified high-frequency band.
[0336] At least some of the aforementioned components can be interconnected and communicate signals (e.g., commands or data) between them via an inter-peripheral communication scheme (e.g., bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industrial processor interface (MIPI)).
[0337] According to an embodiment, commands or data can be sent or received between electronic device 1001 and external electronic device 1004 via server 1008 connected to a second network 1099. Each of electronic device 1002 or electronic device 1004 can be a device of the same type as electronic device 1001, or a device of a different type. According to an embodiment, all or some operations that would be performed on electronic device 1001 can be performed on one or more of external electronic devices 1002, external electronic devices 1004, or server 1008. For example, if electronic device 1001 is required to automatically perform a function or service, or is required to perform a function or service in response to a request from a user or another device, electronic device 1001 may request the one or more external electronic devices to perform at least a portion of the function or service instead of running the function or service, or electronic device 1001 may request the one or more external electronic devices to perform at least a portion of the function or service in addition to running the function or service. The one or more external electronic devices receiving the request may perform at least a portion of the requested function or service, or perform additional functions or services related to the request, and transmit the result of the execution to electronic device 1001. Electronic device 1001 may provide the result as at least a part of the response to the request, with or without further processing of the result. For this purpose, technologies such as cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing may be used. Electronic device 1001 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, external electronic device 1004 may include an Internet of Things (IoT) device. Server 1008 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, external electronic device 1004 or server 1008 may be included in a second network 1099. Electronic device 1001 can be applied to intelligent services based on 5G communication technology or IoT-related technologies (e.g., smart homes, smart cities, smart cars, or healthcare).
[0338] The electronic device according to various embodiments can be one of a variety of types of electronic devices. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. According to embodiments of this disclosure, the electronic device is not limited to those described above.
[0339] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to the specific embodiments, but rather to include various changes, equivalents, or substitutions to the respective embodiments. In the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that nouns in the singular form corresponding to terms may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include any one or all possible combinations of items enumerated together with the corresponding phrase among the plurality of phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used to simply distinguish one component from another and do not limit the components in other respects (e.g., importance or order). It will be understood that, whether the terms “operably” or “communically” are used or not, if an element (e.g., a first element) is referred to as “combined with another element (e.g., a second element),” “combined to another element (e.g., a second element),” “connected to another element (e.g., a second element),” or “attached to another element (e.g., a second element)”, it means that the first element can be directly (e.g., wiredly) connected to the second element, wirelessly connected to the second element, or connected to the second element via a third element.
[0340] As used in connection with various embodiments of this disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "part," or "circuit"). A module may be a single integrated component adapted to perform one or more functions, or the smallest unit or part of such a single integrated component. For example, according to embodiments, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0341] The various embodiments set forth herein can be implemented as software (e.g., program 1040) containing one or more instructions readable by a machine (e.g., electronic device 1001) stored in a storage medium (e.g., internal memory 1036 or external memory 1038). For example, under the control of a processor, the processor (e.g., processor 1020) of the machine (e.g., electronic device 1001) can invoke and execute at least one of the one or more instructions stored in the storage medium, with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. Machine-readable storage media may be provided in the form of non-transitory storage media. The term "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data being stored semi-permanently in the storage medium and data being temporarily stored in the storage medium.
[0342] According to embodiments, methods according to various embodiments of this disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an app store (e.g., the Play Store™), or may be distributed directly between two user devices (e.g., smartphones) (e.g., downloaded or uploaded). If distributed online, at least a portion of the computer program product may be temporarily generated, or at least a portion of the computer program product may be stored at least temporarily in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a forwarding server).
[0343] According to various embodiments, each of the above-described components (e.g., a module or program) may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding component of the multiple components performed one or more functions before integration. According to various embodiments, the operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.
[0344] According to various example embodiments, electronic devices (e.g., Figure 1A The electronic device 100 may include: a flexible display configured to change the size of an area exposed to the outside of the electronic device (e.g., Figure 1A Monitor 110 Figure 2A 200 monitors Figure 2C The monitor 202 and Figure 2D The display 204), and at least one processor connected to the flexible display (e.g., Figure 1A The processor 120).
[0345] The at least one processor can be configured to: be based on a region of a first size and a first screen (e.g., ...). Figure 3B First screen 327 Figure 3C The first screen 360 Figure 5A The first screen 520 Figure 5B The first screen 526 and Figure 6B One of the first screens 630) is displayed in this area, receiving input for changing the area to a second size, and based on the area being changed to a second size according to the input, a second screen corresponding to the second size is displayed in the area that has been changed to the second size (e.g., the first screen is changed to the second size). Figure 3B The second screen 329 Figure 3C The second screen 364 Figure 5A The second screen 524 Figure 5B The second screen 529 and Figure 6B (One of the second screens 632, 634 and 636).
[0346] Among the multiple elements of the content, the second screen may include elements of the content that are present in the first screen (e.g., Figure 1B Reference point 170 Figure 6B Reference object 332 Figure 3C Reference point 370 Figure 5A The first object 570 and Figure 6B The first element corresponding to a portion of the first reference object 640 (e.g., Figure 1B Reference point 174 Figure 3B The first object 337 Figure 3C Reference words 370 or 375 Figure 5A The first object 574 and Figure 6B (One of the first objects 652, 644 and 646) and the second element.
[0347] According to various example embodiments, the second element may be different from the elements in the first screen, and may not be displayed in the area when the area is of the first size.
[0348] According to various example embodiments, if an element in the first screen is text, the text corresponding to that element can be rearranged and included in the second screen. If an element in the first screen is an image or video, at least a portion of the image or video corresponding to that element can be resized and included in the second screen.
[0349] According to various example embodiments, elements in a first screen may be displayed at the top of an area of a first size, first elements in a second screen may be displayed at the top of an area of a second size, and second elements in a second screen may be displayed at the bottom of an area of a second size.
[0350] According to various example embodiments, the display portion of the content including the first element and the second element can be determined based on any one of the type of the element in the first screen, the position of the element, and user settings related to the screen display.
[0351] According to various example embodiments, elements in a first screen can be displayed in response to a reference position of a region, and first elements in a second screen can be displayed in response to a reference position of a region that has been changed to a second size.
[0352] According to various example embodiments, the at least one processor can be configured to control the flexible display to display a first element in response to a reference position of an area that has changed to a second size by moving content.
[0353] According to various example embodiments, the at least one processor can be configured to move content in a second direction perpendicular to the size of the region along a first direction in which it is enlarged or reduced.
[0354] According to various example embodiments, the offset as the degree of content movement can be determined based on any one of the type of element in the first screen, the position of the element, and user settings related to screen display.
[0355] According to various example embodiments, based on the fact that a first element that has been rearranged or resized in the first screen is not included in the second screen, an offset for including the first element in the second screen can be determined, and content can be moved based on this offset.
[0356] According to various example embodiments, the at least one processor can be configured to obtain a second content page corresponding to the first content page based on a display portion that is being displayed in an area as part of the first content page, and to move content based on a comparison between the area of the top hidden portion of the first content page and the area of the top hidden portion of the second content page.
[0357] According to various example embodiments, content can be moved to keep the area of the top hidden portion of the first content page the same as the area of the top hidden portion of the second content page.
[0358] According to various example embodiments, the at least one processor may be configured to: include a first display portion as part of a first content page in a first screen and display the first display portion in the area; identify elements in the first screen displayed in the first display portion in response to a reference position of the area; obtain a second content page corresponding to the second size based on the first content page when the area changes from a first size to a second size; identify a first element corresponding to an element in the first screen from the second content page; determine a second display portion in the second content page based on the first element and the second size; and include the second display portion in the second screen and display the second display portion in the area where the size has changed.
[0359] According to various example embodiments, the at least one processor can be configured to further move the content in a first direction.
[0360] According to various example embodiments, the content can be moved based on at least one of the region's margin, the region's zoom direction, the region's zoom speed, the region's zoom direction, and the region's zoom speed.
[0361] According to various example embodiments, electronic devices (e.g., Figure 1A The electronic device 100 may include: a flexible display configured to change the size of an area exposed to the outside of the electronic device (e.g., Figure 1A Monitor 110 Figure 2A 200 monitors Figure 2CThe monitor 202 and Figure 2D The display 204), and at least one processor connected to the flexible display (e.g., Figure 1A The processor 120).
[0362] The at least one processor can be configured to: be based on a first screen with a region of a first size and including a portion of the object (e.g., Figure 3B First screen 327 Figure 3C The first screen 360 Figure 5A The first screen 520 Figure 5B The first screen 526 and Figure 6B One of the first screens 630 is displayed in the area, receiving input for enlarging the size of the area to a second size, and based on the area being enlarged to a second size according to the input, displaying a second screen (e.g., the first screen enlarged to the second size) in the area enlarged to the second size. Figure 3B The second screen 329 Figure 3C The second screen 364 Figure 5A The second screen 524 Figure 5B The second screen 529 and Figure 6B (One of the second screens 632, 634 and 636).
[0363] The second screen can include objects (e.g., Figure 3B Reference object 332 Figure 5A The first object 570 and Figure 6B At least a portion of the first element corresponding to the first reference object 640 and the second object (e.g., Figure 6B The second object is 672 or 676).
[0364] According to various example embodiments, the second object may be different from the first object, and may not be displayed in the area when the area is of the first size.
[0365] According to various example embodiments, essentially the entirety of the first object can be enlarged according to the second size and displayed on top of the area enlarged to the second size.
[0366] According to various example embodiments, a portion of the first object may be enlarged according to the second size and displayed on top of the area enlarged to the second size, and the second object may be displayed at the bottom of the area enlarged to the second size.
[0367] According to various example embodiments, at least a portion of the first object to be included in the second screen and the second object can be determined based on any one of the object's type, the object's location, and user settings related to the screen display.
[0368] Although this disclosure has been illustrated and described with reference to various exemplary embodiments, it should be understood that these exemplary embodiments are intended to be illustrative and not limiting. Those skilled in the art will further understand that various changes in form and detail may be made without departing from the true spirit and full scope of this disclosure (including the appended claims and their equivalents).
Claims
1. An electronic device comprising: A flexible display includes a display area visible from the front of an electronic device, wherein the size of the display area can change between a first size and a second size larger than the first size as at least a portion of the flexible display moves; At least one processor, including processing circuitry; and Memory, storing instructions that, when executed individually and / or jointly by at least one processor, cause the electronic device to perform the following operations: The flexible display is controlled to display at least a first portion of a first image object and a text area including characters on the first screen, based on a display reference point in a first screen corresponding to a display area of a first size. Based on the fact that the size of the display area visible from the front is enlarged and changed to a second size, the display reference point of the display area of the first size is determined by moving the display reference point of the display area of the first size in the opposite direction to the enlargement direction of the display area. The flexible display is controlled to display, in a second screen corresponding to the display area of the second size, a second image object obtained by moving the first image object relative to the display reference point of the display area of the second size and enlarging the first image object proportionally based on the second size while maintaining the aspect ratio, and characters rearranged based on the display reference point of the display area of the second size and the second image object. The characters are rearranged by moving a portion of the characters to fill the enlarged text area corresponding to the display area of the second size while maintaining the size of the characters in the display area of the first size.
2. The electronic device according to claim 1, wherein, The display reference point of the second-sized display area is determined by moving the display reference point of the first-sized display area in a direction perpendicular to the magnification direction of the display area.
3. The electronic device according to claim 1, wherein, At least a portion of the second image object displayed on the second screen includes at least a portion of the first portion that has been resized to correspond to the second size.
4. The electronic device according to claim 1, in, The first image object includes a second part that is different from the first part. Wherein, when the size of the display area is the first size, the second part is not displayed, and Wherein, at least a portion of the second image object displayed on the second screen includes at least a portion of the second portion that has been resized to a size corresponding to the second size.
5. The electronic device according to claim 1, wherein, While a first screen corresponding to a display area of a first size is displayed, the first image object and the text area are arranged in a content page, the content page including at least one of a webpage, an internet page, or an application page.
6. The electronic device according to claim 4, wherein, The first part is the lower part of the first image object, and the second part is the upper part of the first image object.
7. The electronic device according to claim 1, wherein, The offset indicating the degree of movement of the reference point is determined based on at least one of the position of the first image object or user settings related to the screen display.
8. The electronic device according to claim 1, wherein, The first part is displayed at the top of the first screen, and the text area is located below the first image object. Wherein, when the instructions are executed by at least one processor individually and / or jointly, the electronic device performs the following operations: Receive input for changing the size of the display area from a first size to a second size, and In response to a received input, the flexible display is controlled to display a second screen in the display area, which has been changed to a second size. The second screen includes characters from the text area, wherein the characters are moved and rearranged along a second direction perpendicular to a first direction in which the size of the display area is enlarged or reduced. The characters are rearranged by moving a portion of the characters to fill the enlarged or reduced text area corresponding to the enlarged or reduced display area, while maintaining the size of the characters within the first-sized display area. Based on at least one of the following: the type of the first image object, the position of the first image object, or user settings, determine whether to display the resized first image object, including the second portion, on the second screen, or not to display the resized first image object. If it is determined that the resized first image object, including the second portion, will be displayed on the second screen, then the flexible display will be controlled to display the resized first image object at the top of the second screen; otherwise, the resized first image object will not be displayed. Specifically, when the size of the display area is the first size, the second part is not displayed.
9. The electronic device according to claim 8, wherein, The first part is the lower part of the first image object, and the second part is the upper part of the first image object.
10. The electronic device according to claim 8, wherein, The at least one processor is configured to, if it is determined that a resized first image object, including a second portion, is to be displayed on the second screen, control the flexible display to display substantially all of the resized first image object, which is displayed at the top of the second screen.
11. A method of operating an electronic device, the electronic device including a flexible display, the flexible display including a display area visible from the front of the electronic device, wherein, As at least a portion of the flexible display moves, the size of the display area can change between a first size and a second size, the method comprising: The flexible display displays at least a first portion of a first image object and a text area including characters on the first screen based on a display reference point in the first screen corresponding to a display area of the first size. Based on the fact that the size of the previously visible display area is enlarged and changed to a second size, the display reference point of the second-sized display area is determined by moving the display reference point of the first-sized display area in the opposite direction to the enlargement direction of the display area. A second image object, obtained by moving the first image object relative to the display reference point of the second-sized display area and proportionally enlarging the first image object based on the second size while maintaining the aspect ratio, is displayed on the second screen. Characters rearranged based on the display reference point of the second-sized display area and the second image object are also displayed on the second screen. The characters are rearranged by moving a portion of the characters to fill the enlarged text area corresponding to the second-sized display area while maintaining the size of the characters in the first-sized display area.
12. The method according to claim 11, wherein, The display reference point of the second-sized display area is determined by moving the display reference point of the first-sized display area in a direction perpendicular to the magnification direction of the display area.
13. The method according to claim 11, wherein, At least a portion of the second image object displayed on the second screen includes at least a portion of the first portion that has been resized to correspond to the second size.
14. The method according to claim 11, in, The first image object includes a second portion different from the first portion, wherein the second portion is not displayed when the size of the display area is the first size. Wherein, at least a portion of the second image object displayed on the second screen includes at least a portion of the second portion that has been resized to a size corresponding to the second size.
15. The method according to claim 14, wherein, The first part is the lower part of the first image object, and the second part is the upper part of the first image object.
16. The method according to claim 11, wherein, The offset indicating the degree of movement of the reference point is determined based on at least one of the position of the first image object or user settings related to the screen display.
17. The method according to claim 11, wherein, While a first screen corresponding to a display area of a first size is displayed, the first image object and the text area are arranged in a content page, the content page including at least one of a webpage, an internet page, or an application page.
18. The method according to claim 11, wherein, The first part is displayed at the top of the first screen, and the text area is located below the first image object. The method further includes: Receive input for changing the size of the display area from a first size to a second size, and In response to a received input, the flexible display is controlled to display a second screen in the display area, which has been changed to a second size. The second screen includes characters from the text area, wherein the characters are moved and rearranged along a second direction perpendicular to a first direction in which the size of the display area is enlarged or reduced. The characters are rearranged by moving a portion of the characters to fill the enlarged or reduced text area corresponding to the enlarged or reduced display area, while maintaining the size of the characters within the first-sized display area. Based on at least one of the following: the type of the first image object, the position of the first image object, or user settings, determine whether to display the resized first image object, including the second portion, on the second screen, or not to display the resized first image object. If it is determined that the resized first image object, including the second portion, will be displayed on the second screen, then the flexible display will be controlled to display the resized first image object at the top of the second screen; otherwise, the resized first image object will not be displayed. Specifically, when the size of the display area is the first size, the second part is not displayed.
Citation Information
Patent Citations
Electronic device having rollable display and method of controlling the same
US20170140504A1
Flexible display device and operating method thereof
US20170147189A1