Method and device for managing display area of computing equipment, equipment and medium
By detecting user input and presenting the area representation of the display device in the computing device, multiple display device settings problems are solved, and the display area is adjusted immediately and without overlapping, improving the user experience.
Patent Information
- Application Number
- CN202310512957.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-08
- Publication Date
- 2024-11-08
AI Technical Summary
The prior art is difficult to effectively manage the display area settings between multiple display devices in a computing device, resulting in poor experience of the user during the setting process and the inability to adjust the position relationship of the display device in real time.
By detecting user input, the area representation of multiple display devices is presented based on adjacent positions, and the display area is determined at the end of user input, ensuring that the representation is immediately adjacent but does not overlap, and visual adjustment of the display area is realized.
It provides a more convenient and effective way to set the display area of the computing device, allowing users to adjust the display position relationship of multiple display devices in real time, improving the user experience.
Smart Images

Figure CN118915984A_ABST
Abstract
Description
Technical Field
[0001] Exemplary implementations of the present disclosure generally relate to display area settings, and more particularly to methods, apparatuses, devices, and computer-readable storage media for managing a display area of a computing device. Background Art
[0002] With the development of computer hardware technology, multiple display devices can be connected to a computing device. For example, display devices can be connected to multiple display interfaces of a conventional desktop computer respectively; for another example, for a notebook device, other display devices can be connected in addition to the built-in display device of the notebook device. At this time, the display area of the computing device will include different display areas provided by different display devices. In order to provide a good user experience, it is necessary to pre-set the display areas of multiple display devices, so that it is convenient for users to determine the display positions between multiple display devices. At this time, it is expected that the display area of the computing device can be set in a more convenient and effective way, and it is expected that during the setting process, the positional relationship of the display areas of multiple display devices can be presented in real time as the user inputs the operation. Summary of the invention
[0003] In a first aspect of the present disclosure, a method for managing a display area of a computing device is provided. The computing device is connected to a first display device and a second display device, and the first display device and the second display device respectively have a first display area and a second display area output by the computing device. In the method, a first area representation of the first display device and a second area representation of the second display device are respectively provided. In response to detecting a user input of a user of the computing device for the first area representation, the first area representation is presented at an adjacent position of the second area representation based on the user input, and the first area representation and the second area representation are adjacent and do not overlap. In response to detecting the end of the user input, the first display area and the second display area are determined based on the first area representation and the second area representation.
[0004] In a second aspect of the present disclosure, a device for managing the display area of a computing device is provided. The computing device is connected to a first display device and a second display device, and the first display device and the second display device respectively have a first display area and a second display area output by the computing device. The device includes: a providing module, configured to respectively provide a first area representation of the first display device and a second area representation of the second display device; a presenting module, configured to, in response to detecting a user input of a user of the computing device for the first area representation, present the first area representation at an adjacent position of the second area representation based on the user input, the first area representation and the second area representation being adjacent and non-overlapping; and a determining module, configured to, in response to detecting the end of the user input, determine the first display area and the second display area based on the first area representation and the second area representation.
[0005] In a third aspect of the present disclosure, an electronic device is provided. The electronic device includes: at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit, and when the instructions are executed by the at least one processing unit, the electronic device executes the method according to the first aspect of the present disclosure.
[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the processor implements the method according to the first aspect of the present disclosure.
[0007] It should be understood that the content described in this content section is not intended to limit the key features or important features of the implementation of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easy to understand through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] In the following, in conjunction with the accompanying drawings and with reference to the following detailed description, the above and other features, advantages and aspects of various implementations of the present disclosure will become more apparent. In the accompanying drawings, the same or similar figure labels represent the same or similar elements, wherein:
[0009] Figure 1 A block diagram showing an application environment in which an exemplary implementation according to the present disclosure may be applied;
[0010] Figure 2 A block diagram for managing a display area of a computing device according to some implementations of the present disclosure is shown;
[0011] Figure 3 A block diagram showing a movement trajectory according to some implementations of the present disclosure;
[0012] Figure 4A block diagram for managing a display area of a computing device according to some implementations of the present disclosure is shown;
[0013] Figure 5 A block diagram for determining a target boundary according to some implementations of the present disclosure is shown;
[0014] Figure 6 A block diagram showing a region representation sliding along a horizontal direction according to some implementations of the present disclosure;
[0015] Figure 7 A block diagram illustrating the relationship between display regions and region representations according to some implementations of the present disclosure;
[0016] Figure 8 A block diagram for adjusting a display area of a display device according to some implementations of the present disclosure is shown;
[0017] Fig. 9 A block diagram for adjusting a display area of a display device according to some implementations of the present disclosure is shown;
[0018] Fig.10 A block diagram for adjusting a display area of a display device according to some implementations of the present disclosure is shown;
[0019] Fig.11 A block diagram illustrating movement trajectories associated with multiple display devices according to some implementations of the present disclosure;
[0020] Fig.12 A flowchart illustrating a method for managing a display area of a computing device according to some implementations of the present disclosure is shown;
[0021] Fig.13 A block diagram showing an apparatus for managing a display area of a computing device according to some implementations of the present disclosure; and
[0022] Fig.14 A block diagram of a device capable of implementing multiple implementations of the present disclosure is shown. DETAILED DESCRIPTION
[0023] The implementation of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain implementations of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be interpreted as being limited to the implementations described herein. On the contrary, these implementations are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and implementations of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0024] In the description of the implementation methods of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "an implementation" or "the implementation" should be understood as "at least one implementation". The term "some implementations" should be understood as "at least some implementations". The following may also include other explicit and implicit definitions. As used herein, the term "model" can represent the association relationship between various data. For example, the above-mentioned association relationship can be obtained based on a variety of technical solutions currently known and / or to be developed in the future.
[0025] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.
[0026] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0027] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.
[0028] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information is sent to the user in a manner such as a pop-up window, in which the prompt information can be presented in text form. In addition, the pop-up window can also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0029] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0030] The term "in response to" as used herein refers to a state in which a corresponding event occurs or a condition is satisfied. It will be understood that the timing of executing a subsequent action executed in response to the event or condition is not necessarily strongly related to the time when the event occurs or the condition is satisfied. For example, in some cases, the subsequent action may be executed immediately when the event occurs or the condition is satisfied; while in other cases, the subsequent action may be executed some time after the event occurs or the condition is satisfied.
[0031] Example Environment
[0032] With the development of computer hardware technology, multiple display devices can be connected to a computing device. Figure 1 Describe an application environment according to an exemplary implementation of the present disclosure. Figure 1 1 is a block diagram of an application environment 100 in which an exemplary implementation according to the present disclosure may be applied. Figure 1 As shown, the computing device 130 may be connected to the display device 110 (also referred to as the first display device) via the interface 140, and the computing device 130 may be further connected to the display device 120 (also referred to as the second display device) via the interface 142. At this time, the display area of the computing device will include different display areas output by different display devices respectively.
[0033] will understand, although Figure 1 The computing device 130 is shown as a conventional desktop device, but the computing device 130 may be a notebook device, and the notebook device may include a built-in display device. The computing device 130 may further be connected to one or more other display devices. Figure 1 While shown as being connected via wired interfaces 140 and 142 , the display devices may alternatively and / or additionally be connected via wireless interfaces.
[0034] In order to provide a good user experience, it is necessary to pre-set the display areas of multiple display devices so that the user can determine the display positions between the multiple display devices. At this time, it is expected that the display area of the computing device can be set in a more convenient and effective way, and it is expected that during the setting process, the position relationship of the display areas output by the multiple display devices can be presented in real time with the operation input by the user.
[0035] Displays a summary of locale settings
[0036] In order to at least partially solve the deficiencies in the prior art, according to an exemplary implementation of the present disclosure, a method for managing a display area of a computing device is proposed. Figure 2 An overview of an exemplary implementation according to the present disclosure is described. Figure 2 A block diagram 200 for managing a display area of a computing device according to some implementations of the present disclosure is shown. Here, a computing device 130 is connected to a display device 110 and a display device 120, and the display device 110 and the display device 120 have a display area (also referred to as a first display area) and a display area (also referred to as a second display area) output by the computing device 130, respectively.
[0037] like Figure 2 As shown, in the display management area 230, the area representation 210 of the display device 110 and the area representation 220 of the display device 110 can be presented respectively. The user of the computing device 130 can adjust each area representation by clicking, dragging, etc., so as to achieve the purpose of setting the display area of the display devices 110 and 120. Specifically, the user can adjust the position of any area representation, and only the adjustment of the area representation 210 will be described as an example below. For example, a user input 240 of the user for the area representation 210 can be detected (for example, the user can use a mouse to drag the area representation 210). In the case where the user input 240 is detected, the area representation 210 can be presented at an adjacent position of the area representation 220 based on the user input 240.
[0038] According to an exemplary implementation of the present disclosure, during user operation, the region representation 210 and the region representation 220 are adjacent and do not overlap. In other words, the border (e.g., right border) of the region representation 210 may be adjacent to the border (e.g., left border) of the region representation 220. At this time, the border of the region representation 210 is adsorbed to the border of the region representation 220, and the region representation 210 may slide along the borders of the region representation 220 as the user input 240 moves.
[0039] When the user input 240 includes an upward motion component, the area representation 210 may slide upward until the lower right corner of the area representation 210 contacts the upper left corner of the area representation 220. At this time, when the user input 240 includes a rightward motion component, the area representation 210 may slide to the right until the lower left corner of the area representation 210 contacts the upper right corner of the area representation 220. When the user input 240 includes a downward motion component, the area representation 210 may slide downward until the upper left corner of the area representation 210 contacts the lower right corner of the area representation 220. When the user input 240 includes a leftward motion component, the area representation 210 may slide to the left until the upper right corner of the area representation 210 contacts the lower left corner of the area representation 220. When the user input 240 includes an upward motion component, the area representation 210 may slide upward until the lower left corner of the area representation 210 contacts the lower left corner of the area representation 220. Figure 2 Position shown.
[0040] Although the above only describes the case where the user moves the area representation 210 around the area representation 220 in a clockwise direction, alternatively and / or additionally, the user may move the area representation 210 around the area representation 220 in a counterclockwise direction. In this case, the position of the area representation 220 will remain unchanged, and a certain boundary of the area representation 210 will be attached to the corresponding boundary of the area representation 220 and slide along the boundary.
[0041] Further, if the end of the user input 240 is detected (for example, the user releases the mouse button), the display area and the display area of the two display devices 110 and 120 can be determined based on the area representation 210 and the area representation 220. In other words, when the user input 240 ends, the area representation 210 will stay at the last position during the sliding, and the display area of the two display devices can be determined based on this position.
[0042] By using the exemplary implementation of the present disclosure, when the user drags the region representation 210, the region representation 210 always moves around the region representation 220 along a certain boundary of the region representation 220. At this time, the region representation 210 and the region representation 220 do not overlap, and the dragged region representation 210 can follow the mouse movement without lag. In this way, a visual representation of setting the display area can be provided to the user, thereby facilitating the user to adjust the display area of each display device during the setting process.
[0043] Display the detailed process of regional settings
[0044] In the following, more details of an exemplary implementation of the present disclosure will be described. It will be appreciated that the present disclosure relates to adjusting multiple display devices of the computing device 130, and thus a method according to an exemplary implementation of the present disclosure may be performed upon detecting that an extended display mode is initiated at the computing device 130. In this way, unnecessary initiation of a method for managing display areas of multiple display devices may be avoided.
[0045] According to an exemplary implementation of the present disclosure, each display device connected to the computing device 130 may have an equal relationship, and the dragged area representation 210 may correspond to any display device. Specifically, the display device 210 may be any one of the built-in display device and the external display device of the computing device 130, and the display device 220 may be the other one of the built-in display device and the external display device. In this way, each display device may be managed in a similar manner, thereby reducing the overhead of developing different management strategies for different display devices.
[0046] According to an exemplary implementation of the present disclosure, the region representation 210 and the region representation 220 may be presented in the display management area 230 of the computing device 130. Here, the region representation 210 may be a thumbnail of the display area of the display device 110 (e.g., displayed at a predetermined reduction ratio), and the shape and size of the region representation 210 may be determined based on the resolution of the display area output by the computing device 130 to the display device 110. Similarly, the region representation 220 may be a thumbnail of the display area of the display device 120, and the shape and size of the region representation 220 may be determined based on the resolution of the display area output by the computing device 130 to the display device 120.
[0047] Assume that the resolution of the display area of the display device 110 is 1600*1200 pixels, and the resolution of the display area of the display device 120 is 2240*1400 pixels. At this time, the area representation 210 and the area representation 220 can be presented respectively according to the proportional relationship between the two resolutions. In this way, the size of the corresponding display area of each display device can be presented to the user in a visual manner, thereby facilitating the user to manage the display area of each display device.
[0048] In the following, we will refer to the Figure 3 Describes more details of an exemplary implementation according to the present disclosure, Figure 3 A block diagram 300 of a movement trajectory according to some implementations of the present disclosure is shown. Figure 3 As shown, a moving track 310 of the region representation 210 may be determined, and the region representation 210 may be moved along the moving track 310. When the user drags the region representation 210 with a mouse, the center of the region representation 210 may be moved along the moving track 310. Specifically, the moving track 310 of the region representation 210 may be determined based on a resolution of the display region of the display device 110 (also referred to as a first resolution) and a resolution of the display region of the display device 120 (also referred to as a second resolution).
[0049] At this time, in order to ensure that the two region representations can be close to each other during the movement, the region representation 220 can be expanded outward along the horizontal direction and the vertical direction, thereby obtaining the movement track 310. At this time, the expansion amplitude in the horizontal direction is proportional to the horizontal component in the first resolution, and the expansion amplitude in the vertical direction is proportional to the vertical component in the first resolution.
[0050] According to an exemplary implementation of the present disclosure, the horizontal portion of the movement track 310 may be determined based on the region representation 220 and the vertical component in the first resolution. Specifically, the distance between the upper boundary of the movement track 310 and the upper boundary of the region representation 220 may be half of the vertical component of the first resolution. Assuming that the first resolution is 1600*1200, the distance may be 1200 / 2=600 pixels. It will be understood that since the region representation 210 and the region representation 220 are thumbnails of two display regions, respectively, at this time Figure 3 The distance between the upper boundary of the movement track 310 and the upper boundary of the region representation 220 presented in FIG. 1 is the distance after being reduced by the reduction factor (i.e., half the height of the region representation 210). Similarly, the distance between the lower boundary of the movement track 310 and the lower boundary of the region representation 220 is also 600 pixels, and Figure 3 The reduced distance presented in is half the height of the region representation 210 .
[0051] Similarly, the distance between the left edge of the movement track 310 and the left edge of the region representation 220 is 1600 / 2=800 pixels, and the distance between the right edge of the movement track 310 and the right edge of the region representation 220 is also 800 pixels. Figure 3 The reduced horizontal distance presented in is half the width of the region representation 210. By using the exemplary implementation of the present disclosure, the boundaries of the movement trajectory 310 can be determined in a simple and effective manner. When the user moves the region representation 210, it is only necessary to move the center of the region representation 210 along the movement trajectory 310. In this way, the amount of calculation can be reduced and the efficiency of determining the presentation position of the region representation 210 can be improved.
[0052] According to an exemplary implementation of the present disclosure, a presentation position for presenting the region representation 210 may be determined in the movement trajectory 310 based on the user input 240, and then the region representation 210 may be presented at the presentation position. Figure 3 As shown, when the user mouse is located on the left side of the region representation 220, the region representation 210 may be presented at the presentation position 320. At this time, the horizontal coordinate of the presentation position 320 may remain unchanged and the vertical coordinate may vary within a certain range to ensure that the two region representations always remain adjacent.
[0053] Similarly, when the user mouse is located on the upper side of the area representation 220, the area representation 210 may be presented at a presentation position 322 (whose ordinate may remain unchanged and whose abscissa may vary within a certain range). When the user mouse is located on the right side of the area representation 220, the area representation 210 may be presented at a presentation position 324 (whose abscissa may remain unchanged and whose ordinate may vary within a certain range). When the user mouse is located on the lower side of the area representation 220, the area representation 210 may be presented at a presentation position 326 (whose ordinate may remain unchanged and whose abscissa may vary within a certain range). In this way, the area representation 210 may be presented in a simpler and more efficient manner, and the two area representations may always overlap with only one border.
[0054] According to an exemplary implementation of the present disclosure, in order to enable the region representation 210 to move following the user input 240, a candidate center of the region representation may be determined based on the input position of the user input and the region representation 210. Figure 4 Describes more details about the display management area 230, the Figure 4 A block diagram 400 for managing the display area of a computing device according to some implementations of the present disclosure is shown. Figure 4 The coordinate system is defined in the manner shown. For example, the upper left corner of the display management area 230 can be set as the origin coordinate 430, (expressed as (0,0)). The upper left corner position of the moving track 310 can be expressed as the path minimum coordinate 440 (expressed as (minCenterX, minCenterY)), and the lower right corner position of the moving track 310 can be expressed as the path maximum coordinate 442 (expressed as (maxCenterX, maxCenterY)). The position of the moving track 310 can be determined based on the manner described above.
[0055] According to an exemplary implementation of the present disclosure, the position at the beginning of the user input 240 (i.e., when the user presses the mouse button) can be represented as (mouseX1, mouseY1), and the input position during the user input 240 (i.e., when dragging the mouse) can be represented as input coordinates 420 (represented as (mouseX, mouseY)). Further, the upper left corner of the region representation 210 can be represented as the starting coordinates 410 (represented as (startX, startY)), and the center of the region representation 210 can be represented as the candidate center 410 (represented as (curCenterX, curCenterY)).
[0056] According to an exemplary implementation of the present disclosure, in order to determine the candidate center 450 of the region representation 210, the relative position of the input position of the user input in the display management area 230 of the computing device 130 may be determined based on the following formula 1 (assuming that the width and height of the dragged region representation 210 are width and height respectively):
[0057] deltaXInActive=mouseX1-startX
[0058] deltaYInActive=mouseY1-startY
[0059] Formula 1
[0060] In the above formula, deltaXInActive and deltaYInActive represent the horizontal component and the vertical component of the relative position, respectively. Further, the candidate center 450 of the region representation 210 can be determined based on the input position 420, the relative position and the resolution of the region representation 210. Specifically, the candidate center 450 can be determined based on the following formula 2:
[0061]
[0062]
[0063] By using the exemplary implementation of the present disclosure, Formula 1 and Formula 2 can be used to quickly and accurately determine the candidate center 450 of the region representation 210. In this way, the amount of calculation associated with determining the display position of the region representation 210 can be reduced, thereby presenting the region representation 210 in a smoother manner.
[0064] According to an exemplary implementation of the present disclosure, the minimum distance between the candidate center 450 and multiple boundaries of the moving trajectory 310 can be determined, and then the presentation position is determined based on the minimum distance. In this way, it can be determined in a simple and effective way that the area representation 210 that the user is dragging should be displayed close to the boundary of the area representation 220. Specifically, the distance between the candidate center 450 and each boundary can be determined separately. Here, the multiple boundaries of the moving trajectory 310 can include at least any one of the following: the left boundary, the right boundary, the upper boundary, and the lower boundary of the moving trajectory. At this time, the candidate center 450 can be compared with each boundary one by one, so as to find the boundary with the smallest distance from the candidate center 450.
[0065] According to an exemplary implementation of the present disclosure, the user can press the mouse button to drag the region representation 210, and the state statusA can be used to indicate whether the user is performing a dragging user input. When it is detected that the user is performing a dragging operation, statusA can be set to 1; and when it is detected that the dragging operation ends, statusA can be set to 0. According to an exemplary implementation of the present disclosure, when statusA is 1, the distance between the candidate center 450 and each boundary of the moving track 310 can be determined based on the following formula 3:
[0066] dMinX=|curCenterX=minCenterX|
[0067] dMaxX=|curCenterX=maxCenterX|
[0068] dMinY=|curCenterY=minCenterY|
[0069] dMaxY=|curCenterY=maxCenterY|
[0070] Formula 3
[0071] In the above formula, dMinX, dMaxX, dMinY, dMaxY respectively represent the distances between the candidate center 450 and the left boundary, right boundary, upper boundary, and lower boundary of the moving track 310, and || represents an absolute value. The minimum distance minDistance can be determined based on Formula 4:
[0072] minDistance=min(dMinX,dMaxX,dMinY,dMaxY)
[0073] Formula 4
[0074] Using the exemplary implementation of the present disclosure, the minimum distance can be quickly determined through simple mathematical calculations.
[0075] According to an exemplary implementation of the present disclosure, a target boundary corresponding to the minimum distance among multiple boundaries may be determined, that is, it is determined which boundary the candidate center 450 is closer to. Figure 5 A block diagram 500 for determining a target boundary according to some implementations of the present disclosure is shown. Figure 5As shown, assuming that the lower boundary is determined to be the target boundary 510, the presentation position 520 can be set to move along the target boundary 510, that is, the ordinate of the presentation position 520 is the ordinate of the target boundary 510. Further, the presentation position for presenting the region representation 210 can be determined in the determined target boundary 510. In other words, the presentation position can be used to update the coordinates of the dragged region representation 210 in real time, thereby presenting a visual effect of the region representation 210 moving with the user's mouse.
[0076] According to an exemplary implementation of the present disclosure, the presentation position can be determined based on the target boundary 510 and the candidate center. Further, the center of the region representation 210 can be set at the presentation position. With the exemplary implementation of the present disclosure, the center of the region representation 210 can slide along the moving track 310 with the user's dragging operation. In this way, the dragged region representation 210 can slide along a boundary of the region representation 220, and the two region representations always remain in a state of being adjacent and non-overlapping.
[0077] Figure 6 A block diagram 600 of a region representation sliding along a horizontal direction according to some implementations of the present disclosure is shown. Figure 6 As shown, the user mouse can move left or right along the horizontal moving direction 610. At this time, the presentation position 620 can move with the movement of the user mouse. That is, the horizontal coordinate of the presentation position 620 can be consistent with the horizontal coordinate of the candidate center.
[0078] Specifically, the presentation position may be determined based on the following. If minDistance is equal to dMinX, this indicates that the candidate center is closest to the left boundary. At this time, the horizontal coordinate of the center of the region representation 210 may be set to the left boundary minCenterX, and the vertical coordinate of the center of the region representation 210 may be set to the vertical coordinate curCenterY of the candidate center 450. In other words, at this time, the center coordinates of the region representation 210 may be set to (minCenterX, curCenterY).
[0079] If minDistance is equal to dMaxX, this means that the candidate center is closest to the right boundary. At this time, the horizontal coordinate of the center of the region representation 210 can be set to the right boundary maxCenterX, and the vertical coordinate of the center of the region representation 210 can be set to the vertical coordinate curCenterY of the candidate center 450. In other words, at this time, the center coordinates of the region representation 210 can be set to (maxCenterX, curCenterY).
[0080] If minDistance is equal to dMinY, this means that the candidate center is closest to the upper boundary. At this time, the ordinate of the center of the region representation 210 can be set to the upper boundary minCenterY, and the abscissa of the center of the region representation 210 can be set to the abscissa curCenterX of the candidate center 450. In other words, at this time, the center coordinates of the region representation 210 can be set to (curCenterX, minCenterY).
[0081] If minDistance is equal to dMaxY, this means that the candidate center is closest to the lower boundary. At this time, the ordinate of the center of the region representation 210 can be set to the lower boundary maxCenterY, and the abscissa of the center of the region representation 210 can be set to the abscissa curCenterX of the candidate center 450. In other words, at this time, the center coordinates of the region representation 210 can be set to (curCenterX, maxCenterY).
[0082] When the user's dragging operation is not completed (that is, statusA is 1), the position of the user's mouse can be obtained in real time, and then the region representation 210 can be presented based on the formula described above. When it is detected that the user's dragging operation is completed (that is, statusA is 0), the region representation 210 can be kept at the last dragging position. At this time, the positions of the region representation 210 and the region representation 220 remain fixed, and then the display area of the display device can be connected based on the above positions.
[0083] According to an exemplary implementation of the present disclosure, it is assumed that the size of the display area of the display device 110 is a first resolution (e.g., W1*H1), and the size of the display area of the display device 120 is a second resolution (e.g., W2*H2). Further, the positional relationship between the two display areas can be determined based on the positional relationship between the area representation 210 and the area representation 220, thereby determining the two display areas with the above resolutions.
[0084] Figure 7 A block diagram 700 is shown showing the relationship between display regions and region representations according to some implementations of the present disclosure. Figure 7 As shown, assuming that the right side boundary of the region representation 210 is adjacent to the left side boundary of the region representation 220, and the upper side boundaries of the two region representations 210 and 220 are aligned, the physical coordinates of the display region 710 of the display device 110 and the display region 720 of the display device 120 can be as follows: Figure 7As shown in . Assuming that the display area 710 corresponds to the built-in display of the computing device 130, the coordinates 720 of the upper left corner of the display area 710 can be expressed as (0,0), and the coordinates 722 of the lower right corner of the display area 710 can be expressed as (W1*H1). Further, the coordinates 730 of the upper left corner of the display area 720 can be expressed as (W1,0), and the coordinates 732 of the lower right corner of the display area 720 can be expressed as ((W1+W2)*H2).
[0085] It will be understood that the above only schematically illustrates the positional relationship of the presentation areas of the two display devices. When the area representation 210 and the area representation 220 have different positional relationships, the positional relationship between the corresponding presentation areas can be determined based on the positional relationship of the two area representations. Specifically, the positional offset between the physical display areas can be determined based on the positional offset and the reduction factor of the two area representations in the display management area 230.
[0086] It will be understood that although the above describes a specific example of adjusting the display area by taking the user dragging the area representation 210 as an example, according to an exemplary implementation of the present disclosure, the area representation of any display device of the computing device 130 can be adjusted. Figure 8 A block diagram 800 for adjusting a display area of a display device according to some implementations of the present disclosure is shown. Figure 8 As shown, a user input 810 directed to the area representation 220 may be detected. In other words, the area representation 220 may slide around the boundary of the area representation 210 as the user drags the area representation 220 .
[0087] It will be understood that although the above schematically shows the case where the display area is "horizontally", alternatively and / or additionally, each display area herein may be set to be "vertically". Fig. 9 A block diagram 900 for adjusting a display area of a display device according to some implementations of the present disclosure is shown. As shown, the area representation 910 may represent a display area arranged "vertically", and at this time, the positional relationship of the two area representations may still be adjusted according to the formula described above.
[0088] It will be understood that although the above schematically illustrates the case of adjusting the display areas of two display devices. Alternatively and / or additionally, the computing device 130 may be connected to more display devices, and the display areas of other display devices may be adjusted in a similar manner. According to an exemplary implementation of the present disclosure, the computing device 130 may be further connected to a third display device, and the third display device has a third display area output by the computing device. Fig.10 Describes more details on setting up display areas for three display devices. Fig.10A block diagram 1000 for adjusting a display area of a display device according to some implementations of the present disclosure is shown. Fig.10 As shown, the region representation 210 , the region representation 220 , and the region representation 1010 (also referred to as the third region representation) respectively corresponding to the display regions of the three display devices may be presented in the display management region 230 .
[0089] The region representation 210 and the region representation 220 may be adjusted in the above-described manner. Further, the region representation 1010 may be adjusted in a similar manner. Specifically, if another user input 1120 of the user for the region representation 1010 is detected, the region representation 1010 may be presented at an adjacent position of any of the region representations 210 and 220 based on the user input 1020. The region representation 1010 and any of the region representations are adjacent and do not overlap.
[0090] Similar to the technical solution described above, the movement trajectory of the region representation 1010 can be determined, see Fig.11 Describe in more detail. Fig.11 A block diagram 1100 of a movement trajectory associated with multiple display devices according to some implementations of the present disclosure is shown. As shown, the area representation 210 and the area representation 220 can be expanded outward. The magnitude of the expansion can be determined based on the third resolution of the third display area, for example, the expansion magnitude in the vertical direction can be half of the vertical component of the third resolution, and the expansion magnitude in the horizontal direction can be half of the horizontal component of the third resolution. In this way, the movement trajectory 1110 can be determined, and the center of the area representation 1010 can be moved along the movement trajectory 1110 as the user moves, at which point the boundary of the area representation 1010 will slide around the area representation 210 and the area representation 220. Further, if the end of the user input 1120 is detected, the display area can be determined based on the area representation 1110.
[0091] A technical solution for managing the display area of a computing device has been described. Using an exemplary implementation of the present disclosure, the dragged area representation always slides along the corresponding boundary of the fixed area representation. At this time, multiple area representations do not overlap, and the dragged area representation can follow the mouse movement in real time. In this way, a visual representation of setting the display area can be provided to the user, thereby facilitating the user to adjust his or her user input during the setting process.
[0092] Example Process
[0093] Fig.12A flowchart of a method 1200 for managing a display area of a computing device according to some implementations of the present disclosure is shown. The computing device is connected to a first display device and a second display device, and the first display device and the second display device respectively have a first display area and a second display area output by the computing device. At box 1210, a first area representation of the first display device and a second area representation of the second display device are provided respectively. At box 1220, in response to detecting a user input of a user of the computing device for the first area representation, the first area representation is presented at an adjacent position of the second area representation based on the user input, and the first area representation and the second area representation are adjacent and do not overlap. At box 1230, in response to detecting the end of the user input, the first display area and the second display area are determined based on the first area representation and the second area representation.
[0094] According to an exemplary implementation of the present disclosure, presenting a first area representation at an adjacent position based on user input includes: determining a movement trajectory of the first area representation based on a first resolution of the first display area and a second resolution of the second display area; determining a presentation position for presenting the first area representation in the movement trajectory based on the user input; and presenting the first area representation at the presentation position.
[0095] According to an exemplary implementation of the present disclosure, determining the movement trajectory includes at least any one of the following: determining a horizontal portion of the movement trajectory based on the second area representation and the vertical component in the first resolution; determining a vertical portion of the movement trajectory based on the second area representation and the horizontal component in the first resolution.
[0096] According to an exemplary implementation of the present disclosure, determining the presentation position includes: determining a candidate center of the first area representation based on an input position input by a user and the first area representation; determining a minimum distance between the candidate center and multiple boundaries of the movement trajectory; and determining the presentation position based on the minimum distance.
[0097] According to an exemplary implementation of the present disclosure, determining a candidate center of the first area representation includes: determining the relative position of an input position of a user input in a display management area of a computing device, wherein the first area representation and the second area representation are presented in the management area; and determining a candidate center of the first area representation based on the input position, the relative position and the first resolution.
[0098] According to an exemplary implementation of the present disclosure, determining the minimum distance includes: determining a plurality of distances between the candidate center position and a plurality of boundaries respectively; and selecting a minimum distance from the plurality of distances.
[0099] According to an exemplary implementation of the present disclosure, the multiple boundaries include: a left boundary, a right boundary, an upper boundary, and a lower boundary of the movement track.
[0100] According to an exemplary implementation of the present disclosure, determining the presentation position based on the minimum distance includes: determining a target boundary corresponding to the minimum distance among multiple boundaries; and determining the presentation position based on the target boundary.
[0101] According to an exemplary implementation of the present disclosure, determining the presentation position based on the target boundary includes: determining the presentation position based on the target boundary and the candidate center.
[0102] According to an exemplary implementation of the present disclosure, presenting the first area representation at the presentation position includes: setting the center of the first area representation at the presentation position.
[0103] According to an exemplary implementation of the present disclosure, providing the first region representation and the second region representation respectively includes: providing the first region representation and the second region representation respectively according to a proportional relationship between a first resolution of the first display region and a second resolution of the second display region.
[0104] According to an exemplary implementation of the present disclosure, determining the first display area and the second display area based on the first area representation and the second area representation includes: determining the positional relationship between the first display area and the second display area based on the positional relationship between the first area representation and the second area representation.
[0105] According to an exemplary implementation of the present disclosure, the method 1200 further includes: in response to detecting that the extended display mode is started at the computing device, executing the method.
[0106] According to an exemplary implementation of the present disclosure, the first display device is any one of a built-in display device and an external display device of the computing device, and the second display device is the other one of the built-in display device and the external display device.
[0107] According to an exemplary implementation of the present disclosure, the computing device is further connected to a third display device, and the third display device has a third display area output by the computing device. The method 1200 further includes: providing a third area representation of the third display device; in response to detecting another user input of the user for the third area representation, presenting the third area representation at an adjacent position of any area representation of the first area representation and the second area representation based on the other user input, the third area representation and any area representation being adjacent to and not overlapping; and in response to detecting the end of the other user input, determining the third display area based on the third area representation.
[0108] Example devices and equipment
[0109] Fig.13A block diagram of an apparatus 1300 for managing a display area of a computing device according to some implementations of the present disclosure is shown. The computing device is connected to a first display device and a second display device, and the first display device and the second display device respectively have a first display area and a second display area output by the computing device. The apparatus 1300 includes: a providing module 1310, configured to respectively provide a first area representation of the first display device and a second area representation of the second display device; a presenting module 1320, configured to, in response to detecting a user input of a user of the computing device for the first area representation, present the first area representation at an adjacent position of the second area representation based on the user input, the first area representation and the second area representation being adjacent and non-overlapping; and a determining module 1330, configured to, in response to detecting the end of the user input, determine the first display area and the second display area based on the first area representation and the second area representation.
[0110] According to an exemplary implementation of the present disclosure, the presentation module 1320 includes: a trajectory determination module, configured to determine a movement trajectory of a first area representation based on a first resolution of the first display area and a second resolution of the second display area; a position determination module, configured to determine a presentation position for presenting the first area representation in the movement trajectory based on user input; and an area presentation module, configured to present the first area representation at the presentation position.
[0111] According to an exemplary implementation of the present disclosure, the trajectory determination module includes at least any one of the following: a horizontal trajectory determination module, configured to determine a horizontal portion in the movement trajectory based on the second area representation and the vertical component in the first resolution; a vertical trajectory determination module, configured to determine a vertical portion in the movement trajectory based on the second area representation and the horizontal component in the first resolution.
[0112] According to an exemplary implementation of the present disclosure, the position determination module includes: a candidate center determination module, configured to determine a candidate center of a first area representation based on an input position input by a user and the first area representation; a minimum distance determination module, configured to determine a minimum distance between the candidate center and multiple boundaries of a moving trajectory; and a distance-based determination module, configured to determine a presentation position based on the minimum distance.
[0113] According to an exemplary implementation of the present disclosure, a candidate center determination module includes: a relative position determination module, configured to determine the relative position of an input position of a user input in a display management area of a computing device, a first area representation and a second area representation being presented in the management area; and an area candidate center determination module, configured to determine a candidate center of the first area representation based on the input position, the relative position and the first resolution.
[0114] According to an exemplary implementation of the present disclosure, a minimum distance determination module is configured to include: a distance determination module configured to respectively determine multiple distances between a candidate center position and multiple boundaries; and a selection module configured to select a minimum distance from the multiple distances.
[0115] According to an exemplary implementation of the present disclosure, the multiple boundaries include: a left boundary, a right boundary, an upper boundary, and a lower boundary of the movement track.
[0116] According to an exemplary implementation of the present disclosure, a distance-based determination module includes: a target boundary determination module, configured to determine a target boundary corresponding to a minimum distance among multiple boundaries; and a target boundary-based determination module, configured to determine a presentation position based on the target boundary.
[0117] According to an exemplary implementation of the present disclosure, the target boundary-based determination module includes: a coordinate determination module configured to determine a presentation position based on the target boundary and the candidate center.
[0118] According to an exemplary implementation of the present disclosure, the presentation module 1320 includes: a setting module configured to set the center of the first area representation at the presentation position.
[0119] According to an exemplary implementation of the present disclosure, the providing module 1310 includes: a resolution-based providing module configured to provide a first region representation and a second region representation according to a proportional relationship between a first resolution of the first display region and a second resolution of the second display region, respectively.
[0120] According to an exemplary implementation of the present disclosure, the determination module 1330 includes: a position relationship determination module configured to determine the position relationship between the first display area and the second display area based on the position relationship between the first area representation and the second area representation.
[0121] According to an exemplary implementation of the present disclosure, the apparatus 1300 further includes: a starting module configured to execute a method in response to detecting that an extended display mode is started at the computing device.
[0122] According to an exemplary implementation of the present disclosure, the first display device is any one of a built-in display device and an external display device of the computing device, and the second display device is the other one of the built-in display device and the external display device.
[0123] According to an exemplary implementation of the present disclosure, the computing device is further connected to a third display device, the third display device has a third display area output by the computing device, and the providing module is further configured to: provide a third area representation of the third display device; the presenting module is further configured to: in response to detecting another user input of the user for the third area representation, present the third area representation at an adjacent position of any area representation of the first area representation and the second area representation based on the other user input, the third area representation and any area representation being adjacent to and not overlapping; and the determining module is further configured to: in response to detecting the end of the other user input, determine the third display area based on the third area representation.
[0124] Fig.14 1400 is a block diagram of a device capable of implementing multiple implementations of the present disclosure. It should be understood that Fig.14 The computing device 1400 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the implementations described herein. Fig.14 The computing device 1400 shown may be used to implement the methods described above.
[0125] like Fig.14 As shown, computing device 1400 is in the form of a general-purpose computing device. Components of computing device 1400 may include, but are not limited to, one or more processors or processing units 1410, memory 1420, storage device 1430, one or more communication units 1440, one or more input devices 1450, and one or more output devices 1460. Processing unit 1410 may be an actual or virtual processor and is capable of performing various processes according to a program stored in memory 1420. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to increase the parallel processing capabilities of computing device 1400.
[0126] The computing device 1400 typically includes a plurality of computer storage media. Such media may be any available media accessible to the computing device 1400, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1420 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1430 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data (e.g., training data for training) and may be accessed within the computing device 1400.
[0127] The computing device 1400 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig.14 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 1420 may include a computer program product 1425 having one or more program modules that are configured to perform various methods or actions of various implementations of the present disclosure.
[0128] The communication unit 1440 enables communication with other computing devices via a communication medium. Additionally, the functions of the components of the computing device 1400 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Therefore, the computing device 1400 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
[0129] Input device 1450 may be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1460 may be one or more output devices, such as a display, speaker, printer, etc. Computing device 1400 may also communicate with one or more external devices (not shown) through communication unit 1440 as needed, such as storage devices, display devices, etc., communicate with one or more devices that allow a user to interact with computing device 1400, or communicate with any device that allows computing device 1400 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0130] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, the computer program product is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is provided, on which a computer program is stored, and when the program is executed by a processor, the method described above is implemented.
[0131] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.
[0132] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0133] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0134] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0135] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.
Claims
1. A method for managing a display area of a computing device, the computing device being connected to a first display device and a second display device, the first display device and the second display device respectively having a first display area and a second display area output by the computing device, the method comprising: providing a first area representation of the first display device and a second area representation of the second display device respectively; In response to detecting a user input from a user of the computing device directed to the first area representation, presenting the first area representation at an adjacent position of the second area representation based on the user input, the first area representation and the second area representation being immediately adjacent and non-overlapping; as well as In response to detecting an end of the user input, the first display area and the second display area are determined based on the first area representation and the second area representation.
2. The method of claim 1 , wherein presenting the first region representation at the adjacent location based on the user input comprises: Determining a movement track represented by the first area based on a first resolution of the first display area and a second resolution of the second display area; Based on the user input, determining a presentation position in the movement trajectory for presenting the first area representation; as well as The first region representation is presented at the presentation location.
3. The method according to claim 2, wherein determining the movement trajectory comprises at least one of the following: determining a horizontal portion of the movement trajectory based on the second region representation and the vertical component in the first resolution; Based on the second region representation and the horizontal component in the first resolution, a vertical portion in the movement trajectory is determined.
4. The method of claim 2, wherein determining the presentation location comprises: Determining a candidate center of the first area representation based on an input location of the user input and the first area representation; Determining a minimum distance between the candidate center and a plurality of boundaries of the movement trajectory; as well as Based on the minimum distance, the presentation position is determined.
5. The method of claim 4, wherein determining the candidate center of the first area representation comprises: determining a relative position of an input location of the user input in a display management area of the computing device, the first area representation and the second area representation being presented in the management area; as well as Based on the input position, the relative position, and the first resolution, a candidate center of the first area representation is determined.
6. The method of claim 4, wherein determining the minimum distance comprises: respectively determining a plurality of distances between the candidate center position and the plurality of boundaries; as well as The minimum distance is selected from the plurality of distances.
7. The method of claim 6, wherein the plurality of boundaries comprises: The left boundary, the right boundary, the upper boundary and the lower boundary of the movement track.
8. The method of claim 4, wherein determining the presentation position based on the minimum distance comprises: determining a target boundary among the plurality of boundaries corresponding to the minimum distance; as well as Based on the target boundary, the presentation position is determined.
9. The method of claim 8, wherein determining the rendering position based on the target boundary comprises: The presentation position is determined based on the target boundary and the candidate center.
10. The method of claim 2, wherein presenting the first region representation at the presentation location comprises: The center of the first area representation is set at the rendering location.
11. The method of claim 1 , wherein providing the first region representation and the second region representation, respectively, comprises: The first region representation and the second region representation are provided according to a proportional relationship between a first resolution of the first display region and a second resolution of the second display region, respectively.
12. The method of claim 1, wherein determining the first display area and the second display area based on the first area representation and the second area representation comprises: Based on the positional relationship between the first area representation and the second area representation, a positional relationship between the first display area and the second display area is determined.
13. The method according to claim 1, further comprising: In response to detecting that an extended display mode is initiated at the computing device, the method is performed. 14 . The method according to claim 1 , wherein the first display device is any one of a built-in display device and an external display device of the computing device, and the second display device is the other one of the built-in display device and the external display device.
15. The method of claim 1, wherein the computing device is further connected to a third display device having a third display area output by the computing device, the method further comprising: providing a third region representation of the third display device; In response to detecting another user input by the user for the third area representation, presenting the third area representation at a position adjacent to either of the first area representation and the second area representation based on the another user input, the third area representation being adjacent to and not overlapping either of the first area representation and the second area representation; as well as In response to detecting an end of the another user input, the third display area is determined based on the third area representation.
16. An apparatus for managing a display area of a computing device, the computing device being connected to a first display device and a second display device, the first display device and the second display device respectively having a first display area and a second display area output by the computing device, the apparatus comprising: A providing module configured to provide a first area representation of the first display device and a second area representation of the second display device respectively; a presentation module configured to, in response to detecting a user input from a user of the computing device for the first area representation, present the first area representation at an adjacent position of the second area representation based on the user input, the first area representation and the second area representation being immediately adjacent and non-overlapping; as well as A determination module is configured to determine the first display area and the second display area based on the first area representation and the second area representation in response to detecting an end of the user input.
17. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 15 when executed by the at least one processing unit.
18. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, causes the processor to implement the method according to any one of claims 1 to 15.
