Page layout adjustment method and device, augmented reality equipment and storage medium

Abstract

The embodiment of the invention provides a page layout adjustment method and device, augmented reality equipment and a storage medium, and the method comprises the steps: obtaining eye movement information of a user corresponding to the augmented reality equipment in response to the situation that the augmented reality equipment is in a wearing state; and if the eye movement information meets a preset condition, adjusting a layout mode of a visual area and an element layout area in a display page of the augmented reality equipment. According to the embodiment of the invention, the display page of the augmented reality equipment is divided into the visual area and the element layout area, and when the eye movement information of the user meets the preset condition, the layout modes of the visual area and the element layout area can be automatically adjusted, so that the immobilization of the page layout mode of the display page of the augmented reality equipment is avoided, and the user experience is improved. And the user does not need to manually trigger an adjustment instruction for adjusting the layout mode, so that the adjustment efficiency of adjusting the layout mode of the display page is improved, and the intelligence of the layout mode of the display page of the augmented reality equipment is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of display technology, and particularly to a method and device for adjusting page layout, an augmented reality device, and a storage medium. Background Art

[0002] With the continuous improvement of communication technology, more and more intelligent devices have emerged, and augmented reality devices are one of them. Currently, there are some augmented reality devices, such as AR glasses, MR glasses, etc. When a user wears such an augmented reality device, there will be an element layout area and a visible area for displaying virtual elements in the display interface of the augmented reality device. The virtual elements can be received text messages, icons of various application programs, etc.; when the user wears the augmented reality device, the user can also view real-world objects through the visible area. Summary of the Invention

[0003] Embodiments of the present invention provide a method and device for adjusting page layout, an augmented reality device, and a storage medium, aiming to improve the intelligence of the page layout method of the display page of the augmented reality device.

[0004] In a first aspect, an embodiment of the present invention provides a method for adjusting page layout, the method comprising:

[0005] In response to the augmented reality device being in a worn state, obtaining eye movement information of the user corresponding to the augmented reality device;

[0006] If the eye movement information meets a preset condition, adjusting the layout mode of the visible area and the element layout area in the display page of the augmented reality device.

[0007] Optionally, the step of if the eye movement information meets a preset condition, adjusting the layout mode of the visible area and the element layout area in the display page of the augmented reality device includes:

[0008] If the eye movement information meets a preset condition, obtaining the current layout adjustment mode, and adjusting the layout mode of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information.

[0009] Optionally, the step of adjusting the layout mode of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information includes:

[0010] When the layout adjustment mode is the first adjustment mode, determining a first layout position corresponding to the visible area in the display page of the augmented reality device according to the eye movement information;

[0011] Based on the first layout position, determining a second layout position of the element layout area;

[0012] Adjust the layout of the visible area and the element layout area on the display page of the augmented reality device according to the first layout position and the second layout position.

[0013] Optionally, the adjusting the layout of the visible area and the element layout area on the display page of the augmented reality device according to the layout adjustment mode and the eye movement information includes:

[0014] When the layout adjustment mode is the second adjustment mode, determine a third layout position corresponding to the element layout area on the display page of the augmented reality device according to the eye movement information;

[0015] Determine a fourth layout position of the visible area based on the third layout position

[0016] Adjust the layout of the visible area and the element layout area on the display page of the augmented reality device according to the third layout position and the fourth layout position.

[0017] Optionally, the adjusting the layout of the visible area and the element layout area on the display page of the augmented reality device if the eye movement information meets a preset condition includes:

[0018] If the eye movement information meets a preset condition, obtain the current layout of the visible area and the element layout area;

[0019] Adjust the layout of the visible area and the element layout area on the display page according to the eye movement information and the current layout.

[0020] Optionally, the adjusting the layout of the visible area and the element layout area on the display page of the augmented reality device if the eye movement information meets a preset condition includes:

[0021] If the eye movement information meets a preset condition and the automatic adjustment function of the page layout of the augmented reality device is in an on state, adjust the layout of the visible area and the element layout area on the display page of the augmented reality device according to the eye movement information.

[0022] Optionally, the method further includes:

[0023] In response to detecting an enabling instruction for enabling the automatic adjustment function triggered by the user, control the automatic adjustment function to be in an on state based on the enabling instruction;

[0024] Or

[0025] In response to detecting that the current page of the augmented reality device is the home page, control the automatic adjustment function to be in an on state.

[0026] In a second aspect, an embodiment of the present invention further provides an apparatus for adjusting a page layout. The apparatus for adjusting a page layout is applied to an augmented reality device, and the apparatus for adjusting a page layout includes:

[0027] An eye movement information acquisition module, configured to acquire eye movement information of a user corresponding to the augmented reality device in response to the augmented reality device being in a worn state;

[0028] A layout mode adjustment module, configured to adjust a layout mode of a visible area and an element layout area in a display page of the augmented reality device if the eye movement information meets a preset condition.

[0029] In a third aspect, an embodiment of the present invention further provides an augmented reality device. The augmented reality device includes a processor, a memory, a computer program stored on the memory and executable by the processor, and a data bus for implementing connection communication between the processor and the memory. When the computer program is executed by the processor, it implements the page layout adjustment method as described in the first aspect.

[0030] In a fourth aspect, an embodiment of the present invention further provides a storage medium for computer-readable storage. The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the page layout adjustment method as described in the first aspect.

[0031] An embodiment of the present invention provides a method, an apparatus, an augmented reality device, and a storage medium for adjusting a page layout. The technical solution provided by the embodiment of the present invention realizes

[0032] In the embodiment of the present application, when the augmented reality device is in a worn state, eye movement information of the user corresponding to the augmented reality device is acquired; if the eye movement information meets a preset condition, the layout positions of the visible area and the element layout area in the display page of the augmented reality device are adjusted. It can be seen that in the embodiment of the present application, the display page of the augmented reality device is divided into a visible area and an element layout area, and when the eye movement information of the user meets a preset condition, the layout mode of the visible area and the element layout area can be automatically adjusted, thereby avoiding the fixation of the page layout mode of the display page of the augmented reality device, and eliminating the need for the user to manually trigger an adjustment instruction for adjusting the layout mode, thereby improving the adjustment efficiency of adjusting the display page layout mode and the intelligence of the display page layout mode of the augmented reality device. Description of the Drawings

[0033] To more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings in the following description are some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can also be obtained based on these drawings.

[0034] Figure 1 It is a schematic block diagram of the structure of an augmented reality device provided by an embodiment of the present invention;

[0035] Figure 2 It is a schematic flow chart of a method for adjusting page layout provided by an embodiment of the present invention;

[0036] Figure 3 It is a schematic diagram of a layout method of a visible area and an element layout area in an embodiment of the present invention;

[0037] Figure 4 It is a schematic diagram of another layout method of a visible area and an element layout area in an embodiment of the present invention;

[0038] Figure 5 It is a schematic diagram of another layout method of a visible area and an element layout area in an embodiment of the present invention;

[0039] Figure 6 It is a schematic diagram of another layout method of a visible area and an element layout area in an embodiment of the present invention;

[0040] Figure 7 It is a schematic block diagram of the structure of a device for adjusting page layout provided by an embodiment of the present invention. Detailed Embodiments

[0041] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts fall within the scope of protection of the present invention.

[0042] The flow charts shown in the accompanying drawings are only illustrative examples, and do not necessarily include all contents and operations / steps, nor do they necessarily need to be executed in the described order. For example, some operations / steps can also be decomposed, combined, or partially merged. Therefore, the actual execution order may be changed according to the actual situation.

[0043] It should be understood that the terms used in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include the plural forms.

[0044] Embodiments of the present invention provide a method and apparatus for adjusting page layout, an augmented reality device, and a storage medium. The technical solutions provided by the embodiments of the present invention.

[0045] In the embodiments of the present invention, the augmented reality device may be an AR (Augmented Reality) device, or other devices that can implement AR functions, etc.

[0046] The following will describe in detail some embodiments of the present invention with reference to the accompanying drawings. Without conflict, the following embodiments and the features in the embodiments may be combined with each other.

[0047] Figure 1 is a structural schematic block diagram of an augmented reality device provided by an embodiment of the present invention.

[0048] As Figure 1 shown, the augmented reality device 100 includes a processor 101 and a memory 102. The processor 101 and the memory 102 are connected through a bus 103, and the bus is, for example, an I2C (Inter-integrated Circuit) bus. The augmented reality device 100 may be a target augmented reality device, a first augmented reality device, and a second augmented reality device.

[0049] Specifically, the processor 101 is used to provide computing and control capabilities to support the operation of the entire augmented reality device 100. The processor 101 may be a central processing unit (CPU), and the processor 101 may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0050] Specifically, the memory 102 can be a Flash chip, a read-only memory (ROM), a magnetic disk, an optical disc, a USB flash drive, a mobile hard disk, etc.

[0051] Those skilled in the art can understand that Figure 1 the structure shown in is only a block diagram of some structures related to the solution of the embodiment of the present invention, and does not constitute a limitation on the augmented reality device to which the solution of the embodiment of the present invention is applied. The specific augmented reality device may include more or fewer components than those shown in the figure, or combine some components, or have a different component layout.

[0052] Among them, the processor 101 is used to run a computer program stored in the memory 102. This computer program can be set in the augmented reality device and, when executing the computer program, implement any one of the page layout adjustment methods provided by the embodiments of the present invention.

[0053] In one embodiment, the processor is used to run a computer program stored in the memory and, when executing the computer program, implement the following steps:

[0054] In response to the augmented reality device being in a worn state, obtain the eye movement information of the user corresponding to the augmented reality device;

[0055] If the eye movement information meets a preset condition, then adjust the layout manner of the visible area and the element layout area in the display page of the augmented reality device.

[0056] In one embodiment, the step of, if the eye movement information meets a preset condition, then adjusting the layout manner of the visible area and the element layout area in the display page of the augmented reality device includes:

[0057] If the eye movement information meets a preset condition, then obtain the current layout adjustment mode, and adjust the layout manner of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information.

[0058] In one embodiment, the step of adjusting the layout manner of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information includes:

[0059] When the layout adjustment mode is the first adjustment mode, determine the first layout position corresponding to the visible area in the display page of the augmented reality device according to the eye movement information;

[0060] Based on the first layout position, determine the second layout position of the element layout area;

[0061] Adjust the layout of the visible area and the element layout area in the display page of the augmented reality device according to the first layout position and the second layout position.

[0062] In one embodiment, the adjusting the layout of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information includes:

[0063] When the layout adjustment mode is the second adjustment mode, determine a third layout position corresponding to the element layout area in the display page of the augmented reality device according to the eye movement information;

[0064] Determine a fourth layout position of the visible area based on the third layout position

[0065] Adjust the layout of the visible area and the element layout area in the display page of the augmented reality device according to the third layout position and the fourth layout position.

[0066] In one embodiment, the adjusting the layout of the visible area and the element layout area in the display page of the augmented reality device if the eye movement information meets a preset condition includes:

[0067] If the eye movement information meets a preset condition, obtain the current layout of the visible area and the element layout area;

[0068] Adjust the layout of the visible area and the element layout area in the display page according to the eye movement information and the current layout.

[0069] In one embodiment, the adjusting the layout of the visible area and the element layout area in the display page of the augmented reality device if the eye movement information meets a preset condition includes:

[0070] If the eye movement information meets a preset condition and the automatic adjustment function of the page layout of the augmented reality device is in an on state, adjust the layout of the visible area and the element layout area in the display page of the augmented reality device according to the eye movement information.

[0071] In one embodiment, the method further includes:

[0072] In response to detecting an enabling instruction for enabling the automatic adjustment function triggered by the user, control the automatic adjustment function to be in an on state based on the enabling instruction;

[0073] Or

[0074] In response to detecting that the current page of the augmented reality device is the home page, control the automatic adjustment function to be in an on state.

[0075] It should be noted that those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific working process of the above-described augmented reality device can refer to the corresponding process in the embodiment of the method for adjusting the page layout described below, and will not be elaborated here.

[0076] Hereinafter, Figure 1 the augmented reality device in Figure 1 will be used to introduce in detail the method for adjusting the page layout provided by the embodiments of the present invention. It should be noted that

[0077] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a method for adjusting the page layout provided by an embodiment of the present invention.

[0078] As Figure 2 shown, the method for adjusting the page layout is applied to an augmented reality device, and the method for adjusting the page layout includes steps S101 to S102.

[0079] Step S101: In response to the augmented reality device being in a worn state, obtain the eye movement information of the user corresponding to the augmented reality device;

[0080] When the augmented reality device is in a worn state, the augmented reality device can obtain the eye movement information of the user wearing the augmented reality device through eye movement tracking. Eye movement tracking is the process of measuring the fixation point (where a person is looking) or the movement of the eyes relative to the head. Among them, the eye movement information can be the direction of rotation of the user's eyeballs and / or the angle of rotation of the eyeballs. In the augmented reality device, an eye movement recognition sensor can be set, and the eye movement information of the user can be obtained through this eye movement recognition sensor. A sensor for detecting whether it is in a worn state can be set in the augmented reality device. For example, when the augmented reality device is smart glasses, this sensor can be set at a position corresponding to the user's eyebrows in the frame, and this sensor can be a proximity light sensor or other distance sensors.

[0081] Step S102: If the eye movement information meets a preset condition, adjust the layout mode of the visible area and the element layout area in the display page of the augmented reality device.

[0082] After the augmented reality device obtains the eye movement information, the augmented reality device determines whether the eye movement information meets a preset condition. When the eye movement information is the direction of eye ball rotation, the augmented reality device determines whether the direction of the user's eye ball rotation is a preset direction. If the direction of the user's eye ball rotation is the preset direction, the augmented reality device determines that the eye movement information meets the preset condition; if the direction of the user's eye ball rotation is not the preset direction, the augmented reality device determines that the user's eye movement information does not meet the preset condition. Among them, the preset direction can be preset, such as the preset direction can be one or more of the directions of the eye ball rotating to the left, the eye ball rotating to the right, the eye ball rotating upward, etc.

[0083] When the eye movement information is the eye ball rotation angle and the eye ball rotation direction, the augmented reality device determines whether the direction of the user's eye ball rotation is the preset direction, and determines whether the eye ball rotation angle in this preset direction is greater than or equal to the preset angle. Among them, the preset angles corresponding to different eye ball rotation directions can be the same or different. If the direction of the user's eye ball rotation is the preset direction and the eye ball rotation angle of the user in this preset direction is greater than or equal to the preset angle, the augmented reality device can determine that the user's eye movement information meets the preset condition; if the direction of the user's eye ball rotation is the preset direction, but the eye ball rotation angle of the user in this preset direction is less than the preset angle, the augmented reality device can determine that the user's eye movement information does not meet the preset condition; if the direction of the user's eye ball rotation is not the preset direction, but the eye ball rotation angle of the user in this rotation direction is greater than or equal to the preset angle, the augmented reality device determines that the user's eye movement information does not meet the preset condition; if the direction of the user's eye ball rotation is not the preset direction and the eye ball rotation angle of the user in this rotation direction is less than the preset angle, the augmented reality device determines that the user's eye movement information does not meet the preset condition.

[0084] When the augmented reality device determines that the eye movement information of the user meets a preset condition, the augmented reality device adjusts the layout modes of the visible area and the element layout area in its display page. In this embodiment, the FOV (Field of View) area of the augmented reality device is divided into two or more areas. One area is the visible area where no layout of imaging elements is made, that is, relevant elements are not displayed, and the user views the on-site scene through this visible area; other areas are element layout areas for displaying different visual elements. It can be understood that when the user wears the augmented reality device, the user can view the content of the real world through the visible area, and the element layout area is the area where the augmented reality device displays information. For example, the augmented reality device can display the received information, the captured pictures, and the icons of various application programs in the element layout area, such as displaying weather icons, WeChat icons, etc. The information, pictures, icons, etc. displayed in the element layout area are visual elements. The FOV area of the augmented reality device is the display page, and in this display page, there may be a visible area and at least one element layout area.

[0085] Exemplarily, when it is determined that the eye movement information of the user meets a preset condition, the augmented reality device adjusts the layout modes of the visible area and the element layout area to a set layout mode, and the set layout mode can be pre-set and is the layout mode corresponding to the visible area and the element layout area when the eye movement information meets the preset condition.

[0086] In this embodiment, when the augmented reality device is in a worn state, the eye movement information of the user corresponding to the augmented reality device is obtained; if the eye movement information meets the preset condition, the layout positions of the visible area and the element layout area in the display page of the augmented reality device are adjusted. It can be seen that in the embodiment of the present application, the display page of the augmented reality device is divided into a visible area and an element layout area, and when the eye movement information of the user meets the preset condition, the layout modes of the visible area and the element layout area can be automatically adjusted, thereby avoiding the fixation of the page layout mode of the augmented reality device display page, and there is no need for the user to manually trigger an adjustment instruction for adjusting the layout mode, thereby improving the adjustment efficiency of adjusting the display page layout mode and improving the intelligence of the display page layout mode of the augmented reality device.

[0087] In one embodiment, step S102 includes:

[0088] If the eye movement information meets the preset condition, obtain the current layout modes of the visible area and the element layout area;

[0089] According to the eye movement information and the current layout modes, adjust the layout modes of the visible area and the element layout area in the display page.

[0090] In one embodiment, if the augmented reality device determines that the eye movement information meets a preset condition, the augmented reality device acquires the current layout modes of the visible area and the element layout area, determines the target layout modes corresponding to the visible area and the element layout area according to the eye movement information and the current layout modes, and adjusts the layout modes of the visible area and the element layout area in the display page according to the target layout modes. In the embodiments of the present disclosure, the corresponding relationships between different layout modes and eye movement information are pre-stored in the augmented reality device. In one embodiment, the corresponding relationship may be that when the current layout mode of the visible area and the element layout area is A, when the eye movement information is that the eyeball turns left, the corresponding target layout mode is B; when the eye movement information is that the eyeball turns right, the corresponding target layout mode is C. When the current layout mode of the visible area and the element layout area is D, when the eye movement information is that the eyeball turns right, the corresponding target layout mode is A; when the eye movement information is that the eyeball turns up, the corresponding target layout mode is E.

[0091] In another embodiment, the corresponding relationship may be: when the current layout mode of the visible area and the element layout area is A, when the eye movement information is that the eyeball turns left, and the rotation angle of the left turn is greater than or equal to a and less than b, the corresponding target layout mode is B1; when the current layout mode of the visible area and the element layout area is A, when the eye movement information is that the eyeball turns left, and the rotation angle of the left turn is greater than or equal to b, the corresponding target layout mode is B2.

[0092] It can be understood that the corresponding relationship between the layout modes of the visible area and the element layout area and the eye movement information can be set according to specific needs, and this embodiment does not make specific limitations on this. The corresponding relationship can be pre-stored in the augmented reality device. Under different layout modes, the positional relationships between the visible area and the element layout area are different.

[0093] Specifically, reference may be made to Figures 3 - 6 , Figures 3 - 6 as examples of different layout modes of the visible area and the element layout area. In Figures 3 - 6 ,the element layout area is the element layout area in the embodiments of the present application, and the visible area is the visible area in the embodiments of the present application. In Figure 5 and Figure 6 ,the small squares in the element area represent the visible elements to be displayed, such as the icons of certain application programs. It can be understood that Figures 3 - 6 are only examples of several different layout modes of the visible area and the element layout area in the display page of the augmented reality device. In the embodiments of the present application, other examples may also be adopted for the layout modes of the visible area and the element layout area.

[0094] In the embodiments of the present disclosure, the set layout method can blockify the area of the visible region, that is, the area of the visible region is not interrupted by the visible elements in the element layout region, so that the area of the visible region can have a complete region. For example, there are no visible elements in the element layout region in the visible region, thereby reducing the occlusion of the user's field of view by the layout method in the embodiments of the present application. Further, the embodiments of the present disclosure can determine the layout method for adjusting the visible region and the element layout region according to the user's eye movement information and the current layout method, so that the adjusted layout method better meets the user's needs and improves the accuracy of the layout method adjustment.

[0095] In one embodiment, step S102 includes: sub-step a.

[0096] Sub-step a, if the eye movement information meets the preset condition, obtain the current layout adjustment mode, and adjust the layout method of the visible region and the element layout region in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information.

[0097] In one embodiment, if it is determined that the eye movement information meets the preset condition, the augmented reality device obtains the current layout adjustment mode, and adjusts the layout method of the visible region and the element layout region in its display page according to the layout adjustment mode and the eye movement information. In the embodiments of the present disclosure, there are two layout adjustment modes, and the user can set the current layout adjustment mode as needed. For example, a mode identifier corresponding to the layout adjustment mode can be set, and the current layout adjustment mode can be determined through this mode identifier. Exemplarily, when the mode identifier is "11", it indicates that the current layout adjustment mode is the first adjustment mode; when the mode identifier is "00", it indicates that the current layout adjustment mode is the second adjustment mode. Among them, the first adjustment mode is to first determine the layout position of the visible region according to the eye movement information, and then determine the layout position of the element layout region according to the layout position of the visible region. It can be understood that in the first adjustment mode, the user pays more attention to the layout position of the visible region, that is, at this time, the user pays more attention to the content that can be seen in the visible region; on the contrary, the second adjustment mode is to first determine the layout position of the element layout region according to the eye movement information, and then determine the layout position of the visible region according to the layout position of the element layout region. It can be understood that in the second adjustment mode, the user pays more attention to the layout position of the element layout region, that is, at this time, the user pays more attention to the information displayed in the element layout region.

[0098] In one embodiment, it can be set that in the first adjustment mode, the area of the visible region is larger than the area of the element layout region; in the second adjustment mode, the area of the element layout region is larger than the area of the visible region.

[0099] In one embodiment, the method of adjusting the layout of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information in sub-step a includes:

[0100] When the layout adjustment mode is the first adjustment mode, determine a first layout position corresponding to the visible area in the display page of the augmented reality device according to the eye movement information;

[0101] Determine a second layout position of the element layout area based on the first layout position;

[0102] Adjust the layout of the visible area and the element layout area in the display page of the augmented reality device according to the first layout position and the second layout position.

[0103] When the augmented reality device determines that the current layout adjustment mode is the first adjustment mode, the augmented reality device first determines the layout position corresponding to the visible area in the display page according to the eye movement information. For the convenience of distinction, the layout area corresponding to the visible area determined according to the eye movement information is denoted as the first layout position. After the augmented reality device determines the first layout position, the augmented reality device determines the second layout area of the element layout area according to the first layout position. It can be understood that in the display page, except for the position where the visible area is located, the remaining position is the element layout area. Therefore, after determining the layout position corresponding to the visible area, the layout position of the element layout area can be determined. When the augmented reality device determines the first layout position and the second layout position, the augmented reality device adjusts the visible area from its current layout position to the first layout position, and then adjusts the element layout area from its current layout position to the second layout position, so as to adjust the layout of the visible area and the element layout area in the display page according to the first layout position and the second layout position. Among them, the current layout position of the visible area is the layout position where the visible area is located before adjustment, and the current layout position of the element layout area is the layout position where the element layout area is located before adjustment.

[0104] It can be understood that in the first adjustment mode, the element layout area avoids the direction of eye movement, that is, the visible area moves with the eye movement information. For example, in the first adjustment mode, if the eye movement information is that the eyeball rotates to the right, the head-mounted device controls the visible area to move to the right from its current layout position to adjust the layout position of the visible area. At this time, the first layout position is on the right side of its current layout position; if the eye movement information is that the eyeball rotates to the left, the head-mounted device controls the visible area to move to the left from its current layout position, that is, the first layout position is on the left side of its current layout position. The moving distance of the visible area can be determined according to the eye rotation angle. The larger the eye rotation angle, the larger the moving distance of the visible area. Compared with the second adjustment mode, in the first adjustment mode, it is more beneficial for the user to view the real environment to ensure that the user can view the real environment without obstruction.

[0105] In one embodiment, the method of adjusting the layout of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information in sub-step a includes:

[0106] When the layout adjustment mode is the second adjustment mode, determine a third layout position corresponding to the element layout area in the display page of the augmented reality device according to the eye movement information;

[0107] Determine a fourth layout position of the visible area based on the third layout position

[0108] Adjust the layout of the visible area and the element layout area in the display page of the augmented reality device according to the third layout position and the fourth layout position.

[0109] When the augmented reality device determines that the current layout adjustment mode is the second adjustment mode, the augmented reality device first determines the layout position corresponding to the element layout area in the display page according to the eye movement information. For the sake of distinction, the layout area corresponding to the element layout area determined according to the eye movement information is denoted as the third layout position. After the augmented reality device determines the third layout position, the augmented reality device determines the fourth layout area of the visible area according to the third layout position. After the augmented reality device determines the third layout position and the fourth layout position, the augmented reality device adjusts the element layout area from its current layout position to the third layout position, and then adjusts the visible area from its current layout position to the fourth layout position, so as to adjust the layout of the visible area and the element layout area in the display page according to the third layout position and the fourth layout position.

[0110] It can be understood that in the second adjustment mode, the element layout area moves with the eye movement information. For example, in the second adjustment mode, if the eye movement information is that the eyeball turns to the right, the head-mounted device controls the element layout area to move to the right from the current layout position, that is, the third layout position is on the right side of the current element layout position; if the eye movement information is that the eyeball turns to the left, the head-mounted device controls the element layout area to move to the left from the current layout position, that is, the third layout position is on the left side of its current layout position. The moving distance of the element layout area can be determined according to the eyeball rotation angle. The larger the eyeball rotation angle, the larger the moving distance of the element layout area. Compared with the first adjustment mode, in the second adjustment mode, it is more beneficial for the user to view the elements displayed on the display interface.

[0111] Embodiments of the present disclosure provide two layout adjustment modes. One layout adjustment mode focuses on the adjustment of the visible area, and the other layout adjustment mode focuses on the adjustment of the element layout area. Thus, users can adopt different layout adjustment modes to adjust the layout of the visible area and the element layout area in different scenarios, making the adjusted visible area and element layout area more in line with user needs, and further improving the intelligence of the layout of the visible area and the element layout area of the display page.

[0112] In one embodiment, step S102 further includes:

[0113] If the eye movement information meets a preset condition and the automatic adjustment function of the augmented reality device page layout is in an enabled state, the layout of the visible area and the element layout area in the augmented reality device display page is adjusted according to the eye movement information.

[0114] In one embodiment, when the augmented reality device determines that the eye movement information meets a preset condition, the augmented reality device determines whether the automatic adjustment function of its page layout is in an enabled state. If the augmented reality device determines that the automatic adjustment function of its page layout is in an enabled state, the augmented reality device adjusts the layout of the visible area and the element layout area in its display page according to its eye movement information. If the augmented reality device determines that the automatic adjustment function of its page layout is in a disabled state, the augmented reality device prohibits adjusting the layout of the visible area and the element layout area in the display page according to the eye movement information, that is, the augmented reality device does not respond at this time.

[0115] In another embodiment, the method further includes:

[0116] In response to detecting an enabling instruction for enabling the automatic adjustment function triggered by the user, the automatic adjustment function is controlled to be in an enabled state based on the enabling instruction;

[0117] Or

[0118] In response to detecting that the current page of the augmented reality device is the home page, the automatic adjustment function is controlled to be in an enabled state.

[0119] In another embodiment, a setting button corresponding to the page layout automatic adjustment function is provided in the augmented reality device. The setting button can be a physical button provided in the housing of the augmented reality device or a virtual button provided in the system of the augmented reality device. When the user triggers the setting button, the augmented reality device detects an enabling instruction for enabling the automatic adjustment function and controls the automatic adjustment function to be in an enabled state based on the enabling instruction, so that the augmented reality device can adjust the layout of the visible area and the element layout area when the eye movement information meets a preset condition.

[0120] In another embodiment, when the augmented reality device detects that the current page it is on is the home page, it can also automatically turn on the automatic adjustment function of its page layout, so that the automatic adjustment function of the page layout is in an on state. Herein, the home page is the desktop of the augmented reality device. For example, the home page can be the page displayed after the augmented reality device switches from the shutdown state to the startup state.

[0121] In the embodiments of the present disclosure, only when the automatic adjustment function of the page layout is in an on state, will the layout mode of the visible area and the element layout area in the display page be adjusted when the eye movement information meets the preset conditions, avoiding adjusting the layout mode at any time when the eye movement information meets the preset conditions, thus causing trouble to the user when using the augmented reality device.

[0122] Please refer to Figure 7 , Figure 7 which is a schematic block diagram of the structure of an adjustment device for page layout provided by an embodiment of the present invention.

[0123] As Figure 7 shown, the adjustment device 200 for page layout is applied to an augmented reality device. The adjustment device 200 for page layout includes, wherein:

[0124] An eye movement information acquisition module 210, configured to acquire the eye movement information of the user corresponding to the augmented reality device in response to the augmented reality device being in a worn state;

[0125] A layout mode adjustment module 220, configured to adjust the layout mode of the visible area and the element layout area in the display page of the augmented reality device if the eye movement information meets the preset conditions.

[0126] In some embodiments, the layout mode adjustment module 220 is further configured to, if the eye movement information meets the preset conditions, acquire the current layout adjustment mode, and adjust the layout mode of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information.

[0127] In some embodiments, the layout mode adjustment module 220 includes:

[0128] A first layout position determination unit, configured to, when the layout adjustment mode is the first adjustment mode, determine a first layout position corresponding to the visible area in the display page of the augmented reality device according to the eye movement information; and determine a second layout position of the element layout area based on the first layout position;

[0129] A first layout mode adjustment unit, configured to adjust the layout mode of the visible area and the element layout area in the display page of the augmented reality device according to the first layout position and the second layout position.

[0130] In some embodiments, the layout adjustment module 220 further includes:

[0131] A second layout position determination unit, configured to, when the layout adjustment mode is the second adjustment mode, determine a third layout position corresponding to the element layout area in the display page of the augmented reality device according to the eye movement information; and determine a fourth layout position of the visible area based on the third layout position;

[0132] A second layout adjustment unit, configured to adjust the layout modes of the visible area and the element layout area in the display page of the augmented reality device according to the first layout position and the second layout position.

[0133] In some embodiments, the layout adjustment module 220 further includes:

[0134] A layout mode acquisition unit, configured to, if the eye movement information meets a preset condition, acquire the current layout modes of the visible area and the element layout area;

[0135] A third layout adjustment unit, configured to adjust the layout modes of the visible area and the element layout area in the display page according to the eye movement information and the current layout modes.

[0136] In some embodiments, the layout adjustment module 220 is further configured to, if the eye movement information meets a preset condition and the automatic adjustment function of the page layout of the augmented reality device is in an enabled state, adjust the layout modes of the visible area and the element layout area in the display page of the augmented reality device according to the eye movement information.

[0137] In some embodiments, the page layout adjustment device further includes:

[0138] A control module, configured to, in response to detecting an enabling instruction for enabling the automatic adjustment function triggered by a user, control the automatic adjustment function to be in an enabled state based on the enabling instruction;

[0139] Or

[0140] configured to, in response to detecting that the current page of the augmented reality device is the home page, control the automatic adjustment function to be in an enabled state.

[0141] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described page layout adjustment device can refer to the corresponding process in the foregoing embodiment of the page layout adjustment method, and will not be described herein again.

[0142] An embodiment of the present invention also provides a storage medium for computer-readable storage. The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement any page layout adjustment method provided in the specification of the embodiments of the present invention.

[0143] Among them, the storage medium may be an internal storage unit of the augmented reality device described in the foregoing embodiment, such as the hard disk or memory of the augmented reality device. The storage medium may also be an external storage device of the augmented reality device, such as a plug-in hard disk equipped on the augmented reality device, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc.

[0144] Those of ordinary skill in the art can understand that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, and appropriate combinations thereof. In the hardware embodiment, the division of the functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be executed by several physical components in cooperation. Some physical components or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or may be implemented as hardware, or may be implemented as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassette, tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, a communication medium typically includes computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information delivery medium.

[0145] It should be understood that the term "and / or" used in the specification and appended claims of the present invention refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations. It should be noted that in this text, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or system comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or system. Without further limitation, an element defined by the statement "comprising one..." does not exclude the existence of additional identical elements in the process, method, article or system comprising that element.

[0146] The serial numbers of the above embodiments of the present invention are only for description and do not represent the superiority or inferiority of the embodiments. The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention can easily think of various equivalent modifications or substitutions, and these modifications or substitutions should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A method for adjusting page layout, characterized in that, the method is applied to an augmented reality device, and the method includes: In response to the augmented reality device being in a worn state, obtaining eye movement information of the user corresponding to the augmented reality device; If the eye movement information meets a preset condition, adjust the layout modes of the visible area and the element layout area in the display page of the augmented reality device.

2. The method for adjusting page layout according to claim 1, characterized in that, the step of if the eye movement information meets a preset condition, adjusting the layout modes of the visible area and the element layout area in the display page of the augmented reality device includes: If the eye movement information meets a preset condition, obtain the current layout adjustment mode, and adjust the layout modes of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information.

3. The method for adjusting page layout according to claim 2, characterized in that, the step of adjusting the layout modes of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information includes: When the layout adjustment mode is the first adjustment mode, determine a first layout position corresponding to the visible area in the display page of the augmented reality device according to the eye movement information; Determine a second layout position of the element layout area based on the first layout position; Adjust the layout modes of the visible area and the element layout area in the display page of the augmented reality device according to the first layout position and the second layout position.

4. The method for adjusting page layout according to claim 2, characterized in that, the step of adjusting the layout modes of the visible area and the element layout area in the display page of the augmented reality device according to the layout adjustment mode and the eye movement information includes: When the layout adjustment mode is the second adjustment mode, determine a third layout position corresponding to the element layout area in the display page of the augmented reality device according to the eye movement information; Determine a fourth layout position of the visible area based on the third layout position; Adjust the layout modes of the visible area and the element layout area in the display page of the augmented reality device according to the third layout position and the fourth layout position.

5. The method for adjusting page layout according to claim 1, characterized in that, the step of if the eye movement information meets a preset condition, adjusting the layout modes of the visible area and the element layout area in the display page of the augmented reality device includes: If the eye movement information meets a preset condition, obtain the current layout modes of the visible area and the element layout area; Adjust the layout modes of the visible area and the element layout area in the display page according to the eye movement information and the current layout modes.

6. The method for adjusting page layout according to claim 1, characterized in that, the step of if the eye movement information meets a preset condition, adjusting the layout modes of the visible area and the element layout area in the display page of the augmented reality device includes: If the eye movement information meets a preset condition and the automatic adjustment function of the page layout of the augmented reality device is in an enabled state, the layout modes of the visible area and the element layout area in the display page of the augmented reality device are adjusted according to the eye movement information.

7. The method for adjusting a page layout according to claim 6, wherein, the method further includes: responding to an enabling instruction for enabling the automatic adjustment function triggered by a user being detected, and controlling the automatic adjustment function to be in an enabled state based on the enabling instruction; or responding to detecting that the current page where the augmented reality device is located is the home page, and controlling the automatic adjustment function to be in an enabled state.

8. An apparatus for adjusting a page layout, wherein, the apparatus for adjusting a page layout is applied to an augmented reality device, and the apparatus for adjusting a page layout includes: an eye movement information acquisition module, configured to acquire eye movement information of a user corresponding to the augmented reality device in response to the augmented reality device being in a worn state; a layout mode adjustment module, configured to adjust the layout modes of the visible area and the element layout area in the display page of the augmented reality device if the eye movement information meets a preset condition.

9. An augmented reality device, wherein, the augmented reality device includes a processor, a memory, a computer program stored on the memory and executable by the processor, and a data bus for realizing connection communication between the processor and the memory, wherein when the computer program is executed by the processor, the method for adjusting a page layout according to any one of claims 1 to 7 is realized.

10. A storage medium for computer-readable storage, wherein, the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to realize the method for adjusting a page layout according to any one of claims 1 to 7.

Images