A content synchronous display method, device, equipment and storage medium

Abstract

This invention discloses a method, apparatus, device, and storage medium for synchronized content display. The method includes displaying a first text page; determining a second text page associated with the first text page, and determining the layout index information corresponding to the first and second text pages; sending the page text content of the first and second text pages, along with the layout index information, to a wearable AR device, so that the wearable AR device displays a third text page based on the page text content and layout index information; wherein the text content displayed in the first line of the first text page is synchronously displayed in the first line of the third text page. Using this method, for the same text content, the content at the beginning of the text page displayed on both smart devices and wearable AR devices is better ensured to remain consistent, thereby improving the accuracy of data synchronization between smart devices and wearable AR devices and enhancing the synchronized user experience.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a method, apparatus, device, and storage medium for synchronous content display. Background Technology

[0002] Augmented Reality (AR) glasses are wearable devices that blend digital information with the physical world within a user's field of vision. Specifically, they can overlay images, text, or other information onto the user's real-world environment. Currently, once AR glasses are connected to smart devices, the text displayed on the smart device can also be displayed on the AR glasses.

[0003] However, due to inherent limitations, AR glasses differ from smart devices in their layout and operation methods for the same content. The content displayed on AR glasses often follows the pre-set layout. This leads to inconsistencies between the content displayed on AR glasses and smart devices. For example, a page displayed on a smart device might appear as half a page or a page and a half on AR glasses, or a line displayed on a smart device might appear as half a line or a line and a half on AR glasses. In such cases, inconsistencies arise when page-turning is controlled via either the smart device or the AR glasses. Summary of the Invention

[0004] This invention provides a method, apparatus, device, and storage medium for synchronized content display to solve the problem of inconsistent text content displayed on smart devices and AR glasses for the same text content.

[0005] In a first aspect, embodiments of the present invention provide a content synchronization display method applied to a smart device, wherein the smart device and a wearable AR device establish a connection via short-range wireless communication, and the content synchronization display method includes:

[0006] Display the first text page;

[0007] Determine the second text page associated with the first text page, and determine the layout index information corresponding to the first text page and the second text page;

[0008] The page text content in the first text page and the second text page, as well as the layout index information, are sent to the wearable AR device so that the wearable AR device can display the third text page through the layout index information;

[0009] The text content displayed in the first line of the first text page is simultaneously displayed in the first line of the third text page.

[0010] Secondly, embodiments of the present invention provide a content synchronization display method applied to a wearable AR device, wherein the wearable AR device and a smart device establish a connection via short-range wireless communication, and the content synchronization display method includes:

[0011] Receive page text content and layout index information sent by the smart device;

[0012] A third text page is displayed, and the AR page text content and layout presented in the third text page are determined according to the page text content and the layout index information. The first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.

[0013] Thirdly, embodiments of the present invention provide a content synchronization display device configured in a smart device, wherein the smart device and the wearable AR device establish a connection via short-range wireless communication, and the content synchronization display device includes:

[0014] The first display module is used to display the first text page;

[0015] The information determination module is used to determine the second text page associated with the first text page, and to determine the layout index information corresponding to the first text page and the second text page;

[0016] The information sending module is used to send the page text content in the first text page and the second text page, as well as the layout index information, to the wearable AR device, so that the wearable AR device can display the third text page through the layout index information;

[0017] The text content displayed in the first line of the first text page is simultaneously displayed in the first line of the third text page.

[0018] Fourthly, embodiments of the present invention provide a content synchronization display device configured in a wearable AR device, wherein the wearable AR device and a smart device establish a connection via short-range wireless communication, and the content synchronization display device includes:

[0019] The information receiving module is used to receive the page text content and layout index information sent by the smart device;

[0020] The fourth display module is used to display the third text page. The AR page text content and layout presented in the third text page are determined according to the page text content and the layout index information. The first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.

[0021] Fifthly, embodiments of the present invention provide an intelligent device, the intelligent device comprising:

[0022] At least one processor; and

[0023] A memory communicatively connected to the at least one processor; wherein,

[0024] The memory stores a computer program that can be executed by the at least one processor, which is then executed by the at least one processor to enable the at least one processor to perform the content synchronization display method described in the first aspect embodiment of the present invention.

[0025] Sixthly, embodiments of the present invention provide a wearable device, the wearable enhancement implementation device comprising:

[0026] Wearable device; and

[0027] At least one controller mounted on the wearable body; and

[0028] The memory is communicatively connected to the at least one controller, wherein,

[0029] The memory stores a computer program that can be executed by the at least one controller, which enables the at least one controller to perform the content synchronization display method described in the second aspect embodiment of the present invention.

[0030] In a seventh aspect, embodiments of the present invention provide a computer-readable storage medium storing computer instructions, the computer instructions being used to cause a processor or controller to execute and implement the content synchronization display method described in any embodiment of the present invention.

[0031] This invention provides a method, apparatus, device, and storage medium for synchronized content display. The method first displays a first text page; then determines a second text page associated with the first text page and determines the layout index information corresponding to the first and second text pages; next, it sends the page text content of the first and second text pages, along with the layout index information, to a wearable AR device, enabling the wearable AR device to display a third text page using the layout index information. The first line of text displayed in the first text page is synchronously displayed on the first line of the third text page. In this embodiment, the layout index information sent by the smart device to the wearable AR device is equivalent to layout information formed based on the smart terminal. The wearable AR device can implement text content layout based on this layout index information. This layout method ensures that the first line of the formed text page can present the content of the first line of the text page on the smart device. When the same text content is displayed on two devices, it better achieves a consistent display effect for the first text content on the displayed text page. The technical solution in this embodiment optimizes the data synchronization mechanism between smart devices and wearable AR devices, improving the synchronized user experience.

[0032] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0033] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0034] Figure 1a A flowchart of the content synchronization display method provided in the embodiments of the present invention;

[0035] Figure 1b This is an example image showing the text page displayed on a smart terminal in the content synchronization display method provided in this embodiment of the invention.

[0036] Figure 1c This is a diagram illustrating the effect of displaying text content between the first text page and the third text page in the content synchronization display method provided in this embodiment of the invention.

[0037] Figure 2This is an example of the effect of displaying the first line of text on a text page in a synchronized display method provided in this embodiment of the invention, after the smart device and the wearable AR device slide synchronously.

[0038] Figure 3 A flowchart of the content synchronization display method provided in the embodiments of the present invention;

[0039] Figure 4 This is a schematic diagram of the structure of a content synchronization display device provided in an embodiment of the present invention;

[0040] Figure 5 This is a schematic diagram of the structure of a content synchronization display device provided in an embodiment of the present invention;

[0041] Figure 6 This is a schematic diagram of the structure of a smart device provided in an embodiment of the present invention;

[0042] Figure 7 This is a schematic diagram of the structure of a wearable augmented reality device provided in an embodiment of the present invention. Detailed Implementation

[0043] Embodiments of the present invention will now be described in more detail with reference to the accompanying drawings. While some embodiments of the invention are shown in the drawings, it should be understood that the invention can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the invention. It should be understood that the accompanying drawings and embodiments are for illustrative purposes only and are not intended to limit the scope of protection of the invention.

[0044] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.

[0045] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0046] It should be noted that the concepts of "first" and "second" mentioned in this invention are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0047] It should be noted that the terms "a" and "a plurality of" used in this invention are illustrative rather than restrictive. Those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0048] The names of the messages or information exchanged between the multiple devices in the embodiments of the present invention are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0049] It is understood that before using the technical solutions disclosed in the various embodiments of the present invention, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in the present invention and their authorization should be obtained in accordance with relevant laws and regulations through appropriate means.

[0050] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application program, server, or storage medium executing the operation of this invention, based on the prompt message.

[0051] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0052] It is understood that the above notification and user authorization process is merely illustrative and does not constitute a limitation on the implementation of the present invention. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present invention.

[0053] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0054] It should be noted that, due to limitations inherent in the device itself, AR glasses differ from smart devices in their layout and operation methods for the same content. The content displayed on AR glasses often adopts the pre-set layout. This results in inconsistencies between the content displayed on AR glasses and smart devices.

[0055] Based on this, embodiments of the present invention provide a method for synchronized content display. Figure 1aThis is a flowchart of a content synchronization display method provided in an embodiment of the present invention. The embodiments of the present invention are applicable to the situation of synchronizing text content display on a smart device and a wearable AR device. The method can be executed by a content synchronization display device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by a smart device, preferably a mobile terminal, desktop computer, laptop computer, or server, etc. The smart device and the wearable AR device have established a connection in advance through short-range wireless communication, such as Bluetooth.

[0056] like Figure 1a As shown, the content synchronization display method provided in this embodiment of the invention may specifically include:

[0057] S101. Display the first text page.

[0058] The first text page can be considered as the page currently displayed on the smart device screen. This page can be a text-based scenario page, such as an e-book page, a news page, or a report page. The first text page may contain chapter information, paragraph information, and other text information. For example, a page of an e-book being displayed on a mobile device may show chapter titles, multiple paragraphs, and the main text.

[0059] In this embodiment, the first text page is displayed on the screen of the smart device by means of touch click or swipe control, button control, or by receiving control commands sent from other devices.

[0060] S102. Determine the second text page associated with the first text page, and determine the layout index information corresponding to the first text page and the second text page.

[0061] The second text page can be understood as a page logically related to the first text page, containing preceding or following text content related to the text content displayed on the first text page. For example, the second text page could be the page preceding or following the first text page in continuous text reading. The layout index information can be considered a collection of information that organizes and records the position and characteristics of various parts of the text content, and may include chapter information, character index information, paragraph information, formatting information, and line identifier information, etc., used to achieve rapid search and location of text content.

[0062] For example, Figure 1b This is an example illustration of a text page displayed on a smart terminal in the content synchronization display method provided in this embodiment of the invention. Figure 1bAs shown, three text pages are specifically displayed. The middle text page 12 can be considered as the first text page currently displayed on the smartphone 1, while the previous text page 11 and the next text page 13 associated with the middle text page 12 can be considered as the second text page of the first text page (middle text page 12).

[0063] In this embodiment, based on the displayed first text page, the previous and next text pages logically related to the first text page are determined as the second text page. This embodiment can then analyze the structure of the first and second text pages, identifying elements such as chapters, titles, and paragraphs. Based on the layout structure on the smart device derived from the above analysis, layout index information is determined. This layout index information may include character indexes, paragraph information, and line identifiers. This layout index information can be used to determine the position of each character; it can also be used to determine the position of paragraph divisions and distinguish them from the next paragraph; and it can also be used to determine the position of each line within the text page, etc.

[0064] In this embodiment, when determining the character index, the content of a chapter or the content under a title can be used as a unit. The first character containing the font in each chapter or title is the first index, and the indexing begins. Each character containing the font constitutes one index. After determining the character index as described above, the index of each character can be known. The index of the first character of each line can be considered as the line identifier, thus determining the line identifier of each line. When determining paragraph information, a paragraph mark is represented by one character. The paragraph mark information can be determined based on its position within a specific chapter or title (which line and character), or it can be determined based on the line identifier of the line containing the paragraph mark.

[0065] S103. Send the page text content and layout index information of the first text page and the second text page to the wearable AR device so that the wearable AR device can display the third text page through the page text content and layout index information, wherein the text content displayed in the first line of the first text page is simultaneously displayed in the first line of the third text page.

[0066] The text content on the page can be considered as all text information already displayed or to be displayed on the first and second text pages, possibly including titles, body text, headers, and footers. The third text page can be understood as the current text page displayed by the wearable AR device. The text content displayed on the third text page corresponds to the text content on the first text page, and the first line of the third text page synchronously displays the text content displayed in the first text page. The size of the third text page can be the same as or different from the size of the first text page.

[0067] In this embodiment, the smart device sends all the text information displayed on the first and second text pages, as well as the determined layout index information, to the pre-connected wearable AR device via a short-range wireless communication method, such as Bluetooth.

[0068] As described above, the wearable AR device locates the text content in the first and second text pages by parsing the layout index information determined by the smart device. Next, based on the layout index information, the text content displayed in the first line of the first text page is synchronously displayed in the first line of the third text page. Then, the display range of the text content in the third text page is determined, which can be determined according to the size of the wearable AR device or the user's field of view.

[0069] In this embodiment, the content display range of the third text page extends from the first line of content in the first text page to the text content in both the first and second text pages corresponding to the maximum range of layout index information that the third text page can display. In other words, if the content of the second text page is also within the display range of the third text page, the third text page will simultaneously display the corresponding text content from both the first and second text pages.

[0070] For example, Figure 1c This diagram illustrates the effect of displaying text content on a first text page and a third text page in the content synchronization display method provided in this embodiment of the invention. Figure 1c As shown, two text pages are specifically displayed: a first text page 12 and a third text page 14. Different colors are used to represent different lines of text content displayed on the first and third text pages. Specifically, the first line of text content 141 in the third text page 14 is equivalent to the first line of text content 121 in the first text page, and the second line of text content 142 in the third text page 14 is equivalent to the third line of text content 122 in the first text page 12. Furthermore, the first line of text content 121 displayed in the first text page 12 is simultaneously displayed on the first line of the third text page 14.

[0071] In this embodiment of the invention, the layout index information sent by the smart device to the wearable AR device is equivalent to layout information formed based on the smart terminal. The wearable AR device can then layout the text content based on this layout index information. This layout method ensures that the first line of the resulting text page reflects the content of the first line of the text page on the smart device. When the same text content is displayed on both devices, it better achieves a consistent display effect for the first text content on the displayed text page. This embodiment further optimizes the data synchronization mechanism between the smart device and the wearable AR device, improving the synchronized user experience.

[0072] As a first optional embodiment of this example, based on the above embodiment, the following steps may also be included:

[0073] a1) Receive a first swipe command, which is generated by the smart device through a triggered first swipe event, or sent by the wearable AR device.

[0074] In this embodiment, the first swipe event can be understood as a specific swipe operation performed by the user on a smart device, such as a smartphone, tablet, or laptop, within the first text page. This swipe operation can be performed by touching the screen or by scrolling the mouse wheel of an external device. In this case, the first swipe command can be considered as a corresponding command generated by the smart device after recognizing the triggered first swipe event. It may include the swipe distance and direction corresponding to the first text page on the smart device, used to inform the device of the swipe operation to be performed by the first page-turning event and to determine the text page to be displayed after the swipe. For example, on a mobile phone screen, swiping up from the bottom issues a swipe command to swipe down, indicating to swipe down the text page to view subsequent text content; scrolling the mouse wheel of an external mouse on a laptop issues an swipe command to swipe up, indicating to swipe down the text page to view previous text content.

[0075] In this embodiment, in another case, the first swipe command can be considered as a swipe event triggered directly by an action on the wearable AR device. For example, it can be simulated by head movements or gestures on the AR device, or it can be performed by pressing a button to generate a corresponding first swipe command, which is used to control the direction, distance, etc. of the smart device to swipe the first text page synchronously. Then, the first swipe command is sent to the smart device with a pre-established connection through short-range communication, and the smart device receives the first swipe command sent above.

[0076] b1) Display a first text page with a first target text line as the first line, the text content of the first target text line is synchronously displayed starting from the first line of the text page displayed by the wearable AR device, wherein the first target text line is determined based on the first swipe command.

[0077] In this embodiment, the first target text line can be understood as the text line that will appear at the top of the first text page after the smart device responds to the first swipe command. In other words, after responding to the first swipe command, the first text page of the smart device will start displaying text content from the first target text line.

[0078] In this embodiment, after receiving the first swipe command, the smart device analyzes and responds to information such as the swipe distance and swipe direction in the command to determine the text line that will be at the beginning of the first text page after the swipe, i.e., the first target text line. The smart device then displays the first text page with the first target text line as its first line. Simultaneously, by sending the text content and layout index information of the first text page to the wearable AR device, the text content of the first target text line in the first text page is synchronized with the first line of the text page displayed on the wearable AR device. This is equivalent to the wearable AR device also starting the text content display with the first target text line as its starting point.

[0079] For example, Figure 2 This is an example illustration showing the consistent display of the first line of text on a text page after synchronized sliding between a smart device and a wearable AR device, as provided in the content synchronization display method of this invention. Figure 2 As shown, this specifically demonstrates that... Figure 1c The third line of text content 122 of the first text page 12 is scrolled to the first line of the first text page 12. In the third text page 14, the second line of text content 142, which is equivalent to the third line of text content 122 in the first text page, is also simultaneously displayed at the first line of the third text page 14.

[0080] The above-described technical solution in this embodiment determines the first target text line in the first text page based on the first sliding command generated by the smart device or sent by the wearable AR device received on the smart device. The text content of the first target text line is synchronized with the first line of the text page displayed by the wearable AR device. That is, both the first text page and the text page displayed by the wearable AR device start displaying from the first target text line, ensuring the synchronous sliding of the smart device and the wearable AR device, as well as the consistency of the text page displayed after sliding.

[0081] As one implementation method, this first optional embodiment can further specify the determination of the first target text line based on the first sliding instruction as the following steps:

[0082] a2) When the first swipe instruction is generated by the smart device, parse the first swipe information corresponding to the triggering of the first swipe event from the first swipe instruction, and determine the first target text line from the first text page based on the first swipe information.

[0083] The first swipe information can be considered as the corresponding swipe operation information that the text page displayed by the smart device should perform after the first swipe event is triggered. It controls the text page displayed by the smart device to swipe accordingly based on the first swipe event. The first swipe information can be obtained based on the pre-defined correspondence between the swipe event trajectory on the smart device and the swipe operation of the text page displayed by the smart device, such as direction and distance. For example, if we set a 0.5 cm upward swipe on the phone screen, the text page will swipe upward two lines when the line spacing is 1.5 times, and five lines when the line spacing is 1 times. Thus, the currently triggered first swipe event is a 0.5 cm upward swipe, and when the line spacing is 1.5 times, the first swipe information is a two-line upward swipe.

[0084] In this embodiment, when the first swipe command is generated by the smart device triggering the first swipe event, the swipe trajectory of the first text page corresponding to the first swipe event can be determined by directly parsing the first swipe information corresponding to the first swipe event in the first swipe command. Based on the first swipe information corresponding to the first swipe event obtained from the first swipe command, the swipe direction and distance of the first text page after the first swipe event are determined, thereby identifying the first target text line that will be displayed at the top of the first text page after the swipe.

[0085] Optionally, after determining the first target text line from the first text page based on the first sliding information, the method further includes the following steps:

[0086] A second swipe command is sent to the wearable AR device to cause the wearable AR device to respond to the second swipe command, wherein the second swipe command contains the target line identifier of the first target text line.

[0087] The target line identifier can be considered as a line identifier representing the position of a text line. Specifically, the index of the first character of each line of text is considered the target line identifier for quickly locating the text line. The second swipe instruction can be understood as an instruction for controlling the swiping of the wearable AR device, wherein the second swipe instruction includes the target line identifier of the first target text line.

[0088] In this embodiment, after triggering the first swipe event on the smart device and determining the first target text line from the first text page based on the first swipe information, the target line identifier of the first target text line is determined based on the layout index information contained in the first swipe information. The determined target line identifier of the first target text line is then sent to the wearable AR device in the form of a second swipe command via short-range wireless communication. At this time, the wearable AR device receives and responds to the second swipe command. That is, by receiving and parsing the second swipe command, the wearable AR device obtains the determined target line identifier in the first text page. By responding to the second swipe command, the first target text line is located based on the target line identifier, and the text content of the first target text line is synchronously displayed at the first line of the text page displayed by the wearable AR device.

[0089] In this embodiment, the above-described technical solution sends a second sliding command containing a target line identifier from the smart device to the wearable AR device. The wearable AR device receives and parses the second sliding command to obtain the target line identifier, and then responds to the second sliding command by locating the first target text line based on the target line identifier. By synchronously displaying the text content of the first target text line to the first line of the text page displayed on the wearable AR device, the wearable AR device can be controlled to achieve synchronous sliding with the smart device.

[0090] b2) When the first swipe command is sent by the wearable AR device, the target line identifier contained in the first swipe command is parsed and recorded as the first target line identifier, and the first target text line corresponding to the first target line identifier is determined from the first text page, wherein the first target line identifier is determined by the wearable AR device according to the determined second swipe information.

[0091] In this embodiment, the first target line identifier can be understood as the index information obtained by parsing the target line identifier contained in the first swipe command sent by the wearable AR device, used to determine the first text line that should be synchronously displayed on the text page after the smart device swipes. The second swipe information can be considered as the corresponding swipe operation information that the text page displayed by the wearable AR device should perform after a swipe event is triggered on the wearable AR device, used to control the text page displayed by the wearable AR device to swipe accordingly based on the aforementioned swipe event. The second swipe information can be obtained based on the pre-set correspondence between the operation trajectory of the swipe event on the wearable AR device and the swipe operation of the text page displayed by the wearable AR device, such as direction and distance. For example, a small touchscreen is set on the AR glasses at the upper edge of the frame. It is set that when the swipe is 0.5 cm to the left on the touchscreen, and the text page displayed by the wearable AR device has a line spacing of 1.5 times, the text on the displayed text page will swipe up one line. Thus, when the triggered swipe event is a 0.5 cm swipe to the left and the text page displayed by the wearable AR device has a line spacing of 1.5 times, the second swipe information is that the text page will swipe up one line.

[0092] In this embodiment, when the first swipe command is sent by the wearable AR device, it means that the wearable AR device has triggered a swipe event. Based on the determined second swipe information, the wearable AR device responds in real time. Then, the first text line in the text page after the wearable AR device swipes is determined, and the target line identifier of the first text line is determined based on the layout index information. This target line identifier is then sent to the smart device in the form of a first swipe command. The smart device then receives and parses the first swipe command, parses the first swipe command to include the target line identifier, and records it as the first target line identifier. Based on the first target line identifier, the first target text line in the first text page is determined.

[0093] The above-described technical solution in this embodiment provides two technical solutions for determining the first target text line based on the first sliding instruction received from different sources on the smart device. This solves the problem of how to accurately determine the first target text line on the smart device after the sliding event is triggered on the smart device or on the wearable AR device, so as to achieve synchronous sliding display on both ends.

[0094] As a second optional embodiment of this example, based on the above embodiment, the following steps may also be included:

[0095] a3) Receive a first page-turning instruction, which is generated by the smart device through a triggered first page-turning event or sent by the wearable AR device.

[0096] In this embodiment, the first page-turning event can be understood as a specific simulated page-turning operation performed by the user on a smart device, such as a smartphone, tablet, or laptop. This can be a page-turning operation performed by touching or tapping the screen, scrolling the wheel of an external device, or pressing a physical button.

[0097] In this scenario, the first page-turning command can be considered a corresponding instruction generated by the smart device after recognizing the triggered first page-turning event. This instruction includes the smart device's desired page-turning direction, informing the device of the page-turning operation to be performed after the first page-turning event, and simultaneously determining the current page and the corresponding text page after the page turn. For example, tapping the left / right side of a phone screen is equivalent to issuing a command to turn forward / backward one page, flipping the e-book text page displayed on the phone screen one page forward / backward; similarly, swiping from the left / right edge of the phone screen towards the center is also equivalent to issuing a command to turn forward / backward one page, flipping the e-book text page displayed on the phone screen one page forward / backward; or pressing the left / right arrow keys on a laptop keyboard is also equivalent to issuing a command to turn forward / backward one page, flipping the e-book text page displayed on the computer screen one page forward / backward.

[0098] In this embodiment, in another scenario, the first page-turning command can be considered as a page-turning event triggered directly by an action on the wearable AR device. For example, it can be simulated by head movements or gestures on the AR device, or by pressing a button to perform a page-turning operation, thereby generating a corresponding first page-turning command to control the page-turning direction of the wearable AR device. The first page-turning command from the wearable AR device is sent to a pre-established connected smart device via short-range communication, and the smart device receives the sent first page-turning command.

[0099] As described above, for example, on an AR glasses device with touch buttons, double-clicking the up / down buttons on the AR glasses can control the page text content of the AR glasses to turn forward / backward. After the AR glasses detect the above action, they will convert it into a page turning command for turning forward / backward, and then send the page turning command for turning forward / backward to the mobile phone that has been pre-connected with the AR glasses via Bluetooth. The mobile phone will receive the page turning command for turning forward / backward.

[0100] b3) Display the fourth text page corresponding to the first page-turning instruction, and use it as the new first text page. The first line of text content in the fourth text page is displayed synchronously starting from the first line of the text page displayed by the wearable AR device.

[0101] The fourth text page can be considered as a new text page displayed by the smart device after responding to the first page-turning command. It can be the text page preceding or following the second text page.

[0102] In this embodiment, after receiving the first page-turning command, the smart device analyzes and responds to information such as the page-turning direction in the command to determine the text page to be displayed after page-turning, i.e., the fourth text page. The fourth text page is then used as the new first text page to re-determine the associated new second text page. The first line of text on the fourth text page is synchronized with the first line of text displayed on the wearable AR device; that is, both the smart device and the wearable AR device respond to the page-turning command and, when displaying the new text page after page-turning, both begin displaying from the first line of text on the fourth text page.

[0103] In this embodiment, the above-described technical solution determines the fourth text page to be displayed after the smart device flips the page based on the first page-turning instructions received from different sources. The first line of text content in the fourth text page is synchronously displayed starting from the first line of the text page displayed by the wearable AR device, thus enabling the smart device and the wearable AR device to flip pages synchronously and start displaying the same text content after flipping the page.

[0104] As one implementation method, this second optional embodiment can further specify the determination of the fourth text page as the following steps:

[0105] a4) When the first page-turning instruction is generated by the smart device, parse the first page-turning information corresponding to the first page-turning event triggered from the first page-turning instruction, and select the fourth text page from the second text page according to the first page-turning information.

[0106] The first page-turning information can be considered as the corresponding page-turning operation that the text page displayed by the smart device should perform after the first page-turning event is triggered. It controls the text page displayed by the smart device to turn pages accordingly based on the first page-turning event. The first page-turning information can be obtained based on the pre-set correspondence between the operation trajectory of the page-turning event on the smart device and the page-turning operation of the text page displayed by the smart device, such as direction. For example, if triggering the right edge of the phone screen causes the displayed text page to turn backward one page, and triggering the left edge causes the displayed text page to turn forward one page, then when the first page-turning event is triggered by the left edge of the phone screen, the first page-turning information is that the displayed text page turns forward one page.

[0107] In this embodiment, when the first page-turning instruction is generated by the smart device triggering the first page-turning event, the first page-turning information corresponding to the first page-turning event after the first page-turning instruction is directly parsed. From the parsed first page-turning information, the change trajectory of the displayed text page can be known. At the same time, based on the layout index information, the fourth text page in the second text page obtained after page-turning, as well as the starting display position of the fourth text page, are selected.

[0108] Optionally, after selecting the fourth text page from the second text page based on the first page-turning information, the method further includes:

[0109] The text line identifier of the first line in the fourth text page is determined as the first line identifier, and a second page-turning instruction containing the first line identifier is sent to the wearable AR device so that the wearable AR device responds to the second page-turning instruction.

[0110] In this embodiment, the second page-turning instruction can be considered as an instruction sent by the smart device to the wearable AR device to control the wearable AR device to turn pages synchronously, and the second page-turning instruction includes the first line identifier of the text.

[0111] In this embodiment, a first page-turning event is triggered on the smart device. After selecting the fourth text page from the second text page based on the first page-turning information, the target line identifier of the first text line in the fourth text page, i.e., the first line identifier, is determined based on the first page-turning information and the layout index information. The determined first line identifier is sent to the wearable AR device via short-range wireless communication in the form of a second page-turning instruction. The wearable AR device receives and responds to the second page-turning instruction. That is, the wearable AR device obtains the first line identifier of the text in the fourth text page by receiving and parsing the second page-turning instruction. The wearable AR device responds to the second page-turning instruction by locating the first line of text displayed on the fourth text page based on the first line identifier and synchronously displaying the first line of text content in the fourth text page on the first line of the text page displayed on the wearable AR device.

[0112] In this embodiment, the above-described technical solution determines the first line identifier of the text from the selected fourth text page on the smart device and sends the first line identifier of the text to the wearable AR device in the form of a second page-turning command. After the wearable AR device responds to the second page-turning command, it can realize synchronous page-turning on both the smart device and the wearable AR device, and ensure that the text pages after page-turning all start displaying from the same text line, so as to ensure the consistency of text display on both pages.

[0113] b4) When the first page-turning instruction is sent by the wearable AR device, the first page-turning instruction is parsed to obtain the first line identifier of the page-turning page, and the fourth text page is selected from the second text page according to the first line identifier of the page-turning page, wherein the first line identifier of the page-turning page is determined by the wearable AR device according to the determined second page-turning information and the layout index information.

[0114] In this embodiment, the first line identifier of the page turning can be considered as the target line identifier of the first text line in the new text page displayed after the wearable AR device responds to the page turning command, that is, the index of the first character containing the font in the new text page, used to determine the starting position of the text content displayed in the new text page after the wearable AR device responds to the page turning command. The second page turning information can be understood as the corresponding page turning operation information that the text page displayed by the wearable AR device should perform after a page turning event is triggered on the wearable AR device, used to control the text page displayed by the wearable AR device to perform the corresponding page turning according to the page turning event triggered above. The second page turning information can be obtained based on the pre-set correspondence between the operation trajectory of the page turning event on the wearable AR device and the page turning operation of the text page displayed by the wearable AR device, such as the direction. For example, a small touchscreen is set on the top edge of the AR glasses frame. When the left edge of the touchscreen is triggered, the text page displayed by the AR glasses flips forward one page. When the right edge of the touchscreen is triggered, the text page displayed by the AR glasses flips backward one page. Thus, when the page-flipping event is triggered by the left edge of the AR glasses touchscreen, the second page-flipping information is that the text page displayed by the AR glasses flips backward one page.

[0115] In this embodiment, when the first page-turning command is sent by the wearable AR device, it means that a page-turning event has been triggered on the wearable AR device, and a page-turning response has been performed on the wearable AR device according to the determined second page-turning information; the first line identifier of the page-turning page is determined according to the layout index information, and the information containing the determined first line identifier of the page-turning page is sent to the smart device in the form of a first page-turning command, which can be in the form of a text message; then the smart device receives and parses the first page-turning command, obtains the included first line identifier of the page-turning page, determines the position of the first line identifier of the page-turning page in the second text page, and considers the second text page where the first line identifier of the page-turning page is located as the fourth text page.

[0116] The above-described technical solution in this embodiment provides two technical implementations for determining the fourth text page based on the first page-turning instructions received from different sources on the smart device. This solves the problem that it is difficult to accurately determine the fourth text page on the smart device after page-turning when a page-turning event is triggered on the smart device or a flipping event is triggered on the wearable AR device, thereby achieving synchronous page-turning display on the smart device and the wearable AR device.

[0117] In this specific embodiment, the implementation process of the content synchronization display method is also given from the perspective of a wearable AR device. Specifically, Figure 3 This is a flowchart of a content synchronization display method provided in an embodiment of the present invention. The embodiments of the present invention are applicable to the situation of synchronizing text content display between a wearable AR device and a smart device. The method can be executed by a content synchronization display device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by a wearable AR device, preferably AR glasses, AR helmets, etc. The wearable AR device and the smart device have established a connection in advance through short-range wireless communication.

[0118] like Figure 3 As shown, the content synchronization display method provided in this embodiment of the invention may specifically include:

[0119] S201. Receive the page text content and layout index information sent by the smart device.

[0120] The page text content can be understood as the text content of the first and second text pages determined in the smart device, and the page text content can be displayed continuously without segmentation.

[0121] In this embodiment, the wearable AR device receives the content of a first text page and a second text page, as well as the layout index information corresponding to the first text page and the second text page, sent by the smart device. This information is used by the wearable AR device to extract and locate the content to be displayed synchronously with the smart device.

[0122] S202. Display a third text page. The AR page text content and layout presented in the third text page are determined according to the page text content and the layout index information. The first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.

[0123] The third text page can be considered as the text page displayed by the wearable AR device through AR technology. The content displayed is provided by the smart device and can be text-based content such as e-books and news. The content displayed on the third text page can include titles, a paragraph or multiple paragraphs of body text. Furthermore, the content displayed on the third text page can be solely the content of the first text page, or it can include content from the second text page, depending on the starting point and display size of the third text page. An AR page can be understood as an interface displaying text information within the third text page. The size of AR pages can be very flexible; they can adapt and adjust according to the user's physical environment and the capabilities of the AR device, such as 0.2 meters wide and 0.3 meters long.

[0124] In this embodiment, based on the text content of the first and second text pages sent by the smart device to the wearable AR device via short-range wireless communication, such as Bluetooth, and the layout index information, the wearable AR device parses the received information to synchronize the first line of text content in the first text page displayed by the smart device to the first line of the third text page displayed by the wearable AR device. Simultaneously, based on the size of the third text page, the AR page text content and layout to be displayed on the third text page of the wearable AR device are determined.

[0125] The above-described technical solution in this embodiment receives page text content and layout index information sent by a smart device on the wearable AR device, and parses the received information to make the first line of text content in the first text page displayed by the smart device synchronously start displaying on the first line of the third text page, thereby achieving synchronous display between the smart device and the wearable AR device.

[0126] As a third optional embodiment of this example, based on the above embodiments, the determination of the third text page can be optimized as follows:

[0127] a5) Obtain the set AR page size and parse the layout index information to obtain the first line identifier information and paragraph mark information.

[0128] The first-line identifier information can be considered as the line identifier information of the first line of text on the first text page of a smart device, that is, the index information of the first character containing the font on the first text page. Paragraph marker information can be understood as the index information or position information of the marks or symbols used to distinguish different paragraphs, representing the position of the paragraph division.

[0129] In this embodiment, the size of the AR page preset by the wearable AR device is obtained. At the same time, by receiving and parsing the determined layout index information sent by the smart device through short-range wireless communication at the wearable AR device, the first line identifier information and paragraph mark information contained in the layout index information are obtained.

[0130] b5) Determine the text start point from the page text content based on the first line identifier information, and starting from the text start point, obtain the text content to be displayed of the AR page size from the page text content.

[0131] The text starting point can be considered as the starting point of the text display on the third text page, and also the starting point of the text content display on the AR page. The text content to be displayed can be considered as the text content on the page that is after the text starting point and will be displayed on the AR page together with the text content at the aforementioned text starting point.

[0132] In this embodiment, based on the first-line identifier information obtained by parsing the layout index information, the position of the first-line identifier information in the page text content received by the wearable AR device is determined, and this position is taken as the text starting point; the page text content is acquired starting from the above-mentioned text starting point until enough text content to be displayed in the AR page size is acquired, that is, to fill or adapt to the display space of the AR page.

[0133] c5) Divide the text content to be displayed into paragraphs according to the paragraph mark information, and construct the third text page based on the text content after paragraph division.

[0134] In this embodiment, based on the paragraph mark information obtained by parsing the layout index information, the text content to be displayed is divided into several paragraphs according to the paragraph mark information, and the text content to be displayed after paragraph division is used as the final display text of the third text page.

[0135] The above-described technical solution in this embodiment provides a technical solution for determining the third text page. By using the first-line identifier information and paragraph mark information contained in the layout index information, the starting point of the text content in the page text content is determined, so that the starting display content in the third text page is synchronized with the first text page; and the text content to be displayed is divided into paragraphs according to the paragraph division format of the smart device, and the text content to be displayed after paragraph division is used to construct the third text page, so that the text content of the third text page of the wearable AR device is consistent with the segmentation of the text content in the smart device.

[0136] As a fourth optional embodiment of this embodiment, based on the above embodiments, it further includes:

[0137] a6) Receive a second sliding instruction, which is sent by the smart device or generated by the wearable AR device through a triggered second sliding event.

[0138] The second swipe event can be understood as a swipe operation performed on the wearable AR device. For example, it can be a swipe operation simulated by gestures, or it can be a swipe on the touchpad or small touchscreen on the temple or frame of the AR glasses, or it can be a swipe operation achieved by moving the glasses.

[0139] In this embodiment, the second swipe command received by the wearable AR device can be obtained by the smart device responding to the swipe command corresponding to the swipe event after triggering the swipe event, determining the line identifier of the first line of text in the first text page after swiping, and sending the determined line identifier to the wearable AR device in the form of a second swipe command.

[0140] In this embodiment, the second swipe command received by the wearable AR device can also be generated after a second swipe event is triggered on the wearable AR device. After the second swipe event is triggered on the wearable AR device, a second swipe command is generated according to preset swipe information to control the wearable AR device to respond to the second swipe event, that is, to perform the corresponding swipe text page operation.

[0141] b6) Display a third text page with the second target text line as the first line, the text content of the second target text line is synchronously displayed starting from the first line of the text page displayed by the smart device, wherein the second target text line is determined based on the second sliding command.

[0142] In this embodiment, the second target text line can be considered as the first text line displayed on the third text page after responding to the second swipe command in the wearable AR device.

[0143] In this embodiment, after the wearable AR device responds to the second swipe command, it determines the first line of text, i.e. the second target text line, in the new third text page after the swipe. The text content of the second target text line is synchronously displayed starting from the first line of the text page displayed by the smart device. In other words, both the third text page and the text page displayed by the smart device start displaying from the second target text line.

[0144] The above-described technical solution in this embodiment provides different sources for the second sliding command received by the wearable AR device. By determining the second target text line and synchronously displaying the second target text line at the top of the currently displayed text page on both the wearable AR device and the smart device, the synchronous sliding of the wearable AR device and the smart device, as well as the consistency of the displayed text page after sliding, are ensured.

[0145] As one implementation method, this fourth optional embodiment can further specify the determination of the second target text line based on the second sliding instruction as the following steps:

[0146] a7) When the second swipe instruction is generated by the wearable AR device, parse the second swipe information corresponding to the triggering of the second swipe event from the second swipe instruction, and determine the second target text line from the third text page based on the second swipe information.

[0147] In this embodiment, when the second swipe command is generated by the wearable AR device, the second swipe information containing the relationship between the second swipe event and the second swipe command is directly parsed from the second swipe command. Based on the second swipe information, the swipe direction and distance can be determined, thereby determining the second target text line in the third text page.

[0148] b7) When the second sliding instruction is sent by the smart device, the target line identifier contained in the second sliding instruction is parsed and recorded as the second target line identifier, and the second target text line corresponding to the second target line identifier is determined from the third text page, wherein the second target line identifier is determined by the smart device according to the determined first sliding information.

[0149] In this embodiment, when the second swipe command is sent by the smart device, it indicates that the smart device has triggered the first swipe event and generated the first swipe command. By parsing the first swipe information contained in the first swipe command, the first line of text in the text page displayed on the smart device after the swipe is determined to be the first target text line. Then, the target line identifier of the first target text line is determined, and the target line identifier is sent to the wearable AR device in the form of the second swipe command. By receiving and parsing the second target line identifier on the wearable AR device, the second target line identifier is obtained. The corresponding second target text line is determined from the third text page based on the second target line identifier.

[0150] The above technical solution of this embodiment provides two sources of receiving the second sliding instruction, and determines the second target text line in the third text page based on the second sliding instructions received from different sources, thereby achieving accurate positioning of the second target text line.

[0151] Optionally, after determining the second target text line from the third text page based on the second sliding information, the method further includes:

[0152] A first swipe command is sent to the smart device to cause the smart device to respond to the first swipe command, wherein the first swipe command contains the target line identifier of the second target text line.

[0153] In this embodiment, a second sliding command is generated by a second sliding event triggered by the wearable AR device. Therefore, after parsing the second sliding information corresponding to the second sliding event triggered from the second sliding command and determining the second target text line from the third text page based on the second sliding information, a first sliding command containing the target line identifier of the second target text line is sent to the smart device.

[0154] In this embodiment, the above-described technical solution, after determining the second target text line based on the second sliding information, sends a first sliding instruction containing the target line identifier of the second target text line to the smart device, thereby achieving synchronous sliding between the wearable AR device and the smart device.

[0155] As a fifth optional embodiment of this embodiment, based on the above embodiments, it further includes:

[0156] a8) Receive a second page-turning instruction, which is generated by a second page-turning event triggered by the wearable AR device or sent by the smart device.

[0157] In this embodiment, the second page-turning instruction received by the wearable AR device can be generated by triggering a second page-turning event on the wearable AR device, based on the second page-turning information, including information such as the page-turning direction.

[0158] In this embodiment, the second page-turning command received by the wearable AR device can also be used to determine the new third text page after the page-turning is determined by parsing the corresponding page-turning information after the page-turning is triggered by the smart device. Then, the line identifier of the first line of text of the new third text page is determined, and the line identifier is sent to the wearable AR device in the form of the second page-turning command.

[0159] b8) Display the fifth text page corresponding to the second page-turning instruction, and use it as a new third text page. The first line of text content in the fifth text page is displayed synchronously starting from the first line of the text page displayed by the smart device.

[0160] The fifth text page can be considered as the text page displayed by the wearable AR device after responding to the second page-turning command.

[0161] In this embodiment, when the wearable AR device receives and responds to the second page-turning instruction, the page displayed after page-turning is the fifth text page, which is used as the new third text page. By using the layout index information, the first line of text content in the fifth text page is synchronously displayed from the first line of the text page displayed by the smart device. That is, the fifth text page and the text page displayed by the smart device start displaying from the same line.

[0162] The above-described technical solution in this embodiment displays a fifth text page in response to a second page-turning command by receiving second page-turning information from different sources on the wearable AR device. The first line of text content in the fifth text page is synchronously displayed starting from the first line of the text page displayed by the smart device, thus ensuring synchronous display of the page-turning information between the wearable AR device and the smart device.

[0163] As one implementation method, this fifth optional embodiment can further specify the determination of the fifth text page as the following steps:

[0164] a9) When the second page-turning instruction is generated by the wearable AR device, the second page-turning information corresponding to the triggering of the second page-turning event is parsed from the second page-turning instruction, and the fifth text page is determined based on the second page-turning information and the layout index information.

[0165] In this embodiment, when the second page-turning instruction is generated by the wearable AR device, it means that the second page-turning instruction is triggered by the second page-turning event. The second page-turning instruction is directly parsed to obtain the second page-turning information corresponding to the second page-turning event. Based on the second page-turning information and the layout index information, the page-turning direction and the starting point of the text display after the page-turning are determined, thereby determining the fifth text page.

[0166] Optionally, after determining the fifth text page based on the second page-turning information and the layout index information, the method may further include:

[0167] The text line identifier of the first line in the fifth text page is determined as the first line identifier of the page turning page, and a first page turning instruction containing the first line identifier of the page turning page is sent to the smart device so that the smart device responds to the first page turning instruction.

[0168] In this embodiment, after the wearable AR device determines the fifth text page based on the second page-turning information and the layout index information, it then determines the first line of text in the fifth text page, determines the text line identifier of the first line of text based on the layout index information, and records it as the first line identifier of the page-turning page; then, the first line identifier of the page-turning page is sent to the smart device in the form of a first page-turning instruction, so that the smart device can respond to the first page-turning instruction and perform synchronous page-turning.

[0169] In this embodiment, the above technical solution determines the first line identifier of the page turning and sends the first line identifier of the page turning to the smart device in the form of a first page turning instruction, so that the wearable AR device controls the smart device to turn the page synchronously after responding to the triggered page turning event.

[0170] b9) When the second page-turning instruction is sent by the smart device, the second page-turning instruction is parsed to obtain the text first line identifier contained therein, and the fifth text page is determined based on the text first line identifier combined with the layout index information, wherein the text first line identifier is the text line identifier of the first line in the fourth text page determined by the smart device.

[0171] In this embodiment, when the second page-turning command is sent by the smart device, it means that the first page-turning event is triggered on the smart device. By parsing the first page-turning information contained in the first page-turning command, the fourth text page is determined. Then, based on the layout index information, the text line identifier of the first line of text in the fourth text page, i.e., the text first line identifier, is determined. The determined text first line identifier is sent to the wearable AR device in the form of the second page-turning command. By receiving and parsing the command on the wearable AR device, the text first line identifier is obtained. At the same time, based on the layout index information, the display starting point of the text page after page-turning is obtained, thereby determining the fifth text page.

[0172] In this embodiment, the above-described technical solution enables the wearable AR device to determine the fifth text page after responding to the second page-turning instruction, depending on the different sources of the second page-turning instruction. By parsing the different information contained in the second page-turning instructions from different sources, synchronous page-turning between the smart device and the wearable AR device is achieved, and the text is displayed starting from the same line.

[0173] Figure 4 This is a schematic diagram of a content synchronization display device provided in an embodiment of the present invention. This embodiment is applicable to situations where text content is displayed synchronously on a wearable AR device and a smart device. The device can be implemented in software and / or hardware, optionally through a smart device, preferably a mobile terminal, desktop computer, laptop computer, or server, etc. The smart device and the wearable AR device have established a connection beforehand via short-range wireless communication. Figure 4 As shown, the device may include: a first display module 41, an information determination module 42, and an information sending module 43, wherein,

[0174] The first display module 41 is used to display the first text page;

[0175] The information determination module 42 is used to determine the second text page associated with the first text page, and to determine the layout index information corresponding to the first text page and the second text page;

[0176] The information sending module 43 is used to send the page text content in the first text page and the second text page, as well as the layout index information, to the wearable AR device, so that the wearable AR device can display the third text page through the layout index information;

[0177] The text content displayed in the first line of the first text page is simultaneously displayed in the first line of the third text page.

[0178] This invention provides a method, apparatus, device, and storage medium for synchronized content display. The method first displays a first text page; then determines a second text page associated with the first text page and determines the layout index information corresponding to the first and second text pages; next, it sends the page text content of the first and second text pages, along with the layout index information, to a wearable AR device, enabling the wearable AR device to display a third text page using the layout index information. The first line of text displayed in the first text page is synchronously displayed on the first line of the third text page. In this embodiment, the layout index information sent by the smart device to the wearable AR device is equivalent to layout information formed based on the smart terminal. The wearable AR device can implement text content layout based on this layout index information. This layout method ensures that the first line of the formed text page can present the content of the first line of the text page on the smart device. When the same text content is displayed on two devices, it better achieves a consistent display effect for the first text content on the displayed text page. The technical solution in this embodiment optimizes the data synchronization mechanism between smart devices and wearable AR devices, improving the synchronized user experience.

[0179] Optionally, the device may also include:

[0180] The first receiving module is configured to receive a first sliding instruction, which is generated by the smart device through a triggered first sliding event, or sent by the wearable AR device.

[0181] The second display module is used to display a first text page with a first target text line as the first line. The text content of the first target text line is displayed synchronously starting from the first line of the text page displayed by the wearable AR device. The first target text line is determined based on the first swipe command.

[0182] Furthermore, the device also includes a first determining module, which can be specifically used for:

[0183] When the first swipe instruction is generated by the smart device, the first swipe information corresponding to the triggering of the first swipe event is parsed from the first swipe instruction, and the first target text line is determined from the first text page based on the first swipe information;

[0184] When the first swipe command is sent by the wearable AR device, the target line identifier contained in the first swipe command is parsed and recorded as the first target line identifier. The first target text line corresponding to the first target line identifier is determined from the first text page. The first target line identifier is determined by the wearable AR device based on the determined second swipe information.

[0185] Furthermore, the device may also include: a first instruction sending module, used for:

[0186] After determining the first target text line from the first text page based on the first swipe information, a second swipe command is sent to the wearable AR device to make the wearable AR device respond to the second swipe command, wherein the second swipe command contains the target line identifier of the first target text line.

[0187] Optionally, the device may further include:

[0188] The second receiving module is used to receive the first page-turning instruction, which is generated by the smart device through a triggered first page-turning event or sent by the wearable AR device.

[0189] The third display module is used to display the fourth text page corresponding to the first page-turning instruction, and to serve as the new first text page. The first line of text content in the fourth text page is displayed synchronously starting from the first line of the text page displayed by the wearable AR device.

[0190] Furthermore, the device may also include a second determining module, which may specifically be used for:

[0191] When the first page-turning instruction is generated by the smart device, the first page-turning information corresponding to the first page-turning event after triggering the first page-turning event is parsed from the first page-turning instruction, and the fourth text page is selected from the second text page according to the first page-turning information;

[0192] When the first page-turning instruction is sent by the wearable AR device, the first page-turning instruction is parsed to obtain the first line identifier of the page-turning page, and the fourth text page is selected from the second text page according to the first line identifier of the page-turning page. The first line identifier of the page-turning page is determined by the wearable AR device according to the determined second page-turning information and the layout index information.

[0193] Furthermore, the device may also include: a second instruction sending module, used for:

[0194] After selecting the fourth text page from the second text page based on the first page-turning information, the text line identifier of the first line in the fourth text page is determined as the first line identifier, and a second page-turning instruction containing the first line identifier is sent to the wearable AR device so that the wearable AR device responds to the second page-turning instruction.

[0195] The content synchronization display device provided in this embodiment of the invention can execute the content synchronization display method provided in any embodiment of the invention applied to smart devices, and has the corresponding functional modules and beneficial effects of executing the method.

[0196] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of the present invention.

[0197] In this specific embodiment, the structure of the content synchronization display device is also given from the perspective of a wearable AR device. Specifically, Figure 5 This is a schematic diagram of a content synchronization display device provided in an embodiment of the present invention. This embodiment is applicable to situations where text content is displayed synchronously on a wearable AR device and a smart device. The device can be implemented in software and / or hardware, optionally through a wearable AR device, preferably AR glasses, an AR helmet, etc. The wearable AR device and the smart device have established a connection beforehand via short-range wireless communication. Figure 5 As shown, the device may include: an information receiving module 51 and a fourth display module 52, wherein,

[0198] The information receiving module 51 is used to receive the page text content and layout index information sent by the smart device;

[0199] The fourth display module 52 is used to display a third text page. The AR page text content and layout presented in the third text page are determined according to the page text content and the layout index information. The first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.

[0200] The above-described technical solution in this embodiment receives page text content and layout index information sent by a smart device on the wearable AR device, and parses the received information to make the first line of text content in the first text page displayed by the smart device synchronously start displaying on the first line of the third text page, thereby achieving synchronous display between the smart device and the wearable AR device.

[0201] Furthermore, the device also includes a third determining module, which can specifically be used for:

[0202] Obtain the set AR page size and parse the layout index information to obtain the first line identifier information and paragraph mark information;

[0203] The text starting point is determined from the page text content based on the first line identifier information, and the text content to be displayed of the page size is obtained from the page text content starting from the text starting point.

[0204] The text content to be displayed is divided into paragraphs according to the paragraph marking information, and the third text page is constructed based on the text content after paragraph division.

[0205] Optionally, the device may also include:

[0206] The third receiving module is used to receive the second sliding instruction, which is sent by the smart device or generated by the wearable AR device through a triggered second sliding event;

[0207] The fifth display module is used to display a third text page with the second target text line as the first line. The text content of the second target text line is displayed synchronously starting from the first line of the text page displayed by the smart device. The second target text line is determined based on the second sliding command.

[0208] Furthermore, the device also includes a fourth determining module, which can be specifically used for:

[0209] When the second swipe command is generated by the wearable AR device, the second swipe information corresponding to the triggering of the second swipe event is parsed from the second swipe command, and the second target text line is determined from the third text page based on the second swipe information;

[0210] When the second swipe command is sent by the smart device, the target line identifier contained in the second swipe command is parsed and recorded as the second target line identifier. The second target text line corresponding to the second target line identifier is determined from the third text page. The second target line identifier is determined by the smart device based on the determined first swipe information.

[0211] Furthermore, the device may also include: a third instruction sending module, used for:

[0212] After determining the second target text line from the third text page based on the second sliding information, a first sliding instruction is sent to the smart device to make the smart device respond to the first sliding instruction, wherein the first sliding instruction contains the target line identifier of the second target text line.

[0213] Optionally, the device may further include:

[0214] The fourth receiving module is used to receive a second page-turning instruction, which is generated by a second page-turning event triggered by the wearable AR device or sent by the smart device.

[0215] The sixth display module is used to display the fifth text page corresponding to the second page-turning instruction, and as a new third text page. The first line of text content in the fifth text page is displayed synchronously starting from the first line of the text page displayed by the smart device.

[0216] Furthermore, the device also includes a fifth determining module, which can be specifically used for:

[0217] When the second page-turning instruction is generated by the wearable AR device, the second page-turning information corresponding to the triggering of the second page-turning event is parsed from the second page-turning instruction, and the fifth text page is determined based on the second page-turning information and the layout index information;

[0218] When the second page-turning instruction is sent by the smart device, the second page-turning instruction is parsed to obtain the first line identifier of the text contained therein, and the fifth text page is determined based on the first line identifier of the text and the layout index information, wherein the first line identifier of the text is the text line identifier of the first line in the fourth text page determined by the smart device.

[0219] Furthermore, the device may also include: a fourth instruction sending module, used for:

[0220] After determining the fifth text page based on the second page-turning information and the layout index information, the text line identifier of the first line in the fifth text page is determined as the first line identifier of the page-turning page, and a first page-turning instruction containing the first line identifier of the page-turning page is sent to the smart device so that the smart device responds to the first page-turning instruction.

[0221] The content synchronization display device provided in the embodiments of the present invention can execute the content synchronization display method provided in any embodiment of the present invention applied to wearable AR devices, and has the corresponding functional modules and beneficial effects of executing the method.

[0222] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of the present invention.

[0223] Figure 6 This is a schematic diagram of the structure of a smart device provided for an embodiment of the present invention. The smart device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0224] like Figure 6 As shown, the intelligent device 60 includes at least one processor 61 and a memory, such as a read-only memory (ROM) 62 and a random access memory (RAM) 63, communicatively connected to the at least one processor 61. The memory stores computer programs executable by the at least one processor. The processor 61 can perform various appropriate actions and processes based on the computer program stored in the ROM 62 or loaded from storage unit 68 into the RAM 63. The RAM 63 can also store various programs and data required for the operation of the intelligent device 60. The processor 61, ROM 62, and RAM 63 are interconnected via a bus 64. An input / output (I / O) interface 65 is also connected to the bus 64.

[0225] Multiple components in the smart device 60 are connected to the I / O interface 65, including: an input unit 66, such as a keyboard, mouse, etc.; an output unit 67, such as various types of displays, speakers, etc.; a storage unit 68, such as a disk, optical disk, etc.; and a communication unit 69, such as a network card, modem, wireless transceiver, etc. The communication unit 69 allows the smart device 60 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0226] Processor 61 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 61 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 61 performs the methods and processes described above for smart devices, such as content synchronization display methods.

[0227] In some embodiments, the content synchronization display method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 68. In some embodiments, part or all of the computer program may be loaded and / or installed on the smart device 60 via ROM 62 and / or communication unit 69. When the computer program is loaded into RAM 63 and executed by processor 61, one or more steps of the content synchronization display method described above may be performed. Alternatively, in other embodiments, processor 61 may be configured to perform the content synchronization display method on the smart device side by any other suitable means (e.g., by means of firmware).

[0228] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0229] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0230] Figure 7 This is a schematic diagram of a wearable augmented reality device provided in an embodiment of the present invention. The wearable augmented reality device is intended to represent various forms of smart wearable devices, such as helmets, glasses, watches, etc. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0231] like Figure 7 As shown, the wearable augmented reality device 70 includes a wearable body, at least one controller 71 mounted on the wearable body, and a memory, such as a read-only memory (ROM) 72 or a random access memory (RAM) 73, communicatively connected to the at least one controller 71. The memory stores a computer program executable by at least one processor. The controller 71 can perform various appropriate actions and processes based on the computer program stored in the ROM 72 or loaded from storage unit 78 into the RAM 73. The RAM 73 may also store various programs and data required for the operation of the wearable body. The controller 71, ROM 72, and RAM 73 are interconnected via a bus 74. An input / output (I / O) interface 75 is also connected to the bus 74.

[0232] Multiple components in the wearable augmented reality device 70 are connected to the I / O interface 75, including: an input unit 76, such as a keyboard, mouse, etc.; an output unit 77, such as various types of displays, speakers, etc.; a storage unit 78, such as a disk, optical disk, etc.; and a communication unit 79, such as a network card, modem, wireless transceiver, etc. The communication unit 79 allows the wearable augmented reality device 70 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0233] Controller 71 can be a variety of general-purpose and / or dedicated processing components with processing and computing capabilities. Some examples of controller 71 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any suitable processor, controller, microcontroller, etc. Controller 71 performs the various methods and processes described above for use in wearable AR devices, such as content synchronization display methods.

[0234] In some embodiments, the content synchronization display method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 78. In some embodiments, part or all of the computer program may be loaded and / or installed on the wearable augmented reality device 70 via ROM 72 and / or communication unit 79. When the computer program is loaded into RAM 73 and executed by controller 71, one or more steps of the content synchronization display method described above may be performed. Alternatively, in other embodiments, controller 71 may be configured to perform the content synchronization display method by any other suitable means (e.g., by means of firmware).

[0235] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0236] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0237] This invention provides a computer storage medium. In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. The computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, the computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0238] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0239] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0240] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0241] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0242] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for synchronized content display, characterized in that, Applied to smart devices, the smart devices and wearable augmented reality (AR) devices establish a connection via short-range wireless communication, the method includes: Display the first text page; Determine the second text page associated with the first text page, and determine the layout index information corresponding to the first text page and the second text page; The page text content in the first text page and the second text page, as well as the layout index information, are sent to the wearable AR device so that the wearable AR device can display the third text page through the page text content and the layout index information; The text content displayed in the first line of the first text page is simultaneously displayed in the first line of the third text page.

2. The method according to claim 1, characterized in that, Also includes: Receive a first swipe command, which is generated by the smart device through a triggered first swipe event, or sent by the wearable AR device; A first text page is displayed with the first target text line as the first line, and the text content of the first target text line is synchronously displayed starting from the first line of the text page displayed by the wearable AR device; The first target text line is determined based on the first sliding instruction.

3. The method according to claim 2, characterized in that, The steps for determining the first target text line based on the first sliding instruction include: When the first swipe instruction is generated by the smart device, the first swipe information corresponding to the triggering of the first swipe event is parsed from the first swipe instruction, and the first target text line is determined from the first text page based on the first swipe information; When the first swipe command is sent by the wearable AR device, the target line identifier contained in the first swipe command is parsed and recorded as the first target line identifier, and the first target text line corresponding to the first target line identifier is determined from the first text page; The first target row identifier is determined by the wearable AR device based on the determined second sliding information.

4. The method according to claim 3, characterized in that, After determining the first target text line from the first text page based on the first sliding information, the method further includes: A second swipe command is sent to the wearable AR device to cause the wearable AR device to respond to the second swipe command, wherein the second swipe command contains the target line identifier of the first target text line.

5. The method according to claim 1, characterized in that, Also includes: Receive a first page-turning instruction, which is generated by the smart device through a triggered first page-turning event or sent by the wearable AR device; The fourth text page corresponding to the first page-turning command is displayed and serves as the new first text page. The first line of text content in the fourth text page is displayed synchronously starting from the first line of the text page displayed by the wearable AR device.

6. The method according to claim 5, characterized in that, The steps for determining the fourth text page include: When the first page-turning instruction is generated by the smart device, the first page-turning information corresponding to the first page-turning event after triggering the first page-turning event is parsed from the first page-turning instruction, and the fourth text page is selected from the second text page according to the first page-turning information; When the first page-turning instruction is sent by the wearable AR device, the first page-turning instruction is parsed to obtain the first line identifier of the page-turning page, and the fourth text page is selected from the second text page according to the first line identifier of the page-turning page; The first row identifier of the page turning is determined by the wearable AR device based on the determined second page turning information and the layout index information.

7. The method according to claim 6, characterized in that, After selecting the fourth text page from the second text page based on the first page-turning information, the method further includes: The text line identifier of the first line in the fourth text page is determined as the first line identifier, and a second page-turning instruction containing the first line identifier is sent to the wearable AR device so that the wearable AR device responds to the second page-turning instruction.

8. A method for synchronized content display, characterized in that, The method, applicable to wearable augmented reality (AR) devices, wherein the wearable AR device establishes a connection with a smart device via short-range wireless communication, includes: The device receives page text content and layout index information sent by the smart device. The page text content includes the text content of the first text page and the text content of the second text page. A third text page is displayed, and the AR page text content and layout presented in the third text page are determined according to the page text content and the layout index information. The first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.

9. The method according to claim 8, characterized in that, The steps for determining the third text page include: Obtain the set AR page size and parse the layout index information to obtain the first line identifier information and paragraph mark information; The text starting point is determined from the page text content based on the first line identifier information, and the text content to be displayed of the page size is obtained from the page text content starting from the text starting point. The text content to be displayed is divided into paragraphs according to the paragraph marking information, and the third text page is constructed based on the text content after paragraph division.

10. The method according to claim 8, characterized in that, Also includes: Receive a second swipe command, which is sent by the smart device or generated by the wearable AR device through a triggered second swipe event; A third text page is displayed with the second target text line as the first line, and the text content of the second target text line is synchronously displayed starting from the first line of the text page displayed by the smart device; The second target text line is determined based on the second sliding instruction.

11. The method according to claim 10, characterized in that, The steps for determining the second target text line based on the second sliding instruction include: When the second swipe command is generated by the wearable AR device, the second swipe information corresponding to the triggering of the second swipe event is parsed from the second swipe command, and the second target text line is determined from the third text page based on the second swipe information; When the second swipe command is sent by the smart device, the target line identifier contained in the second swipe command is parsed and recorded as the second target line identifier, and the second target text line corresponding to the second target line identifier is determined from the third text page; The second target row identifier is determined by the smart device based on the determined first sliding information.

12. The method according to claim 11, characterized in that, After determining the second target text line from the third text page based on the second sliding information, the method further includes: A first swipe command is sent to the smart device to cause the smart device to respond to the first swipe command, wherein the first swipe command contains the target line identifier of the second target text line.

13. The method according to claim 8, characterized in that, Also includes: Receive a second page-turning instruction, which is generated by a second page-turning event triggered by the wearable AR device or sent by the smart device; The fifth text page corresponding to the second page-turning instruction is displayed, and serves as a new third text page. The first line of text content in the fifth text page is displayed synchronously starting from the first line of the text page displayed by the smart device.

14. The method according to claim 13, characterized in that, The steps for determining the fifth text page include: When the second page-turning instruction is generated by the wearable AR device, the second page-turning information corresponding to the triggering of the second page-turning event is parsed from the second page-turning instruction, and the fifth text page is determined based on the second page-turning information and the layout index information; When the second page-turning instruction is sent by the smart device, the second page-turning instruction is parsed to obtain the first line identifier of the text contained therein, and the fifth text page is determined based on the first line identifier of the text and the layout index information; The first line identifier of the text is the text line identifier of the first line in the fourth text page determined on the smart device.

15. The method according to claim 14, characterized in that, After determining the fifth text page based on the second page-turning information and the layout index information, the method further includes: The text line identifier of the first line in the fifth text page is determined as the first line identifier of the page turning page, and a first page turning instruction containing the first line identifier of the page turning page is sent to the smart device so that the smart device responds to the first page turning instruction.

16. A content synchronization display device, characterized in that, Configured in a smart device, the smart device establishes a connection with a wearable augmented reality (AR) device via short-range wireless communication, the device comprising: The first display module is used to display the first text page; The information determination module is used to determine the second text page associated with the first text page, and to determine the layout index information corresponding to the first text page and the second text page; The information sending module is used to send the page text content in the first text page and the second text page, as well as the layout index information, to the wearable AR device, so that the wearable AR device can display the third text page through the layout index information; The text content displayed in the first line of the first text page is simultaneously displayed in the first line of the third text page.

17. A content synchronization display device, characterized in that, A device configured for use in wearable augmented reality (AR) devices, wherein the wearable AR device establishes a connection with a smart device via short-range wireless communication, the device comprising: The information receiving module is used to receive page text content and layout index information sent by the smart device. The page text content includes the text content of the first text page and the text content of the second text page. The fourth display module is used to display the third text page. The AR page text content and layout presented in the third text page are determined according to the page text content and the layout index information. The first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.

18. A smart device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the content synchronization display method according to any one of claims 1-7.

19. A wearable augmented reality device, characterized in that, include: Wearable device; as well as At least one controller mounted on the wearable body; as well as The memory is communicatively connected to the at least one controller, wherein, The memory stores a computer program that can be executed by the at least one controller, the computer program being executed by the at least one controller to enable the at least one controller to perform the content synchronization display method according to any one of claims 8-15.

20. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that are used to cause a processor or controller to execute the content synchronization display method according to any one of claims 1-15.

Images