Content synchronous display method and device, equipment and storage medium
By synchronizing text content between AR devices and smart devices and utilizing layout index information, the problem of inconsistent display between AR devices and smart devices was solved, achieving synchronized display of text content and consistent page turning, thus improving the user experience.
Patent Information
- Application Number
- CN202411403545.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-09
- Publication Date
- 2025-01-10
- Estimated Expiration
- 2044-10-09
AI Technical Summary
The inconsistency between the content displayed on AR glasses and smart devices leads to inconsistencies in content when controlling page turning.
Text content is displayed synchronously between smart devices and AR devices via short-range wireless communication. The text content displayed on the AR device is consistent with that on the smart device by using typographic index information, including determining the related pages and typographic index information of the text page, and synchronously displaying the first line of content on the AR device.
It enables the synchronization of text content display on AR devices and smart devices, ensuring consistency of the first line content and improving the data synchronization mechanism and user experience.
Smart Images

Figure CN119299471A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and in particular to a content synchronization display method, device, equipment and storage medium. Background Art
[0002] Augmented Reality (AR) glasses are wearable devices that can integrate digital information and the physical world in the user's field of vision. Specifically, images, text or other information can be superimposed on the real environment seen by the user. Currently, after AR glasses are connected to smart devices, the text content displayed on the smart device can also be displayed on AR glasses.
[0003] However, for the same content, AR glasses are limited by the device itself, and their layout and operation methods are different from those of smart devices. The content displayed on AR glasses is often displayed in the set layout. As a result, there is a problem of inconsistent content displayed by AR glasses and smart devices. For example, a page of content displayed on a smart device may be displayed as half a page or one and a half pages on AR glasses. It is also possible that a line displayed on a smart device may only be displayed as half a line or one and a half lines on AR glasses. In this case, when the page turning control is performed through the smart device or the AR glasses, there will be a problem of inconsistent content displayed on the smart device and AR glasses. Summary of the invention
[0004] The present invention provides a content synchronization display method, device, equipment and storage medium to solve the problem that for the same text content, the text content displayed on a smart device and AR glasses is inconsistent.
[0005] In a first aspect, an embodiment of the present invention provides a content synchronization display method, which is applied to a smart device, wherein the smart device is connected to a wearable AR device through short-range wireless communication, and the content synchronization display method includes:
[0006] Display the first text page;
[0007] Determining a second text page associated with the first text page, and determining typesetting index information corresponding to the first text page and the second text page;
[0008] Sending the page text content in the first text page and the second text page, and the typesetting index information to the wearable AR device, so that the wearable AR device displays a third text page through the typesetting index information;
[0009] Among them, the text content displayed in the first line of the first text page is synchronously displayed on the first line of the third text page.
[0010] In a second aspect, an embodiment of the present invention provides a content synchronization display method, which is applied to a wearable AR device, wherein the wearable AR device is connected to a smart device via short-range wireless communication, and the content synchronization display method includes:
[0011] Receiving page text content and typesetting index information sent by the smart device;
[0012] A third text page is displayed, wherein the AR page text content and content layout presented in the third text page are determined according to the page text content and the layout index information, and the first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.
[0013] In a third aspect, an embodiment of the present invention provides a content synchronization display device, which is configured in a smart device, and the smart device is connected to the wearable AR device through short-range wireless communication. The content synchronization display device includes:
[0014] A first display module, used to display a first text page;
[0015] An information determination module, used to determine a second text page associated with the first text page, and to determine typesetting index information corresponding to the first text page and the second text page;
[0016] an information sending module, configured to send the page text content in the first text page and the second text page, and the typesetting index information to the wearable AR device, so that the wearable AR device displays a third text page through the typesetting index information;
[0017] Among them, the text content displayed in the first line of the first text page is synchronously displayed on the first line of the third text page.
[0018] In a fourth aspect, an embodiment of the present invention provides a content synchronization display device, which is configured in a wearable AR device, wherein the wearable AR device is connected to a smart device via short-range wireless communication, and the content synchronization display device includes:
[0019] An information receiving module, used to receive the page text content and typesetting index information sent by the smart device;
[0020] The fourth display module is used to display a third text page. The AR page text content and content layout presented in the third text page are determined according to the page text content and the layout index information. The first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.
[0021] In a fifth aspect, an embodiment of the present invention provides a smart device, the smart device comprising:
[0022] at least one processor; and
[0023] a memory communicatively connected to the at least one processor; wherein,
[0024] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the content synchronization display method described in the embodiment of the first aspect of the present invention.
[0025] In a sixth aspect, an embodiment of the present invention provides a wearable device, wherein the wearable enhancement implementation device includes:
[0026] A wearable body; and
[0027] at least one controller mounted on the wearable body; and
[0028] a memory communicatively coupled to the at least one controller, wherein:
[0029] The memory stores a computer program executable by the at least one controller, and the computer program is executed by the at least one controller so that the at least one controller can execute the content synchronization display method described in the embodiment of the second aspect of the present invention.
[0030] In a seventh aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor or a controller to implement the content synchronization display method described in any embodiment of the present invention when executed.
[0031] The technical solution of the embodiment of the present invention provides a method, device, equipment and storage medium for synchronous display of content. The method can first display a first text page; then determine the second text page associated with the first text page, and determine the typesetting index information corresponding to the first text page and the second text page; then send the page text content in the first text page and the second text page, and the typesetting index information to the wearable AR device, so that the wearable AR device displays a third text page through the typesetting index information, wherein the text content displayed in the first line of the first text page is synchronously displayed on the first line of the third text page. In the above technical solution of this embodiment, the typesetting index information sent by the smart device to the wearable AR device is equivalent to the typesetting information formed based on the smart terminal. The wearable AR device can realize the typesetting of the text content based on the typesetting index information. This typesetting method can ensure that the first line of the formed text page can present the content of the first line of the text page on the smart device side. When the same text content is displayed on two devices, the display effect of the first text content on the displayed text page can be better achieved. The technical solution of this embodiment better optimizes the data synchronization mechanism between the smart device and the wearable AR device, and improves the synchronization usage experience.
[0032] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0034] Figure 1a A flowchart of a content synchronization display method provided by an embodiment of the present invention;
[0035] Figure 1b This is an example effect diagram of a text page displayed on a smart terminal in the content synchronization display method provided in an embodiment of the present invention;
[0036] Figure 1c A diagram showing the effect of displaying text content on the first text page and the third text page in the content synchronization display method provided in an embodiment of the present invention;
[0037] Figure 2This is an example effect diagram showing that the first line of text content on a text page is displayed consistent after the smart device and the wearable AR device perform synchronous sliding in the content synchronous display method provided in an embodiment of the present invention;
[0038] Figure 3 A flowchart of a content synchronization display method provided by an embodiment of the present invention;
[0039] Figure 4 A schematic diagram of the structure of a content synchronization display device provided by an embodiment of the present invention;
[0040] Figure 5 A schematic diagram of the structure of a content synchronization display device provided by an embodiment of the present invention;
[0041] Figure 6 A schematic diagram of the structure of an intelligent device provided by an embodiment of the present invention;
[0042] Figure 7 A schematic diagram of the structure of a wearable augmented reality device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0043] Embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present invention. It should be understood that the drawings and embodiments of the present invention are only for exemplary purposes and are not intended to limit the scope of protection of the present invention.
[0044] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.
[0045] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.
[0046] It should be noted that the concepts such as "first" and "second" mentioned in the present invention are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0047] It should be noted that the modifications of "one" and "plurality" mentioned in the present invention are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0048] The names of the messages or information exchanged between multiple devices in the embodiments of the present invention are only used for illustrative purposes, and are not used to limit the scope of these messages or information.
[0049] It is understandable that before using the technical solutions disclosed in the embodiments of the present invention, the type, scope of use, usage scenarios, etc. of the personal information involved in the present invention should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0050] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present invention according to the prompt message.
[0051] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0052] It is understandable that the above notification and user authorization process is only illustrative and does not constitute a limitation on the implementation of the present invention. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present invention.
[0053] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.
[0054] It should be noted that for the same content, AR glasses have different layout and operation methods from smart devices due to the limitations of the device itself, and the content displayed on AR glasses is often displayed in the set layout method. This leads to the problem of inconsistent content displayed by AR glasses and smart devices.
[0055] Based on this, an embodiment of the present invention provides a content synchronization display method. Figure 1aThis is a flow chart of a content synchronization display method provided in an embodiment of the present invention. The embodiment of the present invention is applicable to realizing synchronous display of text content on a smart device and a wearable AR device. The method can be executed by a content synchronization display device, which can be implemented in the form of software and / or hardware. Optionally, it is implemented by a smart device, which is preferably a mobile terminal, a desktop computer, a laptop computer, and a server, etc. The smart device and the wearable AR device are connected in advance through short-range wireless communication, such as Bluetooth, etc.
[0056] like Figure 1a As shown, the content synchronization display method provided by the embodiment of the present invention may specifically include:
[0057] S101, displaying a first text page.
[0058] The first text page may be considered as the page currently displayed on the screen of the smart device, which may be a page of a text-based scenario such as an e-book page, a news page, or a report page, and the first text page may include chapter information, paragraph information, and text information, etc. For example, a page of an e-book being displayed on a mobile phone may display a chapter title, multiple paragraphs, and text content.
[0059] In this embodiment, the first text page is displayed on the screen of the smart device by performing touch click or sliding control, button control, etc. on the smart device, or receiving a control instruction sent by other devices.
[0060] S102: Determine a second text page associated with the first text page, and determine typesetting index information corresponding to the first text page and the second text page.
[0061] Among them, the second text page can be understood as a page that is related to the logical content of the first text page, and the second text page contains the previous text content or the following text content related to the text content displayed on the first text page. For example, the second text page can be the previous page of the first text page and the following page of the first text page in the continuous text content reading. The typesetting index information can be considered as an information collection that organizes and records the location and characteristics of each part in the text content, and can include chapter information, character index information, paragraph information, format information, and line identification information in the text, etc., for realizing fast search and positioning of text content.
[0062] For example, Figure 1b This is an example effect diagram of a text page displayed on a smart terminal in the content synchronization display method provided by an embodiment of the present invention. Figure 1bAs shown, three text pages are specifically displayed, among which the middle text page 12 can be considered as the first text page currently displayed by the smart phone 1, and the previous text page 11 and the next text page 13 associated with the middle text page 12 can be used as the second text page of the first text page (middle text page 12).
[0063] In this embodiment, based on the displayed first text page, the previous text page and the next text page that are logically associated with the first text page are determined as the second text page. Afterwards, this embodiment can also analyze the structure of the first text page and the second text page, identify elements such as chapters or titles, paragraphs, and determine the typesetting index information based on the typesetting structure on the smart device obtained from the above analysis. The typesetting index information may include character indexes, paragraph information, and line identifiers, etc. The typesetting index information can be used to determine the position of each character; it can also be used to determine the position of a paragraph division and distinguish it from the next paragraph; it can also be used to determine the position of each line in the text page, etc.
[0064] In this embodiment, when determining the character index, the content of a chapter or the content under a title can be used as a unit, and the first character in each chapter or title that exists in the font is the first index, and the index arrangement begins, wherein one character that exists in the font is one index. After the above operation of determining the character index, the index of each character can be known, and the index of the first character of each line is considered as the line identifier of each line, that is, the line identifier of each line can also be determined. When determining paragraph information, one paragraph mark information is one character, and the paragraph mark information can be determined based on the line number and character of the chapter or title where the paragraph mark is located, or the paragraph mark information can be determined based on the line identifier of the line where the paragraph mark information is located.
[0065] S103. Send the page text content in the first text page and the second text page, and the typesetting index information to the wearable AR device, so that the wearable AR device displays the third text page through the page text content and the typesetting index information, wherein the text content displayed on the first line of the first text page is synchronously displayed on the first line of the third text page.
[0066] The page text content can be considered as all text information that has been displayed or is to be displayed in the first text page and the second text page, which may include the title, text, header and footer, etc. The third text page can be understood as the current text page displayed by the wearable AR device. The text content displayed on the third text page corresponds to the text content of the first text page, and the first line of the third text page synchronously displays the text content displayed on the first line of the first text page. The size of the third text page can be the same as that of the first text page, or it can be different.
[0067] In this embodiment, the smart device sends all text information displayed in the first text page and the second text page and the determined typesetting index information to a wearable AR device with which a connection is established in advance via a short-range wireless communication method, such as Bluetooth.
[0068] Continuing with the above description, the wearable AR device locates the text content in the first text page and the second text page by parsing the typesetting index information determined by the received smart device; then, based on the typesetting index information, the text content displayed in the first line of the first text page is synchronously displayed on the first line of the third text page; then, the text content display range of the third text page is determined, which can be determined according to the size of the wearable AR device or the user's field of view.
[0069] In this embodiment, the content display range of the third text page is from the first line of content in the first text page to the text content in the first text page and the second text page corresponding to the maximum range of typesetting index information that can be displayed on the third text page. That is to say, if the content of the second text page is also within the display range of the third text page, the third text page will synchronously display the corresponding text content in the first text page and the second text page.
[0070] For example, Figure 1c This is a diagram showing the effect of displaying text content on the first text page and the third text page in the content synchronization display method provided by the embodiment of the present invention. Figure 1c As shown, two text pages are specifically displayed, the first text page 12 and the third text page 14, and different colors are used to represent different lines of text content displayed in the first text page and the third text page. Among them, the first line of text content 141 in the third text page 14 is equivalent to the first line of text content 121 in the first text page, the second line of text content 142 in the third text page 14 is equivalent to the third line of text content 122 in the first text page 12, and the first line of text content 121 displayed in the first text page 12 is synchronously displayed on the first line of the third text page 14.
[0071] According to the technical solution of the embodiment of the present invention, the typesetting index information sent by the smart device to the wearable AR device is equivalent to the typesetting information formed based on the smart terminal. The wearable AR device can realize the typesetting of the text content based on the typesetting index information. This typesetting method can ensure that the first line of the formed text page can present the content of the first line of the text page on the smart device side. When the same text content is displayed on two devices, the display effect of the first text content on the displayed text page can be better achieved. The technical solution of this embodiment better optimizes the data synchronization mechanism between the smart device and the wearable AR device, and improves the synchronous use experience.
[0072] As a first optional embodiment of this embodiment, based on the above embodiment, the following steps may be further included:
[0073] a1) receiving a first sliding instruction, where the first sliding instruction is generated by the smart device through a first sliding event triggered, or is sent by the wearable AR device.
[0074] In this embodiment, the first sliding event can be understood as a specific sliding operation performed by the user on a smart device, such as a smart phone, tablet computer or laptop computer, within the first text page. The sliding operation can be performed by touching the screen or by rolling the wheel of an external device. In this case, the first sliding instruction can be considered as a corresponding instruction generated by the smart device after recognizing the triggered first sliding event, which can include the sliding distance and sliding direction of the first text page of the smart device, etc., which is used to inform the device of the sliding operation that the first page turning event wants to perform and determine the display of the text page after the sliding. For example, on the mobile phone screen, swipe from bottom to top to issue a sliding instruction to slide down, indicating to slide the text page down to view the subsequent text content; scroll the wheel of the external mouse of the laptop upward to issue a sliding instruction to slide up, indicating to slide the text page down to view the previous text content.
[0075] In this embodiment, in another case, the first sliding instruction can be considered as a sliding event directly triggered by an action on the wearable AR device. For example, the sliding operation can be simulated by the head movement or gesture of the AR device, or the sliding operation can be performed by pressing a button, thereby generating a corresponding first sliding instruction for controlling the direction, distance, etc. of the smart device to synchronously slide the first text page. The first sliding instruction is then sent to a smart device with a pre-established connection through short-distance communication, and the first sliding instruction sent above is received at the smart device.
[0076] b1) displaying a first text page with a first target text line as the first line, wherein the text content of the first target text line is synchronously displayed starting from the first line of the text page displayed by the wearable AR device, wherein the first target text line is determined based on the first sliding instruction.
[0077] In this embodiment, the first target text line can be understood as the text line that will appear in the first line of the first text page after the smart device responds to the first sliding instruction. That is to say, after responding to the first sliding instruction, the first text page of the smart device will start with the first target text line as the starting point and begin to display the text content.
[0078] In this embodiment, after receiving the first sliding instruction, the smart device analyzes and responds to the sliding distance, sliding direction and other information in the sliding instruction, thereby determining the text line at the first line of the first text page after sliding, that is, the first target text line, and displays the first text page with the first target text line as the first line after sliding on the smart device. At the same time, by sending the text content and typesetting index information in the first text page to the wearable AR device, the text content of the first target text line in the first text page is synchronized with the first line of the text page displayed on the wearable AR device, which is equivalent to starting to display the text content on the wearable AR device with the first target text line as the starting point.
[0079] For example, Figure 2 This is an example effect diagram of the first line of text content on a text page being displayed consistently after the smart device and the wearable AR device perform synchronous sliding in the content synchronous display method provided in an embodiment of the present invention. Figure 2 As shown, it specifically shows that Figure 1c After the third line of text content 122 of the first text page 12 slides to the first line of the first text page 12. In the third text page 14, the second line of text content 142 equivalent to the third line of text content 122 in the first text page is synchronously displayed on the first line of the third text page 14.
[0080] The above technical scheme of this embodiment determines the first target text line in the first text page based on receiving the first sliding instruction generated by the smart device or the first sliding instruction sent by the wearable AR device on the smart device side, and synchronizes the text content of the first target text line with the first line of the text page displayed by the wearable AR device, that is, the first text page and the text page displayed by the wearable AR device are both displayed starting from the first target text line, ensuring the synchronous sliding of the smart device and the wearable AR device, and the consistency of the text page displayed after sliding.
[0081] As one implementation manner, the first optional embodiment may further specify the following steps in which the first target text line is determined based on the first sliding instruction:
[0082] a2) when the first sliding instruction is generated by the smart device, first sliding information corresponding to triggering the first sliding event is parsed from the first sliding instruction, and the first target text line is determined from the first text page according to the first sliding information.
[0083] Among them, the first sliding information can be considered as the corresponding sliding operation information that the text page displayed by the smart device should execute after the first sliding event is triggered, and is used to control the text page displayed by the smart device to slide accordingly according to the first sliding event. The first sliding information can be obtained based on the correspondence between the operation trajectory of the sliding event on the smart device and the sliding operation of the text page displayed by the smart device, such as direction, distance, etc. Exemplarily, it is set that the touch screen of the mobile phone slides up by 0.5 cm, when the line spacing of the mobile phone text page is 1.5 times, the text page slides up by two lines, and when the line spacing of the mobile phone text page is 1 times, the text page slides up by five lines, so that the first sliding event currently triggered is to slide up by 0.5 cm, and when the line spacing of the first text page is 1.5 times, the first sliding information is that the text page slides up by two lines.
[0084] In this embodiment, when the first sliding instruction is generated by triggering the first sliding event on the smart device side, the sliding track of the first text page corresponding to the first sliding event can be known from the parsed first sliding information by directly parsing the first sliding information corresponding to the triggering of the first sliding event in the first sliding instruction. According to the first sliding information corresponding to the triggering of the first sliding event obtained by parsing the first sliding instruction, the corresponding sliding direction and distance of the first text page after the triggering of the first sliding event can be known, thereby determining the first target text line that will be displayed in the first line of the first text page after the sliding.
[0085] Optionally, after determining the first target text line from the first text page according to the first sliding information, the method further includes the following steps:
[0086] A second sliding instruction is sent to the wearable AR device, so that the wearable AR device responds to the second sliding instruction, where the second sliding instruction includes a target row identifier of the first target text row.
[0087] The target row identifier can be considered as a row identifier representing the position of the text row, that is, the index of the first character of each line of text is considered as the target row identifier of the row, which is used to quickly find the text row. The second sliding instruction can be understood as an instruction for controlling the sliding of the wearable AR device, wherein the second sliding instruction includes the target row identifier of the first target text row.
[0088] In this embodiment, a first sliding event is triggered on the smart device side. After the first target text row is determined from the first text page according to the first sliding information, the target row identifier of the first target text row is determined according to the typesetting index information contained in the first sliding information, and the determined target row identifier of the first target text row is sent to the wearable AR device side in the form of a second sliding instruction through short-range wireless communication. At this time, the wearable AR device receives and responds to the second sliding instruction, that is, the wearable AR device obtains the target row identifier determined in the first text page by receiving and parsing the second sliding instruction, and by responding to the second sliding instruction, the first target text row is located according to the target row identifier, and the text content of the first target text row is synchronously displayed to the first line of the text page displayed by the wearable AR device.
[0089] The above technical solution of this embodiment sends a second sliding instruction including a target row identifier from the smart device to the wearable AR device, and the wearable AR device obtains the target row identifier by receiving and parsing the second sliding instruction, and then responds to the second sliding instruction, that is, the wearable AR device locates the first target text row according to the target row identifier, and synchronously displays the text content of the first target text row to the first line of the text page displayed by the wearable AR device, thereby controlling the wearable AR device to achieve synchronous sliding with the smart device.
[0090] b2) When the first sliding instruction is sent by the wearable AR device, the target row identifier contained in the first sliding instruction is parsed and recorded as the first target row identifier, and the first target text row corresponding to the first target row identifier is determined from the first text page, wherein the first target row identifier is determined by the wearable AR device based on the determined second sliding information.
[0091] In this embodiment, the first target row identifier can be understood as the index information obtained by parsing the target row identifier contained in the first sliding instruction sent by the wearable AR device, which is used to determine the first text row that the text page should display synchronously after sliding on the smart device. The second sliding information can be considered as the corresponding sliding operation information that the text page displayed by the wearable AR device should perform after the sliding event is triggered on the wearable AR device, which is used to control the text page displayed by the wearable AR device to slide accordingly according to the above sliding event. The second sliding information can be obtained according to the correspondence between the operation track of the sliding event on the wearable AR device and the sliding operation of the text page displayed by the wearable AR device, such as direction, distance, etc., which is preset. For example, a small touch screen is set on the upper edge of the frame of the AR glasses, and it is set that when the touch screen slides 0.5 cm to the left, when the text page text displayed by the wearable AR device is 1.5 times the line spacing, the above-mentioned displayed text page text slides up one line. Therefore, when the triggered sliding event is a left slide of 0.5 cm and the text page text displayed by the wearable AR device is 1.5 times the line spacing, the second sliding information is a text page sliding up one line.
[0092] In this embodiment, when the first sliding instruction is sent by the wearable AR device, it means that the wearable AR device has triggered a sliding event, and a real-time response is performed on the wearable AR device according to the determined second sliding information; then the first text line in the text page after the wearable AR device slides is determined, and the target line identifier of the above-mentioned first text line is determined according to the typesetting index information, and sent to the smart device in the form of a first sliding instruction; then the smart device receives and parses the first sliding instruction, and the first sliding instruction contains a target line identifier and is recorded as a first target line identifier, and the first target text line in the first text page is determined according to the above-mentioned first target line identifier.
[0093] The above technical scheme of this embodiment provides two technical schemes for determining the first target text line according to the first sliding information, based on the first sliding instructions received from different sources on the smart device side. It solves the problem of how to accurately determine the first target text line on the smart device side after the sliding event is triggered on the smart device side or on the wearable AR device side, so as to realize the synchronous sliding display on the above two ends.
[0094] As a second optional embodiment of this embodiment, based on the above embodiment, the following steps may be further included:
[0095] a3) receiving a first page turning instruction, where the first page turning instruction is generated by the smart device through a first page turning event triggered, or is sent by the wearable AR device.
[0096] In this embodiment, the first page turning event can be understood as a specific simulated page turning operation performed by a user on a smart device, such as a smart phone, tablet computer or laptop computer. It can be a page turning operation performed by touching, sliding or clicking the screen, or by scrolling the scroll wheel of an external device, or by pressing a physical button.
[0097] In this case, the first page turning instruction can be considered as a corresponding instruction generated by the smart device after the smart device recognizes the triggered first page turning event, which includes the direction of the page turning corresponding to the smart device, etc., and is used to inform the device of the page turning operation that the first page turning event wants to perform, and at the same time determine the current page and the corresponding text page after the page turning. For example, clicking on the left / right side of the mobile phone screen is equivalent to issuing an instruction to turn forward / backward one page, which can turn the e-book text page displayed on the mobile phone screen forward / backward one page; or sliding from the left edge / right edge of the mobile phone screen to the middle is equivalent to issuing an instruction to turn forward / backward one page, which can turn the e-book text page displayed on the mobile phone screen forward / backward one page; or by pressing the left / right key of the direction key on the laptop keyboard, it is equivalent to issuing an instruction to turn forward / backward one page, which can turn the e-book text page displayed on the computer screen forward / backward one page.
[0098] In this embodiment, in another case, the first page turning instruction can be considered as a page turning event directly triggered by an action on the wearable AR device, for example, the page turning operation can be simulated by the head action or gesture of the AR device, or the page turning operation can be performed by pressing a button, thereby generating a corresponding first page turning instruction for controlling the page turning direction of the wearable AR device, etc. The first page turning instruction on the wearable AR device side is sent to the pre-established connected smart device through short-distance communication, and the first page turning instruction sent above is received on the smart device side.
[0099] Continuing with the above description, for example, on the AR glasses with touch buttons, you may be able to control the page text content of the AR glasses to turn forward / backward by double-clicking the up / down buttons on the AR glasses. After the AR glasses detect the above action, it will convert it into a page turning instruction for turning forward / backward, and then send the above page turning instruction for turning forward / backward to a mobile phone that has been pre-connected to the AR glasses via Bluetooth, and the mobile phone will receive the page turning instruction for turning forward / backward.
[0100] b3) Displaying a fourth text page corresponding to the first page turning instruction as a new first text page, and displaying the first line of text content in the fourth text page synchronously starting from the first line of the text page displayed by the wearable AR device.
[0101] The fourth text page may be considered as a new text page displayed after the smart device responds to the first page turning instruction, and may be the previous text page or the next text page in the second text page.
[0102] In this embodiment, after receiving the first page turning instruction, the smart device analyzes and responds to the information such as the page turning direction in the page turning instruction, thereby determining the text page displayed after turning the page, that is, the fourth text page. The fourth text page is used as the new first text page, and the associated new second text page is re-determined. Among them, the first line of text content in the fourth text page is synchronized with the first line of the text page displayed by the wearable AR device, that is, the smart device and the wearable AR device both respond to the page turning instruction, and when displaying the new text page after turning the page, they both start displaying from the first line of text content in the fourth text page.
[0103] The above technical scheme of this embodiment determines the fourth text page displayed by the smart device after turning the page according to the first page turning instructions received by the smart device from different sources, and makes the first line of text content in the fourth text page synchronously displayed from the first line of the text page displayed by the wearable AR device, thereby realizing synchronous page turning of the smart device and the wearable AR device, and starting to display from the same text content after turning the page.
[0104] As one implementation manner, the second optional embodiment may further specify the determination of the fourth text page into the following steps:
[0105] a4) when the first page turning instruction is generated by the smart device, first page turning information corresponding to the triggering of the first page turning event is parsed from the first page turning instruction, and the fourth text page is selected from the second text pages according to the first page turning information.
[0106] Among them, the first page turning information can be considered as the corresponding page turning operation information that should be executed by the text page displayed by the smart device after the first page turning event is triggered, and is used to control the text page displayed by the smart device to turn the page accordingly according to the first page turning event. The first page turning information can be obtained based on the correspondence between the operation track of the page turning event preset on the smart device and the page turning operation of the text page displayed by the smart device, such as direction. For example, it is set to trigger the right edge of the mobile phone screen, and the text page displayed on the mobile phone will turn back one page, and trigger the left edge of the mobile phone screen, and the text page displayed on the mobile phone will turn forward one page. Therefore, when the first page turning event triggered is to trigger the left edge of the mobile phone screen, the first page turning information is that the text page displayed on the mobile phone will turn forward one page.
[0107] In this embodiment, when the first page turning instruction is generated by triggering the first page turning event on the smart device, the first page turning information corresponding to the first page turning event triggered in the first page turning instruction is directly parsed. The change trajectory of the displayed text page can be known from the parsed first page turning information. At the same time, according to the typesetting index information, the fourth text page in the second text page obtained after turning the page and the starting display position of the fourth text page are selected.
[0108] Optionally, after selecting the fourth text page from the second text page according to the first page turning information, the method further includes:
[0109] Determine that the text line identifier of the first line in the fourth text page is recorded as the text first line identifier, and send a second page turning instruction including the text first line identifier to the wearable AR device, so that the wearable AR device responds to the second page turning instruction.
[0110] In this embodiment, the second page turning instruction can be considered as an instruction sent by the smart device to the wearable AR device to control the wearable AR device to turn pages synchronously, and the second page turning instruction includes the text first line identifier.
[0111] In this embodiment, the first page turning event is triggered on the smart device side. After the fourth text page is selected from the second text page according to the first page turning information, the target line identifier of the first text line in the fourth text page, that is, the first line identifier of the text, is determined according to the first page turning information and the typesetting index information. The determined first line identifier of the text is sent to the wearable AR device side in the form of a second page turning instruction through short-range wireless communication. At this time, the wearable AR device receives and responds to the second page turning instruction, that is, the wearable AR device obtains the first line identifier of the text in the fourth text page by receiving and parsing the second page turning instruction, and the wearable AR device responds to the second page turning instruction by locating the first line of text displayed on the fourth text page according to the first line identifier of the text, and synchronously displays the first line of text content in the fourth text page to the first line of the text page displayed by the wearable AR device.
[0112] The above technical scheme of this embodiment, by determining the first line identifier of the text from the selected fourth text page on the smart device side, and sending the first line identifier of the text to the wearable AR device in the form of a second page turning instruction, so that the wearable AR device responds to the second page turning instruction, can realize synchronous page turning on the smart device side and the wearable AR device side, and ensure that the text pages after page turning are displayed starting from the same text line, so as to ensure the consistency of text display on the pages at both ends.
[0113] b4) When the first page turning instruction is sent by the wearable AR device, parse the first page turning instruction, obtain the first line identifier of the page turning page contained therein, and select the fourth text page from the second text page according to the first line identifier of the page turning page, wherein the first line identifier of the page turning page is determined by the wearable AR device according to the determined second page turning information and the typesetting index information.
[0114] In this embodiment, the first line identifier of the page turning page can be considered as the target line identifier of the first text line in the new text page displayed after the wearable AR device responds to the page turning instruction, that is, the index of the first character of the font in the new text page, which is used to determine the starting position of the text content display in the new text page after the wearable AR device responds to the page turning instruction. The second page turning information can be understood as the corresponding page turning operation information that should be executed on the text page displayed by the wearable AR device after the page turning event is triggered on the wearable AR device side, which is used to control the text page displayed by the wearable AR device to turn the page accordingly according to the above-triggered page turning event. The second page turning information can be obtained according to the correspondence between the preset operation trajectory of the page turning event on the wearable AR device side and the page turning operation, such as direction, of the text page displayed by the wearable AR device. For example, a small touch screen is provided on the upper edge of the frame of the AR glasses, and the left edge of the touch screen is triggered so that the text page displayed on the AR glasses turns forward one page, and the right edge of the touch screen is triggered so that the text page displayed on the AR glasses turns backward one page. Thus, when the triggered page turning event is to trigger the left edge of the touch screen of the AR glasses, the second page turning information is that the text page displayed on the AR glasses turns backward one page.
[0115] In this embodiment, when the first page turning instruction is sent by the wearable AR device, it means that a page turning event has been triggered on the wearable AR device side, and a page turning response has been made on the wearable AR device side according to the determined second page turning information; the first line identifier of the page turning page is determined according to the typesetting index information, and the information containing the determined first line identifier of the page turning page is sent to the smart device side in the form of a first page turning instruction, and the first page turning instruction can be in the form of a text message; the smart device then receives and parses the first page turning instruction, obtains the first line identifier of the page turning page contained therein, determines the position of the first line identifier of the page turning page in the second text page, and considers the second text page where the first line identifier of the page turning page is located to be the fourth text page.
[0116] The above technical scheme of this embodiment provides two technical implementations for determining the fourth text page according to the first page turning instructions received from different sources on the smart device, thereby solving the problem that it is difficult to accurately determine the fourth text page on the smart device after a page turning event is triggered on the smart device or after a turning event is triggered on the wearable AR device, so as to realize synchronous page turning display on the smart device and the wearable AR device.
[0117] In this specific embodiment, the implementation process of the content synchronization display method is given from the perspective of a wearable AR device. Specifically, Figure 3 This is a flow chart of the content synchronization display method provided in an embodiment of the present invention. The embodiment of the present invention is applicable to the case where text content is synchronously displayed on a wearable AR device and a smart device. The method can be executed by a content synchronization display device, which can be implemented in the form of software and / or hardware. Optionally, it is implemented by a wearable AR device, which is preferably AR glasses, AR helmets, etc., and the wearable AR device and the smart device are pre-connected through short-range wireless communication.
[0118] like Figure 3 As shown, the content synchronization display method provided by the embodiment of the present invention may specifically include:
[0119] S201: Receive page text content and typesetting index information sent by the smart device.
[0120] The page text content may be understood as the text content of the first text page and the second text page determined in the smart device, and the page text content may be displayed continuously without being segmented.
[0121] In this embodiment, the wearable AR device receives the determined contents of the first text page and the second text page sent by the smart device, as well as the typesetting index information corresponding to the first text page and the second text page, so that the wearable AR device can extract and locate the content to be displayed synchronously with the smart device.
[0122] S202, displaying a third text page, wherein the AR page text content and content layout presented in the third text page are determined according to the page text content and the layout index information, and the first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.
[0123] Among them, the third text page can be considered as a text page that can be displayed by the wearable AR device through AR technology. The displayed content is provided by the smart device end, which can be text content such as e-books and news; at the same time, the displayed content in the third text page can include a title, a paragraph or a multi-terminal text, etc.; in addition, the content displayed on the third text page can be only the content in the first text page, or it can include the content in the second text page, depending on the display size of the third text page where the third text display content starts. The AR page can be understood as an interface for displaying text information in the third text page. The size of the AR page can be very flexible. They can be adapted and adjusted according to the user's physical environment and the capabilities of the AR device, such as 0.2 meters wide and 0.3 meters long.
[0124] In this embodiment, the text content of the first text page and the second text page, as well as the layout index information, are sent by the smart device to the wearable AR device through short-range wireless communication, such as Bluetooth; the wearable AR device parses the received information so that the first line of text content in the first text page displayed by the smart device is synchronously displayed starting from the first line of the third text page displayed by the wearable AR device; at the same time, according to the size that the third text page can display, the AR page text content and content layout to be displayed on the third text page of the wearable AR device are determined.
[0125] The above technical solution of this embodiment receives the page text content and layout index information sent by the smart device on the wearable AR device end, parses the received information and makes the first line of text content in the first text page displayed by the smart device start to be displayed on the first line of the third text page synchronously, so as to realize the synchronous display of the smart device and the wearable AR device.
[0126] As a third optional embodiment of this embodiment, based on the above embodiment, the determination of the third text page can be optimized into the following steps:
[0127] a5) Obtaining the set AR page size, and parsing the typesetting index information to obtain the first line identification information and paragraph mark information.
[0128] The first line identification information can be considered as the line identification information of the first line of text in the first text page on the smart device, that is, the index information of the first character in the font in the first text page. The paragraph mark information can be understood as the index information or position information of the mark or symbol used to distinguish different paragraphs, which represents the position of the paragraph division.
[0129] In this embodiment, the size of the AR page preset by the wearable AR device is obtained, and at the same time, the first line identification information and paragraph mark information contained in the layout index information are obtained by receiving and parsing the determined layout index information sent by the smart device through short-range wireless communication on the wearable AR device.
[0130] b5) determining a text starting point from the terminal text content according to the first line identification information, and obtaining the to-be-displayed text content of the AR page size from the terminal text content starting from the text starting point.
[0131] Among them, the terminal text content can be understood as the text content in the first text page and the second text page received by the wearable AR device. The text starting point can be considered as the starting point of the text display of the third text page, and also the starting point of the text content display in the AR page. The text content to be displayed can be considered as the text content in the terminal text content after the text starting point, which will be displayed in the AR page together with the text content at the text starting point.
[0132] In this embodiment, based on the first line identification information obtained by parsing the typesetting index information, the position of the first line identification information in the terminal text content received by the wearable AR device is determined, and this position is used as the text starting point; the terminal text content is obtained starting from the above text starting point until the text content is obtained that is large enough to display on the AR page, that is, to fill or adapt to the display space of the AR page.
[0133] c5) dividing the text content to be displayed into paragraphs according to the paragraph mark information, and constructing the third text page based on the text content after the paragraph division.
[0134] In this embodiment, according to the paragraph mark information obtained by parsing the typesetting index information, the text content to be displayed is divided into several paragraphs according to the paragraph mark information, and the text content to be displayed after the paragraph division is used as the final display text of the third text page.
[0135] The above technical scheme of this embodiment provides a technical scheme for determining the third text page, by determining the text starting point in the terminal text content through the first line identification information and the paragraph mark information contained in the typesetting index information, so that the starting display content in the third text page is synchronized with the first text page; and the text content to be displayed is divided into paragraphs according to the paragraph division form of the smart device end, and the third text page is constructed based on the text content to be displayed after the paragraph division, so that the text content of the third text page of the wearable AR device is consistent with the segmentation of the text content in the smart device.
[0136] As a fourth optional embodiment of this embodiment, based on the above embodiment, it also includes:
[0137] a6) receiving a second sliding instruction, where the second sliding instruction is sent by the smart device or generated by the wearable AR device through a triggered second sliding event.
[0138] Among them, the second sliding event can be understood as a sliding operation performed on the wearable AR device. For example, it can be an operation of simulating a sliding through a gesture, or it can be a touchpad or a small touch screen equipped on the temple or frame of the AR glasses. The sliding operation can also be achieved by moving the glasses.
[0139] In this embodiment, the second sliding instruction received by the wearable AR device can be that after a sliding event of the smart device is triggered, the smart device responds to the sliding instruction corresponding to the sliding event, determines the line identifier of the first line of text in the first text page after sliding, and sends the determined line identifier to the wearable AR device in the form of a second sliding instruction.
[0140] In this embodiment, the second sliding instruction received by the wearable AR device may also be generated after the second sliding event is triggered on the wearable AR device. After the second sliding event is triggered on the wearable AR device, the second sliding instruction is generated according to the preset sliding information, which is used to control the wearable AR device to respond to the second sliding event, that is, to perform the corresponding sliding text page operation.
[0141] b6) Displaying a third text page with the second target text line as the first line, wherein the text content of the second target text line is synchronously displayed starting from the first line of the text page displayed by the smart device, wherein the second target text line is determined based on the second sliding instruction.
[0142] In this embodiment, the second target text line can be considered as the first text line displayed on the third text page in the wearable AR device in response to the second sliding instruction.
[0143] In this embodiment, after the wearable AR device responds to the second sliding instruction, it determines the first text line in the new third text page after sliding, that is, the second target text line, and the text content of the second target text line is synchronously displayed starting from the first line of the text page displayed by the smart device, that is, the third text page and the text page displayed by the smart device are both displayed starting from the second target text line.
[0144] The above technical solution of this embodiment provides different sources for the wearable AR device to receive the second sliding instruction, and by determining the second target text line and synchronously displaying the second target text line on the first line of the text page currently displayed on the wearable AR device and the smart device, it ensures the synchronous sliding of the wearable AR device and the smart device, and the consistency of the text page displayed after sliding.
[0145] As one implementation manner, the fourth optional embodiment may further specify the following steps in which the second target text line is determined based on the second sliding instruction:
[0146] a7) when the second sliding instruction is generated by the wearable AR device, second sliding information corresponding to triggering the second sliding event is parsed from the second sliding instruction, and the second target text line is determined from the third text page according to the second sliding information.
[0147] In this embodiment, when the second sliding instruction is generated by the wearable AR device, the second sliding information including the relationship between the second sliding event and the second sliding instruction is directly parsed from the second sliding instruction. According to the second sliding information, information such as the sliding direction and distance can be determined, thereby determining the second target text line in the third text page.
[0148] b7) When the second sliding instruction is sent by the smart device, the target row identifier contained in the second sliding instruction is parsed and recorded as the second target row identifier, and the second target text row corresponding to the second target row identifier is determined from the third text page, wherein the second target row identifier is determined by the smart device based on the determined first sliding information.
[0149] In this embodiment, when the second sliding instruction is sent by the smart device, it means that the smart device has triggered the first sliding event and generated the first sliding instruction. By parsing the first sliding information contained in the first sliding instruction, the first line of text in the text page displayed on the smart device after the sliding, that is, the first target text line, is determined, and then the target line identifier of the first target text line is determined. The target line identifier is sent to the wearable AR device in the form of a second sliding instruction. By receiving and parsing it on the wearable AR device, the second target line identifier is obtained, and the corresponding second target text line is determined from the third text page according to the second target line identifier.
[0150] The above technical solution of this embodiment provides two sources for receiving the second sliding instruction, and determines the second target text line in the third text page according to the second sliding instructions received from different sources, thereby achieving accurate positioning of the second target text line.
[0151] Optionally, after determining the second target text line from the third text page according to the second sliding information, the method further includes:
[0152] A first sliding instruction is sent to the smart device so that the smart device responds to the first sliding instruction, wherein the first sliding instruction includes a target row identifier of the second target text row.
[0153] In this embodiment, a second sliding event triggered by the wearable AR device generates a second sliding instruction. Therefore, according to the second sliding information corresponding to the triggering of the second sliding event parsed from the second sliding instruction, after determining the second target text line from the third text page according to the second sliding information, a first sliding instruction containing the target line identifier of the second target text line is sent to the smart device.
[0154] The above technical solution of this embodiment realizes synchronous sliding of the wearable AR device and the smart device by sending a first sliding instruction including a target row identifier of the second target text row to the smart device after determining the second target text row according to the second sliding information.
[0155] As a fifth optional embodiment of this embodiment, based on the above embodiment, it also includes:
[0156] a8) receiving a second page turning instruction, where the second page turning instruction is generated by a second page turning event triggered by the wearable AR device, or is sent by the smart device.
[0157] In this embodiment, the second page turning instruction received by the wearable AR device can be generated by triggering a second page turning event on the wearable AR device, and generating a second page turning instruction according to the second page turning information, including information such as the page turning direction.
[0158] In this embodiment, the second page turning instruction received by the wearable AR device can also trigger a page turning event through the smart device, and obtain the corresponding page turning information by parsing to determine the new third text page after the page turning, and then determine the line identifier of the first line of text of the new third text page, and send the above line identifier to the wearable AR device in the form of a second page turning instruction.
[0159] b8) Displaying a fifth text page corresponding to the second page turning instruction as a new third text page, wherein the first line of text content in the fifth text page is synchronously displayed starting from the first line of the text page displayed by the smart device.
[0160] Among them, the fifth text page can be considered as the text page displayed after the wearable AR device responds to the second page turning instruction.
[0161] In this embodiment, when the wearable AR device receives the second page turning instruction and responds to the second page turning instruction, the page displayed after turning is the fifth text page, which is used as the new third text page. By making the first line of text content in the fifth text page synchronously displayed from the first line of the text page displayed by the smart device according to the typesetting index information, that is, the fifth text page and the text page displayed by the smart device are displayed from the same line.
[0162] The above technical solution of this embodiment displays the fifth text page in response to the second page turning instruction by receiving the second page turning information from different sources on the wearable AR device end, and makes the first line of text content in the fifth text page synchronously displayed from the first line of the text page displayed by the smart device, so as to ensure the synchronous display of the wearable AR device and the smart device after page turning.
[0163] As one implementation manner, the fifth optional embodiment may further specify the determination of the fifth text page into the following steps:
[0164] a9) When the second page turning instruction is generated by the wearable AR device, second page turning information corresponding to triggering the second page turning event is parsed from the second page turning instruction, and the fifth text page is determined according to the second page turning information combined with the typesetting index information.
[0165] In this embodiment, when the second page turning instruction is generated by the wearable AR device, it means that the second page turning instruction is triggered by the second page turning event. The second page turning instruction is directly parsed to obtain the second page turning information corresponding to the triggering of the second page turning event. According to the second page turning information and the typesetting index information, the page turning direction and the starting point of the text display after the page turning are determined, thereby determining the fifth text page.
[0166] Optionally, after determining the fifth text page according to the second page turning information combined with the typesetting index information, the method may further include:
[0167] Determine that the text line identifier of the first line in the fifth text page is recorded as the first line identifier of the page turning page, and send a first page turning instruction including the first line identifier of the page turning page to the smart device, so that the smart device responds to the first page turning instruction.
[0168] In this embodiment, after the wearable AR device determines the fifth text page based on the second page turning information combined with the typesetting index information, it then determines the first line of text in the fifth text page, and determines the text line identifier of the above-mentioned first line of text according to the typesetting index information, which is recorded as the first line identifier of the page turning page; then the above-mentioned first line identifier of the page turning page is sent to the smart device in the form of a first page turning instruction, so that the smart device can respond to the first page turning instruction and make synchronous page turning.
[0169] The above technical solution of this embodiment determines the first line identifier of the page turning page and sends the above first line identifier of the page turning page to the smart device in the form of a first page turning instruction, so that the wearable AR device controls the smart device to turn the page synchronously after responding to the triggered page turning event.
[0170] b9) When the second page turning instruction is sent by the smart device, parse the second page turning instruction, obtain the text first line identifier contained therein, and determine the fifth text page based on the text first line identifier combined with the typesetting index information, wherein the text first line identifier is the text line identifier of the first line in the fourth text page determined on the smart device.
[0171] In this embodiment, when the second page turning instruction is sent by the smart device, it means that the first page turning event is triggered on the smart device side, and the fourth text page is determined by parsing the first page turning information contained in the first page turning instruction, and then the text line identifier of the first line of text in the fourth text page, that is, the text first line identifier, is determined according to the typesetting index information. The determined text first line identifier is sent to the wearable AR device side in the form of the second page turning instruction, and the instruction is received and parsed on the wearable AR device side to obtain the text first line identifier contained therein, and at the same time, the display starting point of the text page after the page turning is obtained according to the typesetting index information, thereby determining the fifth text page.
[0172] The above technical scheme of this embodiment enables the wearable AR device to determine the fifth text page after responding to the second page turning instruction according to the different sources of the second page turning instruction. By parsing the different information contained in the second page turning instructions from different sources, the smart device and the wearable AR device can realize synchronous page turning, and display starts from the same text line.
[0173] Figure 4 This is a structural diagram of a content synchronization display device provided by an embodiment of the present invention. The embodiment of the present invention is applicable to realizing the synchronous display of text content on a wearable AR device and a smart device. The device can be implemented in the form of software and / or hardware. Optionally, it can be implemented by a smart device, which is preferably a mobile terminal, a desktop computer, a laptop computer, and a server. The smart device and the wearable AR device are connected in advance through short-range wireless communication. Figure 4 As shown, the device may include: a first display module 41, an information determination module 42, and an information sending module 43, wherein:
[0174] A first display module 41, used to display a first text page;
[0175] An information determination module 42, configured to determine a second text page associated with the first text page, and to determine typesetting index information corresponding to the first text page and the second text page;
[0176] An information sending module 43 is used to send the page text content in the first text page and the second text page, and the typesetting index information to the wearable AR device, so that the wearable AR device displays a third text page through the typesetting index information;
[0177] Among them, the text content displayed in the first line of the first text page is synchronously displayed on the first line of the third text page.
[0178] The technical solution of the embodiment of the present invention provides a method, device, equipment and storage medium for synchronous display of content. The method can first display a first text page; then determine the second text page associated with the first text page, and determine the typesetting index information corresponding to the first text page and the second text page; then send the page text content in the first text page and the second text page, and the typesetting index information to the wearable AR device, so that the wearable AR device displays a third text page through the typesetting index information, wherein the text content displayed in the first line of the first text page is synchronously displayed on the first line of the third text page. In the above technical solution of this embodiment, the typesetting index information sent by the smart device to the wearable AR device is equivalent to the typesetting information formed based on the smart terminal. The wearable AR device can realize the typesetting of the text content based on the typesetting index information. This typesetting method can ensure that the first line of the formed text page can present the content of the first line of the text page on the smart device side. When the same text content is displayed on two devices, the display effect of the first text content on the displayed text page can be better achieved. The technical solution of this embodiment better optimizes the data synchronization mechanism between the smart device and the wearable AR device, and improves the synchronization usage experience.
[0179] Optionally, the device may further include:
[0180] A first receiving module is used to receive a first sliding instruction, where the first sliding instruction is generated by the smart device through a first sliding event triggered, or is sent by the wearable AR device;
[0181] The second display module is used to display a first text page with a first target text line as the first line, and the text content of the first target text line is synchronously displayed starting from the first line of the text page displayed by the wearable AR device, wherein the first target text line is determined based on the first sliding instruction.
[0182] Furthermore, the device further includes: a first determining module, wherein the first determining module can be specifically configured to:
[0183] When the first sliding instruction is generated by the smart device, first sliding information corresponding to triggering the first sliding event is parsed from the first sliding instruction, and the first target text line is determined from the first text page according to the first sliding information;
[0184] When the first sliding instruction is sent by the wearable AR device, the target row identifier contained in the first sliding instruction is parsed and recorded as the first target row identifier, and the first target text row corresponding to the first target row identifier is determined from the first text page, wherein the first target row identifier is determined by the wearable AR device based on the determined second sliding information.
[0185] Furthermore, the device may also include: a first instruction sending module, configured to:
[0186] After determining the first target text row from the first text page according to the first sliding information, sending a second sliding instruction to the wearable AR device so that the wearable AR device responds to the second sliding instruction, wherein the second sliding instruction includes a target row identifier of the first target text row.
[0187] Optionally, the device may further include:
[0188] A second receiving module is used to receive a first page turning instruction, where the first page turning instruction is generated by the smart device through a first page turning event triggered, or is sent by the wearable AR device;
[0189] The third display module is used to display the fourth text page corresponding to the first page turning instruction as a new first text page, and the first line of text content in the fourth text page is synchronously displayed starting from the first line of the text page displayed by the wearable AR device.
[0190] Furthermore, the device may further include a second determining module, and the second determining module may be specifically configured to:
[0191] When the first page turning instruction is generated by the smart device, first page turning information corresponding to the triggering of the first page turning event is parsed from the first page turning instruction, and the fourth text page is selected from the second text page according to the first page turning information;
[0192] When the first page turning instruction is sent by the wearable AR device, the first page turning instruction is parsed to obtain the first line identifier of the page turning page contained therein, and the fourth text page is selected from the second text page according to the first line identifier of the page turning page, wherein the first line identifier of the page turning page is determined by the wearable AR device according to the determined second page turning information and the typesetting index information.
[0193] Furthermore, the device may also include: a second instruction sending module, configured to:
[0194] After selecting the fourth text page from the second text page according to the first page turning information, determine the text line identifier of the first line in the fourth text page as the text first line identifier, and send a second page turning instruction including the text first line identifier to the wearable AR device, so that the wearable AR device responds to the second page turning instruction.
[0195] A content synchronization display device provided by an embodiment of the present invention can execute the content synchronization display method provided by any embodiment of the present invention applied to a smart device, and has functional modules and beneficial effects corresponding to the execution method.
[0196] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present invention.
[0197] In this specific embodiment, the structure of the content synchronization display device is given from the perspective of a wearable AR device. Specifically, Figure 5 This is a schematic diagram of the structure of a content synchronization display device provided by an embodiment of the present invention. The embodiment of the present invention is applicable to the case where the text content on a wearable AR device and a smart device is synchronously displayed. The device can be implemented in the form of software and / or hardware. Optionally, it can be implemented by a wearable AR device. The wearable AR device is preferably AR glasses, AR helmets, etc. The wearable AR device and the smart device are connected in advance through short-range wireless communication. Figure 5 As shown, the device may include: an information receiving module 51 and a fourth display module 52, wherein:
[0198] The information receiving module 51 is used to receive the page text content and typesetting index information sent by the smart device;
[0199] The fourth display module 52 is used to display the third text page. The AR page text content and content layout presented in the third text page are determined according to the page text content and the layout index information. The first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.
[0200] The above technical solution of this embodiment receives the page text content and layout index information sent by the smart device on the wearable AR device end, parses the received information and makes the first line of text content in the first text page displayed by the smart device start to be displayed on the first line of the third text page synchronously, so as to realize the synchronous display of the smart device and the wearable AR device.
[0201] Furthermore, the device further includes: a third determining module, and the third determining module can be specifically used to:
[0202] Obtain the set AR page size, and parse the typesetting index information to obtain the first line identification information and paragraph mark information;
[0203] Determine a text starting point from the terminal text content according to the first line identification information, and obtain the to-be-displayed text content of the page size from the terminal text content starting from the text starting point;
[0204] The text content to be displayed is divided into paragraphs according to the paragraph mark information, and the third text page is constructed based on the text content after the paragraph division.
[0205] Optionally, the device may further include:
[0206] A third receiving module is used to receive a second sliding instruction, where the second sliding instruction is sent by the smart device or generated by the wearable AR device through a second sliding event triggered;
[0207] The fifth display module is used to display a third text page with a second target text line as the first line, and the text content of the second target text line is displayed synchronously starting from the first line of the text page displayed by the smart device, wherein the second target text line is determined based on the second sliding instruction.
[0208] Furthermore, the device further includes: a fourth determining module, and the fourth determining module can be specifically used to:
[0209] When the second sliding instruction is generated by the wearable AR device, second sliding information corresponding to triggering the second sliding event is parsed from the second sliding instruction, and the second target text line is determined from the third text page according to the second sliding information;
[0210] When the second sliding instruction is sent by the smart device, the target row identifier contained in the second sliding instruction is parsed and recorded as the second target row identifier, and the second target text row corresponding to the second target row identifier is determined from the third text page, wherein the second target row identifier is determined by the smart device based on the determined first sliding information.
[0211] Furthermore, the device may further include: a third instruction sending module, configured to:
[0212] After determining the second target text line from the third text page according to the second sliding information, a first sliding instruction is sent to the smart device so that the smart device responds to the first sliding instruction, wherein the first sliding instruction includes a target line identifier of the second target text line.
[0213] Optionally, the device may further include:
[0214] a fourth receiving module, configured to receive a second page turning instruction, where the second page turning instruction is generated by a second page turning event triggered by the wearable AR device, or is sent by the smart device;
[0215] The sixth display module is used to display the fifth text page corresponding to the second page turning instruction as a new third text page, and the first line of text content in the fifth text page is synchronously displayed starting from the first line of the text page displayed by the smart device.
[0216] Furthermore, the device further includes: a fifth determining module, and the fifth determining module can be specifically configured to:
[0217] When the second page turning instruction is generated by the wearable AR device, second page turning information corresponding to the triggering of the second page turning event is parsed from the second page turning instruction, and the fifth text page is determined according to the second page turning information combined with the typesetting index information;
[0218] When the second page turning instruction is sent by the smart device, the second page turning instruction is parsed to obtain the first line identifier of the text contained therein, and the fifth text page is determined based on the first line identifier of the text in combination with the typesetting index information, wherein the first line identifier of the text is the text line identifier of the first line in the fourth text page determined on the smart device.
[0219] Furthermore, the device may further include: a fourth instruction sending module, configured to:
[0220] After determining the fifth text page according to the second page turning information combined with the typesetting index information, determine the text line identifier of the first line in the fifth text page as the first line identifier of the page turning page, and send a first page turning instruction including the first line identifier of the page turning page to the smart device, so that the smart device responds to the first page turning instruction.
[0221] The content synchronization display device provided in the embodiment of the present invention can execute the content synchronization display method provided in any embodiment of the present invention applied to a wearable AR device, and has the corresponding functional modules and beneficial effects of the execution method.
[0222] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present invention.
[0223] Figure 6 A schematic diagram of the structure of an intelligent device provided for an embodiment of the present invention. Intelligent devices are intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.
[0224] like Figure 6 As shown, the smart device 60 includes at least one processor 61, and a memory connected to the at least one processor 61, such as a read-only memory (ROM) 62, a random access memory (RAM) 63, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 61 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 62 or the computer program loaded from the storage unit 68 to the random access memory (RAM) 63. In the RAM 63, various programs and data required for the operation of the smart device 60 can also be stored. The processor 61, the ROM 62, and the RAM 63 are connected to each other via a bus 64. An input / output (I / O) interface 65 is also connected to the bus 64.
[0225] A number of components in the smart device 60 are connected to the I / O interface 65, including: an input unit 66, such as a keyboard, a mouse, etc.; an output unit 67, such as various types of displays, speakers, etc.; a storage unit 68, such as a disk, an optical disk, etc.; and a communication unit 69, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 69 allows the smart device 60 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0226] The processor 61 may be a variety of general and / or dedicated processing components with processing and computing capabilities. Some examples of the processor 61 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 65 executes the methods and processes described above for the smart device, such as the content synchronization display method.
[0227] In some embodiments, the content synchronization display method can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 68. In some embodiments, part or all of the computer program can be loaded and / or installed on the smart device 60 via the ROM 62 and / or the communication unit 69. When the computer program is loaded into the RAM 63 and executed by the processor 61, one or more steps of the content synchronization display method described above can be performed. Alternatively, in other embodiments, the processor 61 can be configured to execute the content synchronization display method on the smart device side in any other appropriate manner (for example, by means of firmware).
[0228] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0229] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0230] Figure 7 A schematic diagram of the structure of a wearable augmented reality device provided by an embodiment of the present invention. The wearable augmented reality device is intended to represent various forms of smart wearable devices, such as helmets, glasses, watches, etc. The components shown herein, their connections and relationships, and their functions are only examples and are not intended to limit the implementation of the present invention described and / or required herein.
[0231] like Figure 7 As shown, the wearable augmented reality device 70 includes a wearable body 71, at least one controller 72 loaded on the wearable body 71, and a memory connected to the at least one controller 72 in communication, such as a read-only memory (ROM) 73, a random access memory (RAM) 74, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the controller 72 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 73 or the computer program loaded from the storage unit 79 to the random access memory (RAM) 74. In RAM 73, various programs and data required for the operation of the wearable body 71 can also be stored. The controller 72, ROM 73 and RAM 74 are connected to each other through a bus 75. An input / output (I / O) interface 76 is also connected to the bus 75.
[0232] Multiple components in the wearable augmented reality device 70 are connected to the I / O interface 76, including: an input unit 77, such as a keyboard, a mouse, etc.; an output unit 78, such as various types of displays, speakers, etc.; a storage unit 79, such as a disk, an optical disk, etc.; and a communication unit 30, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 30 allows the wearable augmented reality device 70 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0233] The controller 72 may be a variety of general and / or dedicated processing components with processing and computing capabilities. Some examples of the controller 72 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The controller 72 executes the various methods and processes described above for use in wearable AR devices, such as a content synchronization display method.
[0234] In some embodiments, the content synchronization display method can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 79. In some embodiments, part or all of the computer program can be loaded and / or installed on the wearable augmented reality device 70 via the ROM 73 and / or the communication unit 30. When the computer program is loaded into the RAM 74 and executed by the controller 72, one or more steps of the content synchronization display method described above can be performed. Alternatively, in other embodiments, the controller 72 can be configured to perform the content synchronization display method in any other appropriate manner (for example, by means of firmware).
[0235] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0236] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0237] The embodiment of the present invention provides a computer storage medium. In the context of the present invention, a computer readable storage medium may be a tangible medium that may contain or store a computer program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. The computer readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the above. Alternatively, the computer readable storage medium may be a machine readable signal medium. A more specific example of a machine readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0238] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).
[0239] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.
[0240] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.
[0241] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.
[0242] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims
1. A content synchronization display method, characterized in that: Applied to a smart device, the smart device establishes a connection with a wearable augmented reality (AR) device via short-range wireless communication, and the method comprises: Display the first text page; Determining a second text page associated with the first text page, and determining typesetting index information corresponding to the first text page and the second text page; Sending the page text content in the first text page and the second text page, and the typesetting index information to the wearable AR device, so that the wearable AR device displays a third text page through the page text content and the typesetting index information; Among them, the text content displayed in the first line of the first text page is synchronously displayed on the first line of the third text page.
2. The method according to claim 1, characterized in that Also includes: Receiving a first sliding instruction, where the first sliding instruction is generated by the smart device through a first sliding event triggered, or is sent by the wearable AR device; Displaying a first text page with a first target text line as the first line, wherein the text content of the first target text line is synchronously displayed starting from the first line of the text page displayed by the wearable AR device; The first target text row is determined based on the first sliding instruction.
3. The method according to claim 2, characterized in that The step of determining the first target text line based on the first sliding instruction includes: When the first sliding instruction is generated by the smart device, first sliding information corresponding to triggering the first sliding event is parsed from the first sliding instruction, and the first target text line is determined from the first text page according to the first sliding information; When the first sliding instruction is sent by the wearable AR device, a target row identifier included in the first sliding instruction is parsed and recorded as a first target row identifier, and a first target text row corresponding to the first target row identifier is determined from the first text page; The first target row identifier is determined by the wearable AR device according to the determined second sliding information.
4. The method according to claim 3, characterized in that After determining the first target text line from the first text page according to the first sliding information, the method further includes: A second sliding instruction is sent to the wearable AR device, so that the wearable AR device responds to the second sliding instruction, where the second sliding instruction includes a target row identifier of the first target text row.
5. The method according to claim 1, characterized in that Also includes: Receiving a first page turning instruction, where the first page turning instruction is generated by the smart device through a first page turning event triggered, or is sent by the wearable AR device; The fourth text page corresponding to the first page turning instruction is displayed as a new first text page, and the first line of text content in the fourth text page is synchronously displayed starting from the first line of the text page displayed by the wearable AR device.
6. The method according to claim 5, characterized in that The step of determining the fourth text page comprises: When the first page turning instruction is generated by the smart device, first page turning information corresponding to the triggering of the first page turning event is parsed from the first page turning instruction, and the fourth text page is selected from the second text page according to the first page turning information; When the first page turning instruction is sent by the wearable AR device, the first page turning instruction is parsed to obtain the first line identifier of the page turning page contained therein, and the fourth text page is selected from the second text page according to the first line identifier of the page turning page; The first line identifier of the page turning page is determined by the wearable AR device according to the determined second page turning information and the typesetting index information.
7. The method according to claim 6, characterized in that After selecting the fourth text page from the second text page according to the first page turning information, the method further includes: Determine that the text line identifier of the first line in the fourth text page is recorded as the text first line identifier, and send a second page turning instruction including the text first line identifier to the wearable AR device, so that the wearable AR device responds to the second page turning instruction.
8. A content synchronous display method, characterized in that: Applied to a wearable augmented reality (AR) device, the wearable AR device establishes a connection with a smart device via short-range wireless communication, and the method includes: Receiving page text content and typesetting index information sent by the smart device; A third text page is displayed, wherein the AR page text content and content layout presented in the third text page are determined according to the page text content and the layout index information, and the first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.
9. The method according to claim 8, characterized in that The step of determining the third text page includes: Obtain the set AR page size, and parse the typesetting index information to obtain the first line identification information and paragraph mark information; Determine a text starting point from the terminal text content according to the first line identification information, and obtain the to-be-displayed text content of the page size from the terminal text content starting from the text starting point; The text content to be displayed is divided into paragraphs according to the paragraph mark information, and the third text page is constructed based on the text content after the paragraph division.
10. The method according to claim 8, characterized in that Also includes: receiving a second sliding instruction, where the second sliding instruction is sent by the smart device or generated by the wearable AR device through a triggered second sliding event; Displaying a third text page with the second target text line as the first line, wherein the text content of the second target text line is synchronously displayed starting from the first line of the text page displayed by the smart device; The second target text row is determined based on the second sliding instruction.
11. The method according to claim 10, characterized in that The step of determining the second target text line based on the second sliding instruction includes: When the second sliding instruction is generated by the wearable AR device, second sliding information corresponding to triggering the second sliding event is parsed from the second sliding instruction, and the second target text line is determined from the third text page according to the second sliding information; When the second sliding instruction is sent by the smart device, a target row identifier included in the second sliding instruction is parsed and recorded as a second target row identifier, and a second target text row corresponding to the second target row identifier is determined from the third text page; The second target row identifier is determined by the smart device according to the determined first sliding information.
12. The method according to claim 11, characterized in that After determining the second target text line from the third text page according to the second sliding information, the method further includes: A first sliding instruction is sent to the smart device so that the smart device responds to the first sliding instruction, wherein the first sliding instruction includes a target row identifier of the second target text row.
13. The method according to claim 8, characterized in that Also includes: receiving a second page turning instruction, where the second page turning instruction is generated by a second page turning event triggered by the wearable AR device or is sent by the smart device; The fifth text page corresponding to the second page turning instruction is displayed as a new third text page, and the first line of text content in the fifth text page is synchronously displayed starting from the first line of the text page displayed by the smart device.
14. The method according to claim 13, characterized in that The step of determining the fifth text page comprises: When the second page turning instruction is generated by the wearable AR device, second page turning information corresponding to the triggering of the second page turning event is parsed from the second page turning instruction, and the fifth text page is determined according to the second page turning information combined with the typesetting index information; When the second page turning instruction is sent by the smart device, the second page turning instruction is parsed to obtain the text first line identifier contained therein, and the fifth text page is determined according to the text first line identifier combined with the typesetting index information; The text first line identifier is a text line identifier of the first line in the fourth text page determined on the smart device.
15. The method according to claim 14, characterized in that After determining the fifth text page according to the second page turning information in combination with the typesetting index information, the method further includes: Determine that the text line identifier of the first line in the fifth text page is recorded as the first line identifier of the page turning page, and send a first page turning instruction including the first line identifier of the page turning page to the smart device, so that the smart device responds to the first page turning instruction.
16. A content synchronization display device, characterized in that: The device is configured on a smart device, wherein the smart device is connected to the wearable augmented reality (AR) device via short-range wireless communication, and the device comprises: A first display module, used to display a first text page; An information determination module, used to determine a second text page associated with the first text page, and to determine typesetting index information corresponding to the first text page and the second text page; an information sending module, configured to send the page text content in the first text page and the second text page, and the typesetting index information to the wearable AR device, so that the wearable AR device displays a third text page through the typesetting index information; Among them, the text content displayed in the first line of the first text page is synchronously displayed on the first line of the third text page.
17. A content synchronization display device, characterized in that: The device is configured in a wearable augmented reality (AR) device, wherein the wearable AR device is connected to a smart device via short-range wireless communication, and the device comprises: An information receiving module, used to receive the page text content and typesetting index information sent by the smart device; The fourth display module is used to display a third text page. The AR page text content and content layout presented in the third text page are determined according to the page text content and the layout index information. The first line of text content in the first text page displayed on the smart device is synchronously displayed starting from the first line of the third text page.
18. A smart device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the content synchronous display method according to any one of claims 1 to 7.
19. A wearable augmented reality device, characterized in that: include: Wearable body; as well as at least one controller mounted on the wearable body; as well as a memory communicatively coupled to the at least one controller, wherein: The memory stores a computer program executable by the at least one controller, and the computer program is executed by the at least one controller so that the at least one controller can perform the content synchronous display method according to any one of claims 8 to 15.
20. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor or a controller to implement the content synchronization display method according to any one of claims 1 to 15 when executed.
Citation Information
Patent Citations
Method and system for controlling virtual reality device based on intelligent wearable device
CN106371602A
Auxiliary listening character near-to-eye display vertical display adjustment method, control device and system
CN111243100A
Text information display method and device, storage medium and electronic equipment
CN113849249A
Method, device and equipment for mobile terminal to store application page and medium
CN114510308A
Context triggered augmented reality
CN116171566A