State early warning method and device of portable display equipment and storage medium

Abstract

The invention relates to the technical field of virtual display, and discloses a state early warning method and device for portable display equipment and a storage medium, and the method comprises the following steps: recording an obtained timestamp as a first time point based on an obtained starting instruction; calculating a second time point according to the first time point and a set time period; at the second time point, popping up interaction content; wherein the interaction content comprises an identifier moving along a preset first path; according to the invention, the fatigue state of the juvenile after using the portable display device for a long time can be pre-warned.

Description

Technical Field

[0001] The present application relates to the field of virtual display, and in particular to a state warning method, device and storage medium for a portable display device. Background Art

[0002] With the development of display technology, the virtual display technology of portable display devices is becoming more and more perfect, for example, helmet-type display devices or smart glasses.

[0003] Among them, smart glasses are like smartphones and have independent operating systems. Users can install software, games and other programs provided by software service providers on smart glasses. Smart glasses can be controlled by voice or motion to add schedules, map navigation, interact with friends, take photos and videos, and make video calls with friends. They can also access wireless networks through mobile communication networks. Users can use portable display devices to immersively experience game works or film and television works, and can also use them to interact in specific simulation scenes.

[0004] Good experience has greatly expanded the user group of portable display devices, including some minors. When minors use portable display devices for a long time, they may feel uncomfortable, such as eye fatigue. Therefore, a method for early warning of fatigue state of minors after long-term use of portable display devices is needed. Summary of the invention

[0005] In order to warn minors of fatigue after using a portable display device for a long time, the present application provides a status warning method, device and storage medium for a portable display device.

[0006] On the one hand, the present application provides a status warning method for a portable display device, which adopts the following technical solution:

[0007] A status warning method for a portable display device comprises the following steps:

[0008] The timestamp acquired based on the acquired startup instruction record is the first time point;

[0009] Calculating a second time point according to the first time point and a set time period;

[0010] At the second time point, pop up interactive content;

[0011] The interactive content includes an identifier moving along a preset first path.

[0012] By adopting the above technical solution and setting the usage time, when the calculated second time node is reached, the interactive content moves according to the preset movement mode, so as to provide an early warning prompt to the user.

[0013] Optionally, before the step of obtaining the start instruction, the following sub-steps are also included:

[0014] Get the user's facial data;

[0015] Adapting age data from a preset database according to the facial data;

[0016] The age data is compared with the age standard. If the age data matches the preset underage age, the start instruction is waited for; otherwise, the start instruction is blocked.

[0017] By adopting the above technical solution, the corresponding age is matched by using face recognition, so as to verify the user age of the portable display device. If the set conditions are not met, the display device will not be started, thereby fundamentally reducing the use time of the portable display device by the set group of people.

[0018] Optionally, the step of popping up the interactive content further includes the following sub-steps:

[0019] Identify the change value of pixels in a preset area in the current display content;

[0020] The area with the largest change value is used as the pop-up area;

[0021] The interactive content is displayed in the pop-up area.

[0022] By adopting the above technical solution, the area with the largest change value is often the area where the user is concerned or the area where the user's attention is attracted; therefore, the interactive content popping up at this location is easier to be noticed, thus achieving a better prompt effect.

[0023] Optionally, the step of moving along the preset first path further includes the following sub-steps:

[0024] According to the position of the interactive content on the first path, the brightness of the content displayed next to the interactive content is adjusted; the lower the completion of the interactive content on the first path, the brighter the content displayed next to the interactive content; the higher the completion of the interactive content on the first path, the darker the content displayed next to the interactive content.

[0025] By adopting the above technical solution, in the process of interactive content moving prompts, the degree of completion is used as an influencing factor of the brightness of the content displayed next to the interactive content, and the setting is from strong to weak, with high brightness reminders around from the beginning to attract more attention. When the user notices it, the surrounding brightness can be appropriately reduced. One is to reduce the stimulation to the eyes caused by high brightness for a long time, and the other is to help rationally plan the use and distribution of electricity.

[0026] Optionally, the step of popping up the interactive content further includes the following sub-steps:

[0027] Get the user's facial data;

[0028] identifying a user's pupil location from the facial data;

[0029] Establishing the corresponding position of the pupil position and the display area;

[0030] The interactive content is displayed at a position in the display area corresponding to the pupil position.

[0031] By adopting the above technical solution, the interactive content can also be set according to the recognition of the position of the pupil of the eye and in accordance with the visual direction of the user. Therefore, the user is more likely to see the interactive content, further improving the effect of the prompt.

[0032] Optionally, the step of moving along the preset first path further includes the following sub-steps:

[0033] When the interactive content moves to the end point of the first path, waiting for the pupil position to reach the end point of the first path;

[0034] After the pupil position reaches the end point of the first path, taking the current position of the interactive content as the starting point, a terminal point is randomly generated in an area of ​​the display area that the interactive content has not passed through to update the first path, so that the interactive content moves along the updated first path.

[0035] By adopting the above technical solution, the interactive content is displayed in a loop, and the positioning of the pupil is used as a condition for starting the next displacement, so as to further improve the warning effect.

[0036] Optionally, the length of the first path is set in a positive correlation with the number of updates.

[0037] By adopting the above technical solution, the longer the movement time of the interactive content is, the longer the time to wait for the pupil to reach the end point of the first path is, so multiple updates are required to improve the effect of the early warning.

[0038] Optionally, the arc of the first path is set in a positive correlation with the number of updates.

[0039] By adopting the above technical solution, the larger the curvature of the first path is, the easier it is to deviate from the corresponding area of ​​the pupil. Therefore, providing multiple prompts is beneficial to further improve the effect of the early warning.

[0040] On the other hand, the present application provides a status warning device for a portable display device, which adopts the following technical solution:

[0041] A status warning device for a portable display device comprises a processor, wherein a program of the status warning method for the portable display device is running in the processor.

[0042] On the other hand, the present application provides a computer-readable storage medium, which adopts the following technical solution:

[0043] A computer-readable storage medium stores a program of the above-mentioned status warning method of the portable display device.

[0044] In summary, the present application includes at least one of the following beneficial technical effects:

[0045] 1. Pop up at a fixed time and move along the set path to give an early warning;

[0046] 2. Determine the interactive content pop-up area based on the pixel changes of the image, which helps to achieve better warning effects;

[0047] 3. Restrict the user’s age through facial recognition;

[0048] 4. The pop-up position of the interactive content is affected by the position of the pupil. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 This is a flowchart of the steps of a status warning method for a portable display device of the present application.

[0050] Figure 2 This application is a status warning method for a portable display device, a trajectory diagram of a first path moving left and right.

[0051] Figure 3 This application is a status warning method for a portable display device, a trajectory diagram of the first path moving up and down.

[0052] Figure 4 This is a status warning method for a portable display device of the present application, a sub-step flow chart before the step of obtaining a start instruction.

[0053] Figure 5 This is a status warning method for a portable display device of the present application, a sub-step flowchart in the step of popping up interactive content.

[0054] Figure 6 The present application discloses a status warning method for a portable display device, and a brightness change diagram of content displayed next to interactive content.

[0055] Figure 7 This is another sub-step flow chart of the step of popping up interactive content in a status warning method for a portable display device of the present application.

[0056] Figure 8 The present application discloses a status warning method for a portable display device, which displays a trajectory diagram of interactive content according to changes in a through hole.

[0057] Fig. 9 This is a flowchart of sub-steps in a step of moving along a preset first path in a status warning method for a portable display device of the present application.

[0058] Fig.10 The present application discloses a status warning method for a portable display device, wherein the first path has a path diagram with a larger curvature.

[0059] Fig.11 The present application discloses a status warning method for a portable display device, wherein the first path has a path diagram with a smaller curvature. DETAILED DESCRIPTION

[0060] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0061] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0062] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0063] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0064] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0065] The present application embodiment discloses a state warning method for a portable display device, referring to Figure 1 , including the following steps:

[0066] The timestamp acquired based on the acquired startup instruction record is the first time point;

[0067] Calculating a second time point according to the first time point and a set time period;

[0068] At the second time point, the interactive content pops up; the interactive content includes an identifier moving along the preset first path. The identifier can be a prompt identifier, a 3D video of the visual fatigue link, the lens changing to a light-transmitting mode, etc. The prompt identifier can be in the form of text, pictures, or symbols.

[0069] The start command is a command to start the portable display device, which can be started by a button or voice control. The set time is set to, for example, half an hour, and when the time comes, the interactive content pops up and moves in a preset way, thereby providing an early warning to the user, which helps protect eyesight. Figure 2 and Figure 3 The preset moving path can be from left to right, or from top to bottom, or along a certain curve trajectory.

[0070] Reference Figure 4 , before the step of obtaining the start instruction, the following sub-steps are also included:

[0071] Get the user's facial data;

[0072] Adapting age data from a preset database based on facial data;

[0073] The age data is compared with the age standard. If the age data matches the preset underage age, the system starts waiting for the start instruction; otherwise, the start instruction is blocked.

[0074] It can be acquired by taking photos with a camera, and then face recognition is performed on the photos taken, mainly to identify facial features, and then match the corresponding age based on these features. For example, when the identified age is younger, in order to protect the user's eyesight, it will not be open to younger users; thus verifying the age of users of portable display devices. If the age is less than the preset condition value, the display device will not start, which fundamentally reduces the use time of the set group of people for the portable display device.

[0075] Reference Figure 5The step of popping up interactive content also includes the following sub-steps:

[0076] Identify the change value of pixels in a preset area in the current display content;

[0077] The area with the largest change value is used as the pop-up area;

[0078] Display interactive content in a popup area.

[0079] In the process of displaying a general dynamic image, not all pixels will change frequently. For example, if a person or car in the image moves, there will be pixel changes in specific areas, and these changes can attract people's attention. The attention will follow these dynamic pixel changes. In the area with the largest change value, it is more conducive to the user's attention or attention being attracted; therefore, popping up interactive content at this place can have a better prompt effect.

[0080] Reference Figure 6 The step of moving along the preset first path further includes the following sub-steps:

[0081] According to the position of the interactive content on the first path, the brightness of the content displayed next to the interactive content is adjusted; the lower the completion of the interactive content on the first path, the brighter the content displayed next to the interactive content; the higher the completion of the interactive content on the first path, the darker the content displayed next to the interactive content.

[0082] Due to the brightness of the content displayed next to the interactive content, the interactive content will be more eye-catching; the brightness of the content displayed next to the interactive content is adjusted variably. Taking the completion of the path as a reference factor, the brightness is changed from strong to weak during the movement. From the beginning, the surrounding high brightness reminder attracts more attention. When the user notices it, the surrounding brightness can be appropriately reduced. One is to reduce the stimulation of the eyes to the high brightness for a long time, and the other is to help rationally plan the use and distribution of electricity.

[0083] Reference Figure 7 and Figure 8 The step of popping up interactive content also includes the following sub-steps:

[0084] Get the user's facial data;

[0085] The user's pupil position is identified from the facial data; the pupil position is the visual area corresponding to the pupil, not the position of the pupil itself.

[0086] Establishing the corresponding position of the pupil position and the display area;

[0087] The interactive content is displayed at a position in the display area corresponding to the pupil position.

[0088] In addition to actively attracting the user's attention, you can also follow the user's attention to make early warning prompts. You can also use image recognition technology to track the position of the eye pupil in real time and set the interactive content according to the user's visual direction. This makes it easier for users to see the interactive content, so the early warning effect is better.

[0089] Reference Fig. 9 The step of moving along the preset first path further includes the following sub-steps:

[0090] When the interactive content moves to the end point of the first path, wait for the pupil position to reach the end point of the first path;

[0091] After the pupil position reaches the end point of the first path, the first path is updated by randomly generating an end point in an area of ​​the display area that the interactive content has not passed through, taking the current position of the interactive content as the starting point, so that the interactive content moves along the updated first path.

[0092] It enables interaction between the user and the display device, and starts the first path of the next update, which helps to ensure that the user notices the prompt. After confirmation, the next prompt is started immediately, which ensures that the dynamics of the prompt can be noticed in the visual area of ​​the pupil, so it can better attract attention and have a better early warning effect. The interactive content is displayed in a loop, and the path is updated to avoid the interactive content being difficult to notice or causing visual fatigue, so as to attract the user's attention as much as possible, and the positioning of the pupil is used as a condition for starting the next displacement, further improving the effect of the early warning.

[0093] The length of the first path is set in positive correlation with the number of updates.

[0094] The longer the interactive content moves, the slower it moves, or the wider the display screen of the display device is, the less likely it is to attract the user's attention. Therefore, multiple updates are required to cyclically display the prompt content. Alternatively, the longer the interactive content moves, the longer it takes to wait for the pupil to reach the end of the first path, so the user's attention is not attracted enough by the pop-up prompt action. Therefore, multiple updates are required to cyclically display the prompt content to improve the warning effect.

[0095] Reference Fig.10 and Fig.11 ,The radian of the first path is set in positive correlation with the number of updates.

[0096] The larger the arc of the first path, the smaller the moving area, or the more difficult it is to enter the corresponding area of ​​the pupil when the pupil is focused on other positions. Therefore, multiple loop prompts are provided to further improve the warning effect. Conversely, the smaller the arc, the wider the area covered by the movement trajectory, and therefore, it is easier to be noticed.

[0097] An embodiment of the present application discloses a status warning device for a portable display device, including a processor, in which a program of the status warning method for the portable display device described above is executed.

[0098] The embodiment of the present application discloses a computer-readable storage medium storing a program of the above-mentioned status warning method of the portable display device.

[0099] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0100] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0101] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0102] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0103] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0104] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to) and the technical solutions formed.

Claims

1. A status warning method for a portable display device, characterized in that: The steps include: The timestamp acquired based on the acquired startup instruction record is the first time point; Calculating a second time point according to the first time point and a set time period; At the second time point, pop up interactive content; The interactive content includes an identifier moving along a preset first path.

2. The status warning method of the portable display device according to claim 1, characterized in that: Before the step of obtaining the start instruction, the following sub-steps are also included: Get the user's facial data; Adapting age data from a preset database according to the facial data; Comparing the age data with the age standard, and if the age data matches the preset underage age, starting to wait for the start instruction; Otherwise, the start instruction is shielded.

3. The status warning method of the portable display device according to claim 1, characterized in that: The step of popping up the interactive content also includes the following sub-steps: Identify the change value of pixels in a preset area in the current display content; The area with the largest change value is used as the pop-up area; The interactive content is displayed in the pop-up area.

4. The status warning method of the portable display device according to claim 1, characterized in that: The step of moving along the preset first path further includes the following sub-steps: According to the position of the interactive content on the first path, the brightness of the content displayed next to the interactive content is adjusted; the lower the completion of the interactive content on the first path, the brighter the content displayed next to the interactive content; the higher the completion of the interactive content on the first path, the darker the content displayed next to the interactive content.

5. The status warning method of the portable display device according to claim 1, characterized in that: The step of popping up the interactive content also includes the following sub-steps: Get the user's facial data; identifying a user's pupil location from the facial data; Establishing the corresponding position of the pupil position and the display area; The interactive content is displayed at a position in the display area corresponding to the pupil position.

6. The status warning method of the portable display device according to claim 1, characterized in that: The step of moving along the preset first path further includes the following sub-steps: When the interactive content moves to the end point of the first path, waiting for the pupil position to reach the end point of the first path; After the pupil position reaches the end point of the first path, taking the current position of the interactive content as the starting point, a terminal point is randomly generated in an area of ​​the display area that the interactive content has not passed through to update the first path, so that the interactive content moves along the updated first path.

7. The status warning method of the portable display device according to claim 6, characterized in that: The length of the first path is set in a positive correlation with the number of updates.

8. The status warning method of the portable display device according to claim 6, characterized in that: The arc of the first path is set in a positive correlation with the number of updates.

9. A status warning device for a portable display device, characterized in that: The device comprises a processor, wherein a program of the status warning method of the portable display device as claimed in any one of claims 1 to 8 is run in the processor.

10. A computer-readable storage medium, characterized in that: A program storing the status warning method of the portable display device according to any one of claims 1 to 8.

Images