Viewing detection method and device based on head-mounted equipment, equipment and medium

Abstract

The invention discloses a watching detection method and device based on head-mounted equipment, equipment and a medium, and relates to the technical field of head-mounted equipment. The method is applied to a head-mounted device, and comprises the following steps: sending positioning information to a detected device; receiving positioning response information which is sent by the detected equipment and aims at the positioning information; determining a relative position between the detected device and the head-mounted device according to the positioning response information and the positioning information; and determining whether the wearer views the detected equipment or not according to the relative position. When the wearer of the head-mounted device is a teenager and the detected device is an electronic device such as a smart phone or a tablet personal computer, the method can realize checking and detection of the teenager on the electronic products such as the smart phone and the tablet personal computer.

Description

Technical Field

[0001] This application relates to the field of head-mounted display technology, and more specifically, to a viewing detection method, apparatus, device, and medium based on head-mounted devices. Background Technology

[0002] Currently, teenagers are experiencing excessive screen time on smartphones, tablets, and other electronic devices, leading to problems such as nearsightedness and internet addiction, which seriously affect their physical and mental health.

[0003] Therefore, how to detect teenagers' viewing of electronic products such as smartphones and tablets has become an urgent technical problem to be solved. Summary of the Invention

[0004] One objective of this application is to provide a new technical solution for viewing detection based on head-mounted devices.

[0005] According to a first aspect of this application, a viewing detection method based on a head-mounted device is provided, applied to a head-mounted device, the method comprising:

[0006] Send location information to the device being tested;

[0007] Receive positioning response information sent by the device under test in response to the positioning information;

[0008] Based on the positioning response information and the positioning information, the relative position between the detected device and the head-mounted device is determined;

[0009] Based on the relative position, it is determined whether the wearer is viewing the device being tested.

[0010] Optionally, the relative position includes: the relative distance between the detected device and the head-mounted device in the horizontal direction, a first included angle in the horizontal direction, and a second included angle in the vertical direction;

[0011] Determining whether the wearer has viewed the detected device based on the relative position includes:

[0012] If the relative distance is less than or equal to a preset distance, the first included angle is less than or equal to a first preset included angle, and the second included angle is less than or equal to a second preset included angle, it is determined that the wearer is viewing the device being tested.

[0013] Optionally, the relative position includes: the relative distance between the detected device and the head-mounted device in the horizontal direction, a first included angle in the horizontal direction, and a second included angle in the vertical direction;

[0014] Before determining whether the wearer has viewed the detected device based on the relative position, the method further includes:

[0015] Obtain the inertial conduction information of the head-mounted device;

[0016] Based on the inertial transmission information, determine the third included angle of the head-mounted device in the vertical direction;

[0017] Determining whether the wearer has viewed the detected device based on the relative position includes:

[0018] If the relative distance is less than or equal to a preset distance, the first included angle is less than or equal to a first preset included angle, and the difference between the second included angle and the third included angle is less than or equal to a second preset included angle, it is determined that the wearer is viewing the device being tested.

[0019] Optionally, the method further includes:

[0020] If it is determined that the wearer has viewed the device being tested, the device being tested will report the detection information of the wearer viewing the device being tested.

[0021] Optionally, the head-mounted device is equipped with a UWB activation device, and the step of sending the first positioning information to the device under test includes:

[0022] The UWB startup device is activated, and when the UWB startup device is activated, the UWB startup device sends positioning information to the device being tested.

[0023] The device under test is equipped with a UWB transponder, and receiving the positioning response information sent by the device under test includes:

[0024] Receive the positioning response information sent by the UWB response device in the device under test.

[0025] Optionally, sending location information to the device being detected includes:

[0026] Detecting whether the wearer is wearing the head-mounted device correctly;

[0027] In this case, location information is sent to the device being tested.

[0028] Optionally, determining whether the wearer has viewed the detected device based on the relative position includes:

[0029] Obtain the currently displayed content information reported by the device under test;

[0030] Based on the relative position and the currently displayed content information, it is determined whether the wearer is correctly viewing the device being tested.

[0031] According to a second aspect of this application, a viewing detection device based on a head-mounted device is provided, applied to a head-mounted device, the device comprising:

[0032] The sending module is used to send location information to the device being tested;

[0033] A receiving module is used to receive positioning response information sent by the device under test in response to the positioning information;

[0034] The first determining module is used to determine the relative position between the detected device and the head-mounted device based on the positioning response information and the positioning information;

[0035] The second determining module is used to determine whether the wearer has viewed the device being tested based on the relative position.

[0036] According to a third aspect of this application, a head-mounted device is provided, the head-mounted device comprising the means as described in the second aspect; or,

[0037] The head-mounted device includes a memory and a processor, the memory for storing computer instructions and the processor for retrieving the computer instructions from the memory to perform the method as described in any one of the first aspects.

[0038] According to a fourth aspect of this application, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the method according to any one of the first aspects.

[0039] This application provides a viewing detection method based on a head-mounted device, applied to a head-mounted device. The method includes: sending positioning information to a device under test; receiving positioning response information from the device under test in response to the positioning information; determining the relative position between the device under test and the head-mounted device based on the positioning response information; and determining whether the wearer is viewing the device under test based on the relative position. Based on this method, it is possible to determine whether the wearer is viewing the device under test by measuring the relative position between the head-mounted device and the device under test. Furthermore, when the wearer is a teenager and the device under test is an electronic device such as a smartphone or tablet, it is possible to detect whether the teenager is viewing smartphones or tablets.

[0040] Other features and advantages of this application will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0041] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of the present application and, together with their description, serve to explain the principles of the present application.

[0042] Figure 1 This is a framework of hardware configuration for a head-mounted device that implements a viewing detection method based on a head-mounted device, according to an embodiment of this application. Figure 1 ;

[0043] Figure 2 This is a flowchart illustrating a viewing detection method based on a head-mounted device, according to an embodiment of this application. Figure 1 ;

[0044] Figure 3 This is a flowchart illustrating a viewing detection method based on a head-mounted device, according to an embodiment of this application. Figure 2 ;

[0045] Figure 4 This is a schematic diagram of a viewing detection device based on a head-mounted device according to an embodiment of this application;

[0046] Figure 5 This is a framework of hardware configuration for a head-mounted device that implements a viewing detection method based on a head-mounted device, according to an embodiment of this application. Figure 2 . Detailed Implementation

[0047] Various exemplary embodiments of this application will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of this application.

[0048] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the scope of this application and its application or use.

[0049] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0050] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0051] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0052] Figure 1This is a framework of hardware configuration for a head-mounted device that implements a viewing detection method based on a head-mounted device, according to an embodiment of this application. Figure 1 .

[0053] The head-mounted device 100 may be, for example, an AR device, a MR device, or an XR device. The head-mounted device 100 may include a processor 101, a memory 102, an interface device 103, a communication device 104, a display device 105, an input device 106, a speaker 107, a microphone 108, a positioning device 109, and a sensing device 110, etc. The processor 101 may be a central processing unit (CPU), a microprocessor (MCU), etc. The memory 102 may include, for example, ROM (Read-Only Memory), RAM (Random Access Memory), or non-volatile memory such as a hard disk. The interface device 103 may include, for example, a USB interface or a headphone jack. The communication device 104 may be capable of wired or wireless communication. The display device 105 may be, for example, an LCD screen or a touch screen. The input device 106 may include, for example, a touchscreen or a keyboard. The user can input / output voice information through the speaker 107 and the microphone 108. The positioning device 109 may specifically be a UWB activation device. The sensing device 110 may specifically be an inertial conduction device.

[0054] Despite Figure 1 The head-mounted device 100 shows multiple devices, but this application may only involve some of them. For example, the head-mounted device 100 may only involve the memory 120 and the processor 110.

[0055] In the embodiments applied in this application, the memory 1200 of the head-mounted device 100 is used to store instructions for controlling the processor 110 to execute the viewing detection method based on the head-mounted device provided in the embodiments of this application.

[0056] In the above description, those skilled in the art can design instructions based on the scheme disclosed in this application. How the instructions control the processor to operate is well known in the art, and therefore will not be described in detail here.

[0057] This application provides a viewing detection method based on a head-mounted device, which is applied to, for example... Figure 1 The head-mounted device shown. (As shown) Figure 2 As shown, the method includes the following steps S2100 to S2400.

[0058] Step S2100: Send location information to the device being tested.

[0059] In this embodiment, the device being tested can be a smartphone, tablet computer, etc.

[0060] Additionally, the head-mounted device sends positioning information to the device under test to determine the relative position between the device under test and the head-mounted device based on the following steps S2200 and S2300.

[0061] It is understandable that the head-mounted device is positioned in the same direction as the wearer's eyes; therefore, the relative position between the device being tested and the head-mounted device can represent the relative position between the device being tested and the wearer's eyes.

[0062] In one embodiment of this application, positioning information can be sent to the device under test at set time intervals, which can avoid the problem of high power consumption of the head-mounted device caused by sending positioning information to the device under test in real time.

[0063] Step S2200: Receive positioning response information sent by the device under test regarding the positioning information.

[0064] In this embodiment, the device under test has the function of generating positioning response information in response to positioning information sent by the head-mounted device. Based on this, after the head-mounted device sends positioning information to the device under test, the device under test receives the positioning information, responds to the positioning information to generate positioning response information, and then sends it back to the head-mounted device so that the head-mounted device can determine the relative position between the device under test and the head-mounted device.

[0065] Step S2300: Determine the relative position between the device being tested and the head-mounted device based on the positioning response information and the positioning information.

[0066] Step S2400: Determine whether the wearer has viewed the device being tested based on the relative position.

[0067] Based on this, after the head-mounted device determines the relative position between itself and the device under test, it determines whether the device under test is within the field of view of the head-mounted device and whether it is within a certain distance. If so, it is determined that the wearer of the head-mounted device is viewing the device under test. Otherwise, it is determined that the wearer of the head-mounted device is not viewing the device under test.

[0068] Based on steps S2100 to S2400, it is possible to determine whether the wearer has viewed the device being tested by measuring the relative position between the head-mounted device and the device being tested. Therefore, when the wearer is a teenager and the device being tested is an electronic device such as a smartphone or tablet, it is possible to detect whether the teenager has viewed the smartphone or tablet.

[0069] This application provides a viewing detection method based on a head-mounted device, applied to a head-mounted device. The method includes: sending positioning information to a device under test; receiving positioning response information from the device under test in response to the positioning information; determining the relative position between the device under test and the head-mounted device based on the positioning response information; and determining whether the wearer is viewing the device under test based on the relative position. Based on this method, it is possible to determine whether the wearer is viewing the device under test by measuring the relative position between the head-mounted device and the device under test. Furthermore, when the wearer is a teenager and the device under test is an electronic device such as a smartphone or tablet, it is possible to detect whether the teenager is viewing smartphones or tablets.

[0070] In one embodiment of this application, the relative position includes: the relative distance between the detected device and the head-mounted device in the horizontal direction, a first angle in the horizontal direction, and a second angle in the vertical direction. Based on this, the above-mentioned step S2400 is specifically implemented through the following step S2410.

[0071] Step S2410: If the relative distance is less than or equal to a preset distance, the first included angle is less than or equal to a first preset included angle, and the second included angle is less than or equal to a second preset included angle, it is determined that the wearer is viewing the device being tested.

[0072] The preset distance is the maximum viewing distance for the wearer when viewing the device being tested. The first preset angle is the maximum horizontal angle within the wearer's field of vision. The second preset angle is the maximum vertical angle within the wearer's field of vision. The preset distance, the first preset angle, and the second preset angle can be determined based on experience or experimentation.

[0073] Based on the above, it is determined whether the relative distance is less than or equal to a preset distance, whether the first included angle is less than or equal to a first preset angle, and whether the second included angle is less than or equal to a second preset angle. If the relative distance is less than the preset distance, it indicates that the relative distance between the device being tested and the wearer is within the maximum viewing distance range. Furthermore, if the first included angle is less than or equal to the first preset angle, and the second included angle is less than or equal to the second preset angle, it indicates that the device being tested is within the wearer's field of vision. Based on this, it is determined that the wearer is viewing the device being tested.

[0074] Conversely, if the relative distance is less than the preset distance, it indicates that the relative distance between the device being tested and the wearer is outside the maximum viewing distance range, and it is determined that the wearer is not viewing the device being tested. Furthermore, if the first included angle is greater than the first preset included angle, and / or the second included angle is greater than the second preset angle, it indicates that the device being tested is outside the wearer's field of vision, and it is determined that the wearer is not viewing the device being tested. If it is determined that the wearer is not viewing the device being tested, step S2100 can be repeated to continue determining whether the wearer is viewing the device being tested.

[0075] Based on the above step S2410, this application provides a method for determining whether a wearer is viewing the device being tested based on relative position.

[0076] In one embodiment of this application, when the relative position includes: the relative distance between the detected device and the head-mounted device in the horizontal direction, a first angle in the horizontal direction and a second angle in the vertical direction, the viewing detection method based on the head-mounted device provided in this application further includes the following steps S2420 and S2421 before the above step S2400.

[0077] Step S2420: Obtain the inertial conduction information of the head-mounted device.

[0078] In one embodiment of this application, an inertial conduction device is provided on the head-mounted device. Based on this, the inertial conduction information of the head-mounted device can be obtained through the inertial conduction device.

[0079] Step S2421: Determine the third included angle of the head-mounted device in the vertical direction based on the inertial transmission information.

[0080] It is understandable that when the wearer wears the head-mounted device correctly, there is no angle between the head-mounted device and the wearer in the horizontal direction. However, when the wearer tilts their head down or up, the head-mounted device will form a certain angle in the vertical direction. Therefore, in order to accurately determine the angle between the head-mounted device and the device being tested in the vertical direction, it is necessary to subtract a third angle from the second angle. This is specifically achieved in step S2400 through step S2430.

[0081] Step S2430: If the relative distance is less than a preset distance, the first included angle is less than or equal to the first preset included angle, and the difference between the second included angle and the third included angle is less than or equal to the second preset included angle, it is determined that the wearer is viewing the device being tested.

[0082] It should be noted that the specific description of step S2430 above is the same as the specific implementation of step S2410 above. Therefore, it will not be repeated here.

[0083] In this embodiment, a third angle in the vertical direction is considered in addition to the second angle between the head-mounted device and the device being tested. This allows for a more accurate determination of whether the wearer is viewing the device being tested.

[0084] In this embodiment, this application provides another way to determine whether the wearer is viewing the device being tested based on relative position.

[0085] In one embodiment of this application, the viewing detection method based on head-mounted devices provided in this application further includes the following step S2500 after the above step S2400.

[0086] Step S2500: If it is confirmed that the wearer has viewed the device being tested, report the testing information of the wearer viewing the device being tested to the device being tested.

[0087] In this embodiment, the detection results are reported through the above step S2500 so that the detected device can perform subsequent processing, such as outputting prompt information.

[0088] In one embodiment of this application, step S2500 can be further implemented as follows: if it is determined that the wearer has viewed the device being tested within a preset time period, the detection information of the wearer viewing the device being tested is reported to the device being tested. This can prevent the detection of the wearer when the wearer is using the device being tested reasonably (e.g., the wearer is viewing the current time through the device being tested).

[0089] In one embodiment of this application, the head-mounted device is provided with a UWB activation device. Based on this, the above-mentioned step S2100 is specifically implemented through the following step S2110.

[0090] Step S2110: Control the UWB startup device to turn on.

[0091] When the UWB initiation device is activated, it sends location information to the device being tested.

[0092] In this embodiment, the head-mounted device is equipped with a UWB activation device. By activating the UWB activation device, the UWB activation device sends a pulse signal that is a request for positioning information to the device being detected, thereby realizing the above step S2110.

[0093] Corresponding to step S2110 above, the device under test is equipped with a UWB response device. Based on this, step S2200 above is specifically implemented through step S2210 below.

[0094] Step S2210: Receive positioning response information sent by the UWB transponder in the device under test.

[0095] After receiving the positioning information sent by the UWB activation device in the head-mounted device, the UWB transponder of the device under test emits a responsive signal as positioning response information. Based on this, the head-mounted device can receive the positioning response information and then determine the relative position between the device under test and the head-mounted device based on the above step S2300.

[0096] In this embodiment, a method is provided for a head-mounted device to determine the relative position between the device being tested and the head-mounted device. This method is easy to implement and has low cost.

[0097] In one embodiment of this application, step S2100 can be specifically implemented by the following steps S2120 and S2121.

[0098] Step S2120: Detect whether the wearer is wearing the head-mounted device correctly.

[0099] Step S2121: If so, send location information to the device being tested.

[0100] In this embodiment, positioning information is sent to the device being tested when the wearer is wearing the head-mounted device correctly. This provides a basis for the head-mounted device to accurately determine the relative position between the device being tested and the head-mounted device.

[0101] Corresponding to step S2121 above, if the wearer does not wear the head-mounted device correctly, a prompt message will be output to remind the wearer to wear the head-mounted device correctly.

[0102] In one embodiment of this application, step S2400 can be specifically implemented by the following steps S2440 and S2441.

[0103] Step S2440: Obtain the current display content information reported by the device under test.

[0104] In this embodiment, the device under test and the head-mounted device establish a communication connection. Based on this communication connection, the head-mounted device obtains the current display content information of the device under test.

[0105] Step S2441: Based on the relative position and the currently displayed content information, determine whether the wearer has correctly viewed the device being tested.

[0106] In this embodiment, the head-mounted device pre-stores detection types. These detection types describe which types of content the wearer needs to view when viewing content displayed on the device, i.e., the types of content the wearer is not allowed to view. In one example, the detection type information includes: game type, short video type, etc. The detection type information can be set according to requirements.

[0107] If, based on relative position, the device under test is determined to be within the field of view of the head-mounted device and within a certain distance, and based on the currently displayed content, it is determined that the device under test is currently displaying content that needs to be tested by the wearer, then it is determined that the wearer is not correctly viewing the device under test. Conversely, if the wearer is correctly viewing the device under test, that is, viewing content of a type other than the testing type, such as viewing learning content, then it is determined that the wearer is correctly viewing the device under test.

[0108] Based on this embodiment, the wearer can avoid effectively viewing the device being tested.

[0109] In conjunction with the above embodiments, this application provides a viewing detection method based on a head-mounted device, such as... Figure 3 As shown, the steps S3100 to S3600 are as follows:

[0110] Step S3100: Send location information to the device under test, and then execute the following step S3200;

[0111] Step S3200: Receive positioning response information sent by the detected device regarding the positioning information, and then execute the following step S3300;

[0112] Step S3300: Determine the relative position between the device being tested and the head-mounted device based on the positioning response information and the positioning information, and then execute the following step S3400.

[0113] Step S3400: Obtain the inertial conduction information of the head-mounted device;

[0114] Step S3500: Determine whether the following conditions are met: the relative distance is less than or equal to the preset distance, the first included angle is less than or equal to the first preset included angle, and the difference between the second included angle and the third included angle is less than or equal to the second preset included angle. If yes, execute the following step S3600; otherwise, repeat the above step S3100.

[0115] Step S3600: Confirm that the wearer has viewed the device being tested, and report the test information of the wearer viewing the device being tested to the device being tested.

[0116] This application also provides a viewing detection device 400 based on a head-mounted device, applied to a head-mounted device, such as... Figure 4 As shown, the viewing detection device 400 based on a head-mounted device includes:

[0117] The transmitting module 410 is used to send positioning information to the device being tested;

[0118] The receiving module 420 is used to receive positioning response information sent by the detected device in response to the positioning information;

[0119] The first determining module 430 is used to determine the relative position between the detected device and the head-mounted device based on the positioning response information and the positioning information;

[0120] The second determining module 440 is used to determine whether the wearer has viewed the device being tested based on the relative position.

[0121] In one embodiment of this application, the relative position includes: the relative distance between the detected device and the head-mounted device in the horizontal direction, a first included angle in the horizontal direction, and a second included angle in the vertical direction;

[0122] The second determining module 440 is specifically used to: determine that the wearer is viewing the detected device when the relative distance is less than or equal to a preset distance, the first included angle is less than or equal to a first preset included angle, and the second included angle is less than or equal to a second preset included angle.

[0123] In one embodiment of this application, the relative position includes: the relative distance between the detected device and the head-mounted device in the horizontal direction, a first included angle in the horizontal direction, and a second included angle in the vertical direction; the viewing detection device 400 based on the head-mounted device further includes:

[0124] The acquisition module is used to acquire the inertial conduction information of the head-mounted device;

[0125] The third determining module is used to determine the third included angle of the head-mounted device in the vertical direction based on the inertial transmission information;

[0126] In this embodiment, the second determining module 440 is specifically used to: determine that the wearer is viewing the device being tested when the relative distance is less than or equal to a preset distance, the first included angle is less than or equal to a first preset included angle, and the difference between the second included angle and the third included angle is less than or equal to a second preset included angle.

[0127] In one embodiment of this application, the viewing detection device 400 based on a head-mounted device provided in this application further includes:

[0128] The reporting module is used to report the detection information of the wearer viewing the device to the device being tested when it is determined that the wearer has viewed the device being tested.

[0129] In one embodiment of this application, the head-mounted device is provided with a UWB activation device, and the transmitting module 410 is specifically used for:

[0130] The UWB startup device is activated, and when the UWB startup device is activated, the UWB startup device sends positioning information to the device being tested.

[0131] The device under test is equipped with a UWB transponder, and the receiving module 420 is specifically used for:

[0132] Receive the positioning response information sent by the UWB response device in the device under test.

[0133] In one embodiment of this application, the sending module 410 is specifically used to: detect whether the wearer is wearing the head-mounted device correctly;

[0134] In this case, location information is sent to the device being tested.

[0135] In one embodiment of this application, the second determining module 440 is specifically used to: obtain the current display content information reported by the detected device;

[0136] Based on the relative position and the currently displayed content information, it is determined whether the wearer is correctly viewing the device being tested.

[0137] This application also provides a head-mounted device, which includes any of the viewing detection devices 400 based on the head-mounted device provided in the above-described device embodiments.

[0138] Or, such as Figure 5 As shown, the head-mounted device 500 includes a memory 510 and a processor 520. The memory 510 is used to store computer instructions, and the processor 520 is used to retrieve the computer instructions from the memory 510 to execute any of the head-mounted device-based viewing detection methods provided in the above method embodiments.

[0139] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the head-mounted device-based viewing detection methods provided in the above method embodiments.

[0140] This application may be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this application.

[0141] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0142] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0143] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from the computer-readable program instructions. These electronic circuits can execute the computer-readable program instructions to implement various aspects of this application.

[0144] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0145] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0146] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0147] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be well known to those skilled in the art that implementation in hardware, implementation in software, and implementation using a combination of software and hardware are equivalent.

[0148] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technical improvements to the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein. The scope of this application is defined by the appended claims.

Claims

1. A viewing detection method based on a head-mounted device, characterized in that, Applied to head-mounted devices, the method includes: Send location information to the device being tested; Receive positioning response information sent by the device under test in response to the positioning information; Based on the positioning response information and the positioning information, the relative position between the detected device and the head-mounted device is determined; Based on the relative position, it is determined whether the wearer is viewing the device being tested.

2. The method according to claim 1, characterized in that, The relative position includes: the relative distance between the device being tested and the head-mounted device in the horizontal direction, a first included angle in the horizontal direction, and a second included angle in the vertical direction; Determining whether the wearer has viewed the detected device based on the relative position includes: If the relative distance is less than or equal to a preset distance, the first included angle is less than or equal to a first preset included angle, and the second included angle is less than or equal to a second preset included angle, it is determined that the wearer is viewing the device being tested.

3. The method according to claim 1, characterized in that, The relative position includes: the relative distance between the device being tested and the head-mounted device in the horizontal direction, a first included angle in the horizontal direction, and a second included angle in the vertical direction; Before determining whether the wearer has viewed the detected device based on the relative position, the method further includes: Obtain the inertial conduction information of the head-mounted device; Based on the inertial transmission information, determine the third included angle of the head-mounted device in the vertical direction; Determining whether the wearer has viewed the detected device based on the relative position includes: If the relative distance is less than or equal to a preset distance, the first included angle is less than or equal to a first preset included angle, and the difference between the second included angle and the third included angle is less than or equal to a second preset included angle, it is determined that the wearer is viewing the device being tested.

4. The method according to claim 1, characterized in that, The method further includes: If it is determined that the wearer has viewed the device being tested, the device being tested will report the detection information of the wearer viewing the device being tested.

5. The method according to claim 1, characterized in that, The head-mounted device is equipped with a UWB activation device, and the step of sending the first positioning information to the device under test includes: The UWB startup device is activated, and when the UWB startup device is activated, the UWB startup device sends positioning information to the device being tested. The device under test is equipped with a UWB transponder, and receiving the positioning response information sent by the device under test includes: Receive the positioning response information sent by the UWB response device in the device under test.

6. The method according to claim 1, characterized in that, Sending location information to the device under test includes: Detecting whether the wearer is wearing the head-mounted device correctly; In this case, location information is sent to the device being tested.

7. The method according to claim 1, characterized in that, Determining whether the wearer has viewed the detected device based on the relative position includes: Obtain the currently displayed content information reported by the device under test; Based on the relative position and the currently displayed content information, it is determined whether the wearer is correctly viewing the device being tested.

8. A viewing detection device based on a head-mounted device, applied to a head-mounted device, characterized in that, The device includes: The sending module is used to send location information to the device being tested; A receiving module is used to receive positioning response information sent by the device under test in response to the positioning information; The first determining module is used to determine the relative position between the detected device and the head-mounted device based on the positioning response information and the positioning information; The second determining module is used to determine whether the wearer has viewed the device being tested based on the relative position.

9. A head-mounted device, characterized in that, The head-mounted device includes the apparatus as described in claim 8; or... The head-mounted device includes a memory and a processor, the memory for storing computer instructions, and the processor for retrieving the computer instructions from the memory to perform the method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, It stores a computer program that, when executed by a processor, implements the method according to any one of claims 1-7.

Images