Method, device and apparatus for searching interactive device, and storage medium

Abstract

The application discloses a searching method and device of an interactive device, equipment and a storage medium, and belongs to the technical field of interaction. The method comprises the following steps: determining the position of the device by monitoring data when a communication connection is established with a second VR device; receiving movement data of the second VR device; and sending the relative position of the second VR device to the second VR device, so that a user searches for the first VR device based on the relative position, wherein the relative position is determined based on the position of the device and the movement data of the second VR device. In the application, the relative position provides a reference for the user to search, avoids the understanding error of the user or the increased searching time due to the fact that the target is not captured in the picture, the user determines the final position of the lost VR device according to the relative position of the two and the actual environment, and therefore, the efficiency of searching for the lost VR device is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of interaction, in particular to a finding method and device of interactive equipment, equipment and storage medium. BACKGROUND

[0002] At present, when a user simultaneously operates a VR handle and a VR head-mounted device, the VR handle and the VR head-mounted device communicate in a preset communication mode. When two VR devices communicate with each other, if the two VR devices are far away from each other, in the prior art, one of the VR devices captures a picture of the other VR device by using a camera to find the other VR device.

[0003] When the user finds the other VR device according to the picture, the user often judges the picture based on subjective experience, which requires multiple searches and consumes a large amount of time of the user, thereby reducing the experience effect of the user experiencing VR, that is, the prior art has the problem of low efficiency of finding a lost VR device based on a picture.

[0004] The above content is only used to assist in understanding the technical solutions of the present application and does not represent the acknowledgement of the above content as prior art. SUMMARY

[0005] The main purpose of the present application is to provide a finding method of interactive equipment, which aims to solve the problem of low efficiency of finding a lost VR device based on a picture in the prior art.

[0006] To achieve the above purpose, the present application provides a finding method of interactive equipment, which is applied to a first VR device in a finding system of interactive equipment, the finding system of interactive equipment further includes a second VR device, the first VR device is configured with a first monitoring element, the second VR device is configured with a second monitoring element, and the method comprises the following steps:

[0007] When a communication connection is established with the second VR device, the position of the first VR device is determined through monitoring data of the first monitoring element;

[0008] Receiving movement data, the movement data is sent by the second VR device, and the movement data is monitored by the second monitoring element;

[0009] Sending a relative position of the second VR device to the second VR device, so that a user finds the first VR device based on the relative position, wherein the relative position is determined based on the position of the first VR device and the movement data of the second VR device;

[0010] In a possible implementation of the present application, the first VR device is further configured with a third monitoring element, and the step of determining the relative position of the second VR device based on the self-position and the movement data of the second VR device comprises:

[0011] When the anti-lost function is detected to be turned on, a real-time relative position of the second VR device is determined, wherein the real-time relative position is determined based on real-time movement data of the second VR device and self real-time movement data monitored by the third monitoring element;

[0012] The real-time relative position of the second VR device is sent to the second VR device, so that the user finds the first VR device based on the real-time relative position.

[0013] In a possible implementation of the present application, the third monitoring element is an inertial measurement unit, and the step of determining the real-time relative position of the second VR device comprises:

[0014] The real-time relative position of the second VR device is determined based on real-time movement data of the second VR device and acceleration of self real-time movement monitored by the inertial measurement unit.

[0015] In a possible implementation of the present application, before the step of determining the self-position based on the monitoring data of the first monitoring element, the method further comprises:

[0016] The preset marker position data sent by the second VR device is received;

[0017] The first monitoring element is initialized based on the marker position data.

[0018] In a possible implementation of the present application, the first VR device is configured with a first camera, and the second VR device is configured with a second camera, and the step of determining the relative position of the second VR device based on the self-position and the movement data of the second VR device comprises:

[0019] The first relative position of the second VR device is determined based on a first picture taken by the first camera and a second picture sent by the second VR device, wherein the first picture is a picture of the second VR device taken by the first camera, and the second picture is a picture of the first VR device taken by the second camera;

[0020] determine a second relative position with the second VR device based on the self-position and movement data of the second VR device;

[0021] determine a relative position with the second VR device based on the first relative position and the second relative position;

[0022] send the relative position with the second VR device to the second VR device, so that the user finds the first VR device based on the relative position.

[0023] In a possible implementation of the present application, the step of determining the relative position with the second VR device based on the first relative position and the second relative position comprises:

[0024] if it is determined that there is an occlusion between the first camera and the second VR device, and / or it is determined that there is the occlusion between the second camera, then directly determine the second relative position as the relative position with the second VR device, wherein the first relative position is invalid.

[0025] In a possible implementation of the present application, after the step of sending the relative position with the second VR device to the second VR device, the method further comprises:

[0026] if it is detected that the relative distance corresponding to the relative position is greater than a distance threshold, then voice prompt is performed.

[0027] In addition, to achieve the above object, the present application further provides an interactive device finding device, which is an entity node device, and comprises a memory, a processor, and an interactive device finding program stored in the memory and executable on the processor, wherein the processor executes the interactive device finding program to implement the steps of the interactive device finding method.

[0028] In addition, to achieve the above object, the present application further provides a storage medium having an interactive device finding program stored thereon, wherein the interactive device finding program is executable on a processor to implement the steps of the interactive device finding method.

[0029] The application provides a finding method, device and equipment of an interactive device and a storage medium. Compared with the low efficiency of finding a VR device based on a picture in the prior art, in the application, when a communication connection is established with the second VR device, the position of the first VR device is determined based on the monitoring data of the first monitoring element; the movement data is received, the movement data is sent by the second VR device, and the movement data is monitored by the second monitoring element; the relative position of the first VR device and the second VR device is sent to the second VR device, so that the user finds the first VR device based on the relative position, wherein the relative position is determined based on the position of the first VR device and the movement data of the second VR device. In the application, the relative position between the two VR devices is determined based on the position of the lost VR device and the movement data of the other VR device, so that the user finds the lost VR device. The user determines the final position of the lost VR device based on the relative position of the two VR devices and the actual environment. The relative position provides a reference for the user to find, avoids the time-consuming finding caused by the subjective judgment error of the user to the picture, and avoids the time-consuming finding caused by the fact that the picture does not capture the target, thereby improving the efficiency of finding the lost VR device. BRIEF DESCRIPTION OF DRAWINGS

[0030] Figure 1 The flowchart of the first embodiment of the finding method of the interactive device of the application;

[0031] Figure 2 The schematic diagram of the first monitoring element device in the first embodiment of the finding method of the interactive device of the application;

[0032] Figure 3 The schematic diagram of the second monitoring element in the first embodiment of the finding method of the interactive device of the application;

[0033] Figure 4 The schematic diagram of the third monitoring element in the second embodiment of the finding method of the interactive device of the application;

[0034] Figure 5 The schematic diagram of the first camera in the third embodiment of the finding method of the interactive device of the application;

[0035] Figure 6 The schematic diagram of the second camera in the third embodiment of the finding method of the interactive device of the application;

[0036] Figure 7 The schematic diagram of the finding device of the interactive device in the fourth embodiment of the finding method of the interactive device of the application;

[0037] Figure 8 The device structure schematic diagram of the hardware running environment involved in the fifth embodiment of the finding method of the interactive device of the application. Detailed Implementation

[0038] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0039] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, components, features, and elements with the same names in different embodiments of this application may have the same meaning or different meanings, the specific meaning of which must be determined by its interpretation in that specific embodiment or further in conjunction with the context of that specific embodiment.

[0040] It should be understood that, although terms, first, second, third, etc. can be used herein to describe various information, these terms are not intended to denote a particular order or hierarchy among the information. These terms are used only to distinguish one category of information from another category of information. For example, a first information can be termed a second information, and similarly, a second information can be termed a first information without departing from the scope hereof. The word "if' as used herein, depending on the context in which it is used, can be interpreted to mean "when" or "upon" or "in response to determining" or "in response to detecting." Also, the word "comprise" or "comprising" as used herein, can be interpreted as meaning "comprising but not limited to." It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, and / or groups but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, items, and / or groups thereof. As used herein, the terms "or," "and / or," "and," "at least one of," and the like are to be interpreted as inclusive, unless the context of their use indicates otherwise. For example, "A, B, or C" or "A, B, and / or C" or "at least one of A and B" can be interpreted to mean "A; B; C; A and B; A and C; B and C; A, B, and C," or the like. Such clauses are also to be interpreted to mean "A, or B, or C, or any combination of the items A, B, and C" or the like.

[0041] It should be understood that, although various steps in the flowcharts of the embodiments of the present application are shown in a sequential order, these steps are not necessarily performed in the order shown. Unless explicitly stated, the steps of the embodiments of the present application are not necessarily performed in the order shown. Furthermore, at least some of the steps can include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but can be performed at different times, and not necessarily in the order shown, but can be performed in a different order, or in a parallel or interleaved manner.

[0042] The word "if' as used herein, depending on the context in which it is used, can be interpreted to mean "when" or "upon" or "in response to determining" or "in response to detecting." Similarly, the phrase "if determined" or "if detecting (a stated condition or event)" can be interpreted to mean "when determined" or "in response to determining" or "when detecting (a stated condition or event)" or "in response to detecting (a stated condition or event)," depending on the context in which it is used.

[0043] It should be noted that in this paper, step codes such as S10, S20, etc. are used, the purpose is to more clearly and briefly express the corresponding content, and does not constitute a substantial limitation on the order. The person skilled in the art may perform S20 first and then perform S10, etc. when implementing, but these should be within the protection scope of the present application.

[0044] It should be understood that the specific embodiments described herein are merely intended to explain the present application and not to limit the present application.

[0045] In the following description, the suffixes such as "module", "component", or "unit" used to represent elements are only for the convenience of the description of the present application, and have no specific meaning. Therefore, "module", "component", or "unit" can be mixedly used.

[0046] In order to make the above objectives, characteristics and advantages of the present application more apparent, clear and complete, the technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings of the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative labor fall within the scope of protection of the present application.

[0047] Embodiment one

[0048] The present application provides a method for finding an interactive device. In the first embodiment of the method for finding an interactive device, with reference to Figure 1 , a first VR device applied to a finding system of an interactive device, the finding system of the interactive device further includes a second VR device, the first VR device is configured with a first monitoring element, the second VR device is configured with a second monitoring element, and the method includes:

[0049] Step S10, when a communication connection is established with the second VR device, determining a self position through monitoring data of the first monitoring element;

[0050] Step S20, receiving movement data, the movement data is sent by the second VR device, and the movement data is monitored by the second monitoring element;

[0051] Step S30, sending a relative position with the second VR device to the second VR device, so that a user finds the first VR device based on the relative position, wherein the relative position is determined based on the self position and the movement data of the second VR device.

[0052] The present embodiment aims to improve the efficiency of finding a lost VR device.

[0053] The specific steps are as follows:

[0054] In step S10, when a communication connection is established with the second VR device, the position of the first VR device is determined based on the monitoring data of the first monitoring element.

[0055] As an example, the finding method of the interactive device is applied to a first VR device in a finding system of the interactive device, and the finding system of the interactive device further includes a second VR device, the first VR device is configured with a first monitoring element, and the second VR device is configured with a second monitoring element.

[0056] In this embodiment, the finding system of the interactive device includes the first VR device and the second VR device, and the first VR device and the second VR device communicate in a preset communication mode.

[0057] As an example, the finding system of the interactive device includes the first VR device and the second VR device, wherein the first VR device can be a VR head-mounted stereoscopic display (VR head-mounted display for short), or a VR handle, etc., which is not specifically limited herein, and the VR head-mounted display includes a mobile terminal head-mounted display, an external head-mounted device, and an integrated head-mounted display. The first VR device can be a VR head-mounted display, or a VR handle, etc., when the first VR device is a VR head-mounted display, the second VR device is a VR handle, and the user finds the VR head-mounted display based on the VR handle; when the first VR device is a VR handle, the second VR device is a VR head-mounted display, and the user finds the VR handle based on the VR head-mounted display.

[0058] In this embodiment, the application scenario is as follows:

[0059] The first VR device and the second VR device need to interact with each other to provide a VR experience for a user. When the user operates the first VR device and the second VR device together to experience the VR experience, as an example, the first VR device is a VR headset, and the second VR device is a VR handle. The user wears the VR headset to browse the VR picture. According to the VR picture seen by the user, the user operates the VR handle in the hand, for example, the user unintentionally throws away the VR handle in the hand during the experience of the skiing game. The user needs to find the lost VR handle, and after finding it, the user can continue to operate the VR handle to experience the game. When the user is looking for the lost VR handle, the user looks for the lost VR handle according to the picture displayed on the VR headset, wherein the picture is a picture of the VR handle taken by a camera in the VR headset. However, when the user looks for the lost VR handle according to the displayed picture, the user needs to judge the picture based on subjective experience. After multiple unsuccessful feedbacks, the user finally finds the lost VR handle. The user spends a lot of time looking for the VR handle, which reduces the experience effect of the user experiencing the VR. In particular, when there is an occlusion between the VR handle and the VR headset, the picture taken by the camera in the VR headset cannot capture the VR handle, which further increases the time consumption of looking for the lost VR device, that is, the efficiency of looking for the lost VR device based on the picture is not high.

[0060] In the embodiment, when the communication connection with the second VR device is established, the position of the first VR device is determined based on the monitoring data of the first monitoring element. The movement data of the second VR device is received, and the movement data is monitored by the second monitoring element. The relative position between the first VR device and the second VR device is sent to the second VR device, so that the user can find the first VR device based on the relative position. The relative position is determined based on the position of the first VR device and the movement data of the second VR device.

[0061] The relative position between the two VR devices determined based on the position of the lost VR device and the movement data of the other VR device is provided for the user to find the lost VR device. The user determines the final position of the lost VR device based on the relative position of the two and the actual environment. The relative position provides a reference for the user to find.

[0062] In step S10, before determining the position of the first VR device based on the monitoring data of the first monitoring element, the following steps S01-S02 are included:

[0063] In step S01, the preset marker position data sent by the second VR device is received.

[0064] In step S02, the first monitoring element is initialized based on the marker position data.

[0065] In the embodiment, the marker position data is in the second VR device, and is used for calibrating the position between the first VR device and the second VR device.

[0066] In the embodiment, the communication connection established by the first VR device and the second VR device can be Bluetooth, WIFI, or lora, which is not limited herein.

[0067] As an example, the first VR device is a VR handle, such as Figure 2 , the first monitoring element configured in the VR handle is an inertial measurement unit 1, abbreviated as IMU1, and the second VR device is a VR headset, such as Figure 3 , the second monitoring element configured in the VR headset is an inertial measurement unit 2, abbreviated as IMU2.

[0068] As an example, before operating the VR game, the user initializes the VR handle and the VR headset. The initialization process is that the user places the VR handle and the VR headset on the same horizontal plane at the same time, and then establishes a WIFI communication connection after turning on the VR handle and the VR headset. Since the height difference between the IMU1 in the VR handle and the IMU2 in the VR headset, the two are initialized and calibrated based on the marker position data in the VR headset. The VR headset sends preset marker position data to the VR handle, and the VR handle receives the marker position data and initializes the configured IMU1 based on the marker position data.

[0069] As an example, after the initialization of the VR handle, the self-position of the VR handle is determined by the monitoring data monitored by the IMU1. The monitoring data collected by the IMU1 includes acceleration a1 and angular velocity w1. The IMU1 monitors the acceleration a1 of the VR handle and the angular velocity w1 of the VR handle. The VR handle determines its own position by monitoring the acceleration a1 and the angular velocity w1 of the VR handle through the IMU1.

[0070] In step S20, the movement data is received, the movement data is sent by the second VR device, and the movement data is monitored by the second monitoring element;

[0071] In the embodiment, the second monitoring element monitors the movement of the second VR device and monitors the movement data of the second VR device. As an example, the second VR device is a VR headset, and the second monitoring element is an IMU2. The IMU2 monitors the acceleration a2 and the angular velocity w2 of the VR headset. The VR headset sends the movement data monitored by the IMU2 to the VR handle. The movement data includes the acceleration a2 and the angular velocity w2. The VR handle receives the movement data sent by the VR headset.

[0072] Step S30, sending the relative position of the second VR device to the second VR device, so that the user finds the first VR device based on the relative position.

[0073] In this embodiment, after receiving the movement data of the second VR device monitored by the second monitoring element, the relative position of the second VR device is calculated based on the self-position monitored by the first monitoring element.

[0074] As an example, the VR handle displays the calculated relative position and sends the relative position to the VR headset. After the VR headset processes the relative position, the relative position of the VR handle relative to the VR headset is obtained. The processed relative position is displayed on the VR headset, so that the user can find the lost VR handle based on the relative position on the VR headset. As an example, the VR headset displays that the VR handle is located at a position 5 meters in front.

[0075] Step S30, after the step of sending the relative position of the second VR device to the second VR device, the method further comprises:

[0076] Step S40, if it is detected that the relative distance corresponding to the relative position is greater than a distance threshold, voice prompting is performed.

[0077] In this embodiment, the distance threshold is a preset safety distance between the first VR device and the second VR device.

[0078] As an example, the distance threshold is 2 meters. After the first VR device sends the relative position of the second VR device to the second VR device, if it is detected that the relative distance of the second VR device is 5 meters, which is greater than the distance threshold of 2 meters, voice prompting is performed. The voice prompt of the lost first VR device improves the convenience of the user when finding, and the user finds according to the sound source, which speeds up the finding speed.

[0079] The application provides a searching method and device of an interactive device, a device and a storage medium. Compared with the low efficiency of searching a VR device based on a picture in the prior art, in the application, when a communication connection is established with the second VR device, the position of the first VR device is determined based on the monitoring data of the first monitoring element; the movement data is received, the movement data is sent by the second VR device, and the movement data is monitored by the second monitoring element; the relative position of the first VR device and the second VR device is sent to the second VR device, so that a user searches for the first VR device based on the relative position, wherein the relative position is determined based on the position of the first VR device and the movement data of the second VR device. In the application, the relative position between the two VR devices is determined based on the position of the lost VR device and the movement data of the other VR device, so that the user searches for the lost VR device. According to the relative position of the two VR devices and the actual environment, the user determines the final position of the lost VR device. The relative position provides a reference for the user to search, avoids the time-consuming searching caused by the subjective judgment error of the user to the picture, and avoids the time-consuming searching caused by the fact that the picture does not capture the target, thereby improving the efficiency of searching for the lost VR device.

[0080] Embodiment two

[0081] Further, based on the embodiment one of the application, another embodiment of the application is provided, in which the first VR device is further configured with a third monitoring element, in step S30, the relative position of the first VR device and the second VR device is sent to the second VR device, so that a user searches for the first VR device based on the relative position, wherein the step of determining the relative position based on the position of the first VR device and the movement data of the second VR device comprises the following steps S31-S32.

[0082] In step S31, when it is detected that the anti-loss function is turned on, the real-time relative position of the first VR device and the second VR device is determined, wherein the real-time relative position is determined based on the real-time movement data of the second VR device and the real-time movement data of the first VR device monitored by the third monitoring element.

[0083] The third monitoring element is an inertial measurement unit, and in step S31, the step of determining the real-time relative position of the first VR device and the second VR device comprises:

[0084] In step S311, the real-time relative position of the first VR device and the second VR device is determined based on the real-time movement data of the second VR device and the acceleration of the real-time movement of the first VR device monitored by the inertial measurement unit.

[0085] As an example, as Figure 4The VR handle is configured with a third monitoring element, which is an inertial measurement unit 3, abbreviated as IMU3. The IMU3 monitors the acceleration a3 of the movement of the VR handle. The acceleration a3 monitored by the IMU3 is real-time. When the VR handle is moved by the user, the acceleration monitored by the IMU3 is updated in real time. That is, the IMU3 monitors the real-time movement data of the VR handle.

[0086] As an example, the user places the VR handle and the VR headset on the same horizontal plane at the same time. After starting the VR handle and the VR headset, if the user starts the anti-loss function of the VR handle, the user needs to initialize the anti-loss function of the VR handle and the VR headset before operating the VR game. The anti-loss function initialization process is as follows: the user places the VR handle and the VR headset on the same horizontal plane at the same time, so that the IMU3 of the VR handle and the IMU2 of the VR headset are aligned, a WIFI communication connection between the VR devices is established, and the determination key is pressed. The VR handle places the IMU3 and the IMU2 in the same world coordinate system, and takes the position of the IMU2 as the coordinate origin. The distance sensor configured in the VR handle calculates the distance between the IMU3 and the IMU2, and takes it as the value of the x-axis of the IMU3 initialization data. The y-axis and z-axis data are initialized to 0, and the anti-loss function initialization of the configured IMU3 is completed.

[0087] As an example, when the first VR device detects that the anti-loss function is started, the real-time relative position of the second VR device is determined based on the real-time movement data of the second VR device and the acceleration of the real-time movement of the IMU3.

[0088] In step S32, the real-time relative position of the second VR device is sent to the second VR device, so that the user finds the first VR device based on the real-time relative position.

[0089] In this embodiment, the application scenario is:

[0090] During the experience of the skiing game, the user accidentally throws away the VR handle in the hand. Based on the relative position between the lost VR device and the other VR device determined based on the position of the lost VR device and the movement data of the other VR device, the user finds the lost VR device. The user determines the final position of the lost VR device based on the relative position of the two and the actual environment. The static relative position only provides a reference for the user to find. However, during the movement of the user to find, the second VR device is moved together with the user. When the user moves to find the lost first VR device, the user can no longer continue to obtain valuable information for finding from the second VR device. That is, the second VR device only provides a reference when the user starts to find. Therefore, the time for the user to find is still long, and the efficiency of finding is still low.

[0091] In the embodiment, the real-time relative position is different from the relative position, and is dynamically updated. The reason why the real-time relative position is dynamically updated is that the real-time relative position is determined according to the real-time movement data of the second VR device and the real-time movement data of the first VR device. As an example, a user unintentionally throws away a VR handle in the process of experiencing a skiing game. The user finds the first VR device according to the real-time relative position displayed on the second VR device. When the user walks in the direction of the first VR device, the real-time relative position displayed on the second VR device is constantly recalculated according to the movement of the user. Therefore, the user can view the direction and distance information displayed on the second VR device in the whole process of finding the lost first VR device, so as to timely adjust the finding path in the constant feedback.

[0092] In the embodiment, when it is detected that the anti-loss function is turned on, the real-time relative position of the second VR device is determined, wherein the real-time relative position is determined based on real-time movement data of the second VR device and real-time movement data of the third monitoring element. The real-time relative position of the second VR device is sent to the second VR device, so that the user finds the first VR device based on the real-time relative position.

[0093] In the embodiment, the real-time movement data of the second VR device is updated in real time, and the monitored real-time movement data is updated in real time. Therefore, the relative position recalculated based on this is also real-time. Based on the real-time relative position, the user can view the direction and distance information displayed on the second VR device in the whole process of finding the lost first VR device, so as to timely adjust the finding path in the constant feedback, thereby further improving the efficiency of finding the lost VR device.

[0094] Embodiment Three

[0095] Further, based on all the above embodiments, another embodiment of the present application is provided. In the embodiment, the first VR device is configured with a first camera, and the second VR device is configured with a second camera. In step S30, the relative position of the second VR device is sent to the second VR device, so that the user finds the first VR device based on the relative position. The relative position is determined based on the movement data of the second VR device and the movement data of the first VR device.

[0096] Step S33, determining a first relative position with the second VR device based on the first picture taken by the first camera and the second picture sent by the second VR device, wherein the first picture is a picture of the second VR device taken by the first camera, and the second picture is a picture of the first VR device taken by the second camera.

[0097] As an example, the first VR device is configured with a first camera, and the first camera is used to take a picture of the second VR device to obtain a first picture. Figure 5 The second VR device is configured with a second camera, and the second camera is used to take a picture of the first VR device to obtain a second picture. Figure 6

[0098] As an example, the first relative position with the second VR device is determined based on the first picture taken by the first camera and the second picture sent by the second VR device.

[0099] Step S34, determining a second relative position with the second VR device based on the self position and movement data of the second VR device.

[0100] Step S35, determining a relative position with the second VR device based on the first relative position and the second relative position.

[0101] As an example, the first relative position with the second VR device is determined based on the first picture taken by the first camera and the second picture sent by the second VR device, the second relative position with the second VR device is determined based on the self position and movement data of the second VR device, and the relative position with the second VR device is obtained by comprehensive calculation based on the first relative position and the second relative position.

[0102] As an example, step S35, determining a relative position with the second VR device based on the first relative position and the second relative position, comprises:

[0103] Step S351, if it is determined that there is an occlusion between the first camera and the second VR device, and / or it is determined that there is the occlusion between the second camera, then directly determining the second relative position as the relative position with the second VR device, wherein the first relative position is invalid.

[0104] ​As an example, when the relative position of the second VR device is determined based on the first relative position and the second relative position, if there is an occlusion between the first VR device and the second VR device, for example, the first VR device is thrown by the user and falls behind the back of the sofa, the first VR device is occluded by the sofa, and the first camera is also occluded, the second VR device is not captured by the first camera, and there is no target in the first picture. That is, the first relative position of the second VR device determined based on the first picture and the second picture is invalid, and if the relative position of the second VR device is continuously determined based on the first relative position and the second relative position, the relative position obtained has errors with the actual situation, and the user will take more time to find the lost first VR device based on the relative position with errors.

[0105] Therefore, if it is determined that there is an occlusion between the first camera and the second VR device, and / or it is determined that there is the occlusion between the second camera, the second relative position is directly determined as the relative position of the second VR device, and the first relative position is invalid.

[0106] In step S36, the relative position of the second VR device is sent to the second VR device, so that the user finds the first VR device based on the relative position.

[0107] As an example, if there is no occlusion between the first camera and the second VR device, and there is no occlusion between the second camera, the relative position of the second VR device is determined based on the first relative position and the second relative position, and the user finds the lost first VR device based on the relative position, and can also view the process of the first VR device being lost according to the second picture captured by the second VR device, thereby improving the intuitiveness of the relative position and facilitating the user to find.

[0108] In this embodiment, the relative position of the second VR device is obtained based on the first relative position and the second relative position, and the first relative position refers to the actual lost picture. The more comprehensive relative position provides more accurate reference data for the user, and the user can view the specific lost picture, thereby improving the intuitiveness of the relative position, improving the convenience of the user when finding, and further improving the efficiency of finding the lost VR device.

[0109] Embodiment Four

[0110] Further, based on all the above embodiments, another embodiment of the present application is provided, in which, as Figure 7 A finding device of an interactive device is provided, and the device comprises:

[0111] determining a self position based on monitoring data of the first monitoring element when a communication connection with the second VR device is established;

[0112] receiving a movement data sent by the second VR device, wherein the movement data is monitored by the second monitoring element;

[0113] sending a relative position with the second VR device to the second VR device, so that a user finds the first VR device based on the relative position, wherein the relative position is determined based on the self position and the movement data of the second VR device;

[0114] In a possible implementation of the present application, the first VR device is further configured with a third monitoring element, and the step of sending a relative position with the second VR device to the second VR device, so that a user finds the first VR device based on the relative position, wherein the relative position is determined based on the self position and the movement data of the second VR device, the device comprises:

[0115] a first determining module configured to determine a real-time relative position with the second VR device when it is detected that the anti-lost function is turned on, wherein the real-time relative position is determined based on real-time movement data of the second VR device and real-time movement data of the self position monitored by the third monitoring element;

[0116] a first sending module configured to send the real-time relative position with the second VR device to the second VR device, so that the user finds the first VR device based on the real-time relative position.

[0117] In a possible implementation of the present application, the third monitoring element is an inertial measurement unit, and the step of determining a real-time relative position with the second VR device comprises:

[0118] a second determining module configured to determine a real-time relative position with the second VR device based on real-time movement data of the second VR device and acceleration of real-time movement of the self position monitored by the inertial measurement unit.

[0119] In a possible implementation of the present application, before the step of determining a self position based on monitoring data of the first monitoring element, the device comprises:

[0120] a first receiving module configured to receive preset marker position data sent by the second VR device;

[0121] an initializing module configured to initialize the first monitoring element configured based on the marker position data.

[0122] In a possible implementation of the present application, the first VR device is configured with a first camera, the second VR device is configured with a second camera, the relative position of the second VR device is sent to the second VR device, so that the user finds the first VR device based on the relative position, wherein the relative position is determined based on the self-position and movement data of the second VR device, and the device comprises:

[0123] a third determining module configured to determine a first relative position of the second VR device based on a first picture taken by the first camera and a second picture sent by the second VR device, wherein the first picture is a picture of the second VR device taken by the first camera, and the second picture is a picture of the first VR device taken by the second camera;

[0124] a fourth determining module configured to determine a second relative position of the second VR device based on the self-position and movement data of the second VR device;

[0125] a fifth determining module configured to determine a relative position of the second VR device based on the first relative position and the second relative position;

[0126] a second sending module configured to send the relative position of the second VR device to the second VR device, so that the user finds the first VR device based on the relative position.

[0127] In a possible implementation of the present application, the step of determining the relative position of the second VR device based on the first relative position and the second relative position, and the device comprises:

[0128] a sixth determining module configured to, if it is determined that there is an occlusion between the first camera and the second VR device, and / or it is determined that there is the occlusion between the second camera, directly determine the second relative position as the relative position of the second VR device, wherein the first relative position is invalid.

[0129] In a possible implementation of the present application, after the step of sending the relative position of the second VR device to the second VR device, the device comprises:

[0130] a voice prompting module configured to, if it is detected that a relative distance corresponding to the relative position is greater than a distance threshold, perform voice prompting.

[0131] The finding device of the interactive device of the present application has basically the same implementation as the above-mentioned finding method of the interactive device, and thus will not be described here again.

[0132] Embodiment Five

[0133] Further, based on all the above embodiments, another embodiment of the present application is provided, in which an interactive device searching device is provided, the interactive device searching device is an entity node device, the interactive device searching device comprises a memory, a processor and a program stored in the memory and used for implementing the interactive device searching method, the memory is used for storing the program used for implementing the interactive device searching method, and the processor is used for executing the program used for implementing the interactive device searching method to implement the steps of the interactive device searching method in the above embodiments.

[0134] Referring to Figure 8 , Figure 8 is a device structure schematic diagram of a hardware running environment involved in an embodiment scheme of the present application.

[0135] As Figure 8 shown, the interactive device searching device can comprise a processor 1001 such as a CPU, a memory 1005, and a communication bus 1002. The communication bus 1002 is used for realizing the connection communication between the processor 1001 and the memory 1005. The memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory) such as a disk memory. The memory 1005 can optionally be a storage device independent of the aforementioned processor 1001.

[0136] In a possible implementation of the present application, the interactive device searching device can further comprise a network interface, an audio circuit, a display, a connection line, a sensor, an input module and the like. The network interface can optionally comprise a standard wired interface, a wireless interface (such as a WI-FI interface, a Bluetooth interface), and the input module can optionally comprise a keyboard (Keyboard), a system soft keyboard, voice input, wireless receiving input and the like.

[0137] Those skilled in the art can understand that the interactive device searching device structure does not constitute a limitation on the interactive device searching device, and can comprise more or fewer components than the diagram, or combine certain components, or different component arrangements.

[0138] The memory as a computer storage medium can comprise an operating system, an information exchange module and an interactive device searching program. The operating system is a program used for managing and controlling hardware and software resources of the interactive device searching device, and supports the running of the interactive device searching program and other software and / or programs. The information exchange module is used for realizing the communication between the components in the memory and the communication with other hardware and software in the management system.

[0139] The processor is configured to execute the searching program of the interactive device stored in the memory, so as to implement the steps of the searching method of the interactive device.

[0140] The searching device of the interactive device provided in the embodiments of the present application is basically the same as the searching method of the interactive device, and thus will not be repeated here.

[0141] Embodiment six

[0142] The embodiments of the present application provide a storage medium, and the storage medium stores one or more programs, and the one or more programs can also be executed by one or more processors to implement the steps of the searching method of the interactive device in the above embodiments.

[0143] The storage medium of the present application is basically the same as the above-mentioned searching method of the interactive device, and thus will not be repeated here.

[0144] It should be noted that in this paper, the term "include", "contain" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or system including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or includes elements inherent to such process, method, article or system. Without more limitations, the element defined by the statement "including a" does not exclude the presence of another identical element in the process, method, article or system including the element.

[0145] The serial numbers of the above embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0146] Through the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment method can be realized by means of software and necessary general hardware platform, of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as ROM or RAM, magnetic disc, optical disc) as described above, and includes a plurality of instructions to make a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) execute the method described in each embodiment of the present application.

[0147] The above is only the preferred embodiment of the present application, and does not limit the patent scope of the present application, and any equivalent structure or equivalent process transformation using the content of the specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method of finding an interactive device, characterized by, The first VR device is applied to a finding system of an interactive device, the finding system of the interactive device further comprises a second VR device, the first VR device is configured with a first monitoring element, the second VR device is configured with a second monitoring element, the first VR device is configured with a first camera, the second VR device is configured with a second camera, the finding method of the interactive device comprises: When a communication connection is established with the second VR device, the position of the first VR device is determined through the monitoring data of the first monitoring element; Receiving movement data, the movement data is sent by the second VR device, and the movement data is monitored by the second monitoring element; Sending the relative position of the second VR device to the second VR device, so that the user finds the first VR device based on the relative position; If it is detected that the relative distance corresponding to the relative position is greater than the distance threshold, a voice prompt is given, so that the user finds according to the sound source; The step of sending the relative position of the second VR device to the second VR device, so that the user finds the first VR device based on the relative position, comprises: Based on the first picture taken by the first camera and the second picture sent by the second VR device, the first relative position of the second VR device is determined, wherein the first picture is the picture of the second VR device taken by the first camera, and the second picture is the picture of the first VR device taken by the second camera; Based on the movement data of the second VR device and the position of the first VR device, the second relative position of the second VR device is determined; Based on the first relative position and the second relative position, the relative position of the second VR device is determined; Sending the relative position of the second VR device to the second VR device, so that the user finds the first VR device based on the relative position, and / or based on the second picture taken in the second VR device, the process of losing the first VR device is viewed.

2. The method of claim 1, wherein, The first VR device is further configured with a third monitoring element, and the step of sending the relative position of the second VR device to the second VR device, so that the user finds the first VR device based on the relative position, comprises: When it is detected that the anti-loss function is turned on, the real-time relative position of the second VR device is determined, wherein the real-time relative position is determined based on the real-time movement data of the second VR device and the real-time movement data of the first VR device monitored by the third monitoring element; Sending the real-time relative position of the second VR device to the second VR device, so that the user finds the first VR device based on the real-time relative position.

3. The method of claim 2, wherein, The third monitoring element is an inertial measurement unit, and the step of determining the real-time relative position of the second VR device comprises: Based on the real-time movement data of the second VR device and the acceleration of the real-time movement of the first VR device monitored by the inertial measurement unit, the real-time relative position of the second VR device is determined.

4. The method of claim 1, wherein, Before the step of determining the position of the first VR device through the monitoring data of the first monitoring element, it comprises: receive the preset marker position data sent by the second VR device; initialize the first monitoring element based on the marker position data.

5. The method of claim 1, wherein, The step of determining the relative position of the second VR device based on the first relative position and the second relative position comprises: If it is determined that there is an occlusion between the first camera and the second VR device, and / or it is determined that there is an occlusion between the second camera, the second relative position is directly determined as the relative position of the second VR device, wherein the first relative position is invalid.

6. A finding device of an interactive device, characterized in that, The finding device of the interactive device comprises: A determining module is configured to determine a self position based on monitoring data of the first monitoring element when a communication connection is established with the second VR device. A receiving module is configured to receive movement data sent by the second VR device, wherein the movement data is monitored by a second monitoring element. A sending module is configured to determine a first relative position of the second VR device based on a first picture taken by a first camera and a second picture sent by the second VR device, wherein the first picture is a picture of the second VR device taken by the first camera, and the second picture is a picture of the first VR device taken by a second camera; determine a second relative position of the second VR device based on the self position and the movement data of the second VR device; determine a relative position of the second VR device based on the first relative position and the second relative position; send the relative position of the second VR device to the second VR device, so that a user finds the first VR device based on the relative position, and / or views a process of the first VR device being lost based on the second picture taken by the second VR device; if it is detected that a relative distance corresponding to the relative position is greater than a distance threshold, a voice prompt is given, so that the user finds the first VR device according to a sound source.

7. A finding device of an interactive device, characterized in that The finding device of the interactive device comprises a memory, a processor, and a finding program of the interactive device stored in the memory and executable on the processor, wherein the processor executes the finding program of the interactive device to implement the steps of the finding method of the interactive device according to any one of claims 1 to 5.

8. A storage medium, characterized by The storage medium stores a program for implementing the finding method of the interactive device, and the program for implementing the finding method of the interactive device is executed by the processor to implement the steps of the finding method of the interactive device according to any one of claims 1 to 5.

Images