Display method, device, and storage medium

Abstract

The present disclosure relates to a display method, device, and storage medium. The method is applied to a wearable electronic device, and includes: obtaining device information of an identified device; determining the morphological information of the identified device; and displaying the device information on the identified device based on the morphological information. The embodiment of the present disclosure can display device information at different positions of the identified device according to the different morphological information of the identified device, thereby making the display of device information on the wearable electronic device more refined and intelligent.

Description

Technical Field

[0001] The present disclosure relates to the technical field of Internet of Things, and in particular to a display method and device, and a storage medium. Background Art

[0002] With the development of technology, the Internet of Things (IoT) can realize the interconnection and interoperability of devices.

[0003] Wearable electronic devices such as AR glasses can interact with artificial intelligence and Internet of Things (AIoT) devices. However, in the process of realizing the interaction between AIoT devices and AR glasses, the information output methods of AR glasses are limited, and often require manual control by users, which is not intelligent enough.

[0004] Therefore, finding a solution that can achieve intelligent interconnection between wearable electronic devices and AIoT devices has become a hot topic in current research. Summary of the invention

[0005] The present disclosure provides a display method and device, and a storage medium.

[0006] According to a first aspect of an embodiment of the present disclosure, there is provided a display method, which is applied to a wearable electronic device, comprising:

[0007] Get the device information of the identified device;

[0008] Determining the morphological information of the identified device;

[0009] Based on the form information, the device information is displayed on the identified device.

[0010] In some embodiments, displaying the device information on the identified device based on the morphology information includes:

[0011] When the morphological information indicates that the identified device does not have a plane, displaying the device information around the outline of the identified device;

[0012] When the shape information indicates that the identified device has a plane, the device information is displayed according to the amount of information contained in the device information.

[0013] In some embodiments, displaying the device information according to the amount of information included in the device information includes:

[0014] When the amount of information is greater than a preset threshold, displaying the device information around the outline of the identified device;

[0015] When the amount of information is less than or equal to the preset threshold, displaying the device information on the plane;

[0016] The device information at least includes the running status information of the identified device and the operation control information of the identified device.

[0017] In some embodiments, the method further comprises:

[0018] When the device information includes mandatory prompt display information, the device information is displayed on the wearable electronic device.

[0019] In some embodiments, the acquiring device information of the identified device includes:

[0020] Based on a first predetermined rule, determining the identified device;

[0021] Based on a second predetermined rule, device information of the identified device is acquired.

[0022] In some embodiments, the determining the identified device based on the first predetermined rule includes one or more of the following:

[0023] Determining the identified device based on the communication connection relationship of the wearable electronic device;

[0024] Determining the identified device based on visual recognition of the wearable electronic device;

[0025] Based on the auditory recognition of the wearable electronic device, the identified device is determined.

[0026] In some embodiments, the determining the identified device based on visual recognition of the wearable electronic device includes:

[0027] Performing identification based on a computer vision recognition model of the wearable electronic device to determine the identified device;

[0028] or,

[0029] The visual two-dimensional code is identified based on the wearable electronic device to determine the identified device.

[0030] In some embodiments, the acquiring the device information of the identified device based on the second predetermined rule includes one or more of the following:

[0031] Based on a communication connection established between the identified device and the wearable electronic device through a communication protocol, receiving the device information sent by the identified device;

[0032] Based on a public network connecting the wearable electronic device and the identified device, the device information sent by the identified device to the public network is received.

[0033] According to a second aspect of an embodiment of the present disclosure, a display device is provided, which is applied to a wearable electronic device, and the device includes:

[0034] A first acquisition module, configured to acquire device information of an identified device;

[0035] A first determining module, configured to determine the morphological information of the identified device;

[0036] The first display module is configured to display the device information on the identified device based on the morphology information.

[0037] In some embodiments, the first display module includes:

[0038] a second display module, configured to display the device information around the outline of the identified device when the morphology information indicates that the identified device does not have a plane;

[0039] The third display module is configured to display the device information according to the amount of information contained in the device information when the morphology information indicates that the identified device has a plane.

[0040] In some embodiments, the third display module includes:

[0041] A fourth display module, configured to display the device information around the outline of the identified device when the amount of the information is greater than a preset threshold;

[0042] a fifth display module, configured to display the device information on the plane when the amount of the information is less than or equal to the preset threshold;

[0043] The device information at least includes the running status information of the identified device and the operation control information of the identified device.

[0044] In some embodiments, the apparatus further comprises:

[0045] The sixth display module is configured to display the device information on the wearable electronic device when the device information includes mandatory prompt display information.

[0046] In some embodiments, the first acquisition module includes:

[0047] A second determination module is configured to determine the identified device based on a first predetermined rule;

[0048] The second acquisition module is configured to acquire the device information of the identified device based on a second predetermined rule.

[0049] In some embodiments, the second determining module includes one or more of the following:

[0050] A third determination module is configured to determine the identified device based on the communication connection relationship of the wearable electronic device;

[0051] a fourth determination module, configured to determine the identified device based on visual recognition of the wearable electronic device;

[0052] The fifth determination module is configured to determine the identified device based on auditory recognition of the wearable electronic device.

[0053] In some embodiments, the fourth determination module is further configured to identify the identified device based on a computer vision recognition model of the wearable electronic device; or to determine the identified device based on the wearable electronic device identifying a visual QR code.

[0054] In some embodiments, the second acquisition module is further configured as one or more of the following: based on the communication connection established between the identified device and the wearable electronic device through a communication protocol, receiving the device information sent by the identified device; based on a public network connecting the wearable electronic device and the identified device, receiving the device information sent by the identified device to the public network.

[0055] According to a third aspect of an embodiment of the present disclosure, a device is provided, the device comprising at least: a processor and a memory for storing executable instructions that can be run on the processor, wherein:

[0056] When the processor is used to run the executable instructions, the executable instructions execute the steps in the display method provided in the first aspect above.

[0057] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the display method provided in the first aspect above.

[0058] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0059] In the embodiment of the present disclosure, the wearable electronic device obtains the device information of the identified device, determines the morphological information of the identified device, and displays the device information on the identified device based on the morphological information. In this way, the embodiment of the present disclosure can display the device information at different positions of the identified device according to the different morphological information of the identified device, thereby making the display of device information by the wearable electronic device more refined and intelligent.

[0060] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0062] Figure 1 This is a display method flow shown in the embodiment of the present disclosure Figure 1 .

[0063] Figure 2a This is a second flow chart of a display method shown in an embodiment of the present disclosure.

[0064] Figure 2b This is a device information display schematic diagram shown in the embodiment of the present disclosure. Figure 1 .

[0065] Figure 2c This is a second schematic diagram of device information display shown in an embodiment of the present disclosure.

[0066] Figure 3 It is a schematic diagram of determining an identified device shown in an embodiment of the present disclosure.

[0067] Figure 4 It is a schematic diagram of determining device information shown in an embodiment of the present disclosure.

[0068] Figure 5 This is a display method flow shown in the embodiment of the present disclosure Figure 3 .

[0069] Figure 6 It is a schematic diagram of device interaction shown in an embodiment of the present disclosure.

[0070] Figure 7 A display device according to an exemplary embodiment is shown Figure 1 .

[0071] Figure 8 FIG2 is a display device shown according to an exemplary embodiment. DETAILED DESCRIPTION

[0072] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0073] Figure 1 This is a display method flow shown in the embodiment of the present disclosure Figure 1 ,like Figure 1 As shown, the method applied to a wearable electronic device comprises the following steps:

[0074] S101, obtaining device information of the identified device;

[0075] S102, determining the form information of the identified device;

[0076] S103: Based on the form information, display the device information on the identified device.

[0077] In the disclosed embodiment, the display method is applicable to the interaction scenario between a wearable electronic device and an Artificial Intelligence & Internet of Thing (AIoT) device. The wearable electronic device may include a head-mounted display device, such as an AR device, a VR device, an MR device, etc.; it may also include a wearable sports device, such as a smart watch or a smart bracelet. The AIOT device includes but is not limited to terminal devices and smart home appliances in the Internet of Things, such as mobile phones, routers, televisions, speakers, air conditioners, or rice cookers.

[0078] The interaction scenarios between the wearable electronic devices and AIOT devices may include: interaction scenarios between AR glasses and TV, interaction scenarios between AR glasses and speakers, or interaction scenarios between AR glasses and mobile phones. For example, AR glasses interact with TV to virtually display TV device information on TV; AR glasses interact with speakers to virtually display speaker device information on speakers.

[0079] In step S101, the identified device is an electronic device identified by the wearable electronic device within the identification range. The identified device can be any electronic device in the AIOT device, for example, the identified device can include a TV, a speaker, an air conditioner or a mobile phone, which is not limited in the embodiments of the present disclosure.

[0080] The above-mentioned identification range can be determined according to different identified devices. When the identified device is a head-mounted display device, the identification range can be the field of view angle range or field of view range of the head-mounted display device; when the identified device is a smart bracelet or smart watch, the identification range can be a range defined by a predetermined distance as a radius, or can be the emission range of an identification sensor in the smart watch or smart bracelet, such as a radar sensor or a laser sensor, which is not limited in the embodiments of the present disclosure.

[0081] It should be noted that the device information can be understood as the operating status information of the identified device or the operation control information of the identified device.

[0082] The operating status information of the identified device may include: operating parameters or operating modes of the identified device. For example, when the identified device is an air conditioner, the operating status information may include: the wind speed of the air conditioner, the temperature of the air conditioner, or the air conditioner is in heating mode; when the identified device is a TV, the operating status information may include: the memory information of the TV, the graphics card information of the TV, or the screen display information of the TV, which is not limited in the embodiments of the present disclosure.

[0083] The operation control information of the identified device may include: various control functions of the identified device. For example, when the identified device is a TV, the operation control information of the identified device includes: power on / off control, volume adjustment control or FM / channel switching control, which is not limited in the embodiments of the present disclosure.

[0084] The above-mentioned acquisition of the device information of the identified device can be understood as: first identify the identified device, and then acquire the device information of the identified device. For example, the AR glasses first identify the identified device as a speaker, and then identify the device information of the speaker as playing nursery rhymes. For another example, the AR glasses first identify the identified device as an air conditioner, and then identify the device information of the air conditioner as being in the heating state.

[0085] In step S102, the morphological information of the identified device can be understood as: shape information and size information of the identified device. Among them, the shape information can be used to determine the shape of the identified device, and whether the identified device has a plane or a curved surface. For example, the shape information can be used to determine that the identified device is a cube with a plane. For another example, the shape information can be used to determine that the identified device is a cylinder with a curved surface and a plane. The size information can be used to determine the sizes of different surfaces of the identified device. For example, the size information can be used to determine the area of ​​a plane of the identified device that is in the shape of a cube.

[0086] In the embodiments of the present disclosure, determining the morphological information of the identified device may include: identifying through a computer vision recognition model of a wearable electronic device to determine the morphological information of the identified device; it may also include: establishing communication between the wearable electronic device and the identified device, and receiving the morphological information sent by the identified device; it may also include: connecting the wearable electronic device to a public network of the identified device, and receiving the morphological information sent to the public network by the identified device, which is not limited by the embodiments of the present disclosure.

[0087] It should be noted that the wearable electronic device has a camera module, a radar module or an ultrasonic module, which can collect the contour information of the identified device and input the contour information into the computer vision recognition model to obtain the morphological information of the identified device.

[0088] In step S103, after determining the device information and the shape information of the identified device, the wearable electronic device may display the device information on the identified device based on the shape information.

[0089] It should be noted that the form information is associated with the position where the device information is displayed on the identified device. Different form information will result in different positions where the device information is displayed on the identified device. In this way, the wearable electronic device can display device information at different positions on the identified device based on the different forms of the identified device.

[0090] In an embodiment of the present disclosure, displaying device information on an identified device based on morphological information may include: displaying device information on one or more surfaces of the identified device, wherein the surface includes but is not limited to a plane or a curved surface; and may also include: displaying device information around the outline of the identified device.

[0091] It should be noted that, in the embodiment of the present disclosure, one surface facing the wearable electronic device may be selected from multiple surfaces of the identified device to display device information. In this way, the device information of the identified device can be better viewed through the wearable electronic device.

[0092] In the embodiment of the present disclosure, the device information of the identified device is obtained, the form information of the identified device is determined, and the device information is displayed on the identified device based on the form information. In this way, the embodiment of the present disclosure can display the device information at different positions of the identified device according to the different form information of the identified device, thereby making the display of device information on the wearable electronic device more refined and intelligent.

[0093] In some embodiments, Figure 2a As shown, the device information is displayed on the identified device based on the form information, that is, step S103, including:

[0094] S103a, when the morphological information indicates that the identified device does not have a plane, displaying the device information around the outline of the identified device;

[0095] S103b: When the shape information indicates that the identified device has a plane, display the device information according to the amount of information contained in the device information.

[0096] In step S103a, the morphological information of the identified device indicates that the identified device does not have a plane, which can be understood as: different surfaces of the identified device are all composed of curved surfaces. For example, the identified device can be circular, elliptical or irregularly curved, which is not limited in the embodiment of the present disclosure.

[0097] It should be noted that displaying device information around the outline of the identified device may include: displaying multiple information to be displayed contained in the device information around the outside of the identified device; or displaying multiple information to be displayed contained in the device information on opposite sides of the identified device.

[0098] Compared with displaying device information in one direction of the identified device, the embodiment of the present disclosure displays device information around the outline of the identified device when the morphological information indicates that the identified device does not have a plane. This can reduce the situation where other devices are obscured due to the large amount of information contained in the device information, improve the display effect of the device information, and make the display of the device information more in line with user habits.

[0099] In the embodiment of the present disclosure, when there are multiple identified devices, displaying the device information around the outline of the identified device may further include: displaying the device information around the outline of the identified device in the gaps between the multiple identified devices. In this way, the situation of blocking other devices due to the large amount of information contained in the device information can be reduced, the display effect of the device information is improved, and the display of the device information can be made more in line with user habits.

[0100] In step S103b, the morphological information of the identified device indicates that the identified device has a plane, which can be understood as the identified device is composed of a plane, for example, the identified device is square or triangular; it can also be understood as being composed of a plane and a curved surface, for example, the identified device is cylindrical or conical.

[0101] In the disclosed embodiment, the number of information contained in the device information may be one or more. For example, when the identified device is an air conditioner, the number of information contained in the device information of the air conditioner may be 5, which are the wind speed of the air conditioner, the temperature of the air conditioner, the mode adjustment button of the air conditioner, the wind speed adjustment button of the air conditioner, or the temperature adjustment switch of the air conditioner. For another example, when the identified device is a water heater, the number of information contained in the device information of the water heater may be 3, which are the water valve opening button of the water heater, the water temperature of the water heater, or the water volume adjustment switch of the water heater.

[0102] It should be noted that when the morphological information indicates that the identified device has a plane, the device information can be displayed directly on the plane or around the outline of the identified device. The plane size of the identified device is limited. When the area occupied by the amount of information contained in the device information is larger than the area occupied by the plane, the information display will be incomplete. Therefore, when it is indicated that the identified device has a plane, the device information needs to be displayed according to the amount of information contained in the device information.

[0103] In the disclosed embodiments, displaying device information around the outline of the identified device or displaying device information according to the amount of information contained in the device information can facilitate the wearable electronic device to control the identified device according to the device information to achieve different functions.

[0104] It should be noted that when the wearable electronic device is a head-mounted display device, such as AR glasses, it can first receive user control instructions in various ways such as gaze point, capturing motion posture, and receiving voice input; and determine the function to be operated by analyzing the user control instructions, and the function of the operation is the function corresponding to the device information displayed on the identified device; and then execute the function of the operation to enable the wearable electronic device to control the identified device according to the device information.

[0105] For example, Figure 2b As shown, the wearable electronic device is an AR glasses, the identified device is an air conditioner, and the device information includes: the wind speed of the air conditioner, the temperature of the air conditioner, the mode adjustment button of the air conditioner, the wind speed adjustment button of the air conditioner, or the temperature adjustment switch of the air conditioner, and the device information is displayed around the outline of the air conditioner. In the embodiment of the present disclosure, the wearable electronic device can click the mode adjustment button of the air conditioner to adjust the current mode of the air conditioner to the heating mode, so that the AR glasses can control the air conditioner to perform the heating function according to the device information.

[0106] In some embodiments, displaying the device information according to the amount of information contained in the device information includes:

[0107] When the amount of the information is greater than a preset threshold, displaying the device information around the outline of the identified device;

[0108] When the amount of information is less than or equal to the preset threshold, displaying the device information on the plane;

[0109] The device information at least includes the running status information of the identified device and the operation control information of the identified device.

[0110] In the disclosed embodiment, the preset threshold can be set according to the area occupied by the plane of the identified device. The area occupied by the plane of the identified device is positively correlated with the value of the preset threshold. The larger the area occupied by the plane of the identified device, the larger the value of the preset threshold.

[0111] It should be noted that the preset threshold value may be in the range of 3 to 8. For example, the preset threshold value is 5. When the number of information is greater than 5, the device information is displayed around the outline of the identified device; when the number of information is less than or equal to 5, the device information is displayed on the plane. Figure 2c As shown, the identified device is an air conditioner having a plane. The device information of the air conditioner includes: the temperature of the air conditioner and the wind speed of the air conditioner. The device information of the air conditioner can be displayed on the plane of the air conditioner.

[0112] In the embodiment of the present disclosure, the amount of the above information is greater than a preset threshold, indicating that the display area occupied by the device information may be larger than the area occupied by the plane of the identified device. At this time, displaying the device information around the outline of the identified device can reduce the situation of incomplete display and improve the display effect.

[0113] The above information quantity is less than or equal to the preset threshold, indicating that the display area occupied by the device information may be smaller than the area occupied by the plane of the identified device. At this time, displaying the device information on the plane of the identified device can make the display of the device information more diversified.

[0114] In an embodiment of the present disclosure, displaying device information on a plane may include: arranging the information to be displayed contained in the device information vertically or horizontally on the plane according to a preset interval distance; it may also include: dividing the information to be displayed into at least two rows according to the length of the information to be displayed contained in the device information, and arranging them on the plane, which is not limited by the embodiment of the present disclosure.

[0115] Wherein, according to the length of the information to be displayed contained in the device information, the information to be displayed is divided into at least two lines, including: dividing the information to be displayed whose length is less than the length threshold into one line, and dividing the information to be displayed whose length is greater than or equal to the length threshold into another line, forming at least two lines of information to be displayed. In some embodiments, the method further includes:

[0116] When the device information includes mandatory prompt display information, the device information is displayed on the wearable electronic device.

[0117] In the disclosed embodiment, the mandatory prompt message is the task with the highest priority among the tasks executed by the wearable electronic device. When the wearable electronic device executes the task, the wearable electronic device will preferentially execute the task with the highest priority.

[0118] Among them, the mandatory prompt message can be set as needed. The mandatory prompt message includes but is not limited to a telephone prompt message, a voice prompt message, a video prompt message or an alarm prompt message, which is not limited by the embodiments of the present disclosure. For example, when the mandatory prompt message is an alarm prompt message, the alarm prompt message can be directly displayed through a wearable electronic device to achieve timely alarm and improve user experience. For another example, when the mandatory prompt message is a telephone prompt message, the incoming call prompt message can be directly displayed through a wearable electronic device to achieve timely answering of the call and improve user experience.

[0119] It should be noted that the highest priority tasks that need to be performed by wearable electronic devices are different for different devices. For example, for air conditioners, washing machines, natural gas or electric fans, the highest priority task is alarm prompt, that is, the mandatory prompt message is alarm prompt; for mobile phones, the highest priority task is phone or voice prompt, that is, the mandatory prompt message is phone or voice prompt.

[0120] In some embodiments, the acquiring device information of the identified device includes:

[0121] Based on a first predetermined rule, determining the identified device;

[0122] Based on a second predetermined rule, device information of the identified device is acquired.

[0123] In the embodiment of the present disclosure, the first predetermined rule is a rule for the wearable electronic device to identify the identified device.

[0124] In some embodiments, the determining the identified device based on the first predetermined rule includes one or more of the following:

[0125] Determining the identified device based on the communication connection relationship of the wearable electronic device;

[0126] Determining the identified device based on visual recognition of the wearable electronic device;

[0127] Based on the auditory recognition of the wearable electronic device, the identified device is determined.

[0128] In the embodiments of the present disclosure, the communication connection relationship of the wearable electronic device includes: Bluetooth communication established between the wearable electronic device and the identified device; or, ultra-wideband communication established between the wearable electronic device and the identified device; or, near-field communication established between the wearable electronic device and the identified device, which is not limited in the embodiments of the present disclosure.

[0129] Among them, the wearable electronic device can have an ultra-wideband (UWB) module, or communicate through a wifi module, a bluetooth module, a laser module, an infrared module, or a zigbee module. Correspondingly, the identified device also has the above-mentioned modules to establish different communication connections with the wearable electronic device to determine the identified device.

[0130] It should be noted that after establishing a communication connection, the wearable electronic device can directly determine the identified device through the identity information sent by the identified device. The identity information can be the device serial number, or the device SN number, device identification, or device authentication related information.

[0131] In the disclosed embodiment, the identified device is determined based on the auditory recognition of the wearable electronic device, including: determining the identified device based on the sound wave signal output by the identified device and received by the wearable electronic device; or determining the identified device based on the auditory QR code on the identified device. For example, the auditory QR code is used to determine the identified device through the speaker on the identified device or the ultrasonic wave emitted.

[0132] The sound wave signal may include a sound wave signal audible to the human ear, or a sound wave signal inaudible to the human ear, such as ultrasonic wave or infrasonic wave.

[0133] It should be noted that the wearable electronic device can determine the identified device through the millimeter wave module, ultrasonic module or radar module it has.

[0134] In the embodiment of the present disclosure, in the process of determining the identified device by visual recognition, the identified device can be determined by image acquisition or recognition of a QR code. In some embodiments, the determination of the identified device based on the visual recognition of the wearable electronic device includes: determining the identified device by identifying based on a computer visual recognition model of the wearable electronic device; or determining the identified device by identifying a visual QR code based on the wearable electronic device.

[0135] It should be noted that wearable electronic devices can obtain device information of the identified device through a camera, laser sensor or radar sensor, and input the device information into a computer vision recognition model for identification to determine the identified device; among them, the computer vision recognition model can be updated based on the recognition sample data collected from the artificial intelligence Internet to improve the recognition accuracy.

[0136] The wearable electronic device can also identify the identified device by identifying the visual QR code on the identified device. The visual QR code is formed by the fusion of the background image area and the QR code body area. For example, the visual QR code includes but is not limited to the light on / off QR code.

[0137] In the embodiment of the present disclosure, in the process of determining the identified device, the identified device can be determined by using a variety of determination methods. Figure 3 As shown, the identification methods of the identified device include: artificial intelligence vision, artificial intelligence hearing, ultra-wideband, Bluetooth, ultrasound or light-on / dark QR code. In the embodiment of the present disclosure, one or more methods can be selected from the identification methods of the identified device to determine the identified device.

[0138] For example, the identified device can be jointly determined based on the Bluetooth connection relationship of the wearable electronic device and artificial intelligence vision. For another example, the identified device can be jointly determined based on artificial intelligence vision and ultrasound of the wearable electronic device. In this way, by selecting multiple identification methods to jointly determine the identified device, the accuracy of identification can be improved.

[0139] It should be noted that in the process of determining the identified device, the identified device can also be determined by formulating an identification priority. For example, when a wearable electronic device establishes a communication connection with an identified device, the identified device can be determined based on the communication connection relationship of the wearable electronic device; when the wearable electronic device cannot establish a communication connection with the identified device, the identified device can be determined based on the visual recognition or auditory recognition of the wearable electronic device. In this way, the embodiment of the present disclosure can preferentially use the communication connection method to determine the identified device, which can improve the recognition efficiency and recognition accuracy of the identified device.

[0140] In some embodiments, the acquiring the device information of the identified device based on the second predetermined rule includes one or more of the following:

[0141] Based on a communication connection established between the identified device and the wearable electronic device through a communication protocol, receiving the device information sent by the identified device;

[0142] Based on a public network connecting the wearable electronic device and the identified device, the device information sent by the identified device to the public network is received.

[0143] In the embodiments of the present disclosure, the communication protocol includes a Bluetooth communication protocol, an ultra-wideband communication protocol, or a near-field communication protocol, which is not limited by the embodiments of the present disclosure. After establishing a communication connection, the wearable electronic device can directly receive the device information of the identified device sent by the identified device. For example, when the wearable electronic device is a smart bracelet or a smart watch, the identified device can be determined through the communication connection established by the ultra-wideband, and the device information of the identified device transmitted by the identified device through the communication connection established by the ultra-wideband can be obtained. For another example, when the wearable electronic device is AR glasses and the identified device is a temperature sensor, the temperature sensor can be directly connected to the AR glasses via Bluetooth, and the device information of the temperature sensor can be directly transmitted to the AR device via Bluetooth.

[0144] In the process of using the public network to obtain the screen status of the identified device, the public network can establish communication connections with the wearable electronic device and the identified device respectively, and then the wearable electronic device of the embodiment of the present disclosure can indirectly obtain the device information of the identified device through the public network. For example, the wearable electronic device is AR glasses, and the identified device is a smoke sensor; the AR glasses are connected to the smoke sensor through the narrowband Internet of Things (Nbiot) to the public network; the AR glasses are connected to the smoke sensor through the low-speed and short-distance transmission wireless network protocol (zigee), multi-port repeater (HUB), and wireless fidelity (wifi) to the public network. For another example, the wearable electronic device is AR glasses, and the identified device is a water heater; the AR glasses are connected to the water heater through wireless fidelity (wifi) to the public network.

[0145] In the embodiment of the present disclosure, in the process of determining the device information of the identified device, the device information of the identified device can be determined by using multiple determination methods. Figure 4 As shown, the determination method of the device information of the identified device includes: public network or communication connection. In the embodiment of the present disclosure, one or two of the determination methods of the identified device can be selected to determine the device information of the identified device.

[0146] For example, the device information of the identified device can be jointly determined based on the communication connection relationship of the wearable electronic device and the computer vision recognition model. In this way, the device information of the identified device can be obtained by multiple determination methods to improve the recognition accuracy.

[0147] It should be noted that, in the process of determining the device information of the identified device, the device information of the identified device can also be determined by setting a priority. For example, when a wearable electronic device establishes a communication connection with an identified device, the device information of the identified device sent by the identified device can be received based on the communication connection established between the identified device and the wearable electronic device through a communication protocol; when the wearable electronic device cannot establish a communication connection with the identified device, the device information of the identified device can be determined based on a public network connecting the wearable electronic device and the identified device. In this way, the embodiment of the present disclosure can preferentially use a communication connection to determine the device information of the identified device, which can improve the recognition efficiency and accuracy of the device information of the identified device.

[0148] In order to better understand the above embodiments, the embodiments of the present disclosure are exemplified as follows:

[0149] The wearable electronic device first obtains the device information of the identified device and determines the shape information of the identified device, and then displays the device information on the identified device based on the shape information. Figure 5 As shown, the wearable electronic device displays device information on the identified device based on the morphological information, including the following steps:

[0150] S201, determine whether the identified device has a plane; if not, go to step S202; if yes, go to step S203;

[0151] S202, displaying device information around the outline of the identified device;

[0152] S203, determine whether the amount of information contained in the device information is greater than a preset threshold; if so, go to step S204, if not, go to step S205;

[0153] S204, displaying device information around the outline of the identified device;

[0154] S205: Display the device information on the plane.

[0155] In the disclosed embodiment, the wearable electronic device can display device information at different positions of the identified device according to different morphological information of the identified device, thereby making the display of device information by the wearable electronic device more refined and intelligent.

[0156] like Figure 6As shown, taking the wearable electronic device as AR glasses and the identified device as an air conditioner as an example, in the disclosed embodiment, a Bluetooth communication connection is established between the AR glasses and the air conditioner. After the AR glasses establish a communication connection with the air conditioner, the air conditioner can send information to the AR glasses through the Bluetooth communication connection; the AR glasses receive the information sent by the air conditioner, and based on the information, determine that the identified device is the air conditioner and the device information and morphological information of the air conditioner, and then the AR glasses can display the device information on the identified device based on the morphological information. In this way, the wearable electronic device can display the device information at different positions of the identified device according to the different morphological information of the identified device, thereby making the display of device information by the wearable electronic device more refined and intelligent.

[0157] Figure 7 A display device according to an exemplary embodiment is shown Figure 1 . Reference Figure 7 The display device includes a first acquisition module 1001, a first determination module 1002 and a first display module 1003, wherein:

[0158] A first acquisition module 1001 is configured to acquire device information of an identified device;

[0159] A first determination module 1002 is configured to determine the form information of the identified device;

[0160] The first display module 1003 is configured to display the device information on the identified device based on the form information.

[0161] In some embodiments, the first display module includes:

[0162] a second display module, configured to display the device information around the outline of the identified device when the morphology information indicates that the identified device does not have a plane;

[0163] The third display module is configured to display the device information according to the amount of information contained in the device information when the morphology information indicates that the identified device has a plane.

[0164] In some embodiments, the third display module includes:

[0165] A fourth display module, configured to display the device information around the outline of the identified device when the amount of the information is greater than a preset threshold;

[0166] a fifth display module, configured to display the device information on the plane when the amount of the information is less than or equal to the preset threshold;

[0167] The device information at least includes the running status information of the identified device and the operation control information of the identified device.

[0168] In some embodiments, the apparatus further comprises:

[0169] The sixth display module is configured to display the device information on the wearable electronic device when the device information includes mandatory prompt display information.

[0170] In some embodiments, the first acquisition module includes:

[0171] A second determination module is configured to determine the identified device based on a first predetermined rule;

[0172] The second acquisition module is configured to acquire the device information of the identified device based on a second predetermined rule.

[0173] In some embodiments, the second determining module includes one or more of the following:

[0174] A third determination module is configured to determine the identified device based on the communication connection relationship of the wearable electronic device;

[0175] a fourth determination module, configured to determine the identified device based on visual recognition of the wearable electronic device;

[0176] The fifth determination module is configured to determine the identified device based on auditory recognition of the wearable electronic device.

[0177] In some embodiments, the fourth determination module is further configured to identify the identified device based on a computer vision recognition model of the wearable electronic device; or to determine the identified device based on the wearable electronic device identifying a visual QR code.

[0178] In some embodiments, the second acquisition module is further configured as one or more of the following: based on the communication connection established between the identified device and the wearable electronic device through a communication protocol, receiving the device information sent by the identified device; based on a public network connecting the wearable electronic device and the identified device, receiving the device information sent by the identified device to the public network.

[0179] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0180] Figure 8FIG2 is a display device according to an exemplary embodiment. For example, the device may be a wearable device, and the wearable device includes: a smart watch, a smart bracelet or AR glasses.

[0181] Reference Figure 8 , the device may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0182] The processing component 802 generally controls the overall operation of the device, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0183] The memory 804 is configured to store various types of data to support the operation of the device. Examples of such data include instructions for any application or method operating on the device, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0184] The power component 806 provides power to the various components of the device. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device.

[0185] The multimedia component 808 includes a screen that provides an output interface between the device and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0186] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0187] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0188] The sensor assembly 814 includes one or more sensors for providing various aspects of the status assessment for the device. For example, the sensor assembly 814 can detect the open / closed state of the device, the relative positioning of the components, such as the display and keypad of the device, and the sensor assembly 814 can also detect the position change of the device or a component of the device, the presence or absence of user contact with the device, the device orientation or acceleration / deceleration and the temperature change of the device. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0189] The communication component 816 is configured to facilitate wired or wireless communication between the device and other devices. The device can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0190] In an exemplary embodiment, the apparatus may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above methods.

[0191] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by the processor 820 of the device to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0192] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a wearable electronic device, enables the wearable electronic device to perform a display method, the method comprising:

[0193] Get the device information of the identified device;

[0194] Determining the morphological information of the identified device;

[0195] Based on the form information, the device information is displayed on the identified device.

[0196] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0197] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A display method, characterized in that: Applied to a wearable electronic device, the method comprises: Get the device information of the identified device; Determine the morphological information of the identified device; the morphological information includes shape information and size information of the identified device; Based on the form information, display the device information on the identified device; wherein the device information is displayed at different positions on the identified device depending on the form information; The displaying the device information on the identified device based on the form information includes: When the morphological information indicates that the identified device does not have a plane, displaying the device information around the outline of the identified device; When the morphology information indicates that the identified device has a plane, displaying the device information according to the amount of information included in the device information; The displaying of the device information according to the amount of information contained in the device information includes: When the amount of information is greater than a preset threshold, displaying the device information around the outline of the identified device; When the amount of information is less than or equal to the preset threshold, displaying the device information on the plane; The device information at least includes the running status information of the identified device and the operation control information of the identified device.

2. The method according to claim 1, characterized in that The method further comprises: When the device information includes mandatory prompt display information, the device information is displayed on the wearable electronic device.

3. The method according to claim 1, characterized in that The obtaining device information of the identified device includes: Based on a first predetermined rule, determining the identified device; Based on a second predetermined rule, device information of the identified device is acquired.

4. The method according to claim 3, characterized in that: The determining the identified device based on the first predetermined rule includes one or more of the following: Determining the identified device based on the communication connection relationship of the wearable electronic device; Determining the identified device based on visual recognition of the wearable electronic device; Based on the auditory recognition of the wearable electronic device, the identified device is determined.

5. The method according to claim 4, characterized in that The step of determining the identified device based on visual recognition of the wearable electronic device includes: Performing identification based on a computer vision recognition model of the wearable electronic device to determine the identified device; or, The visual two-dimensional code is identified based on the wearable electronic device to determine the identified device.

6. The method according to claim 3, characterized in that The acquiring the device information of the identified device based on the second predetermined rule includes one or more of the following: Based on a communication connection established between the identified device and the wearable electronic device through a communication protocol, receiving the device information sent by the identified device; Based on a public network connecting the wearable electronic device and the identified device, the device information sent by the identified device to the public network is received.

7. A display device, characterized in that: Applied to a wearable electronic device, the device comprises: A first acquisition module, configured to acquire device information of an identified device; A first determination module is configured to determine the morphological information of the identified device; the morphological information includes shape information and size information of the identified device; A first display module, configured to display the device information on the identified device based on the morphology information; Wherein, the morphological information is different, and the device information is displayed at a different position on the identified device; The first display module comprises: a second display module, configured to display the device information around the outline of the identified device when the morphology information indicates that the identified device does not have a plane; a third display module, configured to display the device information according to the amount of information included in the device information when the morphology information indicates that the identified device has a plane; The third display module comprises: A fourth display module, configured to display the device information around the outline of the identified device when the amount of the information is greater than a preset threshold; a fifth display module, configured to display the device information on the plane when the amount of the information is less than or equal to the preset threshold; The device information at least includes the running status information of the identified device and the operation control information of the identified device.

8. The device according to claim 7, characterized in that The device also includes: The sixth display module is configured to display the device information on the wearable electronic device when the device information includes mandatory prompt display information.

9. The device according to claim 7, characterized in that The first acquisition module includes: A second determination module is configured to determine the identified device based on a first predetermined rule; The second acquisition module is configured to acquire the device information of the identified device based on a second predetermined rule.

10. The device according to claim 9, characterized in that The second determination module includes one or more of the following: A third determination module is configured to determine the identified device based on the communication connection relationship of the wearable electronic device; a fourth determination module, configured to determine the identified device based on visual recognition of the wearable electronic device; The fifth determination module is configured to determine the identified device based on auditory recognition of the wearable electronic device.

11. The device according to claim 10, characterized in that The fourth determination module is further configured to perform recognition based on a computer vision recognition model of the wearable electronic device to determine the recognized device; or, to perform recognition of a visual two-dimensional code based on the wearable electronic device to determine the recognized device.

12. The device according to claim 9, characterized in that The second acquisition module is also configured as one or more of the following: based on the communication connection established between the identified device and the wearable electronic device through a communication protocol, receiving the device information sent by the identified device; based on a public network connecting the wearable electronic device and the identified device, receiving the device information sent by the identified device to the public network.

13. A display device, characterized in that: The device comprises at least: a processor and a memory for storing executable instructions that can be run on the processor, wherein: When the processor is used to run the executable instructions, the executable instructions execute the steps in the display method provided in any one of claims 1 to 6.

14. A non-transitory computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the display method provided in any one of claims 1 to 6.

Images