Equipment and point location matching method, electronic equipment and system

Abstract

The embodiment of the invention provides a device and point location matching method, which comprises the following steps: when a first device installed at a first point location expresses a guide head and a device identifier of the first device through an information expression function, a second device determines the device identifier of the first device through an expression mode of the first device according to information expressed by the first device, the mapping relation between the device identifier of the first device and the first point location is established, and the expression mode of the first device is the expression mode used when the first device expresses the device identifier of the first device. According to the method, the electronic equipment and the system, the production cost and the labor cost of the equipment can be saved to a great extent, the matching efficiency of the equipment and the point location is improved, in addition, due to the introduction of the guide head, different equipment can use different expression modes, and the application range of the embodiment of the invention is expanded.

Description

Technical Field

[0001] Embodiments of the present application relate to the field of matching devices and points, and more specifically, to a method, electronic device, and system for matching devices and points. Background Art

[0002] Taking the whole-house smart scene as an example, multiple smart devices (such as lighting equipment, curtains, air conditioners, etc.) need to be uniformly controlled through a control center. Only when the control center knows the correspondence between the device identification and the installation point can accurate control of the target device be achieved.

[0003] However, the current implementation method is for the equipment manufacturer to print the equipment identification and paste the equipment identification on the equipment. During installation, the installer obtains the equipment identification on the equipment, matches the equipment identification with its installation point one by one, and then installs the equipment at the corresponding point. This method has the problems of high cost, low efficiency and high error rate. Summary of the Invention

[0004] The present application provides a method, electronic device and system for matching devices and points. Through this method, electronic device and system, the production cost and labor cost of the equipment can be saved to a great extent, and the matching efficiency of the equipment and points can be improved. In addition, due to the introduction of the guide head, different devices can use different expressions, which expands the scope of application of the embodiments of the present application.

[0005] In a first aspect, a method for matching devices and points is provided, the method comprising: when a first device expresses a guide head and a device identification through an information expression function, a second device determines the device identification of the first device through an expression method based on the information expressed by the first device, and the expression method is the expression method used by the first device when expressing the device identification, and the first device is installed at a first point; the second device establishes a mapping relationship between the device identification of the first device and the first point.

[0006] In some embodiments, the information expressed by the first device includes any one or more of light information and sound information, the light information includes at least one of visible light information and invisible light information, and the sound information includes at least one of amplitude information and frequency information.

[0007] In an embodiment of the present application, before the equipment is point-matched, the equipment can be installed directly at the predetermined point. The equipment manufacturer does not need to mark the equipment identification on the equipment, and the workers do not need to enter the equipment identification of each point by scanning the code or manually entering it, which greatly saves production costs and labor costs and improves efficiency. During installation, the installer does not need to search for corresponding equipment from multiple devices based on the matching relationship, which saves time costs. The installation can be installed in parallel, which improves installation efficiency. After all the installations are completed, the equipment identification of each of the multiple devices can be obtained through the information expressed by each of the multiple devices, and then a mapping relationship between the equipment and the point is established. This method has strong reliability and high matching efficiency.

[0008] Moreover, before expressing its own device identification, the device first expresses its own guide header information, which is used to express the expression method used when expressing the device identification. This allows all devices installed in the same whole-house smart scene to use an expression method that suits their actual situation based on their own attributes and the environment in which they are located. This not only makes the use scenarios of the method of the embodiment of the present application wider, but also makes the accuracy of the device identification expressed by the device higher.

[0009] In combination with the first aspect, in one possible implementation method, the expression method includes: information for indicating that the first device uses the information expressed by the first device to express the conversion relationship of the value of the identification bit of the device identifier, and / or information for indicating the time length required for the first device to express the value of an identification bit in the device identifier.

[0010] Optionally, the type of the identification bit is any one of numbers, letters, and symbols.

[0011] It can be understood that the required duration mentioned above refers to: the i-th device continuously expresses the value of an identification bit in its own device identification within a specific duration, and the specific duration is equal to the required duration mentioned above. The device can adopt different specific durations according to its own environment and its own properties. For example, when the environment in which the device is located is more disturbed, the specific duration that the device can adopt is longer. The longer the specific duration, the more sampling times within a specific duration, and the more accurate the value of the identification bit obtained. In other words, different devices can adopt different specific durations according to their own circumstances, which can improve the fault tolerance of the device identification recognition process, and thus improve the accuracy of device identification recognition.

[0012] In an embodiment of the present application, before expressing its own device identification, the device first expresses its own guidance header information, which is used to express the expression method used when expressing the device identification. This allows all devices installed in the same whole-house smart scene to use an expression method that suits their actual situation based on their own attributes and the environment in which they are located. This not only makes the use scenarios of the method of the embodiment of the present application wider, but also makes the accuracy of the device identification expressed by the device higher.

[0013] It can be understood that the form of information expression can be set as needed, and can be set to be cyclic, one-time expression, or intermittent expression, etc.

[0014] In combination with the first aspect, in a possible implementation manner, the method further includes: the second device receiving information indicating the expression manner.

[0015] In an embodiment of the present application, before the second device obtains the device identification of the first device based on the information expressed by the first device, the second device does not need to identify the expression used by the first device to express its own device identification through the information expressed by the first device, but can directly receive the expression of the first device sent by other devices. In this way, some second devices with weaker recognition capabilities can also obtain the device identification of the first device, which expands the scope of application of the embodiment of the present application.

[0016] In combination with the first aspect, in a possible implementation, the method also includes: when the first device expresses the guide header and device identification of the first device through the expressed information, the second device collects a first information sample, and the first information sample is an information sample for the first device to express information; by identifying the guide head of the first device according to the first information sample, the expression method is determined, and the guide head of the first device is used to indicate the expression method.

[0017] In an embodiment of the present application, before the second device obtains the device identification of the first device based on the information expressed by the first device, it can identify the boot header information of the first device based on the information expressed by the first device, and then obtain the expression method used by the first device to express its own device identification through the boot header information of the first device, and further obtain the device identification of the first device based on the expression method of the first device and the information expressed by the first device. In this way, when multiple devices use different expressions to express their own device identifications, the first device can identify the device identification of each device in the multiple devices.

[0018] In combination with the first aspect, in one possible implementation, the sampling interval duration of the second device collecting the first information sample is a first duration, and when the information expressed by the first device is visible light information, the expression method is determined by identifying the guide head of the first device according to the first information sample, including: if the second device determines through the first information sample that the first device expresses M+1 kinds of brightness, and there is a situation where the M+1 kinds of brightness are expressed continuously in the order of increasing brightness values, and, in the first information sample, the minimum number of samples in which the brightness value does not change continuously is n, then determining the expression method includes: the first device The device identification of the first device is expressed by the first M brightnesses among the M+1 brightnesses, wherein the value of the first brightness expression identification bit among the first M brightnesses is 0, the value of the second brightness expression identification bit among the first M brightnesses is 1,…, the value of the Mth brightness expression identification bit among the first M brightnesses is M-1, wherein the M+1th brightness among the M+1 brightnesses is used to express the end of the guide header of the first device, and M is a positive integer greater than 1; and the time required for the first device to express the value of an identification bit in the device identification is the product of n and the first time length, wherein n is a positive integer greater than or equal to 1.

[0019] In the embodiment of the present application, the device can express its own guide head and its own device identification through the brightness information of light, which enables all devices with the function of expressing light information to express their own device identification. Since most devices in the whole-house smart scene have the ability to express light information, this makes the solution of the embodiment of the present application applicable to almost all whole-house smart devices; and since the positions of multiple devices in the whole-house smart scene are generally different, and there is a high probability that there are partitions between multiple devices, when multiple devices express light information at the same time, there is little interference between each other, which also enables multiple devices to achieve parallel matching, which can greatly improve the matching efficiency of devices and points; in addition, the rule for the device to express the guide head can be an incremental rule, which enables the device to determine how many brightness levels to use to express its own device identification according to its own capabilities.

[0020] In combination with the first aspect, in one possible implementation, the sampling interval duration of the second device collecting the first information sample is a first duration. When the information expressed by the first device is visible light information, the expression method is determined by identifying the guide head of the first device according to the first information sample, including: if the second device determines through the first information sample that the first device expresses M+1 colors, and there is a situation where the M+1 colors are expressed continuously in the order of increasing color depth values, and, in the first information sample, the minimum number of samples in which the color depth value does not change continuously is n, then determining the expression method includes: the first A device expresses the device identification of the first device through the first M colors among the M+1 colors, wherein the value of the identification bit expressed by the first color among the first M colors is 0, the value of the identification bit expressed by the second color among the first M colors is 1,…, the value of the identification bit expressed by the Mth color among the first M colors is M-1, wherein the M+1th color among the M+1 colors is used to express the end of the guide header of the first device, M is a positive integer greater than 1; and the time required for the first device to express the value of an identification bit in the device identification is the product of n and the first time length, wherein n is a positive integer greater than or equal to 1.

[0021] In an embodiment of the present application, the device can express its own guide head and its own device identification through the color information of light, which enables devices with different color expression functions to express their own device identification; and, since the positions of multiple devices in the whole-house smart scene are generally different, and there is a high probability that there are partitions between multiple devices, when multiple devices express light information at the same time, there is little interference between each other, which also enables multiple devices to achieve parallel matching, which can greatly improve the matching efficiency of devices and points; in addition, the rule for the device to express the guide head can be an incremental rule, which enables the device to determine how many colors to use to express its own device identification according to its own capabilities.

[0022] In combination with the first aspect, in one possible implementation, the sampling interval duration of the second device collecting the first information sample is a first duration. When the information expressed by the first device is visible light information, the expression method is determined by identifying the guide head of the first device according to the first information sample, including: if the second device determines through the first information sample that the first device expresses M+1 color temperatures, and there is a situation where the M+1 color temperatures are expressed continuously in the order of increasing color temperature values, and, in the first information sample, the minimum number of samples in which the color temperature value does not change continuously is n, then determining the expression method includes: the first device The device expresses the device identification of the first device through the first M color temperatures among the M+1 color temperatures, wherein the value of the first color temperature expression identification bit among the first M color temperatures is 0, the value of the second color temperature expression identification bit among the first M color temperatures is 1, ..., the value of the Mth color temperature expression identification bit among the first M color temperatures is M-1, wherein the M+1th color temperature among the M+1 color temperatures is used to express the end of the guide header of the first device, and M is a positive integer greater than 1; and the time required for the first device to express the value of an identification bit in the device identification is the product of n and the first time length, wherein n is a positive integer greater than or equal to 1.

[0023] In some embodiments, n sample values corresponding to every n information samples in the first information sample determine the value of an identification bit, and the identification corresponding to the boot header of the first device is 01…(M-1)M.

[0024] In the embodiment of the present application, the device can express its own guide head and its own device identification through the color temperature information of the light, which enables devices with different color temperature expression functions to express their own device identification. Since in the whole-house smart scene, most devices have the ability to express light of different color temperatures, this makes the solution of the embodiment of the present application applicable to almost all whole-house smart devices; and since the positions of multiple devices in the whole-house smart scene are generally different, and there is a high probability that there are partitions between multiple devices, when multiple devices express light information at the same time, there is little interference between each other, which also enables multiple devices to achieve parallel matching, which can greatly improve the matching efficiency of devices and points; in addition, the rule for the device to express the guide head can be an incremental rule, which enables the device to determine how many color temperatures to use to express its own device identification according to its own capabilities.

[0025] In combination with the first aspect, in one possible implementation, the sampling interval duration of the second device collecting the first information sample is a first duration. When the information expressed by the first device is visible light information, the expression method is determined by identifying the guide head of the first device according to the first information sample, including: if the second device determines through the first information sample that the first device expresses M types of brightness, and there is no situation where the M types of brightness are expressed continuously in ascending order of brightness values, and the minimum number of samples in the first information sample in which the brightness value does not change continuously is n, then determining the expression method includes: the first device expresses the device identification of the first device through the M types of brightness, wherein the value of the first brightness expression identification bit in the M types of brightness is 0, the value of the second brightness expression identification bit in the M types of brightness is 1,..., the value of the Mth brightness expression identification bit in the M types of brightness is M-1, wherein M is a positive integer greater than 1; and the duration required for the first device to express the value of an identification bit in the device identification is the product of n and the first duration, wherein n is a positive integer greater than or equal to 1.

[0026] In some embodiments, n sample values corresponding to every n information samples in the first information sample determine the value of an identification bit, and the identification corresponding to the boot header of the first device is 101.

[0027] In the embodiment of the present application, the device can express its own guide head and its own device identification through the brightness information of light, which enables all devices with light information expression function to express their own device identification. Since most devices in the whole-house smart scene have the ability to express light information, this makes the solution of the embodiment of the present application applicable to almost all whole-house smart devices; and since the positions of multiple devices in the whole-house smart scene are generally different, and there is a high probability that there are partitions between multiple devices, when multiple devices express light information at the same time, there is less interference with each other, which also enables multiple devices to achieve parallel matching, which can greatly improve the matching efficiency of devices and points; in addition, the rules for the device to express the guide head can be fixed rules.

[0028] In combination with the first aspect, in one possible implementation, the sampling interval duration of the second device collecting the first information sample is a first duration. When the information expressed by the first device is visible light information, the expression mode is determined by identifying the guide head of the first device based on the first information sample, including: if the second device determines through the first information sample that the first device expresses M colors, and there is no situation where the M brightnesses are continuously expressed in ascending order of color depth values, and the minimum number of samples in the first information sample in which the color depth value does not change continuously is n, then determining the expression mode includes: the first device expresses the device identification of the first device through the M colors, wherein the value of the first color expression identification bit of the M colors is 0, the value of the second color expression identification bit of the M colors is 1, ..., the value of the Mth color expression identification bit of the M colors is M-1, where M is a positive integer greater than 1; and the duration required for the first device to express the value of one identification bit in the device identification is the product of n and the first duration, where n is a positive integer greater than or equal to 1.

[0029] In an embodiment of the present application, the device can express its own guide head and its own device identification through the color information of light, which enables devices with different color expression functions to express their own device identification; and, since the positions of multiple devices in the whole-house smart scene are generally different, and there is a high probability that there are partitions between multiple devices, when multiple devices express light information at the same time, there is little interference with each other, which also enables multiple devices to achieve parallel matching, which can greatly improve the matching efficiency of devices and points; in addition, the rules for the device to express the guide head can be fixed rules.

[0030] In conjunction with the first aspect, in one possible implementation, the sampling interval duration of the second device collecting the first information sample is a first duration. When the information expressed by the first device is visible light information, determining the expression mode by identifying the guide head of the first device based on the first information sample includes: if the second device determines through the first information sample that the first device expresses M color temperatures, and the M color temperatures are not expressed continuously in order of increasing color temperature values, and the minimum number of samples in the first information sample in which the color temperature value does not change continuously is n, then determining the expression mode includes: the first device expressing the device identification of the first device through the M color temperatures, wherein the value of the first color temperature expression identification bit of the M color temperatures is 0, the value of the second color temperature expression identification bit of the M color temperatures is 1, ..., the value of the Mth color temperature expression identification bit of the M color temperatures is M-1, where M is a positive integer greater than 1; and the duration required for the first device to express the value of one identification bit in the device identification is the product of n and the first duration, where n is a positive integer greater than or equal to 1.

[0031] In some embodiments, when the above color temperature is replaced by the frequency of ultraviolet rays or the frequency of infrared rays, the solution can also be implemented.

[0032] In the embodiment of the present application, the device can express its own guide head and its own device identification through the color temperature information of the light, which enables devices with different color temperature expression functions to express their own device identification. Since in the whole-house smart scene, most devices have the ability to express light of different color temperatures, this makes the solution of the embodiment of the present application applicable to almost all whole-house smart devices; and since the positions of multiple devices in the whole-house smart scene are generally different, and there is a high probability that there are partitions between multiple devices, when multiple devices express light information at the same time, there is less interference with each other, which also enables multiple devices to achieve parallel matching, which can greatly improve the matching efficiency of devices and points; in addition, the rules for device expression of guide heads can be fixed rules.

[0033] In combination with the first aspect, in a possible implementation, the sampling interval duration of the second device collecting the first information sample is a first duration. When the information expressed by the first device is sound information, the expression method is determined by identifying the guide head of the first device according to the first information sample, including: if the second device determines through the first information sample that the first device expresses M+1 sound frequencies, and there is a situation where the M+1 sound frequencies are continuously expressed in an ascending order of frequency values, and, in the first information sample, the minimum number of samples whose frequency values do not change continuously is n, then determining the expression method includes: the first device determines through the M+1 sound frequencies that the first device expresses The first M sound frequencies in the audio frequency express the device identification of the first device, wherein the value of the identification bit expressed by the first sound frequency in the first M sound frequencies is 0, the value of the identification bit expressed by the second sound frequency in the first M sound frequencies is 1,…, the value of the identification bit expressed by the Mth sound frequency in the first M sound frequencies is M-1, wherein the M+1th sound frequency in the M+1 sound frequencies is used to express the end of the guide header of the first device, and M is a positive integer greater than 1; and the time required for the first device to express the value of an identification bit in the device identification is the product of n and the first time length, wherein n is a positive integer greater than or equal to 1.

[0034] In an embodiment of the present application, the device can express its own guide head and its own device identification through sound information, which enables all devices with sound expression functions to express their own device identification, expanding the applicable scenarios of the embodiments of the present application; in addition, the rule for the device to express the guide head can be an incremental rule, which enables the device to determine how many sounds to use to express its own device identification based on its own capabilities.

[0035] In combination with the first aspect, in one possible implementation, the sampling interval duration of the second device for collecting the first information sample is a first duration. When the information expressed by the first device is sound information, the expression mode is determined by identifying the guide header of the first device based on the first information sample, including: if the second device determines through the first information sample that the first device expresses M sound frequencies, and the M sound frequencies are not expressed continuously in order of increasing frequency values, and the minimum number of samples in the first information sample whose frequency values do not change continuously is n, then determining the expression mode includes: the first device expresses the device identification of the first device through the M sound frequencies, wherein the value of the identification bit for expressing the first sound frequency of the M sound frequencies is 0, the value of the identification bit for expressing the second sound frequency of the M sound frequencies is 1, ..., the value of the identification bit for expressing the Mth sound frequency of the M sound frequencies is M-1, where M is a positive integer greater than 1; and the duration required for the first device to express the value of one identification bit in the device identification is the product of n and the first duration, wherein n is a positive integer greater than or equal to 1.

[0036] In an embodiment of the present application, the device can express its own guide head and its own device identification through sound information, which enables all devices with sound expression function to express their own device identification, expanding the applicable scenarios of the embodiment of the present application; in addition, the rules for the device to express the guide head can be fixed rules.

[0037] In combination with the first aspect, in a possible implementation method, the second device determines the device identification of the first device through an expression method based on the information expressed by the first device, including: determining the value of the identification bit corresponding to the first information sample through the expression method based on the information expressed by the first device; and determining the combination of the values of the identification bits located between the identification bits corresponding to two consecutive guide heads as the device identification of the first device.

[0038] In combination with the first aspect, in a possible implementation manner, the method further includes: the second device uploading a mapping relationship between the device identification of the first device and the first point.

[0039] In an embodiment of the present application, after the second device establishes a mapping relationship between the device identifier of the first device and the first point, the second device uploads the mapping relationship to the server. Finally, the server can obtain the mapping relationship between the device identifiers and points of all controlled devices located in the same whole-house smart scene. In this way, the user can control the corresponding device through the central control screen and other channels based on these mapping relationships.

[0040] In combination with the first aspect, in a possible implementation, before the second device uploads the mapping relationship between the device identifier of the first device and the first point, the method also includes: the second device verifies the mapping relationship between the device identifier of the first device and the first point.

[0041] In an embodiment of the present application, before sending the mapping relationship between the device and the point to the server, the mapping relationship can be verified, which can further improve the accuracy of the matching between the device and the point.

[0042] In combination with the first aspect, in a possible implementation, N devices include the first device, N is a positive integer greater than 1, and the method also includes: when a third device among the N devices expresses a guide head and a device identifier through an information expression function, the second device determines the device identifier of the third device according to the information expressed by the third device and the expression method used by the third device when expressing the device identifier, and the third device is installed at a third point; the second device establishes a mapping relationship between the device identifier of the third device and the third point.

[0043] In the embodiment of the present application, point matching can be performed on multiple controlled devices in sequence through the same device. In addition, point matching can be performed on multiple controlled devices in parallel by multiple devices. The matching process is simple and easy to operate, and the matching accuracy is high.

[0044] In the second aspect, a method for matching devices and points is provided, characterized in that the method is applied to a first device, the first device has an information expression function, and the first device is installed at a first point. The method includes: in response to a first trigger operation, the first device expresses information to express the guide head of the first device and the device identification of the first device, the guide head of the first device is used to indicate the expression method used by the first device when expressing the device identification of the first device, so that the device that obtains the information expressed by the first device determines the device identification of the first device through the expression method, and the device identification of the first device is used to establish a mapping relationship between the device identification of the first device and the first point.

[0045] In some embodiments, the information expressed by the first device includes any one or more of light information and sound information, the light information includes at least one of visible light information and invisible light information, and the sound information includes at least one of amplitude information and frequency information.

[0046] In some embodiments, the first device is a whole-house smart device, for example, the first device may be a lighting device.

[0047] In an embodiment of the present application, before the equipment is point-matched, the equipment can be installed directly at the predetermined point. The equipment manufacturer does not need to mark the equipment identification on the equipment, and the workers do not need to enter the equipment identification of each point by scanning the code or manually entering it, which greatly saves production costs and labor costs and improves efficiency. During installation, the installer does not need to search for corresponding equipment from multiple devices based on the matching relationship, which saves time costs. The installation can be installed in parallel, which improves installation efficiency. After all the installations are completed, the equipment identification of each of the multiple devices can be obtained through the information expressed by each of the multiple devices, and then a mapping relationship between the equipment and the point is established. This method has strong reliability and high matching efficiency.

[0048] Moreover, before expressing its own device identification, the device first expresses its own guide header information, which is used to express the expression method used when expressing the device identification. This allows all devices installed in the same whole-house smart scene to use an expression method that suits their actual situation based on their own attributes and the environment in which they are located. This not only makes the use scenarios of the method of the embodiment of the present application wider, but also makes the accuracy of the device identification expressed by the device higher.

[0049] In combination with the second aspect, in one possible implementation method, the expression method includes: information for indicating the conversion relationship of the value of the identification bit of the device identifier used by the first device to express the information expressed by the first device, and / or information for indicating the time required for the first device to express the value of an identification bit in the device identifier.

[0050] Optionally, the type of the identification bit is any one of numbers, letters, and symbols.

[0051] It can be understood that the required duration mentioned above refers to: the i-th device continuously expresses the value of an identification bit in its own device identification within a specific duration, and the specific duration is equal to the required duration mentioned above. The device can adopt different specific durations according to its own environment and its own properties. For example, when the environment in which the device is located is more disturbed, the specific duration that the device can adopt is longer. The longer the specific duration, the more sampling times within a specific duration, and the more accurate the value of the identification bit obtained. In other words, different devices can adopt different specific durations according to their own circumstances, which can improve the fault tolerance of the device identification recognition process, and thus improve the accuracy of device identification recognition.

[0052] In an embodiment of the present application, before expressing its own device identification, the device first expresses its own guidance header information, which is used to express the expression method used when expressing the device identification. This allows all devices installed in the same whole-house smart scene to use an expression method that suits their actual situation based on their own attributes and the environment in which they are located. This not only makes the use scenarios of the method of the embodiment of the present application wider, but also makes the accuracy of the device identification expressed by the device higher.

[0053] In combination with the second aspect, in a possible implementation method, when the information expressed by the first device is visible light information, the expression method includes any one of the following: expressing the device identification of the first device by flashing M kinds of brightness, wherein the value of the first brightness expression identification bit in the M kinds of brightness is 0, the value of the second brightness expression identification bit in the M kinds of brightness is 1, ..., the value of the Mth brightness expression identification bit in the M kinds of brightness is M-1, wherein the value of M is a positive integer greater than 1; expressing the device identification of the first device by flashing M kinds of colors, wherein the M kinds The value of the first color expression identification bit in the color is 0, the value of the second color expression identification bit in the M colors is 1,…, the value of the Mth color expression identification bit in the M colors is M-1, wherein the value of M is a positive integer greater than 1; or the device identification of the first device is expressed by flashing M color temperatures, wherein the value of the first color temperature expression identification bit in the M color temperatures is 0, the value of the second color temperature expression identification bit in the M color temperatures is 1,…, the value of the Mth color temperature expression identification bit in the M color temperatures is M-1, wherein the value of M is a positive integer greater than 1.

[0054] In the embodiment of the present application, the device can express its own guide head and its own device identification through optical information, which enables all devices with optical information expression function to express their own device identification. Since most devices in the whole-house smart scene have the ability to express optical information, this makes the solution of the embodiment of the present application applicable to almost all whole-house smart devices; and since the positions of multiple devices in the whole-house smart scene are generally different, and there is a high probability that there are partitions between multiple devices, when multiple devices express optical information at the same time, there is less interference with each other, which also enables multiple devices to achieve parallel matching, which can greatly improve the matching efficiency of devices and points.

[0055] In combination with the second aspect, in a possible implementation method, when the information expressed by the first device is sound information, the expression method includes any one of the following: expressing the device identification of the first device by emitting M kinds of sounds, and the M kinds of sounds correspond one-to-one to M kinds of frequencies, wherein the value of the first frequency expression identification bit among the M kinds of frequencies is 0, the value of the second frequency expression identification bit among the M kinds of frequencies is 1,…, and the value of the Mth frequency expression identification bit among the M kinds of frequencies is M-1, wherein the value of M is a positive integer greater than 1; or expressing the device identification of the first device by emitting M kinds of sounds, and the M kinds of sounds correspond one-to-one to M kinds of amplitudes, wherein the value of the first amplitude expression identification bit among the M kinds of amplitudes is 0, the value of the second amplitude expression identification bit among the M kinds of amplitudes is 1,…, and the value of the Mth amplitude expression identification bit among the M kinds of amplitudes is M-1.

[0056] In an embodiment of the present application, the device can express its own guide head and its own device identification through sound information, which enables all devices with sound expression function to express their own device identification, expanding the applicable scenarios of the embodiment of the present application.

[0057] In combination with the second aspect, in a possible implementation, in response to the first trigger operation, the first device expresses information, including: in response to the first trigger operation, the first device enters a point matching mode; the first device expresses information in the point matching mode.

[0058] In the embodiment of the present application, the device will express information only when it is in the point matching mode, which can avoid the device entering the point matching process when there is no point matching requirement.

[0059] In a third aspect, an electronic device is provided, comprising a memory and a processor, wherein the memory is used to store computer program code, and the processor is used to execute the computer program code stored in the memory to implement the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0060] In a fourth aspect, an electronic device is provided, comprising a memory and a processor, wherein the memory is used to store computer program code, and the processor is used to execute the computer program code stored in the memory to implement the method in the above-mentioned second aspect or any possible implementation of the second aspect.

[0061] In a fifth aspect, a system is provided, comprising: the electronic device as described in the third aspect; and the electronic device as described in the fourth aspect.

[0062] In the sixth aspect, a computer-readable storage medium is provided, which stores a computer program or instruction. When the computer program or instruction is executed, it implements the method in the above-mentioned first aspect or any possible implementation of the first aspect, or implements the method in the above-mentioned second aspect or any possible implementation of the second aspect.

[0063] In the seventh aspect, a chip is provided, in which instructions are stored. When the chip is run on a device, the chip executes the method in the above-mentioned first aspect or any possible implementation of the first aspect, or executes the method in the above-mentioned second aspect or any possible implementation of the second aspect.

[0064] In an eighth aspect, a computer program product is provided, in which a computer program or instruction is stored. When the computer program or instruction is executed, the method in the above-mentioned first aspect or any possible implementation of the first aspect is implemented, or the method in the above-mentioned second aspect or any possible implementation of the second aspect is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0066] Figure 2 This is a software structure block diagram of an electronic device provided in an embodiment of the present application;

[0067] Figure 3 This is a schematic diagram of a scenario provided by an embodiment of the present application;

[0068] Figure 4 This is another scenario diagram provided by an embodiment of the present application;

[0069] Figure 5 is a schematic flow chart of a method for matching devices and points;

[0070] Figure 6 is a schematic flow chart of several other methods for matching devices and points;

[0071] Figure 7 is a schematic flow chart of a method for matching devices and points provided in an embodiment of the present application;

[0072] Figure 8 This is a schematic flow chart of another method for matching devices and points provided in an embodiment of the present application.

[0073] Figure 9 This is a schematic diagram of a device provided by an embodiment of the present application using different expression durations to express numbers through flashing lights;

[0074] Figure 10is a schematic diagram of a guide head provided in an embodiment of the present application;

[0075] Figure 11 is a schematic diagram of another guide head provided in an embodiment of the present application;

[0076] Figure 12 This is a schematic flow chart of another method for matching devices and points provided in an embodiment of the present application;

[0077] Figure 13 This is a schematic diagram of a first device among N devices provided by an embodiment of the present application expressing its own guide head and device identification by flashing lights;

[0078] Figure 14 This is a schematic diagram of a second device among N devices provided by an embodiment of the present application expressing its own guide head and device identification by flashing lights;

[0079] Figure 15 This is a schematic flow chart of a system for matching devices and points provided in an embodiment of the present application. DETAILED DESCRIPTION

[0080] The technical solutions of this application will be described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of this application, rather than all the embodiments.

[0081] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" or "multiple" refers to two or more than two.

[0082] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0083] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification of this application and the appended claims, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.

[0084] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "one embodiment," "some embodiments," "another embodiment," and "other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically stated. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically stated.

[0085] The method provided in the embodiments of the present application can be applied to electronic devices with a time display function or a time recognition function, for example, mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), smart home devices and other electronic devices. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0086] For example, Figure 1: The figure shows a schematic structural diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0087] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0088] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0089] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0090] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0091] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0092] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.

[0093] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0094] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0095] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0096] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0097] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0098] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0099] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0100] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0101] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0102] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0103] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0104] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0105] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0106] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is greater than 1.

[0107] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0108] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0109] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0110] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0111] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an App required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0112] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0113] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0114] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0115] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0116] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0117] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0118] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0119] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0120] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0121] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting it into or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an embedded SIM (eSIM) card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0122] It should be understood that the phone card in the embodiments of the present application includes but is not limited to a SIM card, an eSIM card, a universal subscriber identity module (USIM), a universal integrated circuit card (UICC), and the like.

[0123] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0124] Figure 2This is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0125] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0126] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0127] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0128] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0129] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0130] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0131] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0132] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0133] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0134] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0135] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0136] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0137] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (such as OpenGL ES), and a 2D graphics engine (such as SGL).

[0138] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0139] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0140] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0141] A 2D graphics engine is a drawing engine for 2D drawings.

[0142] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0143] It should be understood that the technical solutions in the embodiments of the present application can be used in Android, IOS, Hongmeng and other systems.

[0144] The technical solutions of the embodiments of the present application can be applied to scenarios with multiple device matching points. For example, they can be applied to whole-house smart scenarios, where the whole-house smart scenarios can be, for example, smart scenarios in a family room, smart scenarios in an office, smart scenarios in a workshop, smart scenarios in a business premises, etc. The technical solutions of the embodiments of the present application can also be applied to any other scenarios with multiple device matching points.

[0145] Among them, the electronic device can be a portable electronic device such as a laptop computer, a mobile phone, a folding screen, a tablet computer, a camera, a video camera, a video recorder, or any other electronic device with a camera function, or an electronic device in a 5G network or an electronic device in a future evolved public land mobile communication network (PLMN), etc.

[0146] Taking the whole-house smart scene as an example, many smart devices need to be installed in the whole-house smart scene, such as electric curtains, air conditioners, televisions, lights, switch panels, etc. When installing multiple devices throughout the house, each device needs to be installed according to the installation point in the floor plan. In the control trigger source design, controlled device design, fault replacement and other scenarios, they are all carried out through the installation location. Only by knowing the correspondence between the device identification (such as MAC address) and the installation point can the whole-house system know the actual device to be operated. Therefore, after the installation of multiple devices is completed, the device identification of each device needs to be bound to the installation point one by one.

[0147] For example, Table 1 shows a schematic table showing the one-to-one correspondence between a device identifier (taking a MAC address as an example) and an installation point.

[0148] Table 1

[0149] Installation point Room name MAC address 001 Entrance Entryway switch panel 3066D094D2EA 002 Entrance Porch downlight 2848E7EEF7A0 003 living room Living room downlight 1 2848E7EEF4F6 004 living room Living room downlight 2 2848E7EE2600 005 living room Living room downlight 3 2848E7EE3861 006 living room Living room main light 2848E7EEFAE5 007 living room Living room track lights 2848E7EE5B62 008 living room Living room switch panel 3066D0942B60

[0150] For example, Figure 3 A schematic diagram of a scenario provided by an embodiment of the present application is shown.

[0151] Depend on Figure 3It can be seen that the same smart home scene is equipped with a switch panel 301, a living room light 302, a dining room light 303, a switch panel 304, a bedroom light 305, a bedroom light 306, and a bedroom light 307. The identification of each of these devices is mapped to its installation point, and these devices can be uniformly controlled through a control center. The control center can be, for example, a central control screen on a central control panel, or a mobile device such as a mobile phone or tablet. The control center is connected to the servers corresponding to the multiple devices (for example: a hub or a gateway or a cloud, etc.).

[0152] For example, Figure 4 Another scenario schematic diagram provided by an embodiment of the present application is shown.

[0153] like Figure 4 As shown, the controlled device 002 is installed in the entrance area, the controlled devices 003, 004, 005, 006, and 007 are installed in the living room area, the trigger source (for example, a switch panel) 001 is installed in the entrance area, and the trigger source 008 is installed in the living room area. The control relationship between the trigger source and the controlled device can be shown in Table 2.

[0154] Table 2

[0155] Trigger source controlled devices 001 002、004、006 008 003、004、005、006、007

[0156] It can be seen that the control of the controlled device by the trigger source depends on the correspondence between the device identification of the controlled device and the installation point, so it is necessary to establish a mapping relationship between the installed controlled device and the installation point.

[0157] For example, Figure 5 FIG. 5 is a schematic flow chart of a method 500 for matching devices and points. Figure 5 As shown, the method 500 includes:

[0158] S501: Obtaining a media access control address (MAC) of the first device by scanning a barcode of the first device.

[0159] S502: Input the MAC address of the first device into the first list as the device MAC address corresponding to the first point. The first list is a correspondence list between the device MAC addresses and the points.

[0160] Among them, the installer can use a notebook connected to a barcode scanner to scan the barcode on the first device or the packaging box of the first device with the barcode scanner to enter the MAC address of the first device into the corresponding position in the first list, or the installer can directly manually enter the MAC address of the first device into the corresponding position in the first list.

[0161] S503: Transmit the correspondence between the MAC address of the first device and the first point to the hub or gateway.

[0162] The hub or gateway is the control center of multiple controlled devices, and the first device belongs to the multiple controlled devices.

[0163] S504: Paste a first point label on the first device, or write the first point directly on the first device to mark the point corresponding to the first device as the first point.

[0164] S505: Install the first device at the first location according to the first location information on the first device.

[0165] Among them, generally, by repeating steps S501-S504, the MAC addresses of all controlled devices are matched with the installation points, and the points are marked on all controlled devices, and then the installation work is carried out uniformly. During installation, when installing a device at a certain point, it is necessary to find the controlled device corresponding to the point among all the uninstalled controlled devices and install it.

[0166] In this method, for the corresponding manufacturer, the device identification of each device needs to be marked on the device, which is costly and inefficient. In addition, the installer needs to obtain the device identification of the device through the mark on the device in turn, and establish a corresponding relationship between it and the point, and then install the device according to the correspondence, which also has the problems of high cost and low efficiency. In addition, the marked device identification may be contaminated or damaged, which may cause the installer to be unable to scan the device identification. There may also be situations such as missing scanning of the device identification and error in point marking, resulting in a high error rate.

[0167] For example, Figure 6 Schematic flow charts of several other methods 600 for matching devices and points are shown. Figure 6 As shown, the method 600 includes:

[0168] Figure 6 (a) in FIG. 1 shows a schematic flow chart of a method for matching switch panel devices and points. Figure 6 As shown in (a), the method includes:

[0169] S601: When the installer presses the first switch panel device, the gateway and the hub detect the first switch panel device.

[0170] S602: Display the first switch panel device on a graphical interface of a central control device, and the installer inputs a point corresponding to the first switch panel device on the graphical interface.

[0171] This method cannot achieve parallel installation by multiple people, resulting in low installation efficiency. In addition, if someone controls the light or presses the panel during the process, it is easy to be interfered with, resulting in failure to match the device and the point.

[0172] Figure 6 (b) in FIG. 1 shows a schematic flow chart of a method for matching lighting devices and points. Figure 6 As shown in (b), the method includes:

[0173] S603: The installer determines the position of the first lighting device by controlling the operation of the first lighting device on the graphical interface of the central control device.

[0174] Specifically, after controlling the first lighting device on the graphical interface of the central control device, the installer further determines the actual first lighting device from all controlled devices, and then determines the location of the first lighting device.

[0175] S604: The installer inputs the location corresponding to the first lighting device on the graphical interface.

[0176] In this method, during the process of matching devices and points, it is necessary to search for controlled lights one by one. In the worst case, in order to find the point of a certain lighting device, it is necessary to run through all the rooms.

[0177] Figure 6 (c) in FIG. 1 shows a schematic flow chart of another method for matching lighting devices and points. Figure 6 As shown in (c), the method includes:

[0178] S605: The installer randomly selects a point from multiple points and records it as the first point.

[0179] S606: The installer controls each lighting device one by one on the graphical interface of the central control device until the lighting device corresponding to the first point is found, and then inputs the first point.

[0180] Specifically, when the installer controls each lighting device one by one on the graphical interface of the central control device, when controlling a certain lighting device, when the lighting device at the first point responds to the control, the lighting device is determined to be the lighting device corresponding to the first point, and then a corresponding relationship is established between the first point and the lighting device.

[0181] In this method, during the device and point matching process, it is necessary to try the lights that have not been bound to the point one by one. In the worst case, in order to find the lighting device corresponding to a certain point, all lights that have not been bound to the point must be tried.

[0182] In summary, the current method of matching equipment and points has the problems of high cost, low efficiency and high error rate.

[0183] In view of this, the embodiments of the present application provide a method, electronic device and system for matching devices and points. In this method, after multiple devices are installed at one time, the device can enter a point matching mode. In this mode, the device will express its own device identification by flashing lights, so that the installer can obtain the device identification of the device by collecting the light flashing information of the device, and then establish a mapping relationship between the device identification and the point, and pass the mapping relationship between the device identification and the point to the server (for example, a hub, gateway or cloud). This method supports the parallel installation of devices, and there is no need to mark the device identification of the device on the device when it leaves the factory, and there is no need to manually match the device and the point one by one. It can improve installation efficiency, production and installation costs, and can also improve the accuracy of installation.

[0184] For example, Figure 7 FIG. 7 is a schematic flow chart of a method 700 for matching devices and points provided in an embodiment of the present application. Figure 7 As shown, the method 700 includes:

[0185] S701: Install N devices, each of which has an information expression function and corresponds to N points.

[0186] In some embodiments, the N devices may be whole-house smart devices, and may include devices with sound expression capabilities and / or devices with light expression capabilities, wherein the devices with sound expression capabilities may be, for example, speakers, lighting devices with sound expression capabilities, etc., and the devices with light expression capabilities may be, for example, devices with flashing light functions, such as LED lights, etc., and may also be devices with lighting elements, such as switch panels with LED lights, electric curtains with LED lights, etc.

[0187] Among them, the installation scenario of the N devices can be a whole-house smart scenario, and the specific scenario can be, for example, a home scene, a shopping mall, an office building, a production workshop, a station building, etc. In addition, the embodiment of the present application is applicable to any scenario where devices and points are matched.

[0188] S702: In response to the first trigger operation, the N devices express information to express their own boot headers and their own device identifications.

[0189] The device's lead header is used to indicate the expression method used by the device to express its own device identification.

[0190] In some embodiments, after the N devices are powered on, in response to a first trigger operation, the N devices enter a point matching mode, and the N devices express information in the point matching mode.

[0191] In some embodiments, the information expressed by the above-mentioned device may include any one or more of light information and sound information, wherein the light information may include at least one of visible light information and invisible light information, and the sound information may include at least one of amplitude information and frequency information.

[0192] In some examples, the visible light information may include one or more of the brightness of light, the color of light, and the color temperature of light. In addition, the visible light information may also include other characteristic information of visible light, which is not limited in this application.

[0193] In some examples, invisible light may include ultraviolet rays, infrared rays, etc., and the invisible light information may include, for example, frequency information of the invisible light. In addition, the invisible light information may also include other characteristic information of the invisible light, which is not limited in this application.

[0194] In some embodiments, the first trigger operation may be, for example, an operation in which the device receives a first command broadcast by a server of N devices (for example, a hub, a gateway, or the cloud), wherein the first command is used to command the device to express information; the first trigger operation may also be, for example, an operation in which the device detects that it has no matching points after being powered on; in addition, the first trigger operation may also be other operations, for example, a manual trigger operation, etc., which is not limited in this application.

[0195] It should be understood that the order in which N devices express information is not limited here. N devices can express information simultaneously or at different times. For example, N devices can express information sequentially, or they can express information according to their own categories and other characteristics.

[0196] In some examples, for multiple devices that easily interfere with each other when expressing information (for example, when the information expressed is sound information), the user can perform a first trigger operation on one device or part of the N devices, perform point matching, and then perform a first trigger operation on another device or another part of the devices to perform point matching to reduce the impact of mutual interference of the expressed information on the matching results.

[0197] In some other examples, for multiple devices that express information and are not likely to interfere with each other (for example, when the information expressed is light information), the user can perform a first trigger operation on all N devices, so that the N devices express information at the same time, and then the user can match the N devices and corresponding points sequentially or in parallel, thereby achieving parallel matching of devices and improving the matching efficiency of devices and points.

[0198] S703: The second device obtains an expression of the i-th device, where N devices include the i-th device, the i-th device is installed at the i-th location, and the initial value of i is 1.

[0199] The expression mode of the i-th device is the expression mode used by the i-th device to express its own device identification.

[0200] In some embodiments, the expression of the i-th device includes:

[0201] Information used to indicate the conversion relationship between the values of the identification bits of the device identification used by the i-th device to express its own device identification using the expressed information, and / or

[0202] Information indicating the duration required for the i-th device to express the value of an identification bit in its own device identification.

[0203] Among them, the duration required for the i-th device to express the value of an identification bit in its own device identification means: the i-th device continuously expresses the value of an identification bit in its own device identification within a specific duration, and the specific duration is equal to the above-mentioned required duration.

[0204] The type of the identification bit in the device identification can be any one of numbers, letters, and symbols.

[0205] In one embodiment, the second device obtains the expression mode of the i-th device, which may specifically be: the second device receives the expression mode of the i-th device sent by the intermediate device.

[0206] In another embodiment, the second device obtains the expression method of the i-th device, which can be specifically: when the i-th device expresses its own guide header and device identification through information, the second device collects an information sample of the i-th device during the process of information expression by the i-th device; then the second device identifies the guide header of the i-th device based on the information sample, and then determines the expression method used by the i-th device to express its own device identification through the information of the guide header.

[0207] In a specific example, the sampling interval duration of the information sample collected by the second device for information expression by the i-th device is the first duration. When the information expressed by the i-th device is visible light information, the second device obtains the expression mode of the i-th device, which may be:

[0208] If the second device determines that the i-th device expresses M+1 types of brightness through the information samples of the i-th device, and there is a situation where the M+1 types of brightness are expressed continuously in the order of increasing brightness values, and, among the information samples of the i-th device collected by the second device for information expression, the minimum number of samples in which the brightness value does not change continuously is N, then the expression method used by the i-th device to express its own device identification is determined as follows: the i-th device expresses its own device identification by flashing M types of brightness, wherein the value of the first brightness expression identification bit in the M+1 types of brightness is 0, the value of the second brightness expression identification bit in the M+1 types of brightness is 1,…, the value of the M-1 brightness expression identification bit in the M+1 types of brightness is M-1, wherein M is a positive integer greater than 1; the time required for the i-th device to express the value of one identification bit in the device identification is the product of N and the above-mentioned first time length, wherein N is a positive integer greater than or equal to 1.

[0209] If the second device determines that the i-th device expresses M kinds of brightness through the information samples of the i-th device for information expression, and there is no situation where the M kinds of brightness are expressed continuously in ascending order of brightness values, and, among the information samples of the i-th device for information expression collected by the second device, the minimum number of samples in which the brightness value does not change continuously is N, then the expression method used by the i-th device to express its own device identification is determined as follows: the i-th device expresses its own device identification by flashing M kinds of brightness, wherein the value of the first brightness expression identification bit in the M kinds of brightness is 0, the value of the second brightness expression identification bit in the M kinds of brightness is 1,…, the value of the Mth brightness expression identification bit in the M kinds of brightness is M-1, wherein M is a positive integer greater than 1; the time required for the i-th device to express the value of one identification bit in the device identification is the product of N and the above-mentioned first time length, wherein N is a positive integer greater than or equal to 1.

[0210] It should be understood that when the brightness in the above examples is replaced by color, color temperature or invisible light information (such as the frequency of ultraviolet rays, the frequency of infrared rays, etc.), the solution can also be implemented.

[0211] In another specific example, the sampling interval duration of the information sample collected by the second device for information expression by the i-th device is the first duration. When the information expressed by the i-th device is sound information, the second device obtains the expression method of the i-th device. Specifically, it can be: if the second device determines that the i-th device expresses M+1 sound frequencies through the information sample for information expression by the i-th device, and there is a situation where the M+1 sound frequencies are expressed continuously in the order of increasing frequency values, and, among the information samples collected by the second device for information expression by the i-th device, the minimum number of samples whose frequency values do not change continuously is N, then it is determined that The expression method used by the i-th device to express its own device identification is: the i-th device expresses its own device identification by emitting M sound frequencies, wherein the value of the identification bit expressed by the first sound frequency in the M+1 sound frequencies is 0, the value of the identification bit expressed by the second sound frequency in the M+1 sound frequencies is 1,…, the value of the identification bit expressed by the M-1 sound frequency in the M+1 sound frequencies is M-1, wherein M is a positive integer greater than 1; the time required for the i-th device to express the value of one identification bit in the device identification is the product of N and the above-mentioned first time length, wherein N is a positive integer greater than or equal to 1.

[0212] If the second device determines through the information samples of the i-th device that the i-th device expresses information that M sound frequencies are expressed, and there is no situation where the M sound frequencies are expressed continuously in ascending order of frequency values, and, among the information samples of the i-th device collected by the second device for information expression, the minimum number of samples in which the frequency values do not change continuously is N, then the expression method used by the i-th device to express its own device identification is determined as follows: the i-th device expresses its own device identification by emitting M sound frequencies, wherein the value of the identification bit of the first sound frequency expression in the M sound frequencies is 0, the value of the identification bit of the second sound frequency expression in the M sound frequencies is 1,…, the value of the identification bit of the M-th sound frequency expression in the M sound frequencies is M-1, wherein M is a positive integer greater than 1; the time required for the i-th device to express the value of one identification bit in the device identification is the product of N and the above-mentioned first time length, wherein N is a positive integer greater than or equal to 1.

[0213] It should be understood that when the sound frequency in the above example is replaced by sound amplitude, the solution can also be implemented.

[0214] It can be understood that: taking the information expressed by the device as visible light information as an example, since the light flashing performance of different devices is likely to be different, for example, the power of the light may be different, and the time to jump from one brightness, color or color temperature to another brightness, color or color temperature may also be different, so before the device expresses its own device identification through light flashing, it can first express its own guide head through light flashing. When the device expresses its own guide head and its own device identification through the brightness of the flashing light, the guide head is used to express the conversion relationship between the light brightness expressed by the device next when expressing its own device identification and the value of the device identification bit, as well as the time required to use the light brightness to express the value of a device identification bit, so that the second device can successfully read the device identification through the flashing brightness information.

[0215] The process of the i-th device expressing its own guide header and device identification through information expression can be cyclical, that is, the i-th device first expresses its own guide header through information expression, thereby informing the second device of the expression method to be used when expressing the device identification of the i-th device. Then, the i-th device expresses its own device identification through information expression. After expressing its own device identification, it expresses its own guide header again through information expression. In this way, the second device can obtain the device identification of the i-th device through the information expressed by the i-th device. It can be understood that the form of information expression can be set as needed, and can be set to cyclic, one-time expression, or intermittent expression, etc.

[0216] It can be understood that the second device described in the embodiment of the present application for determining the device identification of the i-th device through the information expressed by the i-th device and the expression method of the i-th device does not specifically refer to one device. The second device can be multiple devices. That is to say, when N devices express information at the same time, the device identifications of the N devices can be determined in parallel by the multiple devices to improve the efficiency of matching devices and points.

[0217] The specific process of reading the boot header information and device identification of the device through the information expressed by the device will be described in detail in subsequent embodiments.

[0218] S704: The second device determines the device identifier of the i-th device according to the information expressed by the i-th device and the expression method of the i-th device.

[0219] In some embodiments, a second device is used to scan the i-th device installed at the i-th point to obtain the device identification of the i-th device. Specifically, the information sample expressed by the i-th device can be collected through the camera or sensor of the second device. The information sample can be, for example, a video collected during the information expression process of the i-th device, or a continuous frame image collected during the information expression process of the i-th device. Then, combined with the expression method of the i-th device, the information sample is read to obtain the device identification of the i-th device.

[0220] In some embodiments, the sampling frequency at which the second device collects information expressed by the i-th device is 30 frames per second.

[0221] In some embodiments, the second device first identifies and reads the boot header information in the information expressed by the i-th device, and determines the expression method used by the i-th device to express its own device identification through the boot header information, that is, the conversion relationship information between the information expressed by the i-th device and the value of the device identification bit of the i-th device, and the time required for the i-th device to express the value of a device identification bit. Then, the second device reads the device identification in the information expressed by the i-th device. When the second device reads the second boot header of the i-th device, the reading operation ends, and the device identification of the i-th device is obtained, that is, the combination of the values of the identification bits corresponding to the information between two consecutive boot headers is determined as the device identification of the i-th device.

[0222] That is, the device identifier is located between the end of the first boot header and the beginning of the second boot header.

[0223] In one example, the second device finds that the i-th device expresses the device identification of the i-th device by flashing three brightness levels, and there is a situation where the three brightness levels are expressed in ascending order of brightness values. Then the value of the first brightness expression identification bit of the three brightness levels is 0, the value of the second brightness expression identification bit of the three brightness levels is 1, and the value of the third brightness expression identification bit of the three brightness levels is 2. The third brightness of the three brightness levels only appears in the boot header and is used to indicate the end of the boot header, and is not used to express the value of the device identification. If the read identification is...123110101123..., then the device identification of the i-th device is determined to be 110101. The device identification is in binary representation and can be further converted into decimal, or converted into corresponding letters, symbols, etc., to obtain the final device identification.

[0224] It should be understood that the device identification of the i-th device obtained by the second device based on the information expressed by the i-th device can be a combination of numbers, such as a combination of binary numbers, a combination of ternary numbers, a combination of decimal numbers, etc. Before outputting the device identification of the i-th device, the second device can convert the obtained combination of numbers, for example, convert some of the numbers into corresponding letters or corresponding symbols, and finally output the converted device identification.

[0225] S705: Establish a mapping relationship between the i-th point and the device identifier of the i-th device.

[0226] In some embodiments, a mapping relationship between the i-th point and the device identification of the i-th device is established through a second device, and the mapping relationship between the i-th point and the device identification of the i-th device is uploaded to a server, which can be, for example, a hub, a gateway, or a cloud.

[0227] In some embodiments, before the second device uploads the mapping relationship between the device identifier of the i-th device and the i-th point, the mapping relationship between the device identifier of the i-th device and the i-th point can be verified. The specific verification method can be, for example, attempting to control the i-th device located at the i-th point by inputting the obtained device identifier. If the response is correct, the verification is successful.

[0228] S706: Determine whether i is greater than or equal to N. If so, end the device and point matching process. If not, set i=i+1 and return to step S703 to perform point matching on the i+1th device among the N devices.

[0229] The (i+1)th device refers to any device among the Ni devices whose points have not been matched among the N devices.

[0230] In some embodiments, when i is greater than or equal to N, it indicates that all N devices have completed point matching. At this time, a first table including the matching relationship between each of the N devices and the point can be uploaded to the server.

[0231] It should be understood that the above S706 is an optional step. When multiple second devices match devices and points in parallel, the above S706 may not be performed.

[0232] In an embodiment of the present application, before point matching of multiple devices is performed, the multiple devices can be directly installed at predetermined points. The equipment manufacturer does not need to mark the device identification on the equipment, and the workers do not need to enter the device identification of each point by scanning the code or manually entering the information, which greatly saves production costs and labor costs and improves efficiency. During installation, the installer does not need to find the corresponding device from multiple devices based on the matching relationship, which saves time cost. The installation can be installed in parallel, which improves installation efficiency. After all the installations are completed, the device identification of each device in the multiple devices can be obtained through the information expressed by each device in the multiple devices, and then a mapping relationship between the device and the point can be established, and multiple devices can be matched in parallel. This method has strong reliability and high matching efficiency.

[0233] Moreover, before expressing its own device identification, the device first expresses its own guide header information, which is used to express the expression method used when expressing the device identification. This allows all devices installed in the same whole-house smart scene to use an expression method that suits their actual situation based on their own attributes and the environment in which they are located. This not only makes the use scenarios of the method of the embodiment of the present application wider, but also makes the accuracy of the device identification expressed by the device higher.

[0234] For example, taking the information expressed by the device as visible light information, Figure 8 FIG. 8 is a schematic flow chart of another method 800 for matching devices and points provided in an embodiment of the present application. Figure 8 As shown, the method 800 includes:

[0235] S801: Install N devices, each of which has a light flashing function, and the N devices correspond to N points.

[0236] In some embodiments, the N devices may include lighting devices, such as LED lights, etc. The N devices may also include devices with lighting elements, such as switch panels with LED lights, electric curtains with LED lights, etc.

[0237] S802: After the N devices are powered on, in response to a first trigger operation, the N devices enter a point matching mode.

[0238] The explanation of the first trigger operation is in Figure 7 The illustrated embodiment has been described in detail and will not be repeated here for the sake of brevity.

[0239] S803: After the N devices enter the point matching mode, they respectively indicate their own guidance heads and their own device identifications by flashing lights.

[0240] Among them, the guide header of the i-th device among the N devices is used to express the expression method used by the i-th device to express its own device identification, and the expression method is used to indicate the conversion relationship of the value of the identification bit of the device identification expressed by the i-th device using light flashing information, and / or, information used to indicate the duration required for the i-th device to express the value of an identification bit in the device identification. In some embodiments, the above-mentioned information for indicating the conversion relationship of the value of the identification bit of the device identification expressed by the i-th device using light flashing information can also be understood as indicating the base number of the value of the identification bit of the device identification expressed by the i-th device using light flashing information, and which number corresponds to each type of light information in the light flashing information.

[0241] In one embodiment, the device indicates its own guiding head and its own device identification by the brightness of the flashing light.

[0242] In yet another embodiment, the device indicates its own guiding head and its own device identification by flashing colors of lights.

[0243] In yet another embodiment, the device indicates its own guiding head and its own device identification through the color temperature of the flashing light.

[0244] It can be understood that: since the light flashing performance of different devices is likely to be different, for example, the power of the light may be different, and the time to jump from one brightness, color or color temperature to another brightness, color or color temperature may also be different, so before the device expresses its own device identification through light flashing, it can first express its own guide head through light flashing. When the device expresses its own guide head and its own device identification through the brightness of the flashing light, the guide head is used to indicate how many light brightnesses the device will use when expressing its own device identification next, what numbers each of these light brightnesses corresponds to, and the expression duration of each light brightness used, so as to know the expression method of the device when expressing its own device identification, that is, which base to use to express the value of the device identification bit, which brightness corresponds to which number, and the expression duration of the value of a device identification bit in the device identification.

[0245] Among them, in a possible implementation method, the process of the i-th device expressing its own guide head and device identification by flashing lights can be performed in a cycle, that is, the i-th device first expresses its own guide head by flashing lights, thereby informing the second device which base digit will be used to express the value of the identification bit in the device identification of the i-th device, and informing the second device of the time required to express the value of an identification bit in the device identification of the i-th device. Then, the i-th device expresses its own device identification by flashing lights. After expressing its own device identification, it again expresses its own guide head by flashing lights. In this way, the sampling device can accurately obtain the device identification of the device through the flashing light information of the device.

[0246] The specific process of reading the device's guidance header information and device identification through light flashing information will be described in detail in subsequent embodiments.

[0247] S804: Use the second device to scan the i-th device installed at the i-th point, and collect information samples of the i-th device during the process of flashing the light of the i-th device to obtain the device identification of the i-th device, wherein N points include the i-th point, N devices include the i-th device, and the initial value of i is 1.

[0248] Before scanning the i-th device, the i-th point can be selected in the matching interface of the second device. Specifically, a point can be randomly selected from N points corresponding to N devices and recorded as the i-th point.

[0249] In some embodiments, a second device is used to scan the i-th device installed at the i-th point to obtain the device identification of the i-th device. The information sample of the i-th device can be collected by the camera of the second device during the process of the i-th device flashing its light. The information sample of the i-th device can be, for example, a video sample of the i-th device flashing its light collected during the process of the i-th device flashing its light, or a continuous frame image of the i-th device flashing its light collected during the process of the i-th device flashing its light. Then, by reading the information sample of the i-th device, the guide head of the i-th device is identified, the expression of the i-th device is obtained, and the device identification of the i-th device is obtained based on the obtained expression and the information sample of the i-th device.

[0250] In some embodiments, the sampling frequency of the second device collecting the light flickering information of the i-th device is 30 frames per second.

[0251] In a specific example, the second device first identifies and reads the boot header information in the information sample of the i-th device, and determines through the boot header information how many base numbers the i-th device will use to express the device identification of the i-th device, what the value of the identification bit corresponding to each different information is, and the time required to determine the value of an identification bit in the i-th device expressing its own device identification. Based on this, the second device then reads the device identification in the information sample of the i-th device. When the second device identifies the second boot header of the i-th device, the reading operation ends, and the combination of the values of the identification bits corresponding to the information samples between the two consecutive boot headers is determined as the device identification of the i-th device.

[0252] The second device mentioned above can also be described as a sampling device.

[0253] S805: Establish a mapping relationship between the i-th point and the device identifier of the i-th device.

[0254] Among them, the explanation of this step is Figure 7 The explanation of S705 in the illustrated embodiments is the same and will not be repeated here for the sake of brevity.

[0255] S806: Determine whether i is greater than or equal to N. If so, end the device and point matching process. If not, set i=i+1 and return to step S804 to perform point matching on the i+1th device.

[0256] Among them, the explanation of this step is Figure 7 The explanation of S706 in the illustrated embodiments is the same and will not be repeated here for the sake of brevity.

[0257] In an embodiment of the present application, before point matching is performed on multiple devices with flashing lights, the multiple devices can be directly installed at predetermined points. The equipment manufacturer does not need to mark the device identification on the equipment, and the workers do not need to enter the device identification of each point by scanning the code or manually entering the information, which greatly saves production costs and labor costs and improves efficiency. During installation, the installer does not need to search for the corresponding device from multiple devices based on the matching relationship, which saves time cost. The installation can be installed in parallel, which improves installation efficiency. After all the installations are completed, the central control device can obtain the device identification of each of the multiple devices through the flashing light information emitted by each of the multiple devices, and then establish a mapping relationship between the device and the point. This method has strong reliability and high matching efficiency.

[0258] Moreover, before expressing its own device identification, the device first expresses its own guidance header information, which is used to express the expression method used when expressing the device identification. This allows all devices installed in the same whole-house smart scene to use an expression method that suits their actual situation based on their own lighting properties and the environment in which they are located. This not only makes the application scenarios of the method of the embodiment of the present application wider, but also makes the accuracy of the device identification expressed by the device higher.

[0259] In addition, since multiple devices are generally distributed in different locations, there is less interference between multiple devices when the devices express their own device identification through optical information. Therefore, when expressing their own device identification through optical information, point matching operations can be performed on multiple devices at the same time, thereby improving the matching efficiency of devices and points.

[0260] In order to more clearly understand the above S702-S704, as well as S803 and S804, the following describes in detail the process of the device expressing its own guidance head and its own device identification by flashing lights, taking the information expressed by the device as visible light information as an example.

[0261] In a whole-home smart scene, the number of installed devices can reach dozens, even hundreds, or even thousands. The types and models of these devices also vary greatly. The performance of the lighting components on these devices varies greatly. In addition to power differences, the time it takes for different devices to transition from one brightness, color, or color temperature to another also varies. For example, for a certain LED lamp, the minimum time required for the lamp to transition between different brightness levels is shown in Table 3.

[0262] Table 3

[0263] Brightness change (%) Time required (ms) 1-10 85.0 10-20 18.5 20-30 15.0 30-40 13.5 40-50 12.0 50-60 10.0 60-70 7.0 70-80 6.5 80-90 5.0 90-100 3.5

[0264] Table 3 shows that this LED lamp takes less time to transition between high brightness levels, but high brightness levels interfere more with other lights. Furthermore, even with the same brightness difference, the high brightness difference is difficult to identify. Furthermore, different manufacturers have different dimming curves, and for different devices, the brightness difference of the same percentage difference is also different. The larger the brightness difference, the easier it is to distinguish. Furthermore, the brightness difference varies between lamps of different power.

[0265] Taking a mobile phone as an example, the frame rate of the video shot by the mobile phone camera is generally 30 frames per second (30fps). The frame rate of the video shot by a high-performance camera can reach 60fps. Taking the shooting frame rate of 30fps as an example, the camera of the sampling device can capture 30 frames of images per second. It can also be understood that the sampling frequency of the sampling device for the light flashing process of the sampled device is 30 frames per second.

[0266] During the sampling process of the camera of the sampling device, there may be a deviation between the clock of the sampling device and the clock of the sampled device, and sampling may occur at the time point when the deviation accumulates, resulting in erroneous recognition results (recognition results of the device identification of the sampled device); in addition, since the sampling process is likely to be affected by other nearby artificial light sources, ambient light at the installation location, and recognition algorithms, it is impossible to guarantee that the brightness of each frame in all sampled frames can be accurately identified; in addition, the time required for lights of different manufacturers, models, and power to change between different brightness (or different color temperatures, or different colors) is also different. These factors make it impossible to use the same flashing expression period (that is, how long it takes to express a bit, or how long it takes to express a symbol in the device identification) for all smart devices in the same whole-house smart scene, which leads to the need to provide a fault-tolerant mechanism, such as determining a bit through multiple frames of sampled images.

[0267] Based on this, illustratively, Figure 9 A schematic diagram showing a device provided by an embodiment of the present application using different expression durations to express numbers through flashing lights is shown. Figure 9 In the figure, the solid triangle pattern marks the first brightness (or first color, or first color temperature) expressed by the device through light flashing, the solid circle pattern marks the second brightness (or second color, or second color temperature) expressed by the device through light flashing, and the solid square pattern marks the sampling time point of the sampling device.

[0268] The device's expression method includes expression duration, and expression duration refers to the duration required for the device to express the value of an identification bit in the device identifier.

[0269] For example, Figure 9 (a) shows a schematic diagram of a device provided in an embodiment of the present application using an expression duration of 33.33ms to express numbers through the brightness of flashing lights.

[0270] like Figure 9As shown in (a), the device can express numbers by flashing between a first brightness (solid circular pattern mark) and a second brightness (solid triangle pattern mark), and the expression time of each number is 33.33ms. The sampling device collects light flashing images at a frequency of 30 frames per second, that is, the sampling device collects one frame of image every 33.33ms. After the sampling device collects the image sample, it reads the brightness information through the image sample, and then determines the number expressed by the brightness information (that is, the sampling result, if the first brightness is collected, the sampling result is 0; if the second brightness is collected, the sampling result is 1). Since in this embodiment, the expression time of the device and the sampling interval of the sampling device are the same, both are 33.33ms, and the number of samples that can be sampled within one expression time is 1, each time a sampling result is obtained, the sampling result is correspondingly determined as a judgment value.

[0271] For example, Figure 9 (b) shows a schematic diagram of a device provided in an embodiment of the present application using an expression duration of 100ms to express numbers through the brightness of flashing lights.

[0272] like Figure 9 As shown in (b), the device can express numbers by flashing between a first brightness (solid circular pattern mark) and a second brightness (solid triangular pattern mark), and the expression time of each number is 100ms. The sampling device collects light flashing images at a frequency of 30 frames per second, that is, the sampling device collects one frame of image every 33.33ms. After the sampling device collects the image sample, it reads the brightness information through the image sample, and then determines the number expressed by the brightness information (that is, the sampling result, if the first brightness is collected, the sampling result is 0; if the second brightness is collected, the sampling result is 1). Since in this embodiment, the expression time of the device is 100ms, the sampling interval of the sampling device is 33.33ms, and the number of times that can be sampled within one expression time is 3, a judgment value is determined accordingly for every 3 sampling results. Among them, determining the judgment value based on the 3 sampling results can follow the principle of minority obeys majority.

[0273] For example, Figure 9 (c) shows a schematic diagram of a device provided in an embodiment of the present application using an expression duration of 166.67ms to express numbers through the brightness of flashing lights.

[0274] like Figure 9As shown in (c), the device can express numbers by flashing between a first brightness (solid circular pattern mark) and a second brightness (solid triangular pattern mark). The expression time of each number is 166.67ms, and the sampling device collects light flashing images at a frequency of 30 frames per second, that is, the sampling device collects one frame of image every 33.33ms. After the sampling device collects the image sample, it reads the brightness information through the image sample, and then determines the number expressed by the brightness information (that is, the sampling result, if the first brightness is collected, the sampling result is 0; if the second brightness is collected, the sampling result is 1). Since in this embodiment, the expression time of the device is 166.67ms, the sampling interval of the sampling device is 33.33ms, and the number of times that can be sampled within one expression time is 5, a judgment value is determined accordingly for every 5 sampling results. Among them, determining the judgment value based on the 5 sampling results can follow the principle of minority obeys majority.

[0275] Therefore, different lights can effectively respond to the different time lengths required for changes in different lights and different brightness values through different expression time lengths. That is to say, when different devices express numbers by flashing lights, they can use different expression time lengths according to their own performance, the environment they are in, etc., so that the expression time length meets the time length required for the device to change the brightness (or color, or color temperature, etc.) of the light.

[0276] It should be understood that the embodiments of the present application use the example of visible light information expressed by the device. When the information expressed by the device is invisible light information, sound frequency information, sound amplitude information or other different information, the conversion between the expressed information and numbers can also be achieved in a similar manner as described above.

[0277] In an embodiment of the present application, by introducing the expression of the guide head, when the device expresses its own device identification through information expression, it can determine the expression duration that suits itself based on its own corresponding information attributes and environmental factors. For example, taking the brightness information of visible light as an example, when the time required for the device to change from the first brightness to the second brightness is greater than 100ms and less than 166.67ms, the device can choose the expression duration to be 100ms; for another example, when the light interference in the environment where the device is located is relatively large, the device can choose the expression duration to be 100ms or 166.67ms. In this way, even if the sampling device incorrectly recognizes a frame of the sampled image, it can obtain the correct judgment value, that is, it can improve the fault tolerance of the device identification recognition process.

[0278] Specifically, when a device can sample multiple times within an expression time, the determination process of the judgment value corresponding to the expression time can follow the judgment principle of minority obeys majority, and determine the judgment value based on multiple sampling results. In this way, even if the sampling results of some frames are recognized incorrectly, it will not affect the recognition of the final judgment value. Therefore, the shorter the expression time of the device, the higher the expression efficiency of the device, and the longer the expression time of the device, the higher the fault tolerance of the device in the expression process, and the higher the accuracy of the expressed judgment value. For example, Figure 9 In (b), the correct judgment value can be obtained even if there is an erroneous sampling result in each expression duration. Figure 9 In (c), the correct judgment value can still be obtained even when there are two erroneous sampling results in each expression duration.

[0279] Since multiple devices in the same whole-house smart scene may need to use different expressions, the sampling device needs to obtain the expression method of its own device identification based on the information expressed by the expression device (referring to the device that expresses information) before obtaining the device identification of the expression device based on the information expressed by the expression device. In order to enable the sampling device to obtain the expression method of its own device identification based on the information expressed by the expression device, the embodiment of the present application introduces the concept of a guide head. That is, the expression device expresses not only its own device identification through information, but also its own guide head. Specifically, the expression device expresses its own guide head and its own device identification through information expression, as shown in the following table:

[0280] Boot Head Device identification Boot Head Device identification Boot Head Device identification ……

[0281] Among them, the guiding head is used by the sampling device to obtain the expression method used by the expression device when expressing its own device identification, wherein the expression method includes: information for indicating the conversion relationship of the value of the identification bit of the expression device using information to express its own device identification, and / or information for indicating the time required for the expression device to express the value of an identification bit in its own device identification.

[0282] In order to more clearly understand the guide head provided by the embodiment of the present application, the following is illustratively described: Figure 10 and Figure 11 Schematic diagrams of two types of guide heads are shown.

[0283] For example, Figure 10 A schematic diagram of a guide head provided in an embodiment of the present application is shown.

[0284] like Figure 10As shown in the figure, the guide header shown in the figure indicates that all controlled devices in the same whole-house smart scene use a fixed 101 identification guide header when expressing their own device identification through information, that is, the expression methods used include:

[0285] (1) The conversion relationship of the value of the identification bit of the device identification expressed by the information: Taking brightness information as an example, the device identification is expressed by two brightnesses. The value of the device identification bit expressed by each brightness is a binary number. The value of the device identification bit expressed by the first brightness (solid circle mark) is 0 (i.e.: Figure 10 The sampling result of the middle mark is 0), and the value of the device identification bit expressed by the second brightness (solid triangle mark) is 1 (ie: Figure 10 The sampling result marked in is 1);

[0286] (2) The time required to express the value of one bit in the device's own identification is 100ms.

[0287] When the sampling frequency of the sampling device is 30 frames per second, three samples can be taken within each expression duration, that is, three sampling results will be obtained within one expression duration. The value of a flag is determined based on the three sampling results (i.e.: Figure 10 (the judgment value marked in ).

[0288] It should be understood that: Figure 10 The embodiment shown is only for illustrative purposes. When all controlled devices use a fixed 101 identification guide head, each of the controlled devices can select an expression duration that suits itself based on its own information attributes (e.g., lighting attributes, speaker attributes, etc.) and the environment in which it is located. In addition, all controlled devices can also use other fixed expressions, such as ternary or quaternary expressions. For example, Figure 11 A schematic diagram of another guide head provided in an embodiment of the present application is shown.

[0289] like Figure 11 As shown in the figure, the guide header shown in the figure indicates that when all controlled devices in the same whole-house smart scene express their own device identification through information, the guide header indicates all information levels that may be used when expressing their own device identification in an incremental manner, and the guide header ends with a higher-level information that will not be used when expressing the device identification. Figure 11 In the example of brightness information, the guide head shows that the brightness changes from the first brightness (solid circular pattern mark) to the second brightness (solid triangle pattern mark), and then changes from the second brightness to the third brightness (solid five-pointed star pattern mark), and ends with the third brightness. This means that the device uses the following expression methods when expressing the device identification:

[0290] (1) The conversion relationship of the value of the identification bit of the device identification expressed by the information: the device identification is expressed by two brightness levels, and the value of the device identification bit expressed by each brightness level is a binary number. The value of the device identification bit expressed by the first brightness level (solid circle mark) is 0 (i.e.: Figure 11 The sampling result of the middle mark is 0), and the value of the device identification bit expressed by the second brightness (solid triangle mark) is 1 (ie: Figure 11 The sampling result of the mark in the middle is 1), where the value of the device identification bit expressed by the third brightness (solid five-pointed star mark) is 2 (ie: Figure 11 The sampling result of the mark in is 2). The third brightness is used to indicate the end of the guide header and only appears in the guide header logo, not in the device logo;

[0291] (2) The time required to express the value of one bit in the device's own identification is 166.67ms.

[0292] When the sampling frequency of the sampling device is 30 frames per second, 5 samples can be taken in each expression duration, that is, 5 sampling results will be obtained in one expression duration, and the value of an identification bit is determined based on the 5 sampling results (ie: Figure 11 (the judgment value marked in ).

[0293] In some embodiments, the identification method of the guide head provided in the embodiments of the present application can be, for example: if the sampling device recognizes that the expression device expresses M+1 types of brightness, and there is a situation where the M+1 types of brightness are expressed continuously in the order of increasing brightness values, then the information corresponding to the increasing brightness interval is determined to be the information of the guide head.

[0294] It should be understood that: Figure 11 The embodiment shown is only for illustrative purposes. Each of all devices in the same scene can illustrate other expressions in a similar manner as described above. For example, the guide head expresses a ternary expression through 4 increasing brightnesses (or 4 different brightnesses, or 4 different colors, or 4 different color temperatures, or 4 different sound frequencies, or 4 different sound amplitudes, etc.). That is to say, each of all devices in the same scene can use the conversion relationship between the information supported by itself and the value of the identification bit. Each of all devices in the same scene can choose the expression duration that suits itself according to its own information attributes and the environment in which it is located.

[0295] It should also be understood that the identification of the guide header is different from the device identification. When the expressing device expresses its own guide header and device identification through information expression, in order to avoid reading errors of the sampling device, the guide header identification cannot be used when expressing the device identification. For example, Figure 10When the guide header shown expresses the device identification, the 101 identification cannot be used. The guide header can also be used as a marking point for starting and ending reading of the device identification.

[0296] It should be noted that for the same whole-house smart scene, in the process of matching devices and points, the rules for expressing the guide head of all controlled devices in the scene need to be consistent, for example, they can all use Figure 10 The rules described in the embodiment shown can also be used Figure 11 The rules described in the illustrated embodiment, but not part of the use Figure 10 The rules described in the embodiment shown, another part uses Figure 11 The rules described in the illustrated embodiment are implemented so that the sampling device can correctly read the information expressed by the expression device.

[0297] Optionally, the above-mentioned expression of brightness can also be replaced by the expression of color temperature, the expression of color, the expression of the frequency of invisible light, the expression of the frequency of sound, the expression of the amplitude of sound, etc.

[0298] For example, Figure 12 A schematic flowchart of another method 1200 for matching devices and points provided in an embodiment of the present application is shown.

[0299] like Figure 12 As shown, the method 1200 includes:

[0300] S1201: Install N devices, each of which has a light flashing function, and the N devices correspond to N points.

[0301] Among them, the explanation of this step is Figure 8 The explanation of S801 in the illustrated embodiments is the same and will not be repeated here for the sake of brevity.

[0302] S1202: After the N devices are powered on, network configuration is performed on the N devices, and a device identifier of each of the N devices is obtained from the server.

[0303] It can be understood that: the server allocates a device identifier to each of the N devices.

[0304] The server is a server for N devices, for example, a hub or a gateway.

[0305] In one embodiment, after being powered on, each of the N devices sends a registration request message to the server. The registration request message is used to request the server to register a device identifier for itself. After registering the device identifier, the server sends the registered device identifier to the corresponding device. In this way, each of the N devices can obtain its own device identifier.

[0306] S1203: In response to the first trigger operation, the N devices enter a point matching mode.

[0307] The explanation of the first trigger operation is in Figure 8 The illustrated embodiment has been explained in detail and will not be described again here for the sake of brevity.

[0308] S1204: The N devices respectively indicate their own guide heads and their own device identifications by flashing lights.

[0309] In one example, for the process of N devices expressing their own device identification by flashing lights, there is the following agreement: the device identifications of the N devices are agreed to be numbers in the range of 0-1023, where N≤1024; in the expression method of each of the N devices, the maximum expression duration allowed is 166.67ms, that is, 5 frames of sampled images express one digit; the value of the identification bit converted from the information expressed by flashing lights is a binary value or a ternary value.

[0310] For the process in which N devices express their own guidance headers by flashing lights, the following convention is used for the expression rules of guidance headers: Each of the N devices is required to express all the brightness levels that may be used in the process of expressing its own device identification in an increasing manner, and end the guidance header with a higher brightness level that will not be used, that is, it is agreed to use Figure 11 The expression rule shown expresses the leading header itself.

[0311] S1205: Use the second device to scan the i-th device installed at the i-th point, and collect information samples of the i-th device during the process of flashing the light of the i-th device to obtain the device identification of the i-th device, wherein N points include the i-th point, N devices include the i-th device, and the initial value of i is 1.

[0312] Among them, the explanation of this step is Figure 8 The explanation of S804 in the illustrated embodiments is the same and will not be repeated here for the sake of brevity.

[0313] S1206: Establish a mapping relationship between the i-th point and the device identifier of the i-th device.

[0314] Among them, the explanation of this step is Figure 8 The explanation of S805 in the illustrated embodiments is the same and will not be repeated here for the sake of brevity.

[0315] S1207: Verify whether the mapping relationship between the i-th point and the device identifier of the i-th device is successfully established. If so, execute S1208; if not, return to S1205 and re-match the points.

[0316] Among them, the method for verifying whether the mapping relationship between the i-th point and the device identification of the i-th device is successfully established can be: performing a first control operation on the i-th device through the second device. If the i-th device makes a correct response operation in a timely manner, it is determined that the mapping relationship between the i-th point and the device identification of the i-th device is successfully established; otherwise, it is determined that the mapping relationship between the i-th point and the device identification of the i-th device fails to be established.

[0317] The reason why the mapping relationship between the i-th point and the device identification of the i-th device fails to be established may be that the sampling device makes an error in obtaining the device identification of the i-th device in S1205 .

[0318] In some embodiments, the first control operation may be, for example, controlling the i-th device to turn off the light through the sampling device. If the light of the i-th device is turned off, it is determined that the mapping relationship between the i-th point and the device identifier of the i-th device is successfully established.

[0319] S1208: Report the mapping relationship between the i-th point and the device identifier of the i-th device to the server.

[0320] S1209: Determine whether i is greater than or equal to N. If so, end the device and point matching process. If not, set i=i+1 and return to step S1205 to perform point matching on the i+1th device.

[0321] Among them, the explanation of this step is Figure 8 The explanation of S806 in the illustrated embodiments is the same and will not be repeated here for the sake of brevity.

[0322] In an embodiment of the present application, before point matching is performed on multiple devices, the multiple devices can be directly installed at predetermined points. The equipment manufacturer does not need to mark the device identification on the equipment, and the workers do not need to enter the device identification of each point by scanning the code or manually entering the information, which greatly saves production costs and labor costs and improves efficiency. During installation, the installer does not need to search for the corresponding device from multiple devices based on the matching relationship, which saves time cost. The installation can be installed in parallel, which improves installation efficiency. After all the installations are completed, the central control device can obtain the device identification of each device in the multiple devices through the information expressed by each device in the multiple devices, and then establish a mapping relationship between the device and the point. This method has high matching efficiency.

[0323] Moreover, before expressing its own device identification, the device first expresses its own guide header information, which is used to express the expression method used when expressing the device identification. This allows all devices installed in the same whole-house smart scene to use an expression method that suits their actual situation based on their own information attributes and the environment in which they are located. This not only makes the application scenarios of the method of the embodiment of the present application wider, but also makes the accuracy of the device identification expressed by the device higher.

[0324] For example, taking the brightness information as an example, Figure 13 A schematic diagram showing a first device among N devices provided by an embodiment of the present application expressing its own guide head and device identification by flashing lights.

[0325] like Figure 13 As shown, taking brightness expression as an example, when the first device among N devices expresses its own device identification by flashing its light, the guidance rule adopted is the rule of increasing brightness (i.e. Figure 11 The rule shown in the figure) indicates that the guide head of the first device increases from brightness 1 to brightness 2, and then from brightness 2 to brightness 3, and then the brightness stops increasing. The sampling device can recognize that this is the guide head information expressed by the first device. Based on the guide head information, the sampling device can determine that the first device will express the value of its own device identification bit through brightness 1 and brightness 2 in the subsequent device identification expression process. The value of the expressed device identification bit is a binary value, wherein the value of the device identification bit expressed by brightness 1 is 0, and the value of the device identification bit expressed by brightness 2 is 1. When the sampling frequency of the sampling device is 30 frames / second, in the guide head identification, the sampling device continuously samples 5 frames with the same brightness value. When the brightness value changes during the continuous sampling of the 6th frame, the sampling device determines that the time required for expressing the value of one identification bit in the device identification of the first device (expression time) is 166.67ms in the process of the first device expressing the device identification of the first device. Within one expression time, the sampling device can sample 5 times, thereby obtaining 5 sampling results, and the value of one identification bit (i.e. Figure 13), that is, the guide header of the first device is used to inform the sampling device that the first device's expression method for expressing the device identification is "expressing the value of the device identification bit through brightness 1 and brightness 2, and the value of the device identification bit expressed is a binary value, wherein the value of the device identification bit expressed by brightness 1 is 0, and the value of the device identification bit expressed by brightness 2 is 1, and the time required to express the value of an identification bit is 166.67ms"; after the guide header expression is completed, the device identification of the first device is expressed immediately, and after the device identification of the first device is expressed, the guide header of the first device is expressed immediately again. In this way, the guide header of the first device and the device identification of the first device are expressed alternately in a cycle. The sampling device can identify the expression interval of the device identification by identifying the guide header, and then obtain the device identification of the first device. Figure 13 It can be seen that the identification corresponding to the boot header of the first device is "012", and the device identification of the first device is "1001". After converting from binary to decimal, the device identification of the first device is "9".

[0326] For example, taking the brightness information as an example, Figure 14 A schematic diagram showing a second device among N devices provided by an embodiment of the present application expressing its own guide head and device identification by flashing lights.

[0327] like Figure 14 As shown, taking brightness expression as an example, when the second device among N devices expresses its own device identification by flashing lights, the guidance rule adopted is the rule of increasing brightness (i.e. Figure 11The guide header of the second device increases from brightness 1 to brightness 2, then from brightness 2 to brightness 3, then from brightness 3 to brightness 4, and then the brightness stops increasing. The sampling device can recognize that this is the guide header information expressed by the second device. Based on the guide header information, the sampling device can determine that the second device will express its own device identification bit value through brightness 1, brightness 2 and brightness 3 in the subsequent device identification expression process. The value of the expressed device identification bit is a ternary value, where the value of the device identification bit expressed by brightness 1 is 0, and the value of the device identification bit expressed by brightness 2 is 1. , the value of the device identification bit expressed by brightness 3 is 2. When the sampling frequency of the sampling device is 30 frames / second, in the guide head recognition, the brightness values corresponding to the 3 consecutive frames sampled by the sampling device are all the same. When the brightness value changes during the 4th consecutive sampling, the sampling device determines that the second device expresses the device identification of the second device. The time required to express the value of one identification bit in the device identification of the second device (expression time) is 100ms. Within one expression time, the sampling device can sample 3 times, and then obtain 3 sampling results. The value of one identification bit (i.e. Figure 14 ), that is, the guide header of the second device is used to inform the sampling device that the second device expresses the device identification in the manner of "expressing the value of the device identification bit through brightness 1, brightness 2 and brightness 3, and the value of the device identification bit expressed is a ternary value, wherein the value of the device identification bit expressed by brightness 1 is 0, the value of the device identification bit expressed by brightness 2 is 1, the value of the device identification bit expressed by brightness 3 is 2, and the time required to express the value of one identification bit is 100ms"; after the guide header expression is completed, the device identification of the second device is expressed immediately, and after the device identification of the second device is expressed, the guide header of the second device is expressed immediately again. In this way, the guide header of the second device and the device identification of the second device are expressed alternately in a cycle. The sampling device can identify the expression interval of the device identification by identifying the guide header, and then obtain the device identification of the second device. Figure 14 It can be seen that the identification corresponding to the boot header of the first device is "0123", and the device identification of the second device is "102". After converting from ternary to decimal, the device identification of the second device is "11".

[0328] For example, Figure 15 FIG1 shows a schematic flow chart of a system 1500 for matching devices and points provided in an embodiment of the present application. Figure 15 As shown, the system 1500 includes:

[0329] N devices (device 1520, device 1530, device 1540, ...), each of which has an information expression function, are respectively installed at N points in the same whole-house smart scene.

[0330] Among them, the whole-house smart scene can be, for example, a smart scene in a home room, a smart scene in an office, a smart scene in a workshop, or a smart scene in a business place. In addition to being applicable to the whole-house smart scene, the method provided in the embodiment of the present application can also be applicable to scenes with any other number of device matching points.

[0331] Among them, the interpretation of N devices and the interpretation of the information expressed by the devices are in Figure 7 The illustrated embodiment has been described in detail and will not be repeated here for the sake of brevity.

[0332] Among them, N devices refer to all devices in the same whole-house smart scene. N devices can also be described as N controlled devices. The expression device described in the above embodiment belongs to N devices.

[0333] The N devices may be used to perform an operation: in response to a first trigger operation, the N devices express information to express their own boot headers and their own device identifications.

[0334] The explanation of this operation is in Figure 7 S702 in the illustrated embodiment has been described in detail and will not be repeated here for the sake of brevity.

[0335] The N devices are specifically used to perform an operation: after the N devices are powered on, they enter a point matching mode in response to a first trigger operation and express information in the point matching mode.

[0336] The device 1510 includes a determination module 1511, a matching module 1512, and a transceiver module 1513. Specifically:

[0337] The determining module 1511 is configured to determine a device identifier of the i-th device according to information expressed by the i-th device among the N devices and an expression method of the i-th device.

[0338] The expression mode of the i-th device is the expression mode used by the i-th device to express its own device identification.

[0339] In some embodiments, the expression of the i-th device includes:

[0340] Information used to indicate the conversion relationship between the values of the identification bits of the device identification used by the i-th device to express its own device identification using the expressed information, and / or

[0341] Information indicating the duration required for the i-th device to express the value of an identification bit in its own device identification.

[0342] The type of the identification bit in the device identification can be any one of numbers, letters, and symbols.

[0343] In one embodiment, the device 1510 further includes an acquisition module for acquiring an expression mode of the i-th device. Specifically, the acquisition module acquires the expression mode of the i-th device sent by the intermediate device through the transceiver module 1513 .

[0344] In another embodiment, the device 1510 further includes a sampling module for collecting information samples of the i-th device during the process of expressing information when the i-th device expresses its own guide header and device identification through information.

[0345] The determination module 1511 is further configured to identify the boot header of the i-th device according to the information sample, and to determine the expression method used by the i-th device to express its own device identification through the information of the boot header.

[0346] The process in which N devices express their own boot headers and device identifications through information expression may be performed cyclically.

[0347] In some embodiments, the sampling frequency at which the second device collects information expressed by the i-th device is 30 frames per second.

[0348] It should be understood that the device identification of the i-th device obtained by the determination module 1511 based on the information expressed by the i-th device can be a combination of numbers, for example, a combination of binary numbers, a combination of ternary numbers, a combination of decimal numbers, etc. Before outputting the device identification of the i-th device, the second device can convert the obtained combination of numbers, for example, convert some of the numbers into corresponding letters or corresponding symbols, etc., and finally output the converted device identification.

[0349] The matching module 1512 is configured to establish a mapping relationship between the i-th point and the device identifier of the i-th device.

[0350] The transceiver module 1513 is also used to upload the mapping relationship between the i-th point and the device identifier of the i-th device to the server, which can be, for example, a hub, a gateway or the cloud.

[0351] In some embodiments, the device 1510 further includes a verification module for verifying the mapping relationship between the device identifier of the i-th device and the i-th point before uploading the mapping relationship between the device identifier of the i-th device and the i-th point to the server.

[0352] In an embodiment of the present application, before point matching of multiple devices is performed, the multiple devices can be directly installed at predetermined points. The equipment manufacturer does not need to mark the device identification on the equipment, and the workers do not need to enter the device identification of each point by scanning the code or manually entering the information, which greatly saves production costs and labor costs and improves efficiency. During installation, the installer does not need to find the corresponding device from multiple devices based on the matching relationship, which saves time cost. The installation can be installed in parallel, which improves installation efficiency. After all the installations are completed, the device identification of each device in the multiple devices can be obtained through the information expressed by each device in the multiple devices, and then a mapping relationship between the device and the point can be established, and multiple devices can be matched in parallel. The system has strong reliability and high matching efficiency.

[0353] In addition, before expressing its own device identification, the device first expresses its own guidance header information, which is used to express the expression method used when expressing the device identification. This allows all devices installed in the same whole-house smart scene to use an expression method that suits their actual situation based on their own attributes and the environment in which they are located. This not only makes the use scenarios of the system of the embodiment of the present application wider, but also makes the accuracy of the device identification expressed by the device higher.

[0354] One or more of the modules or units described herein can be implemented in software, hardware, or a combination of the two. When any of the above modules or units is implemented in software, the software exists in the form of computer program instructions and is stored in a memory, and a processor can be used to execute the program instructions and implement the above method flow. The processor may include, but is not limited to, at least one of the following: a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a microcontroller (MCU), or an artificial intelligence processor, etc., a computing device that runs software, each computing device may include one or more cores for executing software instructions to perform operations or processing. The processor may be built into an SoC (system on chip) or an application specific integrated circuit (ASIC), or it may be an independent semiconductor chip. In addition to the core for executing software instructions to perform operations or processing within the processor, it may further include necessary hardware accelerators, such as a field programmable gate array (FPGA), a PLD (programmable logic device), or a logic circuit that implements dedicated logic operations.

[0355] When the modules or units described in this document are implemented in hardware, the hardware can be any one or any combination of a CPU, a microprocessor, a DSP, an MCU, an artificial intelligence processor, an ASIC, a SoC, an FPGA, a PLD, a dedicated digital circuit, a hardware accelerator, or a non-integrated discrete device, which can run the necessary software or not rely on the software to execute the above method flow.

[0356] When the modules or units described herein are implemented using software, they can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0357] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0358] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0359] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0360] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0361] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0362] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0363] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for matching equipment and points, characterized in that: The method comprises: When the first device expresses the guide head and the device identification through the information expression function, the second device determines the device identification of the first device through an expression method based on the information expressed by the first device, where the expression method is the expression method used by the first device when expressing the device identification, and the first device is installed at a first point; The second device establishes a mapping relationship between the device identifier of the first device and the first point.

2. The method according to claim 1, characterized in that The expressions include: Information for instructing the first device to use the expressed information to express a conversion relationship between values of identification bits of a device identifier, and / or Information indicating the time length required for the first device to express the value of an identification bit in the device identification.

3. The method according to claim 1 or 2, characterized in that The type of the identification bit is any one of numbers, letters, and symbols.

4. The method according to any one of claims 1 to 3, characterized in that The expressed information includes any one or more of light information and sound information, the light information includes at least one of visible light information and invisible light information, and the sound information includes at least one of amplitude information and frequency information.

5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: The second device receives information indicating the expression manner.

6. The method according to any one of claims 1 to 4, characterized in that The method further comprises: When the first device expresses the guide header and device identification of the first device through the information, the second device collects a first information sample, where the first information sample is an information sample for information expression by the first device; The expression mode is determined by identifying a guide header of the first device according to the first information sample, where the guide header of the first device is used to indicate the expression mode.

7. The method according to claim 6, characterized in that The sampling interval duration of the first information sample collected by the second device is a first duration. When the expressed information is visible light information, the determining the expression mode by identifying the guide head of the first device according to the first information sample includes: If the second device determines, based on the first information samples, that the first device expresses M+1 types of brightness, and the M+1 types of brightness are expressed continuously in ascending order of brightness values, and the minimum number of samples in the first information samples whose brightness values do not change continuously is n, then determining the expression method includes: The first device expresses a device identification of the first device by using first M brightnesses among the M+1 brightnesses, wherein a value of an identification bit for expressing a first brightness among the first M brightnesses is 0, a value of an identification bit for expressing a second brightness among the first M brightnesses is 1, ..., a value of an identification bit for expressing an Mth brightness among the first M brightnesses is M-1, wherein the M+1th brightness among the M+1 brightnesses is used to express the end of the guide header of the first device, and M is a positive integer greater than 1; and The duration required for the first device to express the value of one identification bit in the device identifier is the product of n and the first duration, where n is a positive integer greater than or equal to 1.

8. The method according to claim 6, characterized in that The sampling interval duration of the first information sample collected by the second device is a first duration. When the expressed information is visible light information, the determining the expression mode by identifying the guide head of the first device according to the first information sample includes: If the second device determines, through the first information samples, that the first device expresses M types of brightness, and the M types of brightness are not expressed continuously in ascending order of brightness values, and the minimum number of samples in the first information samples whose brightness values do not change continuously is n, then determining the expression method includes: The first device expresses a device identification of the first device through the M brightness expressions, wherein a value of an identification bit of a first brightness expression among the M brightnesses is 0, a value of an identification bit of a second brightness expression among the M brightnesses is 1, ..., a value of an identification bit of an Mth brightness expression among the M brightnesses is M-1, wherein M is a positive integer greater than 1; and The duration required for the first device to express the value of one identification bit in the device identifier is the product of n and the first duration, where n is a positive integer greater than or equal to 1.

9. The method according to claim 6, characterized in that The sampling interval duration of the first information sample collected by the second device is a first duration. When the expressed information is sound information, the determining the expression mode by identifying the guide head of the first device according to the first information sample includes: If the second device determines, based on the first information sample, that the first device expresses M+1 sound frequencies, and the M+1 sound frequencies are expressed continuously in ascending order of frequency values, and the minimum number of samples in the first information sample whose frequency values do not continuously change is n, then determining the expression method includes: The first device expresses the device identification of the first device through the first M sound frequencies among the M+1 sound frequencies, wherein the value of the identification bit of the first sound frequency among the first M sound frequencies is 0, the value of the identification bit of the second sound frequency among the first M sound frequencies is 1, ..., the value of the identification bit of the Mth sound frequency among the first M sound frequencies is M-1, wherein the M+1th sound frequency among the M+1 sound frequencies is used to express the end of the guide header of the first device, and M is a positive integer greater than 1; and The duration required for the first device to express the value of one identification bit in the device identifier is the product of n and the first duration, where n is a positive integer greater than or equal to 1.

10. The method according to claim 6, characterized in that The sampling interval duration of the first information sample collected by the second device is a first duration. When the expressed information is sound information, the determining the expression mode by identifying the guide head of the first device according to the first information sample includes: If the second device determines, based on the first information samples, that the first device expresses M sound frequencies, and the M sound frequencies are not expressed continuously in ascending order of frequency values, and the minimum number of samples in the first information samples whose frequency values do not change continuously is n, then determining the expression method includes: The first device expresses the device identification of the first device through the M sound frequencies, wherein the value of the identification bit of a first sound frequency among the M sound frequencies is 0, the value of the identification bit of a second sound frequency among the M sound frequencies is 1, ..., the value of the identification bit of the Mth sound frequency among the M sound frequencies is M-1, where M is a positive integer greater than 1; and The duration required for the first device to express the value of one identification bit in the device identifier is the product of n and the first duration, where n is a positive integer greater than or equal to 1.

11. The method according to claim 7 or 9, characterized in that The n sample values corresponding to every n information samples in the first information samples determine the value of an identification bit, and the identification corresponding to the boot header of the first device is 01…(M-1)M.

12. The method according to claim 8 or 10, characterized in that The n sample values corresponding to every n information samples in the first information samples determine the value of an identification bit, and the identification corresponding to the boot header of the first device is 101.

13. The method according to any one of claims 1 to 12, characterized in that The second device determines the device identifier of the first device by expression according to the information expressed by the first device, including: Determining, according to the information expressed by the first device, a value of an identification bit corresponding to the first information sample by using the expression method; A combination of the values of the identification bits located between the identification bits corresponding to two consecutive boot headers is determined as the device identification of the first device.

14. The method according to any one of claims 1 to 13, characterized in that The method further comprises: The second device uploads a mapping relationship between the device identifier of the first device and the first point.

15. The method according to claim 14, characterized in that Before the second device uploads the mapping relationship between the device identifier of the first device and the first point, the method further includes: The second device verifies a mapping relationship between the device identifier of the first device and the first point.

16. The method according to any one of claims 1 to 15, characterized in that The N devices include the first device, where N is a positive integer greater than 1, and the method further includes: When a third device among the N devices expresses a guide header and a device identification through an information expression function, the second device determines the device identification of the third device according to the information expressed by the third device and the expression method used by the third device when expressing the device identification, and the third device is installed at a third location; The second device establishes a mapping relationship between the device identifier of the third device and the third point.

17. A method for matching equipment and points, characterized in that: The method is applied to a first device, the first device having an information expression function, and the first device is installed at a first location, and the method includes: In response to a first trigger operation, the first device expresses information to express the guide head of the first device and the device identification of the first device. The guide head of the first device is used to indicate the expression method used by the first device when expressing the device identification of the first device, so that the device that obtains the expressed information determines the device identification of the first device through the expression method. The device identification of the first device is used to establish a mapping relationship between the device identification of the first device and the first point position.

18. The method according to claim 17, characterized in that The expressions include: Information for indicating that the first device uses the information expressed to express the conversion relationship between the values of the identification bits of the device identification, and / or Information indicating the time length required for the first device to express the value of an identification bit in the device identification.

19. The method according to claim 17 or 18, characterized in that The type of the identification bit is any one of numbers, letters, and symbols.

20. The method according to any one of claims 17 to 19, characterized in that The expressed information includes any one or more of light information and sound information, the light information includes at least one of visible light information and invisible light information, and the sound information includes at least one of amplitude information and frequency information.

21. The method according to claim 20, characterized in that When the information to be expressed is visible light information, the expression method includes any one of the following: Expressing the device identification of the first device by flashing M brightness levels, wherein a value of a first brightness expression identification bit among the M brightness levels is 0, a value of a second brightness expression identification bit among the M brightness levels is 1, ..., a value of an Mth brightness expression identification bit among the M brightness levels is M-1, wherein the value of M is a positive integer greater than 1; Expressing the device identification of the first device by flashing M colors, wherein the value of the identification bit of the first color among the M colors is 0, the value of the identification bit of the second color among the M colors is 1, ..., the value of the identification bit of the Mth color among the M colors is M-1, wherein the value of M is a positive integer greater than 1; or The device identification of the first device is expressed by flashing M color temperatures, wherein the value of the first color temperature expression identification bit among the M color temperatures is 0, the value of the second color temperature expression identification bit among the M color temperatures is 1, ..., the value of the Mth color temperature expression identification bit among the M color temperatures is M-1, wherein the value of M is a positive integer greater than 1.

22. The method according to claim 20, characterized in that When the information being expressed is sound information, the expression method includes any one of the following: Expressing the device identification of the first device by emitting M kinds of sounds, wherein the M kinds of sounds correspond one-to-one to M kinds of frequencies, wherein the value of the expression identification bit of the first frequency among the M kinds of frequencies is 0, the value of the expression identification bit of the second frequency among the M kinds of frequencies is 1, ..., the value of the expression identification bit of the Mth frequency among the M kinds of frequencies is M-1, wherein the value of M is a positive integer greater than 1; or The device identification of the first device is expressed by emitting M kinds of sounds, and the M kinds of sounds correspond one-to-one to M kinds of amplitudes, wherein the value of the first amplitude expression identification bit among the M kinds of amplitudes is 0, the value of the second amplitude expression identification bit among the M kinds of amplitudes is 1,…, and the value of the Mth amplitude expression identification bit among the M kinds of amplitudes is M-1.

23. The method according to any one of claims 17 to 22, characterized in that The first device is a whole-house smart device.

24. The method according to claim 23, wherein The first device is a lighting device.

25. The method according to any one of claims 17 to 24, characterized in that The first device expressing information in response to the first trigger operation includes: In response to the first trigger operation, the first device enters a point matching mode; The first device expresses information in the point matching mode.

26. An electronic device, characterized in that: include: one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions that, when executed by the one or more processors, cause the electronic device to perform the method as described in any one of claims 1 to 16.

27. An electronic device, characterized in that: include: one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions that, when executed by the one or more processors, cause the electronic device to perform the method as described in any one of claims 17 to 25.

28. A system, characterized in that The system comprises: The electronic device according to claim 26; The electronic device as claimed in claim 27.

29. A computer-readable storage medium, characterized in that The storage medium stores a program or instruction. When the program or instruction is executed, the method according to any one of claims 1 to 16 or the method according to any one of claims 17 to 25 is implemented.

30. A chip, characterized in that: The chip stores instructions, and when the instructions are executed, the method according to any one of claims 1 to 16 or the method according to any one of claims 17 to 25 is implemented.

31. A computer program product, characterized in that The computer program product stores a program or instructions, and when the program or instructions are executed, the method according to any one of claims 1 to 16 or the method according to any one of claims 17 to 25 is implemented.

Images