Measurement method, device and system

Abstract

The invention discloses a measurement method, device and system. The method comprises the steps that first equipment acquires a depth image of a first user; determining physiological parameter information of the first user according to the depth image of the first user; executing a first operation associated with the physiological parameter information, or displaying information associated with the physiological parameter information; or sending the physiological parameter information to a second device associated with the first user. Therefore, on one hand, the physiological parameters (such as the height) of the user can be automatically and intelligently measured, the operation complexity of manually measuring the physiological parameters by the user is reduced, and the user experience is improved. And on the other hand, the first equipment can intelligently and automatically execute the corresponding first operation according to the physiological parameters of the user, so that the use requirements of the user are met, and the user experience is further improved.

Description

Technical Field

[0001] This application relates to the technical field of terminals, and in particular, to a measurement method, apparatus, and system. Background Art

[0002] Height, as a basic feature of the human body shape, plays an important role in life, such as the growth of children. In some solutions, fixed instrument devices can be used to measure height, such as using a height measuring instrument. However, the applicable scenarios of such a solution are limited and it is not convenient and fast enough. There is an urgent need to propose a method for accurately and conveniently measuring the height of the human body. Summary of the Invention

[0003] This application provides a measurement method, apparatus, and system, which can intelligently and automatically measure the physiological parameters of an object, improving the measurement efficiency and accuracy.

[0004] To achieve the above object, the embodiments of this application adopt the following technical solutions.

[0005] In a first aspect, this application provides a measurement method. The execution subject of this method can be an electronic device or a component located in the electronic device (for example, a chip, a chip system, or a processor, etc.). Hereinafter, the case where the execution subject is an electronic device will be used as an example for description. The method may include: The first device acquires a depth image of a first user; determines physiological parameter information of the first user according to the depth image of the first user; executes a first operation associated with the physiological parameter information, or displays information associated with the physiological parameter information; or sends the physiological parameter information to a second device associated with the first user. In this way, on the one hand, it can automatically and intelligently measure the physiological parameters of the user (such as height), reducing the operation complexity of the user manually measuring the physiological parameters and improving the user experience. On the other hand, the first device can intelligently and automatically execute the corresponding first operation according to the physiological parameters of the user to meet the usage needs of the user and further improve the user experience.

[0006] In addition, since the depth image only includes the contour of the user and does not contain sensitive information that can identify the specific identity of the user, using this method will not cause the leakage of the user's personal identity information.

[0007] In a possible design, the first device includes a whole-house intelligent device. In this way, the whole-house intelligent device can intelligently execute corresponding operations in the whole house according to the physiological parameters of the user, enhancing the user experience in the whole-house scenario.

[0008] In a possible design, the executing the first operation associated with the physiological parameter information includes:

[0009] Send a first instruction to a third device, where the first instruction is used to instruct the third device to execute the scenario associated with the first user.

[0010] In a possible design, it further includes:

[0011] Send a second instruction to the second device, where the second instruction is used to instruct the third device to execute the scenario associated with the first user.

[0012] In a possible design, the displaying of the information associated with the physiological parameter information includes:

[0013] Display the physiological parameter information of the first user, or display a parameter curve generated based on the physiological parameter information.

[0014] In this way, the first device can intelligently display the physiological parameter information or the parameter curve according to the measurement result, so that the user can intuitively observe the change of the physiological parameter and improve the human-computer interaction experience.

[0015] In a possible design, the execution of the first operation associated with the physiological parameter information includes:

[0016] Send a warning message to a fifth device, where the warning message is used to prompt that the first user leaves home alone, and the physiological parameter information and / or identity of the first user meet the first condition;

[0017] The first condition includes at least one of the following conditions: the first user is a child, and the height of the first user is lower than a threshold.

[0018] In this way, by calculating the height value of the user, it is possible to perform a safety warning for the scenario where a user (such as a young child) with a height lower than the threshold leaves home alone, achieving a safety prevention effect.

[0019] In a possible design, the obtaining of the depth image of the first user includes:

[0020] Collect the depth image of the first user through a depth camera.

[0021] In a possible design, it further includes:

[0022] Collect the depth image of the second user at a first position and the depth image at a second position; the physiological parameter information of the second user is known; the depth image of the second user at the first position and the depth image at the second position are used to determine the spatial position of the depth camera; the spatial position includes at least one of the following: the installation height of the depth camera, the installation inclination angle of the depth camera.

[0023] In this way, based on the depth maps of the second user with a known height at different positions, the spatial position of the depth camera can be calibrated to serve as the parameter basis for subsequent height measurement, which can improve the accuracy of height measurement. Moreover, in this solution, there is no need to construct a minimization problem to solve the parameters of the camera, which can reduce the computational complexity.

[0024] In a possible design, determining the physiological parameter information of the first user according to the depth image of the first user includes:

[0025] Determining the physiological parameter information of the first user according to the depth image of the first user and the spatial position of the depth camera.

[0026] In a possible design, the whole-house intelligent device includes a door lock.

[0027] In this way, the door lock can automatically execute the first operation intelligently according to the physiological parameter information of the user. In some examples, it can improve the experience of the user entering and leaving the house.

[0028] In a possible design, the physiological parameter information includes height and body fatness.

[0029] In a possible design, the first device includes a vehicle or a vehicle-mounted device. Optionally, the first device performs a first operation associated with the physiological parameter information, including: determining the device parameters of the fourth device, and the determined device parameters match the physiological parameter information.

[0030] In a possible design, the fourth device includes: a seat and a rearview mirror; the device parameters of the seat include at least one of the following: front-back distance, pitch angle; the device parameters of the rearview mirror include at least one of the following: angle, height; and / or the fourth device includes a home device, and the home device includes a heating and cooling air supply device, and the heating and cooling air supply device includes at least one of the following: an air conditioner, a fan; the device parameters of the heating and cooling air supply device include the blowing angle, the pitch angle of the fan blade, and the height of the fan blade.

[0031] In a vehicle-mounted scenario, compared with the related art where the driver or passenger manually adjusts the seat after getting in the car, in the solution of the present application, on the one hand, the parameters of the in-vehicle devices, such as the parameters of the seat, can be intelligently and automatically adjusted according to the height of the user, reducing the complexity of device parameter adjustment. On the other hand, by mounting a depth camera outside the vehicle door, the height of the user can be measured before getting in the car, and the parameters of the in-vehicle devices can be adjusted according to the height value, avoiding the interference to other passengers and the possible driving safety risks caused by adjusting the in-vehicle device parameters during vehicle driving.

[0032] In a home scenario, the first device can combine the user's height value and perform corresponding actions to improve the performance of device usage in the home scenario and enhance the user's home experience.

[0033] In a second aspect, a method for measuring physiological parameters is provided, which is applied to a second device or corresponding components (such as a chip, a chip system, or a processor, etc.). The method includes: receiving a depth image of a first user from the first device; determining physiological parameter information of the first user based on the depth image of the first user; performing a first operation associated with the physiological parameter information, or displaying information associated with the physiological parameter information.

[0034] In a possible design, it further includes: receiving a second instruction from the first device, where the second instruction is used to instruct a third device to execute a scenario associated with the first user;

[0035] The performing of the first operation associated with the physiological parameter information includes: instructing the third device to execute the scenario associated with the first user according to the second instruction.

[0036] In a possible design, the first device includes a whole-house intelligent device.

[0037] In a possible design, the whole-house intelligent device includes a door lock and home appliances.

[0038] In a possible design, the physiological parameter information includes height and body fat percentage.

[0039] In a third aspect, a device for measuring physiological parameters is provided. The device includes:

[0040] A camera module for acquiring a depth image of a first user;

[0041] A processing module for determining physiological parameter information of the first user based on the depth image of the first user;

[0042] The processing module for performing a first operation associated with the physiological parameter information; or a display module for displaying information associated with the physiological parameter information; or a communication module for sending the physiological parameter information to a second device associated with the first user.

[0043] In a possible design, the first device includes a whole-house intelligent device.

[0044] In a possible design, the processing module for performing a first operation associated with the physiological parameter information includes: controlling the communication module to send a first instruction to a third device, where the first instruction is used to instruct the third device to execute a scenario associated with the first user.

[0045] In a possible design, the communication module is further configured to: send a second instruction to the second device, where the second instruction is used to instruct the third device to execute the scenario associated with the first user.

[0046] In a possible design, the display module is configured to display information associated with the physiological parameter information, including:

[0047] Display the physiological parameter information of the first user, or display a parameter curve generated based on the physiological parameter information.

[0048] In a possible design, the processing module is configured to perform a first operation associated with the physiological parameter information, including: controlling the communication module to send a warning message to a fifth device, where the warning message is used to prompt that the first user leaves home alone, and the physiological parameter information and / or identity of the first user meet a first condition. The first condition includes at least one of the following conditions: the first user is a child, and the height of the first user is lower than a threshold.

[0049] In a possible design, the camera module is further configured to collect a depth image of a second user at a first position and a depth image of the second user at a second position; the physiological parameter information of the second user is known; the depth image of the second user at the first position and the depth image of the second user at the second position are used to determine the spatial position of the camera module; the spatial position includes at least one of the following: the installation height of the camera module, the installation inclination of the camera module.

[0050] In a possible design, the processing module is configured to determine the physiological parameter information of the first user based on the depth image of the first user, including: determining the physiological parameter information of the first user based on the depth image of the first user and the spatial position of the camera module.

[0051] In a possible design, the whole-house intelligent device includes a door lock.

[0052] In a possible design, the physiological parameter information includes height and degree of fatness.

[0053] In a fourth aspect, a physiological parameter measurement device is provided, where the device includes: a communication module, configured to receive a depth image of a first user from a first device; a processing module, configured to determine the physiological parameter information of the first user based on the depth image of the first user; perform a first operation associated with the physiological parameter information, or a display module, configured to display information associated with the physiological parameter information.

[0054] In a possible design, the communication module is further configured to: receive a second instruction from the first device, where the second instruction is used to instruct a third device to execute a scenario associated with the first user; the processing module is configured to perform a first operation associated with the physiological parameter information, including: instructing the third device to execute the scenario associated with the first user according to the second instruction.

[0055] In a possible design, the first device includes a whole-house intelligent device.

[0056] In a possible design, the whole-house intelligent device includes a door lock and home appliances.

[0057] In a possible design, the physiological parameter information includes height and body fat percentage.

[0058] In a fifth aspect, a physiological parameter measurement system is provided, including:

[0059] A first device, configured to obtain a depth image of a first user;

[0060] The first device is further configured to determine the physiological parameter information of the first user according to the depth image of the first user;

[0061] The first device is further configured to send the physiological parameter information to a second device associated with the first user;

[0062] The second device is configured to, after receiving the physiological parameter information, perform a first operation associated with the physiological parameter information, or display information associated with the physiological parameter information.

[0063] In one or more scenarios of this application, the depth image can be collected in real time by a camera, or taken and saved in advance.

[0064] In a possible design, the second device is configured to perform a first operation associated with the physiological parameter information, including:

[0065] Sending an instruction to a third device, where the instruction is used to instruct the third device to execute a scenario associated with the first user.

[0066] In a possible design, the second device is configured to perform a first operation associated with the physiological parameter information, including:

[0067] Determining the device parameters of a fourth device, where the determined device parameters match the physiological parameter information.

[0068] In a possible design, the second device is configured to display information associated with the physiological parameter information, including:

[0069] Display the physiological parameter information of the first user, or display a parameter curve generated based on the physiological parameter information.

[0070] In a possible design, the second device is used to perform a first operation associated with the physiological parameter information, including:

[0071] Send a warning message to a fifth device, where the warning message is used to prompt that the first user leaves home alone, and the physiological parameter information and / or identity of the first user meet a first condition;

[0072] The first condition includes at least one of the following conditions: the first user is a child, and the height of the first user is lower than a threshold.

[0073] In a possible design, the first device includes a whole-house intelligent device.

[0074] In a possible design, the first device includes a vehicle or vehicle-mounted device.

[0075] In a possible design, the first device is provided with a depth camera; the first device is used to obtain a depth image of the first user, including:

[0076] Collect the depth image through the depth camera.

[0077] In a possible design, the first device is further used to:

[0078] Collect the depth image of the second user at a first position and the depth image at a second position through the depth camera; the physiological parameter information of the second user is known; the depth image of the second user at the first position and the depth image at the second position are used to determine the spatial position of the depth camera; the spatial position includes at least one of the following: the installation height of the depth camera, the installation inclination angle of the depth camera.

[0079] In a possible design, the first device is used to determine the physiological parameter information of the first user based on the depth image of the first user, including:

[0080] Determine the physiological parameter information of the first user based on the depth image of the first user and the spatial position of the depth camera.

[0081] In a possible design, the whole-house intelligent device includes a door lock and home appliances.

[0082] In a possible design, the fourth device includes: a seat and a rearview mirror; the device parameters of the seat include at least one of the following: front-back distance, pitch angle; the device parameters of the rearview mirror include at least one of the following: angle, height;

[0083] and / or the fourth device includes a heating and cooling air supply device, and the heating and cooling air supply device includes at least one of the following: an air conditioner, a fan; the device parameters of the heating and cooling air supply device include a blowing angle, a pitching angle of the fan blade, and a height of the fan blade.

[0084] In a possible design, the physiological parameter information includes height and body fatness.

[0085] In a sixth aspect, an electronic device is provided, and the electronic device has a function of implementing the method described in any of the above aspects and any possible implementation manner thereof. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0086] In a seventh aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program (which can also be referred to as an instruction or code), and when the computer program is executed by an electronic device, the electronic device is caused to execute the method of any of the above aspects or any implementation manner in any aspect.

[0087] In an eighth aspect, a computer program product is provided, and when the computer program product runs on an electronic device, the electronic device is caused to execute the method of any of the above aspects or any implementation manner in any aspect.

[0088] In a ninth aspect, a circuit system is provided, and the circuit system includes a processing circuit configured to execute the method of any of the above aspects or any implementation manner in any aspect.

[0089] In a tenth aspect, a chip system is provided, including at least one processor and at least one interface circuit. The at least one interface circuit is configured to perform a transceiver function and send an instruction to the at least one processor. When the at least one processor executes the instruction, the at least one processor executes the method of any of the above aspects or any implementation manner in any aspect.

[0090] In an eleventh aspect, an electronic device is provided, including a processor and a memory. The memory is used to store a computer program (which can also be referred to as an instruction or code), and the processor is used to execute the computer program so that the electronic device executes the method of any of the above aspects or any implementation manner in any aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0091] Figure 1 It is a schematic diagram of the system architecture provided by an embodiment of the present application;

[0092] Figure 2 It is a schematic diagram of the structure of the device provided by an embodiment of the present application;

[0093] Figures 3 - 6Schematic diagram of a scenario for performing corresponding operations based on physiological parameters provided by an embodiment of the present application;

[0094] Figure 7 Another schematic diagram of the architecture of the device control system provided by an embodiment of the present application;

[0095] Figure 8A 、 Figure 8B Schematic diagram of a scenario for the measurement method provided by an embodiment of the present application;

[0096] Figure 9 Schematic flowchart of calibrating the spatial position of a depth camera provided by an embodiment of the present application;

[0097] Figure 10 Schematic diagram of a scenario for calibrating the spatial position of a depth camera provided by an embodiment of the present application;

[0098] Figure 11 Schematic diagram of the coordinate system provided by an embodiment of the present application;

[0099] Figure 12 Schematic flowchart of the measurement method provided by an embodiment of the present application;

[0100] Figure 13 Schematic diagram of a scenario for the measurement method provided by an embodiment of the present application;

[0101] Figure 14 Schematic diagram of the structure of the device provided by an embodiment of the present application;

[0102] Figure 15 Schematic diagram of the structure of the chip system provided by an embodiment of the present application.

[0103] Specific implementation method

[0104] In some related solutions, various instruments can be used to measure human height, such as height and body fat scales, RGB cameras combined with marking points, etc.

[0105] The present application proposes a calibration calculation method for measuring human height using a depth camera (taking itof as an example here), which can be applied to multiple scenarios, such as smart home (door locks, etc.), security, vehicle-mounted, etc. Exemplarily, Figure 1 An example architecture of the system applicable to the embodiments of the present application is shown. The depth camera in the system is used to obtain the depth image of the user. Subsequently, based on the depth image and calibration parameters, the height of the user can be determined.

[0106] Optionally, the depth camera can be set independently, or as Figure 1 , the depth camera can be mounted on the first device.

[0107] In different scenarios, the first device can be devices of different forms. For example, in the smart home scenario, the first device can be a device equipped with a depth camera such as an air conditioner, a fan, etc. In the vehicle scenario, the first device can be a car door, a vehicle device, etc. In the security scenario, the first device can be a door lock, etc. The embodiments of the present application do not limit the form of the first device. As long as it is a device with a height measurement requirement or needs to obtain height measurement data, it can be used as the first device.

[0108] Optionally, the depth camera includes, but is not limited to, an itof (indirect time-of-flight) camera, a dtof (direct time-of-flight) camera, a monocular camera, a binocular camera, etc.

[0109] In the embodiments of the present application, the first device can determine the height of the user based on the depth image obtained by the depth camera, and intelligently execute a first operation associated with the height based on the height of the user. For example, taking the first device as a fan, the fan can adjust the rotation parameters of the fan (such as the blowing angle, which can be simply referred to as the wind direction angle) based on the height of the user. Another example is that taking the first device as a vehicle, the vehicle adjusts the parameters of the seat in the vehicle (such as, but not limited to, the pitch angle) based on the height of the passenger.

[0110] Optionally, the system may further include a control device. In some examples, the control device can turn on the height measurement function of the first device (such as a door lock). Optionally, the control device can be, but is not limited to, a mobile phone, a tablet, a panel, a watch, a vehicle display screen. Taking the control device as a mobile phone as an example, the mobile phone can provide a setting entry to turn on the height measurement function of the first device. For example, the mobile phone provides an interface, and the user can set through the interface to turn on the height measurement function of devices such as door locks.

[0111] In some examples, the first device (such as a door lock) can send the calculated height of the user to the control device (such as a mobile phone). In some examples, the control device can record the height of the user.

[0112] In some examples, the control device can control the first device to perform corresponding actions. For example, the mobile phone controls the fan to adjust the wind direction angle based on the height of the user.

[0113] Optionally, the system may further include a service device.

[0114] In some examples, the service device can calculate the height of the user. The service device can be, but is not limited to, a server, a central device. For example, the vehicle collects the depth image of the passenger through the depth camera, and sends the depth image to the server. The server calculates the height of the passenger and returns the height of the passenger to the vehicle.

[0115] In some examples, after the first device calculates the user's height, it can send the height information to the service device, and the service device can perform the first operation associated with the height or display the information associated with the height. For example, after receiving the height information, the service device learns that the user is a child, and then it can instruct the smart screen at home to enter the children's mode.

[0116] Optionally, the first device may further include one or more other functional modules. For example, Figure 1 , the first device may include a data storage module and a device function module. Among them, the data storage module is used to store information or instructions, such as storing the measured height. The device function module can be used to implement the steps related to the height measurement function.

[0117] Optionally, the first device may further include one or more other functional modules, such as a calibration module, which can be used to calibrate the spatial position of the depth camera on the first device, such as determining the installation height and installation inclination of the depth camera.

[0118] Exemplarily, the above one or more devices can be implemented by Figure 2 the devices in. Figure 2 The following shows a schematic diagram of the hardware structure of the device provided by the embodiment of the present application. The device includes at least one processor 501 and a memory 503. Optionally, the memory 503 may also be included in the processor 501.

[0119] The processor 501 can be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the solution of the present application.

[0120] The memory 503 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or may also be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM), or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media, or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory may exist independently and be connected to the processor through a communication line. The memory may also be integrated with the processor.

[0121] Among them, the memory 503 is used to store computer execution instructions for implementing the solution of this application, and is controlled and executed by the processor 501. The processor 501 is used to execute the computer execution instructions stored in the memory 503, so as to implement the method provided in the following embodiments of this application.

[0122] Optionally, the computer execution instructions in the embodiments of this application may also be referred to as application code, instructions, computer programs, or other names, and this application does not make specific limitations thereto.

[0123] In a specific implementation, as an embodiment, the processor 501 may include one or more CPUs, such as Figure 2 CPU0 and CPU1 in

[0124] In a specific implementation, as an embodiment, the electronic device may include multiple processors, such as Figure 2 the processor 501 and the processor 504 in

[0125] Optionally, the device may further include at least one communication interface 502. The communication interface 502 is used for communicating with other devices. In the embodiments of the present application, the communication interface may be a module, a circuit, a bus, an interface, a transceiver, or other devices capable of implementing communication functions, and is used for communicating with other devices. Optionally, when the communication interface is a transceiver, the transceiver may be an independently provided transmitter, which can be used to send information to other devices, or the transceiver may be an independently provided receiver, which is used to receive information from other devices. The transceiver may also be a component integrating the functions of sending and receiving information. The embodiments of the present application do not limit the specific implementation of the transceiver.

[0126] Optionally, if the device is the above-mentioned first device, then as Figure 2 , the device may further include a depth camera 505, which is used to obtain the depth image of the user.

[0127] It can be understood that Figure 2 the schematic structure does not constitute a specific limitation on the device. In other embodiments of the present application, the device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0128] The terms "first" and "second" in the specification and drawings of the present application are used to distinguish different objects or different processes for the same object. The words such as "first" and "second" can distinguish the same items or similar items with basically the same functions and roles. For example, the first device and the second device are only used to distinguish different devices, and do not limit their sequence. Those skilled in the art can understand that the words such as "first" and "second" do not limit the quantity and execution order, and the words such as "first" and "second" do not necessarily mean different.

[0129] "At least one" means one or more, and "a plurality" means two or more.

[0130] "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after. "At least one (item) of the following" or its similar expressions refer to any combination of these items, including any combination of single item (item) or plural items (items). For example, at least one (item) of a, b, or c can represent: a, b, c, a - b, a - c, b - c, or a - b - c, where a, b, c can be single or multiple.

[0131] In addition, the terms "including" and "having" and any variations thereof mentioned in the description of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally further include other unlisted steps or units, or may optionally further include other steps or units inherent to these processes, methods, products, or devices.

[0132] It should be noted that in the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0133] In the technical solutions of the embodiments of this application, the collection, storage, use, processing, transmission, provision, and disclosure of user personal information and other processing all comply with the provisions of relevant laws and regulations and do not violate public order and good customs. For example, in the technical solutions of the embodiments of this application, the acquisition and processing of the depth images of users are carried out under the authorization of the users. This is hereby uniformly stated and will not be repeated hereinafter.

[0134] The features, structures, or characteristics in the embodiments of this application can be combined in one or more embodiments in any suitable manner. In various embodiments of this application, the magnitude of the sequence numbers of each process does not mean the order of execution. The order of execution of each process should be determined by its function and internal logic and should not constitute any limitation to the implementation process of the embodiments of this application.

[0135] In this application, unless otherwise specified, the same or similar parts between various embodiments can be referred to each other. In each embodiment of this application, if there is no special specification and logical conflict, the terms and / or descriptions between different embodiments are consistent and can be mutually referred to. The technical features in different embodiments can be combined to form new embodiments according to their internal logical relationships. The embodiments of this application do not constitute a limitation to the protection scope of this application.

[0136] In addition, some steps in the method embodiments can be equivalently replaced with other possible steps. Or, some steps in the method embodiments can be optional and can be deleted in some usage scenarios. Or, other possible steps can be added to the method embodiments.

[0137] As follows, the technical solutions of the embodiments of this application will be introduced by scenarios.

[0138] Scenario 1: Smart home scenario

[0139] Taking the first device as an intelligent door lock as an example, a depth camera can be installed on the intelligent door lock. For example, Figure 3 when an entering person (such as a visitor or an owner) uses the face recognition function of the door lock to open the door, the door lock can collect the depth image of the entering person through the depth camera and calculate the height of the entering person based on the depth image.

[0140] Optionally, a color camera, such as an RGB camera, can also be set on the door lock. In some examples, Figure 3 the door lock can display the face image 301 collected by the RGB camera on the display screen, and at the same time, it can also display the calculated height 302 of the entering person on the display screen. In this way, it can automatically and intelligently measure the height of the user, reduce the operation complexity of the user manually measuring the height, and improve the user experience.

[0141] In some embodiments, each time the entering person opens the door, the door lock can calculate and record the height value of the entering person once, and combine the corresponding relationship between the face of the recognized entering person and the height value to store the height value corresponding to the entering person.

[0142] As a possible implementation, the height values recorded by the door lock can form the height curve of the entering person, such as the height growth curve of a child with age. In some examples, the door lock can display the height curve of the user on the display screen.

[0143] As a possible implementation, the door lock can record the height value locally, or store the door lock to other devices, such as storing it to a network attached storage (NAS). For example, Figure 4 the door lock can send the height value of the user to the mobile phone, and the mobile phone can present the height curve of the user.

[0144] In this scenario, the intelligent door lock can calculate and record the height value of the user according to the depth image obtained by the depth camera, improving the user experience.

[0145] Taking the first device as a fan as an example, a depth camera can be installed on the fan. In some examples, the fan collects the depth image of the fan user through the depth camera, calculates the height value of the user based on the depth image, and then adjusts the motion parameters of the fan (an example of the fourth device) according to the height value of the user to improve the user's home experience. The parameters that the fan can adjust include but are not limited to the wind direction angle, the pitch angle of the fan blades, etc. For example, Figure 5 in (a) of Figure 5As shown in (b), it can improve the user's comfort. It can be seen that in the home scenario, the first device can combine the user's height value and perform corresponding actions to improve the device usage performance in the home scenario and enhance the user's home experience.

[0146] It should be noted that the first device can also be other home appliances, such as an air conditioner. The embodiments of the present application do not limit the type and form of the first device.

[0147] In the home scenario, as mentioned above, the depth camera can be installed on the door lock, and the depth camera can calculate the height of the person entering the house. In the embodiments of the present application, the entry configuration suitable for the person entering the house can be performed based on the height of the person entering the house calculated by the door lock. Optionally, the door lock can execute the scenario associated with the person entering the house based on the height of the person entering the house (an example of the first user). For example, according to the height of the person entering the house calculated by the door lock, after the person enters the house, if using a fan or an air conditioner, the air outlet of the fan or the air conditioner can be adjusted based on the height of the person entering the house. Another example is that when the door lock recognizes that a child enters the house, if the child entering the house uses a smart screen, the smart screen can enter the child mode. Another example is that after the child enters the house, the lights enter the eye protection mode, and the gas or electrical appliances enter the high protection mode, etc.

[0148] As a possible implementation, the door lock can directly send an instruction to the device to be controlled. For example, after determining that the person entering the house is a child, the door lock can directly send an instruction (an example of the first instruction) to the smart screen (an example of the third device) to instruct the smart screen to enter the child mode.

[0149] Or, as some other possible implementations, the door lock can send an instruction to the device to be controlled through other devices (such as a central device). For example, the door lock sends a second instruction to the central device (an example of the second device), and the central device sends a corresponding instruction to the smart screen to control the smart screen to enter the child mode.

[0150] The above height measurement method can be but is not limited to applicable to visitors or homeowners. For example, for users who are permanent residents of the family and whose height no longer changes significantly (such as adult residents), the above height measurement function can be used when the door lock is first installed and used. Subsequently, the system can record the height of this user.

[0151] Taking the door lock instructing the corresponding device to execute the corresponding scenario as an example, in some other embodiments, it can also be other home appliances instructing the corresponding device to execute the corresponding scenario. For example, the central device calculates the user's height and instructs the corresponding home appliance to execute the corresponding scenario according to the user's height.

[0152] Exemplarily, Figure 5 (c) of this application gives an example of the architecture of the height measurement system of the embodiments of the present application. As Figure 5For (c) above, the system may include a data acquisition module, a calibration calculation module, and a function adjustment module. Optionally, the data acquisition module may be implemented as a depth camera. The calibration calculation module can be used to calibrate the parameters of the spatial position of the depth camera based on the depth images of user A with known height at two positions collected by the depth camera. It can also be used to calculate the height of user B with unknown height based on the depth image of user B collected by the depth camera and the parameters of the spatial position of the depth camera. Taking a depth camera mounted on a door lock as an example, the calibration calculation module can be a module set on the door lock. Taking a depth camera mounted on a fan as an example, the calibration calculation module can be a module set on the fan.

[0153] The function adjustment module can be used to indicate the adjustment of the function parameters of the first device or the corresponding device according to the height value calculated by the calibration calculation module. Taking a depth camera mounted on a door lock as an example, the function adjustment module can be a module set on the door lock. This module on the door lock instructs the home device to adjust the corresponding function parameters. For example, when detecting a child entering the house, it instructs the lights at home to be adjusted to the eye protection mode. Taking a depth camera mounted on a fan as an example, the function adjustment module can be a module set on the fan. This module on the fan instructs the fan to adjust the corresponding function parameters, such as adjusting the wind direction angle.

[0154] Alternatively, in order to implement the method of one or more embodiments of the present application, the system may also be other architectures, such as including more or fewer modules. Some modules in the system may be located in the same device or dispersed in different devices, and the embodiments of the present application do not make restrictions.

[0155] Scenario 2: Vehicle scenario

[0156] Taking the first device as a vehicle, a depth camera can be set on the vehicle. In some examples, as Figure 6 in (a) above, a depth camera is set on the outer frame of the car door. Before the user (such as the driver or passenger) gets on the car, the vehicle can collect the depth image of the user through the depth camera and measure the height of the user based on this depth image.

[0157] In some embodiments, the vehicle can intelligently and automatically adjust the parameters of the devices on the vehicle (examples of the fourth device) according to the measured value of the user's height. Optionally, the adjustable devices on the vehicle include but are not limited to seats and rearview mirrors. The parameters of the seat can be but are not limited to pose parameters. The pose parameters include but are not limited to at least one of the following: the front-back distance of the seat, the pitch angle. For example, the pitch angle of the seat is adjusted from Figure 6 shown in (b) above to as Figure 6 shown in (c) above. Another example is to adjust the front-back distance of the seat (such as the distance between the seat and the pedal). In this way, the comfort of the user after getting into the car can be better.

[0158] Compared with the related art where the driver or passenger manually adjusts the seat after getting in the vehicle, in the solution of the embodiment of the present application, on the one hand, it can intelligently and automatically adjust the parameters of in-vehicle devices according to the user's height, such as the parameters of the seat, reducing the complexity of adjusting device parameters. On the other hand, a depth camera is mounted outside the vehicle door, which can measure the user's height before getting in the vehicle and adjust the parameters of in-vehicle devices according to the height value, avoiding the interference to other passengers and potential driving safety risks caused by adjusting in-vehicle device parameters during vehicle driving.

[0159] For another example, as Figure 6 (d) shows, the vehicle can intelligently and automatically adjust the angle and height of the rearview mirror according to the height of the user (such as the driver) to achieve the best viewing angle for the driver.

[0160] For another example, a depth camera can be mounted on the outer frame of the vehicle door of a taxi of model A. Before the passenger (such as a passenger taking this model A vehicle for the first time) gets in the vehicle, the depth camera collects the depth image of the passenger. The vehicle controller can calculate the height of the passenger based on this depth image and in combination with the method of the embodiment of the present application, and adjust the seat parameters according to the height of this passenger to improve the comfort of the passenger during the ride. Since the depth image only includes the contour of the passenger and does not contain sensitive information that can identify the specific identity of the passenger, therefore, using this method will not cause the leakage of the passenger's personal identity information.

[0161] Exemplarily, Figure 7 Another example of the architecture of the height measurement system according to the embodiment of the present application is given. As Figure 7 shown, the system may include a data acquisition module, a calibration calculation module, a pose evaluation module, and a seat adjustment module. For the introduction of the data acquisition module and the calibration calculation module, reference can be made to the relevant introduction corresponding to (c) in, for example, Figure 5 and will not be elaborated here.

[0162] The pose evaluation module can be used to evaluate the seat pose most suitable for this height according to the height value calculated by the calibration calculation module. Taking the depth camera mounted on the outer frame of the vehicle door as an example, the calibration calculation module, the pose evaluation module, and the seat adjustment module can be modules set in the vehicle (such as but not limited to in-vehicle devices). The seat adjustment module can be used to adjust the seat according to the seat pose calculated by the pose evaluation module to improve the comfort of the passenger during the ride.

[0163] Scenario three: Security scenario

[0164] To a certain extent, the height value can reflect the age of the person to be measured. The first device can determine whether the user is a child (or toddler) according to the user's height value and trigger the execution of the security scenario accordingly.

[0165] For example, still taking the first device as a door lock, the door lock can calculate the height value of the user through the method of the embodiment of the present application. AsFigure 8A When the door lock detects that a family member with a height value lower than the threshold (such as family member A) leaves home alone, the door lock can send a reminder message to the terminals (such as mobile phones) of other family members. After receiving the reminder message, the terminal (an example of the fifth device) can display a warning prompt window 801. The family member can operate the prompt window 801 to trigger the terminal to display the detailed warning information, such as the time when family member A leaves home, and the relevant images or videos when family member A leaves home.

[0166] In some embodiments, other first conditions can also be set, and the independent leaving home of other family members can be detected. For example, detecting that an elderly person with mobility difficulties leaves home alone triggers an alarm.

[0167] The solution of the embodiment of the present application enables security warnings for scenarios where a user with a height lower than the threshold (such as a toddler) leaves home alone by calculating the height value of the user, achieving a security prevention effect.

[0168] Taking the first device controlling itself to perform corresponding actions according to the user's height as an example above, in some other embodiments, other devices can also control the first device to perform corresponding actions.

[0169] For example, the mobile phone can provide an interface 802 as shown in Figure 8B . The interface 802 includes a fan card, and a switch 803 is presented in the fan card. In response to the user opening the switch 803, the mobile phone can enable the intelligent adjustment parameter function of the fan (which can be abbreviated as the intelligent parameter adjustment function). After enabling the intelligent parameter adjustment function, the fan can adjust parameters such as the wind direction angle according to the user's height.

[0170] Again, the mobile phone can provide a similar interface, and this interface can be set to enable the intelligent parameter adjustment function of one or more other first devices (such as a vehicle seat).

[0171] Again, as shown in Figure 8B , the interface 802 can also include wind direction angle, pitch angle, and fan blade height control 804, which can be used to correspondingly adjust the corresponding parameters of the fan. For example, in response to the user clicking on the fan blade height control 804, the mobile phone can send an instruction to the fan. Based on this instruction and combined with the user's height determined by the above method, the fan adjusts the fan blade height.

[0172] In one or more embodiments of the present application, the spatial position of the depth camera installation needs to be determined in combination with the convenience of use. For example, depth cameras are respectively mounted on the outer frames of each car door so that the depth cameras can collect depth images of each user as accurately as possible.

[0173] The above mainly takes the home, security, and vehicle scenarios as examples. The solution of the embodiments of the present application can also be applied to other scenarios that require automatic indication of equipment to perform corresponding operations according to height. For example, in an office scenario, a depth camera can be mounted on office equipment, and the depth image of the user is collected, and the height of the user is automatically calculated based on the depth image. The computer intelligently and automatically adjusts the height of the computer display screen according to the user's height. The seat intelligently adjusts the height and pitch angle of the seat according to the user's height.

[0174] As follows, the method flow of the embodiments of the present application will be introduced.

[0175] First, before measuring the height of user B using a depth camera, it is necessary to determine the parameters of the depth camera. Figure 9 An example process of a method for determining the parameters of the depth camera is shown. As Figure 9 shown, this method includes the following steps:

[0176] S101. The first device obtains depth image A of user A at position A and depth image B of user A at position B through a depth camera.

[0177] Exemplarily, the first device includes but is not limited to a door lock, a vehicle.

[0178] User A (an example of the second user) is a human body whose accurate height is known. For example, when user A stands at position A as Figure 10 shown, the first device collects depth image A of user A through a depth camera. When user A stands at position B as Figure 10 shown, the first device collects depth image B of user A through a depth camera. Positions A and B are within the imaging range of the depth camera (for example, but not limited to 40 - 70 cm).

[0179] The depth image collected by the depth camera can be an upper body image or a full body image of the user, and the depth image needs to contain the main point of the user and the information above the main point. The concept of the main point will be given later.

[0180] S102. The first device determines the parameters of the depth camera according to depth image A and depth image B.

[0181] The parameters of the depth camera can be parameters for characterizing the spatial position of the depth camera. Optionally, the parameters of the depth camera include at least one of the following: the height of the depth camera, the rotation angle (or installation inclination angle) of the depth camera. The installation inclination angle of the depth camera can be understood as the angle between the photosensitive surface in the depth camera and the plumb line, and the plumb line is a line perpendicular to the horizontal plane. The photosensitive surface can be understood as the surface where the photosensitive element (such as CMOS, etc.) is located. The height of the depth camera can refer to the depth camera in Figure 11The height h in the Z direction in the shown coordinate system, such as the height h of the geometric center of the depth camera in the Z direction; and the installation inclination angle of the depth camera can refer to the rotation angle φ of the depth camera around the Y axis in this coordinate system.

[0182] Considering that the depth image collected by the depth camera contains the depth information of the object, the embodiments of the present application can use this depth information to calculate the parameters of the depth camera. As a possible implementation manner, after the first device collects the depth image A and the depth image B of user A, it can convert the corresponding points on the body of user A into the space coordinate system according to the depth image A and the depth image B, such as converting into the coordinate system as shown in Figure 11 the shown coordinate system. As shown in Figure 10 , in the space coordinate system, point p1 is the highest point of user A (such as the vertex of the head) when user A is at position A, and the coordinates of p1 are (x1, y1, z1); point p1' is the highest point of user A (the highest point of the height) when the user is at position B, and the coordinates of p1' are (x1', y1', z1'); point p2 is the position of the main point on the body of user A when user A is at position A, and the coordinates of p2 are (x2, y2, z2); point p2' is the position of the main point on the body of user A when user A is at position B, and the coordinates of p2' are (x2', y2', z2').

[0183] Among them, the emitted light at the main point on the user's body surface is perpendicular to the photosensitive surface of the depth camera.

[0184] As shown in Figure 10 , the angle between the light at the main point position and the Y axis is φ, and this angle is the same as the inclination angle of the photosensitive surface of the depth camera. As shown in Figure 10 , the angle between the light on the body of user A at the main point p2 and the Y axis is φ.

[0185] As shown in Figure 10 , H1 is the height of user A; h1 is the height of the main point when user A is at position A; h1' is the height of the main point when user A is at position B; h2 is the height between the main point and the top p1 of the person when user A is at position A; h2' is the height between the main point and the top p1' of the person when user A is at position B; h is the installation height of the depth camera; is the installation inclination angle of the depth camera; d1 represents the distance between the main point p2 and the depth camera, and can also be understood as the depth value of the main point p2 relative to the depth camera; d2 represents the distance between the main point p2' and the depth camera, and can also be understood as the depth value of the main point p2' relative to the depth camera. Exemplarily, d1 can be obtained according to the coordinates of the main point p2 and the coordinates of the depth camera, and d2 can be obtained according to the coordinates of the main point p2' and the coordinates of the depth camera. Among them, and h are the parameters to be measured of the depth camera.

[0186] As shown in Figure 10, according to the geometric relationship, the above parameters satisfy the following relationship:

[0187] H1=h1+h2 (Formula 1)

[0188] H1=h1′+h2′ (Formula 2)

[0189]

[0190]

[0191] like Figure 11 In the coordinate system shown, if the coordinates of a point are (x, y, z), then its rotation angle around the Y axis is After that, the transformed coordinates (x', y', z') satisfy the following relationship:

[0192]

[0193] From formula 5, we can get that h2 and h2′ satisfy the following relationship:

[0194]

[0195]

[0196] Combining the above formulas, we can get:

[0197]

[0198]

[0199] In formula 8 and formula 9, d1, x2, x1, d2, x1′, x2′, z1′, z2′, z1, z2 are all known quantities. By combining formula 8 and formula 9, the unknown quantities can be obtained. and In this way, the installation angle of the depth camera can be calculated Will and Substitute h2 and h2′ into Formula 6 and Formula 7 respectively. Substitute h2 and h2′ into Formula 1 and Formula 2, and combine Formula 1, Formula 2, Formula 3 and Formula 4 to obtain the installation height h of the depth camera.

[0200] For example, the first device is a door lock, which is equipped with an itof camera. User A, whose exact height is known, stands at two positions facing the itof camera on the door lock. The itof camera collects depth maps corresponding to the two positions. The door lock can calculate the parameters of the spatial position of the itof camera (i.e., the above-mentioned depth map) according to the two depth maps collected by the itof camera and the calculation process such as the above-mentioned process. and h) for calibration.

[0201] For another example, taking the first device as a vehicle, an itof camera is mounted on the outer side of the vehicle door. User A with a known height stands at two positions facing the itof camera respectively, and the itof camera acquires depth maps corresponding to the two positions respectively. The vehicle can calibrate the parameters of the spatial position of the itof camera according to the two depth maps acquired by the itof camera.

[0202] For another example, taking the first device as a fan, an itof camera is mounted on the fan, and the fan can calibrate the parameters of the spatial position of the itof camera according to the above parameter calibration method.

[0203] The solution of the embodiment of the present application can complete the calibration of the spatial position of the depth camera based on the depth maps of user A with a known height at different positions, so as to be used as the parameter basis for subsequent height measurement, and can improve the accuracy of height measurement. Moreover, in this solution, by calculating the height above the principal point and the height below the principal point of the user with a known height respectively, the internal parameters of the camera are calibrated, and there is no need to construct a minimization problem to solve the parameters of the camera, which can reduce the computational complexity.

[0204] Calculate the installation angle of the depth camera After obtaining the installation height h, the first device can measure the height of user B with an unknown height. The following introduces the height measurement process. Figure 12 An example flow of the height measurement method is shown. As Figure 12 , the method may include the following steps:

[0205] S201. The first device acquires the depth image C of user B through the depth camera.

[0206] For example, user B stands upright directly opposite the depth camera of the first device, and the depth camera acquires the depth image C of user B.

[0207] Optionally, the first device may process the depth image C using an algorithm. The processing includes but is not limited to filtering and noise reduction. The algorithms that the first device can use include but are not limited to median filtering and Gaussian filtering.

[0208] The depth image acquired by the depth camera can be an upper body image or a full body image of the user, and the depth image needs to contain the principal point of the user and the information above the principal point.

[0209] S202. The first device determines the height of user B according to the depth image C and the parameters of the depth camera.

[0210] As Figure 13 , the first device detects the pixel coordinates of the highest point A of the head of user B and the principal point B in the depth image C according to the depth image C of user B, and converts the point A of the head and the principal point B into a three-dimensional space coordinate system. AsFigure 13 , the point p3 in the spatial coordinate system corresponds to the point at the top of user B's head, and the coordinates of point p3 are (x3, y3, z3). p4 corresponds to the main point of user B, and the coordinates of point p4 are (x4, y4, z4).

[0211] As a possible implementation, the first device uses an edge detection algorithm to detect the point A at the highest point of the user's head in the depth image C. The edge detection algorithm includes but is not limited to canny or sobel.

[0212] As a possible implementation, the first device determines the height of the human body above the main point according to the position of the highest point of the human head, the position of the main point, and the installation inclination angle of the depth camera. For example, Figure 13 bringing the coordinates of the vertex p3 at the highest point of the human head as shown, the main point p4, and the installation inclination angle of the depth camera into the above formula 6, the height h4 of the human body above the main point p4 (the height between the main point p4 and the vertex p3) can be obtained:

[0213] As a possible implementation, the first device determines the height of the human body above the main point according to the depth value at the main point of the human body, the installation inclination angle of the depth camera, and the installation height. For example, Figure 13 bringing the depth value d at the main point p4 as shown, the installation inclination angle of the depth camera and the installation height h into the above formula 3, the height h3 of the human body below the main point p4 can be obtained:

[0214] For example Figure 13 , the height value H2 of user A satisfies the following relationship: H2 = h4 + h3. Substituting the values of h4 and h3 into this formula, the height value of user A can be obtained.

[0215] Taking the first device as a fan as an example, in the state where the fan is not started, user B stands in front of the itof camera set on the fan, and the itof camera captures and collects the depth image C of user B. The fan calculates the height value of user B according to this depth image C using the above height calculation method.

[0216] Taking the first device as a vehicle as an example, before user B gets in the car, user B stands in front of the itof camera set on the outer frame of the car door, and the itof camera collects the depth image C of user B. The vehicle can calculate the height of user B according to this depth image C.

[0217] The solution of the embodiment of the present application divides the height of the human body into two parts, above and below the main point, through the position of the main point, and calculates the height values above and below the main point respectively. Finally, the height of the human body is determined according to these two height values.

[0218] After determining the height of User B, such as Figure 12 , the first device may execute S203: According to the height of User B, instruct the second device associated with User B to perform corresponding operations. The second device associated with the first user is the first device or a device other than the first device. Taking the first device as a fan as an example, the fan can calculate the optimal pitch angle of the fan according to the height value of the user and automatically adjust to this pitch angle for operation.

[0219] Taking the first device as a vehicle as an example, the vehicle calculates seat parameters more suitable for the passenger according to the height value of the passenger and automatically adjusts the seat parameters through the intelligent system in the vehicle. In some examples, the seat parameter adjustment can be performed before the passenger gets on the vehicle to avoid safety problems caused by adjusting the seat parameters during driving.

[0220] In some embodiments, the first device may also combine the height of User B and other features of User B (such as but not limited to body shape, face) to instruct the second device associated with User B to perform corresponding operations. For example, the vehicle controller adjusts the seat parameters according to the height and body fatness of User B to improve the riding comfort of User B.

[0221] In the method of the embodiments of the present application, the first device can intelligently and automatically instruct the second device associated with the user to perform corresponding operations, such as adjusting to device parameters matching the user's height, which can better adapt to the personalization of the user, improve the performance of the device, and thus improve the user experience.

[0222] In addition, since the depth image only includes the contour of the user and does not contain sensitive information that can identify the specific identity of the user, using this method will not cause the leakage of the user's personal identity information.

[0223] Taking calculating the user's height according to the depth image as an example above, in some other embodiments, other physiological parameters of the user, such as body fatness, can also be calculated using the depth image. For example, after calculating the user's height, the body fatness of the user is obtained by conversion according to the relationship between the user's height and body fatness. Another example is to directly calculate the body fatness of the user based on the depth value representing the body fatness in the depth image.

[0224] It should be noted that the above-mentioned multiple embodiments can be combined and the combined solution can be implemented. Optionally, some operations in the processes of the method embodiments are optionally combined, and / or the order of some operations is optionally changed. Moreover, the execution order between the steps of each process is only exemplary and does not constitute a limitation on the execution order between the steps. The steps can also be in other execution orders. It is not intended to indicate that the execution order is the only order in which these operations can be performed. Those of ordinary skill in the art will think of various ways to reorder the operations herein. Additionally, it should be pointed out that the process details involved in a certain embodiment herein also apply to other embodiments in a similar manner, or different embodiments can be used in combination.

[0225] In addition, some steps in the method embodiments can be equivalently replaced with other possible steps. Or, some steps in the method embodiments can be optional and can be deleted in certain usage scenarios. Or, other possible steps can be added to the method embodiments. Or, the execution subject (such as a functional module) of some steps in the method embodiments can be replaced with other execution subjects.

[0226] Moreover, the above-mentioned method embodiments can be implemented independently or in combination.

[0227] Some other embodiments of the present application provide a device, which can be the above-mentioned first device, second device, etc. The device may include: a display screen, a memory, and one or more processors. The display screen, memory, and processor are coupled. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the device can perform each function or step in the above method embodiments. The structure of the device can refer to Figure 2 the electronic device (device) shown.

[0228] Among them, the core structure of the device can be represented as Figure 14 the structure shown. The device includes: a processing module 2301, a storage module 2303, and a display module 2304.

[0229] The processing module 2301 may include at least one of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processing module 2301 can perform operations or data processing related to the control and / or communication with at least one of the other components of the user electronic device. Specifically, the processing module 2301 can be used to control the content displayed on the main screen according to certain trigger conditions. The processing module 2301 is also used to process the input instructions or data and determine the display style according to the processed data.

[0230] Optionally, an input module 2302 may also be included, which is configured to obtain instructions or data input by a user and transmit the obtained instructions or data to other modules of the electronic device. Specifically, the input methods of the input module 2302 may include touch, gesture, proximity to the screen, etc., or may also be voice input. For example, the input module may be the screen of the electronic device, which obtains the input operation of the user and generates an input signal according to the obtained input operation, and transmits the input signal to the processing module 2301.

[0231] The storage module 2303 may include a volatile memory and / or a non-volatile memory. The storage module is used to store instructions or data related to at least one of the other modules of the user device.

[0232] The display module 2304 may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical system (MEMS) display, or an electronic paper display. It is used to display content viewable by the user (such as text, images, videos, icons, symbols, etc.).

[0233] Optionally, a communication module 2305 is further included, which is used to support the communication of the personal device (through a communication network) with other personal devices. For example, the communication module may be connected to a network via wireless communication or wired communication to communicate with other personal devices or network servers. The wireless communication may adopt at least one of the cellular communication protocols, such as Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Universal Mobile Telecommunications System (UMTS), Wireless Broadband (WiBro), or Global System for Mobile Communications (GSM). The wireless communication may include, for example, short-range communication. The short-range communication may include at least one of Wireless Fidelity (Wi-Fi), Bluetooth, Near Field Communication (NFC), Magnetic Stripe Transmission (MST), or Global Navigation Satellite System (GNSS).

[0234] If the device is the above-mentioned first device, the device may further include a camera module (not shown in the figure), such as a depth camera.

[0235] It should be noted that each functional module of the device may execute one or more steps in the above method embodiments.

[0236] The embodiment of the present application also provides a chip system, such as Figure 15As shown, the chip system includes at least one processor 1401 and at least one interface circuit 1402. The processor 1401 and the interface circuit 1402 can be interconnected by a line. For example, the interface circuit 1402 can be used to receive signals from other devices (such as the memory of an electronic device). For another example, the interface circuit 1402 can be used to send signals to other devices (such as the processor 1401). Exemplarily, the interface circuit 1402 can read the instructions stored in the memory and send the instructions to the processor 1401. When the instructions are executed by the processor 1401, the electronic device can execute each step in the above embodiments. Of course, the chip system can also include other discrete devices, and the embodiments of the present application do not make specific limitations on this.

[0237] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions run on the above electronic device, the electronic device is enabled to execute each function or step in the above method embodiment.

[0238] An embodiment of the present application also provides a computer program product. When the computer program product runs on a computer, the computer is enabled to execute each function or step that the mobile phone executes in the above method embodiment.

[0239] Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and conciseness of description, only the above division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0240] In several embodiments provided by the present application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical, mechanical or other form.

[0241] The units described as separate components may or may not be physically separated. The components displayed as units may be one physical unit or multiple physical units, that is, they can be located in one place, or they can be distributed to multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0242] In addition, in each embodiment of the present application, each functional unit can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0243] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. The software product is stored in a storage medium and includes several instructions for causing a device (which can be a single-chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the methods in the embodiments of the present application. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical discs that can store program codes.

[0244] The above content is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method for measuring physiological parameters, characterized in that, Applied to a first device, the method includes: Obtain a depth image of a first user; Determine physiological parameter information of the first user according to the depth image of the first user; Perform a first operation associated with the physiological parameter information, or display information associated with the physiological parameter information; or, send the physiological parameter information to a second device associated with the first user.

2. The method according to claim 1, characterized in that, The first device includes a whole-house intelligent device.

3. The method according to claim 1 or 2, characterized in that, The performing the first operation associated with the physiological parameter information includes: Send a first instruction to a third device, where the first instruction is used to instruct the third device to execute a scenario associated with the first user.

4. The method according to claim 1 or 2, characterized in that, It further includes: Send a second instruction to the second device, where the second instruction is used to instruct the third device to execute a scenario associated with the first user.

5. The method according to any one of claims 1-4, characterized in that, The displaying the information associated with the physiological parameter information includes: Display the physiological parameter information of the first user, or display a parameter curve generated according to the physiological parameter information.

6. The method according to any one of claims 1-5, characterized in that, The performing the first operation associated with the physiological parameter information includes: Send a warning message to a fifth device, where the warning message is used to prompt that the first user leaves home alone, and the physiological parameter information and / or identity of the first user meet a first condition; The first condition includes at least one of the following conditions: the first user is a child, and the height of the first user is lower than a threshold.

7. The method according to any one of claims 1-6, characterized in that, The obtaining the depth image of the first user includes: Collect the depth image of the first user through a depth camera.

8. The method according to any one of claims 1-7, characterized in that, It further includes: Collect the depth image of a second user at a first position and the depth image at a second position; The physiological parameter information of the second user is known; the depth image of the second user at the first position and the depth image at the second position are used to determine the spatial position of the depth camera; the spatial position includes at least one of the following: the installation height of the depth camera, the installation inclination angle of the depth camera.

9. The method according to claim 8, characterized in that, The determining the physiological parameter information of the first user according to the depth image of the first user includes: Determine the physiological parameter information of the first user according to the depth image of the first user and the spatial position of the depth camera.

10. The method according to claim 2, characterized in that, The whole-house intelligent device includes a door lock.

11. The method according to any one of claims 1-10, characterized in that, The physiological parameter information includes height and degree of fatness.

12. A physiological parameter measurement system, characterized in that, It includes: A first device for obtaining a depth image of a first user; The first device is further used to determine the physiological parameter information of the first user according to the depth image of the first user; The first device is further used to send the physiological parameter information to a second device associated with the first user; The second device is used to perform a first operation associated with the physiological parameter information or display information associated with the physiological parameter information after receiving the physiological parameter information.

13. The system according to claim 12, wherein, The second device is used to perform the first operation associated with the physiological parameter information, including: Send an instruction to a third device, where the instruction is used to instruct the third device to execute a scenario associated with the first user.

14. The system according to claim 12 or 13, wherein, The second device is used to perform the first operation associated with the physiological parameter information, including: Determine the device parameters of the fourth device, and the determined device parameters match the physiological parameter information.

15. The system according to any one of claims 12 - 14, wherein, The second device is configured to display information associated with the physiological parameter information, including: Display the physiological parameter information of the first user, or display a parameter curve generated based on the physiological parameter information.

16. The system according to any one of claims 12 - 15, wherein, The second device is configured to perform a first operation associated with the physiological parameter information, including: Send a warning message to a fifth device, where the warning message is used to prompt that the first user leaves home alone, and the physiological parameter information and / or identity of the first user meet a first condition; The first condition includes at least one of the following conditions: the first user is a child, and the height of the first user is lower than a threshold.

17. The system according to any one of claims 12 - 16, wherein, The first device includes a whole-house intelligent device.

18. The system according to any one of claims 12 - 17, wherein, The first device includes a vehicle or in-vehicle device.

19. The system according to any one of claims 12 - 18, wherein, The first device is provided with a depth camera; The first device is configured to obtain a depth image of a first user, including: Collect the depth image through the depth camera.

20. The system according to claim 19, wherein, The first device is further configured to: Collect a depth image of a second user at a first position and a depth image at a second position through the depth camera; the physiological parameter information of the second user is known; the depth image of the second user at the first position and the depth image at the second position are used to determine the spatial position of the depth camera; the spatial position includes at least one of the following: the installation height of the depth camera, the installation inclination angle of the depth camera.

21. The system according to claim 20, wherein, The first device is configured to determine the physiological parameter information of the first user based on the depth image of the first user, including: Determine the physiological parameter information of the first user based on the depth image of the first user and the spatial position of the depth camera.

22. The system according to claim 17, wherein, The whole-house intelligent device includes a door lock and home appliances.

23. The system according to claim 14, wherein, The fourth device includes: a seat, a rearview mirror; the device parameters of the seat include at least one of the following: front-back distance, pitch angle; the device parameters of the rearview mirror include at least one of the following: angle, height; And / or the fourth device includes a heating and cooling air supply device, and the heating and cooling air supply device includes at least one of the following: an air conditioner, a fan; the device parameters of the heating and cooling air supply device include the blowing angle, the pitch angle of the fan blade, and the height of the fan blade.

24. The system according to any one of claims 12 - 23, wherein, The physiological parameter information includes height and body fatness.

25. An electronic device, wherein, The electronic device includes a processor and a memory; The memory is used to store computer execution instructions. When the electronic device runs, the processor executes the computer execution instructions stored in the memory, so that the electronic device executes the method according to any one of claims 1-11.

26. A computer-readable storage medium, wherein, Includes a program or instruction, and when the program or instruction is executed, the method according to any one of claims 1-11 is implemented.

Images