Image generation method, image generation device, medium and electronic equipment
By using millimeter wave devices to acquire user posture data in electronic devices, a more realistic and accurate user portrait is generated, and the problem of single information acquisition and low accuracy in the prior art is solved, and high-accuracy portrait generation is achieved.
Patent Information
- Application Number
- CN202010807918.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-08-12
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2040-11-15
AI Technical Summary
When generating user portraits, the information acquisition source is single and cannot represent the user's real state, resulting in low accuracy and lack of objectivity and depth of generated portrait information.
By transmitting millimeter wave signals using a millimeter wave device in an electronic device, echo data is obtained to determine the posture data of the sensing object, and based on this, image generation is realized based on the actual behavioral habits of the user.
It improves the accuracy and credibility of portrait information, simplifies user operation processes, and does not require users to actively enter information or interact with devices, and has a wide range of applications.
Smart Images

Figure CN112000561B_ABST
Abstract
Description
Background Art
[0002] With the increasing popularity and application of the Internet in various industries, companies in e-commerce, Internet finance, life services, games and other fields are committed to collecting and analyzing users' static attributes, social attributes, behavioral attributes and other information data through the Internet to abstract portrait information, thereby exploring user needs and providing users with more targeted products or services.
[0003] The existing technology usually obtains a large amount of commonly used information of users, such as the applications that users often use and the media information that they often browse, through devices such as smart phones or smart speakers, to determine the habits of users and generate portrait information. However, in this way, the information used to generate portrait information often needs to be obtained through interaction between users and devices. In some cases, the information obtained may not represent the real status of the user, resulting in the generated portrait information being one-sided and lacking objectivity. In addition, the source of information acquisition is relatively single, and it is impossible to explore the changing rules of the user's own status, resulting in the generated portrait information being too superficial and having low accuracy. Summary of the invention
[0004] The present disclosure provides a portrait generation method, a portrait generation device, a computer-readable storage medium and an electronic device, thereby improving the problem of low portrait generation accuracy in existing portrait generation methods at least to a certain extent.
[0005] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.
[0006] According to a first aspect of the present disclosure, there is provided a portrait generation method, which is applied to an electronic device equipped with a millimeter wave device, the method comprising: controlling the millimeter wave device to transmit a millimeter wave signal and acquiring echo data of the millimeter wave signal; determining posture data of a sensing object according to the echo data; and generating portrait information of the sensing object based on the posture data.
[0007] According to a second aspect of the present disclosure, there is provided a portrait generation method, which is applied to a first end, wherein the first end is provided with a millimeter wave device, and the method comprises: controlling the millimeter wave device to transmit a millimeter wave signal and acquiring echo data of the millimeter wave signal; determining posture data of a sensing object according to the echo data; and sending the posture data to a second end, so that the second end generates portrait information of the sensing object based on the posture data.
[0008] According to a third aspect of the present disclosure, there is provided a portrait generating device, which is applied to an electronic device equipped with a millimeter wave device, and the device comprises: an echo data acquisition module, which is used to control the millimeter wave device to transmit a millimeter wave signal and obtain echo data of the millimeter wave signal; a posture data acquisition module, which is used to determine the posture data of a sensing object according to the echo data; and a portrait information generating module, which is used to generate portrait information of the sensing object based on the posture data.
[0009] According to a fourth aspect of the present disclosure, there is provided a portrait generating device, which is applied to a first end, wherein the first end is provided with a millimeter wave device, and the device comprises: an echo data acquisition module, which is used to control the millimeter wave device to transmit a millimeter wave signal and obtain echo data of the millimeter wave signal; a posture data acquisition module, which is used to determine the posture data of a sensing object according to the echo data; and a portrait information generating module, which is used to generate portrait information of the sensing object based on the posture data.
[0010] According to a fifth aspect of the present disclosure, there is provided a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the above-mentioned portrait generation method when executed by a processor.
[0011] According to a sixth aspect of the present disclosure, there is provided an electronic device, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the above-mentioned portrait generation method by executing the executable instructions.
[0012] The technical solution disclosed in this disclosure has the following beneficial effects:
[0013] According to the above-mentioned portrait generation method, portrait generation device, computer-readable storage medium and electronic device, they are applied to electronic devices equipped with millimeter wave devices, by controlling the millimeter wave device to transmit millimeter wave signals and obtaining echo data of the millimeter wave signals; determining the posture data of the sensing object according to the echo data; and generating portrait information of the sensing object based on the posture data. On the one hand, this exemplary embodiment proposes a new portrait generation method, which is different from the method of generating portraits by collecting common information of sensing objects in the prior art. This exemplary embodiment can collect the posture data of the sensing object through the millimeter wave device to establish portrait information, that is, it can generate more realistic portrait information based on the actual behavioral habits of the sensing object. The established portrait has high accuracy and credibility, and has a wide range of applications. On the other hand, the process of determining the posture data of the sensing object and establishing the portrait information through the millimeter wave device does not require the sensing object to actively enter information or other interactive operations with the electronic device, which simplifies the operation process of the sensing object.
[0014] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.
[0016] Figure 1 A schematic diagram showing a system architecture of this exemplary embodiment;
[0017] Figure 2 A schematic diagram showing an electronic device according to the present exemplary embodiment;
[0018] Figure 3 A flowchart showing a method for generating a portrait according to the exemplary embodiment;
[0019] Figure 4 A sub-flow chart showing a method for generating a portrait according to the exemplary embodiment;
[0020] Figure 5 A sub-flow chart showing another method for generating a portrait according to the exemplary embodiment;
[0021] Figure 6 A sub-flow chart showing another method for generating a portrait according to the exemplary embodiment;
[0022] Figure 7 A flowchart showing another method for generating a portrait according to this exemplary embodiment;
[0023] Figure 8 A schematic diagram showing another system architecture of this exemplary embodiment;
[0024] Fig. 9 A structural block diagram showing a portrait generating device according to the exemplary embodiment;
[0025] Fig.10 A block diagram showing the structure of another image generating device according to this exemplary embodiment. DETAILED DESCRIPTION
[0026] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be more comprehensive and complete, and the concepts of the example embodiments are fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.
[0027] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.
[0028] Figure 1 FIG. 1 is a schematic diagram showing a system architecture of an exemplary embodiment of the present disclosure. Figure 1 As shown, the system architecture 100 may include: an electronic device 110 and a sensing object 120. The electronic device 110 may be any terminal with a millimeter wave device, such as a wireless access terminal, a smart phone, a smart speaker, or a Kinect, etc. The sensing object 120 may be any user, or other objects with posture changes, such as animals, etc. The electronic device 110 may send a millimeter wave signal to the surrounding environment through the millimeter wave device, determine the posture data of the sensing object 120 according to the received echo data, and generate the portrait information of the sensing object 120 based on the posture data. It should be understood that Figure 1 The number of electronic devices 110 and sensing objects 120 in the embodiment is only for illustration. Any number of electronic devices and sensing objects may be provided according to implementation requirements.
[0029] An exemplary embodiment of the present disclosure provides an electronic device for implementing a method for generating a portrait, which may be Figure 1 The electronic device 110 in the embodiment includes at least a processor and a memory, the memory is used to store executable instructions of the processor, and the processor is configured to execute the image generation method by executing the executable instructions.
[0030] Electronic devices can be implemented in various forms, for example, they can include mobile devices such as mobile phones, tablet computers, laptops, personal digital assistants (PDAs), navigation devices, wearable devices, drones, and fixed devices such as desktop computers and smart TVs.
[0031] Below Figure 2 Taking the mobile terminal 200 in FIG. 1 as an example, the structure of the electronic device is exemplarily described. It should be understood by those skilled in the art that, in addition to the components specifically used for mobile purposes, Figure 2 The structure in the figure can also be applied to fixed type devices. In other embodiments, the mobile terminal 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware. The interface connection relationship between the components is only shown schematically and does not constitute a structural limitation of the mobile terminal 200. In other embodiments, the mobile terminal 200 may also adopt the same Figure 2 Different interface connection methods, or a combination of multiple interface connection methods.
[0032] like Figure 2 As shown, the mobile terminal 200 may specifically include: a processor 210, an internal memory 221, an external memory interface 222, a USB interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 271, a receiver 272, a microphone 273, an earphone interface 274, a sensor module 280, a display screen 290, a camera module 291, an indicator 292, a motor 293, a button 294 and a subscriber identification module (Subscriber Identification Module, SIM) card interface 295, etc.
[0033] The processor 210 may include one or more processing units, for example: the processor 210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, an encoder, a decoder, a digital signal processor (DSP), a baseband processor and / or a neural network processor (NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. The encoder can encode (i.e., compress) the image or video data to form a code stream data; the decoder can decode (i.e., decompress) the code stream data of the image or video to restore the image or video data.
[0034] In some embodiments, the processor 210 may include one or more interfaces. The interface may include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General-Purpose Input / Output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and / or a Universal Serial Bus (USB) interface, etc. Connections are formed with other components of the mobile terminal 200 through different interfaces.
[0035] The USB interface 230 is an interface that complies with the USB standard specification, and specifically can be a MiniUSB interface, a MicroUSB interface, a USB Type C interface, etc. The USB interface 230 can be used to connect a charger to charge the mobile terminal 200, can also be connected to headphones to play audio through the headphones, and can also be used to connect the mobile terminal 200 to other electronic devices, such as computers, peripheral devices, etc.
[0036] The charging management module 240 is used to receive charging input from a charger. While the charging management module 240 is charging the battery 242 , it can also power the device through the power management module 241 .
[0037] The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240, supplies power to various parts of the mobile terminal 200, and can also be used to monitor the status of the battery.
[0038] The wireless communication function of the mobile terminal 200 can be implemented through the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor, the baseband processor, and the like.
[0039] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the mobile terminal 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the mobile terminal 200.
[0040] The wireless communication module 260 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the mobile terminal 200. The wireless communication module 260 can be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and filters it, and sends the processed signal to the processor 210. The wireless communication module 260 can also receive the signal to be sent from the processor 210, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0041] In some embodiments, the antenna 1 of the mobile terminal 200 is coupled to the mobile communication module 250, and the antenna 2 is coupled to the wireless communication module 260, so that the mobile terminal 200 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division-Synchronous Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), New Radio (NR), BT, GNSS, WLAN, NFC, FM, and / or IR technology.
[0042] The mobile terminal 200 implements the display function through a GPU, a display screen 290, and an application processor. The GPU is used to perform mathematical and geometric calculations to achieve graphics rendering and connect the display screen 290 and the application processor. The processor 210 may include one or more GPUs that execute program instructions to generate or change display information. The mobile terminal 200 may include one or more display screens 290 for displaying images, videos, etc.
[0043] The mobile terminal 200 can realize the shooting function through the ISP, the camera module 291, the encoder, the decoder, the GPU, the display screen 290 and the application processor.
[0044] The camera module 291 is used to capture static images or videos, collect light signals through photosensitive elements, and convert them into electrical signals. The ISP is used to process the data fed back by the camera module 291 and convert the electrical signals into digital image signals.
[0045] The external memory interface 222 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile terminal 200 .
[0046] The internal memory 221 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data (such as images, videos), etc. created during the use of the mobile terminal 200. The processor 210 executes various functional applications and data processing of the mobile terminal 200 by running instructions stored in the internal memory 221 and / or instructions stored in a memory provided in the processor.
[0047] The mobile terminal 200 can implement audio functions through an audio module 270, a speaker 271, a receiver 272, a microphone 273, an earphone jack 274, and an application processor. For example, music playing, recording, etc. The audio module 270 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 270 can also be used to encode and decode audio signals. The speaker 271 is used to convert audio electrical signals into sound signals. The receiver 272 is used to convert audio electrical signals into sound signals. The microphone 273 is used to convert sound signals into electrical signals. The earphone jack 274 is used to connect wired headphones.
[0048] The sensor module 280 may include a touch sensor 2801, a pressure sensor 2802, a gyroscope sensor 2803, an air pressure sensor 2804, and the like. The touch sensor 2801 is used to sense touch events input from the outside. It can be set below the display screen 290 to make the display screen 290 a touch screen, or it can be set at other locations, such as a touch panel independent of the display screen 290, or it can be set at a matching external device of the mobile terminal 200, such as an external touch panel, a touch remote control, etc., so that the user can achieve touch interaction through an external device. The pressure sensor 2802 is used to sense the pressure signal, and the pressure signal can be converted into an electrical signal for realizing functions such as pressure touch. The gyroscope sensor 2803 can be used to determine the motion posture of the mobile terminal 200, and can be used for scenes such as anti-shake shooting, navigation, and somatosensory games. The air pressure sensor 2804 is used to measure air pressure, and can assist in positioning and navigation by calculating the altitude. In addition, according to actual needs, sensors with other functions, such as a depth sensor, an acceleration sensor, a distance sensor, etc., may also be provided in the sensor module 280.
[0049] Indicator 292 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0050] The motor 293 can generate vibration prompts, such as vibration prompts for incoming calls, alarms, received messages, etc., and can also be used for touch vibration feedback, etc.
[0051] The key 294 includes a power key, a volume key, etc. The key 294 can be a mechanical key or a touch key. The mobile terminal 200 can receive key input and generate key signal input related to user settings and function control of the mobile terminal 200.
[0052] The mobile terminal 200 may support one or more SIM card interfaces 295 for connecting to a SIM card, so that the mobile terminal 200 interacts with the network through the SIM card to implement functions such as calls and data communications.
[0053] The following is a detailed description of the image generation method and image generation device of the exemplary embodiment of the present disclosure. This exemplary embodiment can be applied to electronic devices with millimeter wave devices, wherein the electronic devices can include but are not limited to smart phones, smart watches, smart speakers, personal computers, Kinect devices, etc. The millimeter wave device can be used to transmit millimeter wave signals to the surrounding environment, collect reflected echo signals and perform signal processing on them.
[0054] Figure 3 A flowchart of a method for generating a portrait in this exemplary embodiment is shown, which includes the following steps S310 to S330:
[0055] Step S310: Control the millimeter wave device to transmit a millimeter wave signal and obtain echo data of the millimeter wave signal.
[0056] A millimeter wave device refers to a device that can transmit a linear frequency modulated continuous wave signal to an environment within a certain range. Millimeter waves are usually electromagnetic waves in the frequency domain of 30 to 300 GHz (wavelength of 1 to 10 mm). Since they are located in the wavelength range where microwaves and far infrared waves overlap, they have the characteristics of both spectra. Echo data refers to the signal data reflected after the millimeter wave device transmits the millimeter wave signal. In this exemplary embodiment, the millimeter wave device can be controlled to transmit millimeter wave signals within a certain range around it. For example, a Kinect device equipped with a millimeter wave device is set up indoors to send millimeter wave signals to a fan-shaped space area based on the device. In order to facilitate subsequent processing, after receiving the millimeter wave echo data, the electronic device can perform mixing, filtering, and analog-to-digital converter sampling processing on it.
[0057] Step S320: determining the posture data of the sensing object according to the echo data.
[0058] The sensing object refers to the object in the surrounding environment that needs to generate portrait information when the millimeter wave device sends millimeter wave signals to the surrounding environment. For example, when an electronic device sends millimeter wave signals to a room, the user in the room is the sensing object. Posture data refers to data that can reflect the posture of the sensing object. For example, when the sensing object is a user, the posture data may include data such as sitting upright, lying down, lying down, standing, walking, running, cooking, using a computer, and using a mobile phone. In this exemplary embodiment, the electronic device sends a millimeter wave signal to the surrounding environment through the millimeter wave device. When the sensing object moves within the detection range of the millimeter wave device, the echo data fed back by the surrounding environment is received, and a variety of feature information that can characterize the posture of the sensing object is extracted from the echo data, such as the distance between the user and the electronic device, the moving speed, the moving acceleration, the position, height, energy, and statistical characteristics. Further, the posture data of the sensing object is determined by filtering, classifying, judging, and other processing of the feature information.
[0059] In an exemplary embodiment, if Figure 4 As shown, the above step S320 may include the following steps:
[0060] Step S410, extracting effective echo data from the echo data of the millimeter wave signal through reference echo data; the reference echo data is echo data emitted and received by the millimeter wave device in a reference environment;
[0061] Step S420: determining the posture data of the sensing object according to the effective echo data.
[0062] Considering that in actual applications, the millimeter wave device may transmit millimeter wave signals to an environment without a sensing object, or transmit millimeter wave signals to an environment with a sensing object. In order to determine the echo data based on the reflection of the sensing object in an environment including the sensing object, the present exemplary embodiment may first transmit the millimeter wave signal in a reference environment to determine a reference echo data, wherein the reference environment is an environment without the sensing object, for example, when no one is indoors, the millimeter wave signal is transmitted and its echo data is received. Furthermore, if there is a sensing object in the environment, the received echo signal will change to a certain extent compared with the echo signal received in the reference environment. Based on this, the present exemplary embodiment may extract valid echo data from the reference echo data to determine the posture data of the sensing object according to the valid echo data.
[0063] Step S330, generating portrait information of the sensing object based on the posture data.
[0064] Furthermore, the corresponding portrait information of the sensing object can be generated by determining the posture data of the sensing object. The portrait information can reflect the behavioral habits of the sensing object. Through the portrait information, the specific attributes of the sensing object can be determined. For example, when the sensing object is a user, the user's life attributes or social attributes can be reflected according to the portrait information, such as whether the user is an office worker, loves to stay at home, loves to cook, or loves fitness, etc. Specifically, this exemplary embodiment can process the posture data by configuring a pre-trained machine learning model in the electronic device to generate the portrait information of the sensing object.
[0065] In an exemplary embodiment, after generating the portrait information of the sensing object, the portrait generation method may further include:
[0066] According to the portrait information of the sensing object, motion guidance information is configured for the sensing object, and / or recommendation information is determined for the sensing object.
[0067] Since the portrait information can reflect the behavior habits or specific attributes of the sensing object to a certain extent, it is possible to configure exercise guidance information for the sensing object or determine corresponding recommendation information for the sensing object based on the established portrait information. For example, if it is determined that the user's portrait information is a young person who loves fitness, then the user can be configured with corresponding exercise guidance information, where the exercise guidance information may include when to exercise, what sports are available, how long each sport lasts, etc. In addition, corresponding recommendation information can also be determined for the sensing object. For example, if it is determined that the user loves cooking based on the user's portrait information, recipes or food can be recommended to the user.
[0068] In summary, in this exemplary embodiment, the millimeter wave device is controlled to transmit a millimeter wave signal, and the echo data of the millimeter wave signal is obtained; the posture data of the sensing object is determined according to the echo data; and the portrait information of the sensing object is generated based on the posture data. On the one hand, this exemplary embodiment proposes a new portrait generation method. Different from the method of generating a portrait by collecting common information of the sensing object in the prior art, this exemplary embodiment can collect the posture data of the sensing object through the millimeter wave device to establish the portrait information, that is, it can generate more realistic portrait information based on the actual behavior habits of the sensing object. The established portrait has high accuracy and credibility, and has a wide range of applications; on the other hand, the process of determining the posture data of the sensing object and establishing the portrait information through the millimeter wave device does not require the sensing object to actively enter information or other interactive operations with the electronic device, which simplifies the operation process of the sensing object.
[0069] In an exemplary embodiment, the controlling the millimeter wave device to transmit a millimeter wave signal may include:
[0070] Within a preset time, the millimeter wave device is controlled to continuously transmit millimeter wave signals.
[0071] That is, the millimeter wave device can be controlled to transmit millimeter wave signals within a preset period of time or time period, for example, within an hour, a day, a week or a few weeks, to continuously transmit millimeter wave signals to obtain echo data within the preset time, so as to establish portrait information based on the echo data. The preset time can be customized as needed, and the present disclosure does not specifically limit this.
[0072] Further, in an exemplary embodiment, the above step S320 may include:
[0073] According to the echo data, one or more groups of posture data of the sensing object within a preset time are determined; wherein each group of posture data includes the type of posture and the maintenance time of the posture.
[0074] After receiving the echo data, one or more groups of posture data can be counted according to a preset data structure, and each group of posture data can include the type of posture and the maintenance time of the posture. For example, when the sensing object is a user, the type of posture can include but is not limited to the user sitting upright, lying down, lying, standing, walking, running, cooking, using a computer, using a mobile phone, etc., which can be represented by a character identifier, such as "1" for the user sitting upright, "2" for the user lying down, etc.; or "a" for the user standing, "b" for the user walking, etc., and the present disclosure does not make specific restrictions on this. The maintenance time of the posture can reflect the time for the sensing object to continue to perform a certain posture, such as the user exercising for two hours, or using a mobile phone for one hour, etc. The maintenance time can be the original time data obtained, such as recording the posture corresponding to each moment; the maintenance time can also be the time data calculated based on the original time data, such as determining the maintenance time corresponding to the posture according to the start time and end time of a certain posture, etc.
[0075] In an exemplary embodiment, the maintenance time of the above-mentioned posture includes the start time and the end time of the posture;
[0076] The above-mentioned method of determining one or more sets of posture data of the sensing object within a preset time based on the echo data includes:
[0077] When determining the posture change of the sensing object based on the echo data, the current time is used as the end time of the current posture and the start time of the next posture.
[0078] In this exemplary embodiment, the electronic device can represent one or more sets of data of the sensing object within a preset time in a preset data structure, wherein the maintenance time in each set of posture data can be recorded as the start time and end time of the posture. For example, the following Table 1 can be used to represent multiple sets of posture data corresponding to the sensing object when the preset time is one day:
[0079] Table 1
[0080]
[0081] Furthermore, based on the posture data of the above one day, a data table with preset time as working day or non-working day can be established, for example, as shown in Table 2, multiple groups of posture data with preset time as 5 working days:
[0082] Table 2
[0083]
[0084]
[0085] As shown in Table 3, the preset time is multiple sets of posture data for two non-working days:
[0086] Table 3
[0087]
[0088] Based on one or more sets of data of the sensing object within a preset time, in an exemplary embodiment, Figure 5 As shown, the above step S330 may include the following steps:
[0089] Step S510, arranging the types of gestures and the duration of gestures in each group of gesture data of the sensing object to establish a gesture matrix of the sensing object;
[0090] Step S520: Input the posture matrix into a pre-trained machine learning model for processing to obtain image information of the sensing object.
[0091] According to the statistically obtained gesture categories corresponding to the sensing and the duration of each gesture, a gesture matrix about the gesture data of the sensing object can be established. The specific establishment method is explained by taking the sensing object as a user and the preset time as one day as an example. Based on the multiple sets of data obtained, the gesture data of the user in each time period of the day is determined, such as dividing the time of the day into a section according to each preset time interval (taking 15 minutes as an example), that is, a day can be divided into 96 time periods, and each time period can correspond to a gesture category. It should be noted that, considering that in actual applications, there may be multiple different gesture categories in a time period, therefore, a gesture category selection mechanism can be set, such as selecting the category of the gesture that maintains the longest time in a time period as the gesture category corresponding to the time period, or selecting the category of the gesture that appears most frequently in a day in a time period as the gesture category corresponding to the time period, etc. Further, the gesture category and the gesture maintenance time are arranged to obtain a 96*2 gesture matrix:
[0092]
[0093] The first column represents time, and the second column represents posture category. Further, the posture matrix can be input into the machine learning model for processing to obtain the corresponding portrait information of the user. Figure 6 As shown in the figure, the specific process of user portrait generation can include the following steps:
[0094] Step S610, controlling the millimeter wave device to continuously transmit millimeter wave signals within a preset time, and acquiring echo data of the millimeter wave signals;
[0095] Step S620, determining one or more sets of posture data of the sensing object within a preset time according to the echo data; wherein each set of posture data includes a type of posture and a maintenance time of the posture;
[0096] Step S630, arranging the types of gestures and the duration of gestures in each group of gesture data of the sensing object to establish a gesture matrix of the sensing object;
[0097] Step S640: Input the posture matrix into a pre-trained machine learning model for processing to obtain image information of the sensing object.
[0098] In this exemplary embodiment, the pre-trained machine learning model can be trained using a large number of sample sensing object posture data and corresponding portrait information labels. Specifically, the posture matrix of the posture data of a large number of sample sensing objects can be used as sample data and input into the machine learning model. The output results are compared with the portrait information labels, and the model parameters are gradually adjusted until the model converges or the accuracy of the model reaches a certain standard. The training process is terminated to obtain a trained machine learning model and configure it in an electronic device.
[0099] This exemplary embodiment also provides another image generation method, which is applied to a first end, and the first end has a millimeter wave device. The specific flow chart of the image generation method is as follows: Figure 7 As shown, the following steps may be included:
[0100] Step S710, controlling the millimeter wave device to transmit a millimeter wave signal and acquiring echo data of the millimeter wave signal;
[0101] Step S720, determining the posture data of the sensing object according to the echo data;
[0102] Step S730, sending the posture data to the second end, so that the second end generates portrait information of the sensing object based on the posture data.
[0103] This exemplary embodiment is similar to the portrait generation method of steps S310 to S330, both of which control the millimeter wave device to transmit millimeter wave signals within a certain range around, receive echo data fed back by the environment, determine the posture data of the sensing object, and then generate the portrait information of the sensing object. In order to facilitate data processing, the posture data can be converted into the form of vectors or matrices, which are used as input data of the machine learning model, and processed by the pre-trained machine learning model to generate the portrait information of the sensing object.
[0104] Different from the portrait generation method in steps S310 to S330, the system architecture of the method of this exemplary embodiment involves a multi-party interaction process. Figure 8 As shown, the system architecture 800 may include: a first end 810, a sensing object 820, and a second end 830. The first end 810 refers to any terminal having a millimeter wave device, for example, a millimeter wave device may be configured at a wireless access terminal, or a smart phone, a smart speaker, or a device such as Kinect may be used as the first end, etc. The second end 830 may include a mobile terminal, such as a smart phone, or may include electronic devices such as a tablet computer, a smart speaker, and a personal computer, and the sensing object 820 may be any user. In this exemplary embodiment, the first end 810 may send a millimeter wave signal to the sensing object 820 through a millimeter wave device, determine the posture data of the sensing object 820 according to the received echo data, and send it to the second end 830, and process it through a machine learning model embedded in the second end 830 to generate portrait information of the sensing object 820. According to actual needs, the second end 830 may recommend information to the sensing object 820 according to the generated portrait information.
[0105] In particular, this exemplary embodiment can be applied to a scenario where a wireless access terminal is used as a first terminal, a mobile terminal is used as a second terminal, and a user is used as a sensing object. By configuring a millimeter wave device at the indoor wireless access terminal, the transmission of millimeter wave signals and the reception of echo data are realized, and the determined posture data is sent to the mobile terminal to generate a user portrait. In this process, there is no step of uploading the user's posture data to the server for parsing, thereby avoiding the problem of possible leakage of user privacy information, which is more friendly to privacy-sensitive users.
[0106] In summary, in this exemplary embodiment, the millimeter wave device is controlled to transmit a millimeter wave signal and acquire the echo data of the millimeter wave signal; the posture data of the sensing object is determined based on the echo data; the posture data is sent to the second end, so that the second end generates portrait information of the sensing object based on the posture data. On the one hand, this exemplary embodiment proposes a new portrait generation method. Different from the method of generating a portrait by collecting common information of the sensing object in the prior art, this exemplary embodiment can collect the posture data of the sensing object through the millimeter wave device to establish portrait information, that is, it can generate more realistic portrait information based on the actual behavior habits of the sensing object. The established portrait has high accuracy and credibility and a wide range of applications. On the other hand, the process of determining the posture data of the sensing object and establishing the portrait information through the millimeter wave device does not require the sensing object to actively enter information or other interactive operations with the electronic device, which simplifies the operation process of the sensing object.
[0107] The exemplary embodiment of the present disclosure also provides a portrait generation device, which is applied to an electronic device equipped with a millimeter wave device. Fig. 9 As shown, the portrait generating device 900 may include: an echo data acquiring module 910, used to control the millimeter wave device to transmit millimeter wave signals and acquire echo data of the millimeter wave signals; a posture data acquiring module 920, used to determine the posture data of the sensing object according to the echo data; and a portrait information generating module 930, used to generate portrait information of the sensing object based on the posture data.
[0108] In an exemplary embodiment, the echo data acquisition module includes: a signal transmitting unit, which is used to control the millimeter wave device to continuously transmit the millimeter wave signal within a preset time.
[0109] In an exemplary embodiment, the posture data acquisition module includes: a posture data determination unit, which is used to determine one or more groups of posture data of the sensing object within a preset time according to the echo data; wherein each group of posture data includes the type of posture and the maintenance time of the posture.
[0110] In an exemplary embodiment, the maintenance time of a posture includes the start time and the end time of the posture; the posture data determination unit is used to use the current time as the end time of the current posture and the start time of the next posture when determining the posture change of the sensing object based on the echo data.
[0111] In an exemplary embodiment, the portrait information generation module includes: a posture matrix establishment unit, which is used to arrange the posture categories and posture maintenance time in each group of posture data of the sensing object to establish a posture matrix of the sensing object; a posture matrix processing unit, which is used to input the posture matrix into a pre-trained machine learning model for processing to obtain the portrait information of the sensing object.
[0112] In an exemplary embodiment, the posture data acquisition module includes: an effective echo data extraction unit, which is used to extract effective echo data from the echo data of the millimeter wave signal through reference echo data; the reference echo data is the echo data emitted and received by the millimeter wave device in a reference environment; and a posture data determination unit, which is used to determine the posture data of the sensing object based on the effective echo data.
[0113] The exemplary embodiment of the present disclosure also provides a portrait generation device, which is applied to a first end, and the first end is equipped with a millimeter wave device. Fig.10 As shown, the portrait generating device 1000 may include: an echo data acquiring module 1010, used to control the millimeter wave device to transmit millimeter wave signals and acquire echo data of the millimeter wave signals; a posture data acquiring module 1020, used to determine the posture data of the sensing object according to the echo data; and a portrait information generating module 1030, used to generate portrait information of the sensing object based on the posture data.
[0114] In an exemplary embodiment, the first end includes a wireless access end, and the second end includes a mobile terminal.
[0115] The specific details of each module in the above device have been described in detail in the implementation method of the method part. The undisclosed details can be found in the implementation method of the method part, so they will not be repeated here.
[0116] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods or program products. Therefore, various aspects of the present disclosure may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as "circuits", "modules" or "systems".
[0117] The exemplary embodiments of the present disclosure also provide a computer-readable storage medium on which a program product capable of implementing the above-mentioned method of the present specification is stored. In some possible implementations, various aspects of the present disclosure can also be implemented in the form of a program product, which includes program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present disclosure described in the above-mentioned "Exemplary Method" section of the present specification, for example, it can execute Figure 3 , Figure 4 , Figure 5 , Figure 6 or Figure 7 Any one or more steps in .
[0118] The exemplary embodiments of the present disclosure also provide a program product for implementing the above method, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.
[0119] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0120] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0121] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.
[0122] Program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).
[0123] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and embodiments are to be regarded as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.
[0124] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A method for generating an image, characterized in that: Applied to an electronic device having a millimeter wave device, the method comprises: Controlling the millimeter wave device to transmit a millimeter wave signal and acquiring echo data of the millimeter wave signal; the controlling the millimeter wave device to transmit a millimeter wave signal comprises: controlling the millimeter wave device to continuously transmit a millimeter wave signal within a preset time; Determine the posture data of the sensing object according to the echo data; the determining the posture data of the sensing object according to the echo data comprises: determining one or more groups of posture data of the sensing object within the preset time according to the echo data; wherein each group of posture data comprises a type of posture and a maintenance time of the posture; the maintenance time of the posture comprises a start time and an end time of the posture; the determining one or more groups of posture data of the sensing object within the preset time according to the echo data comprises: when determining the posture change of the sensing object according to the echo data, taking the current time as the end time of the current posture and the start time of the next posture; Generate portrait information of the sensing object based on the posture data; the generating of the portrait information of the sensing object based on the posture data includes: arranging the posture categories and posture maintenance time in each group of posture data of the sensing object to establish a posture matrix of the sensing object; inputting the posture matrix into a pre-trained machine learning model for processing to obtain the portrait information of the sensing object.
2. The method according to claim 1, characterized in that The step of determining the posture data of the sensing object according to the echo data comprises: Extracting effective echo data from the echo data of the millimeter wave signal through reference echo data; the reference echo data is echo data emitted and received by the millimeter wave device in a reference environment; The posture data of the sensing object is determined according to the effective echo data.
3. The method according to claim 1 or 2, characterized in that: After generating the portrait information of the sensing object, the method further includes: According to the portrait information of the sensing object, motion guidance information is configured for the sensing object, or recommended information is determined for the sensing object.
4. A method for generating an image, characterized in that: Applied to a first end, the first end having a millimeter wave device, the method includes: Controlling the millimeter wave device to transmit a millimeter wave signal and acquiring echo data of the millimeter wave signal; the controlling the millimeter wave device to transmit a millimeter wave signal comprises: controlling the millimeter wave device to continuously transmit a millimeter wave signal within a preset time; Determine the posture data of the sensing object according to the echo data; the determining the posture data of the sensing object according to the echo data comprises: determining one or more groups of posture data of the sensing object within the preset time according to the echo data; wherein each group of posture data comprises a type of posture and a maintenance time of the posture; the maintenance time of the posture comprises a start time and an end time of the posture; the determining one or more groups of posture data of the sensing object within the preset time according to the echo data comprises: when determining the posture change of the sensing object according to the echo data, taking the current time as the end time of the current posture and the start time of the next posture; The posture data is sent to the second end, so that the second end generates portrait information of the sensing object based on the posture data; the generation of the portrait information of the sensing object based on the posture data includes: arranging the posture categories and posture maintenance time in each group of posture data of the sensing object to establish a posture matrix of the sensing object; inputting the posture matrix into a pre-trained machine learning model for processing to obtain the portrait information of the sensing object.
5. The method according to claim 4, characterized in that The first end includes a wireless access end, and the second end includes a mobile terminal.
6. A portrait generating device, characterized in that: Applicable to an electronic device having a millimeter wave device, the device comprising: An echo data acquisition module, used to control the millimeter wave device to transmit millimeter wave signals and acquire echo data of the millimeter wave signals; the echo data acquisition module is configured to: control the millimeter wave device to continuously transmit millimeter wave signals within a preset time; A posture data acquisition module, used to determine the posture data of the sensing object according to the echo data; the posture data acquisition module is configured to: determine one or more groups of posture data of the sensing object within the preset time according to the echo data; wherein each group of posture data includes the type of posture and the maintenance time of the posture; the maintenance time of the posture includes the start time and the end time of the posture; the one or more groups of posture data of the sensing object within the preset time according to the echo data is determined to: when determining the posture change of the sensing object according to the echo data, the current time is used as the end time of the current posture and the start time of the next posture; A portrait information generation module is used to generate portrait information of the sensing object based on the posture data; the portrait information generation module is configured to: arrange the posture categories and posture maintenance time in each group of posture data of the sensing object to establish a posture matrix of the sensing object; input the posture matrix into a pre-trained machine learning model for processing to obtain the portrait information of the sensing object.
7. A portrait generating device, characterized in that: Applied to a first end, the first end is provided with a millimeter wave device, the device comprising: An echo data acquisition module, used to control the millimeter wave device to transmit millimeter wave signals and acquire echo data of the millimeter wave signals; the echo data acquisition module is configured to: control the millimeter wave device to continuously transmit millimeter wave signals within a preset time; A posture data acquisition module, used to determine the posture data of the sensing object according to the echo data; the posture data acquisition module is configured to: determine one or more groups of posture data of the sensing object within the preset time according to the echo data; wherein each group of posture data includes the type of posture and the maintenance time of the posture; the maintenance time of the posture includes the start time and the end time of the posture; the one or more groups of posture data of the sensing object within the preset time according to the echo data is determined to: when determining the posture change of the sensing object according to the echo data, the current time is used as the end time of the current posture and the start time of the next posture; A portrait information generation module is used to send the posture data to the second end so that the second end generates the portrait information of the sensing object based on the posture data; the portrait information generation module is configured to: arrange the posture categories and posture maintenance time in each group of posture data of the sensing object to establish a posture matrix of the sensing object; input the posture matrix into a pre-trained machine learning model for processing to obtain the portrait information of the sensing object.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the image generation method described in any one of claims 1 to 3 or 4 to 5 is implemented.
9. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; Wherein, the processor is configured to execute the image generation method described in any one of claims 1 to 3 or 4 to 5 by executing the executable instructions.
