Information transmission method and first device

Abstract

The invention discloses an information transmission method and first equipment, and the method comprises the steps: recognizing a first feature of a target user based on a first sensing unit when the first equipment is in a first state; under the condition that the first feature meets the first condition, the first device is controlled to be switched from the first state to the second state; wherein the first power consumption of the first device in the first state is smaller than the second power consumption of the first device in the second state; identifying a second feature of the target user based on a second sensing unit; the second working power consumption of the second sensing unit is greater than the first working power consumption of the first sensing unit; in response to the condition that the second feature meets a second condition and the first equipment and the second equipment establish communication connection, determining an associated region corresponding to the second feature; the association area is used for associating a to-be-transmitted target object; and controlling the target object to be transmitted between the first equipment and the second equipment.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of communication technology, and more particularly, to an information transmission method and a first device. BACKGROUND

[0002] With the application of electronic devices in learning and working scenarios, information (such as documents, digital multimedia files, etc.) transmission between devices in close proximity is becoming more and more common. However, in the process of cross-device file transmission, the user needs to manually perform a series of operations, such as starting the communication function, searching for devices, selecting target devices, confirming the connection, selecting files, selecting transmission, etc. It can be seen that this cross-device transmission method has problems such as complicated operation, high device power consumption, and low transmission efficiency. SUMMARY

[0003] Therefore, the present application provides the following technical solutions:

[0004] An information transmission method applied to a first device, comprising:

[0005] In a case where the first device is in a first state, identifying a first feature of a target user based on a first sensing unit;

[0006] In a case where the first feature meets a first condition, controlling the first device to switch from the first state to a second state; wherein a first power consumption of the first device in the first state is less than a second power consumption of the first device in the second state;

[0007] Identifying a second feature of the target user based on a second sensing unit; a second working power consumption of the second sensing unit is greater than a first working power consumption of the first sensing unit;

[0008] In response to a case where the second feature meets a second condition and the first device and the second device establish a communication connection, determining an associated area corresponding to the second feature; the associated area is used to associate a target object to be transmitted;

[0009] Controlling the target object to be transmitted between the first device and the second device.

[0010] Optionally, after controlling the first device to switch from the first state to the second state, further comprising:

[0011] Identifying a third feature of the target user based on the first sensing unit;

[0012] If the third feature meets a communication connection establishment condition, establishing a communication connection between the first device and the second device corresponding to the third feature;

[0013] starting a second sensing unit;

[0014] Alternatively, starting the second sensing unit after the first device is controlled to switch from the first state to a second state, so that a second feature of the target user is identified by the second sensing unit;

[0015] In a case where the second feature meets a second condition, a communication connection between the first device and a second device corresponding to the second feature is established.

[0016] Optionally, the establishing of the communication connection between the first device and the second device corresponding to the third feature comprises:

[0017] In a case where there is at least one other device around the first device, the third feature is analyzed to obtain spatial direction information corresponding to the third feature;

[0018] Based on the spatial direction information, a second device is determined;

[0019] A communication connection between the first device and the second device is established.

[0020] Optionally, the identifying of the first feature of the target user by the first sensing unit comprises at least one of:

[0021] An ultrasonic feature of a first predetermined pattern is identified from an echo signal received by the first sensing unit, the ultrasonic feature of the first predetermined pattern representing the first feature;

[0022] A contour feature of a second predetermined pattern is identified based on a reflected signal received by the first sensing unit after a light pulse is emitted by the first sensing unit, the contour feature of the second predetermined pattern representing the first feature;

[0023] An image feature is identified based on an image signal collected by the first sensing unit, the image feature representing the first feature.

[0024] Optionally, the determining of the associated region corresponding to the second feature comprises:

[0025] A mapping position of spatial position information indicated by the second feature on a device display interface is determined;

[0026] In a case where the first device represents a sender, a user interface element at the mapping position on the first device display interface is determined as the associated region;

[0027] In a case where the first device represents a receiver, a storage path corresponding to a region at the mapping position on the first device display interface is determined as the associated region.

[0028] Optionally, the method further comprises:

[0029] In the case that the first device represents a sender, identifying a type of a user interface element at the mapping position on the display interface of the first device;

[0030] Based on the type, determining a target object to be transmitted.

[0031] Optionally, the method further comprises:

[0032] In the case that the first device represents a sender, based on a communication connection established between the first device and the second device, sending a first instruction to the second device, so that the second device starts a corresponding sensing unit based on the first instruction, and determines a storage area of the target object based on the sensing unit;

[0033] In the case that the first device represents a receiver, in response to the first device receiving the target object, sending a second instruction to the second device, so that the second device closes the corresponding sensing unit based on the second instruction.

[0034] Optionally, the controlling the transmission of the target object between the first device and the second device comprises:

[0035] In the case that the first device represents a sender, sending the target object to the second device;

[0036] In the case that the first device represents a receiver, receiving the target object sent by the second device, and storing the target object in a storage path corresponding to the associated area.

[0037] Optionally, the method further comprises:

[0038] In response to the second feature not satisfying the second condition, controlling the first device to switch from the second state back to the first state.

[0039] A first device, comprising:

[0040] a first sensing unit, a second sensing unit, a memory, and a processor;

[0041] The memory is configured to store an application program and data generated by running of the application program.

[0042] The processor is configured to execute the application program to implement:

[0043] In the case that the first device is in a first state, identifying a first feature of a target user based on the first sensing unit;

[0044] In a case where the first feature meets a first condition, the first device is controlled to switch from the first state to a second state; wherein a first power consumption of the first device in the first state is less than a second power consumption of the first device in the second state.

[0045] A second feature of the target user is identified based on a second sensing unit; a second working power consumption of the second sensing unit is greater than the first working power consumption of the first sensing unit.

[0046] In a case where the second feature meets a second condition and the first device and the second device establish a communication connection, a corresponding associated area of the second feature is determined; the associated area is used for associating a target object to be transmitted.

[0047] The target object is controlled to be transmitted between the first device and the second device. BRIEF DESCRIPTION OF DRAWINGS

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor on the basis of the provided drawings.

[0049] Figure 1 A flowchart of an information transmission method provided by an embodiment of the present application;

[0050] Figure 2 A scene diagram of a first device as a sender provided by an embodiment of the present application;

[0051] Figure 3 A scene diagram of a first device as a receiver provided by an embodiment of the present application;

[0052] Figure 4 An application scene diagram of cross-device transmission of a file provided by an embodiment of the present application;

[0053] Figure 5 A structural diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0054] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0055] The terms "first" and "second" and the like in the present application are used to distinguish different objects, rather than to describe a particular order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but can include steps or units not listed.

[0056] Embodiments of the present application provide an information transmission method, which can be applied to the scene of information transmission between electronic devices such as mobile phones, tablets, laptops and the like. The first device can perceive the first feature of the user in the first state of low power consumption, switch to the second state of high power consumption when the first feature matches, and connect with the second device, then identify the second feature through the second perception unit capable of realizing fine perception, complete the transmission of related information between the first device and the second device, and through the processing mode of layered wake-up and cooperative perception, ensure that the device activates the high-power system and the corresponding unit only after the user's intention is clear, reduce the power consumption of the device, and at the same time, based on the feature, trigger the corresponding unit and control the information transmission, solve the problem that the existing information transmission between different devices is cumbersome.

[0057] Referring to Figure 1 , which shows a flowchart of an information transmission method provided by an embodiment of the present application, the method is applied to a first device and can include the following steps:

[0058] S101, in the case where the first device is in a first state, identifying a first feature of a target user based on a first perception unit.

[0059] In the information transmission scenario, the first device can be an information sender or an information receiver. Specifically, the first device can be a mobile phone, a tablet computer, a notebook computer, a smart display device, etc. The first device in the first state can represent that the first device is in a low-power consumption state, such as the first device being in a low-load state or the first device being in an idle state (also referred to as an Idle state) with no task execution during system operation. Specifically, it can be an S0 low running state of the first device, that is, the system of the first device is not in sleep, and the core components are in low-load running. The first device in the first state has a relatively low first power consumption. Correspondingly, the first perception unit represents a unit capable of running in the first state of the electronic device, that is, a perception component capable of running in a low-power consumption mode. For example, the first perception unit includes but is not limited to a perception unit for emitting and / or receiving ultrasonic waves, a TOF (Time of Flight) sensor, and an image acquisition unit (such as a low-frame-rate camera) integrated with a low-power consumption CV-DSP (Computer Vision-Digital Signal Processor) module. The first feature refers to the initial operation feature of the target user of the first device, which is used to trigger the first device to switch from the first state to the second state, such as the motion profile of the user's hand approaching the first device, the vibration feature of tapping the device shell, and the simple hand gesture (such as waving hands) in front of the device.

[0060] In S102, the first device is controlled to switch from the first state to the second state when the first feature meets the first condition.

[0061] The first condition refers to a condition that the first feature matches a preset initial wake-up feature, such as a preset initial wake-up feature being a waving hand action. Correspondingly, the first feature meeting the first condition refers to detecting that the user has made a waving hand action. For example, the first condition can refer to a duration that meets the preset feature exceeding a time threshold, such as detecting that the user's hand is more than two seconds, which can avoid false triggering and other problems. The first power consumption of the first device in the first state is less than the second power consumption of the first device in the second state. When the first device is in the second state, high-power components can be started, such as starting a high-definition screen, a high-performance processor component, and a second perception unit, so as to meet the subsequent needs of accurately identifying user operations and data processing.

[0062] For example, the low-power image acquisition unit of the notebook computer acquires a first feature of "hand outline (width 10 cm, height 15 cm)", which is compared with the "hand outline (width 8-12 cm, height 12-18 cm)" feature in the initial wake-up feature library, and the matching degree is calculated to be 92%, and the hand outline continues to exist in the next 3 frames of images, that is, it is determined that the first feature meets the first condition. The processor then controls the notebook computer screen to light up (such as switching from the breath-holding mode to the non-breath-holding mode), the CPU frequency is raised to 2.8 GHz, and the second sensing unit (such as a high-definition front camera) is started, and the state switching is completed. In this way, only when the first feature meets the first condition, the second state of relatively high power consumption will be switched to, providing hardware support for subsequent accurate identification of user operation intent (i.e., the second feature), and ensuring the accuracy of operation recognition.

[0063] S103, identifying a second feature of the user based on the second sensing unit.

[0064] The second working power consumption of the second sensing unit is greater than the first working power consumption of the first sensing unit. For example, the second sensing unit represents a high-precision, high-power sensing component, which can be a high-definition image acquisition unit. The second feature can represent the precise operation features of the target user, which are used to determine the associated region and the transmission intent of the information, such as the user's grabbing gesture, pointing gesture, and circle selection gesture, which can contain more rich spatial position information and action details relative to the first feature.

[0065] S104, determining the associated region corresponding to the second feature in the case that the second feature meets the second condition and the first device and the second device establish a communication connection.

[0066] The second condition refers to the matching condition of the second feature and the preset operation intent feature library, such as the condition that the matching degree of the second feature and the target operation feature such as the selected file or the specified storage path in the feature library exceeds 90%, and the action integrity of the second feature meets the requirements, such as the second feature satisfying the complete action of opening and closing required by the grabbing gesture. In the embodiments of the present application, the communication connection with the corresponding second device can be established after the first device switches to the second state, or the communication connection with the corresponding second device can be established in the case that the second feature meets the second condition, wherein the second device represents a device periodically designated by the first device to perform information transmission. For example, the second device to be connected by the first device can be determined by the corresponding gesture pointing, or the second device can be determined according to the default connection configuration information.

[0067] The association area refers to a specific area on the first device corresponding to the second feature, used for associating the target object to be transmitted. If the first device is the information sender, the association area is the area where the object to be transmitted is located, such as the area corresponding to the file to be transmitted. If the first device is the information receiver, the association area is the storage area corresponding to the object to be transmitted, such as a designated storage partition. In this way, in the embodiments of the present application, the association area associated with the object to be transmitted can be determined based on the identified second feature, without the need for the user to manually select the object to be transmitted or determine the storage location of the object to be transmitted, thereby improving the flexibility of interaction.

[0068] S105, control the target object to be transmitted between the first device and the second device.

[0069] The target object represents information to be transmitted between the first device and the second device, including but not limited to files (such as documents, pictures, videos), text segments (such as memo content, web excerpts), application data (such as game archives, software configurations), etc.

[0070] If the first device is the sender, the processor extracts the target object to be transmitted from the association area. The target object can be directly transmitted to the second device, or the target object can be pre-processed (such as compression, encryption, to ensure transmission efficiency and security), and then the pre-processed target object is sent to the second device in the form of a data packet through the established communication connection. At the same time, the processor receives the data packet reception confirmation signal fed back by the second device in real time. If a data packet is lost, a retransmission mechanism is triggered.

[0071] If the first device is the receiver, the processor receives the target object data packet sent by the second device through the communication connection, and performs decompression and decryption processing on the data packet to verify the data integrity (such as through MD5 verification). Then, the processed target object is stored in the association area (such as a designated folder path), and a storage completion prompt is generated, such as a screen display of "file saved to D drive-received file". After the transmission is completed, the first device can automatically turn off the second sensing unit and switch back to the first state to reduce power consumption.

[0072] It should be noted that the first feature and the second feature in the embodiments of the present application can be the same predefined gesture or different user operations. In the case where the first feature and the second feature are the same, the same gesture is used to wake up the device and transmit the confirmation, etc. If the user wants to quickly send a photo on the first device to the second device, in the case where the first device is in the first low-power state, the user makes a "push forward" gesture in the direction of the second device in the vicinity of the first device, the first sensing unit such as the ToF sensor of the first device recognizes the "push forward" gesture profile, the first device is switched to the second state, and a communication connection with the second device is established based on the gesture direction. At this time, the second sensing unit such as the main camera of the first device is turned on, and the user makes the same "push forward" gesture again, the camera can accurately capture the gesture, and also accurately recognize the spatial position information of the gesture, more accurately confirm the transmission intention, and automatically send the currently browsed photo to the second device. In this way, the user only needs to remember one gesture, and the operation process is simple and intuitive. The first sensing unit can also collect the first feature as the second feature, and the second sensing unit can accurately recognize.

[0073] In the case where the first feature and the second feature are different, for example, the user is working on a notebook computer (the second device) and needs to paste a text on a tablet computer (the first device) into a document. The tablet computer is in the first state. The user looks at the tablet and waves his hand (the first feature) to attract the attention of the tablet. The low-power camera of the tablet recognizes the waving action (i.e., the first feature satisfies the first condition). The tablet is woken up to the second state and establishes a connection with the notebook computer. The main camera of the tablet is turned on. The user selects a text on the tablet with his finger (i.e., the second feature, which is different from the previous "wave"). The camera accurately recognizes the selection action and range. The tablet determines the selected text segment as the to-be-transmitted object. The user then points his finger at the insertion point in the notebook computer document (this action can be regarded as a continuation of the second feature or another second feature). The camera of the notebook computer recognizes the pointing position. Finally, the text is transmitted from the tablet to the specified position in the notebook computer document.

[0074] In another embodiment, the first feature and the second feature can be facial features or voice features of the user.

[0075] The information transmission method provided in the embodiments of the present application reduces the standby power consumption of the device and prolongs the endurance time of the device by the low-power consumption operation of the first sensing unit and the first state of the first device. The device is switched to the second state only when the user operation intention is identified, thereby avoiding the long-term operation of the high-power consumption component. In the embodiments of the present application, the device is woken up and the operation intention is determined through the identification of the first feature and the second feature, so that the user does not need to manually complete multiple operations such as device searching, pairing and path selection, thereby simplifying the interaction process and improving the interaction efficiency and user experience effect.

[0076] In some embodiments of the present application, after the first device is controlled to switch from the first state to the second state, the method further comprises: identifying a third feature of the target user based on the first sensing unit; if the third feature meets a communication connection establishment condition, establishing a communication connection between the first device and a second device corresponding to the third feature; and starting the second sensing unit.

[0077] The third feature refers to an operation feature of the target user for triggering the first device and the second device to establish a communication connection, such as the action of the user simultaneously knocking the first device and the second device, the action of the user's finger moving the first device to point to the second device, the sliding gesture between the two devices, etc. The third feature can also be that the second device knocks the first device, or the first device knocks the second device. After the first device is switched to the second state, the second sensing unit is not started yet, and the first sensing unit (such as a low-power consumption MIC or a TOF sensor) continues to collect the operation feature of the target user, and extracts the third feature used for pairing. For example, when the first sensing unit is a vibration sensor, if the user simultaneously knocks the first device and the second device, the vibration sensor of the first device collects the knocking vibration signal, and simultaneously receives the “knocking vibration feature” sent by the second device through the Bluetooth low energy (BLE) module, and the vibration features of the two are combined to determine the third feature. The processor compares the third feature with a pairing operation feature library, and if the communication connection establishment condition (such as the time difference of the vibration features being less than 100 ms and the frequencies being consistent) is met, the second device corresponding to the third feature is determined, and a preset communication protocol (such as Bluetooth or Wi-Fi) is started to establish a connection with the second device. After the connection is established, the processor sends a starting instruction to the second sensing unit to start the second sensing unit to identify the second feature.

[0078] If one device knocks another device, the first device and the second device can use the sensors (such as inertial measurement units IMUs) of both sides to respectively sense the motion of the self, and trigger a wireless communication protocol to complete the pairing and connection between the devices. In another embodiment, the first device can use a loudspeaker to emit an acoustic signal, and use a MIC to receive the signal attribute of the reflected signal to determine whether it is a knocking event.

[0079] The third feature in the embodiments of the present application can be the same as the first feature or different from the first feature. If the third feature is the same as the first feature, it indicates that the user uses the same gesture to continuously trigger the device wake-up and the second device selection. For example, after the device is woken up by the first knock, the user makes the same knock in the direction of the target device, and the system analyzes the spatial directivity of the ultrasonic or ToF signal generated by the knock to determine the second device and establish the connection. This processing mode has lower power consumption, because it does not need to start the high-power camera, and only the low-power sensing unit can complete the connection establishment, which is suitable for fast pairing scenarios with clear target. When the third feature is different from the first feature, the first device can determine whether to switch the first state to the second state based on the first feature, and then determine the corresponding second device according to the third feature to establish the communication connection with the second device, so that the possibility of false connection is reduced through different gesture features, which is suitable for complex environments with many surrounding devices that need to be accurately selected.

[0080] Further, the establishment of the communication connection between the first device and the second device corresponding to the third feature includes: in the case that there is at least one other device around the first device, analyzing the third feature to obtain spatial direction information corresponding to the third feature; determining the second device based on the spatial direction information; and establishing the communication connection between the first device and the second device.

[0081] The at least one other device around the first device can be a device that has been pre-paired with the first device or a device in a discoverable state. After the first device switches to the second state, it scans the surrounding environment through the communication module (such as Bluetooth or Wi-Fi), and if at least one other device is detected, the first sensing unit is started to collect the third feature, and the third feature is analyzed to extract the spatial direction information. For example, when the third feature is the user's gesture of "pointing from the first device to a certain direction" with the finger, the first sensing unit can collect the trajectory data of the gesture to determine the spatial direction information. The first device obtains the position information of all other devices around it, compares the position information of each other device with the spatial direction information of the third feature, and screens out the device with matching position as the second device. Subsequently, the first device sends a connection request (such as containing the device identifier and encryption information of the first device) to the determined second device, and the second device receives the request and verifies it, and returns a connection response signal, and the first device completes the establishment of the communication link based on the response signal. In this way, the accurate device to be connected can be determined based on the direction information of the third feature, and the accuracy of information transmission is improved.

[0082] In another implementation of the embodiments of the present application, after the first device is controlled to switch from the first state to the second state, the second sensing unit is started to enable the second characteristic of the target user to be recognized by the second sensing unit; and in a case where the second characteristic meets a second condition, a communication connection between the first device and a second device corresponding to the second characteristic is established.

[0083] In this implementation, the starting time of the second sensing unit is earlier than the communication connection establishment time, and the second characteristic is used not only to determine the association area but also to determine the second device. After the first device switches to the second state, the processor directly starts the second sensing unit (such as a high-definition camera), the second sensing unit collects the dynamic operation image of the target user, and extracts the second characteristic (such as the trajectory of the user's finger pointing to another tablet computer on the desktop from the first device). The processor compares the second characteristic with the "operation intention feature library", and if the second condition (such as complete trajectory and clear pointing) is met, the second device in the surrounding area is located based on the spatial position information (such as the trajectory end point coordinates) in the second characteristic, and then the communication protocol is started to establish a connection with the second device.

[0084] In the embodiments of the present application, the first characteristic of the target user recognized based on the first sensing unit includes at least one of the following:

[0085] (1) An ultrasonic feature of a first predetermined mode is recognized based on the echo signal received by the first sensing unit, and the ultrasonic feature of the first predetermined mode represents the first characteristic.

[0086] The first sensing unit can be an ultrasonic MIC unit, and the first sensing unit receives an ultrasonic detection signal (such as a frequency of 25 kHz and a power of 1 mW) at a preset period (such as 1 Hz) in the first state, wherein the ultrasonic detection signal can be transmitted by a loudspeaker, and the signal propagates within a range of 1 meter in front of the device. The first sensing unit can also include a loudspeaker unit. If the hand of the target user enters the range, the ultrasonic signal is reflected after encountering the hand to form an echo signal, which is received by the ultrasonic MIC. The signal processing module of the first sensing unit amplifies, filters (removes environmental noise), and Fourier transforms (converts time domain signals to frequency domain signals) the echo signal, and extracts characteristic parameters (such as frequency offset, amplitude value, and duration) of the echo signal. If these parameters meet the first predetermined mode (such as a frequency offset of 80 Hz, an amplitude value greater than 0.5 V, and a duration of 1.2 seconds), the ultrasonic feature is determined as the first characteristic.

[0087] (2) A light pulse is emitted by the first sensing unit, and a contour feature of a second predetermined mode is recognized based on the received reflection signal, and the contour feature of the second predetermined mode represents the first characteristic

[0088] At this time, the first sensing unit can be a ToF sensor, which emits near-infrared light pulses at a preset period in the first state, and the light pulses cover a range of 0-2 meters in front of the device. If the target user's hand enters the range, the light pulses encounter the hand and are reflected to form a reflected signal, which is received by the receiver of the ToF sensor, the time of flight of the light pulses (the time difference from emission to reception) is calculated, and the distance between the hand and the sensor is calculated; at the same time, the two-dimensional contour image of the hand is collected through the pixel array of the sensor, and parameters such as the width, height, and shape of the contour are extracted. If the distance and contour parameters conform to a second predetermined mode, the contour feature is determined as the first feature.

[0089] (3) Collecting image information through the first sensing unit, and identifying a third image feature based on the image signal, the third image feature representing the first feature.

[0090] At this time, the first sensing unit can be a low-power image acquisition unit, such as an image acquisition unit integrated with a low-power CV-DSP module. The low-power image acquisition unit collects grayscale image signals in front of the device at a low frame rate in the first state, and the image data is directly transmitted to the integrated CV-DSP module. The CV-DSP module performs lightweight processing on each frame of image, such as first performing background modeling (establishing a background grayscale model when there is no user operation), then differentiating the current frame image from the background model, and extracting the region where the grayscale value changes by more than a preset threshold (i.e., the foreground region). If the area, shape, and motion characteristics of the foreground region conform to the predetermined mode of the third image feature, the image feature is determined as the first feature.

[0091] In some embodiments of the present application, the process of determining the associated region corresponding to the second feature includes: determining the mapping position of the spatial position information on the display interface of the device according to the spatial position information indicated by the second feature. In the case of the first device representing the sender, the user interface element at the mapping position on the display interface of the first device is determined as the associated region. In the case of the first device representing the receiver, the storage path corresponding to the region at the mapping position on the display interface of the first device is determined as the associated region.

[0092] The spatial position information indicated by the second feature refers to the spatial parameters contained in the second feature for indicating the position of the user operation, such as the starting point or ending point coordinates of the action trajectory of the second feature (such as the physical position relative to the first device, such as 50 mm from the left side of the device screen and 100 mm from the top), the center point coordinates of the gesture contour, etc. The mapping position refers to the conversion of the spatial position information of the second feature to the coordinate position of the display interface of the first device, such as the screen pixel coordinates, with the upper left corner of the screen as the origin, the X-axis to the right, and the Y-axis downward, to establish a corresponding relationship between the spatial operation and the interface position.

[0093] Referring to Figure 2It illustrates a scenario where the first device is the sender, according to an embodiment of this application. Figure 2 In this system, the first device is the information sender, and the second device is the information receiver. A target object is transmitted between the first and second devices. A second feature, such as a grab gesture from the target user, indicates the selection of the target object to be transmitted. The first device detects the spatial location information indicated by the grab gesture and determines the user interface element at the mapped location corresponding to that spatial location information. If a file icon for a meeting document (such as...) exists at that location... Figure 2 If the document is labeled "A", then the area corresponding to the file icon (including the icon and associated storage information) is identified as the associated area, and the meeting document A is selected as the target object to be transmitted. Then, the meeting document A is transmitted to the second device.

[0094] See Figure 3 It illustrates a scenario where the first device is the receiver, according to an embodiment of this application. Figure 3 In the first device, which is the information receiver, if the second feature represents a pointing gesture and represents the specified storage location of the target object in the first device, if the spatial location corresponding to the pointing gesture is detected to be folder B on the display interface of the first device, then the associated storage path of folder B can be determined as the associated area, and then the target object sent by the second device, such as document C, is transmitted to the first device and stored in folder B.

[0095] Further, in this embodiment, controlling the transmission of the target object between the first device and the second device includes: sending the target object to the second device when the first device represents the sender; and receiving the target object sent by the second device and storing the target object in the storage path corresponding to the associated area when the first device represents the receiver. For example, a user is browsing photos on a mobile phone (first device, sender) and wants to transfer the selected photo to a tablet computer (second device, receiver) for editing. Sender (mobile phone) operation: The user makes a "pinch and toss" gesture towards the photo icon on the mobile phone screen. After recognizing this gesture, the system sends the target object (i.e., the photo file) to the second device (i.e., the tablet computer). Receiver (tablet computer) operation: The user's gesture points to the icon of the drawing application on the tablet. The tablet computer system recognizes this pointing gesture and determines the associated area (i.e., the work area of ​​the drawing application). Upon receiving the photo from the mobile phone, the tablet computer stores the target object in the storage path corresponding to the associated area and automatically opens the photo in the drawing application for editing.

[0096] In the embodiments of the present application, the user gesture can be associated with the interface element or the storage path through the spatial position mapping corresponding to the second feature, ensuring that the associated region conforms to the user's operation intention, such as selecting which object when the user points to which icon, storing to which path when the user points to which folder, thereby improving the interaction accuracy and convenience, and improving the user experience effect.

[0097] Further, in the case that the first device represents the sender, the type of the user interface element at the mapping position on the display interface of the first device is identified; based on the type, the target object to be transmitted is determined.

[0098] The type of the user interface element refers to the category of the element at the mapping position on the display interface of the first device, including: a single file type, such as a document file, a picture file, a video file, etc., having a unique file identifier and a storage path; a folder type, such as a directory containing multiple sub-files or sub-folders, having a directory storage path; a text type, such as a text box, a memo, a text segment in a web page, containing editable or copyable text content; an application type, such as an application icon, corresponding to specific data generated by the application, such as a screenshot, a cache file, etc. Then, according to the type of the interface element, the corresponding logic is used to extract or select the target object to be transmitted, ensuring that the target object conforms to the user's operation intention. Figure 1 .

[0099] For example, after the notebook computer enters the first state, the first sensing unit (such as an ultrasonic MIC) identifies the first feature (such as a hand echo), and switches to the second state. The second sensing unit (such as a high-definition camera) is started, the user makes a gesture of "pointing to the text of the browser web page", and determines that the associated region is the text element. The interface element type is identified as "text type", and the web page text content such as "2024 Technology Exhibition Time Schedule..." is obtained, which has a total of 1500 characters. The notebook computer screen prompts "Please select the text segment", and the user selects the first 300 characters in front of the screen through the gesture, and determines the segment as the target object. Then, the notebook computer establishes an NFC connection with the tablet, and sends the text segment to the memo application of the tablet, and the transmission is completed. In the embodiments of the present application, the target object to be transmitted can be accurately determined based on the type of the interface element, thereby improving the transmission accuracy.

[0100] In the embodiments of the present application, in the case that the first device represents the sender, the first instruction is sent to the second device based on the communication connection established between the first device and the second device, so that the second device starts the corresponding sensing unit based on the first instruction, and determines the storage area of the target object based on the sensing unit.

[0101] The first instruction is an instruction sent by the first device as a sender to the second device as a receiver, which is used to trigger the second device to start its sensing unit, such as an instruction to start an image acquisition unit, and further includes an instruction to start a communication unit, a processing unit, and a network unit, so that the second device can further process the target object after receiving the transmitted target object, and improve the efficiency of collaborative processing.

[0102] In the case that the first device represents the receiver, in response to the first device receiving the target object, the second instruction is sent to the second device, so that the second device closes the corresponding sensing unit based on the second instruction. The second instruction is an instruction for triggering the second device to close the started sensing unit, which is used to reduce the power consumption of the second device. For example, after the first device (receiver) establishes a communication connection with the second device, the first device receives the target object data packet sent by the second device through the communication connection, and decrypts, decompresses and integrity verifies (such as MD5 verification) the data packet. If the target object is received and verified, the processor of the first device generates the second instruction, such as the instruction content including “instruction type: close sensing; sensing unit identifier: camera 0 (image acquisition unit of the second device)”. The first device sends the second instruction to the second device through the communication connection. After the second device receives the second instruction, the instruction content is parsed to confirm the legality of the instruction, and then the sensing unit specified in the instruction (such as camera 0) is closed, and the sensing unit is switched from the working state to the sleep state to reduce the power consumption of the second device. The second device sends a confirmation signal “sensing unit has been closed” to the first device, and the first device receives the confirmation signal and selectively closes the second sensing unit of the first device and switches back to the first state.

[0103] In the embodiments of the present application, when the first device is the sender, the first instruction ensures that the second device starts the sensing unit before receiving, determines the storage area in advance, and avoids transmission delay caused by the second device not being ready; when the first device is the receiver, the second instruction ensures that the second device closes the sensing unit in time after the transmission is completed, and avoids invalid power consumption.

[0104] In the embodiments of the present application, the information transmission method further includes: in response to the second feature not satisfying the second condition, controlling the first device to switch back to the first state from the second state. The second feature not satisfying the second condition means that the second feature fails to match the preset “operation intention feature library” (such as a matching degree lower than 90%), the second feature action is incomplete (such as a grabbing gesture only completing “opening” and not completing “closing”), and the second feature is not identified within a preset time period (such as no valid gesture within 10 seconds after starting the second sensing unit), which represents that the user has no valid transmission intention or operation error. Based on this, the first device is switched back to the first state with lower power consumption, so as to reduce the power consumption of the first device.

[0105] Referring to Figure 4Fig. 1 shows an application scenario of cross-device file transmission provided by an embodiment of the present application. In the application scenario, a first device such as a computer has only one second device around it, and a first sensing unit (i.e. a low-power sensing unit) can be started when the first device and the second device are paired, to perform low-power sensing and preliminary detection on the surrounding environment and user operation. When the first sensing unit detects a trigger signal meeting a preset condition, such as detecting a user's hand approaching, a second sensing unit (such as a high-definition camera) is started. Then, the user performs a light touch operation, and the computer starts a visual processing algorithm to determine the hand condition. If the algorithm determines that the user's hand is detected, the camera is started at the same time of device pairing. In 20 seconds, the hand is captured in the state of unfolding from the collected images, and then the computer screen matches the corresponding file area according to the position of the hand. After that, the hand action changes from unfolding to pinching, and the target file in the corresponding area is captured and then transmitted to another device such as a mobile phone. When the system detects the pinching action of the hand, the file is delivered to the mobile phone when the hand action changes from pinching to releasing. If the user does not have a clear gesture for the mobile phone, the file can be sent to a default location, and if there is a clear gesture for the mobile phone, the file can be sent to the area corresponding to the gesture. Finally, the file transmission is completed, and the high-power camera of the computer is turned off to reduce its power consumption.

[0106] In the embodiments of the present application, a first device is also provided, referring to Figure 5 The electronic device includes:

[0107] a first sensing unit 501, a second sensing unit 502, a memory 503, and a processor 504. The memory 503 is configured to store an application program and data generated by running of the application program; and the processor 504 is configured to execute the application program to implement:

[0108] In a case where the first device is in a first state, a first feature of a target user is identified based on the first sensing unit;

[0109] In a case where the first feature meets a first condition, the first device is controlled to switch from the first state to a second state; wherein a first power consumption of the first device in the first state is less than a second power consumption of the first device in the second state;

[0110] a second feature of the target user is identified based on the second sensing unit; and a second working power consumption of the second sensing unit is greater than a first working power consumption of the first sensing unit;

[0111] In response to the second feature satisfying a second condition and the first device and the second device establishing a communication connection, determine an association area corresponding to the second feature; the association area is used for associating a target object to be transmitted;

[0112] Control transmission of the target object between the first device and the second device.

[0113] Optionally, after controlling the first device to switch from the first state to a second state, further comprising:

[0114] Identify a third feature of the target user based on the first sensing unit;

[0115] If the third feature satisfies a communication connection establishment condition, establish a communication connection between the first device and a second device corresponding to the third feature;

[0116] Start a second sensing unit;

[0117] Alternatively, after controlling the first device to switch from the first state to a second state, start the second sensing unit to enable the second sensing unit to identify a second feature of the target user;

[0118] In a case where the second feature satisfies a second condition, establish a communication connection between the first device and a second device corresponding to the second feature.

[0119] Optionally, the establishing of the communication connection between the first device and the second device corresponding to the third feature comprises:

[0120] In a case where there is at least one other device around the first device, parse the third feature to obtain spatial direction information corresponding to the third feature;

[0121] Based on the spatial direction information, determine a second device;

[0122] Establish a communication connection between the first device and the second device.

[0123] Optionally, the identifying of the first feature of the target user by the first sensing unit comprises at least one of:

[0124] Identify an ultrasonic feature of a first predetermined pattern through an echo signal received by the first sensing unit, the ultrasonic feature of the first predetermined pattern representing the first feature;

[0125] Emit a light pulse through the first sensing unit, and identify a contour feature of a second predetermined pattern based on a received reflection signal, the contour feature of the second predetermined pattern representing the first feature;

[0126] The first sensing unit collects an image signal, and a third image feature is identified based on the image signal, the third image feature representing the first feature.

[0127] Optionally, the determining the associated region corresponding to the second feature comprises:

[0128] According to the spatial position information indicated by the second feature, a mapping position of the spatial position information on a display interface of the device is determined.

[0129] In the case that the first device represents a sender, a user interface element at the mapping position on the display interface of the first device is determined as the associated region.

[0130] In the case that the first device represents a receiver, a storage path corresponding to a region at the mapping position on the display interface of the first device is determined as the associated region.

[0131] Optionally, the method further comprises:

[0132] In the case that the first device represents a sender, a type of the user interface element at the mapping position on the display interface of the first device is identified.

[0133] Based on the type, a target object to be transmitted is determined.

[0134] Optionally, the method further comprises:

[0135] In the case that the first device represents a sender, a first instruction is sent to the second device based on a communication connection established between the first device and the second device, so that the second device starts a corresponding sensing unit based on the first instruction, and determines a storage region of a target object based on the sensing unit.

[0136] In the case that the first device represents a receiver, in response to the first device receiving the target object, a second instruction is sent to the second device, so that the second device closes the corresponding sensing unit based on the second instruction.

[0137] Optionally, the controlling the transmission of the target object between the first device and the second device comprises:

[0138] In the case that the first device represents a sender, the target object is sent to the second device.

[0139] In the case that the first device represents a receiver, the target object sent by the second device is received, and the target object is stored in a storage path corresponding to the associated region.

[0140] Optionally, the method further comprises:

[0141] In response to the second feature not satisfying the second condition, controlling the first device to switch from the second state back to the first state.

[0142] In another embodiment of the present application, a readable storage medium is also provided, and the readable storage medium has a computer program stored thereon. The computer program is executed by a processor to implement the information transmission method as described above.

[0143] It should be noted that the specific implementation of the processor in this embodiment can refer to the corresponding content in the foregoing, which will not be described in detail here.

[0144] The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the difference from other embodiments. The same or similar parts between the various embodiments can be referred to each other. For the device disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple, and the related parts can be referred to the method part.

[0145] The skilled person can further realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware, computer software or a combination of the two. In order to clearly show the interchangeability of hardware and software, the components and steps of the examples have been described in the above description. Whether the functions are realized by hardware or software depends on the specific application and design constraints of the technical solution. The skilled person can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0146] The steps of the method or algorithm described in combination with the embodiments disclosed herein can be directly implemented by hardware, a software module executed by a processor, or a combination of the two. The software module can be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0147] The above description of the disclosed embodiments enables a person skilled in the art to implement or use the present application. Various modifications to the embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An information transmission method, applied to a first device, comprising: When the first device is in the first state, the first feature of the target user is identified based on the first sensing unit; When the first feature satisfies the first condition, the first device is controlled to switch from the first state to the second state; wherein the first power consumption of the first device in the first state is less than the second power consumption of the first device in the second state. The second feature of the target user is identified based on the second sensing unit; the second operating power consumption of the second sensing unit is greater than the first operating power consumption of the first sensing unit. In response to the second feature satisfying the second condition and the first device and the second device establishing a communication connection, an associated region corresponding to the second feature is determined; the associated region is used to associate the target object to be transmitted. Control the transmission of the target object between the first device and the second device.

2. The method according to claim 1, further comprising, after controlling the first device to switch from the first state to the second state: The third feature of the target user is identified based on the first sensing unit; If the third feature satisfies the communication connection establishment condition, a communication connection is established between the first device and the second device corresponding to the third feature; Activate the second sensing unit; Alternatively, after controlling the first device to switch from the first state to the second state, the second sensing unit is activated so that the second feature of the target user can be identified through the second sensing unit; If the second feature satisfies the second condition, a communication connection is established between the first device and the second device corresponding to the second feature.

3. The method according to claim 2, wherein establishing a communication connection between the first device and the second device corresponding to the third feature comprises: In the case that there is at least one other device around the first device, the third feature is parsed to obtain the spatial pointing information corresponding to the third feature; Based on the spatial orientation information, the second device is determined; Establish a communication connection between the first device and the second device.

4. The method according to claim 1, wherein the first feature of the target user identified based on the first sensing unit includes at least one of the following: The echo signal received by the first sensing unit identifies the ultrasonic features of the first predetermined pattern, and the ultrasonic features of the first predetermined pattern characterize the first feature. The first sensing unit emits light pulses, and the contour features of the second predetermined pattern are identified based on the received reflected signals. The contour features of the second predetermined pattern characterize the first feature. Image signals are acquired through a first sensing unit, and a third image feature is identified based on the image signals. The third image feature represents the first feature.

5. The method according to claim 1, wherein determining the associated region corresponding to the second feature includes: Based on the spatial location information indicated by the second feature, determine the mapping position of the spatial location information on the device display interface; When the first device represents the sender, the user interface element whose mapping location is on the display interface of the first device is determined as the associated area; When the first device represents the receiver, the storage path corresponding to the area where the mapping location is located on the display interface of the first device is determined as the associated area.

6. The method according to claim 5, further comprising: When the first device represents the sender, identify the type of the user interface element on the display interface of the first device where the mapping location is located; Based on the type, the target object to be transmitted is determined.

7. The method according to claim 5, further comprising: When the first device represents the sender, based on the communication connection established between the first device and the second device, a first instruction is sent to the second device, so that the second device can activate the corresponding sensing unit based on the first instruction and determine the storage area of ​​the target object based on the sensing unit; When the first device represents the receiver, in response to the first device receiving the target object, a second instruction is sent to the second device, causing the second device to shut down the corresponding sensing unit based on the second instruction.

8. The method according to claim 5, wherein controlling the target object to be transmitted between the first device and the second device comprises: If the first device represents the sender, the target object is sent to the second device; When the first device represents the receiver, the target object sent by the second device is received, and the target object is stored in the storage path corresponding to the associated area.

9. The method according to claim 1, further comprising: In response to the second feature not satisfying the second condition, the first device is controlled to switch back from the second state to the first state.

10. A first device, comprising: The system comprises a first sensing unit, a second sensing unit, a memory, and a processor. The memory is used to store the application and the data generated by the application during its operation; The processor is configured to execute the application program to achieve: When the first device is in the first state, the first feature of the target user is identified based on the first sensing unit; When the first feature satisfies the first condition, the first device is controlled to switch from the first state to the second state; wherein the first power consumption of the first device in the first state is less than the second power consumption of the first device in the second state. The second feature of the target user is identified based on the second sensing unit; the second operating power consumption of the second sensing unit is greater than the first operating power consumption of the first sensing unit. In response to the second feature satisfying the second condition and the first device and the second device establishing a communication connection, an associated region corresponding to the second feature is determined; the associated region is used to associate the target object to be transmitted. Control the transmission of the target object between the first device and the second device.

Images